Check status of each file process by dataFlow if more than one file present in GCS bucket | Community
Skip to main content
Pradeep-Jaiswal
Pradeep-Jaiswal
Level 5
July 9, 2025
Solved

Check status of each file process by dataFlow if more than one file present in GCS bucket

  • July 9, 2025
  • 2 replies
  • 302 views

when there are multiple file present int he GCS bucket (file broken into parts by GCS team due to large size), the dataFlow only show overall status, but there is no way to find total how many file DataFlow has processed already and how many is pending to be processed. is it possible in UI or via API to find this ?

Best answer by arpan-garg

Hi @pradeep-jaiswal  -  You can go to monitoring dashboard in AEP and click on your account to see how the records were ingested and how many of them failed. However you can't see anything like pending records there

2 replies

AnkitJasani29
AnkitJasani29
Level 6
July 14, 2025

Hi @pradeep-jaiswal ,

To my knowledge, both the UI and the API only report the overall run status; neither provides counts of files processed or pending.

Thanks,

Ankit

arpan-garg
Community Advisor
arpan-gargCommunity AdvisorAccepted solution
Community Advisor
July 15, 2025

Hi @pradeep-jaiswal  -  You can go to monitoring dashboard in AEP and click on your account to see how the records were ingested and how many of them failed. However you can't see anything like pending records there

Terms & ConditionsAccessibility statement

Loading footer...