Check status of each file process by dataFlow if more than one file present in GCS bucket

[Pradeep-Jaiswal]

when there are multiple file present int he GCS bucket (file broken into parts by GCS team due to large size), the dataFlow only show overall status, but there is no way to find total how many file DataFlow has processed already and how many is pending to be processed. is it possible in UI or via API to find this ?

[AnkitJasani29]

Hi @Pradeep-Jaiswal ,

To my knowledge, both the UI and the API only report the overall run status; neither provides counts of files processed or pending.

Thanks,

Ankit

[arpan-garg · Accepted solution]

Hi @Pradeep-Jaiswal  -  You can go to monitoring dashboard in AEP and click on your account to see how the records were ingested and how many of them failed. However you can't see anything like pending records there