The files are not being picked up, even though the dataflow is running and showing a successful status. | Community
Skip to main content
June 12, 2025
Solved

The files are not being picked up, even though the dataflow is running and showing a successful status.

  • June 12, 2025
  • 2 replies
  • 632 views

Hi Adobe,

We have a source connection to Azure Blob, and the dataflow initially failed with the error "failed to copy data from source." Since then, the dataflow has been running every hour. Although there are files present in the Azure Blob, the dataflow runs without picking up the files, but the status still shows as success.

Could you please assist with this issue?

Best answer by Parvesh_Parmar

Hello @tejasvi_mudumala ,

 

I assume your connection is set up correctly and working — meaning, during the source connector setup, you were able to access the folder and files.

Still, feel free to double-check each step as described here:
Configure a Dataflow to Ingest Batch Data from a Cloud Storage Source in the UI | Adobe Experience Platform

Now, if the files are present but the data hasn’t been loaded, I believe you’ve already verified that no records were ingested into the dataset.

Please cross-check that all files coming into the folder have the same structure — such as file type, number of columns, column order, etc. — as defined during the connection setup.

One more tip: you could try creating a new connection from scratch.
Sometimes that’s the easiest way to resolve such issues.

Hope this helps.

Kind regards,
Parvesh

2 replies

Parvesh_Parmar
Community Advisor
Parvesh_ParmarCommunity AdvisorAccepted solution
Community Advisor
June 13, 2025

Hello @tejasvi_mudumala ,

 

I assume your connection is set up correctly and working — meaning, during the source connector setup, you were able to access the folder and files.

Still, feel free to double-check each step as described here:
Configure a Dataflow to Ingest Batch Data from a Cloud Storage Source in the UI | Adobe Experience Platform

Now, if the files are present but the data hasn’t been loaded, I believe you’ve already verified that no records were ingested into the dataset.

Please cross-check that all files coming into the folder have the same structure — such as file type, number of columns, column order, etc. — as defined during the connection setup.

One more tip: you could try creating a new connection from scratch.
Sometimes that’s the easiest way to resolve such issues.

Hope this helps.

Kind regards,
Parvesh

Parvesh Parmar – Adobe Community Advisor https://www.linkedin.com/in/parvesh-parmar/
kautuk_sahni
Community Manager
Community Manager
June 26, 2025

@tejasvi_mudumala Just checking in — were you able to resolve your issue?
We’d love to hear how things worked out. If the suggestions above helped, marking a response as correct can guide others with similar questions. And if you found another solution, feel free to share it — your insights could really benefit the community. Thanks again for being part of the conversation!

Kautuk Sahni