The files are not being picked up, even though the dataflow is running and showing a successful status.

[Tejasvi_mudumala]

Hi Adobe,

We have a source connection to Azure Blob, and the dataflow initially failed with the error "failed to copy data from source." Since then, the dataflow has been running every hour. Although there are files present in the Azure Blob, the dataflow runs without picking up the files, but the status still shows as success.

Could you please assist with this issue?

[Parvesh_Parmar · Accepted solution]

Hello @Tejasvi_mudumala ,

I assume your connection is set up correctly and working — meaning, during the source connector setup, you were able to access the folder and files.

Still, feel free to double-check each step as described here:
Configure a Dataflow to Ingest Batch Data from a Cloud Storage Source in the UI | Adobe Experience P...

Now, if the files are present but the data hasn’t been loaded, I believe you’ve already verified that no records were ingested into the dataset.

Please cross-check that all files coming into the folder have the same structure — such as file type, number of columns, column order, etc. — as defined during the connection setup.

One more tip: you could try creating a new connection from scratch.
Sometimes that’s the easiest way to resolve such issues.

Hope this helps.

Kind regards,
Parvesh

[kautuk_sahni]

@Tejasvi_mudumala Just checking in — were you able to resolve your issue?
We’d love to hear how things worked out. If the suggestions above helped, marking a response as correct can guide others with similar questions. And if you found another solution, feel free to share it — your insights could really benefit the community. Thanks again for being part of the conversation!