Expand my Community achievements bar.

how to recognize if data is uploaded through Batch API vs Sources

Avatar

Level 10

How based on dataflows recognize if some data is ingested through Batch API and which one is ingested through Source Connectors? 

In the SFTP source connector I do not see dataset which I have some doubts about and that's why I suppose its batch API

Topics

Topics help categorize Community content and increase your ability to discover relevant content.

1 Reply

Avatar

Level 5

Hey Michael! If you don't have THAT many dataflows in your instance, you should be able to simply go to the monitoring tab and check your batch end to end and streaming end to end flows to find your dataset name. Once you've done that you can look at the source, which will point out the specific batch. If you don't get all the info that you need there, you can leverage the get batch information APIs to find the dataflow name. 

Let me know if the first method works for you, or if a step by step on the latter option would be helpful!

Best, 
Tyler Krause