Expand my Community achievements bar.

Marketo Engage Source connector, "sample dataflow" toggle button behavior for incremental data

Avatar

Level 4

 

using marketo engage source connector, creating a dataflow, there is a toggle button "sample dataflow". As per the documentation it says that this toggle button helps to restrict historical data and can be used for testing purposes. 

 

But is there any impact on handling incremental data with this toggle button. meaning does it restrict amount of data being processed incrementally when this toggle button is enabled?

2 Replies

Avatar

Level 6

@itsMeTechy There is no clear documentation of the expected behavior of the 'Sample Dataflow' toggle, it does seem like will restrict ingestion of historical backfill but what is the behavior on future ongoing data ingestion, will it be full data generated each day (in real-time) will be ingested or that will not be sampled is not clear. I would not use this feature for restricting historical backfill alone, as it is unclear of the expected behavior ongoing data, I use it only for testing purpose and ingest full Marketo data, if at all historical data is not needed I would delete those batches to remove them from Data Lake. 

Avatar

Level 6

@itsMeTechy I hope like or agree to my response to your question, please mark it as "Correct Answer" so it can help other community members as well.