Data flow run on demand | Community
Skip to main content
G
GabrielaNa1
Level 3
July 1, 2025
Solved

Data flow run on demand

  • July 1, 2025
  • 2 replies
  • 412 views

I would like to run on demand a data flow for a specific source. I checked this documentation: On-demand Ingestion for Sources Dataflows In The UI | Adobe Experience Platform

These are the parameters required for running on demand. 

 

Ingestion start time - The scheduled time of when the on-demand flow run will begin.
Date range start time - The earliest date and time that data will be retrieved from.
Date range end time - The date and time that data will be retrieved up to.

 

Below, what date is that which must be selected for "Date range start time" and "Date range end time" parameters? The wording in the documentation is very unclear. 

This is an SFTP source, and the data resides in a certain csv file in the location (like MyFile.csv). The file is periodically overwritten by keeping the same name, and I want to import the new content, in full.

 

Any clarification will be highly appreciated.

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by KumarRishii

In AEP,  "Date range start time" and "end time" for on-demand ingestion refer to the file's last modified timestamp on the SFTP server — not the data inside the file.

Since your file (MyFile.csv) is periodically overwritten with the same name:

1) Set a date range that includes the file’s last modified time to ensure it's picked up.

2) If unsure, use a broad time window (e.g., last 1–2 days) to ensure inclusion.

For regular ingestion of an updated file, consider creating a recurring dataflow instead of using on-demand.

2 replies

KumarRishii
KumarRishiiAccepted solution
Level 5
July 2, 2025

In AEP,  "Date range start time" and "end time" for on-demand ingestion refer to the file's last modified timestamp on the SFTP server — not the data inside the file.

Since your file (MyFile.csv) is periodically overwritten with the same name:

1) Set a date range that includes the file’s last modified time to ensure it's picked up.

2) If unsure, use a broad time window (e.g., last 1–2 days) to ensure inclusion.

For regular ingestion of an updated file, consider creating a recurring dataflow instead of using on-demand.

    G
    GabrielaNa1Author
    Level 3
    July 9, 2025

    Thanks Kumar. I will try this. And for regular ingestion, yes, I am using a recurring flow. I use the run on demand just for out-of-the-ordinary run, when we need to push data into the Platform outside the regular schedule.

    kautuk_sahni
    Community Manager
    kautuk_sahniCommunity Manager
    Community Manager
    July 2, 2025

    @gabrielana1 Just checking in — were you able to resolve your issue?
    We’d love to hear how things worked out. If the suggestions above helped, marking a response as correct can guide others with similar questions. And if you found another solution, feel free to share it — your insights could really benefit the community. Thanks again for being part of the conversation!

    Kautuk Sahni
    Terms & ConditionsAccessibility statement

    Loading footer...