Duration of keeping files on storage or memory after data ingestion

[vikramrai]

Hi , 

How long does Adobe AEP keep data file that are being ingested in memory. e.g. when we ingest .csv file where does the file go and how does it get archived the moment data is being transferred to Data lake 

@adobechat @adobe 

Thank you 

Vikram 

[Anil_Umachigi]

@vikramrai The CSV/file is not stored, assuming you doing this via UI? 

if you follow the steps which ends is successful ingestion of data, the data now resides in the dataset. 

[jayakrishnaaparthasarathy · Accepted solution]

Hi @vikramrai  - Adobe uses catalog service, Catalog Service is the system of record for data location and lineage within Adobe Experience Platform. While all data that is ingested into Experience Platform is stored in the Data Lake as files and directories, Catalog holds the metadata and description of those files and directories for lookup and monitoring purposes.

Hope this answered your question.

Read more here - https://experienceleague.adobe.com/docs/experience-platform/catalog/home.html?lang=en 

Thank you,

Jay.