Data Ingestion help

[vs1985]

I have a few questions regarding the data ingestion , when we upload the data to the AEP in the form of csv file and lets say it has duplicate records , so how does AEP detects , if not then how that can be done.

[birthariyamayank]

Hi,

The process will ingest all the records to data lake without any de-duplication.

Against the profile store, this depends on the type of schema you are using for ingesting data.

The Profile Record data any duplicate will replace the old record.(In the mentioned case, I am not sure which record will be picked by Profile store but there will just a single record)

For Experience Event, based on same_id profile store will reject the latest record from Profile Store.

Thanks!