Skip to main content
vs1985
Level 2
August 17, 2023
Solved

Data Ingestion help

I have a few questions regarding the data ingestion , when we upload the data to the AEP in the form of csv file and lets say it has duplicate records , so how does AEP detects , if not then how that can be done.

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
birthariyaAccepted solution
Level 3
August 21, 2023

Hi,

The process will ingest all the records to data lake without any de-duplication.

Against the profile store, this depends on the type of schema you are using for ingesting data.

The Profile Record data any duplicate will replace the old record.(In the mentioned case, I am not sure which record will be picked by Profile store but there will just a single record)

For Experience Event, based on same_id profile store will reject the latest record from Profile Store.

 

Thanks!

View in thread

1 reply

birthariyaAccepted solution
Level 3
August 21, 2023

Hi,

The process will ingest all the records to data lake without any de-duplication.

Against the profile store, this depends on the type of schema you are using for ingesting data.

The Profile Record data any duplicate will replace the old record.(In the mentioned case, I am not sure which record will be picked by Profile store but there will just a single record)

For Experience Event, based on same_id profile store will reject the latest record from Profile Store.

 

Thanks!

Translate
Terms & ConditionsAccessibility statement

Loading footer...