AEP Schema Duplicate Records | Community
Skip to main content
December 22, 2023
Solved

AEP Schema Duplicate Records

  • December 22, 2023
  • 3 replies
  • 1621 views

Hi Team,

                   

I'm having trouble with AEP Schema. My question is this: I created a schema in AEP and inserted 50 records into it. Then I changed some values in the same file and inserted the record into the same schema, but it was not updated; instead, it was inserted into the same schema.

Is there any way to update the records?

 

 

SS for reference

 

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by BryanRek

Hello @jeeshan02 

 

When data is introduced into the Adobe RTCP platform the schema is the building blocks to collect data and a dataSet can be viewed as the pipeline to insert data into the schema. 

 

The data ingested will write into the unified profile store if the schema and dataSet are marked for profile.  Typically if updates are needed best practice is to create a new batch and re-insert the data.

 

Another option is to consider updating the dataSet for upsert functionality. This will allow for the updating of specific fields which are associated to an entity.

 

https://experienceleague.adobe.com/docs/experience-platform/catalog/datasets/enable-for-profile.html?lang=en

3 replies

BryanRek
Community Advisor
BryanRekCommunity AdvisorAccepted solution
Community Advisor
January 2, 2024

Hello @jeeshan02 

 

When data is introduced into the Adobe RTCP platform the schema is the building blocks to collect data and a dataSet can be viewed as the pipeline to insert data into the schema. 

 

The data ingested will write into the unified profile store if the schema and dataSet are marked for profile.  Typically if updates are needed best practice is to create a new batch and re-insert the data.

 

Another option is to consider updating the dataSet for upsert functionality. This will allow for the updating of specific fields which are associated to an entity.

 

https://experienceleague.adobe.com/docs/experience-platform/catalog/datasets/enable-for-profile.html?lang=en

arpan-garg
Community Advisor
Community Advisor
January 3, 2024

Hello @jeeshan02 ,

This is how AEP works, When you update data, a new entry is created in the dataset without replacing the old data. If the dataset was profile enabled, you will see the newly inserted data. If you wish to remove the old data for any reason, you can delete the dataset, create a new one, and then insert the updated data.

 

Even if you insert the same data again and again in the same dataset, a new entry will be added in the dataset for it. Old entry is never updated.

 

Best regards,

Arpan

NimashaJain
Adobe Employee
Adobe Employee
January 15, 2024

@jeeshan02 Did you find the suggestion solution helpful? It would be great if you can  mark the answer as correct for posterity. If you have found out solution yourself, share it with wider audience in the community.