Need clarity - Deduplication in AEP to a destination | Community
Skip to main content
Level 3
November 28, 2023
Solved

Need clarity - Deduplication in AEP to a destination

  • November 28, 2023
  • 1 reply
  • 2130 views

Hello,

An confused with the data behaviour in AEP when Deduplication is set to a AEP destination. The deduplication is enabled on ownership-id and has multiple Profile records with same ownership-id imported in following order:

 

User 1

email: test@test.com | ownership-id: 999999999 | First Name: A-1 | Last Name: B-1 | Creation Date: 1/1/2022

User 2

email: test@test.com | ownership-id: 999999999 | First Name: A-2 | Last Name: B-2  |Creation Date: 2//2/2023

 

What is ideally expected from the data export to the destination? As per AEP docs (https://experienceleague.adobe.com/docs/experience-platform/destinations/ui/activate/activate-batch-profile-destinations.html?lang=en#deduplication-use-case-3), it should be "Profile 2 is the latest one that qualified for the audience, so it is the only one getting exported.". So I should get User 2 in the data export.

 

But, I see different results. Any reason for this behaviour? Appreciate any pointers.

 

Thanks!

 

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by abhinavbalooni

Yes, few are on different identities like email, CustomerID, phone etc coming from different systems. How should I tackle this scenario? 

 

I believe, I need to set secondary identities accordingly so that they get merged in Unified profile datalake before Segmentation picks up that data. Thoughts?

 


Hi @md__ajazan 

 

Yeah you should be defining these fields as identities, whether primary or secondary would depend on the system where the data comes from. For instance, data from CRM would have CRMId as a primary identity and then rest as identities.

 

You would also need to ensure that you have some form of a common identity across sources so that AEP knows that data coming from multiple sources belongs to one person and hence needs to be merged into one profile.

 

Hope the above helps.

 

Cheers.

1 reply

abhinavbalooni
Community Advisor
Community Advisor
November 28, 2023

Hey @md__ajazan 

 

When you say you observe different results, can you provide example of what you see at your end. Also, creation date above ? Is that the membership qualification time ? You need to look at the lastqualificationtime for the segment membership and not the creation date of the record highlighted above to see if User1 records should reflect or User2 records should get exported.

 

For eg., even though User2 was created more recently, if User1 qualifies for a segment on a later date (more recent) you are trying to export against, User1 record will get exported.

 

Hope the above helps.

 

Cheers,

Abhinav

abhinavbalooni
Community Advisor
Community Advisor
November 29, 2023

Hey @md__ajazan 

Did the above response help? Let me know if you need any further help.

 

Cheers,

Abhinav