De-duplicate by email workaround | Community
Skip to main content
Level 2
November 14, 2022
Solved

De-duplicate by email workaround

  • November 14, 2022
  • 3 replies
  • 3978 views

Hi! Since there is no option to de-duplicate by email in journeys, is there a workaround to achieve this with for example segments or condition (functions) in a journey? Thanks! 

Best answer by Pradeep_Kumar_Srivastav

Hi @maurip , This is what I heard from Adobe Product team on similar question when asked in July.

 

• Audience Portal / Orchestration will enable users to perform a series of operations (query, union, enrichment, deduplication etc.) on the data to create one or multiple personalized audiences that can be activated by the Journey canvas -> Aiming for Sept ‘22 release (Deduplication will not be part of the initial release of this feature)
• In subsequent / follow-up release, Deduplication will enable users to remove “duplicate” records based off a selected attribute/identity -> Aiming for Q1 ’23 release

 

Hope this helps.

 

Thanks!

3 replies

Anuhya-Y
Community Advisor
Community Advisor
November 14, 2022

@maurip I believe email is used as an identifier at schema level in your system. If yes, there won’t be any duplicate profiles in system(don’t get confused with profile fragments with unified profile). So, no need of de-duplication activity in AJO as there won't be any duplicate profiles. 

 

Could you please share more details around how duplicate profiles exists with same email? what is the identifier used in schemas while generating these duplicate profiles.

MauriPAuthor
Level 2
November 14, 2022

Thanks for the reply!

 

Email is not used as an identifier in our system, hence the need for de-duplication.

 

Primary identifier is an ID generated in CRM. In addition to that, couple of other IDs generated in different source systems.

 

Email cannot be used as an identifier because some customers share an email address (usually family members in B2C). Also, many B2B customers use shared email address. Sending multiple emails to same email address is not an issue if the email is personalized. However, there is a need to send informational emails without personalization.

Pradeep_Kumar_Srivastav
Community Advisor
Pradeep_Kumar_SrivastavCommunity AdvisorAccepted solution
Community Advisor
November 14, 2022

Hi @maurip , This is what I heard from Adobe Product team on similar question when asked in July.

 

• Audience Portal / Orchestration will enable users to perform a series of operations (query, union, enrichment, deduplication etc.) on the data to create one or multiple personalized audiences that can be activated by the Journey canvas -> Aiming for Sept ‘22 release (Deduplication will not be part of the initial release of this feature)
• In subsequent / follow-up release, Deduplication will enable users to remove “duplicate” records based off a selected attribute/identity -> Aiming for Q1 ’23 release

 

Hope this helps.

 

Thanks!

Zahid_14
Level 2
September 9, 2023

Dear @pradeep_kumar_srivastav, @maurip and @anuhya-y 

Do you know if there is any update on this topic? I have a same situation here. Do you think we can use composition function of audience for this? 

Anuhya-Y
Community Advisor
Community Advisor
September 11, 2023

@zahid_14 

Could you please share more details around how duplicate profiles exists with same email? what is the identifier used in schemas while generating these duplicate profiles. If email is not an identifier, email filed/attribute can hold only one email according to the merge policy.

 

However, think on the lines of excluding duplicates profile audience/segment from the main/required segment. https://experienceleague.adobe.com/docs/experience-platform/segmentation/ui/audience-composition.html?lang=en#exclude-block 

January 8, 2025

Is there a solution for this yet? the exclude in audience composition does not work for this.

 

Thanks