Ignoring records that are duplicate | Community
Skip to main content
Level 3
April 19, 2021
Solved

Ignoring records that are duplicate

  • April 19, 2021
  • 1 reply
  • 1204 views

Hi Everyone,

 

Is there any way to ignore the duplicate records from the qualifying base using the deduplication activity. I have a requirement where in I have to discard the records that are duplicate in the file rather than selecting any of them.

 

Thanks

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by Jonathon_wodnicki

Hi,

 

That is what the deduplication activity is intended to do.

Put it after file ingest to remove undesired duplicates from working table.

 

Thanks,

-Jon

1 reply

Jonathon_wodnicki
Community Advisor
Jonathon_wodnickiCommunity AdvisorAccepted solution
Community Advisor
April 20, 2021

Hi,

 

That is what the deduplication activity is intended to do.

Put it after file ingest to remove undesired duplicates from working table.

 

Thanks,

-Jon

Level 2
February 22, 2022

my question is though, once you do that does it not still only give you 1 of those duplicate records?
How do you remove all duplicate records?

ex. you have 2 records with the same email address but you don't want to send to anyone that has duplicated records?