Ignoring records that are duplicate

[ratika]

Hi Everyone,

Is there any way to ignore the duplicate records from the qualifying base using the deduplication activity. I have a requirement where in I have to discard the records that are duplicate in the file rather than selecting any of them.

Thanks

[Jonathon_wodnicki · Accepted solution]

Hi,

That is what the deduplication activity is intended to do.

Put it after file ingest to remove undesired duplicates from working table.

Thanks,

-Jon

[mditullio]

my question is though, once you do that does it not still only give you 1 of those duplicate records?
How do you remove all duplicate records?

ex. you have 2 records with the same email address but you don't want to send to anyone that has duplicated records?