Your achievements

Level 1

0% to

Level 2

Tip /
Sign in

Sign in to Community

to gain points, level up, and earn exciting badges like the new
Bedrock Mission!

Learn more

View all

Sign in to view all badges

SOLVED

Ignoring records that are duplicate

Avatar

Level 2

Hi Everyone,

 

Is there any way to ignore the duplicate records from the qualifying base using the deduplication activity. I have a requirement where in I have to discard the records that are duplicate in the file rather than selecting any of them.

 

Thanks

1 Accepted Solution

Avatar

Correct answer by
Community Advisor

Hi,

 

That is what the deduplication activity is intended to do.

Put it after file ingest to remove undesired duplicates from working table.

 

Thanks,

-Jon

View solution in original post

2 Replies

Avatar

Correct answer by
Community Advisor

Hi,

 

That is what the deduplication activity is intended to do.

Put it after file ingest to remove undesired duplicates from working table.

 

Thanks,

-Jon

Avatar

Level 1

my question is though, once you do that does it not still only give you 1 of those duplicate records?
How do you remove all duplicate records?

ex. you have 2 records with the same email address but you don't want to send to anyone that has duplicated records?