Your achievements

Level 1

0% to

Level 2

Tip /
Sign in

Sign in to Community

to gain points, level up, and earn exciting badges like the new
BedrockMission!

Learn more

View all

Sign in to view all badges

SOLVED

Ignoring records that are duplicate

ratika
Level 2
Level 2

Hi Everyone,

 

Is there any way to ignore the duplicate records from the qualifying base using the deduplication activity. I have a requirement where in I have to discard the records that are duplicate in the file rather than selecting any of them.

 

Thanks

1 Accepted Solution
wodnicki
Correct answer by
Community Advisor
Community Advisor

Hi,

 

That is what the deduplication activity is intended to do.

Put it after file ingest to remove undesired duplicates from working table.

 

Thanks,

-Jon

View solution in original post

1 Reply
wodnicki
Correct answer by
Community Advisor
Community Advisor

Hi,

 

That is what the deduplication activity is intended to do.

Put it after file ingest to remove undesired duplicates from working table.

 

Thanks,

-Jon

View solution in original post