Your achievements

Level 1

0% to

Level 2

Tip /
Sign in

Sign in to Community

to gain points, level up, and earn exciting badges like the new
BedrockMission!

Learn More

View all

Sign in to view all badges

Ignoring records that are duplicate

Avatar

Avatar
Level 1
ratika
Level 1

Likes

0 likes

Total Posts

2 posts

Correct Reply

0 solutions
View profile

Avatar
Level 1
ratika
Level 1

Likes

0 likes

Total Posts

2 posts

Correct Reply

0 solutions
View profile
ratika
Level 1

19-04-2021

Hi Everyone,

 

Is there any way to ignore the duplicate records from the qualifying base using the deduplication activity. I have a requirement where in I have to discard the records that are duplicate in the file rather than selecting any of them.

 

Thanks

Accepted Solutions (1)

Accepted Solutions (1)

Avatar

Avatar
Establish
MVP
wodnicki
MVP

Likes

961 likes

Total Posts

1,090 posts

Correct Reply

509 solutions
Top badges earned
Establish
Affirm 500
Contributor
Shape 1
Give Back 100
View profile

Avatar
Establish
MVP
wodnicki
MVP

Likes

961 likes

Total Posts

1,090 posts

Correct Reply

509 solutions
Top badges earned
Establish
Affirm 500
Contributor
Shape 1
Give Back 100
View profile
wodnicki
MVP

19-04-2021

Hi,

 

That is what the deduplication activity is intended to do.

Put it after file ingest to remove undesired duplicates from working table.

 

Thanks,

-Jon

Answers (0)