Sign in to Community
Sign in to view all badges
Is there any way to ignore the duplicate records from the qualifying base using the deduplication activity. I have a requirement where in I have to discard the records that are duplicate in the file rather than selecting any of them.
That is what the deduplication activity is intended to do.
Put it after file ingest to remove undesired duplicates from working table.