Automatic removal of duplicates in Adobe Extracts

Question

Hello,

I was wondering if it's possible to create an extract through data warehouse that automatically removes the duplicated IDs. Here's an example below:

Date	ID	column 1	column 2
11/02/23	123	1	2
12/02/12	123	1	1

Final output:

Date	ID	column 1	column 2
12/02/12	123	1	1

Thank you!

gautham_madala · Answer

Not sure if I understand this right.
So the reason you are seeing two rows because its unique per day.
For instance, If I have a unique visitor id 123 and I visit on 1st day of the month and last day of the month.
While reporting if you use day as dimension then I would be shown twice, one per day.
However if you use month dimension then Ill be counted only once.
Totally depends on what you are reporting. I dont think you can write a condition to say take the latest date of the ID. Would rather use raw data from Datalake extract and query it in databricks or something.
Let me know if you find any other alternatives Ill be happy to learn too.

Inscrivez-vous

Login social

Bienvenue

Login social

Analyse virus du fichier

Ce fichier ne peut pas être téléchargé