Automatic removal of duplicates in Adobe Extracts

[Jess-H1]

Hello,

I was wondering if it's possible to create an extract through data warehouse that automatically removes the duplicated IDs. Here's an example below:

Date	ID	column 1	column 2
11/02/23	123	1	2
12/02/12	123	1	1

Final output:

Date	ID	column 1	column 2
12/02/12	123	1	1

Thank you!

[gautham_madala]

Not sure if I understand this right. 
So the reason you are seeing two rows because its unique per day. 
For instance, If I have a unique visitor id 123 and I visit on 1st day of the month and last day of the month. 
While reporting if you use day as dimension then I would be shown twice, one per day. 
However if you use month dimension then Ill be counted only once. 
Totally depends on what you are reporting. I dont think you can write a condition to say take the latest date of the ID. Would rather use raw data from Datalake extract and query it in databricks or something.
Let me know if you find any other alternatives Ill be happy to learn too.