Deduplication of profile datasets in Query Service

[DuckAndChips]

How should I go about finding the most updated record of a profile in a profile dataset in Query Service. Like are there any built-in created-at timestamps? Query Service documentation tells us about how to do deduplication with ExperienceEvents, but not for Profile datasets. We are looking for something similar, so as to use the query results to do data analysis and find data issues, which is most feasible using the Query Service.

[arijitg]

Hi @DuckAndChips ,

Best practice is to use now() in data prep to capture ingestion timestamp (you can use OOTB Audit field group for that) and then query the latest record from data lake but there are no built-in created-at timestamps captured in data lake at the moment.

Regards,

Arijit Ghosh