Deduplication of profile datasets in Query Service | Community
Skip to main content
D
DuckAndChips
Level 2
September 20, 2023
Question

Deduplication of profile datasets in Query Service

  • September 20, 2023
  • 1 reply
  • 540 views

How should I go about finding the most updated record of a profile in a profile dataset in Query Service. Like are there any built-in created-at timestamps? Query Service documentation tells us about how to do deduplication with ExperienceEvents, but not for Profile datasets. We are looking for something similar, so as to use the query results to do data analysis and find data issues, which is most feasible using the Query Service.

    This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

    1 reply

    arijitg
    Adobe Employee
    arijitgAdobe Employee
    Adobe Employee
    October 10, 2023

    Hi @duckandchips ,

     

    Best practice is to use now() in data prep to capture ingestion timestamp (you can use OOTB Audit field group for that) and then query the latest record from data lake but there are no built-in created-at timestamps captured in data lake at the moment.

     

    Regards,

    Arijit Ghosh

    Terms & ConditionsAccessibility statement

    Loading footer...