Follow Up Datalake Retention | Community
Skip to main content
DavidRoss91
Community Advisor
DavidRoss91Community Advisor
Community Advisor
September 16, 2024
Solved

Follow Up Datalake Retention

  • September 16, 2024
  • 2 replies
  • 830 views

Hello,

In reference to this post: Solved: AEP Data Lake Retention - Adobe Experience League Community - 679830

 

Can anyone here confidently confirm with documentation, that deletion of batches would only affect the profile store, and not data lake itself? I have a POC i'm working on for Data Lake Retention in AEP and best practices of how to handle.

 

Any insights would be extremely helpful as I can't seem to pinpoint any documentation.

 

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by ReenaJohn

Hi @davidross91 

 

Please find below snippets from documentation on dataset and batch deletion -

 

  • If a dataset is enabled for Profile, deleting that dataset through the UI will delete it from the data lake, Identity Service, and also any profile data associated with that dataset in the Profile store.
  • In the case of a bad batch, you can simply delete that batch from the dataset itself. Keep in mind that, unlike deleting datasets, deleting batches only removes data from the data lake. It doesn’t remove data from the identity graph or profile store.

 

Warm Regards,

Reena John

2 replies

Pradeep_Kumar_Srivastav
Community Advisor
Pradeep_Kumar_SrivastavCommunity Advisor
Community Advisor
September 18, 2024

Hi @davidross91 , Can you please refer https://experienceleague.adobe.com/en/docs/platform-learn/tutorials/data-hygiene/delete-datasets-and-batches to see if it clears your query?

ReenaJohn
Community Advisor
ReenaJohnCommunity AdvisorAccepted solution
Community Advisor
September 18, 2024

Hi @davidross91 

 

Please find below snippets from documentation on dataset and batch deletion -

 

  • If a dataset is enabled for Profile, deleting that dataset through the UI will delete it from the data lake, Identity Service, and also any profile data associated with that dataset in the Profile store.
  • In the case of a bad batch, you can simply delete that batch from the dataset itself. Keep in mind that, unlike deleting datasets, deleting batches only removes data from the data lake. It doesn’t remove data from the identity graph or profile store.

 

Warm Regards,

Reena John

    Indra-2
    Community Advisor
    Indra-2Community Advisor
    Community Advisor
    October 6, 2024

    After 24hrs we may not see the specific batch deleted data in Profile store and Identity graph as well right ? as the data will be refreshed from Data lake in next day audience evaluation.

    Terms & ConditionsAccessibility statement

    Loading footer...