Skip to main content
DavidRoss91
Community Advisor
Community Advisor
Sep 16, 2024 1:07 PM UTC
Solved

Follow Up Datalake Retention

Hello,

In reference to this post: Solved: AEP Data Lake Retention - Adobe Experience League Community - 679830

 

Can anyone here confidently confirm with documentation, that deletion of batches would only affect the profile store, and not data lake itself? I have a POC i'm working on for Data Lake Retention in AEP and best practices of how to handle.

 

Any insights would be extremely helpful as I can't seem to pinpoint any documentation.

 

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
ReenaJohn
ReenaJohnAccepted solution
Community Advisor
Sep 18, 2024 10:48 AM UTC

Hi @davidross91 

 

Please find below snippets from documentation on dataset and batch deletion -

 

  • If a dataset is enabled for Profile, deleting that dataset through the UI will delete it from the data lake, Identity Service, and also any profile data associated with that dataset in the Profile store.
  • In the case of a bad batch, you can simply delete that batch from the dataset itself. Keep in mind that, unlike deleting datasets, deleting batches only removes data from the data lake. It doesn’t remove data from the identity graph or profile store.

 

Warm Regards,

Reena John

3 replies

Pradeep_Kumar_Srivastav
Community Advisor
Community Advisor
Sep 18, 2024 1:18 AM UTC
ReenaJohn
Community Advisor
ReenaJohnCommunity AdvisorAccepted solution
Community Advisor
Sep 18, 2024 10:48 AM UTC

Hi @davidross91 

 

Please find below snippets from documentation on dataset and batch deletion -

 

  • If a dataset is enabled for Profile, deleting that dataset through the UI will delete it from the data lake, Identity Service, and also any profile data associated with that dataset in the Profile store.
  • In the case of a bad batch, you can simply delete that batch from the dataset itself. Keep in mind that, unlike deleting datasets, deleting batches only removes data from the data lake. It doesn’t remove data from the identity graph or profile store.

 

Warm Regards,

Reena John

Translate
Indra-2
Community Advisor
Community Advisor
Oct 6, 2024 1:32 AM UTC

After 24hrs we may not see the specific batch deleted data in Profile store and Identity graph as well right ? as the data will be refreshed from Data lake in next day audience evaluation.

Translate