Expand my Community achievements bar.

SOLVED

Follow Up Datalake Retention

Avatar

Community Advisor

Hello,

In reference to this post: Solved: AEP Data Lake Retention - Adobe Experience League Community - 679830

 

Can anyone here confidently confirm with documentation, that deletion of batches would only affect the profile store, and not data lake itself? I have a POC i'm working on for Data Lake Retention in AEP and best practices of how to handle.

 

Any insights would be extremely helpful as I can't seem to pinpoint any documentation.

 

1 Accepted Solution

Avatar

Correct answer by
Level 4

Hi @DavidRoss91 

 

Please find below snippets from documentation on dataset and batch deletion -

 

  • If a dataset is enabled for Profile, deleting that dataset through the UI will delete it from the data lake, Identity Service, and also any profile data associated with that dataset in the Profile store.
  • In the case of a bad batch, you can simply delete that batch from the dataset itself. Keep in mind that, unlike deleting datasets, deleting batches only removes data from the data lake. It doesn’t remove data from the identity graph or profile store.

 

Warm Regards,

Reena John

View solution in original post

3 Replies

Avatar

Correct answer by
Level 4

Hi @DavidRoss91 

 

Please find below snippets from documentation on dataset and batch deletion -

 

  • If a dataset is enabled for Profile, deleting that dataset through the UI will delete it from the data lake, Identity Service, and also any profile data associated with that dataset in the Profile store.
  • In the case of a bad batch, you can simply delete that batch from the dataset itself. Keep in mind that, unlike deleting datasets, deleting batches only removes data from the data lake. It doesn’t remove data from the identity graph or profile store.

 

Warm Regards,

Reena John

Avatar

Level 5

After 24hrs we may not see the specific batch deleted data in Profile store and Identity graph as well right ? as the data will be refreshed from Data lake in next day audience evaluation.