What are Data Retention policies for Adobe Experience Platform?

[prateekg]

Hi,

I like to know what are the defined policies by Adobe for Experience Platform? Can someone point me to the link/url as I am not able to find one.

Thanks.

Prateek

[Anil_Umachigi]

@prateekg Could you elaborate more? are you trying to understand how long data is stored or can be stored? Or more towards policy on data ownership, retention and ability to delete on demand? 

[prateekg]

Hi Anil, 

Yes, I like to understand if there is any explicit  data retention policies set by Adobe for AEP just like it is there for Analytics (below url). Basically I like to know once data is brought in AEP in the form of various datasets then will it get purged based on any retention period like 25 months etc. Also, if there is any specific data retention policy for AEP for other data sets like customer data in AEP data lake, profile data, segment data, campaigns, logs etc.

https://experienceleague.adobe.com/docs/analytics/technotes/data-retention.html

Thanks.

Prateek

[Anil_Umachigi]

@prateekg Right ok! So unlike other Adobe products things work bit differently for Adobe Experience platform. 

All of the data ingested are stored within a dataset, the amount and of data ingested, maintained and retained is decided by the customer. 

The customer has complete access to purge the data from each data set or hit the nuclear button by resetting the entire sandbox. 

In addition product like CJA has rolling data options, ability to use only part of your data set ensuring optimal billing and data storage. 

As far as Profile data, it includes an opton called TTL

* A mechanism that limits the amount of time that data lives within a dataset. This lets you automatically remove data from the Profile Store that is no longer useful for your use cases.

Feel free to reach out to CSM to confirm other specific use cases. 

Hope that helps! 

[prateekg]

ok. So what I am understanding is by default there is no delete/purge policy in AEP for the data ingested in Dataset i.e. in Datalake and Customer has to decide how much historical data he wants to keep in AEP?

Is this correct?

Also what is CJA?

[Anil_Umachigi]

@prateekg yes, a customer can decide how much historical data to get into dataset.

CJA --> Adobe Customer Journey Analytics tool which depends on data from various dataset for reporting usecases

[Anuhya-Y · Accepted solution]

@prateekg 

Check out the links

Datasets/data lake retention is 7 days. If Customer AI Intelligent Service is part of the licence, then 180 days

https://experienceleague.adobe.com/docs/experience-cloud-kcs_en/kbarticles/KA-19958.html?lang=en

TTL applies to profile store not data lake. If you'd like to clean up data lake as well after profiles removed from profile store, a workaround solution would be to query all batches older than X number of days. Once you have the list of batch IDs, you'd run an API request to delete those found batch  IDs.

https://experienceleague.adobe.com/docs/experience-platform/profile/apply-ttl.html%3Flang%3Den

[prateekg]

Hi Anuhya,

We are storing data in Datasets in AEP which I think stores the data in Datalake. So are you saying that data retention period for these datasets is 180 days if our customer has  "AI Intelligent Service" license?

Please confirm.

[Anuhya-Y]

Yes, that is the correct understanding.

[prateekg]

Thanks Anuhya.

[JohnnyLiao]

@Anuhya-Y 

Is it correct?

In my sandbox, all the data ingested via source connectors or the WebSDK has not been deleted for more than 7 days.

[Anuhya-Y]

@JohnnyLiao check "AI Intelligent Service" license details of your server . If you have "AI Intelligent Service" license data retention period for datasets is 180 days.

[arpan-garg]

@Anuhya-Y - Does it mean that all the data ingested via source connectors or Websdk will be deleted in 7 days?

Thanks