Your achievements

Level 1

0% to

Level 2

Tip /
Sign in

Sign in to Community

to gain points, level up, and earn exciting badges like the new
Bedrock Mission!

Learn more

View all

Sign in to view all badges

List batch ids from streaming ingestion

Avatar

Level 2

Hi community,

 

unlike e.g. Adobe Analytics there is no automatic data retention service available within the AEP. Therefore, I tried to identify according ingestion ids in order to delete data manually after a certain time period. This is quite easy for “normal” batch ingestions:

 

Identify batch IDs

GET https://platform.adobe.io/data/foundation/catalog/batches?limit=100&properties=created

Delete in datasets

POST https://platform.adobe.io/data/foundation/import/batches/{BATCH_ID}?action=REVERT

Delete in RTCDP

POST https://platform.adobe.io/data/core/ups/system/jobs

 

I tried to do that also with streaming data (via Web SDK). It is possible to identify batches via:

GET https://platform.adobe.io/data/foundation/catalog/dataSetFiles?dataSetId=XXXXXXXXXXXXXXXXXXXXXXXXXXX...

 

However, it looks like this list is not complete. Does anyone has an idea how this could be solved?

 

BR

1 Reply

Avatar

Community Advisor

Hi @udvbia,

You can retrieve the list of batches based on dataset id, timestamp, etc. Please check the catalog service - https://developer.adobe.com/experience-platform-apis/references/catalog/#tag/Batches/operation/listB... 

 

Hope this helps!

 

Thanks,

Chetanya