List batch ids from streaming ingestion | Community
Skip to main content
A
ArturRu
Level 2
July 26, 2021
Question

List batch ids from streaming ingestion

  • July 26, 2021
  • 1 reply
  • 1178 views

Hi community,

 

unlike e.g. Adobe Analytics there is no automatic data retention service available within the AEP. Therefore, I tried to identify according ingestion ids in order to delete data manually after a certain time period. This is quite easy for “normal” batch ingestions:

 

Identify batch IDs

GET https://platform.adobe.io/data/foundation/catalog/batches?limit=100&properties=created

Delete in datasets

POST https://platform.adobe.io/data/foundation/import/batches/{BATCH_ID}?action=REVERT

Delete in RTCDP

POST https://platform.adobe.io/data/core/ups/system/jobs

 

I tried to do that also with streaming data (via Web SDK). It is possible to identify batches via:

GET https://platform.adobe.io/data/foundation/catalog/dataSetFiles?dataSetId=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX&limit=100

 

However, it looks like this list is not complete. Does anyone has an idea how this could be solved?

 

BR

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

1 reply

ChetanyaJain-1
Community Advisor
ChetanyaJain-1Community Advisor
Community Advisor
December 9, 2022

Hi @arturru,

You can retrieve the list of batches based on dataset id, timestamp, etc. Please check the catalog service - https://developer.adobe.com/experience-platform-apis/references/catalog/#tag/Batches/operation/listBatches 

 

Hope this helps!

 

Thanks,

Chetanya

Terms & ConditionsAccessibility statement

Loading footer...