Expand my Community achievements bar.

SOLVED

XDM Batching to improve the performance for Data ingestion into AEP

Avatar

Level 1

Hi All, We are adding single XDM data (as mentioned sample below) in EventData and sending into AEP via EventDataBatch.  Can some one guide on XDM batching with sample data instead of sending single XDM data.

 

If shared sample data for XDM batch process might be great, Thanks in advance !

Sample:

{
"header": {
"schemaRef": {
"id": "https://ns.adobe.com/test/schemas/asd765675asdas7d5765s6dadad5",
"contentType": "application/vnd.adobe.xed-full+json;version=1.0"
},
"source": {
"name": "event_hub"
}
},
"body": {
"xdmMeta": {
"schemaRef": {
"id": "https://ns.adobe.com/test/schemas/asd765675asdas7d5765s6dadad5",
"contentType": "application/vnd.adobe.xed-full+json;version=1.0"
}
},
"xdmEntity": {
"type": "test",
"mobile": {
"group": {
"source": "testing"
},
"test_group": {
"contact": "9132672583"
}
},
"timestamp": "2023-08-02T00:38:12.000-05:00"
}
}
}

1 Accepted Solution

Avatar

Correct answer by
Community Advisor

Hi @AjayPrakash7  - There are many ways that we can ingest data as a batch from platform. Listed out below which will help you to ingest data as batch, data to be ingested may include profile data from a flat file to the AEP system. Refer below and hope this will help you to familarise on batch ingestion. 

https://experienceleague.adobe.com/docs/experience-platform/ingestion/tutorials/map-csv/existing-sch... 

https://experienceleague.adobe.com/docs/experience-platform/ingestion/tutorials/ingest-batch-data.ht... 

View solution in original post

3 Replies

Avatar

Community Advisor

Hi There - Not sure if I understand your batch query exactly, let me try to answer. So are you looking to ingest the bulk sample data through postman service instead of sending single XDM.

https://experienceleague.adobe.com/docs/platform-learn/getting-started-for-data-architects-and-data-...  

 

Thanks for your response, here ask is from application and NOT related to postman. Expecting sample XDM data with batching 

Avatar

Correct answer by
Community Advisor

Hi @AjayPrakash7  - There are many ways that we can ingest data as a batch from platform. Listed out below which will help you to ingest data as batch, data to be ingested may include profile data from a flat file to the AEP system. Refer below and hope this will help you to familarise on batch ingestion. 

https://experienceleague.adobe.com/docs/experience-platform/ingestion/tutorials/map-csv/existing-sch... 

https://experienceleague.adobe.com/docs/experience-platform/ingestion/tutorials/ingest-batch-data.ht...