Expand my Community achievements bar.

SOLVED

Streaming Ingestion error - The transformed message is empty.

Avatar

Level 7

Hi there,

 

I've set up a http api source which feeds data into a dataset. I've tried sending a sample payload via POSTMAN, and I keep getting this error in the dataset UI:

 

The transformed message is empty. Please check the mapping set...

 

 

Below is the payload, wondering if anyone has came across this error or can provide some insights to resolve this?

 

curl --location 'https://dcs.adobedc.net/collection/xyz?syncValidation=true' \
--header 'Content-Type: application/json' \
--header 'x-sandbox-name: sandbox name' \
--data-raw '{
"header": {
    "schemaRef": {
        "id": "https://ns.adobe.com/tenantid/schemas/b2e177c083df3a51c9ad54e06e9eab914d5ebafc7dd860e0",
        "contentType": "application/vnd.adobe.xed-full+json;version=1"
                },
    "imsOrgId": "123@AdobeOrg",
    "datasetId": "654ed72a03f8e728d33d4814",
    "flowId": "c954342e-e88f-44f4-993c-f6f546f34e72"
},
"body": {
    "xdmMeta": {
        "schemaRef": {
            "id": "https://ns.adobe.com/tenantid/schemas/b2e177c083df3a51c9ad54e06e9eab914d5ebafc7dd860e0",
            "contentType": "application/vnd.adobe.xed-full+json;version=1"
                    }
                },
    "xdmEntity": {  
          "_tenantid":{
                "offerId": "123",
                "offerName": "test",
                "status": 1
                  }
                 }  
        }
}'

 

 Thanks!

1 Accepted Solution

Avatar

Correct answer by
Community Advisor

Thanks for sharing @akwankl 

Your source fields dont look right.

Think of it this way, you are sending data in the payload inside tenant id node whereas in the source in the mapping set, you do not have the tenant id node but rather the fields directly. Try changing the source fields to reflect the actual structure of the payload or you can also select the fields on clicking on the select icon on the right of every field.

 

You might have read the below link but still putting for reference:

https://experienceleague.adobe.com/docs/experience-platform/sources/ui-tutorials/create/streaming/ht...

View solution in original post

7 Replies

Avatar

Community Advisor

Hey @akwankl 

 

Might be a silly qn, but are you using the above payload as is? Cause x-sandbox-name has tenant-id and not the actual tenant-id ?

Avatar

Level 7

Oh, my mistake. I was just masking all the things, I have the correct x-sandbox-name in the real payload.

Avatar

Community Advisor

@akwankl 

Have done quite a few streaming setups but not encountered this one yet. Transformed message empty seems to point at a data prep issue within the mapping step of the connection. 

 

The info shared isn't enough as we do not have the view of the mapping set. What does the mapping set look like ? Is there a data prep you are doing in the mapping ?

 

Cheers,

Abhinav

Avatar

Level 7

Hi @abhinavbalooni,

 

The mapping set is very basic, no data prep as I am just testing the connectivity.

akwankl_1-1700901894016.png

 

 

Avatar

Correct answer by
Community Advisor

Thanks for sharing @akwankl 

Your source fields dont look right.

Think of it this way, you are sending data in the payload inside tenant id node whereas in the source in the mapping set, you do not have the tenant id node but rather the fields directly. Try changing the source fields to reflect the actual structure of the payload or you can also select the fields on clicking on the select icon on the right of every field.

 

You might have read the below link but still putting for reference:

https://experienceleague.adobe.com/docs/experience-platform/sources/ui-tutorials/create/streaming/ht...

Avatar

Level 7

Hi @abhinavbalooni,

 

Thanks for pointing it out! I keep thinking under the false impression that the Postman payload needs to align with the destination structure, but it should in fact align with the source mapping structure which flows into the destination.

 

 

Avatar

Community Advisor

@akwankl Awesome that it worked ! New error learning for me too

 

Cheers,

Abhinav