Streaming Ingestion error - The transformed message is empty.

[akwankl]

Hi there,

I've set up a http api source which feeds data into a dataset. I've tried sending a sample payload via POSTMAN, and I keep getting this error in the dataset UI:

The transformed message is empty. Please check the mapping set...

Below is the payload, wondering if anyone has came across this error or can provide some insights to resolve this?

curl --location 'https://dcs.adobedc.net/collection/xyz?syncValidation=true' \
--header 'Content-Type: application/json' \
--header 'x-sandbox-name: sandbox name' \
--data-raw '{
"header": {
    "schemaRef": {
        "id": "https://ns.adobe.com/tenantid/schemas/b2e177c083df3a51c9ad54e06e9eab914d5ebafc7dd860e0",
        "contentType": "application/vnd.adobe.xed-full+json;version=1"
                },
    "imsOrgId": "123@AdobeOrg",
    "datasetId": "654ed72a03f8e728d33d4814",
    "flowId": "c954342e-e88f-44f4-993c-f6f546f34e72"
},
"body": {
    "xdmMeta": {
        "schemaRef": {
            "id": "https://ns.adobe.com/tenantid/schemas/b2e177c083df3a51c9ad54e06e9eab914d5ebafc7dd860e0",
            "contentType": "application/vnd.adobe.xed-full+json;version=1"
                    }
                },
    "xdmEntity": {  
          "_tenantid":{
                "offerId": "123",
                "offerName": "test",
                "status": 1
                  }
                 }  
        }
}'

 Thanks!

[abhinavbalooni]

Hey @akwankl 

Might be a silly qn, but are you using the above payload as is? Cause x-sandbox-name has tenant-id and not the actual tenant-id ?

[akwankl]

Oh, my mistake. I was just masking all the things, I have the correct x-sandbox-name in the real payload.

[abhinavbalooni]

@akwankl 

Have done quite a few streaming setups but not encountered this one yet. Transformed message empty seems to point at a data prep issue within the mapping step of the connection. 

The info shared isn't enough as we do not have the view of the mapping set. What does the mapping set look like ? Is there a data prep you are doing in the mapping ?

Cheers,

Abhinav

[akwankl]

Hi @abhinavbalooni,

The mapping set is very basic, no data prep as I am just testing the connectivity.

[abhinavbalooni · Accepted solution]

Thanks for sharing @akwankl 

Your source fields dont look right.

Think of it this way, you are sending data in the payload inside tenant id node whereas in the source in the mapping set, you do not have the tenant id node but rather the fields directly. Try changing the source fields to reflect the actual structure of the payload or you can also select the fields on clicking on the select icon on the right of every field.

You might have read the below link but still putting for reference:

https://experienceleague.adobe.com/docs/experience-platform/sources/ui-tutorials/create/streaming/ht...

[akwankl]

Hi @abhinavbalooni,

Thanks for pointing it out! I keep thinking under the false impression that the Postman payload needs to align with the destination structure, but it should in fact align with the source mapping structure which flows into the destination.

[abhinavbalooni]

@akwankl Awesome that it worked ! New error learning for me too

Cheers,

Abhinav