How Can I Upsert an array of objects by straming http api source

[matheus-paixao]

Hi,

{

    "tenant": {

        "cardDetails": [

            {

                "cardId": "30",

                "cardNumber": "30",

                "status": "ativo00s"

            }

        ],

        "cardsList": [

            {

                "cardId": "100",

                "cardNumber": "500",

                "status": "ativo0"

            }

        ],

        "identities": {

            "myId": "Marcelo"

        }

    }

}

I have this schema, i have it enabled for profile, also its dataset is enable for profile and upsert. 

I have tried data prep upsert_array_append but also no lucky.

All I want is to have an array of credit cards being upserted by streaming events.

cardId should be unique in the array.

can anyone please help me?

[marc_stowe_za]

you not going to like this reply but i dont think you can. the data stream is essentially a push to a dataset, so the peices of the array need to be a compelte set of details.

The solve around this is to stream the data to a non profiole enabled dataset, then run something like data distiller against it and create a complete entry with the full object to push into your current dataset. O nly problem here is that getting the data into your active dataset is going to be slow as it runs through distiller first, which most likely means batch