How Can I Upsert an array of objects by straming http api source | Community
Skip to main content
M
MatheusPa1
Level 2
April 3, 2025
Question

How Can I Upsert an array of objects by straming http api source

  • April 3, 2025
  • 1 reply
  • 414 views
Hi,
 
{
    "tenant": {
        "cardDetails": [
            {
                "cardId": "30",
                "cardNumber": "30",
                "status": "ativo00s"
            }
        ],
        "cardsList": [
            {
                "cardId": "100",
                "cardNumber": "500",
                "status": "ativo0"
            }
        ],
        "identities": {
            "myId": "Marcelo"
        }
    }
}
 
I have this schema, i have it enabled for profile, also its dataset is enable for profile and upsert. 
I have tried data prep upsert_array_append but also no lucky.
 
All I want is to have an array of credit cards being upserted by streaming events.
 
cardId should be unique in the array.
 
can anyone please help me?
    This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

    1 reply

    M
    marc_stowe_za
    Level 3
    May 27, 2025

    you not going to like this reply but i dont think you can. the data stream is essentially a push to a dataset, so the peices of the array need to be a compelte set of details.

     

    The solve around this is to stream the data to a non profiole enabled dataset, then run something like data distiller against it and create a complete entry with the full object to push into your current dataset. O nly problem here is that getting the data into your active dataset is going to be slow as it runs through distiller first, which most likely means batch

      Terms & ConditionsAccessibility statement

      Loading footer...