Data in BigQuery is present in the format of array of object. where each value in the object is string.
[{ "MODEL_NAME":"PRP__TRIGGER_1Y_14DLAG",
"MODEL_DECILES":"5",
"MODEL_SCORE":"0.049972750246524811",
"DATE":"2024-12-29"
}
,
{ "MODEL_NAME":"PRP_60D_LAPS_1Y_REV1",
"MODEL_NAME":"9",
"MODEL_SCORE":"0.45968803763389587",
"DATE":"2025-03-15"
]
But when we connect the bigQ with AEP as source and preview the dataFlow, AEP intercept this as object. and each value in the object is an array. This is reverse of how it was present in the BigQ. Also it has backward slash at many places in preview.
{"MODEL_NAME":"[\"PRP__TRIGGER_1Y_14DLAG\",\"PRP_60D_LAPS_1Y_REV1\"]","MODEL_DECILES":"[5,9]","MODEL_SCORE":"[0.049972750246524811,0.45968803763389587]","DATE":"[\"2024-12-29\",\"2025-03-15\"]"}
As a result the data ingestion fails from bigQuery.
1) Why is AEP-BQ connector transforming the data structure ?
2) Is there a formula in calculated field to transfer the preview structure{key:[]} to the expected structure [{key:""}]?
