Expand my Community achievements bar.

SOLVED

Array object field ingestion using Parquet file

Avatar

Community Advisor

Team - I would like to quickly clarify on ingesting parquet file which has a object array over the target schema. We were trying to ingest parquest based file from S3 and schema has an object array which hold mutiple value for a single customer (holding information about preference on different category). However, data is being ingested except array object, should we use JSON format to ingest array object. Any leads or suggestion would be appreciate. 

 

1 Accepted Solution

Avatar

Correct answer by
Employee

It is very well possible to ingest data into array object from Parquet file. Source Parquet file should be XDM compliant file, as you don't have option for data mapping.

 

fyi, Data of array object won't be visible in UI. you need to query the dataset to see the data of array object attribute.

 

--ssj

View solution in original post

1 Reply

Avatar

Correct answer by
Employee

It is very well possible to ingest data into array object from Parquet file. Source Parquet file should be XDM compliant file, as you don't have option for data mapping.

 

fyi, Data of array object won't be visible in UI. you need to query the dataset to see the data of array object attribute.

 

--ssj