Array object field ingestion using Parquet file | Community
Skip to main content
jayakrishnaaparthasarathy
Community Advisor
jayakrishnaaparthasarathyCommunity Advisor
Community Advisor
February 7, 2024
Solved

Array object field ingestion using Parquet file

  • February 7, 2024
  • 1 reply
  • 1000 views

Team - I would like to quickly clarify on ingesting parquet file which has a object array over the target schema. We were trying to ingest parquest based file from S3 and schema has an object array which hold mutiple value for a single customer (holding information about preference on different category). However, data is being ingested except array object, should we use JSON format to ingest array object. Any leads or suggestion would be appreciate. 

 

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by ssj

It is very well possible to ingest data into array object from Parquet file. Source Parquet file should be XDM compliant file, as you don't have option for data mapping.

 

fyi, Data of array object won't be visible in UI. you need to query the dataset to see the data of array object attribute.

 

--ssj

1 reply

S
Adobe Employee
ssjAdobe EmployeeAccepted solution
Adobe Employee
February 16, 2024

It is very well possible to ingest data into array object from Parquet file. Source Parquet file should be XDM compliant file, as you don't have option for data mapping.

 

fyi, Data of array object won't be visible in UI. you need to query the dataset to see the data of array object attribute.

 

--ssj

Terms & ConditionsAccessibility statement

Loading footer...