Data Ingestion for Object Array field using File Upload method?

Question

Hi team,Please help me to ingest below data in data lake through file upload methodSample file in below records:PNameBirthdateJery|doll2023-03-10T18:56:41+00:00|2023-08-10T18:56:41+00:00Tom|Marry2023-05-10T18:56:41+00:00|2023-08-10T18:56:41+00:00on below schema for reference schema structure for reference:Please provide the suggestion or guide me on the same.We are expecting to getting similar records at dataset level:PNameBirthdateJery|doll2023-03-10T18:56:41+00:00|2023-08-10T18:56:41+00:00Tom|Marry2023-05-10T18:56:41+00:00|2023-08-10T18:56:41+00:00Regards,Sandip

arpan-garg · Accepted Answer

Hello, @sandip_surse

This solution will suit your needs:

Transform the arrays using the following method:

arrays_to_objects("birthDate", explode(Birthdate, "\|"), "XYZName", explode(PName, "\|"))

I couldn't find the correct name for the 'Name' field in your schema, so I used 'XYZName' as a placeholder above.

Once you've completed this step, kindly map it directly to the object array. Make sure to remove [0] from the data mapping.
Thanks,

Arpan

Verticurl · Answer

Please confirm a proper file format (.Parquet or JSON) for manual file uploads, not csv.

https://experienceleague.adobe.com/docs/experience-platform/ingestion/tutorials/ingest-batch-data.html?lang=en#add-data-to-dataset

PName	Birthdate
Jery\|doll	2023-03-10T18:56:41+00:00\|2023-08-10T18:56:41+00:00
Tom\|Marry	2023-05-10T18:56:41+00:00\|2023-08-10T18:56:41+00:00

Sign up

Login with SSO

Login to the community

Login with SSO