Data not getting ingested into array type objects using csv file in Adobe Experience Platform

[RitwikMo]

0

I am trying to ingest data through CSV file into array type object fields in a schema in Adobe experience platform.But the data is not getting ingested although it's not showing any error while ingesting.

Array type objects:

Cool Numbers - Integer type

Favorite Choice - String type

Sample data in csv file:

Cool Numbers           Favorite Choice

2|26                           ic|t

5|63|74                      t|ic

When I am loading the CSV file manually into schema,I am creating calculated field for both of them like

to_array(true,split(Cool_Numbers,"|"))

and mapping it to the corresponding target field.

Validation is coming fine but when I finish the workflow and check the processed data,it shows blank in both the fields in the dataset.

[sambhav-jain]

arrays are not supported using file based connector.

Only way in this case would be to store the file data in a non profile enabled dataset and then run schedule a SQL query to read data, transform it in array and then ingest it in profile enabled dataset with array objects. (Checkout your license restrictions before using scheduled queries)

[RitwikMo]

The dataset is not profile enabled.Is there no other way or approach through which it can be loaded properly through csv file.

[sambhav-jain]

no, using csv files, arrays are not supported. Other options would be JSON via API connector or as mentioned above using queries.

[brekrut]

@RitwikMo I would look into the data prep function of to_object to cover the CSV column to an object and then to_array. 

[RitwikMo]

Can you provide an example,that would be great.

[John_Man · Accepted solution]

Hi @RitwikMo 

I've done a POC to simulate office purchase, and below is the raw csv sample records, and the screen capture is the data mapping.

The array_to_object function can help you to map delimitered fields into the standard productListItems field.

Hope it helps.

id,timestamp,customerID,storeCode,pageName,purchaseID,priceTotal,SKU,QTY
202311060101-0003,2023-11-06T13:07:19+08:00,u033@yahoo.com,SHOP003,Offline Purchase,635-025-655-6792,8139,SKU113|SKU089,2|2
202311060102-0004,2023-11-06T13:02:19+08:00,u034@icq.com,SHOP004,Offline Purchase,635-025-655-6793,1214,SKU018,4
202311060102-0005,2023-11-06T13:02:19+08:00,u035@icq.com,SHOP001,Offline Purchase,635-025-655-6794,718,SKU023|SKU194|SKU905|SKU226,2|2|3|5

[gengaipandi03]

This is new information to load the csv file to array object schema. Really helpful, i will also try this. 

[John_Man]

Hi @RitwikMo 

I've tried below mapping and it can import data from CSV to the standard product list field.