JSON to XDM Parquet

[Cristhian_AlexisNa]

Hi!

I hope you are well

Do you have an ad hoc generic process in python to convert JSON data to XDM Parquet file in order to ingest to AEP Dataset?

I was testing a normal .parquet file but Adobe does not recognize some files.

Example JSON:

[{

    "_ingdirectspain": {

        "Savings": [

            {

                "ccc_product": "123456789",

                "pro_type": "tipo_1"

            },

            {

                "ccc_product": "1234567890",

                "pro_type": "tipo_3"

            }

        ]

    },

    "identityMap": {

        "UUID": [

            {

                "authenticatedState": "authenticated",

                "primary": true,

                "id": "7270526"

            }

        ],

        "cipID": [

            {

                "authenticatedState": "authenticated",

                "primary": false,

                "id": "07270526"

            }

        ]

    }

}]

[Shubham_AEP]

To ingest data into AEP, the JSON must be transformed into a Parquet file that strictly follows the structure and data types defined in the target XDM schema. This includes matching field names, nesting, and data types exactly as registered in AEP.

1. In order to Convert to Parquet Format

Use a Parquet-compatible tool (like Python with PyArrow and Pandas) to save the transformed data:

• Maintain column names and types as defined in the schema

• Output the file in, .parquet format with a supported library

2. Validate Before Uploading

Optionally, use AEP tools or APIs to validate the file:

• Ensure the schema mapping is correct

• Confirm the structure matches the dataset you are ingesting into