JSON to XDM Parquet | Community
Skip to main content
C
Cristhian_AlexisNa
Level 2
March 27, 2025
Question

JSON to XDM Parquet

  • March 27, 2025
  • 1 reply
  • 379 views

Hi!

I hope you are well

 

Do you have an ad hoc generic process in python to convert JSON data to XDM Parquet file in order to ingest to AEP Dataset?

I was testing a normal .parquet file but Adobe does not recognize some files.

 

Example JSON:

[{
    "_ingdirectspain": {
        "Savings": [
            {
                "ccc_product": "123456789",
                "pro_type": "tipo_1"
            },
            {
                "ccc_product": "1234567890",
                "pro_type": "tipo_3"
            }
        ]
    },
    "identityMap": {
        "UUID": [
            {
                "authenticatedState": "authenticated",
                "primary": true,
                "id": "7270526"
            }
        ],
        "cipID": [
            {
                "authenticatedState": "authenticated",
                "primary": false,
                "id": "07270526"
            }
        ]
    }
}]

    1 reply

    Shubham_AEP
    Shubham_AEP
    Level 2
    June 10, 2025

    To ingest data into AEP, the JSON must be transformed into a Parquet file that strictly follows the structure and data types defined in the target XDM schema. This includes matching field names, nesting, and data types exactly as registered in AEP.

     

    1. In order to Convert to Parquet Format

    Use a Parquet-compatible tool (like Python with PyArrow and Pandas) to save the transformed data:

    • Maintain column names and types as defined in the schema

    • Output the file in, .parquet format with a supported library

    2. Validate Before Uploading

    Optionally, use AEP tools or APIs to validate the file:

    • Ensure the schema mapping is correct

    • Confirm the structure matches the dataset you are ingesting into

      Terms & ConditionsAccessibility statement

      Loading footer...