Adobe analytics historical data to CJA through AEP | Community
Skip to main content
gautham_madala
gautham_madala
Level 5
November 22, 2024
Solved

Adobe analytics historical data to CJA through AEP

  • November 22, 2024
  • 3 replies
  • 1533 views

Hello, 
I have read multiple articles and blogs regarding how to get Adobe analytics historical data into CJA.  
But I havent found any solid ones apart from https://www.fullstackanalyst.io/blog/adobe-customer-journey-analytics/web-analytics-with-adobes-customer-journey-analytics-part-2-system-architecture-in-experience-platform/

Currently I do have historical data coming from adobe source connector which has its own default schema. 
Unfortunately I cannot select my custom schema since it does not have the Analytics experience template field group. 

How does one map both historical data from source connector and future data from websdk into one field ? 
Is this even possible ? For example I have page name that is coming as eVar1 from adobe analytics and pagename as web.pagedetails.pagename from websdk 
Now how do I merge these two into one field in data view? 

Has anyone tried like alternative approach where the datafeed is exported to datalake using APIs and then fed back into AEP for mapping into custom schema?

Looking forward to get some clear answers with direction that can help me set for future. 


    Best answer by Harveer_SinghGi1

    Hi @gautham_madala ,

    If it is a hard requirement for you to have the data mapped to custom fields in a schema of your choice, here is what you can do,

    1. Create a custom schema with Analytics Experience Template Field Group
    2. Add your custom fields to the same schema
    3. Use this schema to setup the AA data ingestion through ADC
    4. In data prep of the dataflow for this source connection, add mapping to map Standard AA XDM fields to the custom XDM fields of your choice
    5. (Optional) Nullify the standard fields coming from ADC to remove redundant fields containing same information

    This way you can use the ADC and have data in fields of your choice.

    3 replies

    Josh__Stephens
    Community Advisor
    Josh__StephensCommunity Advisor
    Community Advisor
    November 22, 2024

    hi @gautham_madala - I've worked with historical backfills sent from data lake.  Mapping this data to appropriate schema path definitely gives you more flexibility so the data all ties together.

    Using the AA source connector might be a quicker start, but AFAIK there's definitely drawbacks for the bigger picture.

      gautham_madala
      gautham_madalaAuthor
      Level 5
      November 22, 2024

      Could you please walk me through the process of connecting to datalake ? Were you using like databricks or something ? 
      Also I am guessing you mapped your variables to the post processed data ? 

      Josh__Stephens
      Community Advisor
      Josh__StephensCommunity Advisor
      Community Advisor
      November 26, 2024

      Hi @gautham_madala  - I should have clarified, I've been involved in projects where data from data lakes was used for historical backfill.  I haven't been directly involved in the process/technical aspects.

      The data was pre-processed so we could then apply persistence, etc., as desired within CJA.

      J
      jlasso71
      Level 2
      November 27, 2024

      Hi @gautham_madala,

       

      I've found the same issue when ingesting historical data coming from Adobe Analytics source connector. Currently, you can map AA data to XDM through this source connector, but this will not work if you want to map evars/props to Adobe field groups or your schema does not have the Analytics experience template field group, as you well said.

       

      Therefore, we decided to map everything we could through the Adobe Analytics source connector and use query service to apply the mappings we could not and insert data into a new dataset:

       

      - Dataset 1 with a schema with Analytics experience template field group.

      - Dataset 2 with a custom schema.

      - AA source connector mapping data to Dataset 1.

      - Transform AA schema to custom schema through Query Service, insert data into Dataset 2.

       

      This solution is not a good fit if you want to have data in RTCDP but as our requirement was only for CJA it worked well.

       

      Hope this helps.

      Harveer_SinghGi1
      Community Advisor
      Harveer_SinghGi1Community AdvisorAccepted solution
      Community Advisor
      December 30, 2024

      Hi @gautham_madala ,

      If it is a hard requirement for you to have the data mapped to custom fields in a schema of your choice, here is what you can do,

      1. Create a custom schema with Analytics Experience Template Field Group
      2. Add your custom fields to the same schema
      3. Use this schema to setup the AA data ingestion through ADC
      4. In data prep of the dataflow for this source connection, add mapping to map Standard AA XDM fields to the custom XDM fields of your choice
      5. (Optional) Nullify the standard fields coming from ADC to remove redundant fields containing same information

      This way you can use the ADC and have data in fields of your choice.

      gautham_madala
      gautham_madalaAuthor
      Level 5
      April 22, 2025

      @harveer_singhgi1 

      How do you nullify the standard fields coming from ADC , I dont see any option in AEP. 
      Unless this is something that you think we should be doing at CJA in Data view.

      Josh__Stephens
      Community Advisor
      Josh__StephensCommunity Advisor
      Community Advisor
      April 23, 2025

      Using data prep, you can nullify fields.

      Terms & ConditionsAccessibility statement

      Loading footer...