Adobe analytics historical data to CJA through AEP

[gmadala]

Hello, 
I have read multiple articles and blogs regarding how to get Adobe analytics historical data into CJA.  
But I havent found any solid ones apart from https://www.fullstackanalyst.io/blog/adobe-customer-journey-analytics/web-analytics-with-adobes-cust...

Currently I do have historical data coming from adobe source connector which has its own default schema. 
Unfortunately I cannot select my custom schema since it does not have the Analytics experience template field group. 

How does one map both historical data from source connector and future data from websdk into one field ? 
Is this even possible ? For example I have page name that is coming as eVar1 from adobe analytics and pagename as web.pagedetails.pagename from websdk 
Now how do I merge these two into one field in data view? 

Has anyone tried like alternative approach where the datafeed is exported to datalake using APIs and then fed back into AEP for mapping into custom schema?

Looking forward to get some clear answers with direction that can help me set for future. 

[Josh__Stephens]

hi @gmadala - I've worked with historical backfills sent from data lake.  Mapping this data to appropriate schema path definitely gives you more flexibility so the data all ties together.

Using the AA source connector might be a quicker start, but AFAIK there's definitely drawbacks for the bigger picture.

[gmadala]

Could you please walk me through the process of connecting to datalake ? Were you using like databricks or something ? 
Also I am guessing you mapped your variables to the post processed data ? 

[Josh__Stephens]

Hi @gmadala  - I should have clarified, I've been involved in projects where data from data lakes was used for historical backfill.  I haven't been directly involved in the process/technical aspects.

The data was pre-processed so we could then apply persistence, etc., as desired within CJA.

[jlasso71]

Hi @gmadala,

I've found the same issue when ingesting historical data coming from Adobe Analytics source connector. Currently, you can map AA data to XDM through this source connector, but this will not work if you want to map evars/props to Adobe field groups or your schema does not have the Analytics experience template field group, as you well said.

Therefore, we decided to map everything we could through the Adobe Analytics source connector and use query service to apply the mappings we could not and insert data into a new dataset:

- Dataset 1 with a schema with Analytics experience template field group.

- Dataset 2 with a custom schema.

- AA source connector mapping data to Dataset 1.

- Transform AA schema to custom schema through Query Service, insert data into Dataset 2.

This solution is not a good fit if you want to have data in RTCDP but as our requirement was only for CJA it worked well.

Hope this helps.