Data flow from AEP Web SDK to Real Time CDP profile

[Neelabh_]

Hello Everyone,

We are capturing event data from our website using AEP Web SDK [via launch]. The data captured in data elements is mapped to Adobe Analytics fields  like eVars via XDM object. I can see all the eVars populated correctly in AEP debugger under events. However I randomly see many eVar values missing under profile of a user [email address as identity] in RTCDP. Does anyone has any idea about probable cause for this issue or a way to fix it.

On a different note, how can I have this unified data for customer profile visible in CJA. Currently I can see the data fragmented but not related and so can not frame a full journey of customer in CJA. For example I can see dimension 1 and dimension 2 for a particular email id separately but cannot map dimension 1 & 2 together with the email id.

Thanks

[jayakrishnaaparthasarathy · Accepted solution]

Hi @Neelabh_ ,

Hope, you would have used data element (via ExperiecenEevent Schema class) to map all your web site event data to adobe analytics. There are some reasons that why we cannot see other profile related information under the profile feature for particular user,

To best of my knowledge to give answer for your question,

1. We cannot directly send profile level information to AEP through web SDK as Individual profile class will not be available for the mapping under the data element. So, all information related to profile will be missed from web SDK implementation.

2. However, still you can use custom code method to pass profile related information to your Individual profile class data set.

3. Make sure to enable your both event and profile data set from DataStream (which is a configured instance of Edge Network) help us to serve your data to Edge network.

4. Hope, you would have also have other sources fill your profile level information with adobe analytics event  ( i.e CRM, loyalty system) to stitch your profile information. Make sure you enable the profile from respective dataset as well.

[dwright]

I'm not sure what you mean by "I randomly see many eVar values missing under profile of a user [email address as identity] in RTCDP". Why would you expect to see eVar values in the Real-time Customer Profile? Does your schema include one of the "Adobe Analytics ExperienceEvent" field groups or so you have xdm fields named "eVar#" being sent to Platform?

Also, how are you looking for them? Are you opening the profile in Platform UI > Profiles > [Opened Profile] > Events? As @jayakrishnaaparthasarathy , this data would not be attribute data in Profile, it would be attached to a specific event.

How are you passing the identity? In identityMap or as an identity-labeled field in your schema? I would expect you would be able to see all of the identities (ECID and email address) when you open the profile in the Detail view.

[jayakrishnaaparthasarathy]

Hi @Neelabh_  - Hope, this clarify your question. Please let us know incase if you required anything else.

[Neelabh_]

Thanks everyone for the response.

I had a discussion with Adobe team where we debugged the complete flow and identified a couple of issues and then proceeded with a reimplementation. The application is working fine now as expected after reimplementation. I would like to share the points identified so that it may help others facing similar issues in future.

01. The first point we identified was that though we could see the data captured in AEP debugger but it was never stored in AEP.  It was confirmed when we checked 'streaming end to end' window for Monitoring in Data Management section and found that certain records appeared failed with reason 'null value present for some eVars'. This led us to conclude that the issue is with launch implementation which is leading to null value exception for eVar values. We tried to set default values for many such eVars in launch, that were identified as error in data monitoring but unfortunately it did not work.
So the recommendation was to go ahead with a reimplementation by avoiding use of Analytics variables [evar & props] as Adobe Analytics was NOT in our scope of application but was used only to pass data to AEP. As a best practice we were advised not to use Adobe Analytics Experience Event Template field group in XDM ExperienceEvent to capture values from website for AEP [and subsequently Analytics variables via data elements in Launch], if Adobe Analytics is not involved.
We were suggested to create custom field groups under XDM ExperienceEvent and use the same to capture values in launch through via data elements. Although this may not fix the issue, but it eased out the process by removing ambiguity and gave us clarity in terms of Launch rules and schema variables because it helped to add context to data through custom names rather than just naming them as evars. Once this was done, we could see all the data now being recieved in AEP without any error in the records [checked in Data Monitoring & Dataset] (reimplementation fixed the issue as we removed previous launch rules of populating evars)

02. The second part of the issue was fragmented data in CJA where we could not frame a full journey with dimensions working independently but not in relation with event and profile schema taken together. The root cause of this issue was incorrect connection created for CJA where we had selected primary identifiers for profile and event schema. We had two profile schemas and 1 event schema. For Profile schema A & B Email ID served as primary identifier, while for event schema ECID was primary identifier with email id as other identifier field. When we created connection in CJA we choose Email ID as 'Person ID' (for profile schema A & B ) while selecting ECID as 'Person ID' for event schema. This was incorrect and so we created a new connection where email ID served as 'Person ID' from both profile schemas and event schema to fix this issue.