Adobe CJA connections not showing any records, but records are added successfully in AEP.

[SwetaRani]

In my Adobe CJA connections, I am not seeing any records after establishing the connection. However, in my dataset within Adobe Experience Platform (AEP), I can see data totaling approximately 2.36M records, but it is not being added to Adobe CJA.

I have tried using both lookup and event schemas. I created a timestamp field and mapped it to one of the fields in my source data flow. Similarly, I mapped the identity field, naming it "Quote ID." I cannot use the timestamp which is already provided by XDM Experience Event because I don't have any field in my source which has Map data type.

I followed all the steps in AEP, including creating the schema, setting up data flows in Sources (using Salesforce), and creating the dataset. The data flow appears to be functioning according to the specified time interval, currently set to 15 hours and add records within AEP. I even tried reducing it to 1 hour, but the issue persists with records coming up in Adobe CJA.

Despite completing these steps, Adobe CJA doesn’t show any errors. It simply fails to add any records. I have been troubleshooting this for several weeks, tweaking the schema, data flow, and connections, but nothing seems to work. Even my data backfills are failing for event dataset every time. While the lookup dataset worked.

Can anyone help me with this?

[Roshanchauhan]

Hi @SwetaRani , 

It’s a bit challenging to pinpoint the exact issue without reviewing the configuration. However, you can follow these steps to help identify the problem.

Step 1: Verify Data Flow and Connection Setup

1. Check the Connection between AEP and CJA:
   • Ensure that the connection between AEP and CJA is properly established.
   • In AEP, go to Data > Connections, verify that the CJA connection is active and correctly configured.
     
     
2. Check the Dataset Configuration:
   • Ensure that the dataset is correctly mapped to the right schema (either Event Schema or Lookup Schema).
   • In AEP > Datasets, check that your dataset is set to push data to CJA.

Step 2: Check Schema Mapping (Identity & Timestamps)

1. Verify Identity Field Mapping:

   • Double-check that the "Quote ID" field is mapped correctly as the identity in both the Event Schema and the CJA schema.
   • Ensure the identity field is not duplicated or conflicting with other identity fields in AEP.

2. Verify Timestamp Field Mapping:

   • If you're using your own timestamp field, ensure it’s mapped correctly in the dataset.
   • Make sure you’re not trying to map a Map data type field to a standard String/Number field. Adobe expects the timestamp to be in a specific format. You can create a custom timestamp field if you don't have one in your source data.
   • If possible, try to map the timestamp directly from the XDM Experience Event to the timestamp field in your dataset.

Step 3: Check the Data Flow Configuration

1. Verify Data Flow Time Interval:

   • Make sure the data flow is set to the correct time interval. Since you’re currently set to 15 hours, try reducing it to a smaller value (e.g., 1 hour) and see if data starts flowing into CJA.
   • In AEP > Data Flow, set the time interval to 1 hour and test the connection again.

2. Confirm Data is Flowing into AEP:

   • Before testing the connection with CJA, make sure that the records are available in AEP. Check that your records are actually being ingested into the platform.
   • Use the AEP Query API to check the data being stored in AEP, and verify if the expected data is present.

Step 4: Test with Minimal Data Setup

1. Create a Minimal Dataset:
   • Create a small sample dataset with a few records (just a handful) that are formatted according to the expected schema.
   • Ensure these records include key fields like the Quote ID and Timestamp.
2. Test the Flow to CJA:
   • Test this minimal dataset by running the data flow to CJA and check if it appears in CJA.

Step 5: Review Event Dataset Configuration

1. Check Event Schema vs Lookup Schema:
   • Event Schema: If you're using an event dataset, ensure that the schema definitions align with CJA’s event processing requirements (e.g., the proper use of event types and timestamp formats).
   • Lookup Schema: If you’re using a lookup schema, ensure that you’re mapping identity fields correctly and that they match across systems.

Step 6: Backfill Data Configuration

1. Check Backfill Settings:
   • Ensure that your backfill settings are configured correctly in AEP, especially for event datasets.
   • Go to AEP > Data > Backfill, and check if there are any issues with the backfill process for your event datasets.
2. Check for Errors in Backfill Logs:
   • Review the backfill logs in AEP to see if any errors are preventing the data from being added.
   • If the backfill fails, identify the reason (e.g., field format issues, missing fields) and resolve them.

Step 7: Verify CJA Configuration

1. Verify Dataset in CJA:

   • In CJA, ensure that the dataset is properly configured to receive the data from AEP.
   • Check the data mappings in CJA to ensure they are consistent with AEP and that the correct datasets are selected.

2. Check Data in CJA:

   • Once you’ve ensured the data is flowing from AEP to CJA, check in CJA > Sources to verify if the records appear there.

Step 8: Use Adobe Experience Platform Debugger

1. Debug the Data Flow:
   • Use Adobe Experience Platform Debugger to check for any errors or issues with your data flow configuration.
   • This can provide more insight into where the flow is failing or where mappings might be incorrect.

[SwetaRani]

Thank you for the debugging steps.

It seems I was mapping my identity field to a field which had common outputs. I needed to map it to a unique key value pair field where all data are different. I started fresh and followed this and it worked.