AEP Real-Time Profile not updating after batch ingestion segment membership stale despite successful dataset run | Community
Skip to main content
Level 1
May 17, 2026
Solved

AEP Real-Time Profile not updating after batch ingestion segment membership stale despite successful dataset run

  • May 17, 2026
  • 2 replies
  • 56 views

Hi Community, we are ingesting customer profile data into AEP via batch ingestion into a profile-enabled dataset. The batch runs show as successful in Monitoring and the data is visible in the dataset preview. However the Real-Time Customer Profile is not reflecting the updated attributes and our segment membership is not updating even after 24 hours. Identity stitching is configured with ECID as primary identity. We verified the dataset is profile-enabled and the schema has the correct union schema. Batch status shows as Success with no failed records. What could cause profile not to update even when batch ingestion succeeds?

Best answer by akhil_merupula

Hi ​@deek_kodem,

 

This is a classic AEP gotcha where batch success does not equal profile update success they are two separate pipeline stages and each can fail independently. Here are the four things to check in order.

 

First check Profile ingestion specifically not just batch status. Go to Monitoring, select your dataset, and switch the view from Dataset to Profile. A batch can show Success meaning the data landed in the data lake successfully but profile processing can still fail or be skipped. Look for profile-specific errors here, this is the most common root cause.

 

Second check your merge policy. Go to Customer Profiles, then Merge Policies. If the segment you are checking uses a dataset precedence merge policy and your new dataset is ranked lower than an older dataset with conflicting values, the older values win and the profile appears unchanged even though new data was ingested. Switch to timestamp ordered merge policy to confirm whether this is the issue.

 

Third check identity stitching. If ECID in your batch records does not exactly match the ECID already in the profile store, even a formatting difference like uppercase vs lowercase or extra whitespace,  AEP creates a new profile fragment instead of merging with the existing one. Go to a specific profile in the UI, click Identity Graph, and see if you have duplicate fragments for the same person.

 

Fourth check segment evaluation mode. If your segment is using batch evaluation it only runs once per day on a schedule. If the scheduled run happened before your ingestion completed that person will not show updated membership until the next scheduled evaluation. Switch to streaming evaluation if near-real-time membership is required or manually trigger a segment job.


The most likely culprit based on your description is either profile monitoring showing errors that batch monitoring hides, or a merge policy conflict. Check those two first. Hope that helps!

 

2 replies

akhil_merupulaAccepted solution
Level 4
May 17, 2026

Hi ​@deek_kodem,

 

This is a classic AEP gotcha where batch success does not equal profile update success they are two separate pipeline stages and each can fail independently. Here are the four things to check in order.

 

First check Profile ingestion specifically not just batch status. Go to Monitoring, select your dataset, and switch the view from Dataset to Profile. A batch can show Success meaning the data landed in the data lake successfully but profile processing can still fail or be skipped. Look for profile-specific errors here, this is the most common root cause.

 

Second check your merge policy. Go to Customer Profiles, then Merge Policies. If the segment you are checking uses a dataset precedence merge policy and your new dataset is ranked lower than an older dataset with conflicting values, the older values win and the profile appears unchanged even though new data was ingested. Switch to timestamp ordered merge policy to confirm whether this is the issue.

 

Third check identity stitching. If ECID in your batch records does not exactly match the ECID already in the profile store, even a formatting difference like uppercase vs lowercase or extra whitespace,  AEP creates a new profile fragment instead of merging with the existing one. Go to a specific profile in the UI, click Identity Graph, and see if you have duplicate fragments for the same person.

 

Fourth check segment evaluation mode. If your segment is using batch evaluation it only runs once per day on a schedule. If the scheduled run happened before your ingestion completed that person will not show updated membership until the next scheduled evaluation. Switch to streaming evaluation if near-real-time membership is required or manually trigger a segment job.


The most likely culprit based on your description is either profile monitoring showing errors that batch monitoring hides, or a merge policy conflict. Check those two first. Hope that helps!

 

Devyendar
Level 6
May 18, 2026

@deek_kodem based on what you shared, the most likely issue seem that you might have ingested Batch data before the dataset was Enabled for Profile.

Within the Dataset or in Monitoring at the Batch ID level you can see if any of the data is contributing to the Profile with ‘New Profile Fragment’ or ‘Existing Profile Fragment’ fields.

If no records are shown for Profile fragments then data never reach the Profile and Identity service and Segments qualification failed. You will need to re-ingest the Batch data (only after Schema & Dataset enabled for Profile).

 

If you do see records for Profile Fragments then it is most likely a MergePolicy issues where you have a a rule which gives precedence for other fragments of data in the profile. Check for any Precedence or possibility of time stamp override (with new data ingested from other sources/datasets) and affecting the Profile Lookup and Segment qualification. For Segments too you can check if a Default merge policy or a custom Merge policy was used.

Despite all of these being okay still not seeing data in Profile or Segments, you will need to reach out to Adobe Support for backend investigation