Adobe Real-Time Customer Data Platform

when there are multiple file present int he GCS bucket (file broken into parts by GCS team due to large size), the dataFlow only show overall status, but there is no way to find total how many file DataFlow has processed already and how many is pending to be processed. is it possible in UI or via API to find this ?

is profile-store data exposed in any of the dataset ? is there any possibility to query the profile-store using query service ? except an API for a specific record, is there a way to get result of top 100 records from profile-store ?

Hello Adobe Community,   So, our team is trying to do some cleanup on our total number of profiles in RTCDP and data size. I was wondering if any other teams have experience with this and have any good recommendations for how to reduce either.   Thanks, Nick

DataFlow is running successfully, and it requires further changes in the mapping to add/remove fields. I have seen most of the people create new dataFlow , disable and delete the old dataFlow. is this a good practice to keep creating new dataFlow for any changes and abandon the old dataFlow. Does adobe not provide an option to update existing dataFlow ?

Once data is ingested into dataLake, it create a profile in profile store. when we query the profile using ECID or other namespace, we do see unique profile-id associated with the record. now does this profile-id changes under any circumstance for that particular profile ? if yes, what are those scenario ? is this profile-id present in any dataset, if we need to query it using queryService ?

how to get customer generated dataSet, as the below API only returns system generated dataSets ?https://developer.adobe.com/experience-platform-apis/references/catalog/#operation/listDatasets

profilesnapshot dataset has a field identityMap which has value in map structure. This is one of the sample value of identityMap field from the snapshot. [ecid -> "{(NULL,49790455655365226853605257450011089444,NULL)}",gid -> "{(NULL,3bcaebe5-6723-4822-abd4-2cfb22c4b908,NULL)}",vid -> "{(NULL,bacb8bd9d4aadef2d22482a829f1c149,NULL)}"] [ups -> "[795d22e5-ba6f-43e9-b8d8-e96f2be2e24c -> "(NULL,realized,2025-07-05 16:54:55.0)",73ffb7e5-7988-4108-9dd3-4403b2773915 -> "(NULL,realized,2025-07-05 16:54:55.0)"]"] i want to query snapshot dataset for a specific ecid. i have tried different syntax (cast, unnest, json_extract etc) but none of them worked. this is one of the query i tried. whats the correct syntax to access map values in snapshot dataset ? SELECT * FROM profile_snapshot_export_44b7518a_0a16_44bd_888c_891a9999ef0a whereJSON_EXTRACT(identityMap, '$.ecid[1]') = '49790455655365226853605257450011089444'

There is not at the bottom of this pagehttps://experienceleague.adobe.com/en/docs/experience-platform/sources/connectors/adobe-applications/analyticsYou can use Data Prep to filter out secondary identities coming from Analytics, such as AAID and AACUSTOMID. If filtered out, these identities will not be ingested into Profile if they are available in the incoming Analytics data. Unfiltered data will continue to be loaded into the data lake. Is this correct statement ? How can we filter something for profile-store and have unfiltered data getting ingested into dataLake , is that even possible ?

when a new field is introduced in the schema after it already been enabled for the profile and have the data ingested, how do we ingest the historical data for newly introduce field ? One approach I am ware is create a new dataSet with primary key and new field, and then use that dataset to ingest both historical and incremental data. however this approach may not be scalable, if we introduce new field every quarter, then it would lead to multiple dataset

We have events recorded in the profiles sections which are configured for 45days as a set. And, on rolling days post 45days, the events will be removed from the profile section. However, the events will be stored in datalake for 13months and can be retrieved as an when required as a whole set. Exploring from adobe documentation, there is a way to hold the specific events and can be achieved through SQL. Has anyone used this approach? Any insights or usecases will be highly appreciated. Thanks inadvance. Kind regards,Kiran Buthpur 

Hi Everyone, We have csv.pgp encrypted source files stored in Azure Blob Storage. These files are ingested into the Data Landing Zone using an API-based ingestion process.Our source and target schemas are different. We would like to reference a field from the source file (e.g., CRMID) and use it to update an existing attribute in the target schema (customer_status). However, the customer_status attribute does not exist in the source schema/source file.For example: If CRMID = 12345 (from the source file), then update the customer_status=moved in the target.Could you please advise on the best approach to implement this logic? Should we use Data Prep or Data Distiller after ingestion? Also, what steps or actions should we take to achieve this?Additional questions:CRMID is present in both the source and target schemas. Should this be the primary identifier in both schemas?Do we need to add customer_status field in the source? Is it necessary?If the customer_status field currently has

Hi Team, We are planning to shift to Adobe CDP from exist CDP, please help me to understand steps and what action should be taken initially. Thanks, 

Hi, I have an urgent request and would appreciate a quick response. I'm trying to export a dataset from AEP to a third-party system (Azure Blob/S3/SFTP). The records in these datasets contain PII data, and I cannot select which fields to activate for the destination, as that option is not available in AEP. How can I export the datasets and all the records while skipping the activation of the PII fields? I understand I can label the fields and create a governance policy to restrict activation, but will that restrict the activation of the entire record or just the specific field? Thanks!

  Hi Adobe Community,   I'm currently working in AEP and noticed something odd. While I can see the Audience ID present in the Profile Snapshot, the corresponding Audience is not appearing under the Audience Membership section of the profile.   Has anyone encountered this issue before? Are there specific conditions or delays that might prevent the audience from showing up in the membership view, even though it's clearly linked in the snapshot?   Any insights or suggestions would be greatly appreciated!   Thanks in advance,Indra

There is a requirement to split the historical adobe analytics data into two dataset. dataset1 having key events and enabled for profile. dataset2 having rest of the events(low importance) and not enabled for profile. is there a way to split the data ingestion using dataPrep or other method ?

Hey there! As we all know the profile snapshot dataset is an incredibly powerful tool! I would like to be able to do the 'inverse' and I was curious if anyone has figured out a method for this within AEP already.I would like to be able to query a given Audience ID, and get a result of all customers that are qualified for that audience. It could be a 'realized' state or it any other method, but basically giving me a return of all profiles that fall within the given criteria. I already do this via API for one off checks, and have audiences that I have activated to various platforms, but I would love to be able to do it right within AEP.Does anyone have a solve for this use case?Thanks so much!Tyler Krause

How to create multiple Test Profiles in AEP through API in a one go

Hi everyone, Issue:Due to certain issues, data from some files (corresponding to specific dates) is missing in AEP. We need to ingest this missing data, but we are concerned about potential data duplication in the dataset.Some information on the dataflow setup:Our source data files are stored in Azure Storage Explorer. These are incremental files, with a new file received daily. Each file is retained in Azure Blob Storage for 7 days before deletion.In AEP, we are using the Data Landing Zone (DLZ) and connecting to the Azure source via API.A dataflow has been created to handle incremental data loading from Azure to AEP DLZ via API, and it is currently running on a daily schedule.Current Setup (Example):On May 1st, we performed a one-time data load into the dataset via API. After ingestion, we disabled this dataflow.On May 5th, we created and activated an incremental dataflow for the same dataset. This flow has been running daily and continues to function without issues.However, dat

Hello everyone, we are currently facing a challenge and it is the following: my profiles are being excluded when exporting them to a destination.What could be the cause of this??We did an exercise with the same audience where it was exported to 2 different destinations, in one it was excluded and in the other it didn't exclude anyone.

Hi Community,I’m looking for guidance on how to properly delete a profile in Adobe Real-Time CDP (RTCDP).If I delete a dataset that contributes to profile stitching and profile usage, will that automatically remove the associated profiles from RTCDP?Is it recommended to use the Profile API to delete individual profiles instead?For context, I have already paused the Azure pipelines/workflows in Adobe Experience Platform that were contributing to the dataset I plan to delete.Would appreciate any best practices or insights on how to ensure the profiles are fully removed and not just the dataset.

AEP maintains datLake and profile store separately. dataLake can be queried using the dataset name. how do we query the records from profile store ?

We have multiple environments aligned with our application servers and there are few batch definitions created to process the data based on scheduled batch configurations. However, we are looking into if there's an API that can be used to trigger the batch process manually to check if all the datasets defined executes as expected instead of awaiting on batch to execute on scheduled time. Thanks in advance!

Hi, has anyone who has taken the exam managed to record or remember some of the questions asked?The practice test has only the same 50 questions reoccurring so taking the practice test makes you feel like you know everything but in reality you are answering the same questions over and over again.if anyone has records of the exam questions, could you share it?

Is it possible to create a dynamic segment based on attributes from AEP schema & FAC audience attribute together in same equation ? 

Hi All,Has anyone had success applying retention to the AEP Data Lake. Not TTL from a dataset perspective, but at the DL level itself. A successful POC for us would be the ability to delete an old batch.Would the best way, be to use the following: https://developer.adobe.com/experience-platform-apis/references/catalog/#operation/listBatches