Merging partial data to existing profiles

[FlorijanGa1]

Hi all, I have a specific situation concerning ingesting partial updates for profiles in AEP.

The situation is that we have some data coming in Google Cloud Storage buckets, and we need to ingest the data to AEP but it is only a partial insert to a profile. We want to add data to a let's say Person schema without completely replacing all the data in the Person schema dataset, while avoiding creating "orphan profiles" i.e. new profiles with only partial data.

Here Send partial row updates to Real-Time Customer Profile using Data Prep is the page we thought to find the solution but it seems it falls just short of our requirement.

The question is how we can do this and is it even possible at this time?

Thank you for your time

[brekrut · Accepted solution]

Hello @FlorijanGa1 

Reviewing the information you have provided it appears you will need to use the upset feature of Adobe RTCDP.  The upsert option can be enabled upon a dataSet and can account for partial profile updates.  

Please review the following information and perform this testing within an dev instance before pushing this change to production.

https://experienceleague.adobe.com/en/docs/experience-platform/catalog/datasets/enable-upsert

[ReenaJohn]

Hi @FlorijanGa1 ,

Please use the Upsert feature to enable partial ingestions in Batch and Streaming data. 

For Batch data upsert refer to this document - https://experienceleague.adobe.com/en/docs/experience-platform/catalog/datasets/enable-upsert

For Streaming data upsert refer to this document - 

Send Partial Row Updates To Real-Time Customer Profile Using Data Prep | Adobe Experience Platform

Warm Regards,

Reena John