Restrict Data processing to profile store for profile enabled dataset using httpAPI source connector | Community
Skip to main content
itsMeTechy
itsMeTechy
September 8, 2025
Solved

Restrict Data processing to profile store for profile enabled dataset using httpAPI source connector

  • September 8, 2025
  • 3 replies
  • 465 views

 

is there a way to disable data flow partially, meaning that fine to process the data to data lake, but not to profile store. 

 

source connector is httpapi, target dataset is profile enabled.

Best answer by marc_stowe_za

Hi, the only way would be to setup a second dataset that is not profile enabled and stream to that one. 

 

There may be a use case then to use data distiller to select records from that dataset and move them to the active dataset to include them for the identity graph

3 replies

M
marc_stowe_zaAccepted solution
September 10, 2025

Hi, the only way would be to setup a second dataset that is not profile enabled and stream to that one. 

 

There may be a use case then to use data distiller to select records from that dataset and move them to the active dataset to include them for the identity graph

    AmarapuramMahesh
    AmarapuramMahesh
    September 19, 2025

    Hi,
    When you send data to a profile-enabled dataset in Adobe Experience Platform, it goes into both the Data Lake and the Profile store ,there’s no way to split that up. If you want to keep some data out of customer profiles, start by putting it into a non-profile-enabled dataset so it stays just in the Data Lake. Later, you can use Data Distiller to run SQL queries and carefully select only the data you want to move into the Profile store. This way, you control what gets activated for customer engagement and keep your data management clean and strategic.

      Sukrity_Wadhwa
      Community Manager
      Sukrity_WadhwaCommunity Manager
      Community Manager
      September 22, 2025

      Hi @itsmetechy,

      Were you able to resolve this query with the help of the provided solutions, or do you still need further assistance? Please let us know. If any of the answers were helpful in moving you closer to a resolution, even partially, we encourage you to mark the one that helped the most as the 'Correct Reply.'

      Thank you!

      Sukrity Wadhwa
      Terms & ConditionsAccessibility statement

      Loading footer...