Conditionally include partial data from a source/dataflow into Profile | Community
Skip to main content
Devyendar
Devyendar
Level 6
October 23, 2025
Question

Conditionally include partial data from a source/dataflow into Profile

  • October 23, 2025
  • 2 replies
  • 500 views

When we profile enable a Schema and Dataset from Marketo, all the data ingested into it is included in profile. But we have data quality issues in Marketo due to which do not want to include all the data into Profile, only certain data matching few qualified campaigns should be included into profile. Marketo doesn't support row level filtering for Individual Records data. Is there any easier way to achieve this?

2 replies

K
Karuppiah_Sakthivel
Level 4
October 28, 2025

Hi,

When a Marketo schema and dataset are Profile-enabled, all ingested records automatically flow into the Real-Time Customer Profile — there’s no way to apply row-level filters within the Marketo connector.

To include only qualified records (e.g, specific campaigns), the easiest approach is to:

  1. Ingest all Marketo data into a non-Profile dataset (your raw landing zone).
  2. Create a second, Profile-enabled dataset with the same schema.
  3. Use Query Service (or Data Distiller) to filter and copy only the qualified rows into the Profile-enabled dataset.
  4. Schedule this query so your Profile dataset stays up to date
Devyendar
DevyendarAuthor
Level 6
October 28, 2025

@karuppiah_sakthivel We are using the Query approach for the time being, we want to move away for this, as Queries make Marketo data work for only Batch Segmentation (as it is considered as Batch dataset). The original Marketo Connector based data can be used for Streaming Segments and real-time use cases. These use cases are impacted using Query ingestion and query execution on large volume of data can not adversely impact Query performance/failures.

    K
    Karuppiah_Sakthivel
    Level 4
    October 30, 2025

    Good point — using Query Service does make the dataset batch-only, so we lose streaming segmentation and real-time updates from the Marketo connector. It’s a solid workaround for data quality control, but ideally Adobe should let us apply filters directly on the Marketo source to keep streaming use cases intact.

      Sukrity_Wadhwa
      Community Manager
      Sukrity_WadhwaCommunity Manager
      Community Manager
      November 17, 2025

      Hi @devyendar,

      Were you able to resolve this query with the help of the provided solutions, oror was this something you were able to figure out on your own? Please let us know. If any of the answers were helpful in moving you closer to a resolution, even partially, we encourage you to mark the one that helped the most as the 'Correct Reply.'

      Thank you!

      Sukrity Wadhwa
      Terms & ConditionsAccessibility statement

      Loading footer...