Marketo source connector can we put some filters on incoming data

[ShainiGu]

Hi All,

We are using Marketo source connector so just wanted to check if we can do some filtering or customization on the data which is getting ingested from Marketo connector.

Thanks & Regards

Shaini Gupta

[Parvesh_Parmar · Accepted solution]

Hello @ShainiGu ,

You can perform data transformation and validation before ingesting data into AEP.

1. Data Transformation: During the data mapping steps, when you set up your data flow, you can use built-in functions to transform the data. For example, if you have an email address in Marketo, you can encrypt in SHA256 it during ingestion.
For more details, please refer to the following links:

https://experienceleague.adobe.com/en/docs/experience-platform/data-prep/ui/mapping#add-a-new-field-...

https://experienceleague.adobe.com/en/docs/experience-platform/sources/ui-tutorials/create/adobe-app...

2. Data Validation: If you define any attribute as required in your schema, if there is a records missing that attribute during data ingestion, this record will be dropped. You should also set a threshold for error records. For example, if you set the threshold at 5% and more than 5% of records do not have the required attributes, the data flow will stop. You can enable partial ingestion to allow the process to continue with valid records.

https://experienceleague.adobe.com/en/docs/experience-platform/sources/ui-tutorials/create/adobe-app...

Best regards,
Parvesh

[kautuk_sahni]

@ShainiGu Did you find the suggestion helpful? Please let us know if you require more information. Otherwise, please mark the answer as correct for posterity. If you've discovered a solution yourself, we would appreciate it if you could share it with the community. Thank you!