Incremental Dataset Export Options in AEP

Question

Hi everyone,

Using AEP Query Service, we have created a derived dataset by joining selected fields from the Profile dataset and the Event dataset, along with performing deduplication. The resulting data is stored in a derived dataset, which we then export to cloud storage destinations such as SFTP or a data landing zone in Azure.

How can we perform this export action incrementally using Data Distiller and dataset export in Destinations?

Currently, we do not have the option to export dataset files in CSV format. Can this use case be achieved by using Audiences instead, and exporting the audience in CSV format? The solution should also support incremental export.

Could someone help us with the best option to achieve this?Data distiller or using Audiences

Thanks!

SG14_97 · Accepted Answer

Data Distiller based derived datasets should be available for incremental export (mind that the first export will always be full extract followed by incremental logic). CSV as of now is not supported, if you have some transformation tools available for example Azure Data Factory you can easily parse the json and convert it to a csv extract ready for use.

Sukrity_Wadhwa · Answer

Hi ​@AEPuser16,Was the given solution by ​@SG14_97helpful to resolve your query or do you still need more help here?Do let us know. In case the given solution was helpful, then kindly choose it as the 'Best Answer'.Thanks!

Sign up

Login with SSO

Login to the community

Login with SSO

Scanning file for viruses.

This file cannot be downloaded