Look-up datasets in AEP

@aditikaushik  This came right from AI Assistant in AEP

Creating lookup datasets in Adobe Experience Platform (AEP) for classifications involves a series of steps to ensure that the datasets are accurately mapped and ingested. Here's a comprehensive guide to help you create lookup datasets in AEP for classifications:

1. Create a Dataset with Associated Schema:

   • Start by choosing the "New Dataset" option and providing a name and description for the dataset.
   • Use the schema finder to assign a schema to the dataset. This step involves mapping the source file field to the target field based on the title and type of the fields. Pre-mapping of standard fields is editable, and you can add new field mappings to map a source field to a target field.

2. Add Calculated Fields and Preview Data:

   • After selecting a schema for the dataset, you can add calculated fields to run functions on source fields to prepare the data for ingestion. For example, you can combine the first name and last name fields into a calculated field using the Concatenation function before ingesting the data into a dataset field.
   • Preview the sample result of a calculated field and review the field mapping to ensure that the ingested data will be stored accurately in your dataset.

3. Set Scheduling and Backfill Options:

   • The scheduling step allows you to choose a frequency at which data should flow from the source to the dataset. You can select a frequency, such as 15 minutes, and set a start time for data flow.
   • Enable the backfill option if you want historical data to be ingested. Backfill is a Boolean value that determines what data is initially ingested. If enabled, all current files in the specific pot will be ingested during the first scheduled ingestion.

By following these steps, you can create lookup datasets in AEP for classifications, ensuring that the data is accurately mapped, ingested, and scheduled for future data flows.

Sources

1. Create data sets and ingest data: DocumentationJourney,Loyalty Data andthen... 
2. Configure a Dataflow to Ingest Batch Data from a Cloud Storage Source in the UI: Lets choose the...