Export AEP Dataset to S3 | Community
Skip to main content
sheejo
sheejo
August 16, 2023
Solved

Export AEP Dataset to S3

  • August 16, 2023
  • 3 replies
  • 2504 views

Hello All

I am trying to export the AEP datasets to AWS S3. I am able to export some datasets successfully. But when I am trying to export "Profile-Snapshot-Export-XXXX" dataset, I am not able to see in the dataset selection list. Is there any restrictions to export the "Profile-Snapshot-Export-XXXX" dataset?

 

Thanks in Advance

Sheejo

    This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
    Best answer by Krish829

    Hi Sheejo,

    The  "Profile-Snapshot-Export-XXXX" dataset is not available to export to the destinations.

    To do so, you have to manually copy the data from the  "Profile-Snapshot-Export-XXXX" dataset to a new profile dataset and set up that new dataset for export to destination. Follow the below steps-

     

    1). Create a new dataset via API(refer below link to create new profile dataset)

    https://experienceleague.adobe.com/docs/experience-platform/profile/api/export-jobs.html?lang=en#create-a-target-dataset

     

    2). Initiate export job via API 

    https://experienceleague.adobe.com/docs/experience-platform/profile/api/export-jobs.html?lang=en#initiate

     

    3). Next, monitor the above export job status via he API-

    https://experienceleague.adobe.com/docs/experience-platform/profile/api/export-jobs.html?lang=en#monitor-export-progress

     

    Krishna

    3 replies

    B
    birthariya
    August 16, 2023

    Hi,

    Dataset Export supports the export of first-generation data, which means raw data directly ingested into AEP from Customer’s data stores or Adobe Experience Cloud solutions.

    Though, you can make a copy of such datasets and export it (also, you can automate the process as necessary).

     

    Thanks

      sheejo
      sheejoAuthor
      August 16, 2023

      @birthariya , I am not aware of the automation process for copying. Could you please explain in detail? Or any documentation is available?

       

      Thanks in advance

      Sheejo

       

       

        B
        birthariya
        August 16, 2023

        By automation process, I meant scheduling the query to populate the new dataset with Profile snapshot data on a daily(or need) basis. 

        Please refer to this to schedule a query: https://experienceleague.adobe.com/docs/experience-platform/query/ui/query-schedules.html?lang=en

         

        Note: Profile snapshots can be huge data to load on a daily basis, please check contractual limitations and try to optimize when copying it to the new dataset.

          _Manoj_Kumar_
          Community Advisor
          _Manoj_Kumar_Community Advisor
          Community Advisor
          August 17, 2023

          Hello @sheejo 

           

          Unfortunately, Only the dataset assigned to out-of-the-box schema types can be exported. 

           

          You will notice that the dataset created by the query service uses "Some Adhoc XDM Schema", which is not compatible with the dataset export feature, and that is why your data set is not appearing in the export list.

           

               Manoj     Find me on LinkedIn
            Krish829
            Krish829Accepted solution
            Level 2
            August 18, 2023

            Hi Sheejo,

            The  "Profile-Snapshot-Export-XXXX" dataset is not available to export to the destinations.

            To do so, you have to manually copy the data from the  "Profile-Snapshot-Export-XXXX" dataset to a new profile dataset and set up that new dataset for export to destination. Follow the below steps-

             

            1). Create a new dataset via API(refer below link to create new profile dataset)

            https://experienceleague.adobe.com/docs/experience-platform/profile/api/export-jobs.html?lang=en#create-a-target-dataset

             

            2). Initiate export job via API 

            https://experienceleague.adobe.com/docs/experience-platform/profile/api/export-jobs.html?lang=en#initiate

             

            3). Next, monitor the above export job status via he API-

            https://experienceleague.adobe.com/docs/experience-platform/profile/api/export-jobs.html?lang=en#monitor-export-progress

             

            Krishna

              Terms & ConditionsAccessibility statement

              Loading footer...