Query 1:
If the query output number is in the millions, will it be able to successfully ingest the data into a data lake, profile store, or identity services?
Test use case: An error was thrown when batch ingesting data larger than 20 GB.
Few limitation is available in the below link required some additional information.
Ref url: Export Datasets to Cloud Storage Destinations | Adobe Experience Platform
Hi @vvishnu0332 - Seems there is a limit up to 20 GB of data per hour to data lake using the batch ingestion API.
Batch Ingestion Guardrails - https://experienceleague.adobe.com/docs/experience-platform/ingestion/guardrails.html?lang=en#:~:text=You%20can%20ingest%20up%20to%2020%20GB%20of%20data%20per%20hour%20to%20data%20lake%20using%20the%20batch%20ingestion%20API.
Default Guardrails - https://experienceleague.adobe.com/docs/experience-platform/profile/guardrails.html?lang=en
Refer the above limits to avoid the error on your ingestion.
Thank you,
Jay.
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.