Activating a Large Audience to Destination

[JathiRatnalu]

HI All, --------------------------- I wanted to Export a large audience like 60 to 100 M to a cloud destination like blob with only 1 field like FirstName or email. --------------------------- The current dev and stage sandboxes have a limit of 4M max as the upper limit of engageable profiles. So is there a way to deduplicate the existing audiences to create a new audiences?. --------------------------- Approach Tried - 1. I have tried to use Audience composition rule builder. But there isn't a native option to do this? --------------------------- Approach thinking to try - 1. Make a FAC audience connection and create a large volume audiences. 2. Activate the large volume to destination ( I doubt even to activate, it comes under engageable limit. --------------------------- Let me know of any other ways. --------------------------- Thanks

[Imbalakumar · Accepted solution]

Hi @JathiRatnalu

If you have limitation under your license or account permission, you are right, you will end up with engageable limit.

In general, Adobe has few "Guardrails" like performance or system enforced while we do data ingestion, audience segmentation, query service etc. Refer this to know more - https://experienceleague.adobe.com/en/docs/experience-platform/rtcdp/guardrails/overview

May be try, splitting the audience based on date range or profile type or any other rule and activate in batches to FTP or any other destination and ingest to the destination platform.

Refer Guardrails for data activation to understand them - https://experienceleague.adobe.com/en/docs/experience-platform/destinations/guardrails 

Thanks,

Bala

[JathiRatnalu]

Thanks @AnkitJasani29  & @Imbalakumar. My end Goal is to Export a large volume audiences using an API call. So that I could activate this in 1 single dataflow from external systems call. We have large audiences in Prod but not in lower Env's to test before publishing. I think the only way is to test this in PROD directly.

[Imbalakumar]

Yes, since no option, you can try in Prod making sure no impact to end customer experience or any other issues that impacts business goals.

Let us know if it worked out well for you.

[AnkitJasani29]

Hi @JathiRatnalu ,

You can use Query Service to de-duplicate and select only the fields you need and based on the result you can create dataset and push it on a schedule into blob via a dataflow.

The system will run your Query under the covers and deliver all rows directly into blob, auto-splitting at 5 M rows per file.

Reference: 

https://experienceleague.adobe.com/en/docs/experience-platform/destinations/ui/activate/export-datas...

https://experienceleague.adobe.com/en/docs/experience-platform/destinations/guardrails

https://experienceleague.adobe.com/en/docs/experience-platform/destinations/api/connect-activate-bat...

Thanks

Ankit

[kautuk_sahni]

@JathiRatnalu Just checking in — were you able to resolve your issue?
We’d love to hear how things worked out. If the suggestions above helped, marking a response as correct can guide others with similar questions. And if you found another solution, feel free to share it — your insights could really benefit the community. Thanks again for being part of the conversation!