That's correct @arpan-garg it's recommended that we do all joins, lookup, aggregations etc to the source and send the finalized data to AEP.

Hi @mansibedi on demand jobs are ad-hoc evaluation so you need to run every time.AFAIK if you try to schedule it to run every 3 hour the request shall fail with a 400 response due to chronos schedule validation. You can only schedule the job at most once a day. Regards,Arijit Ghosh

Hi @mansibedi  1. If you query the identityMap or explode it you can see values f/t within the object this denotes secondary/primary. ECID is primary by default and AAID is secondary but in case ECID is not generated then AAID is set as primary. (select identitymap from <AA_Dataset> limit 2;) 2. I t...

Hi @mansibedi 1. Yes, profiles should qualify. As they're from AA dataset I would suggest if you can write a query to mimic the same segment logic and check count from data lake. They won't be exact but you will have an estimate. 2. I assumed you're using OOTB source connector for AA in that case da...

Sorry @arpan-garg AEP has limited ETL capability and data-prep functions does not support such target table lookup feature that you're expecting.

@sowndharya possible if the profile & event datasets you've selected doesn't have any common identity to link (less likely to happen) otherwise I think due to low cardinality in your identity values the subset of data used to generate this preview couldn't find any match within (you can raise a supp...

Thanks @sowndharya for confirming.As array elements can't cater a tabular view so when you go to preview dataset you won't be able to see the values, correct way to validate them is using query service like you did.

Hi @mansibedi if I understand correctly your segment has only 1 event attribute of "URL parameter contains xxxx" but no profile attribute and it's still not populating any audience? I got confused by your reference "Schema for Adobe Analytics in CDP has Hashed ID and ECID both as Secondary Identifie...

Hi @sowndharya just to make sure that your output appears to be empty can you once check from data lake please (explode that particular object in a select query) that none of the record has them mapped?

@Parm2 There are certain profile guardrails that @arpan-garg shared above and there are certain ingestion guardrails (Guardrails for Data Ingestion | Adobe Experience Platform) that you can check but no such hard guardrail on dataset size as of now.Though we are not aware about your data or use case...