Query Dataset Using Batch ID

[SundarSritharan]

Hello Team,

We all know, there is batch ingestion can be done to populate AEP Datasets. So, in that case is there any way that I can query tables using where batch_id = ""? (batch id as reference). -> To query specific to batch id.

Thanks,

Sundar

[arijitg · Accepted solution]

@SundarSritharan yes, you can use metadata column as a filter like below : 

where
_acp_system_metadata.acp_sourceBatchId = '<Your Batch Id Here>'

[Ankita5]

@arijitg 
This solved my issue too.

Follow up question: Can we also get the batch ingestion timestamp from _acp_system_metadata columns. What all _acp_system_metadata columns are available to be queried?

Thanks in advance

[arijitg]

Hi @Ankita5 

Batch ingestion timestamp is not available. Best practice is to pass now() in dataprep to extSourceSystemAudit.createdDate (available in "External Source System Audit Details" standard field group) to maintain ingestion timestamp, this helps in Audit purpose.