Query Dataset Using Batch ID | Community
Skip to main content
S
SundarSritharan
Level 2
March 29, 2023
Solved

Query Dataset Using Batch ID

  • March 29, 2023
  • 1 reply
  • 5372 views

Hello Team,

 

We all know, there is batch ingestion can be done to populate AEP Datasets. So, in that case is there any way that I can query tables using where batch_id = ""? (batch id as reference). -> To query specific to batch id.

 

Thanks,

Sundar

Best answer by arijitg

@sundarsritharan yes, you can use metadata column as a filter like below : 

 

where
_acp_system_metadata.acp_sourceBatchId = '<Your Batch Id Here>'

1 reply

arijitg
Adobe Employee
arijitgAdobe EmployeeAccepted solution
Adobe Employee
March 29, 2023

@sundarsritharan yes, you can use metadata column as a filter like below : 

 

where
_acp_system_metadata.acp_sourceBatchId = '<Your Batch Id Here>'

    A
    Adobe Employee
    Ankita5Adobe Employee
    Adobe Employee
    October 26, 2023

    @arijitg 
    This solved my issue too.

    Follow up question: Can we also get the batch ingestion timestamp from _acp_system_metadata columns. What all _acp_system_metadata columns are available to be queried?

     

    Thanks in advance

    arijitg
    Adobe Employee
    arijitgAdobe Employee
    Adobe Employee
    October 26, 2023

    Hi @ankita5 

     

    Batch ingestion timestamp is not available. Best practice is to pass now() in dataprep to extSourceSystemAudit.createdDate (available in "External Source System Audit Details" standard field group) to maintain ingestion timestamp, this helps in Audit purpose.

      Terms & ConditionsAccessibility statement

      Loading footer...