which API to be used to get the adhock query response using python ?

this from https://experienceleague.adobe.com/en/docs/experience-platform/query/use-cases/data-explorationit says that set drop_system_columns=false;would show metadata columns _acp_system_metadata and _ACP_BATCHID when i run below query, it works fineselect * from datasetName but when i run this que...

Description -Ability to filter DataFlow based on Target dataSet is missing in the AEP UI Why is this feature important to you -When there are 10s of more dataFlow going into a perticular dataSet, we only have an option to filter by source Application. Many times we want to see how many dataFlow are ...

Data in BigQuery is present in the format of array of object. where each value in the object is string.[{ "MODEL_NAME":"PRP__TRIGGER_1Y_14DLAG","MODEL_DECILES":"5","MODEL_SCORE":"0.049972750246524811","DATE":"2024-12-29"},{ "MODEL_NAME":"PRP_60D_LAPS_1Y_REV1","MODEL_NAME":"9","MODEL_SCORE":"0.459688...

when there are multiple file present int he GCS bucket (file broken into parts by GCS team due to large size), the dataFlow only show overall status, but there is no way to find total how many file DataFlow has processed already and how many is pending to be processed. is it possible in UI or via AP...

is there an API which can tell list of all dataFlow which are pointing to same dataSet ?secondly, the dataFlow UI doesnt have schema based or dataSet based filtering, any hack to find the list from UI too ? The only filter in UI is related to source applicaiton.

is it fair to say the profileSnapshot export dataSet is a -1D copy of profile store ?

Consider dataStream have 10 fields from profile enabled schema. is there a way to restrict few fields in AEP dataLake ingestion, while getting all fields forwarded to other service such as Adobe Analytics ? So out of 10 fields , only 3 fields goes into dataLake but all 10 field goes into adobe analy...

once export-jobs is setup using API, I can see another set of API to check the Status. But can we also see profile-export status in the UI , would that reflect in the dataFlow tab or somewhere else ?

great thanks for sharing the limitation with source application.i just found that another API supports the mapping update.https://experienceleague.adobe.com/en/docs/experience-platform/sources/api-tutorials/update-dataflows