Your achievements

Level 1

0% to

Level 2

Tip /
Sign in

Sign in to Community

to gain points, level up, and earn exciting badges like the new
Bedrock Mission!

Learn more

View all

Sign in to view all badges

How to verify that data ingested into a dataset processed to Profile successfully.

Avatar

Community Advisor

Hi All,

How can I validate/check if the data ingested into dataset processed to Profile successfully?

Thanks

6 Replies

Avatar

Community Advisor

one of the quick way is to grab few random IDs from the data set and try to search from the Profile.

Avatar

Level 4

Hi @Luca_Lattarini 

To get the stats on how many records were ingested, how many moved to profile, how many ids were generated... all this can be derived from the Monitoring dashboard. You can filter by days, check with specific dataflow as well.

 

For records that failed to move to the profile, I am not sure which API can be utilized to fetch that. But there should be a way to find that.

 

As @Lokesh_Shivalingaiah suggested you can randomly perform sanity check as well by searching. However for large data to find the profiles that couldn't make it to UPS - I will check if I can find more details.

 

Thanks,

Chetanya

Avatar

Employee

HI @Luca_Lattarini 

 

1. Check for the status of the batch in the dataset activity tab.

2. You can use the Retrieve Batch Catalog API to receive the same metrics that you see in the dataset activity tab.

Avatar

Community Advisor

Hello @poojasinha @Lokesh_Shivalingaiah @chetanyajain ,

I did some test and I found that check Dataset> Activity and Identies > Browser are the two ways for my marketers. These two ways allow me to monitor from the ingestion part to the Profile side.Is it correct consider that Query Service and Monitoring Batch covers the same ingestion part of Dataset> Activity ?

Thanks

 

Avatar

Employee

Hi @Luca_Lattarini 

 

If marketers are comfortable using the UI they should rely on the Dataset>Activity and Monitoring Tabs to get the metrics/ information from ingestion to profile.  The identities tab will not give them this information.

 

Thanks,

Pooja