Expand my Community achievements bar.

JOIN US Next Wednesday, 12/6/23 @ 8am PT for the next Community Q&A Coffee Break! Bring your Machine Learning, AI Reporting & Analysis Questions to the chat. Experts Brent Kostak, Cristinel Anastasoaie, & Drew Burns of the Adobe Target Product Team will be providing deep insights and useful tips

Alerts for Reaching Statistical Significance


Level 1


I would like an automatic way to be alerted of when our a/b tests have hit statistical significance. Currently the process is manual. We use the confidence calculator to predict when a test hits statistical significance and put a calendar reminder to check-in at the appropriate time. We also monitor our activities. However things come up (like PTO, absence/sick, job transitions, trainings etc). Current state is not a scalable process when we have many a/b tests running across multiple workspaces and have multiple report suites. We have an activity tracker where we put all of our details from our tests plan in it and use as our source of truth. However, we are in Target and Analytics frequently.


I would normally try this through creating an alert, however lift and confidence are not standard Analytics metrics so you cannot choose them when creating rules in the Alert Builder.

1 Comment