Your achievements

Level 1

0% to

Level 2

Tip /
Sign in

Sign in to Community

to gain points, level up, and earn exciting badges like the new
BedrockMission!

Learn More

View all

Sign in to view all badges

Alerts for Reaching Statistical Signficance

Avatar

Avatar
Shape 1
Level 1
aparker2
Level 1

Likes

0 likes

Total Posts

2 posts

Correct Reply

0 solutions
Top badges earned
Shape 1
View profile

Avatar
Shape 1
Level 1
aparker2
Level 1

Likes

0 likes

Total Posts

2 posts

Correct Reply

0 solutions
Top badges earned
Shape 1
View profile
aparker2
Level 1

18-05-2021

Hello -

 

I submitted an idea for this, but wondering if anyone else has a suggestion or recommendation?

 

I would like an automatic way to be alerted of when our a/b tests have hit statistical significance. Currently the process is manual. We use the confidence calculator to predict when a test hits statistical significance and put a calendar reminder to check-in at the appropriate time. We also monitor our activities. However things come up (like PTO, absence/sick, job transitions, trainings etc). Current state is not a scalable process when we have many a/b tests running across multiple workspaces and have multiple report suites. We have an activity tracker where we put all of our details from our tests plan in it and use as our source of truth. However, we are in Target and Analytics frequently.

 

I would normally try this through creating an alert, however lift and confidence are not standard Analytics metrics so you cannot choose them when creating rules in the Alert Builder.

 

Link to the idea: https://experienceleaguecommunities.adobe.com/t5/adobe-target-ideas/alerts-for-reaching-statistical-...

 

Accepted Solutions (0)

Answers (0)