Level 1

0% to

Level 2

Tip /

to gain points, level up, and earn exciting badges like the new
Mission!

View all

dheerajucla
Offline

6

Accepted Solutions

Accepted Solutions
1

Likes

Likes
5

Posts

Posts
3

Discussions

Discussions
0

Questions

Questions
3

Ideas

Ideas
0

Blog Posts

Blog Posts
0
Top badges earned by dheerajucla
Customize the badges you want to showcase on your profile
Re: Auto-Allocate : Not showing - Lift Bounds and Confidence
dheerajucla
Level 2

Likes

5 likes

Total Posts

3 posts

1 solution
View profile
dheerajucla
Yes, auto-allocation helps determining the winner faster than a manual AB-test but if the test is stopped before reaching the conclusion i.e. before a winner is declared, one just needs to make the best guess based on the metric values, e.g. conversation rate, by himself. It is neither right, nor very useful, to claim a result when there is still a lot of similarity across the experiences as per the underlying algorithm and the test could go in either direction if run for more time. Hope that he...

Views

811

Likes

2

Replies

0
Re: Auto-Allocate : Not showing - Lift Bounds and Confidence
dheerajucla
Level 2

Likes

5 likes

Total Posts

3 posts

1 solution
View profile
dheerajucla
Yes, of course. Once you have the winner , irrespective of how long it takes for the algorithm to determine that depending on the traffic volume and activity, you should start seeing the lift bounds and confidence values.

Views

797

Likes

2

Replies

0
Re: Auto-Allocate : Not showing - Lift Bounds and Confidence
dheerajucla
Level 2

Likes

5 likes

Total Posts

3 posts

1 solution
View profile
dheerajucla
For any activity, lift bounds start showing up for a given experience when it has reached the state of statistical significance in terms of confidence with respect to control and the confidence interval value.What differs auto-allocation based activities is that there is no notion of control experience and the statistical significance of each experience is bound to that of the activity itself, which is attained when the true winner of the activity has been determined by the algorithm. Once that ...

Views

790

Like

1

Replies

0
Likes from