Expand my Community achievements bar.

SOLVED

Seeing winning experience with A4T

Avatar

Level 3

Is it possible to view which experience was the winning version when using A4T reporting?

My use case is wanting to get a count of all the winning experiences launched in a particular timeframe.

1 Accepted Solution

Avatar

Correct answer by
Community Advisor

1. Calculate the expected value of whatever the KPI you use for A/B test with a lift that you expect (say 5% lift on conversion rate of 2% - which is a KPI) by using this calculator

 

2. You can try using Bullet graph on Workspace with the expected value on the KPI (say, new CVR value is 5.15%) as a goal

 

3. As the test runs, you can see a variant (control or treatments) showing their value with respect to the expected value of the KPI. Whichever variant reaches or crosses the goal set on bullet graph, that's a clear winner

View solution in original post

3 Replies

Avatar

Employee

@jonathanl557422 In Target when a clear winner is declared, Target displays “Winner: Experience X.”

 

Regards,

Karan

Avatar

Level 3
Thanks Karan. Do you know if there's something similar in the Analytics UI when using A4T?

Avatar

Correct answer by
Community Advisor

1. Calculate the expected value of whatever the KPI you use for A/B test with a lift that you expect (say 5% lift on conversion rate of 2% - which is a KPI) by using this calculator

 

2. You can try using Bullet graph on Workspace with the expected value on the KPI (say, new CVR value is 5.15%) as a goal

 

3. As the test runs, you can see a variant (control or treatments) showing their value with respect to the expected value of the KPI. Whichever variant reaches or crosses the goal set on bullet graph, that's a clear winner