Skip to main content
jonathanl557422
jonathanl557422
Level 2
Oct 19, 2020 3:01 PM UTC
Solved

Seeing winning experience with A4T

Is it possible to view which experience was the winning version when using A4T reporting?

My use case is wanting to get a count of all the winning experiences launched in a particular timeframe.

    This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
    Kishore_Reddy
    Kishore_ReddyAccepted solution
    Community Advisor
    Dec 29, 2021 2:52 PM UTC

    1. Calculate the expected value of whatever the KPI you use for A/B test with a lift that you expect (say 5% lift on conversion rate of 2% - which is a KPI) by using this calculator

     

    2. You can try using Bullet graph on Workspace with the expected value on the KPI (say, new CVR value is 5.15%) as a goal

     

    3. As the test runs, you can see a variant (control or treatments) showing their value with respect to the expected value of the KPI. Whichever variant reaches or crosses the goal set on bullet graph, that's a clear winner

    View in thread

    3 replies

    Adobe Employee
    karandhawanAdobe Employee
    Adobe Employee
    Nov 26, 2020 10:14 AM UTC

    @jonathanl557422 In Target when a clear winner is declared, Target displays “Winner: Experience X.”

     

    Regards,

    Karan

    Translate
      jonathanl557422
      jonathanl557422Author
      Level 2
      Jan 13, 2021 5:12 PM UTC
      Thanks Karan. Do you know if there's something similar in the Analytics UI when using A4T?
      Translate
        Kishore_Reddy
        Community Advisor
        Kishore_ReddyCommunity AdvisorAccepted solution
        Community Advisor
        Dec 29, 2021 2:52 PM UTC

        1. Calculate the expected value of whatever the KPI you use for A/B test with a lift that you expect (say 5% lift on conversion rate of 2% - which is a KPI) by using this calculator

         

        2. You can try using Bullet graph on Workspace with the expected value on the KPI (say, new CVR value is 5.15%) as a goal

         

        3. As the test runs, you can see a variant (control or treatments) showing their value with respect to the expected value of the KPI. Whichever variant reaches or crosses the goal set on bullet graph, that's a clear winner

        Translate
          Terms & ConditionsAccessibility statement

          Loading footer...