Skip to main content
Anonymous
Jul 31, 2016 7:11 AM UTC
Solved

A/B testing level of confidence

Hi,

Does anyone know what is the level of confidence by default? is it 80%? 90% or less?

also, can I control it somehow?

 

I really need to know in order to know how trustable is my test.

Thanks!

    This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
    nicolasw7824172
    nicolasw7824172Accepted solution
    Adobe Employee
    Aug 17, 2016 6:42 PM UTC

    Hi Ido,

     

    The level of confidence is calculated, not controllable, and there is no default value. We will suggest you make the decision once the confidence level reaches 95% or above. Generally speaking, the longer period of your test will bring more traffic and have a higher possibility of reaching a confidence level of 95% above. For more information about confidence level, please refer to the link below

    https://marketing.adobe.com/resources/help/en_US/target/target/c_confidence_level_and_confidence_interval.html

     

    Hope that helps.

     

    Best,

    Nic

    View in thread

    1 reply

    nicolasw7824172
    Adobe Employee
    nicolasw7824172Adobe EmployeeAccepted solution
    Adobe Employee
    Aug 17, 2016 6:42 PM UTC

    Hi Ido,

     

    The level of confidence is calculated, not controllable, and there is no default value. We will suggest you make the decision once the confidence level reaches 95% or above. Generally speaking, the longer period of your test will bring more traffic and have a higher possibility of reaching a confidence level of 95% above. For more information about confidence level, please refer to the link below

    https://marketing.adobe.com/resources/help/en_US/target/target/c_confidence_level_and_confidence_interval.html

     

    Hope that helps.

     

    Best,

    Nic

    Translate
      Terms & ConditionsAccessibility statement

      Loading footer...