A/B testing level of confidence | Community
Skip to main content
A
Anonymous
July 31, 2016
Solved

A/B testing level of confidence

  • July 31, 2016
  • 1 reply
  • 1638 views

Hi,

Does anyone know what is the level of confidence by default? is it 80%? 90% or less?

also, can I control it somehow?

 

I really need to know in order to know how trustable is my test.

Thanks!

    This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
    Best answer by nicolasw7824172

    Hi Ido,

     

    The level of confidence is calculated, not controllable, and there is no default value. We will suggest you make the decision once the confidence level reaches 95% or above. Generally speaking, the longer period of your test will bring more traffic and have a higher possibility of reaching a confidence level of 95% above. For more information about confidence level, please refer to the link below

    https://marketing.adobe.com/resources/help/en_US/target/target/c_confidence_level_and_confidence_interval.html

     

    Hope that helps.

     

    Best,

    Nic

    1 reply

    nicolasw7824172
    Adobe Employee
    nicolasw7824172Adobe EmployeeAccepted solution
    Adobe Employee
    August 17, 2016

    Hi Ido,

     

    The level of confidence is calculated, not controllable, and there is no default value. We will suggest you make the decision once the confidence level reaches 95% or above. Generally speaking, the longer period of your test will bring more traffic and have a higher possibility of reaching a confidence level of 95% above. For more information about confidence level, please refer to the link below

    https://marketing.adobe.com/resources/help/en_US/target/target/c_confidence_level_and_confidence_interval.html

     

    Hope that helps.

     

    Best,

    Nic

      Terms & ConditionsAccessibility statement

      Loading footer...