Expand my Community achievements bar.

SOLVED

A/B testing level of confidence

Avatar

Former Community Member

Hi,

Does anyone know what is the level of confidence by default? is it 80%? 90% or less?

also, can I control it somehow?

 

I really need to know in order to know how trustable is my test.

Thanks!

1 Accepted Solution

Avatar

Correct answer by
Employee

Hi Ido,

 

The level of confidence is calculated, not controllable, and there is no default value. We will suggest you make the decision once the confidence level reaches 95% or above. Generally speaking, the longer period of your test will bring more traffic and have a higher possibility of reaching a confidence level of 95% above. For more information about confidence level, please refer to the link below

https://marketing.adobe.com/resources/help/en_US/target/target/c_confidence_level_and_confidence_int...

 

Hope that helps.

 

Best,

Nic

View solution in original post

1 Reply

Avatar

Correct answer by
Employee

Hi Ido,

 

The level of confidence is calculated, not controllable, and there is no default value. We will suggest you make the decision once the confidence level reaches 95% or above. Generally speaking, the longer period of your test will bring more traffic and have a higher possibility of reaching a confidence level of 95% above. For more information about confidence level, please refer to the link below

https://marketing.adobe.com/resources/help/en_US/target/target/c_confidence_level_and_confidence_int...

 

Hope that helps.

 

Best,

Nic