Your achievements

Level 1

0% to

Level 2

Tip /
Sign in

Sign in to Community

to gain points, level up, and earn exciting badges like the new
Bedrock Mission!

Learn more

View all

Sign in to view all badges

SOLVED

A/B testing level of confidence

idob17895314
Level 2
Level 2

Hi,

Does anyone know what is the level of confidence by default? is it 80%? 90% or less?

also, can I control it somehow?

 

I really need to know in order to know how trustable is my test.

Thanks!

1 Accepted Solution
nicolasw7824172
Correct answer by
Employee
Employee

Hi Ido,

 

The level of confidence is calculated, not controllable, and there is no default value. We will suggest you make the decision once the confidence level reaches 95% or above. Generally speaking, the longer period of your test will bring more traffic and have a higher possibility of reaching a confidence level of 95% above. For more information about confidence level, please refer to the link below

https://marketing.adobe.com/resources/help/en_US/target/target/c_confidence_level_and_confidence_int...

 

Hope that helps.

 

Best,

Nic

View solution in original post

1 Reply
nicolasw7824172
Correct answer by
Employee
Employee

Hi Ido,

 

The level of confidence is calculated, not controllable, and there is no default value. We will suggest you make the decision once the confidence level reaches 95% or above. Generally speaking, the longer period of your test will bring more traffic and have a higher possibility of reaching a confidence level of 95% above. For more information about confidence level, please refer to the link below

https://marketing.adobe.com/resources/help/en_US/target/target/c_confidence_level_and_confidence_int...

 

Hope that helps.

 

Best,

Nic

View solution in original post