Level 3

Adobe Target - Confidence - 99% - Clarification

Forum|Forum|6 years ago
September 4, 2019
2 replies
8295 views

Hi Experts,

Newbie here in Target :-).

We have setup a A/B campaign.

The experience seems to work. Nevertheless, there is one curious number, the confident rate one. After a day we got over 99% of confidence while the traffic on this website is not high enough to generate this kind of confident rate after a day. (refer attached screenshot)

I've gone through Adobe Target documentation but I'm not able to follow the concepts.

Adobe Link - Average Lift, Lift Bounds, and Confidence Interval

Please help.

Thanks,

PV

Target

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

Andrey_Osadchuk

Level 10

Regardless of what Confidence Level is after a day, consider to continue the test for at least a full week.

I wonder why the Orders metric indicates 0.12 and 0.05 (I would expect these numbers percent-formatted)? Does 1504 stand for the total number of orders?

Can you share the full screenshot?

P

prathiv23Author

Level 3

Thank you Andrey Osadchuk for checking this scenario

Here is the entire screenshot:

Andrey_Osadchuk

Level 10

Thanks for sharing. Now it's clear that 0.13 and 0.05 are 13% and 5% conversion rates. Pay attention to the date range, it indicates a month not a day mentioned in the initial question.

S

Shruti_Premkumar

Adobe Employee

prathiv23 Also when running A/B tests and reading confidence values there are some things you should keep in mind. Always use sample size calculator to determine how long you should run the test before looking at the data. Here are some resources that should be helpful.

Nine common A/B testing pitfalls and how to avoid them

How long should you run an A/B test?

Sign up

Login with SSO

Login to the community

Login with SSO

Scanning file for viruses.

This file cannot be downloaded