Your achievements

Level 1

0% to

Level 2

Tip /
Sign in

Sign in to Community

to gain points, level up, and earn exciting badges like the new
BedrockMission!

Learn More

View all

Sign in to view all badges

Adobe Sample Size calculator

Avatar

Avatar
Validate 1
Level 1
divyas46613305
Level 1

Like

1 like

Total Posts

7 posts

Correct Reply

0 solutions
Top badges earned
Validate 1
Ignite 1
Give Back
Boost 1
View profile

Avatar
Validate 1
Level 1
divyas46613305
Level 1

Like

1 like

Total Posts

7 posts

Correct Reply

0 solutions
Top badges earned
Validate 1
Ignite 1
Give Back
Boost 1
View profile
divyas46613305
Level 1

18-05-2020

Hi, I am trying to understand the sample size calculator. As with the increase in the lift percentage, the no of days to complete the test is less. Example - if Lift is 15% then Days to complete test is 2 if daily visitors are 1242.
So, how it is calculating this no of days. Could anyone explain how this field nos. are calculating(no of days)

 

divyas46613305_1-1589814373232.png

 

 

Accepted Solutions (1)

Accepted Solutions (1)

Avatar

Avatar
Boost 5
Level 3
TanviAgarwal89
Level 3

Likes

28 likes

Total Posts

33 posts

Correct Reply

16 solutions
Top badges earned
Boost 5
Boost 3
Boost 25
Boost 10
Boost 1
View profile

Avatar
Boost 5
Level 3
TanviAgarwal89
Level 3

Likes

28 likes

Total Posts

33 posts

Correct Reply

16 solutions
Top badges earned
Boost 5
Boost 3
Boost 25
Boost 10
Boost 1
View profile
TanviAgarwal89
Level 3

20-05-2020

.

Answers (2)

Answers (2)

Avatar

Avatar
Boost 5
Level 3
TanviAgarwal89
Level 3

Likes

28 likes

Total Posts

33 posts

Correct Reply

16 solutions
Top badges earned
Boost 5
Boost 3
Boost 25
Boost 10
Boost 1
View profile

Avatar
Boost 5
Level 3
TanviAgarwal89
Level 3

Likes

28 likes

Total Posts

33 posts

Correct Reply

16 solutions
Top badges earned
Boost 5
Boost 3
Boost 25
Boost 10
Boost 1
View profile
TanviAgarwal89
Level 3

20-05-2020

@divyas46613305 

 

The number of days are based on number of visitors/day.

And

Lift is directly related to the number of visitors of the page.

 

If you want the A/B test to have a high probability of detecting a very small lift, the number of visitors that must be included in the test would be prohibitively large. The reason for this is that, if the difference in conversion rate is small, both conversion rates must be estimated with high accuracy to identify the difference, which requires a large number of visitors. 

 

Hope that helps. You can find more explanation here > https://docs.adobe.com/content/help/en/target/using/activities/abtest/sample-size-determination.html...

Avatar

Avatar
Give Back 5
Level 7
Eric_Vidana
Level 7

Likes

154 likes

Total Posts

150 posts

Correct Reply

37 solutions
Top badges earned
Give Back 5
Give Back 3
Give Back 25
Give Back 10
Give Back
View profile

Avatar
Give Back 5
Level 7
Eric_Vidana
Level 7

Likes

154 likes

Total Posts

150 posts

Correct Reply

37 solutions
Top badges earned
Give Back 5
Give Back 3
Give Back 25
Give Back 10
Give Back
View profile
Eric_Vidana
Level 7

19-05-2020

I read it like this: the higher the lift, the quicker the test finds a winner. Lift is a calculated metric based on the typical conversion rate that you provided in accordance with the new offers performing the same conversion metric as control. If an offer is providing 15% lift, then the experiments wraps up with the winner in short order.

 

Side note: you must be doing something right because I think a 2% conversion rate is a good baseline for click-thru banner sort of stuff.