Expand my Community achievements bar.

SOLVED

Can we run A/B test for additional days to achieve sample size(visitors)?

Avatar

Level 1

I have an A/B test run on my client site, but it has not achieved the significant number of visitors within the estimated time period for the test. Can anyone confirm if we could run the test for more number of days to achieve the significant/estimated number of sample size? If so, how many number of maximum days we could run the test further? And can we able to get the significant test results with running it for additional days than the initial estimation?

Thanks in Advance!

Topics

Topics help categorize Community content and increase your ability to discover relevant content.

1 Accepted Solution

Avatar

Correct answer by
Employee Advisor

Hi @Sundhara,

I presume you used the test-duration calculator to determine how long the test should be run, and you are wondering if statistically speaking if letting it run longer is going to compromise the statistical calculations. I think the "days" measure is the less important measure of duration. The more important ones from a stats perspective are total visitors and total conversions per experience. So in short, I'd say yes, run it until you reach the pre-determined per experience visitor volume you need to get a reliable reading on confidence level.

Hope that helps!

View solution in original post

1 Reply

Avatar

Correct answer by
Employee Advisor

Hi @Sundhara,

I presume you used the test-duration calculator to determine how long the test should be run, and you are wondering if statistically speaking if letting it run longer is going to compromise the statistical calculations. I think the "days" measure is the less important measure of duration. The more important ones from a stats perspective are total visitors and total conversions per experience. So in short, I'd say yes, run it until you reach the pre-determined per experience visitor volume you need to get a reliable reading on confidence level.

Hope that helps!