Can we run A/B test for additional days to achieve sample size(visitors)? | Community
Skip to main content
S
Sundhara
June 14, 2021
Solved

Can we run A/B test for additional days to achieve sample size(visitors)?

  • June 14, 2021
  • 1 reply
  • 1072 views

I have an A/B test run on my client site, but it has not achieved the significant number of visitors within the estimated time period for the test. Can anyone confirm if we could run the test for more number of days to achieve the significant/estimated number of sample size? If so, how many number of maximum days we could run the test further? And can we able to get the significant test results with running it for additional days than the initial estimation?

Thanks in Advance!

    This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
    Best answer by ryanr7

    Hi @sundhara,

    I presume you used the test-duration calculator to determine how long the test should be run, and you are wondering if statistically speaking if letting it run longer is going to compromise the statistical calculations. I think the "days" measure is the less important measure of duration. The more important ones from a stats perspective are total visitors and total conversions per experience. So in short, I'd say yes, run it until you reach the pre-determined per experience visitor volume you need to get a reliable reading on confidence level.

    Hope that helps!

    1 reply

    R
    Adobe Employee
    ryanr7Adobe EmployeeAccepted solution
    Adobe Employee
    June 14, 2021

    Hi @sundhara,

    I presume you used the test-duration calculator to determine how long the test should be run, and you are wondering if statistically speaking if letting it run longer is going to compromise the statistical calculations. I think the "days" measure is the less important measure of duration. The more important ones from a stats perspective are total visitors and total conversions per experience. So in short, I'd say yes, run it until you reach the pre-determined per experience visitor volume you need to get a reliable reading on confidence level.

    Hope that helps!

      Terms & ConditionsAccessibility statement

      Loading footer...