Skip to main content
kani456
Level 2
February 17, 2026
Question

Complete confidence calculator - Confidence that offer a is different

  • February 17, 2026
  • 1 reply
  • 131 views

Hi, 


I’ve downloaded this confidence calculator and I was wondering what percentage do I need in the column “Confidence that Offer is different from Offer A” to say that the offers are different?
 

 

    This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

    1 reply

    Vishal_Anand
    Vishal_Anand
    Level 6
    February 20, 2026

    ​@kani456 Use 95 as the standard cutoff.

    If the "Confidence that Offer is different" ≥ 95 you can say the offer is statistically different from Offer A (equivalent to a 95% CI for the conversion-rate lift that does not include zero).

    In your table:

    • Offer B (81.09%) → not different.
    • Offer C (93.13%) → not different at 95% (close, but still below the threshold).

    Notes:

    • You can choose a lower threshold (e.g., 90) for faster decisions, but that increases false positives.
    • If you need a firm decision, run the test longer period or calculate required sample size to reach 95.
      Terms & ConditionsAccessibility statement

      Loading footer...