Complete confidence calculator - Confidence that offer a is different | Community
Skip to main content
Level 1
February 17, 2026
Question

Complete confidence calculator - Confidence that offer a is different

  • February 17, 2026
  • 1 reply
  • 49 views

Hi, 


I’ve downloaded this confidence calculator and I was wondering what percentage do I need in the column “Confidence that Offer is different from Offer A” to say that the offers are different?
 

 

    1 reply

    Vishal_Anand
    Level 5
    February 20, 2026

    @kani456 Use 95 as the standard cutoff.

    If the "Confidence that Offer is different" ≥ 95 you can say the offer is statistically different from Offer A (equivalent to a 95% CI for the conversion-rate lift that does not include zero).

    In your table:

    • Offer B (81.09%) → not different.
    • Offer C (93.13%) → not different at 95% (close, but still below the threshold).

    Notes:

    • You can choose a lower threshold (e.g., 90) for faster decisions, but that increases false positives.
    • If you need a firm decision, run the test longer period or calculate required sample size to reach 95.