The method
How it is worked out
- p-value
- Chance of seeing a gap this large if there were no real difference
- confidence interval
- Range the true difference likely falls in
Is the difference between two conversion rates real? Significance, confidence interval and the sample size you still need. The result updates as you type so you can compare scenarios quickly.
The method
Keep in mind
Use the calculator to compare scenarios rather than as a guaranteed forecast.
Test whether the difference between two conversion rates is real: significance, p-value, confidence interval and the sample still needed.
A two-proportion z-test with pooled variance; significance when |z| exceeds the critical value; the interval uses unpooled standard error; sample size for the observed effect at 80% power.
12,000 visitors each: A converts 4.5%, B 5.0%, an 11% lift, p = 0.07 — not significant at 95%. About 15,600 per variant needed.
Put it to work
Load an example
What moves the result most
Worked out from your figures above. Tap a row to try it.
Who uses it, and when
Product, growth and marketing teams running experiments.
Mistakes worth avoiding
Questions
Is the difference between two conversion rates real? Significance, confidence interval and the sample size you still need.
A two-proportion z-test with pooled variance; significance when |z| exceeds the critical value; the interval uses unpooled standard error; sample size for the observed effect at 80% power.
The core calculation or transformation runs in your browser. Normal website security and analytics may still record page-level events, but the tool does not need to create a public record from your inputs.
Stopping the test when it first looks good. Testing several variants without a correction. Ignoring order value.
No. Use the result as a practical check or planning aid and verify important decisions with the relevant primary source, provider or professional advice.
Executive Insights
Results are estimates based on the figures entered, for general information only, and not financial, investment, tax or legal advice. See our terms of use.