Definition
The percentage of A/B tests or experiments that produce a statistically significant positive result.
Formula
Experiments with a significant positive result / Total experiments run x 100
How to measure
Track the outcome of every completed experiment and divide the count of statistically significant wins by the total number run.
Why track it
Experiment win rate, tracked alongside velocity, shows whether a growth team's hypotheses are well-targeted or if they're running too many low-conviction tests.
Example
A growth team's experiment win rate holds steady at 30%, considered healthy since most credible experimentation programs win on a minority of tests.
FAQ
- What is Experiment Win Rate?
- The percentage of A/B tests or experiments that produce a statistically significant positive result.
- How do you calculate Experiment Win Rate?
- Experiments with a significant positive result / Total experiments run x 100
- Why track Experiment Win Rate?
- Experiment win rate, tracked alongside velocity, shows whether a growth team's hypotheses are well-targeted or if they're running too many low-conviction tests.