A Dirty Dozen: Twelve Common Metric Interpretation Pitfalls in Online Controlled Experiments

Online controlled experiments (e.g., A/B tests) are now regularly used to guide product development and accelerate innovation in software. Product ideas are evaluated as scientific hypotheses, and tes