The Intransitivity of AB Tests
Winning comparisons in a sequence of A/B tests do not guarantee a clean global ranking of variants.
Read the essayTopic
Experimentation
Experiments, A/B testing limitations, and the conditions under which evidence really travels.
Read this if you work with A/B tests and want fewer naive conclusions.
The Greediness of AB Tests
A/B testing can optimize for local wins while quietly pushing teams away from broader learning.
Read the essay
The Temporal Limitations of AB Testing
A/B test results are bounded by time, context, and population, even when the output looks statistically neat.
Read the essay