The Temporal Limitations of AB Testing
A/B test results are bounded by time, context, and population, even when the output looks statistically neat.
Read the essaySeries
A short series on how experimental results fail when they ignore time, transitivity, and greed for local wins.
A/B test results are bounded by time, context, and population, even when the output looks statistically neat.
Read the essayWinning comparisons in a sequence of A/B tests do not guarantee a clean global ranking of variants.
Read the essayA/B testing can optimize for local wins while quietly pushing teams away from broader learning.
Read the essay