interference
2 free lessons tagged interference across Business. Each one is a short sequence of focused steps with narration and a five-question quiz at the end — take them in any order, no signup required.
CUPED and Interference: Faster Experiments, and When Arms Contaminate Each Other
Two advanced problems decide how much an experimentation platform is actually worth. Variance: most product metrics are so noisy that detecting small effects takes painful sample sizes, and CUPED buys the reduction with data you already have. And interference: in marketplaces and social products the arms affect each other, so the measured difference misstates what full launch will do.
When your A/B test is lying anyway
You randomized correctly and read the statistics honestly, and the experiment can still give the wrong answer, because the clean logic assumes things that are not always true. Learn how users affecting each other breaks the method, why a short test misjudges a long-run effect, how an average hides opposite effects in subgroups, and the reflex of distrusting results that look too good.