Multiple Comparisons

Microsoft's experimentation team tells experimenters to relax about overlapping A/B tests

The Experimentation Platform group compared every pair of A/B tests running on the same day in four products, and argues the interference risk is small enough that isolating tests costs more statistical power than it protects.