build1 publisher
Netflix scored a new launch rule by replaying 123 finished A/B tests
A new paper evaluates the decision rule itself by asking what every past test would have returned under it, and reports that the obvious backward-looking estimate runs high whenever each experiment's signal is weak.
Publishers:arxiv.org
Reality
- Evidence58
- Adoption28
- Hype gap+12
- Incentives55
- Confidence55