Model Ensembling and Aggregation

Polling-style aggregation often amplified shared misconceptions across five benchmarks

An arXiv preprint ran majority voting, confidence weighting and the Surprisingly Popular algorithm over several open models, and the errors were correlated enough that none of them beat a single sample.