Community assessment and challenge benchmarks

Biomedical foundation models strain the benchmarking rules computational biology was built on

Computational biology proves a method by trying to break it on data it has not seen. Biomedical foundation models slip that test, and how the field responds decides what any benchmark number is worth.