Model Procurement and Selection

Talos ran 66 model settings at one log-review task and refused to name a winner

Cisco Talos reports that turning reasoning effort up often cost more without scoring better, and sometimes scored worse. The number that should drive procurement is the worst run, not the median.