Topic

Calibrated Confidence

The property of a model whose stated probabilities match how often it is actually right, so that a 90% answer is wrong roughly one time in ten and downstream code can act on the number.

Current clusters

product1 publisher

TypeSafe ships a model that answers only with a decision and a confidence number

Diogo Almeida's TypeSafe put Jev into early access on 15 September with $40m from DCVC, and it sells a calibrated confidence number on every answer as the thing that makes automation possible, with the evaluations behind that claim built in-house.

Publishers:thenextweb.com

Reality

Evidence42
Adoption55
Hype gap+22
Incentives78
Confidence45