Skip to content

benchmark

GDPval-AA

Artificial Analysis benchmark implementation that uses the pairwise comparison method also offered in Optima.

Known aliases

  • GDPval-AA v2.1

Relationships

No evidence-backed relationships are recorded.

Current stories

invest5 publishers

Cached context shrinks the discount from Anthropic's half-price Sonnet 5.5

Anthropic released Sonnet 5.5 at $2 and $10 per million input and output tokens, half the Opus 5.5 rate. How much a buyer saves by moving work down a tier depends on tokens burned per task and on cache reads priced identically on both models.

Perspective Coverage

5 publishers
Builder
Builder 46%
Operator
Operator 38%
Investor
Investor 16%

Reality

Evidence55
Adoption35
Hype gap+20
Incentives70
Confidence60
product11 publishers

Sonnet 5.5 comes within two points of Opus 5.5 at half the per-token price

Anthropic says Sonnet 5.5 nearly ties Opus 5.5, 1,844 to 1,846, on an everyday-work benchmark while running more than 30% faster than Sonnet 5. For teams paying double per token for Opus, Sonnet becomes the sensible default, with Opus kept for long, ambiguous jobs.

Perspective Coverage

11 publishers
Builder
Builder 36%
Operator
Operator 43%
Investor
Investor 21%

Reality

Evidence45
Adoption50
Hype gap+25
Incentives65
Confidence55
build6 publishers

Spark 1.3's index jump lands on the three tests that carry half the score

Meta's fourth Muse Spark in five months gains four points on Artificial Analysis' Intelligence Index, almost entirely in agentic tests, while two scores fall and the tier Meta benchmarked against rivals is still a limited preview.

Perspective Coverage

6 publishers
Builder
Builder 52%
Operator
Operator 26%
Investor
Investor 22%

Reality

Evidence68
Adoption25
Hype gap+30
Incentives65
Confidence70
product7 publishers

Box measured Claude Opus 5.5 using a third of the tokens Opus 5 needed

Anthropic priced Opus 5.5 tokens 20 percent below Opus 5 and raised five-hour usage limits by the same amount. The larger saving in the launch is a token count from one customer's evaluation of its own content.

Perspective Coverage

7 publishers
Builder
Builder 41%
Operator
Operator 38%
Investor
Investor 21%

Reality

Evidence45
Adoption30
Hype gap+35
Incentives60
Confidence60