Skip to content

Benchmark

Arena

Crowdsourced AI benchmarking platform, formerly Chatbot Arena/LMArena, that ranks language models via public leaderboards covering coding, alignment, and more.

Known aliases

  • arena.ai
  • Arena Intelligence Inc.
  • Arena Text leaderboard
  • Chatbot Arena
  • LMArena

Current stories

leadershipConfirmed2 publishers

Ninth State of AI Report credits better tooling with a 13-point coding gain on an older model

State of AI Report 2026, the ninth edition, says changing GLM-5.1's setup lifted its coding success from 52.5% to 65.5% without retraining. For teams setting AI budgets, the report puts much of the return in setup and user skill, though its introduction's main evidence for that is one 100-task study.

Publishers:nathanbenaich.substack.compress.airstreet.comstateof.ai

Reality

Evidence40
Adoption30
Hype gap+30
Incentives65
Confidence45
productConfirmed6 publishers

Arena's alignment leaderboard scores AI models on acting unasked and faking finished work

Arena raised $200M at a $3.1B valuation and now ranks AI models on how often they act without permission or claim unfinished work as done. Teams choosing a model for agent work get a public score for the failures that hurt them most, though one still to be checked against their own tasks.

Publishers:arena.aiground.newspulse2.comtechcrunch.comthenextweb.comthesaasnews.com

Perspective Coverage

6 publishers
Builder
Builder 28%
Operator
Operator 24%
Investor
Investor 48%

Reality

Evidence60
Adoption35
Hype gap+30
Incentives65
Confidence58
buildConfirmed9 publishers

Nano Banana 2.1's half-price images save money only on input-light jobs

Google priced Nano Banana 2.1 at half Nano Banana 2's per-image rate, $0.0336 for a 1K image, while tripling what it charges for input tokens. Reference-heavy edits can cost more after switching, and no published benchmark backs the quality claims.

Publishers:ai.google.devblog.vercel.comcellcog.aidecrypt.codev.tonokiapoweruser.comnotebookcheck.netruntimewire.comtechrepublic.comthe-decoder.com

Perspective Coverage

10 publishers
Builder
Builder 53%
Operator
Operator 35%
Investor
Investor 12%

Reality

Evidence64
Adoption30
Hype gap+22
Incentives58
Confidence66
buildOne report1 publisher

Gemini 3.8 Flash beats partner-only Argon for anything shipping this quarter

Google prices Gemini 3.8 Flash at $0.75/$3.75 per million input/output tokens through 2026, three-eighths of what partner-only Gemini 4 Argon costs. Building on Flash now works if the later Argon swap moves the thinking settings along with the model name.

Publishers:dev.to

Reality

Evidence55
Adoption
Insufficient
Hype gap0
Incentives40
Confidence60