project

openai-on-aws/benchmarks-openai

Open-source benchmarking harness that runs OpenAI models through one Responses API code path and records accuracy, token spend and agent trajectory cost in timestamped result files.

Known aliases

benchmarks-openai

Relationships

No evidence-backed relationships are recorded.

Current clusters

build1 publisher

A 1.5x per-token price still bought a 25 percent cheaper correct answer in AWS's benchmark

AWS's open harness records $0.0021 per correct AIME answer for gpt-5.6-luna after an 80 percent Bedrock price cut. The figure depends on running luna with reasoning disabled while mini runs at its defaults.

Publishers:aws.amazon.com

Reality

Evidence58
Adoption: Insufficient
Hype gap+15
Incentives80
Confidence55