Build1 distinct publisher3 min readPublished
The router picks a cheaper model for work that resembles work it has already seen, and falls back to the strongest one when nothing matches. The same traces that enable that call are the proposed training set.
The Engineer · Build desk

Compiled by The EngineerSomething wrong?How this is made
The load-bearing part is the K-nearest-neighbour fit over embedded requests [5]. Such a fit answers one question, which is which model previously handled work that looked like this. The value of the answer scales with how much of your traffic has a close neighbour in your own trace history. An agent hitting the same six tools all day has dense coverage. An agent taking tasks from users has whatever its tail looks like, and the tail is where the expensive errors live.
Which is why the confidence gates are the part I would point at in review. When the evidence is weak, or a request looks unlike the router's training examples, it stays on the strongest known model [7]. That is the correct default, and it fixes the failure mode: unfamiliar traffic costs full price rather than producing bad output. Read the savings figures accordingly, as a measurement of how repetitive the traffic being routed was.
Upstream of the router sits the piece that is harder to verify. World Model Optimizer ingests traces and constructs text simulations of the tools and environments an agent encounters, then runs candidate models against those simulated tasks [4]. A cheaper model is therefore promoted on evidence gathered against a reconstruction of your API rather than your API. Anywhere the reconstruction is more forgiving than production, the routing table inherits the error. Fallah led development of a mixed-reality simulator at Waabi for testing autonomous vehicles [8], so simulator fidelity is a problem this team has already met under harsher conditions.
Experiential Labs says plainly that the published numbers are configurations it chose and ran itself [14]. Their spread is the interesting bit. RouterBench came in 66.5% cheaper for a 1.7% performance drop [11], which leaves 33.5% of baseline spend, about a third [1]. TauBench came in 44.5% cheaper with performance 6.3% higher [12]. Terminal Bench 2 came in 64% cheaper [13]. Elsewhere the company advertises up to 97% lower cost on some tasks [17], which sits 30.5 points beyond its own best published benchmark [3], and a guaranteed 50% saving at equal or better quality [17] that its own TauBench figure misses by 5.5 points [2]. The guarantee reads as commercial terms rather than a result.
For any of those figures to move to your workload you would need a comparable candidate model set, a comparable task mix, and comparable prompt cache hit rates, since the router prices caching into its estimate of what a request effectively costs [6]. Change the cache economics and the cheap option changes with them.
The adoption cost is legible. You run the gateway locally, connect provider keys, and build the router from OpenTelemetry traces [10], which means instrumenting the agent and retaining traces in a form the optimizer can read. That retained corpus is the actual bet, not the routing table. Experiential Labs says customers will own the weights its training workflow produces [16], and a commenter on the launch thread asked for precisely the artefact that would test it: a model trained with the method, shown against its base [15]. Until that exists, this is a cost control with an option attached, and the option is denominated in traces you have to start keeping before you know what they are worth.
Ranked by verification strength, evidence, and original report placement.
On RouterBench, Experiential Labs reported the router cut cost by 66.5% while performance fell 1.7%.
Kion Fallah and Silen Naihin open-sourced a model router in July that uses an AI agent's production history to decide which model should handle each new request.
Experiential Labs is a San Francisco company in Y Combinator's Summer 2026 batch; it sits between an agent and the models it calls, offering one OpenAI-compatible endpoint for hosted providers, customer-owned API keys, local models and custom models.
The gateway records the traces needed to evaluate cheaper alternatives and to train specialized models.
World Model Optimizer, introduced by Naihin in a July Hacker News post, ingests agent traces and constructs text simulations of the tools and environments an agent encounters, then runs candidate models against those simulated tasks.
The tool embeds the requests and fits a K-nearest-neighbor router that selects a model based on similar past work.
Distinct publishers with included, body-backed reporting in this cluster.
1 article · August 27, 2026
Follow any of these and your For You feed starts watching them — no settings page required.
build
Replit makes its router decide which model writes your code1 distinct publisher
invest
Touchmark opens a forwards market for tokens because finance cannot forecast them1 distinct publisher
build
A 12MB Go binary bets agent cost control is cache stickiness, not a dashboard1 distinct publisher
build
Vercel moves DNS, renewals and membership into a CLI your pipeline already trusts1 distinct publisher
Evidence-backed comparisons of source perspectives and observed adoption signals. Read the methodology
Which Builder, Operator, and Investor concerns the observed source mix emphasized—not a truth score.
Evidence, demonstrated adoption, hype gap, incentives, and confidence are assessed independently, each on its own current evidence. How these are measured.
Mechanism documented, outcomes vendor-attested
The architecture is described in concrete, checkable detail — OpenAI-compatible endpoint, OpenTelemetry trace ingestion, text simulations, K-nearest-neighbor routing, cache-aware pricing, confidence gates — and the code is publicly runnable. But every performance number comes from configurations the company chose and ran, the single reporting outlet says outright that this is not independent validation, and the core claim that traces yield cheaper owned replacements has no released artifact behind it.
Early open-source interest, no disclosed deployments
The only quantified uptake signal is 380-plus GitHub stars weeks after a July launch. There are no disclosed customers, no revenue, no named production deployments and no customer-trained model in the wild, so adoption is real but minimal.
Marketing ceiling well ahead of published results
The company's external claims — up to 97% lower cost and a guaranteed 50% savings at equal or better quality — sit above its own best published benchmark of 66.5%, and one of its three published results (44.5%) falls short of the guarantee it advertises. The load-bearing narrative that inference spend finances its own replacement rests on a training loop with no released model. The reporting outlet flags these gaps rather than amplifying them, which limits the overstatement to the company's own framing.
Vendor-originated launch material with fundraising context
Substantially all substantive content originates with an early-stage Y Combinator company promoting its own launch: self-run benchmarks, self-described guarantees, founder-supplied biography and unnamed angel backing. The company has a direct commercial interest in the savings narrative that would move traffic through its gateway. The reporting publisher adds counterweight by labelling the benchmarks vendor-run and listing what has not been disclosed.
Facts of the launch solid, outcomes unresolved
What was released, by whom, with what architecture and what the company claims are all clearly established, and the single source is candid about its own limits. Confidence is capped by the absence of any second publisher, any independent benchmark reproduction, and any disclosed deployment or trained-model artifact.