Build1 distinct publisher3 min readPublished
Vercel says its agent pipeline closes 70 to 80 percent of AI SDK issues, four weeks after the backlog passed a thousand. That rate travels only to projects whose bugs a sandbox can reproduce without a human in the loop.
The Engineer · Build desk
Compiled by The EngineerSomething wrong?How this is made
Two numbers in Vercel's write-up measure different things, and only one of them looks like a backlog. Authoring 25 to 35 percent of merged PRs is a production share. Closing 70 to 80 percent of issues is a disposal rate [12]. Apply the disposal rate to the late-June pile of more than a thousand open issues and you get 700 to 800 [21], but the reported figure is a rate four weeks into operation, and inflow did not stop while the agents ran.
For that rate to transfer, the pipeline has to survive its first stage. The pattern runs triage, then reproduction, then a fix or feature, then a review, then a hand-back to a human to merge [3], with separate agents for reproducing the bug, applying the fix and reviewing it [7]. Everything downstream of reproduction depends on a failure a sandbox can produce on demand. AI SDK is a package pulling more than 20 million npm downloads a week [5], so a large share of its reports are one wrong return value in a small script. If your issues are API design arguments, or races that only show up on one user's hardware, the reproduce agent stalls and the rest of the line has nothing to work on.
The mechanism worth copying is where trust lives. Vercel engineer Lars Grammel described it as trust in a particular agent configuration: a specific agent with a specific optimised prompt that history shows was successful on a certain category of bugs [9]. He advised open source projects to run their own agents and their own setup rather than trusting the community, on the grounds that it cuts review time [10]. That is the whole argument for closing the door. An outside PR may come from a better model, but it arrives with no measured record attached, and Vercel says it trusts its own agents over community-run ones [8]. Flue's contributor guide names what it is filtering, calling them "Drive-by AI slop PRs" [18].
Astro, at 62,000 GitHub stars, adopted the same idea [13]. Creator Fred Schott told Latent Space it has totally shifted in the last six months, with automations handling triage, reproduction, and getting the user to verify the bot's suggested fix before a maintainer looks at it [15]. That last step is the real saving: reviewer attention arrives at the end of a chain where the reporter has already confirmed the patch. Schott says the effect is that issues became a thing the team prioritises every week rather than a backlog it constantly trims, which he had not seen in a decade-plus of open source [16]. The auto-triage work is what led him to build Flue [17], whose guide pairs the team's own expertise with the best available state-of-the-art LLMs it can reach [20].
If I were adopting this, I would ship the reproduce agent alone and measure it for a month, because its output is the only one a human can check in ten seconds: the failing case runs, or it does not. The rest of the factory is worth building once you can name the bug categories your configuration has a record on. Pull requests have been open by default since GitHub invented them 18 years ago [1]; the projects closing them, tldraw among them, are the ones that already automated the other side of the door [2].
Ranked by verification strength, evidence, and original report placement.
GitHub invented pull requests, and for 18 years they have been open by default.
Top AI-native open source projects including Flue and tldraw refuse to accept pull requests from external contributors, in part because those PRs are usually AI-generated; maintainers prefer to use their own agents to create and manage PRs.
A 'software factory' typically involves a team of agents triaging a PR, reproducing the issue if it is a bug, implementing a fix or new feature, reviewing it, then handing it back to a human to merge.
Vercel published a post entitled 'Building a software factory for AI SDK'.
The open source AI SDK project gets over 20 million npm downloads per week.
By late June, AI SDK's backlog had reached over 1,000 open issues and almost 800 pull requests.
Distinct publishers with included, body-backed reporting in this cluster.
1 article · September 1, 2026
Follow any of these and your For You feed starts watching them — no settings page required.
build
Flue 2 bets that agents are a rendering problem, not an orchestration one1 distinct publisher
build
AI-written code fails the same four ways, and every gate you own reports green1 distinct publisher
build
Cloudflare moves durable execution under the harness, and the platform starts choosing it1 distinct publisher
build
Cursor ships Origin default-on to every paid seat1 distinct publisher
Evidence-backed comparisons of source perspectives and observed adoption signals. Read the methodology
Which Builder, Operator, and Investor concerns the observed source mix emphasized—not a truth score.
Evidence, demonstrated adoption, hype gap, incentives, and confidence are assessed independently, each on its own current evidence. How these are measured.
Primary material, single witness
The sourcing is unusually direct — Vercel's own post and Grammel's video, Flue's contributor guide verbatim, Schott on the record — and unusually narrow, because Latent Space is the only outlet carrying any of it. Direct quotation is not verification: the throughput figures come from the party that built the thing, and the reporting reproduces them without asking what counts as a closed issue.
Live on four named repositories
This is not a pilot deck. AI SDK, Astro, Flue and tldraw are named, sized and running the policy or the pipeline today, and the sizes are real — 20 million weekly downloads, 62,000 stars, 50,000 stars. What stops it going higher: all four sit in the JavaScript framework and dev-tooling niche, where a bug reproduces in a sandbox. Nobody here maintains a database engine or a driver.
The number outruns its footnotes
Latent Space is restrained in its framing and specific about mechanics, so the overstatement is inherited rather than authored: '70 to 80% of issues' does a lot of persuasive work for a figure four weeks old, self-reported, and undefined as to base. Read against the late-June backlog it suggests 700-odd issues cleared, which may be an artefact of the arithmetic rather than a finding. Schott's un-numbered account of prioritising instead of trimming is the sturdier evidence in the story and gets the quieter billing.
Everyone quoted is selling their own workflow
Vercel is publishing operating results for agents running on Vercel infrastructure against a package Vercel stewards. Schott describes the triage system that produced Flue, the framework he now ships. Ruiz and Hashimoto are defending policies they announced. None of that makes the accounts false, but there is no participant in this story whose interests are served by the pipeline underperforming, and no cost figure anywhere.
Solid on the what, thin on the how much
Be confident that these four projects have closed or automated their contribution paths and that the architecture is roughly as described — that much is documented in artefacts a reader can check. Be far less confident that 70 to 80 percent transfers anywhere, or that it means the same thing next quarter. One publisher, four weeks of data, and no revert rate is a floor on how sure anyone can be.