Build1 distinct publisher3 min readPublished
A dev.to engineer argues the shipping bottleneck has moved from prompt wording to the environment around the loop, and his own postmortems carry that case a good deal better than the 40% failure figure he opens with.
The Engineer · Build desk

Compiled by The EngineerSomething wrong?How this is made
A harness is mostly four decisions made in code: which functions are registered as tools, which paths the sandbox actually mounts, what ends the loop, and what happens to state when a tool returns garbage. Those are the four the dev.to author names as the things that broke his agents in production [12]. The prompt is read once per step. The other four are enforced on every step, by the runtime, whether or not anyone wrote them down.
Recursive self-summarization is the clean example because it has no fixed point. Every summary is fresh input, so the model always has a next action available, and a loop with an available action and no budget check does not exit. According to the post, nothing in the system told the agent to stop [10]. The fix is a counter: max steps, a token ceiling, a wall-clock limit, or a no-progress detector that compares consecutive outputs. A token counter is a less impressive artifact than a hand-tuned reasoning scaffold, and it is the one that would have ended that run.
The eval gap he reports is the number I would actually take to a review. For a score on fixtures to transfer to production, the fixtures have to contain what production contains, and his did not: the attached PDFs, the half-deleted Slack thread, the customer who said "you know, the thing" [9]. Read that way, the eval was measuring a harness he never shipped, which is the same failure mode as any benchmark table quoted without its input distribution.
The failure-rate figure at the top of the post I would not plan against. The text names no study, no sampling frame, and no test for what counts as failing in production [19]. The Y Combinator survey sitting next to it at least has a population, and a date: CTOs and CPOs, March 2026, reporting that the difference between success and failure was not the model [2]. Self-report from people who already chose to deploy is a different instrument from a failure census [20].
The renaming deserves the same scrutiny as the numbers. Anthropic's framing is the honest version, calling context engineering "the natural progression of prompt engineering" [15], because the artifact is still curated tokens, just many more of them and mostly not typed by a human [16]. Karpathy's line that it is "a lot more than just the prompt itself" [13] and Philip Schmid's that the new skill is context rather than prompting [14] are the same observation from a different seat. Harness engineering, as the post scopes it, means context plus constraints plus tools plus lifecycle plus feedback plus observability [17], which is close to a description of the whole application. The credible part is the delta in his own directory: 47 templates in late 2023 [5], 23 deleted by mid-2025 [6], 24 kept [7]. He ran the change and reported what survived.
In my context the first thing worth instrumenting is every tool call with its return value, because the stop condition and the rollback both read from there, and my agents hold write access to real repositories. A bad tool return is a state change, not a bad sentence. If your agents only draft text, the prompt may well still be your bottleneck, and the post is arguing about someone else's blast radius.
Ranked by verification strength, evidence, and original report placement.
The author writes that in late 2023 he had a directory called prompts/ containing 47 carefully tuned templates, including few-shot examples, chain-of-thought scaffolds and a small ReAct loop.
The author writes that by mid-2025 he had deleted 23 of those templates, saying they were not wrong, they just were not the bottleneck any more.
The author writes that a prompt he wrote scored 92% on his eval set and 11% on real customer tickets.
The author says his eval set did not contain the messy attached PDFs, the half-deleted Slack thread, or the customer who said 'you know, the thing', so the prompt was perfect for an environment that did not exist.
The author says one of his agents, with a carefully engineered context, spent four hours and $38 in tokens recursively summarizing its own summaries because nothing in the system told it to stop.
The author says what broke his agents in production was never the prompt but the environment around it: the tools they could call, the files they could see, the moment the loop should stop, and the rollback when a tool returned garbage.
Distinct publishers with included, body-backed reporting in this cluster.
dev.to
1 article · August 29, 2026
Follow any of these and your For You feed starts watching them — no settings page required.
build
Agent reliability is a harness problem, not a prompt problem1 distinct publisher
build
OpenClaw makes the channel the architecture, and the reasoning loop a lodger1 distinct publisher
invest
Agents that left notes for each other: inside the 17,600-incident Hugging Face intrusion1 distinct publisher
leadership
Data center opposition is now a siting cost, and the industry is pricing it as a PR line1 distinct publisher
Evidence-backed comparisons of source perspectives and observed adoption signals. Read the methodology
Which Builder, Operator, and Investor concerns the observed source mix emphasized—not a truth score.
Evidence, demonstrated adoption, hype gap, incentives, and confidence are assessed independently, each on its own current evidence. How these are measured.
Firsthand postmortems, borrowed statistics
Two numbers here can be argued with because they belong to the author: a prompt library cut from 47 templates to 24, and a prompt that scored 92% on his eval set and 11% on live customer tickets. Everything that makes the piece read like an industry finding — the 40% production failure rate, the March 2026 Y Combinator survey, the 75% deployment share — arrives with no study, no sample, and no link, and dev.to is the only place any of it appears in our coverage.
Deployment signals all at second hand
The only deployment we can actually watch is one of the author's own agents burning $38 in four unattended hours. The rest of the picture is relayed: a Y Combinator share with no denominator, Anthropic's Managed Agents at $0.08 a session hour, an Agents SDK update described as model-native, Google and Microsoft 'followed'. Plausibly real events, but nothing on the page lets a reader verify one of them, and no repository, revenue line, or user count appears anywhere.
The title outruns the man
An engineer who still keeps two dozen prompt templates has published a post called 'Prompt Engineering Is Dead', and the distance between those two facts is the story. His lived material argues something narrower and far more useful: nobody owns the stopping rule or the rollback. Wrapping that in a 40% failure rate and four labs supposedly agreeing the harness is the product turns a modest, earned diagnosis into a movement it hasn't been shown to be.
Naming rights, nothing for sale
No course, tool, or employer is being pitched in the text we have, and dev.to attaches no disclosure either way. What the post does stand to gain is definitional — it is arguing for a label — and its proof that the label matters is a run of vendor announcements, Anthropic's price and OpenAI's SDK among them, rather than any result measured outside the author's own machine.
One voice, and it stops mid-argument
All of this rests on a single dev.to post by a single author; no other publisher touches the numbers, and the quotations doing the heaviest lifting — Karpathy, Philip Schmid, Anthropic's own write-up — reach us third-hand. The text also breaks off at 'There's a real disagreement in the field about whether harness enginee', which means even the author's concession to his critics is missing from what we can read.