Skip to content

BuildNot yet confirmed elsewhere1 publisher2 min readPublished Updated

Adding a reviewer agent bought one useful objection in five, and two new bugs

A solo operator paired Claude Code with a read-only supervisor agent. Three months later the checking layer was producing more errors than the work it was checking.

The Engineer · Build desk

How we use AISend a correction

Illustration accompanying Adding a reviewer agent bought one useful objection in five, and two new bugs
Generated illustration

What happened

  • A solo operator running about a dozen products added a second Claude instance three months ago, able to read everything and change nothing, as supervisor to his builder agent.
  • The pair never argued; they agreed in ever finer detail until both were examining the method by which the check had been performed rather than the work, and the project stalled.
  • Asked to grade the collaboration, the system reported five objections in one afternoon: four correct, one that would have changed the result.
  • That same day the builder's only two errors were both inside checking, while the job that moved several million database rows completed cleanly.
  • The project's 668-line status header held 505 lines of prose and had never parsed; scripts reading it had been falling back to text search for weeks.

Why it matters

  • constraint With thoroughness the only rewarded behaviour on both sides, the exchange has no terminating condition of its own. It stops when a human interrupts, which means it stops late.
  • exposure The part of the system most likely to report a false pass is now the part that tells you whether anything is wrong, and nothing sits above it to check that claim.
  • cost The bill arrives as writing with no reader: generation is charged and reading is not, so a stalled project keeps producing artefacts that look like progress.
  • contradiction The same supervisor caught real problems a builder cannot see and also froze the work, so whether a reviewer agent is earning its place cannot be answered without a hit rate nobody is keeping.

Both halves of the loop are rewarded for the same thing. Thoroughness, not by any instruction the operator wrote but by the way the pair is set up [20]. A reviewer that returns nothing reads as lazy. A reviewer that returns four true findings reads as diligent, and nothing charges it extra when all four are inert. The builder that answers each finding carefully also reads as diligent. Nowhere in that arrangement is there a penalty for a correct objection that changes no outcome.

Which is why the ratios matter more than the anecdote. One objection in five altered the result, so 80 percent of the review output was accurate, well argued and paid for in wall clock without moving anything [14]. Set that against the builder's own defects for the day and the review layer produced two errors for every one it prevented [15]. The operator's own summary is the right one: quality control had become the largest moving part in the machine [21].

Conflict is self-instrumenting. Agreement is not. He reckons a fight between the two agents would have surfaced inside a week [6]. The mutual admiration ran for weeks, because at each individual step it is indistinguishable from care.

The paper trail is where this becomes measurable, and it is the only measurement in the account that does not depend on a model grading itself. 505 prose lines out of 668 puts 76 percent of a machine-readable header into essays [16]. Strip the prose and 163 lines remain in a block designed to carry six or eight short fields, so even the residue is roughly twenty times its intended size [17]. Fifty of that project's fifty-four documents went unopened on the day of the audit [18]. Fifty-nine percent of the projects carried a briefing nobody had touched since rollout while their code kept shipping [19]. In the folder of rules governing how the two agents should cooperate, one section's entire content was an explanation of why that section had previously appeared twice [13].

The account has limits worth keeping in view. It is one operator, one toolchain, around a dozen products [4]. The five-objections figure came from asking the system under audit to score itself, which makes it an order of magnitude rather than a measurement [2]. What survives both limits is the shape of the failure. The supervisor did catch the thing a builder structurally cannot, namely whether the code just described is the code actually on the machine [1]. That value was real. It arrived attached to a process with no stopping rule and no cost for being right about nothing.

What to watch

  • Whether these ratios survive outside a single-operator setup, where a human reviewer already sits in the loop and has an incentive to disagree.
  • Whether any agent harness ships a review budget, such as an objection quota or a cost for inert findings, rather than an open-ended review mandate.
  • What the author changed after concluding that both agents were rewarded for thoroughness; the published account breaks off at that point.

Clarity's read

What the record supports and how the coverage leans. The claims behind it follow.

Reality

Evidence28
Adoption12
Hype gap+22
Incentives38
Confidence34
Why these scores

Claim ledger

Ranked by verification strength, evidence, and original report placement.

  1. [1]

    The supervisor caught what a builder structurally cannot: the outside question of whether the thing just described is actually on the machine or only exists in the description of it.

  2. [2]

    When the author asked the system directly whether the collaboration was productive, it produced numbers: five objections that afternoon, four of them correct, and one that would have led to a different result if it had never been raised.

  3. [3]

    The same day, the builder made two mistakes of its own, both in checking and neither in building: it reported a check as passed when the check's central step had silently failed, and it read the wrong field out of a table and drew a confident conclusion from it. The actual work, which moved several million rows of a database, went through without a scratch.

Sources

1 independent publisher whose own reporting we read for this story.

  1. dev.to

    1 article · August 23, 2026

    I gave my AI a supervisor. It built a bureaucracy.

Share your take

Let Clarity write the post for you.

Signed-in readers get a short post drafted on this story in the register they choose — narrative, analytical, or a direct position — editable to the last word before it goes anywhere. The share buttons at the top of this story work without an account.

Topics and entities

Follow any of these and your For You feed starts watching them — no settings page required.

Topics

Entities

Loading related stories