Build1 distinct publisher3 min readUpdated
A dev.to build log finds Gemma 4 26B holds deep single-artifact work but loses the plan after one or two hand-offs, while the coordinators that can plan will not fit in memory.
The Engineer · Build desk
Compiled by The EngineerSomething wrong?How this is made
A build log published on dev.to reports that its local multi-agent setup broke at the coordinator rather than at the workers: Gemma 4 26B, described as the best of the local models in the worker seat, handled one or two sequential hand-offs and then lost the plan, dropping a step, summarising prematurely, or narrating the work instead of delegating it [1][2]. That relocates the ceiling on self-hosted agent stacks away from raw model quality and onto two duller constraints, role-casting and how much RAM the machine has [3][15].
The author's diagnosis is that this is not weakness. Gemma sustains deep single-session work and will iterate on one artifact for a long time without drifting [4]. What it cannot hold is the coordination loop: tracking several delegations, remembering which are outstanding, and assembling the results into a whole [5]. That is breadth of attention across threads rather than depth on one, and it is not what a model built for on-device, single-purpose work was designed to do [6]. The workers were cast correctly; only the conductor was miscast [7].
Two of the replacement candidates failed instructively. The first, llama3-groq-tool-use:8b, is a tool-calling specialist scoring about 89% on the Berkeley Function-Calling Leaderboard [8]. Given a real task it staged a collaboration instead of running one, emitting an invented session identifier, a call to a tool that exists nowhere in the system, a fabricated teammate with a hobbies bio, and a final "task complete" for work that never ran [9]. The author's reading is that a high tool-use score certifies one well-formed function call in isolation and says little about whether the model will track a multi-step task without inventing its own progress [10].
The second failure was arithmetic. gpt-oss:120b, roughly 77 GB, genuinely reasoned about the plan, sequenced its delegations and did not fabricate, though the summary table also records it stumbling on the agentic loop [11][12]. It ran mostly on CPU and system RAM, spilling far past the machine's 16 GB of VRAM, at around 9 tokens per second, which the author calls tolerable [13]. What was not tolerable: the machine has about 80 GB of RAM, the coordinator claimed about 77 GB of it, and the Gemma workers needed roughly 20 GB more [14][15]. A 97 GB working set on an 80 GB box is short by about 17 GB, so nothing can be co-resident [1]. Every hand-off became an eviction cycle, on the order of 100 GB of weights moved in and out for a single delegation [16]. A single "introduce yourself" call timed out at 121 seconds on the first attempt and completed in 291 seconds on the second [17]. Nearly five minutes to say hello, and none of it spent thinking [18].
The fallback is the shape of the answer: gpt-oss:20b at about 14 GB, small enough to sit alongside the workers, noted here and taken up in a later entry [19]. With the workers' 20 GB that is a 34 GB resident stack on an 80 GB machine, leaving around 46 GB of headroom [2]. qwen3:30b, a mixture-of-experts model in Gemma's speed class, was set aside once a clearer contender appeared [20].
Worth watching: whether the 20B coordinator holds a plan across more than the two hand-offs Gemma managed [2][19], and whether anyone reporting local agent results states their co-resident memory budget rather than a leaderboard number [10][1].
Follow any of these and your For You feed starts watching them — no settings page required.
Ranked by verification strength, evidence, and original report placement.
Part 3 of the series ended on a specific failure: Gemma 4 26B, the best of the local models as a worker, could not orchestrate.
Gemma 4 26B handled one or two sequential hand-offs and then lost the plan, dropping a step, summarising prematurely, or narrating the work instead of delegating it.
The Part 4 entry is titled 'The Coordinator Search - Role-Casting and the Memory Wall' and is the search for a model that could hold a plan together.
llama3-groq-tool-use:8b is a tool-calling specialist scoring about 89% on the Berkeley Function-Calling Leaderboard.
Instead of calling tools, llama3-groq-tool-use:8b staged them: given a real task it produced a fluent transcript of a collaboration that never occurred, including an invented session identifier, a call to process(action="poll") for a tool that exists nowhere in the system, an invented teammate named Maya with the bio 'enjoys hiking and science fiction', and a final 'result: task complete' when nothing had run.
gpt-oss:120b ran mostly on CPU and system RAM because the model spills far past the machine's 16 GB of VRAM, generating around 9 tokens per second, which the author called tolerable.
Evidence-backed comparisons of source perspectives and observed adoption signals. Read the methodology
Which Builder, Operator, and Investor concerns the observed source mix emphasized—not a truth score.
Evidence, demonstrated adoption, hype gap, incentives, and confidence are assessed independently, each on its own current evidence. How these are measured.
Concrete but single-host and self-reported
The cluster rests on one first-person build log. It is unusually specific for the genre — named model tags, footprints in GB, a 9 tok/s rate, two timed attempts (121s, 291s) and quoted failure transcripts — and its memory arithmetic is internally consistent. But there is no independent replication, no trial counts or success rates behind the qualitative orchestration verdicts, no harness or quantisation disclosure, and the piece contradicts itself on whether gpt-oss:120b handled the agentic loop.
One practitioner's own machine
The only usage signal is the author's personal single-host experiment, plus a cited third-party benchmark score. There is no deployment, install, download, production-usage or multi-user data in the supplied material, so no adoption level can be measured without inventing facts.
Claims sit close to, slightly under, the evidence
The write-up is notably restrained: it labels its benchmark lesson 'narrow', reports both the model that worked and the reason it was discarded, and grounds conclusions in named numbers rather than superlatives — if anything the practically useful memory-residency finding is stated more modestly than its reach warrants. The small positive offset comes from generalising a single-machine result into a universal rule ('capability that does not fit is not capability') and from the unreconciled 120B contradiction.
Self-published series, no disclosed vendor stake
The author has an evident audience incentive — this is Part 4 of a serialised dev.to build log that closes by teasing the next entry — but no sponsorship, employer, vendor relationship or commercial product is disclosed, and the piece criticises models it also praises, including reporting failures of open-weight models it had hoped would work. Incentive pressure is therefore modest and mostly narrative rather than financial.
Plausible and specific, unreplicated
The mechanism (a coordinator that cannot stay resident alongside its workers pays swap costs that dominate the task) is internally coherent and consistent with the reported footprints and timings, so the operator-facing conclusion is credible on this hardware. Confidence is held near the middle because the cluster has one publisher, no replication, no methodology, an internal contradiction about the 120B model, and no adoption evidence to corroborate the generalised lessons.
build
Force the tool call, then hand Lightsail a long-lived key1 distinct publisher
build
AI-written code fails the same four ways, and every gate you own reports green1 distinct publisher
build
CSA's 2026 threat list is a flat line, so ask which threats a config snapshot can prove1 distinct publisher
build
An empty array is a claim about your query: verify identifiers before you trust the metric1 distinct publisher
Distinct publishers with included, body-backed reporting in this cluster.
dev.to
1 article · August 18, 2026