Build1 distinct publisher3 min readUpdated
Sol-Luna's supervisor could have split independent modules across parallel workers. Given a free choice across six benchmark runs, it kept the work for itself every time.
The Engineer · Build desk
Compiled by The EngineerSomething wrong?How this is made
A developer built an open-source orchestration layer for OpenAI Codex in which the supervisor model is allowed to decide, per task, whether spawning worker agents is worth it, and the answer came back the same way every time it was asked [1][2][9]. That negative result is more useful than a speedup, because it puts the bottleneck in multi-agent coding where the plumbing already suggested it was: coordination cost, not worker capability.
The system, called Sol-Luna, has two roles [1]. A GPT-5.6 instance named Sol owns the task, the decomposition, verification and final review; GPT-5.6 Luna instances act as bounded workers when Sol decides delegation is useful [3]. There are two separate adaptive decisions. First, whether to delegate at all, with an optimal worker count that is explicitly allowed to be zero [4]. Second, if it does delegate, how much reasoning effort each worker gets, from a ladder of Medium, High, XHigh and Max [5].
The control layer is the price sheet. According to the author, parallel workers run in isolated Git worktrees, tasks declare their intended file scope and violations are checked after execution, verification is independently rerun rather than trusting a worker's own PASS result, and Sol still reviews the final output [6]. Workers also cannot recursively invoke the orchestrator and grow their own worker trees [7]. Every one of those items exists because concurrent agents edit overlapping files, drift outside declared scope, misreport their own results, and collide on Git operations [8]. That is the overhead a supervisor is implicitly pricing when it declines.
Earlier benchmarks had already shown parallel Luna workers beating sequential Luna delegation, while one Sol working alone was still faster than both [10][11]. The author's hypothesis was that a break-even point existed and could be reached by making the task big enough and genuinely decomposable [12]. So the fixtures were built to be favourable to parallelism: a four-module independent workload, a six-module independent workload, and a coupled control where decomposition was deliberately inappropriate [13]. The six-module fixture ran to roughly 530 lines of specification and 85 deterministic assertions, about fourteen assertions per module, with each module workable on its own [14][15].
One boundary matters. The author says the fixture, though much larger than before, still fit comfortably inside a single Sol session, and that he was testing whether clean parallelism alone produced a crossover, not simulating a multi-hour production repository [16][17]. Three modes were compared: delegation disabled, delegation available with Sol free to choose, and delegation forced [18]. Nineteen of nineteen runs completed [19]. Six were free-choice runs, leaving thirteen in the disabled and forced modes [20][21]. In all six free-choice runs, Sol declined to delegate: a delegation rate of zero [9][22].
The version of the post available here cuts off before reporting the forced-delegation timings at scale [23], so the strong claim is not yet on the table. What the experiment does support is narrower and still worth acting on: inside the range where one model can hold the whole task, the coordination tax exceeds the parallelism gain even when the work is engineered to be independent.
Watch two things. Whether a crossover shows up once the task exceeds a single supervisor session, which is the case this benchmark deliberately did not test [16]. And whether the effort ladder ever gets exercised at all, given that it only applies when Sol delegates [5], and so far it has not.
Follow any of these and your For You feed starts watching them — no settings page required.
Ranked by verification strength, evidence, and original report placement.
The design question was whether one strong AI could decide when it actually needed help from other agents, rather than automatically splitting every task, so the supervisor weighs delegation against coordination cost first.
GPT-5.6 Sol acts as supervisor, owning the overall task, decomposition, verification and final review; GPT-5.6 Luna instances act as bounded workers when Sol decides delegation is useful.
Sol decides whether to delegate at all, and the optimal worker count is allowed to be zero; small, tightly coupled work or work where coordination looks more expensive than doing it can stay entirely with Sol.
If Sol does delegate, it separately decides how much reasoning effort each Luna worker needs, from Medium, High, XHigh or Max.
Sol-Luna runs parallel workers in isolated Git worktrees, has tasks declare their intended file scope with scope violations checked after execution, reruns verification independently instead of trusting a worker's own PASS result, and keeps Sol responsible for reviewing final output.
Workers cannot recursively invoke the orchestrator and create their own worker trees.
Evidence-backed comparisons of source perspectives and observed adoption signals. Read the methodology
Which Builder, Operator, and Investor concerns the observed source mix emphasized—not a truth score.
Evidence, demonstrated adoption, hype gap, incentives, and confidence are assessed independently, each on its own current evidence. How these are measured.
Structured self-run benchmark, single unaudited source
The methodology is unusually explicit for a personal post: deterministic fixtures with stated size (roughly 530 spec lines, 85 assertions), three run modes per fixture, 19 of 19 runs completed, and quantified slowdown and token multiples. But everything comes from one self-published author with no repository reference, no raw logs, no absolute timings and no independent replication, and the author himself flags that all fixtures fit inside a single supervisor session.
No adoption signal in supplied material
The supplied source describes a personal open-source project and its own benchmarks only. There are no stars, downloads, forks, external deployments, third-party users, pricing or licensing events, or any other party running Sol-Luna, so adoption cannot be scored without inventing facts. The benchmark observations recorded here are the author's own measurements, not usage by others.
Findings framed more modestly than the data would allow
The post runs against the prevailing multi-agent narrative and stays inside its measurements: it reports a negative result, explicitly names the single-session fixture limitation, and concedes parallel workers retain non-speed benefits such as isolation, bounded scope and independent verification. That is understatement relative to the quantified slowdown and token overhead it documents. The only inflationary pressure is the opening generalisation that more AI agents did not make coding faster, which is broader than the small deterministic fixtures actually tested, so the gap is mildly negative rather than strongly so.
Author promotes own project but publishes a counter-interest result
The writer is the builder of the system under test and publishes on a self-service developer platform, so there is a clear promotional incentive and no editorial or peer review. That is offset because the headline finding undercuts the project's most marketable feature - multi-agent fan-out - and because the benchmark design deliberately favoured parallelism with independent module streams before it failed to pay off. No sponsorship, vendor relationship or commercial dependency is disclosed in the supplied text.
Plausible and well-structured, but single-source and narrowly scoped
Internal consistency is good and the numbers are specific, so the direction of the finding is credible for the regime tested. Confidence is capped by one publisher, one author, one model family, small single-session fixtures, no absolute cost or latency figures, no external replication, no adoption evidence, and an unresolved discrepancy about how much of the results section is actually available.
invest
OpenAI's Multi-Agent v2 turns tiered-model cost arbitrage into a supported architecture1 distinct publisher
build
Bedrock turns GPT-5.6 throughput into a routing choice, with residency as the price1 distinct publisher
build
Codex can now ask and keep going, which deletes the only checkpoint you were getting for free1 distinct publisher
build
Codex learns to click: the coding agent stops typing patches and starts operating the machine1 distinct publisher
Distinct publishers with included, body-backed reporting in this cluster.
dev.to
1 article · August 15, 2026