Build2 distinct publishers3 min readPublished
JetBrains has taken the assembly work out of running a coding agent offline. What it could not take out is the hardware, and that is now the thing deciding who adopts.
The Engineer · Build desk
Compiled by The EngineerSomething wrong?How this is made
Qwen3.6-27B at four bits is roughly 13.5 GB of weights [1]. JetBrains asks for 64 GB of unified memory [4], close to five times that footprint [2], and the download is about 20 GB [3], leaving some 6.5 GB the weights alone do not account for [3]. Both gaps point the same direction, and the company's own engineering write-up says where: prefill.
With a cloud model, when the agent needs a file again it simply reads it again, because prefill is fast and the context window can be pruned to whatever is relevant [c13a]. On local inference it is not fast [c13a]. So JetBrains changed the loop to append every new request directly to the rolling context, keeping files the model has already read resident so the KV cache survives from one task to the next [13], and reordered the session-start payload so the engine can cache the whole prefix up to the user's request and reuse it across tasks in the same project [14]. Read that against the memory floor and it looks less like a model-size requirement than a working-set one. The 64 GB is not there to hold the weights. It is there to hold everything the agent has decided never to read twice.
The chip floor has the same origin. JetBrains says most of an agent's wall-clock time goes on prefill rather than generation [11], and that Junie Local starts at M5 because the Neural Accelerator carries 8-bit arithmetic instructions the M4 lacks, worth around 40% more prefill throughput [12]. That part is software, and JetBrains says the patch is going upstream as a PR to MLX-VLM [12]. Its engine sits on mlx-vlm and Apple's MLX [17]; Ollama moved its Apple Silicon engine onto MLX back in March [18]. If the patch lands, the do-it-yourself crowd inherits the same throughput without buying anything.
What the free tier actually buys is a harness fitted to one quantized model. Qwen 3.6 ignores Junie's request for XML-style progress blocks, so JetBrains scrapes the model's plain-text narration of its tool calls instead, and notes that this kind of adaptation is model-specific [15]. Optional LLM calls and multi-agent mode are switched off, the latter because sequential processing is what an M5 handles best [16]. Point Junie at your own model in Ollama, which has been possible for a while [28], and you are back to picking weights and tuning settings yourself.
The quality claim needs reading carefully too. Parity with Sonnet 4.5 at a 10,000-token reasoning limit [8] is the local model with reasoning disabled entirely, measured against cloud models that had it on [9], because reasoning cost two to three times the tokens for very little quality [9]. Qwen3.8 needed it on and ran roughly four times slower for the privilege [6]. Everything here is a speed budget wearing different clothes, and JetBrains is blunt about the bill: 64 GB on an M5 is what a 27B model costs to run well today, and it is the number they are working hardest to bring down, according to head of marketing Dmitry Savelev [24][25].
Ranked by verification strength, evidence, and original report placement.
JetBrains deliberately chose Qwen3.6 over the newer 3.8 because 3.8 needs reasoning enabled to work reliably, and with reasoning on tasks run roughly four times slower; "On today's Macs, 3.6 wins."
Qwen3.6-27B is a 27-billion-parameter open-weight model released in April; the newer Qwen3.8-27B arrived earlier in August with improvements.
JetBrains says generation speed is the wrong number to chase for a coding agent because most of the time is spent on prefill while the model reads files, so optimising prefill is where the real gains were.
For local inference JetBrains changed Junie's logic so every new request is added directly to the rolling context, letting KV caches from the previous task be reused so a file the model has already read stays in the context window.
With cloud models the agent can take only relevant pieces of context into the window and re-request file contents because prefill is fast; for local models prefill is not fast and it takes significant time to read files.
JetBrains reordered the data sent at the start of a session and added logic to the inference engine to cache the prefix all the way up to the user's request, so it is reused for subsequent tasks in the same project.
Follow any of these and your For You feed starts watching them — no settings page required.
Evidence-backed comparisons of source perspectives and observed adoption signals. Read the methodology
Which Builder, Operator, and Investor concerns the observed source mix emphasized—not a truth score.
Evidence, demonstrated adoption, hype gap, incentives, and confidence are assessed independently, each on its own current evidence. How these are measured.
Detailed but vendor-generated, with no independent verification
The technical record is unusually specific for a launch: two JetBrains posts document the model, quantization, engine, harness changes and the exact hardware floor, and the one independent article confirms requirements and situates the release. What is missing is any evidence not produced by JetBrains — the quality claim rests on an undisclosed private test set, the prefill and speculative-decoding gains are self-measured, and no source in the cluster contains hands-on testing.
Shipped and free, but hardware-gated with no usage signal
Adoption evidence is availability only. The product is released, free and installable in one command, and the surrounding ecosystem (Copilot CLI local mode, Ollama on MLX, Cline/Continue/Aider) shows demand for local agents. But the requirement of an M5 Mac with 64 GB of unified memory and macOS 26 shrinks the eligible base to high-end configurations, and no source reports downloads, installs, team deployments or any third-party usage — the release is one day old in these sources.
Mildly overstated: unverified parity, candid hardware
JetBrains is notably candid where vendors usually are not — it concedes the 64 GB M5 requirement is a big ask, names it as the number it most wants to reduce, and discloses that reasoning is disabled locally. The overstatement is narrower: 'on par with Sonnet 4.5' comes from an undisclosed private test set and compares a reasoning-off local model with reasoning-enabled cloud models, while 'you most likely wouldn't notice the gap' is asserted without measurement, and the unmetered-work framing describes potential rather than observed behaviour change. Coverage is thin rather than inflated, so the gap is small and positive.
Vendor-authored launch material, marketing-led
Two of three sources are JetBrains' own blog, and the launch post was written by the company's head of marketing, with the third source a trade article built largely from those posts and quotes. JetBrains has a direct commercial interest in making its agent stickier inside paid IDEs and in shaping the local-agent narrative, and the free, no-card framing plus the invitation to vote on the next platform are acquisition and roadmap-signal mechanics. Against that, the engineering deep dive volunteers unflattering detail (disabled features, degraded UX, model-specific hacks) and the hardware barrier is stated plainly, which tempers the score.
Facts solid, effects unproven
What the product is, what it requires and how it was tuned are well established and corroborated across two publishers, so the descriptive core is reliable. Confidence is held down because everything consequential — quality relative to cloud models, real-world speed, and whether anyone with eligible hardware actually adopts it — is either vendor-measured or entirely absent, and the cluster captures a single launch day with no follow-up.
build
Your Coding Agent Reads .env, And .gitignore Was Never The Control1 distinct publisher
build
2,513 tool calls, zero refactorings: what agents actually do when you ask them to refactor1 distinct publisher
build
The flash_attn error in llama.cpp is a layout constraint, and it decides your context window1 distinct publisher
build
Qwen 3.8's Apache-licensed 27B is the one you can actually own, and its KV cache is why1 distinct publisher
Distinct publishers with included, body-backed reporting in this cluster.
2 articles · August 24, 2026
1 article · August 24, 2026