Build1 distinct publisher3 min readUpdated
Alibaba's new 27B model defaults reasoning_effort to xhigh. Simon Willison measured 22,276 reasoning tokens and 21 minutes for one SVG that took two minutes with reasoning off.
The Engineer · Build desk

Compiled by The EngineerSomething wrong?How this is made
Alibaba's Qwen lab released Qwen 3.8 27B on Friday, an Apache 2 licensed, vision-capable 27B parameter model [1]. According to Simon Willison, who ran it on a 128GB M5 Max MacBook Pro and an NVIDIA DGX Spark using LM Studio's 17GB Q4_K_M build [2], the decision that will govern your latency and your token spend is not the weights: the model's `reasoning_effort` ships set to `xhigh` [3].
Qwen's own documentation lists three levels: `xhigh` as the default, for complex tasks demanding thorough analysis; `medium`, balancing accuracy and speed; and `low`, for efficient reasoning optimising speed and cost [4]. The GGUF Willison tested in LM Studio preserves that default [5]. So the out-of-the-box configuration is the one Qwen describes as being for hard problems, applied indiscriminately to every prompt you send.
The numbers are the argument. Willison's pelican-on-a-bicycle SVG prompt took 21 minutes at the default setting, spending 22,276 reasoning tokens to produce 3,223 tokens of output [6]. The same prompt with reasoning turned off produced 3,715 tokens in 137 seconds [7]. That is roughly 6.9 reasoning tokens burned per token of output [8], about nine times the wall-clock cost [9], and the cheap run emitted about 15 percent more actual output than the expensive one [10].
The second-order damage is worse than the token bill. Willison first hit LM Studio's default context limit of 8,192 tokens, because the model was consuming the entire window thinking about mundane problems; loading it with the full 262,144 token context removed the symptom [11]. His reasoning trace alone was roughly 2.7 times the size of that default window [12]. An operator who installs both defaults together gets a model that appears broken rather than one that appears slow.
Willison is not dismissive about quality. He calls the result the best pelican SVG he has generated from a model running locally, from a 17GB file on disk [13], and he lists specifics: correct frame shape, legs on both sides of the bike, wings reaching the handlebars, motion lines behind rather than in front [14]. He is also blunt that 21 minutes was not worth it [15]. The failure mode shows up most clearly on trivial input. Asked to "draw an svg of a circle", the model spent its trace deliberating over concentric guide circles, tick marks, gradient fills and Bauhaus palette options, then several minutes later produced an elaborate animated circle that was not what was asked for [16]. His recommendation is to ignore the default and start at `low` or no reasoning at all [17].
Worth noting what is still unverified. The headline gains over Qwen 3.6 27B and the closed-weight Qwen 3.7-Plus are Qwen's self-reported benchmarks, and Willison says he wants to see independent numbers [18]. Qwen 3.7-Plus was one of the lab's strongest models of any size as recently as May [19], which is the scale of claim being made.
Watch three things: whether independent benchmarks reproduce the self-reported jump [18]; whether packagers such as LM Studio keep inheriting the `xhigh` default they currently pass through [5]; and how the 27B compares on real work against the much larger Qwen 3.8 2.4T-A95B released the week before [20]. Willison also reports the model is very good at bounding boxes [21], which is the kind of capability worth testing at `low` before you pay for `xhigh`.
Follow any of these and your For You feed starts watching them — no settings page required.
Ranked by verification strength, evidence, and original report placement.
Qwen's self-reported benchmarks show a boost over both Qwen 3.6 27B and the closed-weight Qwen 3.7-Plus, and Willison says it will be interesting to hear what independent benchmarks say about the model.
Qwen 3.8 27B is an Apache 2 licensed, 27B parameter, vision-capable LLM from Alibaba's Qwen research lab, released on the Friday before 16 August 2026.
Simon Willison ran the model on a 128GB M5 Max MacBook Pro and an NVIDIA DGX Spark, using LM Studio and a 17GB Q4_K_M quantized build, and also tried llama-server directly on the Spark.
Qwen's documentation describes the model as defaulting to xhigh for reasoning effort.
Qwen 3.8 comes with official support for reasoning_effort with three levels: xhigh (default) for complex tasks demanding thorough analysis, medium balancing accuracy and speed, and low for efficient reasoning optimizing for speed and cost.
The LM Studio GGUF build Willison tested preserves the xhigh default.
Evidence-backed comparisons of source perspectives and observed adoption signals. Read the methodology
Which Builder, Operator, and Investor concerns the observed source mix emphasized—not a truth score.
Evidence, demonstrated adoption, hype gap, incentives, and confidence are assessed independently, each on its own current evidence. How these are measured.
Strong first-hand measurement, single observer
The core claims rest on reproducible, numerically specific first-hand runs on two named machines with linked reasoning traces and transcripts: 22,276 reasoning tokens, 3,223 output tokens, 21 minutes, 137 seconds, 8,192 versus 262,144 token context. That is unusually concrete for a new-model post. It is capped by there being exactly one publisher and one tester, no independent benchmark suite, and no throughput or memory instrumentation.
Early: open release plus one practitioner's use
There is real, dated adoption signal - an Apache 2 open-weight release, a quantized build distributed through LM Studio, a larger sibling reachable via OpenRouter, and one documented end-to-end use in which the model built a working offline tool. But the cluster contains no organisational deployment, no download or usage statistics, no pricing data and no second user, so adoption is at the earliest observable stage.
Broadly aligned, with unverified vendor numbers
The article's own headline finding is well-measured and self-deflating: the author states plainly that the 21-minute result was not worth waiting for and that the shipped default is a bad place to start. The small positive residual comes from the vendor's self-reported gains over Qwen 3.6 27B and the closed-weight Qwen 3.7-Plus, which no independent benchmark in this cluster tests, and from 'best local pelican SVG' resting on one idiosyncratic single-prompt test rather than a suite.
Vendor-reported numbers inside an independent write-up
Two incentive layers are visible in the supplied material. Alibaba's Qwen lab has a clear interest in the self-reported benchmark gains it published, including the claim of beating its own closed-weight tier. The sole publisher is an independent practitioner blog with no disclosed commercial relationship to Alibaba, LM Studio, NVIDIA or OpenRouter, and it publishes a negative verdict on the shipped default - though it also promotes its own signature pelican-SVG test as the evaluation instrument. Nothing in the cluster shows sponsorship, early access terms or paid placement, so distortion risk is moderate rather than high.
Confident on the setting, thin on generalisation
Confidence is high for the narrow, decision-relevant claim - the shipped xhigh default produces order-of-magnitude latency and token blowups and breaks small default context windows - because that is directly measured with published traces on two machines. Confidence is much lower for anything about the model's general capability ranking, since the only comparative numbers are the vendor's own and the qualitative verdicts derive from single prompts assessed by one person.
build
A 27B Apache-2.0 model in 17GB makes local inference a wiring decision, not a demo1 distinct publisher
build
Qwen 3.8's Apache-licensed 27B is the one you can actually own, and its KV cache is why1 distinct publisher
build
Qwen3.8's 27B dense checkpoint is the one operators can actually host1 distinct publisher
product
A 27B laptop model scores like a rented one, and thinks three times as hard to do it1 distinct publisher
Distinct publishers with included, body-backed reporting in this cluster.
1 article · August 21, 2026