Skip to content

Build1 publisher2 min readPublished

4.6 KB of instruction cut Claude Code's answers from 524 words to 258

The measured half is a word count over 24 runs on three everyday questions. One eval arm's result shifted between two patch releases of Claude Code, and the transcript layer rides on hooks the CLI does not document.

The Engineer · Build desk

Illustration accompanying 4.6 KB of instruction cut Claude Code's answers from 524 words to 258

What happened

  • Across three everyday questions the answers averaged 258 words with the style against 524 without it, and every plugin answer came in shorter than the shortest stock answer to the same question.
  • On Claude Code 2.1.274 the first six cases of the plugin's behavioral eval scored six of six both with the style loaded and without it.
  • Re-run on 2.1.278 with the prompt untouched, the baseline arm failed one case because it ran out of turns on the ambiguous request, so the grader got no final message.
  • The repo also publishes an earlier run in which the plugin's answer came out longer than stock, with the raw outputs and exact flags in demo/README.md.

Compiled by The EngineerSomething wrong?How this is made

Why it matters

  • constraint The halving was measured on prose answers to three questions, so a team running agents over large repos should expect the style to compress only the reporting layer of a transcript that is mostly tool output and diffs.
  • cost Roughly 1,150 tokens of instruction ride in every request to save roughly 350 tokens of output per answer, so what adoption buys is the reader's attention.
  • decision The behaviour under test moved between two patch versions while the prompt stayed identical, so a house prompt style now has to be graded against CLI releases.
  • exposure The hooks the transcript layer redraws the conversation with are undocumented in Claude Code, so whoever installs it owns an interface with no compatibility promise.

Clear Partner is one Markdown file with a frontmatter block, loaded as the communication layer of the system prompt [2]. The frontmatter sets `keep-coding-instructions: true` and `force-for-plugin: true` [3], so Claude Code's own coding instructions stay in place and only the reporting habits change. The instruction body runs about 4.6 KB [4].

What separates this from a brevity prompt is written into the instructions: "Economical in what the user reads, never in the work" [5], followed by a flat prohibition, "Never drop a warning, constraint, assumption, exact number, scope condition, or important tradeoff merely to be shorter" [6]. One carve-out survives for safety-critical warnings, which stay as a single short line with nothing added [21]. The author wrote that "Most brevity prompts quietly make the model shallower" [18].

Four runs per arm produced those averages, so 12 answers per arm and 24 recorded answers in total [8]. Each answer lost 266 words on average [9]. For that to transfer, two things have to hold on your workload: your questions have to resemble the three chosen here, and prose has to be most of what you read.

The token accounting is less flattering than the word count. At four characters per token, 4.6 KB is roughly 1,150 tokens riding in the system prompt on every request [10]; at 1.33 tokens per word, 266 words is roughly 350 tokens of output saved per answer [11]. Prompt caching makes the standing 1,150 cheap after the first call.

The suite is 12 cases, run with `claude plugin eval`, and the first six pin the basics [12]. Six cases at $1.54 and 342 seconds is about 26 cents and 57 seconds per case [14][16]. The post flags that these figures come from one run per arm [25].

Two of the three layers sit on documented surface: an output style and a statusline [1]. The third, Clear Transcript, redraws the transcript using what the post calls Claude Code's undocumented function hooks, and it is the only layer filed under `experimental/` [22][1]. Undocumented interfaces change in patch releases without a deprecation notice, and the eval suite grades final messages; nothing in it grades a hook signature.

The design rule behind the split is stated plainly: prompts for judgment, deterministic mechanisms for mechanics, and never solve the same problem in two layers [20]. The measurements cover length and whether six basics still pass. Depth is the claim the whole design rests on, and according to the post it is asserted from experience with naive brevity prompts, which drop the warning, the exact number, the assumption and the tradeoff [19].

What to watch

  • Whether the remaining six of the 12 eval cases get published with per-case results.
  • Whether the function hooks behind Clear Transcript reach Claude Code's documentation, or change in a patch release first.
  • Whether anyone reproduces the 51 percent cut on a tool-heavy agent session where prose is a minority of the tokens.
Loading claim ledger
Loading source directory links
Loading share composer
Loading topic controls
Loading related stories