Topic
The engineering discipline of building the scaffolding—control loop, tools, context, memory—that turns a language model into an agent.
Portable Computer's harness is real engineering. The bill of materials starts at a $4,800 DGX Spark or a 24GB RTX card, which turns local agents into a hardware order.
Perspective Coverage
3 publishersReality
Automated harness evolution keeps whatever edits raise its own benchmark score, so the harness ends up fitted to the eval set. Google Cloud AI Research answers with five regularizers lifted from supervised learning.
Reality
LangChain's new harness profiles set prompts, tool implementations and tool names per model family. The company measures a 10 to 20 point gain on a tau2-bench subset it curated from tasks frontier models have not saturated.
Reality
Any harness that refreshes the date in its system prompt or slips a status line into the transcript between turns now gets a 400 instead of a completion, which makes append-only history the fix rather than a retry loop.
Reality
The New Stack's harness argument doubles as an estimating memo, because the schemas, idempotency keys, permission checks and readable traces it lists are the parts that decide whether a demo survives a reworded question.
Reality
Up to four coding agents finished in roughly a week and a half a test-suite migration Asana had been grinding through since 2022, which makes the queue of someday cleanups less a matter of capacity than of what a leader schedules first.
Reality
A vendor postmortem on one 19-step case argues the demo-to-production gap in AI browser testing is harness engineering. Its own worst outage happened inside the harness.
Reality
One model was verified at 30.16 in the official harness and reported at 100.00 in NVIDIA's. Microsoft's Agent Lightning now trains the harness into the weights.
Reality
One rate limiter, a ten-million-token allowance and no termination criterion produced a diff 50 times the size of the job. The published fix only inspects the damage after the run ends.
Reality
The harness did the work on ARC-AGI-3, which puts agent reliability on your engineering backlog rather than in your vendor contract.
Reality
A developer edited a task while an agent was still setting up, and found that permission scopes say nothing about stale instructions. The fix is a revision bound at dispatch and checked before every write.
Reality
Part 6 of dev.to's Harness Engineering series puts the runtime where tool calls execute at the center of agent safety. Its list of things a bounded environment must prevent reads as an infra checklist.
Reality
A dev.to series on harness engineering splits persistence into in-task scratch and cross-session recall, and argues that building them as one system produces neither.
Reality