Product1 publisher2 min readPublished
Anthropic's 400,000 Claude Code sessions leave 70 percent of the planning decisions to the human
Anthropic's analysis of roughly 400,000 sessions puts about 80 percent of the execution decisions with the agent. The benefit it reports is longer unattended runs between check-ins, counted in actions per turn.
The Product Desk · Product desk

What happened
- Anthropic analyzed around 400,000 real Claude Code sessions to see how people use the tool and what separates the users who get the most out of it from everyone else.
- Users made roughly 70 percent of the planning decisions across those sessions, deciding what needed doing, which approach made sense, and what a successful result should look like.
- Claude made around 80 percent of the execution decisions, including which files to edit, what code to write and which commands to run.
- A typical user prompt triggered a chain of about 10 Claude actions, from reading files to running commands, and some chains stretched beyond a hundred.
Compiled by The Product DeskSomething wrong?How this is made
Why it matters
- contradiction The advice and its best evidence point different ways: the recommended split keeps planning with the user, while the sessions that ran furthest per turn are the ones where the agent planned. A team copying the rule should not expect the 16-action runs.
- constraint Actions per turn is a depth-of-use number a team can raise by writing vaguer prompts, so it cannot serve as a quality target for a rollout without something measuring what came out.
- cost Fewer check-ins does not remove the reviewer's work, it moves it downstream, where a whole turn's worth of edits arrives as one thing for a person to read and answer for.
- decision If problem expertise is the part that cannot be handed over, the rollout question is which people are qualified to grade the agent's output, not how many seats to buy.
Anthropic's session data puts a length on the tightly supervised session: when users kept more than 80 percent of the execution decisions, Claude ran about eight actions per turn [6]. The same research says how much the agent finishes between check-ins tracks closely with how much control the user hands over [12].
The two figures being compared sit on different axes. Eight actions per turn describes sessions grouped by who made the execution calls, while the sixteen-action figure describes sessions where Claude made more than 80 percent of the planning decisions [7]. The rule the write-up draws from this is that you decide what and Claude decides how [8]. The longest runs in the data came from sessions where Claude decided both [2].
Sixteen against eight is twice the agent activity between check-ins, so a human looks up half as often for the same amount of agent work [1]. What that counts is how far the tool goes unattended. It is a real saving in interruptions for the person at the keyboard, and it is also a larger diff landing at review.
The research also says something about the operator. According to XDA's summary, the one thing a user cannot outsource is knowing enough about the problem they are trying to solve [9]. That sits next to the claim in the same piece that tools like Claude Code have lowered the barrier enough that years of programming experience are no longer needed to turn an idea into something functional [11]. Both can hold, and together they describe who the workflow is for: someone who can write a specification and grade the result, in a codebase they know well enough to say what done means.
What decides whether a team gets anything from the pattern is who writes the specification, and whether anyone on the team can tell a correct result from a plausible one. When the team writes the spec and can grade output, delegation works and the check-in saving is real. Write the spec but fail to grade, and you ship whatever compiles. Let the agent set the goal while keeping a strong reviewer, and the drift gets caught late, at review cost. Do neither and you have long sessions nobody can score.
The trainable artifact is the first prompt: what the outcome is, and what a finished result has to satisfy. Whether the training took shows up in how much of the agent's output a reviewer accepted without rework, and XDA's account of the research does not include that number.
What to watch
- Whether Anthropic publishes the underlying report with outcome measures such as rework or acceptance rates alongside actions per turn.
- Whether the eight-versus-sixteen comparison gets restated on a single axis, planning or execution, when the full data appears.
- Whether Claude Code adds session reporting so a team lead can see the planning and execution split for their own repository.