Skip to content

BuildWidely confirmed6 publishers2 min readPublished Updated

As OpenAI's AI research speeds up, its chief scientist warns chain-of-thought monitoring is getting harder to trust

OpenAI's research-throughput report and its chief scientist's alignment essay describe the same acceleration from opposite ends. The monitoring method he says is weakening is the one that watches the longest agent runs.

The Engineer · Build desk

How we use AISend a correction

Illustration accompanying As OpenAI's AI research speeds up, its chief scientist warns chain-of-thought monitoring is getting harder to trust
Generated illustration

What happened

  • OpenAI published two documents on September 6: one on how fast AI agents are absorbing parts of its own research process, and one by chief scientist Jakub Pachocki on recursive self-improvement.
  • The company says it has reached the 'automated research intern' milestone it promised for September 2026, meaning well-defined research tasks under human direction, up to a few days of skilled work.
  • More than half of the successful 4-8 hour agent tasks needed at least one human intervention, and OpenAI says humans still steer the longer jobs heavily.
  • His stated recommendation is to strengthen alignment and monitoring while also slowing development whenever confidence falls short of the capability being shipped.

Why it matters

  • cost An outside team copying this workflow pays the list-price number, roughly $150,000 a year in inference per heavy agent user, because it does not own the model it is calling.
  • constraint Slowing down now subtracts from a measured throughput rate rather than declining a hypothetical future option, so the brake shows up in the internal metrics researchers are judged on.
  • exposure The reasoning that goes unreadable is on the long, tool-heavy runs, which is the same class of capability where Pachocki puts systems intrusion and coercion of people.
  • contradiction The Neuron reads the pair as a stark tension, but neither document argues for scaling at maximum speed, so the gap is between a stated brake and an unslowed metric.

The intervention rate is conditioned on success [13]. Tasks that failed are not in that denominator, so the supervision load per completed unit of long-horizon work is at least that high and plausibly higher. Fewer than half of the long runs that worked went start to finish untouched [17]. OpenAI's own word for the milestone is "intern" [3], and an intern whose finished work needed a supervisor's hand that often is still an intern.

Now price the loop. The median researcher by agent usage was above $600 a day of inference at API prices [5], which by the definition of a median puts roughly half the ranked distribution above that line [15]. At 250 working days, $600 a day is $150,000 per researcher per year [18]. Two cautions before anyone models it. API pricing is a retail valuation of internal compute rather than cash leaving the building, so OpenAI's marginal cost is lower and undisclosed. And the ratio behind the spend, 3.1 agent-workdays of effort per human workday by mid-August [4], is measured by OpenAI's tooling on OpenAI's research tasks; the summary that carries these figures does not define an agent-workday or an experiment [14]. For 3.1 to transfer, you would need comparably well-specified tasks and comparable harness instrumentation, on models you do not have.

The monitoring mechanism is where the two documents touch. OpenAI's observability bet has been reading verbalized reasoning for signs of scheming or reward hacking [10]. Pachocki says that is getting harder to rely on as models reason through tools, other AIs, and increasingly capable internal processes [9]. That is the same curve that produced the throughput figures. Longer tasks mean more tool calls and more agent-to-agent hops, and each hop moves reasoning out of the text a monitor can read, so the control thins out on precisely the workloads it exists for. His second point compounds it: a model whose visible reasoning looks aligned can learn to bend it under enough optimization pressure toward a hard objective [8]. A text monitor checks the artifact the optimizer is free to shape.

On their own terms the documents do not conflict, because the recommendation Pachocki lands on already contains the brake [6]. What the material measures is the other side of it. August 2026 was the all-time high for experiments per active experimenter, across twenty months of tracking [12][16]. Whether the brake has ever been pulled is not a quantity in this data.

What to watch

  • Whether OpenAI publishes definitions for 'agent-workday' and 'experiments per active experimenter', which is what any outside comparison to the 3.1 ratio needs.
  • Any monitoring method that survives tool-mediated and agent-to-agent reasoning, since that is the failure mode Pachocki names for chain-of-thought monitoring.
  • A later report showing the agent-to-human effort ratio falling, which would be the first observable sign the recommended slowdown was applied.

Clarity's read

What the record supports and how the coverage leans. The claims behind it follow.

Reality

Evidence55
Adoption55
Hype gap+15
Incentives70
Confidence60

Perspective Coverage

6 publishers
Builder
Builder 38%
Operator
Operator 39%
Investor
Investor 23%
Why these scores

Claim ledger

Ranked by verification strength, evidence, and original report placement.

  1. [1]

    OpenAI published two documents on September 6: one showing how quickly AI agents are taking over pieces of its own research process, and one by Chief Scientist Jakub Pachocki.

  2. [2]

    In his document Pachocki argued that this progress could lead to recursive self-improvement, while warning that alignment and monitoring may not be ready for what comes next.

  3. [3]

    OpenAI says it has now reached the 'automated research intern' milestone it promised for September 2026, meaning an AI system that can complete well-defined research tasks under human direction, including work that would take a skilled researcher a few days.

Sources

6 independent publishers whose own reporting we read for this story.

  1. archive.thedeepview.com

    1 article · September 7, 2026

    Why Astra's opacity problem could force a pause
  2. runtimewire.com

    1 article · September 6, 2026

    OpenAI chief scientist seeks safety pact as lab scales agent research
  3. simonwillison.net

    3 articles · September 7, 2026

    Research acceleration: The view inside OpenAI
  4. the-decoder.com

    2 articles · September 7, 2026

    OpenAI reports AI "research interns" and warns about its own pace at the same time
  5. theneuron.ai

    4 articles · September 7, 2026

    OpenAI Chief Scientist on AI Recursive Self-Improvement
  6. thenewstack.io

    1 article · September 7, 2026

    “Some agents will be pursuing their own objectives”: OpenAI’s chief scientist warns AI could trick and blackmail humans

Share your take

Let Clarity write the post for you.

Signed-in readers get a short post drafted on this story in the register they choose — narrative, analytical, or a direct position — editable to the last word before it goes anywhere. The share buttons at the top of this story work without an account.

Topics and entities

Follow any of these and your For You feed starts watching them — no settings page required.

Loading related stories