Skip to content

InvestAlso reported elsewhere2 publishers2 min readPublished

Sources say Anthropic and OpenAI sought strict control of evaluators' reports after backing their independence

Anthropic and OpenAI sought significant control over what outside AI evaluators can publish, Reuters reported, citing two people familiar. Both companies dispute parts of that account. The fight turns on who decides which findings are trade secrets.

The Investor · Invest desk

How we use AISend a correction

Photograph accompanying Sources say Anthropic and OpenAI sought strict control of evaluators' reports after backing their independence
Photo: channelnewsasia.com
Anthropic may approve new evaluators' reports Where each party stands on who controls evaluators' reports. The story's dates give no year and its one count is a split of the labs, so no chart is drawn.

Amodei backed publishing key findings without editorial control. Anthropic reserves approval of new firms' reports. OpenAI says it seeks no approval of full reports. Contracts can bar publishing confidential information without consent. Faculty's reporting details are still being worked out.

Anthropic may approve new evaluators' reports
WhoHowKindClaim
Anthropic CEO Dario AmodeiSaid evaluators should have the right to publish key findings "without editorial control"precedent1
AnthropicReserves the right to comment on and approve reports from new evaluator firmsdecision4
OpenAINot seeking approval rights over full report text; evaluators can disclose major redactionsdecision5
Evaluators under lab contractsContract language can bar publishing confidential information without the companies' consentconstraint6
FacultyAnthropic's first embedded evaluator; access and reporting details still being worked outexposure11

What happened

  • Last month, Anthropic CEO Dario Amodei argued that outside evaluators should be entitled to publish their main findings "without editorial control."
  • On Oct 5, according to the two people, both labs were still seeking strict editorial control over what evaluators could publish.
  • Anthropic told Reuters that the description did not fit all its discussions, and that evaluators it previously worked with control their methods, criteria, conclusions and what to publish.
  • OpenAI told Reuters it was not seeking approval rights over the full text of reports and that evaluators can disclose whether major redactions were made.

Why it matters

  • contradiction Anthropic reserves a right to comment on and approve reports from new evaluator firms while they learn its models. That right sits against Amodei's "without editorial control." It also applies when a new reviewer has least leverage.
  • exposure Evaluators bound by the contract language Reuters saw need the lab's consent before publishing anything the lab calls confidential, so the lab's definition of the word sets the limit.
  • decision Faculty, Anthropic's first embedded evaluator, and any firm after it must accept terms while access and reporting rules are still being worked out.
  • constraint Under the discussed bar on working at two labs at once, an embedded evaluator can serve 1 of the 2 labs at a time, or 50% of the pair.

On paper, the public line and the private asks can both stand. OpenAI backed Amodei's position days later, saying assessors should have "editorial independence" [2], and a lab can honor that wording while still requiring consent before anything it calls confidential reaches the page. The labs have a stated reason to want the consent: according to Reuters' sources, they worry that evaluator staff working inside their walls could take proprietary information to rivals [7]. Having lab employees observe embedded teams as they work is one measure under discussion [8].

The fight is over where "confidential" ends. A separate person with knowledge of past dealings with the labs said that what they consider crucial intellectual property can overlap with information relevant to judging a model's risk. That overlap, the person said, leads to arguments and redactions [10]. Bars on sharing a client's confidential information are typical in technology contracts [13], so the clause itself is ordinary. Reuters reported that evaluator independence is a concern because Anthropic and OpenAI choose who carries out the reviews [14].

The dates sit close together. The Oct 5 position was eight days old when Reuters published on Oct 13 [23][21]. By Oct 8, three days after it, one person said Anthropic's talks with some evaluators appeared to have evolved [22][20]. We think that points to an opening ask that met resistance, though the sources do not say who pushed back, and a single anonymous person supplies the Oct 8 change. The people declined to be named because the matter was private [18].

Reuters tied the dispute to labs seeking trillion-dollar valuations in what could be major IPOs [15]. In our view that raises the cost of each redaction decision, because a risk finding in a public report is a document a prospective investor can read (this is our inference).

The counter-thesis is that this is routine contract haggling converging on the public line. Faculty's chief executive used that line himself: "Evaluators are only useful if people can trust what they report, so independence and transparency are critical," Marc Warner told Reuters [12]. We would be wrong if the signed terms let evaluators keep their conclusions and flag major redactions in their reports. The Oct 5 asks would then have been an opening position, and the public statements an accurate summary of the result.

What to watch

  • Signed terms between Anthropic and Faculty on access and reporting, and whether Faculty can publish without the lab's approval.
  • Whether evaluator reports begin to flag major redactions, as OpenAI said evaluators can.
  • Whether lab observers and the bar on simultaneous embedding at two labs appear in final contracts.

Clarity's read

What the record supports and how the coverage leans. The claims behind it follow.

Reality

Evidence55
Adoption
Insufficient
Hype gap+15
Incentives70
Confidence60

Perspective Coverage

3 publishers
Builder
Builder 20%
Operator
Operator 33%
Investor
Investor 47%
Why these scores

Claim ledger

Ranked by verification strength, evidence, and original report placement.

  1. [1]

    Anthropic CEO Dario Amodei said last month that external evaluators should have the right to publish key findings "without editorial control."

    ReportedSupportedSource: Reuters, via channelnewsasia.com2 sources— create a free account to open themView cited source
  2. [2]

    OpenAI agreed days later, saying assessors should have "editorial independence."

    ReportedSupportedSource: Reuters, via channelnewsasia.com2 sources— create a free account to open themView cited source
  3. [3]

    Anthropic said that seeking significant control over embedded evaluators' publications did not accurately characterize all of its discussions with independent evaluators, and that in current conversations with evaluators it previously worked with it had made clear the reviewers control their methods, evaluation criteria, conclusions and what to publish.

    ReportedSupportedSource: Anthropic, in response to Reuters questions2 sources— create a free account to open themView cited source

Sources

2 independent publishers whose own reporting we read for this story.

  1. channelnewsasia.com

    1 article · October 13, 2026

    Exclusive-Behind AI industry's call for independent reviews, a fight over what gets made public
  2. cryptobriefing.com

    1 article · October 13, 2026

    Anthropic and OpenAI reportedly seek control over evaluator publications, raising trade secret concerns
  3. thenextweb.com

    1 article · October 13, 2026

    AI labs sought control over what outside evaluators publish, Reuters says

Share your take

Let Clarity write the post for you.

Signed-in readers get a short post drafted on this story in the register they choose — narrative, analytical, or a direct position — editable to the last word before it goes anywhere. The share buttons at the top of this story work without an account.

Topics and entities

Follow any of these and your For You feed starts watching them — no settings page required.

Loading related stories