Skip to content

ScienceNot yet confirmed elsewhere1 publisher2 min readPublished

NCEAS wrote down the AI arguments its own teams kept having: agent access, and sessions that forget

The center's own teams kept re-arguing how much access an AI agent should get. The published answer is that it belongs in project setup, not in the middle of a pipeline.

The Scientist · Science desk

How we use AISend a correction

What happened

  • NCEAS researchers at UC Santa Barbara published ten rules for using generative AI in environmental code work in PLOS Computational Biology.
  • The document came out of a literature review and months of co-writing by 22 researchers, developers and data analysts, then was offered to the wider field.
  • The trigger case was the Wildfire Resilience Index, built by six people across two countries and 13 jurisdictions on R and Python pipelines.
  • Senior author Cat Fong says prior guidance was aimed at software engineers or at science in the abstract, not at small teams with mixed coding experience and messy multi-source data.
  • The authors cite a UN report putting generative AI use near two-thirds in some high-income countries and around 5% in many low-income ones.

Why it matters

  • decision Agent access scope becomes something a project owner records at setup, or it stays what each researcher improvised privately, which is what NCEAS found happening in its own building.
  • constraint Guidance tied to a specific tool generation goes stale faster than a project ships, so any team rulebook has to be written at the level of process or it expires before publication.
  • exposure As capable tools move behind paid tiers, researchers at underfunded institutions and in low-income countries inherit a rulebook written for capabilities they cannot buy.
  • cost The compute behind these tools carries an environmental cost the authors say they cannot size, because much of the data needed is private, leaving an unpriceable input inside environmental research.

Rachel King's list of the arguments that kept resurfacing contains one item a reviewer can settle line by line and two that a reviewer cannot: how much access to give an AI agent, and what to do when a long chat session forgets a decision it made an hour earlier [6].

Access is different in kind from a bad suggestion. It is granted once, it persists, and it applies to work nobody has read yet. Context loss has a similar shape: a session that has dropped an earlier decision keeps emitting code consistent with the wrong one until somebody notices, and the wrongness is internally coherent. Neither failure is repaired by better prompting after the fact, which is the most plausible reason the ten rules place project preparation and AI selection in the "before coding" phase, and put verification of generated code plus documentation of the process in the "after" phase [9].

The documentation half is the part that carries weight, because it is the only artefact that outlives the tool. A record of which assistant produced which function, and who checked it, converts an unreproducible chat into something a methods section can hold. Without it, a team's evidence that a human verified anything is somebody's recollection.

The paper is also blunt about who is in the room. King cites a roughly thirteenfold gap between generative AI use in some high-income countries and use in many low-income ones [10], and reports that male researchers describe larger productivity gains than their female counterparts [15]. Guidance written for people with an agent wired into their repository is, at that ratio, guidance for a minority of the field it addresses.

Cat Fong says the result filled a gap nobody else had addressed [3], and several of the 22 contributors went in openly skeptical of the tools, which is why the output reads as a tradeoff inventory rather than an endorsement [12]. That skepticism is doing useful work. A rulebook produced by enthusiasts tends to specify which tool to use; one produced by an argument tends to specify who decides.

For a center where dozens of teams sit side by side on wildfire, biodiversity and climate work [13], the operational change is narrow and checkable: agent access now has a slot in the project plan, before the pipeline exists, where a name can sit next to the decision. The rest of the guide is advice. That slot is a control.

What to watch

  • Whether journals or funders start citing the ten rules as a review expectation for environmental code, rather than as optional advice.
  • Whether NCEAS reissues the guide when the next tool generation invalidates specific guidance, or lets the process-level rules stand unchanged.
  • Whether a documented case emerges of a team dropping to a weaker model because the capable tier moved behind a paywall.

Clarity's read

What the record supports and how the coverage leans. The claims behind it follow.

Reality

Evidence44
Adoption21
Hype gap+14
Incentives62
Confidence46
Why these scores

Claim ledger

Ranked by verification strength, evidence, and original report placement.

  1. [1]

    King cited a recent UN report finding that while roughly two-thirds of people in some high-income countries use generative AI tools, usage in many low-income countries hovers near just 5%.

    ReportedSupportedSource: Rachel King, citing a UN report2 sources— create a free account to open themView cited source
  2. [2]

    Senior author Cat Fong said existing advice was written for software engineers or for science in the abstract, and almost none of it accounted for what environmental science actually looks like: messy, multi-source data, small teams, and wildly different levels of coding experience in the same room.

  3. [3]

    Fong said what started as guidance for the NCEAS community ended up filling a gap nobody else had addressed.

Sources

1 independent publisher whose own reporting we read for this story.

  1. phys.org

    1 article · August 26, 2026

    A field guide for the Wild West of AI-assisted environmental science

Share your take

Let Clarity write the post for you.

Signed-in readers get a short post drafted on this story in the register they choose — narrative, analytical, or a direct position — editable to the last word before it goes anywhere. The share buttons at the top of this story work without an account.

Topics and entities

Follow any of these and your For You feed starts watching them — no settings page required.

Topics

  • AI Environmental FootprintFollow
  • AI Access EquityFollow
  • Research Software EngineeringFollow
  • AI-Assisted Coding PracticesFollow
  • Environmental Data ScienceFollow

Entities

Loading related stories