ScienceNot yet confirmed elsewhere1 publisher2 min readPublished
NCEAS wrote down the AI arguments its own teams kept having: agent access, and sessions that forget
The center's own teams kept re-arguing how much access an AI agent should get. The published answer is that it belongs in project setup, not in the middle of a pipeline.
The Scientist · Science desk
What happened
- NCEAS researchers at UC Santa Barbara published ten rules for using generative AI in environmental code work in PLOS Computational Biology.
- The document came out of a literature review and months of co-writing by 22 researchers, developers and data analysts, then was offered to the wider field.
- The trigger case was the Wildfire Resilience Index, built by six people across two countries and 13 jurisdictions on R and Python pipelines.
- Senior author Cat Fong says prior guidance was aimed at software engineers or at science in the abstract, not at small teams with mixed coding experience and messy multi-source data.
- The authors cite a UN report putting generative AI use near two-thirds in some high-income countries and around 5% in many low-income ones.
Why it matters
- decision Agent access scope becomes something a project owner records at setup, or it stays what each researcher improvised privately, which is what NCEAS found happening in its own building.
- constraint Guidance tied to a specific tool generation goes stale faster than a project ships, so any team rulebook has to be written at the level of process or it expires before publication.
- exposure As capable tools move behind paid tiers, researchers at underfunded institutions and in low-income countries inherit a rulebook written for capabilities they cannot buy.
- cost The compute behind these tools carries an environmental cost the authors say they cannot size, because much of the data needed is private, leaving an unpriceable input inside environmental research.
Rachel King's list of the arguments that kept resurfacing contains one item a reviewer can settle line by line and two that a reviewer cannot: how much access to give an AI agent, and what to do when a long chat session forgets a decision it made an hour earlier [6].
Access is different in kind from a bad suggestion. It is granted once, it persists, and it applies to work nobody has read yet. Context loss has a similar shape: a session that has dropped an earlier decision keeps emitting code consistent with the wrong one until somebody notices, and the wrongness is internally coherent. Neither failure is repaired by better prompting after the fact, which is the most plausible reason the ten rules place project preparation and AI selection in the "before coding" phase, and put verification of generated code plus documentation of the process in the "after" phase [9].
The documentation half is the part that carries weight, because it is the only artefact that outlives the tool. A record of which assistant produced which function, and who checked it, converts an unreproducible chat into something a methods section can hold. Without it, a team's evidence that a human verified anything is somebody's recollection.
The paper is also blunt about who is in the room. King cites a roughly thirteenfold gap between generative AI use in some high-income countries and use in many low-income ones [10], and reports that male researchers describe larger productivity gains than their female counterparts [15]. Guidance written for people with an agent wired into their repository is, at that ratio, guidance for a minority of the field it addresses.
Cat Fong says the result filled a gap nobody else had addressed [3], and several of the 22 contributors went in openly skeptical of the tools, which is why the output reads as a tradeoff inventory rather than an endorsement [12]. That skepticism is doing useful work. A rulebook produced by enthusiasts tends to specify which tool to use; one produced by an argument tends to specify who decides.
For a center where dozens of teams sit side by side on wildfire, biodiversity and climate work [13], the operational change is narrow and checkable: agent access now has a slot in the project plan, before the pipeline exists, where a name can sit next to the decision. The rest of the guide is advice. That slot is a control.
What to watch
- Whether journals or funders start citing the ten rules as a review expectation for environmental code, rather than as optional advice.
- Whether NCEAS reissues the guide when the next tool generation invalidates specific guidance, or lets the process-level rules stand unchanged.
- Whether a documented case emerges of a team dropping to a weaker model because the capable tier moved behind a paywall.
Clarity's read
What the record supports and how the coverage leans. The claims behind it follow.
Reality
- Evidence44
- Adoption21
- Hype gap+14
- Incentives62
- Confidence46
Claim ledger
Ranked by verification strength, evidence, and original report placement.
- [1]
King cited a recent UN report finding that while roughly two-thirds of people in some high-income countries use generative AI tools, usage in many low-income countries hovers near just 5%.
ReportedSupportedSource: Rachel King, citing a UN report2 sources— create a free account to open themView cited source - [2]
Senior author Cat Fong said existing advice was written for software engineers or for science in the abstract, and almost none of it accounted for what environmental science actually looks like: messy, multi-source data, small teams, and wildly different levels of coding experience in the same room.
ReportedSupportedSource: Cat Fong, NCEAS2 sources— create a free account to open themView cited source - [3]
Fong said what started as guidance for the NCEAS community ended up filling a gap nobody else had addressed.
ReportedSupportedSource: Cat Fong, NCEAS2 sources— create a free account to open themView cited source - [4]
Researchers at UC Santa Barbara's National Center for Ecological Analysis and Synthesis (NCEAS) published "Ten simple rules for effective use of generative AI for code development in environmental science" in PLOS Computational Biology.
- [5]
The guide was refined through literature review and months of co-writing among 22 researchers, developers and data analysts, and was offered to the whole field rather than kept internal to NCEAS.
- [6]
Ecologist and data scientist Rachel King said teams kept repeating the same conversation project after project: whether to trust a suggestion, how much access to give an AI agent, and what to do when a long chat session forgets a decision it made an hour earlier.
- [7]
A six-person team built the Wildfire Resilience Index, an open-access tool for measuring how prepared communities and landscapes are for wildfire, stitching satellite imagery, land-cover data and socioeconomic variables with R and Python pipelines across two countries and 13 unique jurisdictions.
- [8]
The Wildfire Resilience Index project began in 2023, and by the time it was released an entirely new generation of AI coding tools had arrived, so lessons the team had learned six months earlier no longer applied.
- [9]
The 10 rules are organized around three phases of working with AI: before, during and after coding. They cover project preparation and AI selection, promote best practices during coding, and call for verification of AI-generated code and documentation of the process after coding.
- [10]
The generative AI usage figures King cites imply roughly a thirteenfold gap between adoption in some high-income countries and adoption in many low-income countries.
- [11]
The researchers said the infrastructure behind generative AI carries its own environmental costs, but there is a lot of uncertainty about the magnitude because the field is changing rapidly and much of the data needed to make estimates is private.
- [12]
Fong said some of the authors were openly skeptical of generative AI going into the project, and that the result is honest about the tradeoffs rather than just enthusiastic about the tool.
- [13]
At NCEAS, dozens of research teams work side by side on subjects including wildfire, biodiversity and climate change.
- [14]
Across NCEAS, junior researchers were leaning on AI they did not fully understand, veteran scientists doubted it could be trusted at all, and people in between were quietly inventing their own rules for what counted as responsible use.
- [15]
King said male researchers report larger productivity gains from generative AI than their female counterparts.
ReportedInsufficientSource: Rachel King, NCEAS2 sources— create a free account to open themView cited source - [16]
According to the researchers, as leading generative AI companies shift toward paid tiers, the most capable tools risk becoming inaccessible to researchers at underfunded institutions and in low-income countries, turning what was billed as an equalizer into a new barrier to entry.
Sources
1 independent publisher whose own reporting we read for this story.
- phys.orgA field guide for the Wild West of AI-assisted environmental science
1 article · August 26, 2026
Topics and entities
Follow any of these and your For You feed starts watching them — no settings page required.