Loading today’s stories
Product3 distinct publishers3 min readUpdated
FDA's generative-AI device rulebook is still a draft, and the comment docket shuts October 19
The agency floated doctor-style competency testing for GenAI medical devices and said the graded object is the shipped product, not the model underneath. Comments close October 19, 2026.
The Product Desk · Product desk
What happened
- FDA issued a discussion paper on considerations for the regulation of generative AI-enabled medical devices, seeking feedback on risk assessment, premarket evaluation, postmarket monitoring and other related topics.
- The Digital Health Center of Excellence, within FDA's Center for Devices and Radiological Health, is leading the discussion paper.
- The paper begins by outlining a possible two-axis framework for risk assessment that might inform regulatory expectations.
- The potential premarket approach is built on competency assessment, inspired at a high level by how physicians are trained and evaluated, and consists of non-clinical device benchmarking and clinical confirmation.
- The paper describes several potential approaches to risk-proportionate postmarket monitoring and discusses considerations around foundation models and agentic AI systems.
Compiled by The Product DeskSomething wrong?How this is made
Why it matters
The two axes matter more than the exam metaphor. FDA says the rigor of premarket testing would scale with a product's risk profile, and that the profile could turn on whether a product steers a user toward an action or provides information, and on what happens when a user relies on a faulty output [8]. Companies are already shipping chatbots that help patients manage mental health, diabetes and other conditions [19], and where any one of them lands on those two axes decides whether its evidence package is a benchmark run or a prospective clinical study with trained patient actors [9]. Arguing that placement costs a comment letter now. It costs a submission cycle later.
The second structural choice is the tested object. FDA would evaluate the final, user-facing device rather than foundation models or isolated subcomponents [6]. A base model vendor's own scores are therefore not your evidence file, and the paper's separate treatment of foundation models and agentic systems [5] does not change the unit being graded. Any team planning to swap or upgrade the model underneath a cleared product is holding a question the paper leaves open: how much of the competency record survives that change.
Benchmarking is meant to cover clinical knowledge, analytic capabilities, safety behavior, communication and generalizability, scored with rubrics and expert adjudication [7][10]. Rubric authorship is where the leverage sits, and it is not vacant: academics have already proposed requiring generative AI products to pass licensure exams, and the American Medical Association is weighing whether AI licenses are the right path [16]. FDA also concedes benchmark testing may not fully capture real clinical practice, which is why clinical confirmation is on the menu alongside real-world evidence collection after launch [11][c11b]. Count the stages and the framework asks for three separate evidence streams per device rather than one clearance event [23].
The paper is explicitly not draft or final guidance and does not propose policy changes [20], and it declines to address whether any of these approaches sit inside FDA's existing legal authorities [14]. Rick Abramson, who directs the Digital Health Center of Excellence, wrote on LinkedIn that FDA is putting its ideas in the public square to refine them before translating them into policy [13]. That is the operative word. CDRH also says its goal is a nimble approach using least burdensome principles and timely patient access [18], and the agency framed the whole effort as aligned with the administration's priority of using AI to speed medical products to market [22]. Both lines are quotable back at the agency when the guidance arrives heavier than the paper.
The consultation is the visible end of work already under way: an advisory committee met in 2024 and 2025, FDA has published several requests for information, and it recently convened health AI companies to guide its thinking [17]. The firms in those rooms know what they intend to file. Respondents are not required to answer every question and may submit partial responses [21], so the entry price for everyone else is one well-argued question, not the whole paper.
Loading topic controls
Loading related stories