Security1 distinct publisher3 min readUpdated
The Agentic AI Detection and Response system runs in production at Uber. Three of its five components are now open source, including a 300-task, 133-MCP-server benchmark.
The Watch · Security desk
Compiled by The WatchSomething wrong?How this is made
Uber has published ADR, an "Agentic AI Detection and Response" system that it says is deployed in production internally to secure employee-facing agents such as Cursor, Claude Code and Codex, plus customer-facing support agents [1][2][3]. The release matters less as software than as a published reference point: the accompanying benchmark gives buyers a concrete thing to point at when a vendor says it does "AI agent security" [10].
The architecture Uber describes has five parts: discovering unsanctioned AI tools, observing agent activity, benchmarking defenses, detecting threats, and preventing unsafe actions [5]. Three of the five are in the open-source drop [1]. Discovery, which inventories installed AI applications, CLI agents, local model runtimes and MCP servers on employee endpoints, is held back [6]. So is Prevention, the part that actually blocks an action [7]. So is ADR Explorer, the offline engine Uber says it uses to harden detection through pre-deployment red teaming [8]. What you get is the Sensor, the benchmark and the Detector [12], under Apache 2.0, with AgentDojo vendored under MIT inside the benchmark tree [13].
The observability claim is the one with production mileage behind it. Uber says the sensor captures agent intent, tool use and execution traces across more than seven AI coding tools on macOS, Linux and Windows, as well as internal automation and customer-facing support agents [9]. That is the unglamorous half of this problem and the half most teams have skipped: before you can detect a compromised coding agent, you need a unified record of what it decided to do and which tools it called.
ADR-Bench is the part that creates an obligation for everyone else. Uber puts it at more than 300 tasks across 133 MCP servers, with coverage of what it counts as all 17 agent attack techniques [10]. That works out to roughly 2.3 tasks per MCP server, so the design bias is breadth of environment rather than depth per server [2]. The 17-technique taxonomy is Uber's own accounting, and the benchmark ships synthetic fixtures - fake credentials, emulated environments, prompt-injection scenarios - that Uber labels for defensive research only [10][16]. Detection itself is two-tier: high-recall triage first, deeper agentic reasoning only on sessions that look suspicious [11]. The default detector is a dual-agent configuration called adr, with a keyless llamafirewall baseline available for smoke tests [14], and the quickstart exports both an Anthropic and an OpenAI API key [15]. That tells you where the reasoning happens and, by extension, where the per-session cost lands.
The paper behind it was accepted to the Ninth Conference on Machine Learning and Systems in 2026, and the repository includes a reproducibility document covering benchmark inflation, detector runs and figure generation [4][17].
Watch three things. Whether Discovery and Prevention ever ship, because an observe-and-detect stack without an enforcement point leaves the response half of "detection and response" as an exercise for the reader [6][7]. Whether any commercial agent-security vendor publishes its own ADR-Bench results rather than describing its coverage in prose [10]. And whether the two-tier detector's numbers hold outside Uber's telemetry, given that the red-teaming engine used to harden it was not released [8][11].
Follow any of these and your For You feed starts watching them — no settings page required.
Ranked by verification strength, evidence, and original report placement.
ADR (Agentic AI Detection and Response) is an enterprise security system for AI agents.
ADR helps organizations secure employee-facing agents such as Cursor, Claude Code and Codex, as well as customer-facing agents such as AI support agents.
The accompanying paper, 'ADR: An Agentic Detection System for Enterprise Agentic AI Security', was accepted to MLSys 2026 (Proceedings of the Ninth Conference on Machine Learning and Systems, 2026).
ADR secures enterprise AI agents through five complementary capabilities: discovering unsanctioned AI tools, observing agent activity, evaluating defenses, detecting threats, and preventing unsafe actions.
ADR Discovery inventories installed AI applications, CLI agents, local model runtimes and MCP servers on employee endpoints; this component is not included in the current open-source release.
Evidence-backed comparisons of source perspectives and observed adoption signals. Read the methodology
Which Builder, Operator, and Investor concerns the observed source mix emphasized—not a truth score.
Evidence, demonstrated adoption, hype gap, incentives, and confidence are assessed independently, each on its own current evidence. How these are measured.
Artifact-verifiable, but efficacy unmeasured and single-sourced
The shippable parts of the claim set are checkable in the repository itself: license terms, component layout, default detector, API-key setup, synthetic fixtures and a documented reproducibility workflow, backed by a peer-reviewed MLSys 2026 acceptance. What is missing is the part that would substantiate the security claim: no detector recall, precision or false-positive numbers accompany the 300-task, 133-server benchmark or the 'all 17 attack techniques' coverage assertion, and the production and cross-platform coverage figures are first-party with no corroborating source in the cluster.
One first-party production user, release too new for external uptake
Adoption evidence is real but narrow: a genuine production deployment inside the publishing organization, across multiple operating systems and agent classes, plus a fresh open-source release and a published benchmark. There is no evidence of any external adopter, contributor, star/fork count, downstream integration or vendor reporting against ADR-Bench, and the components an outside enterprise would most need to operate the system (Discovery, Prevention) are not released.
Modestly overstated: five-capability story, three-component release, zero published scores
The repository frames ADR as a five-capability system that secures enterprise AI agents and covers all 17 agent attack techniques, while shipping three components and no efficacy results; the story headline's suggestion that vendors now have a number to be measured against outruns a benchmark released without scores. The overstatement is bounded rather than severe because the release is candid about what is withheld, the license and setup details are accurate, and the paper passed peer review.
Vendor-published, prestige and recruiting oriented
The single source is the publishing organization's own repository, promoting a system it built, alongside a conference acceptance and 'Stay tuned' teasers for the unreleased components. Uber gains engineering-brand, research-credibility and recruiting value, and controls which parts of the stack become public while keeping endpoint discovery and prevention proprietary. There is no disclosed commercial product or pricing in the cluster, which keeps the incentive from being straightforwardly sales-driven.
Facts crisp, breadth thin: one first-party source
Confidence is limited by cluster structure rather than by ambiguity. The claims are specific and internally consistent, and much of the release is directly inspectable, which supports moderate confidence in the repository-level facts. But there is exactly one publisher and it is the project owner, no independent replication of benchmark or production figures, and no adoption data beyond the first-party deployment, so assessments about efficacy and market impact remain provisional.
build
EDR sees the file write, not the reason: the case for an agent-native detection layer1 distinct publisher
product
A 2x LLM bill is not a bug report: token spend is an observability problem1 distinct publisher
build
Your Multi-Key Failover Is The Most Expensive Line On Your Coding Agent Bill1 distinct publisher
build
A 12MB Go binary bets agent cost control is cache stickiness, not a dashboard1 distinct publisher
Distinct publishers with included, body-backed reporting in this cluster.