Skip to content

Build1 publisher2 min readPublished

The agent's own summary launders a poisoned web page past both memory defenses

A preprint from Ariel University reports laundering attack success of up to 68% against existing agent-memory defenses, and argues in machine-checked TLA+ that authority has to be bound to an item's origin at the moment it is written.

The Engineer · Build desk

Illustration accompanying The agent's own summary launders a poisoned web page past both memory defenses

What happened

  • A preprint on arXiv by Yedidel Louck of the Ariel Cyber Innovation Center at Ariel University takes on memory poisoning in LLM agents that keep persistent long-term memory.
  • It names three laundering channels open to an agent adversary: the agent's own summarization, a trusted-tool echo, and manufactured corroboration, each breaking or flipping the item's derivation edge to trusted.
  • Its machine-checked separation theorem states that no content- or lineage-based defense is sound under laundering, that write-time origin binding is necessary, and that origin-bound authority with Sybil-resistant corroboration-gated elevation is sufficient.
  • The paper's own construction, TMA-NM, short for Tamper-evident Memory Authority, Non-Malleable, instantiates non-malleable information-flow control for agent memory.

Compiled by The EngineerSomething wrong?How this is made

Why it matters

  • exposure The party carrying the loss is the operator, not the session that was attacked: the item is written while researching one task and fires in an unrelated session weeks later, and anyone reviewing the action sees a note the agent wrote itself.
  • decision Anyone gating a payment or a settings change on a trust score or a provenance edge now has a published argument that the gate sits at the wrong end of the pipeline, and has to decide whether to move the check into the write path.
  • constraint The elevation path only works if the store can tell two independent corroborating sources from one source counted twice, which is a new requirement on a memory write API.
  • cost You can test the claim with the published harness, benchmark and TLA+ models instead of rebuilding the attacks; the cost is the engineering time to point them at your own memory store.

An agent that fetches a page and saves a note stores its own sentences, not the page. The bytes change, and the paper's claim is that the derivation edge back to the untrusted origin breaks, or flips to "trusted", in the process [3]. Its worked example is a page that says to send the customer list to a given address whenever backups are mentioned. The agent rewrites the page in its own words. Weeks later, in an unrelated session, the user asks about backups, the agent recalls the note, and the data goes out [14].

That sequence defeats content inspection. A poisoned memory is benign until it activates, so there is nothing to detect at write or rest time, and the paper argues an adaptive adversary can disguise the trigger well enough to survive inspection at use time [12]. Provenance fails differently. MemLineage tracks derivation and gates sensitive actions, but according to the paper it re-derives its verdict at dispatch and "offers no path for legitimate untrusted information to ever act" [13].

Write-time binding, the condition T2 makes necessary, is a schema change before it is anything else. The origin label has to live outside the note's text, since the text is what the model rewrote. It belongs in a record field the model's output never reaches, set by the write path itself. Elevation is the harder half: T3 permits it only through corroboration that resists Sybils [5]. Skip the independence check and the third laundering channel supplies the corroboration [3].

The 68% is a maximum over a grid, cross-defense, cross-attack and cross-model, run on eight frontier models [7]. Eight models by three laundering channels is 24 model-channel cells [15]. For that maximum to say anything about a particular deployment, three properties have to hold there. The agent writes paraphrases of fetched content into durable memory, of the sort MemGPT, Mem0, Generative Agents and MemMachine provide [10]. A tool's output is treated as an origin and not merely as content [3]. And something in the action path consults a content score or a derivation edge before dispatch [2]. An agent that keeps nothing between sessions sits outside the write-retrieve-act pipeline the paper formalises [16].

The proofs are TLA+ models, published with the benchmark and the harness [9]. Soundness holds for the specification as written, and matching a memory store to that specification is separate work. Two figures are blank in the abstract as rendered: TMA-NM's attack-success rate on direct and laundering attacks, and the injection-success rate the introduction cites for earlier poisoning results [8].

What to watch

  • Whether the released harness reproduces the up-to-68% laundering numbers on models and memory stores the author left untested.
  • Whether any of the memory frameworks the paper names adds an origin field set by the write path and unreachable from model output.
  • Whether reviewers accept a soundness result proved over a TLA+ model of the write-retrieve-act pipeline as covering shipping memory implementations.
Loading claim ledger
Loading source directory links
Loading share composer
Loading topic controls
Loading related stories