Skip to content

BuildNot yet confirmed elsewhere1 publisher3 min readPublished

Six to nine vendors, five obligations each: the first AI security exercise is arithmetic

A vendor-authored count says a typical production AI app routes through 6 to 9 services, each adding a key, an egress path, an in-runtime SDK, a prompt log and a subprocessor. The count holds up.

The Engineer · Build desk

How we use AISend a correction

Photograph accompanying Six to nine vendors, five obligations each: the first AI security exercise is arithmetic
Photo: okta.com

What happened

  • Each of those vendors adds at least five things: a standing API key, an egress path, an SDK running in your process, a log store filling with prompts, and a DPA subprocessor.
  • It cites Morris et al. (2023) recovering 92% of short text inputs exactly from their embeddings as grounds for treating vectors as sensitive.
  • It traces a single user message into four systems: the gateway log, the vector database, the memory service and the observability trace.

Why it matters

  • constraint An erasure obligation you cannot execute in code becomes an errand. Four vendor APIs with four deletion semantics means the best evidence you can produce is a ticket, not a logged result.
  • exposure If the vector store is missing from the data map, the gap surfaces the day a regulator or an enterprise buyer asks where customer data lives, and the honest answer includes a system nobody listed.
  • cost The recurring bill is attention: key rotations, egress rules, vendor reviews and CVE feeds per vendor, work that no single sprint ever budgeted and no single owner inherited.
  • contradiction The post's own enumeration lands at nine or ten vendors against its advertised ceiling of nine, so anyone using its range as a planning baseline is starting one vendor short.

Finish the multiplication the post starts. Five obligations per vendor across six to nine vendors is 30 to 45 recurring items [12]: keys with their own rotation stories, egress destinations the firewall has to allow, subprocessor entries on the DPA, breach notification clocks that start independently, dependency trees whose CVE feeds someone is nominally watching [6]. None of that arrived as a decision. It arrived one sprint at a time, according to Backboard.io, which wrote the count [15].

Then count the stack the post itself lists, and the headline range stops holding. Gateway, vector database, memory service, RAG framework, embedding provider, orchestration layer and observability tool is seven categories before you add the two or three model providers, which puts a typical deployment at nine or ten vendors, not six to nine [13]. The company arguing you have too many vendors is undercounting by at least one. Treat 6 to 9 as a floor.

The interesting failure is deletion, and it is a structural one rather than a vendor quality problem. Follow a single user message: it lands in the gateway's request log, a derivative embedding lands in the vector database, the memory service persists a version, and the observability tool captures the whole trace including the completion [7]. That is four retention policies and four deletion semantics behind four vendor APIs, which means an erasure request becomes four tickets rather than one executed operation [8]. Backboard's framing is the right one: under GDPR Article 17, "we asked our subprocessors" is a weaker position than "we called the delete endpoint and logged the result" [16]. The obligation is single and yours; the capability is distributed and mostly not yours.

The escape hatch teams reach for is that embeddings are just numbers, and the cited literature closes it. Morris et al. (2023) demonstrated iterative reconstruction that exactly recovers 92% of short text inputs from their embeddings [4], and Song and Raghunathan (2020) showed embeddings leak content and authorship [c5b]. So the vector store is a second queryable copy of the source data, in a different trust boundary, with its own key, and frequently missing from the data map compliance maintains [1]. Two questions worth asking before any tooling purchase: whether that key is scoped per workload or reads every namespace [11], and whether erasure deletes the embeddings or only the source rows [18].

The in-runtime SDK item on the list is not hypothetical either. LangChain shipped a remote code execution vulnerability in its math chain, CVE-2023-29374 [9], and the integration layer is by definition the code holding credentials to both the model and data layers [3]. Meanwhile the security review goes to the model provider, and the seven services wrapped around it usually get none [17].

Backboard sells AI infrastructure and labels that interest at the end of its own post [10]. The pitch is consolidation, so discount it accordingly. The arithmetic is free, and it is checkable against artefacts you already have: keys in config, allow rules in the firewall, the subprocessor list in the DPA.

What to watch

  • Whether any Article 17 enforcement action names a vector store as a location where personal data lives, which would settle the "just numbers" defence in public.
  • Whether the services in this stack ship per-workload scoped keys and a logged embedding-delete endpoint, the one item on the list a customer cannot build around.
  • Whether Backboard's consolidation product actually shortens the subprocessor list on a signed DPA, or moves the same names one layer down.

Clarity's read

What the record supports and how the coverage leans. The claims behind it follow.

Reality

Evidence54
Adoption
Insufficient
Hype gap+22
Incentives78
Confidence46
Why these scores

Claim ledger

Ranked by verification strength, evidence, and original report placement.

  1. [1]

    A vector database is a second, queryable copy of source data, sitting in a different trust boundary, usually with its own API key, and frequently excluded from the data inventory the compliance team maintains.

  2. [2]

    Each vendor adds at least five things to the attack surface: a standing API key, an egress path out of the network, an SDK executing inside the runtime, a log store that fills with prompts, and a subprocessor on the data processing agreement.

    ReportedSupportedView cited source
  3. [3]

    The AI attack surface has three parts: the model layer (providers prompts travel to), the data layer (systems storing prompts, embeddings, memories or retrieved documents), and the integration layer (every SDK, framework and glue service with credentials to the other two).

    ReportedSupportedView cited source

Sources

1 independent publisher whose own reporting we read for this story.

  1. dev.to

    1 article · August 26, 2026

    Every Layer of Your AI Stack Is an Attack Vector. Count Them.

Share your take

Let Clarity write the post for you.

Signed-in readers get a short post drafted on this story in the register they choose — narrative, analytical, or a direct position — editable to the last word before it goes anywhere. The share buttons at the top of this story work without an account.

Topics and entities

Follow any of these and your For You feed starts watching them — no settings page required.

Entities

Loading related stories