BuildNot yet confirmed elsewhere1 publisher3 min readPublished
Six to nine vendors, five obligations each: the first AI security exercise is arithmetic
A vendor-authored count says a typical production AI app routes through 6 to 9 services, each adding a key, an egress path, an in-runtime SDK, a prompt log and a subprocessor. The count holds up.
The Engineer · Build desk

What happened
- Each of those vendors adds at least five things: a standing API key, an egress path, an SDK running in your process, a log store filling with prompts, and a DPA subprocessor.
- It cites Morris et al. (2023) recovering 92% of short text inputs exactly from their embeddings as grounds for treating vectors as sensitive.
- It traces a single user message into four systems: the gateway log, the vector database, the memory service and the observability trace.
Why it matters
- constraint An erasure obligation you cannot execute in code becomes an errand. Four vendor APIs with four deletion semantics means the best evidence you can produce is a ticket, not a logged result.
- exposure If the vector store is missing from the data map, the gap surfaces the day a regulator or an enterprise buyer asks where customer data lives, and the honest answer includes a system nobody listed.
- cost The recurring bill is attention: key rotations, egress rules, vendor reviews and CVE feeds per vendor, work that no single sprint ever budgeted and no single owner inherited.
- contradiction The post's own enumeration lands at nine or ten vendors against its advertised ceiling of nine, so anyone using its range as a planning baseline is starting one vendor short.
Finish the multiplication the post starts. Five obligations per vendor across six to nine vendors is 30 to 45 recurring items [12]: keys with their own rotation stories, egress destinations the firewall has to allow, subprocessor entries on the DPA, breach notification clocks that start independently, dependency trees whose CVE feeds someone is nominally watching [6]. None of that arrived as a decision. It arrived one sprint at a time, according to Backboard.io, which wrote the count [15].
Then count the stack the post itself lists, and the headline range stops holding. Gateway, vector database, memory service, RAG framework, embedding provider, orchestration layer and observability tool is seven categories before you add the two or three model providers, which puts a typical deployment at nine or ten vendors, not six to nine [13]. The company arguing you have too many vendors is undercounting by at least one. Treat 6 to 9 as a floor.
The interesting failure is deletion, and it is a structural one rather than a vendor quality problem. Follow a single user message: it lands in the gateway's request log, a derivative embedding lands in the vector database, the memory service persists a version, and the observability tool captures the whole trace including the completion [7]. That is four retention policies and four deletion semantics behind four vendor APIs, which means an erasure request becomes four tickets rather than one executed operation [8]. Backboard's framing is the right one: under GDPR Article 17, "we asked our subprocessors" is a weaker position than "we called the delete endpoint and logged the result" [16]. The obligation is single and yours; the capability is distributed and mostly not yours.
The escape hatch teams reach for is that embeddings are just numbers, and the cited literature closes it. Morris et al. (2023) demonstrated iterative reconstruction that exactly recovers 92% of short text inputs from their embeddings [4], and Song and Raghunathan (2020) showed embeddings leak content and authorship [c5b]. So the vector store is a second queryable copy of the source data, in a different trust boundary, with its own key, and frequently missing from the data map compliance maintains [1]. Two questions worth asking before any tooling purchase: whether that key is scoped per workload or reads every namespace [11], and whether erasure deletes the embeddings or only the source rows [18].
The in-runtime SDK item on the list is not hypothetical either. LangChain shipped a remote code execution vulnerability in its math chain, CVE-2023-29374 [9], and the integration layer is by definition the code holding credentials to both the model and data layers [3]. Meanwhile the security review goes to the model provider, and the seven services wrapped around it usually get none [17].
Backboard sells AI infrastructure and labels that interest at the end of its own post [10]. The pitch is consolidation, so discount it accordingly. The arithmetic is free, and it is checkable against artefacts you already have: keys in config, allow rules in the firewall, the subprocessor list in the DPA.
What to watch
- Whether any Article 17 enforcement action names a vector store as a location where personal data lives, which would settle the "just numbers" defence in public.
- Whether the services in this stack ship per-workload scoped keys and a logged embedding-delete endpoint, the one item on the list a customer cannot build around.
- Whether Backboard's consolidation product actually shortens the subprocessor list on a signed DPA, or moves the same names one layer down.
Clarity's read
What the record supports and how the coverage leans. The claims behind it follow.
Reality
- Evidence54
- Adoption
- Insufficient
- Hype gap+22
- Incentives78
- Confidence46
Claim ledger
Ranked by verification strength, evidence, and original report placement.
- [1]
A vector database is a second, queryable copy of source data, sitting in a different trust boundary, usually with its own API key, and frequently excluded from the data inventory the compliance team maintains.
- [2]
Each vendor adds at least five things to the attack surface: a standing API key, an egress path out of the network, an SDK executing inside the runtime, a log store that fills with prompts, and a subprocessor on the data processing agreement.
- [3]
The AI attack surface has three parts: the model layer (providers prompts travel to), the data layer (systems storing prompts, embeddings, memories or retrieved documents), and the integration layer (every SDK, framework and glue service with credentials to the other two).
- [4]
Morris et al. (2023), "Text Embeddings Reveal (Almost) As Much As Text", demonstrated iterative reconstruction that exactly recovers 92% of short text inputs from their embeddings.
- [5]
Song and Raghunathan (2020) showed that embeddings leak both content and authorship.
- [6]
Eight vendors means roughly eight API keys with their own rotation stories, eight egress destinations the firewall must allow, eight vendor security reviews (or eight skipped), eight subprocessors on the DPA, eight breach notification clocks that can start independently, and eight dependency trees whose CVE feeds someone should be watching.
- [7]
One user message lands in the gateway's request log, produces a derivative in the vector database, is persisted by the memory service, and is captured in full by the observability tool including prompt and completion: one piece of customer data in four systems.
- [8]
Those four systems carry four retention policies, four vendor APIs and four different deletion semantics, so a team cannot execute a specific user's deletion itself; it can file four tickets and ask.
- [9]
LangChain shipped a remote code execution vulnerability in its math chain, CVE-2023-29374.
- [10]
The post is by the team at Backboard.io, which builds AI infrastructure, says it has a position, and states that position, clearly labeled, at the end.
- [11]
Another of the questions is whether the vector DB key in the app config has read access to every namespace or is scoped per workload.
- [12]
At five added items per vendor, a 6 to 9 vendor stack carries 30 to 45 distinct standing surface items; an eight-vendor stack carries 40.
- [13]
The seven service categories the post enumerates plus its own 2 to 3 model providers total 9 to 10 vendors, which exceeds the stated upper bound of 9.
- [14]
A typical production AI application runs on 6 to 9 separate vendors: a model gateway, a vector database, a memory service, a RAG framework, an embedding provider, an orchestration layer, an observability tool, and 2 to 3 model providers.
ReportedContestedSource: Backboard.io, writing on dev.to2 sources— create a free account to open themView cited source - [15]
Most teams never approved this stack as a whole; they approved it one sprint at a time.
- [16]
Under GDPR Article 17 and similar regimes, "we asked our subprocessors" is a much weaker position than "we called the delete endpoint and logged the result".
- [17]
The model provider gets a security review; the seven services wrapped around it usually do not.
- [18]
One of the three questions the post says teams should ask is whether, when a customer invokes the right to erasure, the pipeline deletes the embeddings or only the source rows; it says that is where most stacks fail.
Sources
1 independent publisher whose own reporting we read for this story.
- dev.toEvery Layer of Your AI Stack Is an Attack Vector. Count Them.
1 article · August 26, 2026
Topics and entities
Follow any of these and your For You feed starts watching them — no settings page required.
Topics
- AI Supply Chain SecurityFollow
- AI Application SecurityFollow
- Shadow AIFollow
- Data Deletion and GDPR ErasureFollow
- Third-Party and Supply Chain RiskFollow
- Vector Databases and Embedding PrivacyFollow