Build1 distinct publisher3 min readPublished
The corpus is 24.47 TB. The ground truth cost more than a quadrillion distance computations. What actually changes a procurement conversation is the YAML-configured harness, which also runs against two competing engines.
The Engineer · Build desk

Compiled by The EngineerSomething wrong?How this is made
The ground-truth bill is the part of this you can check with arithmetic. Exact top-1,000 results for 100,000 queries against 10.07 billion vectors is 1.007e15 distance computations [16], which is where Qdrant's "more than one quadrillion" figure lands [8]. That arithmetic tells you the method: no index and no approximation, one exhaustive pass over the corpus per query, on GPUs [10]. It is the only way a recall number means anything, because recall is measured against the exact answer. Vultr supplied the machines and ran the embedding pipeline, and Hugging Face donated hosting plus a storage grant [9]. Those costs sit with Vultr and Hugging Face, not with whoever tries to reproduce the run.
Read the dataset card before the announcement. A 768-dimensional float32 vector is 3,072 bytes, so 10.07 billion of them would be 30.9 TB, and Qdrant reports 24.47 TB of vector data [17][4]. So the 10.07 billion counts dense and sparse together, roughly one dense and one sparse representation per source document [3], or the dense side is stored in something narrower than fp32. Either reading changes what "ten billion" means when you size the hardware to hold it.
The same care applies to the query count. The extra 19,953 queries on the card are 16.6% of the total load [18], and the two filtered sets, which are the ones that exercise the interaction between the index and the predicate, are 8.3% [19]. A recall figure only means something once it names its query set.
For a FineWeb-10B latency number to predict your latency, three things have to hold: your embeddings are 768-dimensional and come from a model with geometry similar to gte-multilingual-base [3], your filter selectivity resembles the text- and structured-filtered sets [7], and your corpus is about as static as a web crawl snapshot. Qdrant concedes the dataset will age as embedding models and retrieval techniques change [21]. The write path is where I would push. Qdrant's own argument is that production systems must index changing data and hold tail latency across billions of records [14], and the harness tracks ingestion throughput and p50/p95/p99 latency as metrics [11]; whether it tracks them concurrently is the thing to confirm in the YAML before you quote a p99.
The leverage sits in one line of the release: the load and stress tools support Milvus and Elasticsearch alongside Qdrant [11]. Workloads are YAML files split across distributed workers with SkyPilot provisioning [10]. That makes "run this config and publish the p99" a reasonable thing to put in an evaluation plan, rather than a favour. Qdrant has an obvious interest in the answer. Runtimewire reads the release as a bid to set a standard aligned with Qdrant's own engineering strengths [13], funded in part by the $50 million Series B that AVP led on 12 March [12]. That interest doesn't make the test dishonest, it makes it a test worth running yourself, at roughly 100 times the 100-million ceiling where Qdrant says most vector benchmarks stop [5][20].
Ranked by verification strength, evidence, and original report placement.
According to the release, Supernova's load and stress-testing tools support Qdrant, Milvus and Elasticsearch, and tests can track ingestion throughput, queries per second, recall and latency at the 50th, 95th and 99th percentiles.
Qdrant released a 10-billion-vector search benchmark and the open-source engine used to build it on September 1st, pairing Qdrant-FineWeb-10B with Supernova, a framework for embedding data, calculating exact results, loading databases and running concurrent search workloads.
Andre Zayarni and Andrey Vasnetsov began working together in 2021 on a matching engine for unstructured data; Qdrant says existing tools including Meta's FAISS library lacked the production features and scale they needed, so Vasnetsov built a vector search engine from scratch and published it on GitHub, with Zayarni as CEO and Vasnetsov as CTO.
The dataset card describes roughly 10.07 billion dense and sparse vectors derived from Hugging Face's FineWeb corpus, alongside source text and metadata, and says each source document has a 768-dimensional dense embedding and a sparse representation generated with Alibaba-NLP's gte-multilingual-base.
Qdrant reports 24.47 TB of vector data and 28.66 TB of text and metadata.
Qdrant says common vector search benchmarks stop between 10 million and 100 million embeddings, frequently omit exact ground truth, and underrepresent sparse, multivector and filtered retrieval.
Distinct publishers with included, body-backed reporting in this cluster.
runtimewire.com
1 article · September 2, 2026
Follow any of these and your For You feed starts watching them — no settings page required.
build
Your RAG Cannot Find SKU-4471, And A Bigger Embedding Model Will Not Help1 distinct publisher
build
The query a vector index cannot answer, whatever you embed it with1 distinct publisher
invest
OpenAI allocates Astra's sharpest cyber capability by eligibility instead of price1 distinct publisher
build
DuckDB's vss extension removes a database from your RAG stack, then names the price1 distinct publisher
Evidence-backed comparisons of source perspectives and observed adoption signals. Read the methodology
Which Builder, Operator, and Investor concerns the observed source mix emphasized—not a truth score.
Evidence, demonstrated adoption, hype gap, incentives, and confidence are assessed independently, each on its own current evidence. How these are measured.
Checkable artifacts, one checker
The numbers are unusually specific for a vendor launch — 10.07 billion vectors, 24.47 TB and 28.66 TB, 119,953 queries broken out by set — and they live in a dataset card anyone can open, which is why Runtimewire could catch the announcement's headline covering only the dense subset. Two things hold the score down. Every figure still originates with Qdrant, and the storage arithmetic does not close: 768-dimensional float32 at that count needs roughly 30.9 TB, not 24.47 TB, and nothing in the release says what format absorbs the difference.
Shipped, not yet used by anyone else
What exists is real: a 53 TB corpus on Hugging Face, an open harness, and two infrastructure providers — Vultr for compute, Hugging Face for storage — willing to underwrite the build. What does not exist is a single outside data point. No Milvus or Elasticsearch team has published a run, no buyer has cited it in a comparison, and Qdrant itself concedes independent teams must reproduce the pipeline and tune each engine before the results mean anything in a vendor bake-off.
Modestly ahead of the receipts
The gap is small and mostly structural. A vendor-authored benchmark presented as a step toward internet-scale reproducibility is doing standard-setting work before anyone independent has run it, and the announcement's tidy 100,000 undersells a four-part query design that the dataset card lays out properly. Pulling the other way: shipping a harness that drives Milvus and Elasticsearch, and an FAQ that admits your own engineers may misconfigure rivals, are not the moves of a pure marketing exercise. The reporting itself is restrained; the overstatement sits in the framing, not the figures.
The scorekeeper sells the product
Qdrant built the corpus, picked the embedding model, wrote the harness, chose the metrics and set the defaults — and the metrics chosen are scale, hybrid retrieval, filtering and tail latency, precisely where its Rust engine is positioned. Fresh Series B capital gives it reason to move buyer attention onto those axes now. Publishing the code and supporting rival engines genuinely lowers the temperature, but availability of code is not parity of expertise: the party that knows how to tune all three engines is the party selling one of them.
Firm on what shipped, thin on what it means
We can be fairly confident about the artifact — it is published, the counts are itemised, one of them was checked directly, and the compute arithmetic holds. We are much less confident about the interpretation, because a single outlet is carrying a vendor's account of its own benchmark, the storage figures do not reconcile, and there is no external run to test any of it against. Confidence would move quickly on one reproduction by a team that does not sell a vector database.