Build1 distinct publisher3 min readPublished
The leader changes with the measurement, so a shortlist filtered on traversal latency can hand you the engine that needs four seconds to count edges. The query shape you run all day is what decides the purchase.
The Engineer · Build desk

Compiled by The EngineerSomething wrong?How this is made
Counting citations per paper across the whole graph has to touch all 352,807 edges [2]. Divide the two slow aggregation times by that edge count and you get about 11 microseconds per edge for ArangoDB Oasis and about 5 for CognoDB [1][2]. On a graph this size, per-edge costs in the microseconds are what turn a query into a batch job, which is roughly how the author frames the difference between a full scan and a point lookup [16]. He checked the boring explanation first: db.explain() showed the edge index in use with no planner warnings [11].
His reading of the concurrency result is a protocol ceiling. ArangoDB Oasis is the only platform in the set speaking HTTP/REST, where three others use Bolt and FalkorDB uses native RESP [12], and he says plainly that he cannot prove root cause from a free-tier black box [13]. I would take it on those terms. The evidence has the right shape for it, because per-request overhead is invisible in one timed query and expensive when forty clients are pushing at once [8].
The flatline itself rests on a thin sample. Two ten-second runs at those rates come to roughly 310 ArangoDB operations in total [4]. The reported 1.05x does not quite agree with the printed integers either, whose ratio is 1.07 [5], so there were decimals behind them. The direction is not in question; a 4x load increase observed over twenty seconds of wall clock is still a smoke test rather than a capacity model.
For any of this to transfer, two things have to hold. Your traffic has to be dominated by the shape that decided the ranking, and the gap between the fast pair and the slower three on hops and lookups is roughly 1.6x to 2.2x at the reported boundaries [7], which stops being a procurement criterion the moment your latency budget is 250ms. Your graph also has to look like this one, averaging 12.7 edges per node [3], uniform enough that a three-hop traversal is a bounded amount of work rather than an accidental scan through a supernode.
The finding I would act on is the cheapest one to verify. CognoDB speaks Bolt and Cypher, and the author repointed the same client code at it by changing a URI, a username and a password [15]. That is what makes this argument operational: if a candidate costs three environment variables to try, you can run the suite against your own query mix instead of adjudicating someone else's. Worth noting that the author was asked to benchmark CognoDB against the other four [1], and it landed mid-pack on traversals and lookups [14] with the second-slowest aggregation of the five [8]. The post does not say who asked, and the result reads like measurement rather than promotion.
Ranked by verification strength, evidence, and original report placement.
A dev.to post by Ahmed Amer reports benchmarking CognoDB Cloud, a new Neo4j-compatible managed graph database, against Neo4j AuraDB, Memgraph Cloud, FalkorDB Cloud and ArangoDB Oasis, using the same dataset, the same logical queries, the same client machine and five free-tier cloud instances. The author states he was asked to benchmark CognoDB Cloud against the four others.
Memgraph was fastest on 1-hop, 2-hop and 3-hop traversals and fastest again on point lookups and indexed lookups, with Neo4j AuraDB a close second on all of these.
The dataset was SNAP's cit-HepTh citation network: 27,770 physics papers and 352,807 citation edges, with a schema of (:Paper)-[:CITES]->(:Paper).
Five things were measured on every platform: data load speed, 1/2/3-hop traversal from a node, key lookup, aggregation across the whole graph, and behaviour under concurrent load.
On traversals and lookups, CognoDB, FalkorDB and ArangoDB clustered in the 140-200ms range while Memgraph and Neo4j sat comfortably under 90ms.
On the aggregation query, which counted citations per paper across the whole graph and returned the top 20, Neo4j took first place after being second on every single-hop query.
Follow any of these and your For You feed starts watching them — no settings page required.
Evidence-backed comparisons of source perspectives and observed adoption signals. Read the methodology
Which Builder, Operator, and Investor concerns the observed source mix emphasized—not a truth score.
Evidence, demonstrated adoption, hype gap, incentives, and confidence are assessed independently, each on its own current evidence. How these are measured.
One self-run free-tier benchmark with disclosed methodology and disclosed confounds
Numbers, dataset, query shapes and workload mix are specific and reproducible in principle, and the author volunteers limits (unequal free-tier hardware, different regions, unproven root cause) plus an explain-plan check. But there is a single publisher, no independent replication, no vendor response, raw figures live in an unlinked repo, and one internal arithmetic inconsistency (1.05x versus 16/15) goes unreconciled.
No deployment or usage evidence
The cluster contains only a benchmark exercise on vendor free tiers. There are no production deployments, customer counts, usage disclosures, pricing or licensing signals for CognoDB Cloud or any of the four comparators, so real-world adoption cannot be measured from the supplied material.
Mildly overstated: real finding, narrower validity than the framing implies
The core assertion (leaderboard reorders with query shape) is directly supported by the reported numbers and the author hedges more than most vendor-adjacent benchmarks. The overstatement is one of scope: a purchase-shaping conclusion is drawn from free-tier instances on unequal hardware in different regions, with an unproven protocol hypothesis and one figure that does not reconcile arithmetically.
Vendor-adjacent commissioning disclosed only as 'I was asked'
The author says he was asked to benchmark CognoDB Cloud against four incumbents but never states by whom or on what terms. The subject vendor is the only one given a qualitative upside narrative (drop-in Bolt/Cypher switching, most transparent dashboard) alongside an unfavourable aggregation result, and the one competitor criticism outside the numbers targets Neo4j AuraDB Free's paywalled metrics. That is a material, partially disclosed incentive.
Moderate: transparent method, single unreplicated vendor-adjacent source
Confidence is limited by single-source sole authorship, an undisclosed commissioning relationship, absent independent verification and one arithmetic inconsistency; it is lifted by explicit methodology, self-disclosed confounds, an explain-plan sanity check and clear separation of measurement from hypothesis.
build
A CognoDB-side benchmark puts the vendor mid-pack, and ships the repo so you can check1 distinct publisher
build
A five-way graph database benchmark spent its first four hours measuring undersea cable1 distinct publisher
build
The number a graph benchmark won't print: 740 of 744 operations failed at 40 clients1 distinct publisher
build
The query a vector index cannot answer, whatever you embed it with1 distinct publisher
Distinct publishers with included, body-backed reporting in this cluster.
dev.to
1 article · August 27, 2026