Build1 distinct publisher3 min readPublished
A Pingora prototype zstd-encodes eligible responses as they enter cache and keeps them compressed between data centers, cutting those assets to a third of their on-disk size for a modelled few percent more CPU.
The Engineer · Build desk

Compiled by The EngineerSomething wrong?How this is made
Cloudflare's write-up shows its thinking most clearly in the policy it dropped. Cloudflare first considered transcoding only popular assets, since hot objects are reused most, and abandoned that because decode runs on every serve: limiting the feature to the hottest content gave up storage savings without cutting CPU by the same proportion [14][15]. The cold tail is where compression is nearly free, because those bytes occupy disk and are rarely decoded, while the objects you would have hand-picked are the ones that pay decode over and over. Blanket eligibility won on the simpler mechanism [15].
Now the ceiling. A third off eligible assets [5] applies only to that narrow, deliberately limited slice of the cache, not to the cache as a whole. Images, video and fonts were 63.3% of sampled bytes and get skipped as already compressed [8]. Text was 22.3% of bytes, and roughly 71% of it arrived with Content-Encoding unset, which is what Cloudflare stores on disk when the origin sends it that way [9][10][18]. So the eligible slice is 0.223 x 0.71, about 15.8% of bytes; at the corpus ratio of 2.8x it lands at 5.6%, and the sampled footprint falls by roughly 10% [6][13]. Petabytes at Cloudflare's scale [7], and one fewer disk in your rack.
For that figure to transfer, the request-weighted mix in the sample has to resemble what is actually resident on disk, and there is no reason those two distributions match: a cache holding mostly media presents less eligible surface than a request count suggests [8]. The post also carries two ratios, a third on average in initial testing and about 2.8 times on the controlled corpus, a spread of about 7% [5][6][19]. Plan against the smaller one.
The CPU figure wants the same scrutiny. A few percent is a model output under Cloudflare's own traffic and reuse assumptions [12], and hits per fill is the term that decides it. Encoding is paid once and the savings recur on every reuse [16], so high reuse amortises the fill and leaves decode as the steady cost, while a cache that fills and evicts pays level 3 encode repeatedly for bytes nobody reads twice [11].
Level 3 is a defensible pick rather than a tuned one. It is where most of the compression benefit arrives before fills become a CPU bottleneck [11], and Cloudflare's earlier browser testing put zstd 42% faster than Brotli at nearly the same file size and 11.3% smaller than gzip at comparable speed [17]. Losslessness is what actually matters here, more than ratio: every byte has to come back identical for the cache to serve the asset it promised to store [4]. This is still a prototype built by an intern on the 1.1.1.1 program [2], so read the ratios as a design note rather than a capacity plan.
Ranked by verification strength, evidence, and original report placement.
In initial testing, the encoding shrank eligible assets to one third of their original on-disk size on average.
In Cloudflare's controlled test corpus, the eligible assets compressed by roughly 2.8 times.
The prototype uses zstd level 3, which Cloudflare describes as giving most of the compression benefit without turning cache fills into a CPU bottleneck.
At zstd level 3, Cloudflare's model kept the extra CPU cost to a few percent under the traffic and reuse assumptions it tested.
Cloudflare says memory costs are increasing dramatically and that both RAM and hard disk drive prices have exploded over the past year.
Cache Transcoding is a prototype system built during an internship at Cloudflare as part of the 1.1.1.1 Intern Program.
Distinct publishers with included, body-backed reporting in this cluster.
1 article · September 1, 2026
Follow any of these and your For You feed starts watching them — no settings page required.
invest
The remedy New Mexico won at trial is the one Meta's $18 billion settlement does not contain1 distinct publisher
product
A 2x LLM bill is not a bug report: token spend is an observability problem1 distinct publisher
security
PavinLoader: the lures keep changing, the MSBuild stage does not1 distinct publisher
build
796 pages of semantic search with no vector database, and what it cost to skip one1 distinct publisher
Evidence-backed comparisons of source perspectives and observed adoption signals. Read the methodology
Which Builder, Operator, and Investor concerns the observed source mix emphasized—not a truth score.
Evidence, demonstrated adoption, hype gap, incentives, and confidence are assessed independently, each on its own current evidence. How these are measured.
Specific numbers, one interested author
The disclosures are unusually granular for a vendor post and they hang together: a traffic mix, an eligibility filter, a compression ratio, a compression level, a size floor. That granularity is why this is not scored lower. What holds it down is that all of it is Cloudflare measuring Cloudflare, the CPU figure is explicitly a model rather than an observation, and the two compression ratios in the post disagree with each other by about 7%.
Prototype, and it says so
Cloudflare is candid that Cache Transcoding was built during an internship and remains a prototype. Nothing is enabled for customers, no share of cache fills is behind it, and no shipping intent is stated. Credit for the honesty; there is simply nothing deployed to score.
Headline ratio, footnote effect
'Petabytes' and 'a third of on-disk size' are doing heavy lifting that Cloudflare's own sample does not support at that scale. Text is 22.3% of bytes, about 71% of it eligible, so roughly 15.8% of the corpus gets squeezed 2.8x — a saving near a tenth of the sampled footprint. Genuinely worth the CPU; about a quarter as dramatic as the framing, and measured against a fleet size nobody has published.
The saver writes the receipt
A CDN announcing that it can absorb a disk and memory price spike with software is telling customers and shareholders something flattering, and the piece doubles as advertising for the intern program that produced it and for Cloudflare's own Pingora and zstd work. None of that makes the percentages wrong. It does mean the favourable reading is the only reading on the record.
Trust the mechanism, not the magnitude
The engineering is described precisely enough to be argued with, which is more than most vendor posts manage, and the internal arithmetic is checkable. But a single interested source, a modelled cost, and nothing in production put a firm ceiling on how much of the claimed win we can stand behind.