Cloudflare made its Data Platform generally available as Basin, three serverless services that ingest, catalog and query Apache Iceberg tables on R2. Outside Iceberg engines read the same tables, so Workers teams can price Basin SQL against a warehouse on identical data.
Perspective Coverage
3 publishers
- Builder
- Builder 39%
- Operator
- Operator 38%
- Investor
- Investor 23%
Reality
- Evidence55
- Adoption25
- Hype gap+25
- Incentives75
- Confidence60
Apache Iceberg's REST Catalog spec now lets a catalog return per-user row filters and nine column actions for a trusted engine to enforce, Databricks says. Policies that need subqueries or lookup tables do not fit that vocabulary, so the portability covers simple rules running on engines a deployment already trusts.
Reality
- Evidence40
- Adoption10
- Hype gap+15
- Incentives70
- Confidence45
Dropping three driver-side rewrite passes and one Step Functions wave produced most measured savings in a Glue pipeline's 56% runtime cut. An unindexed Oracle partition and a driver memory ceiling show where more concurrency stops helping.
Reality
- Evidence45
- Adoption
- Insufficient
- Hype gap+5
- Incentives
- Insufficient
- Confidence50
Keeping the Iceberg table format governance-unaware was a deliberate call. That leaves the catalog as the only thing standing on the path of every read. A dev.to guide lists six pieces an operator has to source above it.
Reality
- Evidence42
- Adoption25
- Hype gap+22
- Incentives74
- Confidence45
Astronomer's State of Apache Airflow 2026 puts 5,818 practitioners behind two migration numbers measured on different denominators. Recomputed on one base, about 62 percent are planning a move they have not started.
Reality
- Evidence46
- Adoption55
- Hype gap+30
- Incentives78
- Confidence56
A GCP walkthrough put Spark, Trino and BigQuery on the same orders table through Google's Iceberg REST catalog. The 409 ConflictException it logged is the part of the demo a production pipeline has to plan for.
Reality
- Evidence38
- Adoption18
- Hype gap+20
- Incentives35
- Confidence45
The partition count was frozen at checkpoint creation because each partition has its own RocksDB instance on disk. In Databricks Runtime 18, a separate config resizes the store and moves the state to match.
Reality
- Evidence60
- Adoption22
- Hype gap+18
- Incentives88
- Confidence52
A new Iceberg REST Catalog addition lets the catalog evaluate policy for one principal and return nine column actions plus row filters for a trusted engine to apply, while the spec leaves establishing that trust to the deployment.
Reality
- Evidence45
- Adoption30
- Hype gap+12
- Incentives80
- Confidence50
Microsoft documents no configurable mirroring window, and support confirmed that restarting a mirror reloads the whole table instead of resuming from the last CDC position. The estate here has roughly 2,500 tables.
Reality
- Evidence60
- Adoption35
- Hype gap−10
- Incentives30
- Confidence55
Uber reported 169:1 on 200TB of Spark logs a day by separating static templates from variable fields before anything was written to HDFS. Whether that ratio transfers depends on how few call sites your lines come from.
Reality
- Evidence45
- Adoption32
- Hype gap+20
- Incentives
- Insufficient
- Confidence48
Adyen traced sandbox setup failures on its big data clusters to a garbage collector that walks every tracked connection in order, which turns the table-size knob you raised for headroom into part of the fault.
Publishers:adyen.com
Reality
- Evidence66
- Adoption35
- Hype gap+8
- Incentives30
- Confidence60
Genie answers engineers in Slack rather than customers in an app. The 45,000-questions-a-month figure Uber published gives other planners a baseline they rarely get, even without a disclosed deflection rate.
Reality
- Evidence44
- Adoption28
- Hype gap+18
- Incentives62
- Confidence58
A dev.to writeup reduces the storage choice to a property test on the calling code. The part worth arguing about is when each wrong answer shows up: on the first query, or at 10 million files.
Reality
- Evidence28
- Adoption
- Insufficient
- Hype gap+18
- Incentives34
- Confidence40
A dev.to walkthrough lays out the POSIX recipe behind HDFS short-circuit reads and points it at java.lang.foreign. The supplied text stops before the Java arrives.
Reality
- Evidence48
- Adoption
- Insufficient
- Hype gap+22
- Incentives32
- Confidence54
AWS cut Glue pricing 30% and shipped full Iceberg v3, but the rate follows the version string, and its own two announcement posts do not agree on which Python you will be running.
Reality
- Evidence55
- Adoption18
- Hype gap+34
- Incentives88
- Confidence58
A 5-million-row file, opened byte by byte, puts the credit where it belongs: column locality, neighbour-dependent encoding, and metadata you can skip.
Reality
- Evidence61
- Adoption
- Insufficient
- Hype gap−12
- Incentives24
- Confidence56
Its SQL scripting now maps cursors, temp tables and exception handlers with near-identical syntax. The piece it calls decisive, multi-table rollback, is where the published walkthrough runs out.
Reality
- Evidence34
- Adoption15
- Hype gap+40
- Incentives90
- Confidence44
Anywhere Cloud promises governed agent access to data in public cloud, on-prem, sovereign and edge environments. The supporting evidence is Cloudera's own survey, and no pricing or customers are disclosed.
Reality
- Evidence22
- Adoption
- Insufficient
- Hype gap+45
- Incentives82
- Confidence33
Coverage extending to temporary cluster data removes the exact objection security reviewers used to block Spark workloads. The platform did not change much; the exception request did.
Reality
- Evidence20
- Adoption
- Insufficient
- Hype gap+45
- Incentives45
- Confidence27