Skip to content

Topic

Data Lakehouse

An architecture combining data lake storage with warehouse-style querying, typically using open table formats like Iceberg plus a catalog and SQL engine.

Current stories

buildOne report1 publisher

Iceberg 1.11.0 puts Spark, Flink and Hive file access behind one format registry

Iceberg 1.11.0 ships a File Format API that sends Spark, Flink, Hive and plain-Java reads and writes through one registry of format models. A dev.to walkthrough says the file format list stays fixed, so Vortex and Lance still need a change inside Iceberg.

Publishers:dev.to

Reality

Evidence55
Adoption
Insufficient
Hype gap−10
Incentives
Insufficient
Confidence50
buildOne report1 publisher

RustFS puts an Iceberg REST catalog on the same port as its S3 API

RustFS embeds an Apache-2.0 Iceberg REST catalog in its object store and serves it on the S3 port, according to a dev.to walkthrough. Teams can drop a separate metastore, but catalog metadata then shares a failure domain with the data.

Publishers:dev.to

Reality

Evidence50
Adoption
Insufficient
Hype gap−10
Incentives
Insufficient
Confidence55