Topic
Apache Parquet and Avro as storage and metadata encodings, including projection-read capability and release quality.
Iceberg 1.11.0 ships a File Format API that sends Spark, Flink, Hive and plain-Java reads and writes through one registry of format models. A dev.to walkthrough says the file format list stays fixed, so Vortex and Lance still need a change inside Iceberg.
Reality
The figure comes from a conference demo scanning a 4K video, and the same talk sets a target closer to 50 Gbit/s. The reason today's loaders still stage shards on disk turns out to be PyTorch's worker model.
Reality
Native geometry and geography types in format v3, with matching Parquet 2.11 logical types underneath, give a shape column its own bounding boxes and a CRS that travels with the data. The second half is the part worth migrating for.
Reality
A 5-million-row file, opened byte by byte, puts the credit where it belongs: column locality, neighbour-dependent encoding, and metadata you can skip.
Reality
Two decisions made on public mailing lists this week change what a safe lakehouse upgrade plan looks like. Streaming writers and anyone queued behind Parquet 1.18.0 need to re-read their notes.
Reality