Build2 publishersAlso reported elsewhere2 min readPublished
Spark and Athena can now read Redshift materialized views kept in Iceberg format
Amazon Web Services added Iceberg materialized views to Redshift, so a result Redshift computes once can be read by Spark and Athena, a dev.to write-up says. Teams that copy shared metrics between engines with ETL jobs can retire those jobs only if the views stay fresh enough for their readers.
The Engineer · Build desk

What happened
- Redshift materialized views store a snapshot of a query's result, so reports pull processed data instead of recomputing the logic on each request.
- Sharing a calculated metric across engines has usually meant building ETL pipelines, and the write-up blames those copies for delays and transfer errors.
- The author argues that separate pipelines computing the same metric produce conflicting numbers, and that one view stored in Iceberg gives every team one figure.
- The write-up also pitches the views for AI agents that query the same data repeatedly, saying precomputed results make those lookups faster and cheaper.
Compiled by The EngineerSomething wrong?How this is made
Why it matters
- decision Teams running ETL jobs to copy Redshift metrics into Spark or Athena now have to decide, job by job, whether to point those readers at the view and switch the copy off.
- cost Compute for a shared metric concentrates on Redshift, the engine that calculates it once, while Spark and Athena pay only to read the stored result.
- precedent An optimization built in Redshift no longer has to be rebuilt when a team adds or swaps query engines, because the precomputed result sits in an open format.
The cost argument in the dev.to write-up rests on one example. If three engines run the same calculation, the company pays for that compute three times. With a shared Iceberg view, one engine does the work and the others consume the result [6]. On those terms, compute for that calculation falls by about two-thirds [12]. The example assumes every run costs the same and every read costs nothing [12].
Two conditions have to hold before that figure carries over to a real stack. Reading the stored view in Athena or Spark has to cost much less than recomputing the query there. The jobs on those engines also have to be rewritten to read the view instead of re-running the SQL against base tables. That second condition means a migration for every consuming job.
Freshness is where the write-up is least careful. The author says AI agents reading a shared view are less likely to encounter stale or conflicting data [9]. The conflicting part holds, because there is one copy. The stale part does not follow. The view is a stored snapshot [2], so a reader is exactly as current as the last refresh.
The write-up does not say how the views refresh, which catalog Spark and Athena use to find them, or what AWS charges for them. Those details decide whether a team can switch an ETL job off or only shorten it.
I think storing the shared result in an open table format is the right design. It takes the precomputed layer out of any single engine. The author's point that query optimizations stop being locked to one vendor follows directly from that [10]. The write-up also promises that engineers will focus on high-value tasks instead of basic maintenance [11]. I would wait for the refresh documentation before booking that time.
The first test I would run is short. Point Athena at the view, update a base table in Redshift, and time how long the two disagree.
What to watch
- Redshift documentation on how Iceberg materialized views refresh, since a full recompute on every refresh would move the saved compute back onto the Redshift bill.
- Which catalog Spark and Athena use to discover the views, and whether that works without per-engine setup.
- AWS pricing for storing and refreshing the views. That price sets how much of the three-engine saving survives.
Clarity's read
What the record supports and how the coverage leans. The claims behind it follow.
Reality
- Evidence28
- Adoption
- Insufficient
- Hype gap+40
- Incentives
- Insufficient
- Confidence35
Claim ledger
Ranked by verification strength, evidence, and original report placement.
- [1]
Amazon Web Services launched support for Iceberg materialized views within its Redshift data warehouse service.
- [2]
Materialized views function as stored snapshots of query results; instead of calculating complex logic every time a report is requested, the warehouse pulls the already processed data.
- [3]
Redshift now extends materialized views to the Apache Iceberg format, so results generated in Redshift are accessible to other tools like Spark or Athena.
- [4]
Before this update, sharing a specific calculated metric across engines usually required building extraction, transformation and loading pipelines, which led to delays and increased the likelihood of errors during data transfer.
- [5]
The new interoperability removes the necessity for these extra pipelines.
- [6]
If three different analytics engines run the same calculation, the company pays for that compute three times; Iceberg materialized views allow one engine to do the work and others to consume the result.
- [7]
When different teams use separate pipelines to calculate the same business metrics they often end up with conflicting results; storing metrics in an open table format like Iceberg provides a single source of truth.
- [8]
AI agents frequently query underlying data sets; by using precomputed views, agents can retrieve information faster and more cheaply.
- [9]
When AI agents access a shared materialized view, they are less likely to encounter stale or conflicting data.
- [10]
Performance optimizations were often locked into a specific vendor or engine; open formats like Iceberg break these barriers, letting companies evolve their data stacks without losing query optimization progress.
- [11]
The change creates an environment where technical teams focus on high-value tasks instead of basic maintenance.
- [12]
In the write-up's three-engine example, computing once and letting two engines read the result cuts compute for that calculation by about two-thirds, assuming each run costs the same and reads cost nothing.
Sources
2 independent publishers whose own reporting we read for this story.
- aws.amazon.comAmazon Redshift adds support for creating and refreshing Apache Iceberg materialized views
1 article · October 5, 2026
- dev.toAmazon Redshift adds Iceberg materialized views
1 article · October 8, 2026
Topics and entities
Follow any of these and your For You feed starts watching them — no settings page required.
Topics
- Cloud data warehousingFollow
- Materialized viewsFollow
- Open table formatsFollow