Skip to content

Build2 publishersAlso reported elsewhere2 min readPublished

Spark and Athena can now read Redshift materialized views kept in Iceberg format

Amazon Web Services added Iceberg materialized views to Redshift, so a result Redshift computes once can be read by Spark and Athena, a dev.to write-up says. Teams that copy shared metrics between engines with ETL jobs can retire those jobs only if the views stay fresh enough for their readers.

The Engineer · Build desk

How we use AISend a correction

Illustration accompanying Spark and Athena can now read Redshift materialized views kept in Iceberg format
Generated illustration

What happened

  • Redshift materialized views store a snapshot of a query's result, so reports pull processed data instead of recomputing the logic on each request.
  • Sharing a calculated metric across engines has usually meant building ETL pipelines, and the write-up blames those copies for delays and transfer errors.
  • The author argues that separate pipelines computing the same metric produce conflicting numbers, and that one view stored in Iceberg gives every team one figure.
  • The write-up also pitches the views for AI agents that query the same data repeatedly, saying precomputed results make those lookups faster and cheaper.

Compiled by The EngineerSomething wrong?How this is made

Why it matters

  • decision Teams running ETL jobs to copy Redshift metrics into Spark or Athena now have to decide, job by job, whether to point those readers at the view and switch the copy off.
  • cost Compute for a shared metric concentrates on Redshift, the engine that calculates it once, while Spark and Athena pay only to read the stored result.
  • precedent An optimization built in Redshift no longer has to be rebuilt when a team adds or swaps query engines, because the precomputed result sits in an open format.

The cost argument in the dev.to write-up rests on one example. If three engines run the same calculation, the company pays for that compute three times. With a shared Iceberg view, one engine does the work and the others consume the result [6]. On those terms, compute for that calculation falls by about two-thirds [12]. The example assumes every run costs the same and every read costs nothing [12].

Two conditions have to hold before that figure carries over to a real stack. Reading the stored view in Athena or Spark has to cost much less than recomputing the query there. The jobs on those engines also have to be rewritten to read the view instead of re-running the SQL against base tables. That second condition means a migration for every consuming job.

Freshness is where the write-up is least careful. The author says AI agents reading a shared view are less likely to encounter stale or conflicting data [9]. The conflicting part holds, because there is one copy. The stale part does not follow. The view is a stored snapshot [2], so a reader is exactly as current as the last refresh.

The write-up does not say how the views refresh, which catalog Spark and Athena use to find them, or what AWS charges for them. Those details decide whether a team can switch an ETL job off or only shorten it.

I think storing the shared result in an open table format is the right design. It takes the precomputed layer out of any single engine. The author's point that query optimizations stop being locked to one vendor follows directly from that [10]. The write-up also promises that engineers will focus on high-value tasks instead of basic maintenance [11]. I would wait for the refresh documentation before booking that time.

The first test I would run is short. Point Athena at the view, update a base table in Redshift, and time how long the two disagree.

What to watch

  • Redshift documentation on how Iceberg materialized views refresh, since a full recompute on every refresh would move the saved compute back onto the Redshift bill.
  • Which catalog Spark and Athena use to discover the views, and whether that works without per-engine setup.
  • AWS pricing for storing and refreshing the views. That price sets how much of the three-engine saving survives.

Clarity's read

What the record supports and how the coverage leans. The claims behind it follow.

Reality

Evidence28
Adoption
Insufficient
Hype gap+40
Incentives
Insufficient
Confidence35
Why these scores

Claim ledger

Ranked by verification strength, evidence, and original report placement.

  1. [1]

    Amazon Web Services launched support for Iceberg materialized views within its Redshift data warehouse service.

    ReportedSupportedSource: dev.to write-upView cited source
  2. [2]

    Materialized views function as stored snapshots of query results; instead of calculating complex logic every time a report is requested, the warehouse pulls the already processed data.

    ReportedSupportedSource: dev.to write-upView cited source
  3. [3]

    Redshift now extends materialized views to the Apache Iceberg format, so results generated in Redshift are accessible to other tools like Spark or Athena.

    ReportedSupportedSource: dev.to write-upView cited source

Sources

2 independent publishers whose own reporting we read for this story.

  1. aws.amazon.com

    1 article · October 5, 2026

    Amazon Redshift adds support for creating and refreshing Apache Iceberg materialized views
  2. dev.to

    1 article · October 8, 2026

    Amazon Redshift adds Iceberg materialized views

Share your take

Let Clarity write the post for you.

Signed-in readers get a short post drafted on this story in the register they choose — narrative, analytical, or a direct position — editable to the last word before it goes anywhere. The share buttons at the top of this story work without an account.

Topics and entities

Follow any of these and your For You feed starts watching them — no settings page required.

Topics

Loading related stories