AWS details Iceberg materialized views in Amazon Redshift for data lake interoperability
This blog post explains the functionality of Iceberg materialized views within Amazon Redshift, allowing users to pre-compute complex queries and store the results as open Apache Iceberg tables in Amazon S3. It details how these views foster cross-engine interoperability, enabling sharing of expensive analytical outputs with services like Amazon Athena, Apache Spark, and Amazon SageMaker AI without data duplication. The article highlights how this capability simplifies data transformation pipelines and provides a consistent source of truth across diverse analytics workloads. It also contrasts Iceberg MVs with native Redshift MVs, noting support on Serverless and Graviton-powered RG instances.
- →Add lakeformation.amazonaws.com to the IAM role trust policy (in addition to redshift.amazonaws.com and glue.amazonaws.com)
- →Add lakeformation:GetDataAccess to the role’s inline policy
Features (2) ›
- Add lakeformation.amazonaws.com to the IAM role trust policy (in addition to redshift.amazonaws.com and glue.amazonaws.com)
- Add lakeformation:GetDataAccess to the role’s inline policy
https://aws.amazon.com/blogs/big-data/materialize-once-query-anywhere-introducing-iceberg-materialized-views-in-amazon-redshift/
Related releases
- Amazon Redshift Adds Support for Apache Iceberg Materialized Views AWS What's New ·
- Amazon Bedrock AgentCore Gateway supports private TLS certificates for VPC endpoints AWS What's New ·
- Amazon Redshift now supports cross-Region S3 data lake queries AWS What's New ·
- AWS Glue now offers system-managed write protection for Apache Iceberg materialized views AWS What's New ·
- AWS launches system-managed write protection for Apache Iceberg materialized views AWS What's New ·
- Amazon DynamoDB adds filtered export to Amazon S3 AWS What's New ·