Apache Iceberg materialized views now support system-managed write protection
Today, AWS announces system-managed materialized views for Apache Iceberg. Materialized views let you precompute an expensive query once and reuse the result across engines. Because this result is an open Iceberg table in your data lake, anyone with write access can change it, either through the catalog or by writing to the files in Amazon S3.
Also shipped Sep 30, 2026AWS in September 2026 →
Place pipeline processors anywhere you need them with Pipeline Control
Pipeline Control pipelines used to ship with a static, fixed structure , one Sample Rate node, one Filter node, one Transform node, in a set order. Now you can add and delete Sample Rate, Filter, and Transform processors at any point in the pipeline, in any order, as many times as you need.
The updated version of Pathpoint is now available in Public Preview
The updated version of Pathpoint is now available in Public Preview. When something breaks in a complex system, sometimes the hardest part isn't fixing it, but figuring out how it may impact the business and what part of the customer journey to look at first.
The new Astro experience is now live for all Organizations
The new Astro experience is now turned on for all Organizations and is out of Preview. It replaces the previous Astro experience, so there is no longer an opt-in or an option to switch back. The change doesn't affect your pipelines or configuration. Astro's navigation gives you a single view across your entire Organization instead of a single Workspace.
The Astro IDE is generally available
The Astro IDE is now generally available and is no longer a Preview feature. The Astro IDE is a browser-based workspace for Apache Airflow where you write Dag code, validate and test changes, and deploy or push your work without setting up a local development environment.
Containers - New scheduling policy for Containers to configure image and instance from Durable Objects
Containers now support the durable_object scheduling policy in public beta. This policy lets a Durable Object select the image and instance size for a Container at runtime instead of using one centrally managed configuration for the application.
Containers - Snapshot and restore Container filesystem
Containers now support snapshot APIs in public beta for saving and restoring point-in-time filesystem state. Create a snapshot first, then pass it back to start() to restore files after container sleep, restart, or handoff to another Durable Object. Use snapshotContainer() through the Durable Object Container API to capture the full container filesystem.
More from AWS Glue and Lake FormationEvery AWS Glue and Lake Formation release →
AWS Glue Data Catalog now supports table optimization, statistics, and crawlers for Apache Iceberg V3
AWS Glue Data Catalog now supports table optimization, statistics, and crawlers for Apache Iceberg Version 3 (V3) tables. With these new capabilities, you can automatically maintain V3 tables, optimize them for query performance, and discover them in Amazon S3.
AWS Glue Data Quality delivers context-specific rule recommendations in seconds
AWS Glue Data Quality now generates data quality rules in seconds, reducing the time to establish data quality checks for your tables in the AWS Glue Data Catalog. You get a ready-to-use set of rules with full coverage across every column, with no manual setup, so you can move from raw data to trusted data faster while authoring pipelines.
Amazon EMR now supports native data quality checks in Apache Spark jobs
Amazon EMR now validates data quality natively within Apache Spark jobs. Data engineering teams can catch quality issues inline before bad data reaches downstream systems, without building or maintaining separate validation infrastructure.
AWS Glue zero-ETL now captures archived Salesforce records
AWS Glue zero-ETL integrations for Salesforce now capture archived records in your target tables, giving you a complete replica of your Salesforce data for analytics and reporting. Archived records are identified and reflected accurately through the isArchived field, so your analytical data stays fully in sync with your Salesforce source.
AWS Glue zero-ETL adds target table property ownership and conflict detection
AWS Glue zero-ETL integrations now detect table property conflicts and track integration ownership. When you configure a source table and target catalog, Glue associates the resulting table properties with the owning integration, so two integrations can no longer be pointed at the same target table without your knowledge.
AWS Glue Data Catalog now supports OAuth for Apache Iceberg REST Catalog APIs
AWS Glue Data Catalog now supports OAuth 2.0 bearer token authentication for Apache Iceberg REST Catalog APIs, allowing secure federated access for third-party analytics platforms.
AWS Glue Data Catalog now supports Apache Iceberg table optimization in the US West (N. California) Region
Automatic table optimization for Apache Iceberg is now available in the US West (N. California) region. It compacts small files and removes unreferenced snapshots to improve query performance.
Amazon S3 Tables now offer managed migration of Apache Hive tables to Apache Iceberg
Amazon S3 Tables now supports managed migration of Apache Hive tables to Apache Iceberg. The service handles data validation, compatibility checks, type conversions, and file recompression as a managed, API-driven operation.