AWS Glue announces automatic version upgrades for Apache Spark jobs
AWS Glue introduces automatic version upgrades, a capability that keeps your Apache Spark jobs current on the latest AWS Glue runtime without manual coordination. Staying current on supported runtimes gives your jobs the latest security patches, performance improvements, and support for evolving table formats such as Apache Iceberg.
Also shipped Nov 12, 2026AWS in November 2026 →
Genie ZeroOps is available in Beta
Genie ZeroOps is now in beta, providing automated monitoring for jobs, pipelines, and tables. It detects failures and data quality issues, investigates root causes, and proposes fixes.
You can track table-level data lineage in Knowledge Catalog for BigQuery pipelines
You can track table-level data lineage in Knowledge Catalog for BigQuery pipelines. For more information, see Track data lineage . This feature is generally available (GA).
BigQuery generative AI functions now support the gemini-4-hydrogen model
BigQuery generative AI functions now support the gemini-4-hydrogen model. This model is generally available .
[In preview] Public Preview: SQL performance monitoring for Azure SQL Managed Instance
The public preview of Microsoft-managed performance monitoring for Azure SQL Managed Instance is now available. Customers monitoring business-critical SQL Managed Instance workloads often rely on custom scripts and disconnected monitoring tools. This requ
Gemini Enterprise: Gemini 4 Hydrogen available in web app, mobile app, Workflow Builder, and AI developer tools
Gemini 4 Hydrogen is generally available (GA) for the Gemini Enterprise web app, mobile app, Workflow Builder, and AI developer tools. Location availability : Supported in global , us , and eu multi-regions, with data residency and ML processing support in us and eu . For more information, see Data residency for Gemini Enterprise .
Gemini Enterprise: Gemini 3.8 Flash regional availability in Canada and Japan
Gemini 3.8 Flash is generally available (GA) in Canada and Japan. Location availability : Supported in the Canada and Japan in-country regions with in-region at-rest data residency (DRZ) and machine learning processing (MLP). App availability : Turned on by default in the web app for the Canada and Japan regions.
More from AWS Glue and Lake FormationEvery AWS Glue and Lake Formation release →
AWS Glue adds 100 new native connectors for popular SaaS applications
AWS Glue now includes 100 native connectors for SaaS and REST API applications, enabling data integration without custom code. These connectors allow teams to reuse connections across ETL jobs with existing permission models.
AWS Glue Data Catalog now supports catalog-vended credentials with Apache Iceberg REST catalog federation
AWS Glue Data Catalog now supports vended credentials for Apache Iceberg REST catalog federation. This allows users to read external Iceberg tables using coarse-grained grants and temporary security credentials scoped to S3 prefixes.
Amazon S3 Tables now offer managed migration of Apache Hive tables to Apache Iceberg
Amazon S3 Tables now supports managed migration of Apache Hive tables to Apache Iceberg. The service handles data validation, compatibility checks, type conversions, and file recompression as a managed, API-driven operation.
AWS Glue Data Catalog now supports Apache Iceberg table optimization in the US West (N. California) Region
Automatic table optimization for Apache Iceberg is now available in the US West (N. California) region. It compacts small files and removes unreferenced snapshots to improve query performance.
AWS Glue Data Catalog now supports OAuth for Apache Iceberg REST Catalog APIs
AWS Glue Data Catalog now supports OAuth 2.0 bearer token authentication for Apache Iceberg REST Catalog APIs, allowing secure federated access for third-party analytics platforms.
Amazon EMR now supports native data quality checks in Apache Spark jobs
Amazon EMR now validates data quality natively within Apache Spark jobs. Data engineering teams can catch quality issues inline before bad data reaches downstream systems, without building or maintaining separate validation infrastructure.
AWS Glue Data Catalog now supports table optimization, statistics, and crawlers for Apache Iceberg V3
AWS Glue Data Catalog now supports table optimization, statistics, and crawlers for Apache Iceberg Version 3 (V3) tables. With these new capabilities, you can automatically maintain V3 tables, optimize them for query performance, and discover them in Amazon S3.
Apache Iceberg materialized views now support system-managed write protection
Today, AWS announces system-managed materialized views for Apache Iceberg. Materialized views let you precompute an expensive query once and reuse the result across engines. Because this result is an open Iceberg table in your data lake, anyone with write access can change it, either through the catalog or by writing to the files in Amazon S3.