GCP Managed Service for Apache Spark: New Images, Features, and Breaking Changes
Google Cloud has rolled out new subminor cluster image versions for its Managed Service for Apache Spark, introducing several feature enhancements and critical updates. These include added support for Apache Hudi and Iceberg 1.10, improved Parquet footer caching, and upgraded Cloud Storage and OpenLineage connectors. Users should note breaking changes related to preconfigured Conda channels and stricter SSH metadata restrictions, requiring migration to newer images and updated connection methods. The release also remediates a security vulnerability and fixes a parsing bug.
- →Managed Service for Apache Spark
Breaking changes (1) ›
- Managed Service for Apache Spark Managed Service for Apache Spark
Managed Service for Apache Spark (formerly Dataproc on Compute Engine): Preconfigured Conda channels removed: Preconfigured conda channels (such as conda-forge ) have been removed from configurations. All image version aliases now point to the latest image without conda channel configuration. Support for earlier images with conda channels configuration to be announced in upcoming release notes. Recommendation: Migrate to the latest image versions as soon as possible. Affected image versions: 1.3.96+ , 1.4.81+ , 1.5.92+ , 2.0.161+ , 2.1.119+ , 2.2.87+ , and 2.3.36+ . Impact: Additional conda pa
Fixes (1) ›
- Managed Service for Apache Spark Managed Service for Apache Spark
Managed Service for Apache Spark (formerly Dataproc on Compute Engine): Fixed a segmentation fault when OpenLineage parses complex SQL query strings with the Lakehouse Runtime catalog.
Notes (1) ›
- Managed Service for Apache Spark
New Managed Service for Apache Spark (formerly Dataproc on Compute Engine) subminor cluster image versions : 2.1.119-debian11, 2.1.119-rocky8, 2.1.119-ubuntu20, 2.1.119-ubuntu20-arm 2.2.87-debian12, 2.2.87-rocky9, 2.2.87-ubuntu22, 2.2.87-ubuntu22-arm 2.3.36-debian12, 2.3.36-ml-ubuntu22, 2.3.36-rocky9, 2.3.36-ubuntu22, 2.3.36-ubuntu22-arm 3.0.2-debian13, 3.0.2-ml-ubuntu24, 3.0.2-rocky9, 3.0.2-ubuntu24 Key updates in these image versions include: Feature updates: Apache Hudi: Added support for the Apache Hudi optional component in 3.0 images. Version 1.2.0 is available in 3.0 images. Parquet foo
https://docs.cloud.google.com/release-notes#September_04_2026
Related releases
- Google Cloud Introduces Data Agent Kit for Agentic Data Analysis in IDEs Google Cloud Blog ·
- Cloud Healthcare API: Filtered DICOM Data Export Now Generally Available Google Cloud release notes ·
- Terraform Provider for Google Cloud v7.46.1 Released Terraform Google Provider Releases ·
- Google Cloud Storage Introduces Dynamic Batch Operations Google Cloud release notes ·
- Cloud SDK 583.0.0 delivers updates for AlloyDB, BigQuery, Composer, and Cloud Run Google Cloud release notes ·
- Agent Platform Workbench Enhances Cloud Storage Integration and Notebook Reliability Google Cloud release notes ·