ReleaseBytes
gcp Google Cloud release notes ·

Managed Service for Apache Spark Updates Image Versions with Iceberg 1.10 and OpenLineage 1.49

datagcpgaengineergcp-dataprocgcp-compute-engine
patch announcement

Google has released new subminor cluster image versions for Managed Service for Apache Spark, spanning versions 2.1, 2.2, 2.3, and 3.0. These updates introduce Iceberg version 1.10 by default for 2.3 clusters utilizing the Lightning Engine, enhancing data lake capabilities. Additionally, OpenLineage has been upgraded to version 1.49 in 2.2 and 2.3 image versions, improving lineage support for tables created via the Lakehouse Runtime catalog. The release also includes a fix for a segmentation fault occurring in OpenLineage when parsing complex SQL query strings.

  • →Managed Service for Apache Spark
Fixes (1) ›
  • Managed Service for Apache Spark Managed Service for Apache Spark

    Managed Service for Apache Spark (formerly Dataproc on Compute Engine): Fixed a segmentation fault when OpenLineage parses complex SQL query strings.

Notes (1) ›
  • Managed Service for Apache Spark

    New Managed Service for Apache Spark (formerly Dataproc on Compute Engine) subminor cluster image versions : 2.1.118-debian11, 2.1.118-rocky8, 2.1.118-ubuntu20, 2.1.118-ubuntu20-arm 2.2.86-debian12, 2.2.86-rocky9, 2.2.86-ubuntu22, 2.2.86-ubuntu22-arm 2.3.35-debian12, 2.3.35-ml-ubuntu22, 2.3.35-rocky9, 2.3.35-ubuntu22, 2.3.35-ubuntu22-arm 3.0.1-debian13, 3.0.1-ml-ubuntu24, 3.0.1-rocky9, 3.0.1-ubuntu24 Key updates in these image versions include: Iceberg updates : In the 2.3 image version, 2.3 clusters with Lightning Engine now use Iceberg version 1.10 by default. OpenLineage updates : In the 2.

    Managed Service for Apache Spark (formerly Dataproc on Compute Engine) subminor
Read the original announcement →

https://docs.cloud.google.com/release-notes#August_19_2026

Related releases