AWS Glue Interactive Sessions adds Spark Connect support
AWS Glue Interactive Sessions now supports Apache Spark Connect, enabling developers to run Spark applications from local IDEs and notebooks on AWS Glue's serverless infrastructure. This feature simplifies development workflows by decoupling client applications from the Spark execution environment, improving debugging and iterative development. It is available in specific AWS regions and provides enhanced observability.
- →Support for Apache Spark Connect in AWS Glue Interactive Sessions
- →Thin client architecture for improved development workflows
- →Simplified upgrades and improved stability
- →Enhanced observability for interactive sessions
- →Regional availability and getting started
Features (1) ›
- Support for Apache Spark Connect in AWS Glue Interactive Sessions
AWS Glue Interactive Sessions now supports Apache Spark Connect, allowing development and execution of Spark applications from preferred environments like SageMaker, Jupyter, or VS Code. This leverages AWS Glue's serverless infrastructure without cluster management.
Enhancements (3) ›
- Thin client architecture for improved development workflows
Spark Connect decouples client applications from the Spark execution environment, enabling ad hoc data exploration, iterative debugging, and incremental PySpark job development directly from familiar tools.
- Simplified upgrades and improved stability
The Spark Connect architecture isolates client dependencies from the server-side Spark runtime, simplifying upgrades and enhancing overall stability.
- Enhanced observability for interactive sessions
Users can monitor sessions in real-time via the Spark UI, track history using the Spark History Server, and manage sessions through the AWS Glue API, CLI, or SDK.
Notes (1) ›
- Regional availability and getting started
AWS Glue Interactive Sessions with Spark Connect is available in select regions across Asia Pacific, Canada, Europe, South America, and the US. Connection can be established from SageMaker, IDEs, or AWS API/SDK/CLI.
https://aws.amazon.com/about-aws/whats-new/2026/06/aws-glue-interactive-sessions-spark-connect-smus-notebooks