Databricks Re-architects Serverless Network Config Delivery for 97.5% Latency Cut
Databricks has re-architected its serverless network configuration delivery, moving from synchronous upstream calls to an event-driven pre-computation pipeline. This change significantly improved performance and reliability for its serverless compute platform, which launches tens of millions of VMs daily. The new architecture cut RPC p99 latency by 97.5% (from 5,000ms to 125ms) and boosted service availability to 99.99%. It also reduced upstream call volume by 86%, benefiting customers using SQL warehouses, notebooks, and ML serving endpoints.
Features (1) ›
- Re-architected Serverless Network Configuration Delivery
Databricks re-architected its serverless network configuration delivery, moving from synchronous upstream calls to an event-driven pipeline that pre-computes configurations and serves them from a snapshot store. This change reduced RPC p99 latency by 97.5% (5,000ms to 125ms), boosted availability to 99.99%, and cut upstream call volume by 86% across billions of daily requests.
https://www.databricks.com/blog/databricks-network-configuration-delivery-tens-millions-serverless-vms
Related releases
- Databricks SDK for Go v0.172.0 Enhances IAMv2 and Job Cluster Management Databricks Go SDK Releases ·
- Databricks Java SDK v0.146.0 Adds IAM V2 API, Updates Job Cluster Field Databricks Java SDK Releases ·
- Databricks SDK for Python v0.128.0 Adds Account and Workspace IAM V2 API Methods Databricks Python SDK Releases ·
- Amtrak Builds Unified Data Backbone with Databricks for Rail Network Transformation Databricks Blog ·
- How a Major Freight Railroad Scaled Pipeline Creation with Databricks Genie Code Databricks Blog ·
- Databricks Terraform Provider v1.126.0 Released Terraform Databricks Provider Releases ·