Databricks Unity AI Gateway Nearing General Availability for Enterprise AI Governance
Databricks Unity AI Gateway, a new governance solution for enterprise AI built on Unity Catalog, is slated for general availability soon. This gateway extends governance to interactions between models, agents, and tools, allowing organizations to control AI service usage, manage traffic, and monitor spend from a central control plane. Key capabilities include governing model, MCP, and model provider services, alongside budget management. It provides a unified approach for securing and managing AI workloads within the Databricks ecosystem.
- →Model Services for AI Traffic Management
- →MCP Services for Agent Governance and Tool Selection
- →Model Provider Services for External AI Integrations
- →Budgets for Cost Monitoring and Control
Features (4) ›
- Model Services for AI Traffic Management
Model services, treated as Unity Catalog securables, enable routing requests to pay-per-token and external models with traffic splitting and fallback. These services can be shared across multiple workspaces for centralized management.
- MCP Services for Agent Governance and Tool Selection
MCP (Model Control Plane) services allow registering external or Databricks-provided MCP servers. This capability enables governing agent access through grants and facilitates the selection of third-party tools within a controlled environment.
- Model Provider Services for External AI Integrations
Model provider services represent external AI providers such as OpenAI, Anthropic, and Amazon Bedrock. They offer centrally managed credentials, simplifying the governance and secure integration of third-party AI models.
- Budgets for Cost Monitoring and Control
The Budgets feature allows monitoring and controlling monthly Unity AI Gateway spend. It supports setting per-user thresholds and hard caps to manage consumption effectively and prevent unexpected costs.
https://docs.databricks.com/aws/en/release-notes/whats-coming#upcoming-general-availability-of-unity-ai-gateway
Related releases
- Python UDTFs in Unity Catalog Now Generally Available Databricks Release Notes ·
- Databricks Enhances Dashboards and Genie Code with AI-Powered Features Databricks Release Notes ·
- Databricks Rolls Out Automatic Upgrades for Row Tracking and Checkpoint V2 Databricks Release Notes ·
- Databricks Unity Catalog Now Generally Available for Managing Secrets Databricks Release Notes ·
- Databricks Unity AI Gateway Now Generally Available Databricks Release Notes ·
- Databricks Unity Catalog Introduces Tag Automations in Beta Databricks Release Notes ·