databricks Databricks Release Notes ·

Databricks Unity AI Gateway Consumer Access Reaches General Availability

aidatabricksgapreviewengineer
feature

Databricks is making consumer access to Unity AI Gateway model and model provider services generally available, transitioning from its current opt-in public preview. This change will enable consumer users to query these services without requiring preview enablement, potentially increasing model traffic, including to external providers. Account administrators are advised to set budgets, rate limits, or disable direct model access for consumer users before the GA transition. This ensures proper controls are in effect when the capability is fully released.

Notes (1)
  • Unity AI Gateway Consumer Access Will Be Generally Available

    Consumer access to Unity AI Gateway model and model provider services, currently opt-in via Public Preview, will become generally available. This will allow consumer users to query these services directly, which could lead to increased model traffic, including to external model providers. Account administrators should configure budgets, rate limits, or disable direct model access for consumer users prior to the GA release to manage potential traffic increases.

Read the original announcement →

https://docs.databricks.com/aws/en/release-notes/whats-coming#consumer-access-to-query-unity-ai-gateway-services-will-become-generally-available

Related releases