Scottish Water Drives Conversational Data Access with Databricks Genie & Copilot
Scottish Water implemented Databricks Genie to create a natural language interface for its capital investment data. This solution, integrated with Microsoft Teams and Copilot, allows project teams to ask plain English questions and receive governed insights quickly. The approach aims to reduce reliance on specialist data teams and fragmented reports, making data more accessible for faster, informed decision-making across the organization. It is built for trust and scale, leveraging Unity Catalog and custom business rules.
- →Addressing fragmented data access at Scottish Water
- →Implementing a conversational data interface with Databricks Genie
- →Significant improvements in data access and efficiency
- →Ensuring data trust and accuracy through robust governance
- →Continuous monitoring and repeatable delivery for production
Notes (5) ›
- Addressing fragmented data access at Scottish Water
Scottish Water faced challenges with fragmented access to critical capital investment data, requiring teams to navigate numerous reports or rely on data specialists. This often led to duplicated efforts, slow decision-making, and valuable information not reaching non-technical users efficiently.
- Implementing a conversational data interface with Databricks Genie
Scottish Water built "SPARK," a natural-language interface on Databricks Genie, integrated with Microsoft Teams via Copilot. This allows project teams to ask questions in plain English and receive trusted answers, grounded in curated and governed data layers, directly within their workflow.
- Significant improvements in data access and efficiency
The new system drastically reduces the time and effort required to access project data, turning multi-step searches into direct question-and-answer interactions. It saves project teams significant hours weekly by enabling faster, tailored insights and reducing dependence on specialist support.
- Ensuring data trust and accuracy through robust governance
The solution was designed with governance from the start, utilizing Unity Catalog for access control and a semantic layer built on metric views to standardize definitions. It was also tuned for accuracy with curated business rules, terminology, and example questions to align with Scottish Water's conventions.
- Continuous monitoring and repeatable delivery for production
Scottish Water established comprehensive monitoring for the SPARK solution, tracking adoption, answer quality, and performance in production. This includes reviewing recurring questions for potential visualizations and ensuring the solution can be safely and consistently promoted across environments.
https://www.databricks.com/blog/how-scottish-water-made-its-capital-investment-data-conversational-databricks-genie
Related releases
- AI Hallucinations: Causes, Risks, and Prevention Strategies Databricks Blog ·
- Databricks Introduces Smart Routing in Unity AI Gateway for Cost-Optimized Coding Databricks Blog ·
- Databricks SDK for Go v0.172.0 Enhances IAMv2 and Job Cluster Management Databricks Go SDK Releases ·
- Databricks Java SDK v0.146.0 Adds IAM V2 API, Updates Job Cluster Field Databricks Java SDK Releases ·
- Databricks SDK for Python v0.128.0 Adds Account and Workspace IAM V2 API Methods Databricks Python SDK Releases ·
- Amtrak Builds Unified Data Backbone with Databricks for Rail Network Transformation Databricks Blog ·