NBCUniversal Migrates to Databricks Lakehouse for Scalable Analytics
NBCUniversal successfully migrated its data infrastructure to the Databricks Lakehouse Platform, achieving a 30% cost reduction by switching to dedicated job compute. This move enables independent scaling of data pipelines, faster job completion, and meets Service Level Agreements. The migration impacts data analysts, engineers, and scientists by providing a unified platform for advanced ML model development and real-time analytics, with a phased, partner-led implementation by EXL minimizing disruption.
- →Cost Reduction and Performance Gains with Databricks
- →Unified Platform for Advanced Analytics and ML
- →NBCUniversal's Data Infrastructure Modernization
- →Partner-Led Migration Strategy with Custom Tools
- →Lakehouse Architecture Benefits
Features (2) ›
- Cost Reduction and Performance Gains with Databricks
By migrating to Databricks' job-specific compute and away from a slot-based reservation model, NBCUniversal achieved a 30% cost reduction. This allows independent scaling of parallel pipelines, resulting in faster job completion and consistent SLA adherence.
- Unified Platform for Advanced Analytics and ML
The migration to Databricks provides NBCUniversal with a unified platform that supports advanced capabilities for ML model development, real-time analytics, and collaborative data engineering at scale.
Enhancements (3) ›
- Partner-Led Migration Strategy with Custom Tools
EXL implemented a phased migration strategy using custom automation tools, including a SQL translation engine and an orchestration migrator, to accelerate the process, reduce manual effort, and ensure code conversion, data migration, and validation.
- Lakehouse Architecture Benefits
Databricks' lakehouse architecture, leveraging Delta Lake and Apache Spark, provides NBCUniversal with flexibility for diverse data formats, enhanced machine learning capabilities via MLflow integration, and granular compute control for dedicated pipeline execution.
- Unity Catalog for Data Governance
NBCUniversal implemented Unity Catalog as the central governance layer within the Databricks environment, enhancing data lineage tracking and policy enforcement.
Notes (1) ›
- NBCUniversal's Data Infrastructure Modernization
NBCUniversal modernized its data infrastructure to support a growing content ecosystem, seeking a more scalable and integrated solution to enhance flexibility, improve performance, and optimize compute expenses.
https://www.databricks.com/blog/nbcuniversals-seamless-migration-unlocking-scalable-analytics-databricks
Related releases
- Databricks `ai_transcribe()` SQL Function for Audio Transcription (Beta) Databricks Release Notes ·
- Databricks Lakebase Snapshots API (Beta) for Programmatic Management Databricks Release Notes ·
- Databricks Introduces Session Restore for Serverless Jobs in Public Preview Databricks Release Notes ·
- Announcing On-Demand State Repartitioning for Apache Spark Structured Streaming on Databricks Databricks Blog ·
- Databricks Genie now displays visualizations directly in Slack replies Databricks Release Notes ·
- Databricks Introduces Configurable Data Retention for System Tables (Beta) Databricks Release Notes ·