databricks Databricks Blog ·

Databricks Feature Store now delivers real-time features with sub-second freshness

blogmldatabricksgadata-scientist
feature

Databricks Feature Store now provides sub-second freshness for ML features, reducing feature lag from minutes or hours to 200ms p99 latency. This enhancement enables real-time machine learning use cases such as fraud detection and personalization, which depend on immediate insights. Data scientists and ML engineers can leverage fresh signals without building complex custom streaming infrastructure. The capability is powered by Spark Real-Time Mode for continuous processing and Lakebase for streaming-optimized online storage.

Features (1)
  • Sub-second Feature Freshness for Real-time ML

    The Databricks Feature Store now delivers streaming aggregations from Kafka to the online store with 200ms p99 latency, collapsing feature lag from minutes or hours to milliseconds. This enables critical real-time ML use cases like fraud detection and personalization. The capability is built upon Spark Real-Time Mode (RTM) for continuous processing and Lakebase for streaming-optimized online storage.

Read the original announcement →

https://www.databricks.com/blog/how-databricks-feature-store-serves-features-sub-second-freshness

Related releases