Bigtable integrates with LMCache for LLM KV caching
Google Cloud Bigtable can now serve as a remote storage backend for LMCache. This allows multiple AI serving instances to share and reuse precomputed attention tensors for LLM key-value caches, reducing compute overhead and improving time-to-first-token for repeated prompts. The feature is currently in Preview and intended for users running AI serving workloads.
Features (1) ›
- Bigtable
You can use Bigtable as a remote storage backend for LMCache . By storing the large language model (LLM) key-value (KV) cache externally in Bigtable, multiple AI serving instances can share and reuse precomputed attention tensors. This reduces compute overhead and significantly improves time-to-first-token (TTFT) for repeated prompts and shared documents. This feature is in Preview .
https://docs.cloud.google.com/release-notes#July_30_2026
Related releases
- Cloud SQL for SQL Server 2017 Deprecation and End-of-Life Announced Google Cloud release notes ·
- GCP Network Intelligence Center simplifies Monitoring Point installation Google Cloud release notes ·
- Compute Engine now shows Workload Manager findings on Overview page Google Cloud release notes ·
- Vertex AI Search: Configurable Pricing for Query Add-ons Now GA Google Cloud release notes ·
- Google SecOps SIEM Deprecates Three Mandiant/Open Source Intelligence Feeds Google Cloud release notes ·
- Cloud SQL for PostgreSQL Adds `pg_textsearch` Extension for Full-Text Search Google Cloud release notes ·