Bigtable integrates with LMCache for LLM KV caching
Google Cloud Bigtable can now serve as a remote storage backend for LMCache. This allows multiple AI serving instances to share and reuse precomputed attention tensors for LLM key-value caches, reducing compute overhead and improving time-to-first-token for repeated prompts. The feature is currently in Preview and intended for users running AI serving workloads.
Features (1) ›
- Bigtable
You can use Bigtable as a remote storage backend for LMCache . By storing the large language model (LLM) key-value (KV) cache externally in Bigtable, multiple AI serving instances can share and reuse precomputed attention tensors. This reduces compute overhead and significantly improves time-to-first-token (TTFT) for repeated prompts and shared documents. This feature is in Preview .
https://docs.cloud.google.com/release-notes#July_30_2026
Related releases
- Config Connector 1.154.1 Adds New Alpha Resources and Field Support Google Cloud release notes ·
- Security Command Center: Data Residency & Agent Vulnerability Scanning Preview Google Cloud release notes ·
- Cloud SQL for PostgreSQL: Private Service Connect changes August 2026 Google Cloud release notes ·
- Cloud SQL for SQL Server: Private Service Connect connection behavior changes Google Cloud release notes ·
- Cloud SQL for MySQL: Private Service Connect and QueryData Updates Google Cloud release notes ·
- Cloud SQL for PostgreSQL: Faster CMEK Re-encryption Google Cloud release notes ·