gcp Google Cloud Blog ·

Data Commons on Spanner GA, Platform Preview for Knowledge Graph Unification

blogdataaigcppreviewengineerretailgcp-bigquerygcp-spanner
feature announcement

Google announced the general availability of Data Commons on Spanner Graph and the preview of the Data Commons Platform, enabling businesses to unify private knowledge graphs with public datasets. This integration simplifies connecting internal data with over 100 authoritative public data providers, leveraging Spanner Graph's native graph capabilities for scalability and efficient querying. The platform supports organizations in building private instances, allowing federated analysis across public and proprietary data, with SDMX 3.0 interoperability for third-party tool integration. Preview access for the Data Commons Platform is available by contacting support.

  • Preview of Data Commons Platform to unify private and public knowledge
  • SDMX 3.0 interoperability for statistical data exchange
  • Build private instances of Data Commons Platform
  • Data Commons on Spanner Graph now generally available
  • Spanner Graph powers Data Commons for improved performance and updates
Features (3)
  • Preview of Data Commons Platform to unify private and public knowledge

    The new Data Commons Platform is now in preview, designed to unify organizations' private knowledge graphs with public datasets. This allows for federated analysis across proprietary data and Google's public knowledge graph, maintaining data isolation and enabling new use cases such as retail analytics.

  • SDMX 3.0 interoperability for statistical data exchange

    Data Commons now supports the SDMX technical standard version 3.0, facilitating integration with third-party tools like Tableau, Flourish, and Observable. This is enabled through SDMX-JSON and SDMX-CSV 2.0 formats via availability and data APIs for discovering and retrieving multi-dimensional datasets.

  • Build private instances of Data Commons Platform

    Organizations can now build private instances of the Data Commons Platform using the same scalable technology powering Google's instance. This provides full control over private data while enabling natural language queries that can blend results from private data with Google's public data.

Enhancements (1)
  • Spanner Graph powers Data Commons for improved performance and updates

    The Data Commons architecture has transitioned to Spanner Graph, utilizing a native graph model for high availability, scalability, and transactional consistency. This move simplifies pipelines, supports incremental data updates, and allows for dynamic graph traversals and consistent data snapshots via Spanner's TrueTime and stale reads.

Notes (1)
  • Data Commons on Spanner Graph now generally available

    Data Commons on Spanner Graph is now generally available, enabling businesses to connect internal data with public reference data to create knowledge graphs. The platform unifies data from over 100 providers, structuring over 400 billion data points using Schema.org definitions.

Read the original announcement →

https://cloud.google.com/blog/products/databases/unify-public-and-private-data-with-data-commons-on-spanner-graph/

Related releases