databricks Databricks Blog ·

Databricks improves agent retrieval accuracy using structured chart extraction

blogaidatabricksengineer
announcement

Databricks details an approach that significantly improves agent retrieval and answer accuracy for chart-based questions within proprietary documents. The method leverages structured chart extraction capabilities from `ai_parse_document`, combined with lightweight text retrieval, outperforming large multimodal embedding models. This is crucial for enterprises, particularly in financial services, where agents often struggle to interpret data in figures and charts. The technique uses Databricks' AI functions to build a chart-aware retrieval pipeline.

Enhancements (1)
  • Enhanced Agent Retrieval with Structured Chart Data

    Databricks demonstrates how structured chart extraction via `ai_parse_document`, combined with text retrieval, significantly improves agents' ability to answer questions from chart-heavy documents. This approach, evaluated on benchmarks like ViDoRe V3 and Chart-RAG, yields better retrieval and answer quality compared to traditional caption-only methods and large multimodal embedding models.

Read the original announcement →

https://www.databricks.com/blog/enhancing-agent-retrieval-structured-chart-extraction

Related releases