Databricks Lakeflow Connect to add incremental ingestion for Salesforce formula fields
Databricks Lakeflow Connect will soon enable incremental ingestion for Salesforce formula fields, moving away from the current default of full snapshots. This enhancement is designed to improve pipeline performance and reduce operational costs. Currently, formula fields are ingested via full snapshots on each run. Once generally available, incremental ingestion will become the default, benefiting users who integrate Salesforce data.
Features (1) ›
- Upcoming Incremental Ingestion for Salesforce Formula Fields
Lakeflow Connect will soon support incremental ingestion for Salesforce formula fields, replacing the current default of full snapshots. This change is expected to enhance performance and lower costs for data pipelines integrating Salesforce data.
https://docs.databricks.com/aws/en/release-notes/whats-coming#incremental-ingestion-for-salesforce-formula-fields-in-lakeflow-connect-will-soon-be-generally-available
Related releases
- Databricks Lakeflow Connect: Zerobus Ingest to Default Storage in Public Preview Databricks Release Notes ·
- Verkada Connector Now in Beta for Databricks Lakeflow Connect Databricks Release Notes ·
- Anysphere Audit Logs Connector for Databricks Lakeflow Connect (Beta) Databricks Release Notes ·
- Apache Arrow Support for Zerobus Ingest in Lakeflow Connect is Generally Available Databricks Release Notes ·
- Databricks Lakeflow: Pipeline Events System Table Enters Beta Databricks Release Notes ·
- Databricks Lakeflow Connect Adds Managed Glean Data Ingestion Connector (Beta) Databricks Release Notes ·