Snowpipe Streaming Elastic Channels Now Generally Available on Snowflake

Snowpipe Streaming's Elastic Channels are now generally available, enabling direct, simplified streaming of data from applications, devices, and services into Snowflake or Snowflake-managed Apache Iceberg tables. This eliminates the need for separate ingestion systems, significantly reducing operational overhead, latency, and total cost of ownership for organizations.

Elastic Channels simplify the producer experience by automatically batching data additions, retrying transient failures, and managing ingestion scaling. The feature supports demanding workloads with throughputs up to 20GB/s per table and allows data to be queryable in as little as 5 seconds, providing durable acknowledgments when data is persistently stored.

Elastic Channels offer at-least-once delivery without strict ordering, while existing Named Channels provide per-channel ordering and exactly-once delivery for specific workloads. It offers Python, Java, and Node.js SDKs, as well as a REST API, and is generally available in all AWS, GCP, and Azure commercial regions, with Snowpipe Streaming charged per GB of ingested data.

Elastic Channels cater to various scenarios where numerous producers continuously generate data, including connected products and IoT for telemetry, industrial operations for machine signals, and digital applications for user events. It also streamlines security and observability by streaming logs, metrics, and traces from distributed agents.