ReleaseBytes
aws AWS What's New ·

AWS Glue REST API connector adds VPC, filter pushdown, and partition support

dataawsengineer
feature

AWS Glue's REST API connector now supports VPC connections, filter pushdown, and partition support, allowing secure access to private data sources and improving ingestion performance. These enhancements enable engineers to integrate data from proprietary systems without custom code, reducing costs and speeding up ETL pipelines. The new capabilities are available in all AWS commercial regions.

  • →REST API connector now supports VPC connections
  • →Filter pushdown improves efficiency and performance
  • →Partition support enables parallel reads for faster ingestion
  • →Enhanced REST API connector is broadly available
Features (1) ›
  • REST API connector now supports VPC connections

    AWS Glue's REST API connector can now securely access data sources hosted in private subnets or connected via VPNs or AWS PrivateLink without exposing traffic to the public internet.

Enhancements (2) ›
  • Filter pushdown improves efficiency and performance

    Filter pushdown translates query predicates into API-native parameters, ensuring only matching records are transferred from the source. This reduces data transfer costs and enhances job performance.

  • Partition support enables parallel reads for faster ingestion

    Partition support splits large datasets across multiple Spark workers using field-based or record-count strategies. This provides parallel reads, reducing ingestion time for high-volume, paginated APIs.

Notes (1) ›
  • Enhanced REST API connector is broadly available

    These new capabilities for the AWS Glue REST API connector are available in all AWS commercial regions where AWS Glue is offered.

Read the original announcement →

https://aws.amazon.com/about-aws/whats-new/2026/07/aws-glue-rest-connector-filtering-partitioning-vpc

Related releases