aws AWS News Blog ·

Amazon EC2 G7 instances with NVIDIA RTX PRO 4500 GPUs now available

bloginfraawsgaengineeraws-ec2
feature announcement

AWS has launched Amazon EC2 G7 instances, the first major cloud provider offering with NVIDIA RTX PRO 4500 Blackwell Server Edition GPUs. These instances provide significant performance gains for AI inference, graphics, and data analytics workloads compared to previous generations. They are suitable for a wide range of GPU-enabled applications and are now available in two AWS regions.

  • New Amazon EC2 G7 instances offer enhanced GPU acceleration
  • G7 instances support various GPU-accelerated workloads
  • Enhanced multi-GPU and multi-node communication features
  • G7 instances provide faster GPU memory and high-performance networking
  • Advanced video encoding and decoding engines improve video workflows
Features (3)
  • New Amazon EC2 G7 instances offer enhanced GPU acceleration

    Amazon EC2 G7 instances are now generally available, featuring NVIDIA RTX PRO 4500 Blackwell Server Edition GPUs and custom Intel Xeon Scalable processors. These instances deliver up to 4.6x AI inference performance and up to 2.1x graphics performance improvements over G6 instances.

  • G7 instances support various GPU-accelerated workloads

    These instances are well-suited for AI inference, graphics rendering, video transcoding, spatial computing, virtual desktop infrastructure (VDI), and GPU-accelerated data analytics, including on Amazon EMR and Amazon EKS.

  • Enhanced multi-GPU and multi-node communication features

    G7 instances support NVIDIA GPUDirect P2P for multi-GPU communication and NVIDIA GPUDirect RDMA with EFA for low-latency GPU-to-GPU and multi-node communication, including with Amazon FSx for Lustre.

Enhancements (2)
  • G7 instances provide faster GPU memory and high-performance networking

    The new instances boast 1.33x more GPU memory capacity and 2.45x more GPU memory bandwidth per GPU, with 32 GB of memory. They also offer 700 Gbps of EFA-enabled networking throughput and up to 7.6 TB of local NVMe SSD storage.

  • Advanced video encoding and decoding engines improve video workflows

    G7 instances include ninth-generation NVENC and sixth-generation NVDEC engines that support 4:2:2 encoding and decoding. This enables 1.5x more concurrent video streams compared to the previous generation G6 instances.

Notes (1)
  • G7 instances are available in select regions with multiple purchasing options

    Amazon EC2 G7 instances can be launched starting today in the US East (Ohio) and US West (Oregon) regions. They are available through On-Demand, Savings Plans, and Spot Instances, with Dedicated Instances supported for certain sizes.

Read the original announcement →

https://aws.amazon.com/blogs/aws/announcing-amazon-ec2-g7-instances-accelerated-by-nvidia-rtx-pro-4500-blackwell-server-edition-gpus/

Related releases