Amazon Bedrock AgentCore adds runtime instances for production AI agents
Amazon Bedrock AgentCore now offers runtime instances, a new compute option for production AI agents requiring persistent infrastructure and GPU acceleration. This feature allows agents to collaborate, maintain state for up to 14 days, and integrate with existing Bedrock services without self-managed infrastructure. It complements existing microVMs, enabling flexible orchestration for complex, long-running, or resource-intensive agent workloads, and is available now.
- →Introduce runtime instances for persistent agent compute
- →Support for containerized deployments and custom frameworks
- →Enable agent collaboration and stateful workflows
- →Integrate with EBS and AgentCore Memory for long-term recall
- →Complementary compute options for flexible orchestration
Features (2) ›
- Introduce runtime instances for persistent agent compute
Runtime instances provide AWS-managed EC2 infrastructure for Amazon Bedrock AgentCore, allowing multiple agents to run in a single environment with persistent sessions up to 14 days. This feature supports GPU acceleration and containerized deployments, simplifying the management of complex agent workloads that previously required self-provisioned infrastructure.
- Support for containerized deployments and custom frameworks
Developers can package agents as zip files or container images, bringing their own frameworks like CrewAI, LangGraph, or LlamaIndex. The runtime instances simplify deployment with minimal packaging requirements, such as an @app.entrypoint decorator.
Enhancements (3) ›
- Enable agent collaboration and stateful workflows
Agents deployed on runtime instances can now call each other as tools within shared sessions, facilitating autonomous iteration and complex task completion. Session storage persists for up to 14 days, and agents can be hibernated and resumed, preserving state across extended periods.
- Integrate with EBS and AgentCore Memory for long-term recall
Runtime instances integrate with Amazon Elastic Block Store (EBS) and AgentCore Memory, providing agents with long-term recall capabilities that extend beyond individual sessions and environments.
- Complementary compute options for flexible orchestration
Runtime instances and existing runtime microVMs are complementary. A lightweight orchestrator on microVMs can dispatch tasks to specialized worker agents running on instances, leveraging the strengths of both compute options for efficient workflow management.
Notes (1) ›
- Example demonstrates code generation and review workflow
A demo showcases two agents, a code writer and a code reviewer, collaborating within a shared file system on the same runtime instance. The example details the steps for creating a capacity provider, deploying agents via zip files, and invoking them through the AWS Management Console.
https://aws.amazon.com/blogs/aws/runtime-instances-persistent-compute-for-production-ai-agents-on-amazon-bedrock-agentcore/
Related releases
- Amazon EC2 R8a Instances Now Available in Canada (Central) Region AWS What's New ·
- AWS EC2 Image Builder streamlines Microsoft Office integration Modernizing with AWS Blog ·
- AWS EC2 High Memory U7in Instances Now Available in São Paulo AWS What's New ·
- Amazon EC2 introduces application status checks for app-level monitoring AWS What's New ·
- Amazon EC2 R8i and R8i-Flex instances available in Europe (Milan) AWS What's New ·
- Amazon GameLift Servers adds 21 EC2 instance types AWS What's New ·