agentgateway

Next Generation Agentic Proxy for AI Agents and MCP servers

What is agentgateway?

Next Generation Agentic Proxy for AI Agents and MCP servers

Overview of agentgateway

What it is

Agentgateway is an open source proxy built on AI-native protocols (MCP & A2A) that provides drop-in security, observability, and governance for agent-to-LLM, agent-to-tool, and agent-to-agent communication across any framework and environment. It is a Linux Foundation project.

Key features

  • LLM Gateway: Route traffic to major LLM providers (OpenAI, Anthropic, Gemini, Bedrock, and more) through a unified OpenAI-compatible API with budget and spend controls, prompt enrichment, load balancing, and failover.
  • MCP Gateway: Connect LLMs to tools and external data sources via MCP with tool federation, stdio/HTTP/SSE/Streamable HTTP transports, OpenAPI integration, and OAuth authentication.
  • A2A Gateway: Enable secure agent-to-agent communication using A2A, with capability discovery, modality negotiation, and task collaboration.
  • Inference Routing: Intelligent routing to self-hosted models using Kubernetes Inference Gateway extensions, with decisions based on GPU utilization, KV cache, LoRA adapters, and queue depth.
  • Guardrails: Multi-layered content filtering with regex, OpenAI moderation, AWS Bedrock Guardrails, Google Model Armor, and custom webhooks.
  • Security & Observability: Auth (JWT, API keys, OAuth), fine-grained RBAC with CEL policy engine, rate limiting, TLS, and OpenTelemetry metrics/logs/tracing.

Use cases

Agentgateway is designed for connecting agent-to-agent or agent-to-tool in any environment. It can be deployed standalone or on Kubernetes using the built-in controller and Gateway API. Use cases include routing traffic to LLM providers, connecting LLMs to tools via MCP, enabling secure agent-to-agent communication via A2A, and applying guardrails and observability to agent interactions.

Getting started

See the repository README for standalone and Kubernetes quickstart instructions. The project provides a built-in UI to explore agentgateway connecting agent-to-agent or agent-to-tool.

License and pricing

Agentgateway is open source under the Apache-2.0 license.

Based on the project's public README and repository metadata.

Add this badge to your README

Featured on YunoDB Badge styles & help

Maintain this project? Show that it is featured on YunoDB.

Markdown[![Featured on YunoDB](https://yunodb.com/badge/agentgatewayagentgateway.svg)](https://yunodb.com/tools/agentgatewayagentgateway?utm_source=github&utm_medium=badge)
HTML<a href="https://yunodb.com/tools/agentgatewayagentgateway?utm_source=github&utm_medium=badge"><img src="https://yunodb.com/badge/agentgatewayagentgateway.svg" alt="Featured on YunoDB" height="20"></a>