Agentgateway is an open source proxy built on AI-native protocols (MCP & A2A) that provides drop-in security, observability, and governance for agent-to-LLM, agent-to-tool, and agent-to-agent communication across any framework and environment.
<br> <div align="center"> <img alt="agentgateway UI" src="img/architecture.svg" width="800"> </div> <br>Intro to Agentgateway Video
<br> <div align="center"> <a href="https://youtu.be/SomP92JWPmE"> <img alt="Agentgateway Intro Video" src="https://img.youtube.com/vi/SomP92JWPmE/hqdefault.jpg"> </a> </div> <br>Key Features
-
LLM Gateway<br> Route traffic to major LLM providers (OpenAI, Anthropic, Gemini, Bedrock, and more) through a unified OpenAI-compatible API with budget and spend controls, prompt enrichment, load balancing, and failover.
-
MCP Gateway<br> Connect LLMs to tools and external data sources via MCP with tool federation, stdio/HTTP/SSE/Streamable HTTP transports, OpenAPI integration, and OAuth authentication.
-
A2A Gateway<br> Enable secure agent-to-agent communication using A2A, with capability discovery, modality negotiation, and task collaboration.
-
Inference Routing<br> Intelligent routing to self-hosted models using Kubernetes Inference Gateway extensions, with decisions based on GPU utilization, KV cache, LoRA adapters, and queue depth.
-
Guardrails<br> Multi-layered content filtering with regex, OpenAI moderation, AWS Bedrock Guardrails, Google Model Armor, and custom webhooks.
-
Security & Observability<br> Auth (JWT, API keys, OAuth), fine-grained RBAC with CEL policy engine, rate limiting, TLS, and OpenTelemetry metrics/logs/tracing.
<br>
Getting Started
- Standalone Quickstart — Get started with agentgateway in minutes.
- Kubernetes Quickstart — Deploy on Kubernetes using the built-in controller and Gateway API.
Documentation
Depending on your deployment environment, check out the following docs:
- agentgateway.dev/docs: For deployments without the full Kubernetes controller, driven by flat yaml config.
- agentgateway.dev/docs/kubernetes/latest: For Kubernetes-based deployments using the built-in Kubernetes controller and Gateway API support.
Agentgateway has a built-in UI for you to explore agentgateway connecting agent-to-agent or agent-to-tool:
<div align="center"> <img alt="agentgateway UI" src="img/UI-homepage.png"> </div>Sponsors
<table> <tr> <td align="center" width="33.3%"> <a href="https://blacksmith.sh/"> <picture> <source media="(prefers-color-scheme: light)" srcset="https://raw.githubusercontent.com/agentgateway/agentgateway/main/img/blacksmith-light.svg"> <img src="https://raw.githubusercontent.com/agentgateway/agentgateway/main/img/blacksmith.svg" alt="Blacksmith" height="48"> </picture> </a> </td> </tr> </table>Thank you to our sponsors for helping to fund the development of agentgateway!
Contributing
For instructions on how to contribute to the agentgateway project, see the CONTRIBUTION.md file.
Community Meetings
To join a community meeting, add the agentgateway calendar to your Google account. Then, you can find event details on the calendar.
Recordings of the community meetings will be published on our google drive.
Roadmap
agentgateway is currently in active development. If you'd like a feature that's missing, open an issue in our GitHub repo.
Contributors
Thanks to all contributors who are helping to make agentgateway better.
<a href="https://github.com/agentgateway/agentgateway/graphs/contributors"> <img src="https://contrib.rocks/image?repo=agentgateway/agentgateway" /> </a><div align="center"> <img src="img/lf-stacked-color.png" width="300" alt="Linux Foundation logo"/> <p>Agentgateway is a <a href="https://www.linuxfoundation.org/">Linux Foundation</a> project.</p> </div>