Envoy AI Gateway
Envoy AI Gateway: A Kubernetes-native open gateway for routing, governing, and observing LLM traffic. Ranked #11 of 34 in LLM Gateway Software by our editors (7.9/10); pricing: Free plan; best for kubernetes teams building an open gateway.
At a glance
- Editor score7.9 / 10
- PricingFree plan
- Best forKubernetes teams building an open gateway
- Free planYes
- Paid fromFree
- Founded2024
- Facts checked21 Sep 2026
Where it wins
- Routes across a broad set of hosted and self-hosted model providers
- Adds failover, weighted routing, token limits, and usage budgets
- Helm-based Kubernetes installation with traffic and cost observability
Where it doesn't
- Kubernetes-oriented deployment may not suit teams seeking a hosted gateway
- Self-hosted operation places deployment responsibility on the team
- Founded in 2024, making it a newer project
Our verdict on Envoy AI Gateway
Envoy AI Gateway is an open-source, Kubernetes-oriented gateway for applications that send traffic to generative AI services. It provides a unified API across hosted providers and self-hosted model endpoints, with provider authentication, upstream authorization, model and provider routing, automatic failover, rate limiting, budgets, and observability. Its strongest fit is for Kubernetes teams that want to control how LLM traffic moves across providers rather than integrate each provider separately.
The ecosystem coverage is broad. Integrations include OpenAI, AWS Bedrock, Azure OpenAI, Google Gemini, Google Vertex AI, Anthropic, Groq, Grok, Together AI, Cohere, Mistral, DeepInfra, DeepSeek, Hunyuan, and SambaNova. Routing can use weighted or prioritized backends, while traffic, usage, performance, and cost observability provide operational visibility. Support for self-hosted model endpoints also makes the gateway suitable for environments combining external APIs with models running under their own control.
Pricing is straightforward: Envoy AI Gateway is open source and has a free plan. The published product details describe capabilities rather than multiple paid tiers, so its value centers on the gateway software and the control it provides. Installation is Kubernetes-native through Helm charts, which aligns well with teams already operating Kubernetes but makes the product less suitable for organizations seeking a fully managed, non-Kubernetes gateway. Teams that need routing governance, fallback behavior, budget controls, and provider flexibility should consider it; teams wanting a hosted service with minimal platform ownership should choose an alternative. The project was renamed Agent Router on September 10, 2026.
Your product? Our editors can test Envoy AI Gateway in depth and publish a review, labelled as paid · from $149/mo →
Envoy AI Gateway pricing
Envoy AI Gateway fact sheet
| Free plan | Yes |
|---|---|
| Paid from | Free |
| Provider count | Not verified |
| Fallback routing | Yes |
| Usage analytics | Yes |
| Self-hosted deployment | Yes |
| Budget controls | Yes |
| Virtual API keys | Not verified |
| Deployment | Self-hosted |
| Support | Community, Docs |
| Built for | Mid-market, Enterprise (editorial estimate) |
| Integrations | 16 integrations: OpenAI, AWS Bedrock, Azure OpenAI, Google Gemini, Google Vertex AI, Anthropic … See all → |
| Pricing | Free plan |
| Website | aigateway.envoyproxy.io |
| Facts checked | 21 Sep 2026 |
Envoy AI Gateway integrations
Envoy AI Gateway lists 16 integrations on its own site.
- OpenAI
- AWS Bedrock
- Azure OpenAI
- Google Gemini
- Google Vertex AI
- Anthropic
- Groq
- Grok
- Together AI
- Cohere
- Mistral
- DeepInfra
- DeepSeek
- Hunyuan
- SambaNova
- Self-hosted models
See all Envoy AI Gateway integrations →
Alternatives to Envoy AI Gateway
- OpenRouterA broad LLM gateway for teams that need model choice without separate integrations.9.2
- Cloudflare AI GatewayA free managed gateway for routing, monitoring, and governing multi-provider AI traffic.9.1
- Alibaba Cloud AI GatewayA broad AI gateway for enterprises standardizing LLM, agent, and MCP traffic.9.0
See all Envoy AI Gateway alternatives →
Also Ranked In
Envoy AI Gateway is ranked in 2 of our directories.
Used Envoy AI Gateway? Be the first to review it
The editor score above is our own research. What this page doesn't have yet is a reader's view — what you used Envoy AI Gateway for, what worked and what didn't. No stars are seeded and no review is paid for; an editor reads every one before it appears.
Write a reviewTwo minutes · verified accounts only · read by an editor before it appears
Featured on iTechGuides
Envoy AI Gateway is listed in our LLM Gateway Software directory. Add the badge to your site — it links back to this page.
<a href="https://www.itechguides.com/products/envoy-ai-gateway/"><img src="https://www.itechguides.com/best/badge/envoy-ai-gateway.svg" alt="Featured on iTechGuides" width="230" height="46"></a>
Reviewed by iTechGuides Editors · Editorial team · Updated Oct 2026
Advertiser disclosure: iTechGuides is reader-supported. Vendors can pay for top positions in our rankings and for a place on other products' pages, and we may earn a commission when you click some links. Bought places stand at the number bought; this page and our disclosure say so. Paying vendors may get a fuller, more detailed review from our editors, and that review can change their score. How we rank.
Last updated · How we research and update