LLM Gateway
LLM Gateway: A simple free gateway with failover, analytics, spend limits, caching, and self-hosting. Ranked #17 of 34 in LLM Gateway Software by our editors (7.3/10); pricing: Free plan · 30-day trial; best for teams wanting a simple free self-hosted gateway.
At a glance
- Editor score7.3 / 10
- PricingFree plan · 30-day trial
- Best forTeams wanting a simple free self-hosted gateway
- Free planYes
- Facts checked21 Sep 2026
Where it wins
- OpenAI-compatible routing with automatic provider failover
- Self-hosted deployment through Docker, Compose, or Kubernetes
- Analytics, spend limits, response caching, and BYOK support
Where it doesn't
- Listed SDK integrations cover OpenAI, Anthropic, and Vercel AI
- Enterprise pricing requires contacting sales
- Free usage includes rate limits and a 5% platform fee on credit usage
Our verdict on LLM Gateway
LLM Gateway is an open-source, OpenAI-compatible API gateway for applications that route requests across multiple LLM providers. It is designed for teams that want one API layer for provider selection, failover, usage tracking, cost controls, and access to several AI API types. The product supports web, API, and self-hosted deployments, with features covering image, video, web search, embeddings, speech, and transcription APIs. Teams can also bring their own provider API keys and run the AGPLv3-licensed gateway on their own infrastructure.
Pricing is built around a Free plan and an Enterprise plan. The Free plan costs $0 forever and includes free models with rate limits, API and Lounge access, activity logs with export, and Discord community support. Hosted usage uses prepaid credits and carries a 5% platform fee on credit usage, while BYOK has no platform fee. A 30-day free trial is available. Enterprise adds volume discounts, custom routing, unlimited data retention, a 99.9% uptime SLA, and 24/7 SLA support with a Slack channel. Enterprise pricing is available through sales.
The gateway’s strongest operational features are automatic provider selection and failover, real-time usage, cost, token, and request analytics, project-specific API keys, recurring and all-time spend limits, and response caching. Its deployment options suit teams that prefer infrastructure control, while OpenAI SDK, Anthropic SDK, and Vercel AI SDK support provide a focused integration base. Organizations needing a straightforward gateway with self-hosting and budget controls should consider LLM Gateway. Teams seeking a broader prebuilt integration ecosystem may need another option.
Your product? Our editors can test LLM Gateway in depth and publish a review, labelled as paid · from $149/mo →
LLM Gateway pricing
All 2 LLM Gateway plans and prices →
LLM Gateway fact sheet
| Free plan | Yes |
|---|---|
| Paid from | Not verified |
| Provider count | Not verified |
| Fallback routing | Yes |
| Usage analytics | Yes |
| Self-hosted deployment | Yes |
| Budget controls | Yes |
| Virtual API keys | Yes |
| Free trial | 30 days |
| Money-back guarantee | 14 days |
| Deployment | Cloud, Self-hosted |
| Platforms | Web |
| Compliance & security | SOC 2, SSO/SAML |
| Support | Email, Community, Docs · 24/7 |
| Built for | Small business, Mid-market, Enterprise (editorial estimate) |
| Integrations | 3 integrations: OpenAI SDK, Anthropic SDK, Vercel AI SDK |
| Pricing | Free plan · 30-day trial (source) |
| Website | llmgateway.io |
| Facts checked | 21 Sep 2026 |
LLM Gateway integrations
LLM Gateway lists 3 integrations on its own site.
- OpenAI SDK
- Anthropic SDK
- Vercel AI SDK
Alternatives to LLM Gateway
- OpenRouterA broad LLM gateway for teams that need model choice without separate integrations.9.2
- Cloudflare AI GatewayA free managed gateway for routing, monitoring, and governing multi-provider AI traffic.9.1
- Alibaba Cloud AI GatewayA broad AI gateway for enterprises standardizing LLM, agent, and MCP traffic.9.0
See all LLM Gateway alternatives →
Also Ranked In
LLM Gateway is ranked in 2 of our directories.
Used LLM Gateway? Be the first to review it
The editor score above is our own research. What this page doesn't have yet is a reader's view — what you used LLM Gateway for, what worked and what didn't. No stars are seeded and no review is paid for; an editor reads every one before it appears.
Write a reviewTwo minutes · verified accounts only · read by an editor before it appears
Featured on iTechGuides
LLM Gateway is listed in our LLM Gateway Software directory. Add the badge to your site — it links back to this page.
<a href="https://www.itechguides.com/products/llm-gateway/"><img src="https://www.itechguides.com/best/badge/llm-gateway.svg" alt="Featured on iTechGuides" width="230" height="46"></a>
Reviewed by iTechGuides Editors · Editorial team · Updated Oct 2026
Advertiser disclosure: iTechGuides is reader-supported. Vendors can pay for top positions in our rankings and for a place on other products' pages, and we may earn a commission when you click some links. Bought places stand at the number bought; this page and our disclosure say so. Paying vendors may get a fuller, more detailed review from our editors, and that review can change their score. How we rank.
Last updated · How we research and update