LLM Gateway review
A simple free gateway with failover, analytics, spend limits, caching, and self-hosting.
Reviewed by iTechGuides Editors · Editorial team · Updated Oct 2026
LLM Gateway is an open-source, OpenAI-compatible API gateway for applications that route requests across multiple LLM providers. It is designed for teams that want one API layer for provider selection, failover, usage tracking, cost controls, and access to several AI API types. The product supports web, API, and self-hosted deployments, with features covering image, video, web search, embeddings, speech, and transcription APIs. Teams can also bring their own provider API keys and run the AGPLv3-licensed gateway on their own infrastructure.
Pricing is built around a Free plan and an Enterprise plan. The Free plan costs $0 forever and includes free models with rate limits, API and Lounge access, activity logs with export, and Discord community support. Hosted usage uses prepaid credits and carries a 5% platform fee on credit usage, while BYOK has no platform fee. A 30-day free trial is available. Enterprise adds volume discounts, custom routing, unlimited data retention, a 99.9% uptime SLA, and 24/7 SLA support with a Slack channel. Enterprise pricing is available through sales.
The gateway’s strongest operational features are automatic provider selection and failover, real-time usage, cost, token, and request analytics, project-specific API keys, recurring and all-time spend limits, and response caching. Its deployment options suit teams that prefer infrastructure control, while OpenAI SDK, Anthropic SDK, and Vercel AI SDK support provide a focused integration base. Organizations needing a straightforward gateway with self-hosting and budget controls should consider LLM Gateway. Teams seeking a broader prebuilt integration ecosystem may need another option.
LLM Gateway pros and cons
- Where it wins
- OpenAI-compatible routing with automatic provider failover
- Self-hosted deployment through Docker, Compose, or Kubernetes
- Analytics, spend limits, response caching, and BYOK support
- Where it doesn't
- Listed SDK integrations cover OpenAI, Anthropic, and Vercel AI
- Enterprise pricing requires contacting sales
- Free usage includes rate limits and a 5% platform fee on credit usage
LLM Gateway fact sheet, pricing and score →
Advertiser disclosure: iTechGuides is reader-supported. Vendors can pay for top positions in our rankings and for a place on other products' pages, and we may earn a commission when you click some links. Bought places stand at the number bought; this page and our disclosure say so. Paying vendors may get a fuller, more detailed review from our editors, and that review can change their score. How we rank.
Last updated · How we research and update