TensorZero
TensorZero: A feature-rich open-source gateway whose archived status limits its fit for new deployments. Ranked #9 of 34 in LLM Gateway Software by our editors (8.1/10); pricing: Free plan; best for teams combining gateway and model optimization.
At a glance
- Editor score8.1 / 10
- PricingFree plan
- Best forTeams combining gateway and model optimization
- Free planYes
- Paid fromFree
- Facts checked21 Sep 2026
Where it wins
- Unified API with fallbacks across multiple LLM providers
- Observability, analytics, usage, and cost tracking in one platform
- Evaluations, A/B testing, and optimization support experimentation
Where it doesn't
- The project is no longer maintained
- The GitHub repository was archived on June 12, 2026
- Deployment is self-hosted through containers
Our verdict on TensorZero
TensorZero combines an open-source LLM gateway with observability, evaluations, optimization, and experimentation. It is designed for teams that need one API across multiple model providers while retaining control over routing, fallbacks, usage tracking, authentication, and deployment. The platform supports web, API, and self-hosted use, with API-key authentication for client access and integrations including Anthropic, AWS Bedrock, Azure, DeepSeek, Google AI Studio, Mistral, OpenAI, OpenRouter, and others.
Its strongest fit is for teams combining gateway management with model optimization. Automatic provider and variant fallbacks can support routing resilience, while inference analytics and cost tracking provide operational visibility. Evaluations use heuristics and LLM judges, and A/B testing supports structured experimentation with prompts, models, and inference choices. Those capabilities make TensorZero broader than a narrow provider-routing layer, particularly for teams that want optimization workflows alongside gateway functions.
The main consideration is project status. TensorZero remains available on GitHub, but it is no longer maintained, and the GitHub repository was archived on June 12, 2026. That substantially changes its suitability for new production adoption, regardless of the breadth of its feature set. Teams evaluating an existing deployment or studying an open-source gateway may still find its unified API, provider integrations, and LLMOps capabilities relevant. Teams seeking an actively maintained foundation should choose an alternative instead.
Your product? Our editors can test TensorZero in depth and publish a review, labelled as paid · from $149/mo →
TensorZero pricing
TensorZero fact sheet
| Free plan | Yes |
|---|---|
| Paid from | Free |
| Provider count | Not verified |
| Fallback routing | Yes |
| Usage analytics | Yes |
| Self-hosted deployment | Yes |
| Budget controls | Yes |
| Virtual API keys | Yes |
| Deployment | Self-hosted |
| Platforms | Web |
| Support | Email, Community, Docs |
| Built for | Small business, Mid-market, Enterprise (editorial estimate) |
| Integrations | 20 integrations: Anthropic, AWS Bedrock, AWS SageMaker, Azure, DeepSeek, Fireworks AI … See all → |
| Pricing | Free plan |
| Website | tensorzero.com |
| Facts checked | 21 Sep 2026 |
TensorZero integrations
TensorZero lists 20 integrations on its own site.
- Anthropic
- AWS Bedrock
- AWS SageMaker
- Azure
- DeepSeek
- Fireworks AI
- GCP Vertex AI Anthropic
- GCP Vertex AI Gemini
- Google AI Studio
- Groq
- Hyperbolic
- Mistral
- OpenAI
- OpenRouter
- SGLang
- TGI
- Together AI
- vLLM
- xAI
- OpenAI-compatible APIs
See all TensorZero integrations →
Alternatives to TensorZero
- OpenRouterA broad LLM gateway for teams that need model choice without separate integrations.9.2
- Cloudflare AI GatewayA free managed gateway for routing, monitoring, and governing multi-provider AI traffic.9.1
- Alibaba Cloud AI GatewayA broad AI gateway for enterprises standardizing LLM, agent, and MCP traffic.9.0
See all TensorZero alternatives →
Also Ranked In
TensorZero is ranked in 2 of our directories.
Used TensorZero? Be the first to review it
The editor score above is our own research. What this page doesn't have yet is a reader's view — what you used TensorZero for, what worked and what didn't. No stars are seeded and no review is paid for; an editor reads every one before it appears.
Write a reviewTwo minutes · verified accounts only · read by an editor before it appears
Featured on iTechGuides
TensorZero is listed in our LLM Gateway Software directory. Add the badge to your site — it links back to this page.
<a href="https://www.itechguides.com/products/tensorzero/"><img src="https://www.itechguides.com/best/badge/tensorzero.svg" alt="Featured on iTechGuides" width="230" height="46"></a>
Reviewed by iTechGuides Editors · Editorial team · Updated Oct 2026
Advertiser disclosure: iTechGuides is reader-supported. Vendors can pay for top positions in our rankings and for a place on other products' pages, and we may earn a commission when you click some links. Bought places stand at the number bought; this page and our disclosure say so. Paying vendors may get a fuller, more detailed review from our editors, and that review can change their score. How we rank.
Last updated · How we research and update