Memoturn
Memoturn: A self-hosted LLM monitor with tracing, evaluation, prompt management, and automation. Ranked #17 of 24 in Model Monitoring Software by our editors (7.7/10); pricing: Open source; best for open-source teams wanting a self-hosted monitor.
At a glance
- Editor score7.7 / 10
- PricingOpen source
- Best forOpen-source teams wanting a self-hosted monitor
- Paid fromFree
- Facts checked22 Sep 2026
Where it wins
- Free open-source deployment with tracing, evaluations, and human review
- Broad provider and framework integrations, including OpenTelemetry and MCP
- Prompt registry, experiments, monitors, budgets, and alert automations in one platform
Where it doesn't
- Teams must operate Docker-based self-hosted infrastructure
- The supplied feature set centers on LLM applications rather than broad data monitoring
- Teams needing drift, bias, or data-quality controls should consider another platform
Our verdict on Memoturn
Memoturn is an open-source AI engineering platform for teams building and operating LLM applications. It combines OpenTelemetry-native tracing, cost and latency metrics, offline dataset experiments, online evaluators for sampled production traces, human review queues, prompt versioning, datasets, monitors, budgets, and alert automations. Its web, API, and self-hosted deployment options make it a fit for engineering and AI teams that want to inspect production LLM behavior and manage quality on infrastructure they own.
The ecosystem coverage is a practical strength. Memoturn integrates with OpenTelemetry and model providers including OpenAI, Anthropic, Amazon Bedrock, Google Gemini, Groq, Mistral, Cohere, vLLM, Ollama, and OpenRouter. Framework integrations include LangChain, LangGraph, LlamaIndex, and CrewAI. Its MCP server extends access to prompts, datasets, and review queues, while dashboards can track cost, token, latency, and custom metrics. Teams already working across several model providers or frameworks can use this breadth to keep observability and evaluation in the same workflow.
The standout value is the connection between production tracing, offline experiments, online evaluation, human scoring, prompt channels, and automated alerts. Docker-based infrastructure supports self-hosted deployment, but it also means the operating team owns that deployment model. Memoturn is well suited to open-source teams that need detailed LLM application observability and evaluation without separating prompt and review workflows. Teams primarily looking for drift, bias, or data-quality monitoring should choose a platform centered on those controls instead.
Your product? Our editors can test Memoturn in depth and publish a review, labelled as paid · from $149/mo →
Memoturn pricing
Memoturn fact sheet
| Free plan | Not verified |
|---|---|
| Paid from | Free |
| Drift detection | Not verified |
| Performance monitoring | Yes |
| Bias monitoring | Not verified |
| Data quality monitoring | Not verified |
| Deployment options | Both |
| Monitored model limit | Not verified |
| Deployment | Cloud, Self-hosted |
| Platforms | Web |
| Compliance & security | SSO/SAML |
| Support | Docs |
| Built for | Small business, Mid-market, Enterprise (editorial estimate) |
| Integrations | 20 integrations: OpenTelemetry, OpenAI, Anthropic, Amazon Bedrock, Google Gemini, Groq … See all → |
| Pricing | Open source |
| Website | memoturn.com |
| Facts checked | 22 Sep 2026 |
Memoturn integrations
Memoturn lists 20 integrations on its own site.
- OpenTelemetry
- OpenAI
- Anthropic
- Amazon Bedrock
- Google Gemini
- Groq
- Mistral
- Cohere
- vLLM
- Ollama
- OpenRouter
- LangChain
- LangGraph
- LlamaIndex
- CrewAI
- Haystack
- LiteLLM
- Pinecone
- Chroma
- Weaviate
See all Memoturn integrations →
Alternatives to Memoturn
- Arize AXBroad monitoring for LLMs and agents, with tracing, evaluations, and cost visibility.9.4
- Arize PhoenixA free Phoenix platform for tracing, evaluating, and improving LLM applications.9.3
- W&B WeaveA mature monitoring platform for teams operating complex LLM applications and agents.9.1
See all Memoturn alternatives →
Used Memoturn? Be the first to review it
The editor score above is our own research. What this page doesn't have yet is a reader's view — what you used Memoturn for, what worked and what didn't. No stars are seeded and no review is paid for; an editor reads every one before it appears.
Write a reviewTwo minutes · verified accounts only · read by an editor before it appears
Featured on iTechGuides
Memoturn is listed in our Model Monitoring Software directory. Add the badge to your site — it links back to this page.
<a href="https://www.itechguides.com/products/memoturn/"><img src="https://www.itechguides.com/best/badge/memoturn.svg" alt="Featured on iTechGuides" width="230" height="46"></a>
Reviewed by iTechGuides Editors · Editorial team · Updated Oct 2026
Advertiser disclosure: iTechGuides is reader-supported. Vendors can pay for top positions in our rankings and for a place on other products' pages, and we may earn a commission when you click some links. Bought places stand at the number bought; this page and our disclosure say so. Paying vendors may get a fuller, more detailed review from our editors, and that review can change their score. How we rank.
Last updated · How we research and update