Local LLM Software: ranks 51–66
Page 2 of 2 of the full local LLM software ranking. Every tool here is researched from its official pricing and product pages. See our top picks →
Advertiser disclosure: iTechGuides is reader-supported. Vendors can pay for top positions in our rankings and for a place on other products' pages, and we may earn a commission when you click some links. Bought places stand at the number bought; this page and our disclosure say so. Paying vendors may get a fuller, more detailed review from our editors, and that review can change their score. How we rank.
Ranks 51–66 of 66 tools, best first
-
Best forFeature-rich on-device Android assistant
A broad, open-source Android assistant for local chat, multimodal tasks and coding projects.
- Local API server
- Built-in model downloads
- GPU acceleration
4.1/10★★☆☆☆Visit Mochu AI -
Best forWindows users wanting an offline personal assistant
A capable offline Windows assistant, with useful tools but a narrow platform footprint.
- Quantized model support
- Built-in model downloads
- GPU acceleration
4.0/10★★☆☆☆Visit O.A.S.I.S. -
Best forDevelopers needing local RAG utilities
A free, self-hosted Rust toolkit for local model inference and RAG building.
- Quantized model support
- Built-in model downloads
- GPU acceleration
3.9/10★★☆☆☆Visit Kalosm -
Best forAndroid users needing a lightweight offline assistant
A capable offline Android assistant with vision, memory, voice, and device tools.
- Quantized model support
- Built-in model downloads
3.8/10★★☆☆☆Visit OfflineMate -
Best forGGUF tuning and performance monitoring
A focused open-source desktop for GGUF downloads, LoRA tuning, and local performance insight.
- Local API server
- GPU acceleration
3.7/10★★☆☆☆Visit HomeBred-LLM -
Best forWindows users wanting a llama.cpp control console
A free, open-source Windows console for managing llama.cpp models, runtimes, chat, and APIs.
- Local API server
- Quantized model support
- Built-in model downloads
3.6/10★★☆☆☆Visit Ooor -
Best forMobile users running models privately on-device
A free, private mobile app for chatting with GGUF models and adding local voice tools.
- Local API server
- Quantized model support
- Built-in model downloads
3.5/10★★☆☆☆Visit PocketPal AI -
Best forSelf-hosted document RAG and tool workflows
A self-hosted API for cited RAG, document ingestion, tools, and local model workflows.
3.4/10★★☆☆☆Visit PrivateGPT -
Best forAndroid local character-chat users
A focused Android frontend for local GGUF chats and many remote APIs, with mobile-only reach.
- Quantized model support
3.3/10★★☆☆☆Visit ChatterUI -
Best forIndividuals wanting a private desktop chat client
A private, open-source Ollama client for desktop chat, code, and vision.
- Built-in model downloads
3.2/10★★☆☆☆Visit Hermit -
Best forApple users wanting simple offline AI tools
A focused offline LLM app for Apple devices, with Android beta access but no API or free tier.
- GPU acceleration
3.1/10★★☆☆☆Visit Private LLM -
Best forDevelopers specifically targeting RWKV models
A focused local runtime for developers building CPU or GPU applications around RWKV models.
- GPU acceleration
3.0/10★★☆☆☆Visit RWKV.cpp -
Best forMac users needing offline document chat
A focused Mac workspace for private, offline document chat with local models.
- Quantized model support
- Built-in model downloads
- GPU acceleration
3.0/10★★☆☆☆Visit LocalChat -
Best forAndroid users wanting portable local model chat
A free Android client combining on-device GGUF chat with broad remote-provider access.
- Quantized model support
- Built-in model downloads
3.0/10★★☆☆☆Visit Maid -
Best forOffline research-focused assistant users
A free, local Ollama assistant built for cited offline research and reference work.
- Built-in model downloads
3.0/10★★☆☆☆Visit Survival LLM -
Best forSolo Apple users wanting private document chat
A free, private document-chat app for iPhone, iPad and Mac users.
- Built-in model downloads
3.0/10★★☆☆☆Visit privateSLM
No tools match those filters.
Compare at a glance
| # | Tool | Free plan | Paid from | Supported operating systems | Local API server | GPU acceleration | Built-in model downloads | Score |
|---|---|---|---|---|---|---|---|---|
| 51 | Mochu AI | Yes | Free | Yes | Yes | Yes | 4.1 | |
| 52 | O.A.S.I.S. | Yes | €25 one-time | Windows | Yes | Yes | 4.0 | |
| 53 | Kalosm | Yes | Free | No | Yes | Yes | 3.9 | |
| 54 | OfflineMate | Yes | Free | Yes | 3.8 | |||
| 55 | HomeBred-LLM | Free | Yes | Yes | 3.7 | |||
| 56 | Ooor | Yes | Free | Windows | Yes | Yes | Yes | 3.6 |
| 57 | PocketPal AI | Yes | Cross_platform | Yes | Yes | Yes | 3.5 | |
| 58 | PrivateGPT | Free | 3.4 | |||||
| 59 | ChatterUI | Free | Windows | No | No | 3.3 | ||
| 60 | Hermit | Free | Cross_platform | Yes | 3.2 | |||
| 61 | Private LLM | No | No | Yes | 3.1 | |||
| 62 | RWKV.cpp | Yes | Free | No | Yes | 3.0 | ||
| 63 | LocalChat | No | $99 one-time | Macos | Yes | Yes | 3.0 | |
| 64 | Maid | Yes | Free | No | Yes | 3.0 | ||
| 65 | Survival LLM | Yes | Free | Cross_platform | No | Yes | 3.0 | |
| 66 | privateSLM | Yes | Cross_platform | No | Yes | 3.0 |
Reviewed by iTechGuides Editors · Editorial team · Updated Nov 2026
Last updated · How we research and update
