Suggestions appear as you type. Use the up and down arrows to choose one and Enter to open it.

Local LLM Software: ranks 51–66

Page 2 of 2 of the full local LLM software ranking. Every tool here is researched from its official pricing and product pages. See our top picks →

Advertiser disclosure: iTechGuides is reader-supported. Vendors can pay for top positions in our rankings and for a place on other products' pages, and we may earn a commission when you click some links. Bought places stand at the number bought; this page and our disclosure say so. Paying vendors may get a fuller, more detailed review from our editors, and that review can change their score. How we rank.

Ranks 51–66 of 66 tools, best first

16 tools
  1. Mochu AI

    Best forFeature-rich on-device Android assistant

    A broad, open-source Android assistant for local chat, multimodal tasks and coding projects.

    • Local API server
    • Built-in model downloads
    • GPU acceleration
    4.1/10★★☆☆☆
    Visit Mochu AI
  2. Best forWindows users wanting an offline personal assistant

    A capable offline Windows assistant, with useful tools but a narrow platform footprint.

    • Quantized model support
    • Built-in model downloads
    • GPU acceleration
    4.0/10★★☆☆☆
    Visit O.A.S.I.S.
  3. Kalosm

    Best forDevelopers needing local RAG utilities

    A free, self-hosted Rust toolkit for local model inference and RAG building.

    • Quantized model support
    • Built-in model downloads
    • GPU acceleration
    3.9/10★★☆☆☆
    Visit Kalosm
  4. Best forAndroid users needing a lightweight offline assistant

    A capable offline Android assistant with vision, memory, voice, and device tools.

    • Quantized model support
    • Built-in model downloads
    3.8/10★★☆☆☆
    Visit OfflineMate
  5. Best forGGUF tuning and performance monitoring

    A focused open-source desktop for GGUF downloads, LoRA tuning, and local performance insight.

    • Local API server
    • GPU acceleration
    3.7/10★★☆☆☆
    Visit HomeBred-LLM
  6. Ooor

    Best forWindows users wanting a llama.cpp control console

    A free, open-source Windows console for managing llama.cpp models, runtimes, chat, and APIs.

    • Local API server
    • Quantized model support
    • Built-in model downloads
    Free plan Our Ooor verdict → Visit Ooor
    3.6/10★★☆☆☆
    Visit Ooor
  7. Best forMobile users running models privately on-device

    A free, private mobile app for chatting with GGUF models and adding local voice tools.

    • Local API server
    • Quantized model support
    • Built-in model downloads
    3.5/10★★☆☆☆
    Visit PocketPal AI
  8. Best forSelf-hosted document RAG and tool workflows

    A self-hosted API for cited RAG, document ingestion, tools, and local model workflows.

    3.4/10★★☆☆☆
    Visit PrivateGPT
  9. ChatterUI

    Best forAndroid local character-chat users

    A focused Android frontend for local GGUF chats and many remote APIs, with mobile-only reach.

    • Quantized model support
    3.3/10★★☆☆☆
    Visit ChatterUI
  10. Hermit

    Best forIndividuals wanting a private desktop chat client

    A private, open-source Ollama client for desktop chat, code, and vision.

    • Built-in model downloads
    Open source Our Hermit verdict → Visit Hermit
    3.2/10★★☆☆☆
    Visit Hermit
  11. Best forApple users wanting simple offline AI tools

    A focused offline LLM app for Apple devices, with Android beta access but no API or free tier.

    • GPU acceleration
    3.1/10★★☆☆☆
    Visit Private LLM
  12. RWKV.cpp

    Best forDevelopers specifically targeting RWKV models

    A focused local runtime for developers building CPU or GPU applications around RWKV models.

    • GPU acceleration
    3.0/10★★☆☆☆
    Visit RWKV.cpp
  13. LocalChat

    Best forMac users needing offline document chat

    A focused Mac workspace for private, offline document chat with local models.

    • Quantized model support
    • Built-in model downloads
    • GPU acceleration
    3.0/10★★☆☆☆
    Visit LocalChat
  14. Maid

    Best forAndroid users wanting portable local model chat

    A free Android client combining on-device GGUF chat with broad remote-provider access.

    • Quantized model support
    • Built-in model downloads
    Free plan Our Maid verdict → Visit Maid
    3.0/10★★☆☆☆
    Visit Maid
  15. Best forOffline research-focused assistant users

    A free, local Ollama assistant built for cited offline research and reference work.

    • Built-in model downloads
    3.0/10★★☆☆☆
    Visit Survival LLM
  16. Best forSolo Apple users wanting private document chat

    A free, private document-chat app for iPhone, iPad and Mac users.

    • Built-in model downloads
    3.0/10★★☆☆☆
    Visit privateSLM

No tools match those filters.

Compare at a glance

#ToolFree planPaid fromSupported operating systemsLocal API serverGPU accelerationBuilt-in model downloadsScore
51Mochu AIYesFreeYesYesYes4.1
52O.A.S.I.S.Yes€25 one-timeWindowsYesYes4.0
53KalosmYesFreeNoYesYes3.9
54OfflineMateYesFreeYes3.8
55HomeBred-LLMFreeYesYes3.7
56OoorYesFreeWindowsYesYesYes3.6
57PocketPal AIYesCross_platformYesYesYes3.5
58PrivateGPTFree3.4
59ChatterUIFreeWindowsNoNo3.3
60HermitFreeCross_platformYes3.2
61Private LLMNoNoYes3.1
62RWKV.cppYesFreeNoYes3.0
63LocalChatNo$99 one-timeMacosYesYes3.0
64MaidYesFreeNoYes3.0
65Survival LLMYesFreeCross_platformNoYes3.0
66privateSLMYesCross_platformNoYes3.0

Reviewed by iTechGuides Editors · Editorial team · Updated Nov 2026

Last updated · How we research and update