iTechGuides is reader-supported. When you buy through links on our site, we may earn an affiliate commission. As an Amazon Associate I earn from qualifying purchases. Learn more
Yes—some GMKtec mini PCs can run local large language models, but the name alone tells you little about speed or which models will fit. Memory capacity, model quantization, context length, runtime and the exact machine all matter. GMKtec publishes promising EVO-X2 speed figures for a 128GB configuration, but those are manufacturer claims, not independent benchmarks. And an AI app on a GMKtec PC does not necessarily mean its models run locally.
What “local LLMs on GMKtec” can—and cannot—mean
GMKtec sells a range of mini PCs, not one standard configuration. A result from an EVO-X2 with 128GB of memory cannot be applied to every GMKtec system, or even automatically to an EVO-X2 with less memory. Before judging a result, identify the exact model and memory configuration, the operating system and runtime, and the model file and quantization used.
The title “I ran local LLMs on GMKtec” does not identify a test machine or settings. The available evidence therefore supports a practical answer about GMKtec systems and specific published or reviewed examples—not a claim that a particular unit was tested here.
Recommended Free Tools
What GMKtec says the EVO-X2 can run
GMKtec lists the EVO-X2 with an AMD Ryzen AI Max+ 395 processor and publishes a model-compatibility table for 64GB, 96GB and 128GB configurations. The table indicates that compatibility varies with memory capacity. Its published figures for the 128GB configuration include the following average generation speeds:
#1 Best Overall
- MINI PC COMPUTER OFFICE LIGHT GAMING - GMKtec Nucbox G10 Series is equipped with the Ryzen 5 3500U, a 64-bit quad-core mid-range performance x86 mobile microprocessor. This processor is based on AMD's Zen+ microarchitecture and is fabricated on a 12 nm process. The 3500U operates at a base frequency of 2.1 GHz with a TDP of 15 W and a Boost frequency of 3.7 GHz. This APU supports up to 32 GB of dual-channel DDR4-2400 memory and incorporates Radeon Vega 8 Graphics operating at up to 1.2 GHz. 20% Multi-core Performance increase over previous Ryzen 3 models such as 4300U. 35% performance increase over the Intel N-series N95/N97/N150.
- RYZEN 5 3500U vs RYZEN 3 4300U COMPARISON - Why Choose Ryzen 5 3500U: Better multi-threaded performance: More threads, better suited for multitasking and demanding applications. Better graphics: With Vega 8, it's superior for casual gaming, video playback, and GPU-intensive tasks. Overall higher performance: Higher boost clock and better ability to handle a variety of workloads, from light gaming to productivity tasks. So, if you're looking for a more balanced processor with stronger multitasking capabilities and better GPU performance, the Ryzen 5 3500U would be the clear choice.
- 16GB DUAL CHANNEL DDR4 + 512GB SSD - Installed with DDR4 16GB SO-DIMM RAM Dual Channel (2x8GB) and a 512GB SSD, the Nucbox G10 mini pc supports memory expansion to 64GB RAM. Featured with Dual M.2 2280 PCIe 3.0 slots, supports dual storage slot expansion to 16TB SSD (2*8TB). (Upgrades not included) This model supports a configurable TDP-down of 12 W and TDP-up of 35 W.
- UNLEASH RAW PERFORMANCE MODE 25W - Dominate demanding tasks with the AMD Ryzen 5 3500U processor. When switched to Performance Mode in the BIOS (press "Esc" key repeatedly during boot, save then exit), this mini PC delivers superior multi-core processing power, significantly outperforming Intel N-series chips in CPU-intensive applications, multitasking, and creative workloads.
- MINI DESKTOP COMPUTER WITH TRIPLE DISPLAY SCREEN - Nucbox G10 integrates AMD Radeon Vega 8 1200 MHz GPU to deliver powerful graphics processing power to easily handle video editing, and playback, or casual gaming. And it can connect to 3 display screens simultaneously via HDMI 2.1 TMDS/ DPv1.4/ TYPE-C.
| Model listed by GMKtec | Published average speed | Attribution |
|---|---|---|
| OpenAI GPT-OSS 120B | 19.25 tokens/s | GMKtec, accessed 2026 |
| OpenAI GPT-OSS 20B | 57.15 tokens/s | GMKtec, accessed 2026 |
| Qwen3 30B | 55.02 tokens/s | GMKtec, accessed 2026 |
| Qwen3 235B | 11 tokens/s | GMKtec, accessed 2026 |
| Llama4 109B-Q4KM | 13.83 tokens/s | GMKtec, accessed 2026 |
These are GMKtec’s published EVO-X2 figures, not independent test results. The page does not provide enough test-method detail to establish a controlled, like-for-like comparison. Treat the numbers as claims for the listed 128GB configuration, not a promise for other EVO-X2 memory options or GMKtec models.
A model that loads is not necessarily pleasant to use. Generation speed is only part of the experience: prompt processing, context length, quantization, runtime and workload can change performance. A large model producing tokens slowly may be useful for some tasks, but “supported” does not mean fast interactive chat.
Rank #2
- 12th INTEL ALDER LAKE N95 PROCESSOR - The G3S mini pc uses the 12th Intel N95 CPU 4 Core 4 Threads 6MB cache, burst speed up to 3.4GHz. Compared with (N100/N5105/N5100/N5095), the N95 offers an overall performance improvement of 36%. Ideal for routine tasks, office work and home entertainment,which is more convenient than traditional desktop pc
- 8GB RAM MEMORY & 256GB SSD STORAGE - GMKtec Nucbox G3S mini pc is prebuilt with 8GB DDR4 RAM, you will enjoy a speedier experience with Built-in 256GB M.2 2242 SSD Hard Drive. Our mini desktop pc boots up in seconds, work on multiple browser tabs, software applications and quickly transfers files
- RICH INTERFACE - Nucbox G3 Plus mini computer is equipped with USB 3.2, up to 10Gbps/S, HDMI(4K@60Hz)×2, 3.5mm Audio Jack. Supports WiFi 5, and Gigabit Ethernet RJ45 1000MbE network connectivity, Bluetooth 5.0. This Mini PC supports multiple device connection and can be used with servers, monitoring equipment, office equipment, displays, projectors, televisions, etc
- 4K DUAL SCREEN DISPLAY - Mini desktop computer is equipped with upgraded Intel Graphics(max 1000MHz), supports 4K video playback and AV1 decoding, connect the pc with a projector as a home theatre, enjoy a variety of entertainments. Two HDMI 2.0 ports allows you to multi-task efficiently on two 4K@60Hz displays
- WiFi5 & BT5.0 - Built-in Bluetooth 5.0 enables you to connect multiple wireless devices such as mice, keyboard, monitoring equipment, printer and monitor. High-speed wireless connection technology, reliable and efficient transmission speed, providing a faster internet experience for browsing and streaming. Small pc supports Wake On LAN, PXE Boot, RTC Wake and Auto Power On, ideal to use as a server
Why memory is often the deciding constraint
Model weights must fit in available memory alongside the runtime, operating system, context and other active workloads. Quantization reduces the memory needed for a model, usually with trade-offs, while a longer context also consumes memory. This is why a model’s parameter count alone cannot tell you whether it will fit or how responsive it will be.
Do these 3 things before closing this tab:
1Repair Windows errors before they cause bigger problems2Fix the driver behind crashes, sound loss and screen glitches3Clear out junk files and repair common Windows errorsThe EVO-X2 compatibility table’s differing results across 64GB, 96GB and 128GB configurations illustrate why you should check the exact memory option against the model you intend to run. An independent review of a different GMKtec machine, the K13, also identifies its fixed 16GB memory as a constraint for larger memory-hungry local models. That is an example of a different system’s limitation—not evidence about EVO-X2 performance.
Rank #3
- VALUE & PERFORMANCE MINI PC - GMKtec Nucbox M6 Ultra Series is equipped with the powerful AMD Ryzen 5 7640HS processor. This CPU is an upper mid-range processor (APU) of the Phoenix product family. It has 6 SMT-enabled Zen 4 cores (12 threads) running at 4.3 GHz base speed to turbo boost 5.0 GHz.With a TDP Boost of 45W-60W, the Ryzen 7640HS CPU is more energy efficient and delivers a 30% Performance increase over previous AMD Ryzen 7 6800H, 6600U.
- 32GB DDR5 RAM & 1TB PCIe SSD - Installed with DDR5 32GB RAM SO-DIMM Dual Channel (2x16GB), the Nucbox M6 Ultra mini pc support expansion to 128GB RAM. Featured with 1TB M.2 2280 PCIe 3.0 SSD, support dual slot expansion to PCIe 4.0 8TB SSD. (Upgrades not included)
- GAMING PC - The Radeon 760M iGPU has 8 CUs (512 shaders) running at up to 2,600 MHz. This desktop computer can play moderate gaming at a steady FPS, it also HW-encodes and HW-decodes the most widely used video codecs such as AV1, HEVC and AVC.
- DUAL NIC LAN 2.5G RJ45 - Fast Network Speeds: Enjoy up to 2500Mbps data transmission speed without worrying about lagging. Ideal for working, gaming, and surfing the internet. Great for Untangle, Pfsense or as a server office PC.
- TRIPLE 4K DISPLAY - Unlock unparalleled productivity with support for three simultaneous displays, including a stunning 8K@60Hz via USB4, plus 4K@60Hz through both HDMI 2.0 and DisplayPort, transforming your workspace into a command center for multitasking and immersive entertainment.
How much confidence to put in other GMKtec reports
Review findings are specific to the reviewed setup
TechRadar’s EVO-X3 review describes local chat, reasoning, image recognition, image generation, transcription and coding tests on a 128GB system. It reports that smaller language models began responding quickly and larger ones were slower. Those observations concern that reviewed EVO-X3 setup, not every GMKtec PC.
The same review reports a software wrinkle: Herdsman detected the NPU, but the then-current runtime manifests did not support the Ryzen AI Max+ 395. The reviewer worked around this by installing Lemonade and the Ryzen AI runtime. That is a dated report of the software available in the review, not proof of a current or universal compatibility problem. See the TechRadar EVO-X3 review.
Rank #4
- GMKtec M2 Pro S mini computer is equipped with 11th generation Intel Core i7-1185G7 processor, main frequency up to 4.8 GHz, 4 cores, 8 threads, 12MB cache, running much faster than i7-10810U, i5-12450H and i5-8259U, Windows PC series The power is only 35W, supporting your daily work with less power consumption, without delaying daily tasks
- 16GB DDR4 and 1TB NVME SSD: Desktop computer Comes with 16GB SODIMM, dual-channel DDR4 supports expansion up to 64GB. 1TB SSD M.2 2280 NVMe (PCIe3.0), supports expansion to 2TB, in addition, M.2 2242 SATA can be expanded to 2TB
- 4K UHD & 3 Screens Support: Mini PC with Intel Iris Xe Graphics G7 96EU GPU delivers high-quality graphics for the most demanding applications, 2 x HDMI (4K @ 60Hz) and 1 x USB Type-C (4K @ 60Hz) output terminals, allowing you to independently display 4K screens on 3 displays at the same time
- 2.5Gbps LAN & WiFi6 + BT5.2: GMKtec mini PC dual band WiFi 2.4G+5G networking and Giga (RJ45 speed up to 2500M), Loading web, video, or other networked operations is faster and more stable, Bluetooth 5.2 connect faster Speed, Farther Coverage, it is also a big feature that you can transfer files over LAN at high speed
- Package Included: 1x GMKtec Nucbox M2 Pro, 1x DC Power Plug, 1x HDMI Cable. 1 x VESA Mount with Screws, 1x User Manual
An AI launcher may use cloud services
PCWorld’s review of the GMKtec K13 found that its preinstalled Cherry AI launcher provided access to services and models including Doubao, Qwen and DeepSeek, but used cloud services rather than running inference locally in the reviewed configuration. That finding applies to the K13 setup the reviewer examined; it does not establish how every GMKtec model or AI app works. The PCWorld K13 review is a useful reminder to verify where processing happens.
How to tell whether inference is really local
Running a model through an app is not enough to show that the PC did the inference. For a meaningful local test, record the runtime and the specific model artifact, then check whether the setup continues to generate responses with the network disconnected. If it stops working offline, or the app requires a remote service, the result does not demonstrate offline local inference.
Best Value
- 12th Intel Alder Lake N95 Processor – The GMKtec G3 S Mini PC is powered by the 12th Gen Intel N95 processor with 4 cores, 4 threads, 6MB cache and a burst frequency up to 3.4GHz. Compared with N100/N5105/N5100/N5095, the N95 delivers up to 36% overall performance improvement. Perfect for routine tasks, office work, and home entertainment, this compact mini desktop is more convenient than traditional bulky PCs.
- 8GB RAM & 256GB SSD Storage – Pre-installed with 8GB DDR4 memory and a fast 256GB M.2 2242 SSD, the G3 S mini desktop offers quicker startup, smoother multitasking, and faster file transfers. Enjoy seamless performance whether you’re working on multiple applications, browsing, or streaming content.
- Rich Interfaces & Connectivity – The G3 S mini computer comes equipped with USB 3.2 (up to 10Gbps), dual HDMI 2.0 (4K@60Hz), and a 3.5mm audio jack. With support for WiFi 5, Bluetooth 5.0, and Gigabit Ethernet (RJ45 1000MbE), it connects easily with monitors, projectors, printers, office equipment, and other peripherals, making it versatile for both home and business use.
- Dual 4K Display Support – Featuring upgraded Intel UHD Graphics (up to 1000MHz), the G3 S supports 4K video playback and AV1 decoding for a smooth viewing experience. With dual HDMI outputs, you can connect two 4K@60Hz displays simultaneously, enabling efficient multitasking for work and entertainment.
- GMKtec WARRANTY - GMKtec offers a 1-year limited GMKtec's warranty for each mini PC, starting from the date of the purchase. All defects due to design and workmanship are covered. With a professional after sales team always ready to attend to your needs, you can simply relax and enjoy your mini PC.
- Record the GMKtec model, memory configuration and operating system.
- Name the runtime and the model artifact, including quantization where known.
- State the context length and workload used.
- Separate prompt-processing speed from generation speed; report tokens per second only with the measurement method and settings.
- Check behavior offline if the claim is that inference happens locally.
What to compare before choosing a GMKtec for local AI
Do not use a single TOPS figure as a substitute for an LLM test. Compare the actual memory configuration and runtime support, then look for performance measurements made with the model, quantization, context and workload you care about. If sustained use matters, noise, power draw and thermal behavior also deserve attention—but the cited figures and reviews do not establish those values for every configuration.
GMKtec’s AI mini PC catalog lists multiple systems; its displayed products and configurations can change. Verify the exact model and memory option being sold before applying any performance claim to a purchase decision.
Quick Recap
Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.
What’s actually slowing this PC down?
Pick the symptom - the matching free tool is one click away.
