What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

iTechGuides is reader-supported. When you buy through links on our site, we may earn an affiliate commission. As an Amazon Associate I earn from qualifying purchases. Learn more

Yes—YOLOv5 can run on the Mixtile Blade 3 through Rockchip’s RKNN model and runtime path, which uses the RK3588’s NPU. The practical route is to convert or obtain an RKNN-ready model, install a runtime compatible with the board’s Ubuntu image, and run an RKNN demo or application. Do not assume NVIDIA CUDA or GPU-focused Docker instructions apply.

Can the Blade 3 run YOLOv5?

The Mixtile Blade 3 is an ARM64 single-board computer based on the Rockchip RK3588. Its NPU makes it suitable for edge inference, but a standard YOLOv5 model is not automatically an NPU-ready deployment. The usual approach is to convert the model to Rockchip’s RKNN format, or start with a compatible RKNN model, then run inference with the matching Rockchip runtime.

Check Mixtile’s manual for the exact Blade 3 revision in use. RAM, eMMC, connectors, and carrier details can differ by revision, so do not assume one board’s configuration describes every Blade 3.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

What do you need before setting it up?

  • A supported Ubuntu image for the Blade 3 and a working Rockchip NPU driver/runtime.
  • YOLOv5 weights and either a host machine for conversion or an RKNN-ready model.
  • A board-side RKNN Toolkit2 Lite/runtime package that matches the software stack.
  • A compatible ARM64 Python environment or container, plus any libraries required by the chosen demo.
  • An image, camera, or video source for inference. Camera, storage, power, and cooling compatibility depend on the specific board and accessories.

The RK3588 project’s documented WebUI route uses Ubuntu, FFmpeg and related libraries, ARM64 Miniconda, Python 3.9, rknn_toolkit_lite2, and the repository’s requirements. It also documents an optional Docker route. Treat those as that project’s setup rather than a guarantee that every Blade 3 image or runtime will use identical versions.

#1 Best Overall
Orange Pi 5 Plus 8GB RK3588 8 Core 64 Bit Single Board Computer, 2.4GHz Frequency 8K Video Decoding Open Source Development Board Run Orange Pi OS, Android, Debian, Ubuntu
  • Orange Pi 5 Plus 8GB adopts a Rockchip RK3588 8-core 64 bit processor, specifically a quadcore A76+quadcore A55, designed using an 8nm process, with a main frequency of up to 2.4GHz. It integrates ARM Mali-G610, has a built-in 3D GPU, and is compatible with OpenGL ES1.1/2.0/3.2, OpenCL 2.2, and Vulkan 1.2; There is 4GB/8GB/16GB LPDDR4/4x memory and eMMC flash socket, which can be externally connected to 16GB/32GB/64GB/128GB/256GB eMMC modules(NO Include).
  • The embedded NPU of Ornage pi 5 plus 8gb mini pc supports the hybrid operation of INT4/INT8/INT16/FP16, with the computing power up to 6Tops, which can meet the edge computing requirements of most terminal devices. Orange Pi 5 Plus supports the official operating system Orange Pi OS developed by Orange Pi, as well as operating systems such as Android 12, Debian 11, and Ubuntu 22.04.
  • Orange pi 5 Plus Single Board Computer has rich interfaces, 2 HDMl output ports, 1 input HDMl port, and can be decoded up to 8K@60P Video, two PCIe extended 2.5G Ethernet interfaces, equipped with an M.2 M-Key slot that supports the installation of NVMe solid-state drives, and an M.2 E-Key slot that supports Wi Fi 6/BT modules. In addition, the OPi 5 Plus has 2 USB 3.0, 2 USB 2.0, and 2 Type-C (one of which is a power interface).
  • Orange pi 5 Plus microcontroller open source board mini computer has a wide range of applications, which can help embedded system development enthusiasts explore and is also suitable for enterprises to develop mini machine vision systems with multiple Ethernet ports. OPi 5 Plus provides a stronger performance experience for high-end applications and can meet the customized needs of different industries.
  • Orange Pi Single Board Computers can builed a computer, a wireless server, Games, music and sounds, HD video, a speaker, Android, Scratch.Pretty much anything else, because Orange Pi is open source.

How to deploy YOLOv5 through RKNN

  1. Prepare the board. Install a supported Ubuntu image for the Blade 3, then confirm the Rockchip NPU driver and runtime are present and functional.
  2. Choose the model path. Obtain YOLOv5 weights and convert them to RKNN on a host machine if required, or use an RKNN-ready model intended for the RK3588.
  3. Match the software versions. Set up an ARM64 Python environment or suitable container and install the RKNN Toolkit2 Lite/runtime package compatible with the board’s driver and OS image. Install the selected demo’s Python dependencies as well.
  4. Run an inference example. Launch a YOLOv5 RKNN demo or WebUI with an image, camera, or video input. Confirm that the application is using the RKNN path rather than an unsupported CUDA configuration.
  5. Measure the whole pipeline. Record whether preprocessing, postprocessing, display, and recording are enabled; those operations affect end-to-end throughput.

Ultralytics’ generic Docker quickstart includes commands such as python train.py, python val.py, python detect.py, and python export.py. Its GPU setup assumes NVIDIA drivers and NVIDIA Container Toolkit, which is a different deployment path from the RK3588 NPU workflow. Use Rockchip-specific RKNN instructions for Blade 3.

What FPS can you expect on an RK3588?

Published figures illustrate how widely throughput can vary with model and test setup; they are not a guaranteed Blade 3 result. Qengineering’s 2024 RK3588 table reports the following model-specific figures. That table says models are INT8-quantized unless noted, and uses separate model and input conditions, so the rows should not be treated as a controlled comparison under one shared configuration.

Rank #2
youyeetoo YY3588 AI Single Board Computer - RK3588 SoC with 6TOPS NPU - LPDDR4 32GB RAM Max, 4K/8K Video Codec, Support PCIe 3.0 2280 NVMe/SATA 3.0 SSD for IoT (8g+64g,Carrier + Core Board kit)
  • [Powerful RK3588 Octa-Core SoC ] Youyeetoo YY3588 AI development boards is equipped with the Rockchip RK3588 octa-core ARM CPU (4× Cortex-A76 2.4GHz & 4× Cortex-A55 1.8GHz), ARM Mali-G610 MP4 GPU (450 GFLOPS performance) and 6TOPS NPU, which can compatible with Tensor-Flow, Py-Torch, Caffe, RKNN, supports INT4/INT8/INT16 operations.
  • [Multiple Memory Specifications] YY3588 AI Linux Open Source Dev Board Kit onboard LPDDR4 RAM - options: 4GB, 8GB, 16GB, 32GB RAM, which delivers superior performance for local large-scale model inference, industrial automation, edge AI, and smart end applications.
  • [High-speed Storage Expansion] Youyeetoo YY3588 mini pc provides M.2 2280 NVMe SSD (PCIe 3.0 x4) and SATA 3.0 interfaces, also onboard 32GB/64GB/128GB/256GB eMMC 5.1 for high read and write speeds in data-intensive scenarios.This enables the YY3588 to achieve unlimited memory possibilities, significantly enhancing developers' productivity.
  • [Dual Network & Multi-Protocol Support ] Youyeetoo YY3588 AI Single Board Computer features dual Ethernet ports (2.5GbE & Gigabit) and integrates 4G LTE, WiFi 6, BT5.2, NFC, and CAN bus to meet the demand for multi-protocol convergence for industrial IoT. 4G LTE expansion (MiniPCIe with SIM slot, supports EC20/EC25).
  • [4K/8K Multi-Display Output] Youyeetoo YY3588 AI Single Board Computer supports HDMI 8K 60fps and dual MIPI DSI/EDP outputs, compatible with 7-11.6-inch touchscreens, and can be deployed in digital signage, HMI terminals, and other devices in a plug-and-play manner.
YOLOv5 variant Reported throughput Source and qualification
yolov5n 58.8 FPS Qengineering, 2024; model/input conditions differ across entries, and models are INT8 unless noted.
yolov5s_relu 50.0 FPS Qengineering, 2024; model/input conditions differ across entries, and models are INT8 unless noted.
yolov5s 37.7 FPS Qengineering, 2024; model/input conditions differ across entries, and models are INT8 unless noted.
yolov5m 16.2 FPS Qengineering, 2024; model/input conditions differ across entries, and models are INT8 unless noted.

A separate Applied-Deep-Learning-Lab RK3588 project reports that recording reduced its frame rate by about 20 FPS and that it could reach around 60 FPS without recording. That is a project-specific report, not a controlled Blade 3 benchmark or a promise of sustained performance on every board.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

How to compare or benchmark results fairly

FPS numbers are useful only when the test conditions are clear. Record these details with any result:

Rank #3
KICKPI K2B 2GB DDR 16GB eMMC Allwinner H618 Single Board Computer, Surpport Mali-G31 MP2, Gigabit Ethernet, HDMI, Dual-Band WiFi & Bluetooth, Android 12/Ubuntu 22.04
  • 【Powerful Allwinner H618 Quad-Core Performance】 Powered by the Allwinner H618, KICKPI K2B features 4× ARM Cortex-A53 cores up to 1.5GHz and a Mali-G31 MP2 GPU, delivering a balanced combination of responsive computing and smooth graphics performance. Built to handle everyday multitasking, multimedia processing, and demanding development workloads with ease.
  • 【4K@60Hz Hareware Video Decoding】 Enjoy fluid high-definition playback with H.264/H.265 4K@60Hz hardware decoding and H.264 1080p@60Hz encoding. Dedicated hardware acceleration reduces CPU workload while delivering efficient, stable video processing for a smoother multimedia experience.
  • 【Flexible Android 12 & Ubuntu 22.04 Support 】Choose the environment that best fits your project: Android 12 provides access to a rich mobile app ecosystem, while Ubuntu 22.04 offers a familiar Linux environment for development and customization. This dual-OS flexibility makes it easier to build, test, and deploy your own software and embedded solutions.
  • 【Rich Connectivity & 20-PIN Expansion】 Features Gigabit Ethernet, dual-band 2.4GHz/5GHz WiFi and Bluetooth for fast and flexible connectivity. The 20-pin expansion interface supports UART, SPI, PWM, I2C, I2S, SPDIF and USB for hardware development and peripheral integration.
  • 【Compact & Versatile Platform for Custom Projects】 Designed for flexible development and deployment, KICKPI K2B offers 1GB/2GB/4GB RAM and 8GB/32GB storage options, Type-C 5V power, USB 2.0, HDMI output up to 4K@60Hz, and SD card support. Its compact and versatile design makes it an ideal foundation for IoT gateways, video conferencing terminals, set-top boxes, karaoke systems, projectors, and other custom embedded solutions.
  • YOLOv5 variant and whether the model is quantized.
  • Input resolution and RKNN runtime version.
  • Preprocessing and postprocessing included in the timing.
  • Whether input comes from a camera or file, and whether display or recording is active.
  • Ubuntu image, power and thermal conditions, and the Blade 3 revision.

For a practical application, measure with the same recording and display behavior you intend to use in deployment. An inference-only figure can overstate the throughput users experience when the full video pipeline is active.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.