Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

iTechGuides is reader-supported. When you buy through links on our site, we may earn an affiliate commission. As an Amazon Associate I earn from qualifying purchases. Learn more

Connectivity is an edge AI architecture decision because it helps determine where inference happens, what data must travel, and whether the system can keep working when a link slows or drops. The right design is usually a distribution of work across device, nearby edge infrastructure, and cloud—not a choice between “edge” and “cloud,” and not automatically a choice for 5G.

Should AI run on the device, at the edge, or in the cloud?

ITU-T’s AIoT reference model treats device, edge, and cloud as domains where AI, data, and IoT functions can be assigned according to application requirements. The standard’s current recommendation, ITU-T Y.4618 (06/2026), places local inference and autonomous control among device functions, while cloud functions include large-scale storage, global training, orchestration, and model lifecycle management. The layers can cooperate.

Choose placement by asking what must happen quickly or locally, what can be shared across devices, and what benefits from broad storage or computing resources. Model placement and data movement are related but distinct decisions: a device can infer locally while sending selected events to the cloud, for example.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Pattern Where work happens When it fits Key constraint
Device-first Inference and preprocessing run on the endpoint. Immediate response, local autonomy, or limiting transmission of sensitive raw data matters, and endpoint resources are sufficient. The device must have enough compute and power for the model and task.
Edge-assisted A nearby edge node handles contextual inference, regional analytics, coordination, or management. Endpoints are constrained or multiple devices need shared local context. The node and its local network still need suitable capacity and a defined failure plan.
Cloud-centered Remote cloud infrastructure handles substantial storage, global training, orchestration, and lifecycle operations. The task benefits from centralized resources or fleet-wide operations. Sending data and relying on remote results makes connectivity and transfer requirements part of the design.
Hybrid or distributed Functions are split across device, edge, and cloud. Local action must coexist with regional coordination and global optimization. Interfaces, data flows, security, and behavior during disconnection must be designed across layers.

The ITU-T model describes vertical, horizontal, and hybrid distributions of AIoT functions. The practical consequence is that the architecture can keep urgent decisions near their source while reserving cloud resources for work that does not need to happen on the endpoint.

#1 Best Overall
Radxa Cubie A7A,Edge AI Platform,High-Speed LPDDR5,Single Board Computer (Radxa Cubie A7A 4GB)
  • POWERFUL COMPUTING: Advanced single board computer featuring high-speed LPDDR5 memory for superior processing capabilities and edge AI computing performance
  • CONNECTIVITY: Multiple USB ports, HDMI output, and Ethernet connectivity provide versatile interface options for various applications
  • COMPACT DESIGN: Space-efficient circuit board layout integrates powerful computing components in a single compact form factor
  • DEVELOPMENT READY: Ideal platform for edge AI development, programming, and prototyping with comprehensive hardware interfaces
  • EXPANDABILITY: Features multiple GPIO pins and standard connectors enabling extensive hardware expansion possibilities

What determines where inference belongs?

Start with the application’s requirements, not with a preferred radio or hardware platform. The same deployment may use different placement for different tasks: one function may need local control, while another can aggregate information from many sites.

Response time

For a time-critical closed loop, putting inference close to the device can reduce dependence on a round trip to a remote service. Whether it meets the actual deadline depends on the application, local compute, and network behavior; no fixed latency follows from the label “edge.” Measure the full path under realistic conditions.

Data movement

Estimate the amount and type of sensor data generated, how often it is produced, and what must leave the endpoint. Local filtering, preprocessing, and event extraction can reduce transfers by sending summaries or actionable information instead of every raw sample. The IETF’s RFC 9556 describes local computation, decisions, preprocessing, and offloading as edge functions, including ways to reduce reliance on high-bandwidth links.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Make the data policy explicit: which raw streams are retained locally, which derived events are transmitted, and what must be available for coordination, audit, or later analysis. Local processing can lower network demand, but the savings depend on the workload and what the system still needs to communicate.

Rank #2
Tinker Edge R RK3399Pro Single Board Computer with Edge TPU AI Accelerator and Dual Camera Interface Onboard 2GB RAM 1GB NPU RAM 16GB eMMC Storage for Edge Computing Support Tensorflow Lite/Caffe
  • [High performance] Quad-core ARM SoC up to 1. 8GHz with 3GB RAM- The Tinker Edge R features the Rockchip RK3399Pro SoC and Mali - T764 GPU along with 2GB of Dual Channel LPDDR4 memory for system, 1 GB LPDDR3 memory for NPU and 16GB eMMC flash
  • [Gigabit Class networking]Tinker Edge R features a high speed GB LAN port for true Gigabit Class networking throughput along with 3x USB3.2 Gen1 Type-A. It also features onboard Wi-Fi & Bluetooth for robust IoT & Network connectivity
  • [Open-source]The board will come with fully open-source kernel and support for multiple APIs, including OpenGL, Vulkan, OpenCL, OpenVX, TensorFlow Lite, Android NN, and Caffe
  • [HD Audio & UHD video support] It supports 192/24bit HD Audio playback with automatic Audio jack detection as well as accelerated HD & UHD ( 4K ) video playback and supports HDMI CEC for seamless power on & off configurations
  • [WiKi]For more information please refer to the product description, any technical issues after purchase please contact with our tech-support team: click "WayPonDEV" and ask a question. Package Content: 1x Tinker Edge R (3GB+16G eMMC); 2x Wi-FiVBT antenna cable; 1x Stand offset(4xScrew+4xHex); 2x Camera MIPI Convert cable (22P to 15P); 1 x Shielding bag; 1 x Quick start guide

Coverage and geography

Check which wireless technologies are available at the places devices will operate, what local operators can support, and what regulations apply. Qualcomm’s June 2022 guidance on cloud connectivity planning for IoT edge devices identifies workload data type, adoption of wireless technologies in the target geography, regional regulatory requirements, and operator capabilities as design considerations. These are deployment-specific inputs, not reasons to assume one technology works everywhere.

Compute, power, and cost

Confirm that an endpoint can run the required model within its compute and power envelope. If not, a nearby edge node may serve several devices or provide more capacity, but that shifts requirements to the node and its connection to those devices. Cloud resources can offer another place to run functions; they do not eliminate the need to account for data transfer or endpoint constraints.

Privacy and security

Decide what information can be processed locally and what needs to be shared. Processing near the source may limit movement of raw data, but it does not automatically make a system secure. ITU-T Y.4618 calls for security, trust, and privacy across device, edge, and cloud, including protected communications and secure handling of models and data.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Resilience

Define what the application should do when a connection is slow, intermittent, or unavailable. A system may continue a local function, buffer information for later transfer, enter a safe state, or stop a function; the correct behavior depends on the application’s risks. The design must specify and validate that behavior rather than treating connectivity loss as an exceptional afterthought.

Rank #3
KLAYERS ESP32-S3 AIoT CAM OV3660 Development Board with Audio, Display, and Edge Impulse Support
  • Supports access to online large model platforms and includes Edge Impulse object detection demo for real-time multi-object recognition
  • Equipped with Xtensa dual-core LX7 processor (up to 240MHz), 8MB PSRAM, 16MB Flash, and dual-mode WF + BT LE
  • Dual-microphone array with noise reduction and echo cancellation for high-quality voice processing
  • Integrated audio input and output module, supporting AI speech interaction and voice recognition applications
  • Onboard camera interface (DVP) and SPI / QSPI display interface for image capture, recognition, and external display connection

Does edge AI need 5G?

No single radio technology is implied by edge AI. ITU-T Y.4618 identifies networking options that include IMT-2020 and beyond, WLAN, and LPWA. Which option is appropriate depends on the workload, deployment geography, coverage, operator support, regulatory conditions, and the amount and timing of data that must move.

Begin with requirements such as data volume, response time, range, power, and availability, then verify which network options are usable at the actual deployment sites. A technology name by itself does not establish that a connection will meet the application’s needs. Avoid choosing a network in isolation from compute placement, data handling, and the system’s offline behavior.

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

How much connectivity does an edge AI system need?

There is no universal bandwidth or uptime figure. The required connection depends on what the system sends and receives, how often it communicates, and which functions must remain available during an outage. A useful way to scope it is to map data flows by purpose:

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
  • Local operation: Identify decisions that must be made on the device or nearby node without waiting for a remote response.
  • Coordination: Specify what devices or edge nodes need to exchange to coordinate activity.
  • Reporting and storage: Separate raw data from events, summaries, and records that must be retained or sent onward.
  • Model and software lifecycle: Account for controlled delivery of models, updates, and management information.
  • Recovery: Determine what can be buffered, retried, or discarded after a connection returns, and how the system behaves until then.

This inventory helps distinguish a system that needs continuous access to a remote inference service from one that can act locally and transmit only what is necessary. RFC 9556 describes edge processing as a way to preprocess inputs and offload useful information, but the appropriate balance must be established for the application.

Rank #4
ELECROW AI Starter Kit for Jetson Orin Nano with 11.6" Screen, 30 Sensors
  • 30-in-1 No-Solder Sensor Board, Plug and Play: Integrates 30 functional sensors including temperature & humidity, ultrasonic ranging, gas and motion sensors. Innovative common board design requires no soldering or complex wiring, and comes with a full set of accessories like 128G SD card, adapter board and acrylic mounting plates for zero-threshold experiments
  • 8MP Gimbal Camera & Dual Servos for Professional Visual AI: The Starter Kit is equipped with an IMX219 8MP monocular camera and a dual-servo gimbal, supporting face and target tracking, and is ideal for AI edge computing scenarios such as intelligent monitoring, robot navigation, and automated recognition
  • 38 Step-by-Step Python Tutorials, From Beginner to Practical Application: The Jetson Orin Nano Starter Kit comes with 38 well-designed Python tutorials progressing from basic programming to vision practice, covering all key knowledge of sensor control, embedded development and AI visual recognition for both beginners and advanced learners
  • 11.6-inch IPS HD Screen & AI Voice Interaction System: Built-in 1366*768 resolution IPS screen eliminates the need for an external monitor, enabling one-device experimentation and visual feedback. The exclusive AI voice interaction system supports intelligent Q&A and voice command control for natural human-computer dialogue
  • Rich Expansion Interfaces & Portable All-in-One Design: Features 2x I2C, 1x UART and 2 IO expansion interfaces to meet personalized experiment expansion needs; a custom carrying case integrates all components (11.81×7.87×3.94 inch), allowing AI experiments and demonstrations anytime and anywhere

What should the connectivity design protect?

Security and trust span every layer, not just the network link. The ITU-T Y.4618 requirements address secure communication, mutual authentication and encryption across interfaces, model and data lifecycle management, resilience, and model integrity and governance.

  • How are devices and services authenticated to one another?
  • How are communications protected between device, edge, and cloud?
  • How are model versions validated, controlled, and audited?
  • What happens if a model or software update cannot be delivered or verified?
  • Which data must be retained or transmitted, and who is permitted to access it?

ISO/IEC TR 30164:2020 presents IoT edge computing as an interaction of networking with data management, coordination, processing, heterogeneous computing, security, and hardware and software optimization. That is why connectivity should be designed with the rest of the system rather than selected as a standalone component.

How can a team prototype an edge AI design?

A developer kit can help explore model execution and application behavior on edge hardware, but it is a prototype platform—not proof that a finished deployment meets its compute, power, connectivity, or regulatory requirements. NVIDIA describes its developer kits as tools for developing and testing Jetson-based products and presents the Jetson Orin Nano Super Developer Kit as a compact computer for edge AI.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

For a prototype, verify separately which network interfaces or add-on modules are required for the intended connection. Then test the actual workload and failure behavior: local inference, transfer of selected data, operation with poor or absent connectivity, and update handling. A development board does not by itself establish production readiness or the suitability of a particular wireless technology.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.