Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

iTechGuides is reader-supported. When you buy through links on our site, we may earn an affiliate commission. As an Amazon Associate I earn from qualifying purchases. Learn more

Design an AIoT system around where each function needs to run—not around a single universal stack. Place sensing, inference, coordination, storage, training, and control across devices, edge infrastructure, and cloud according to response-time needs, data locality, available resources, connectivity, scale, and operational capability. Then design security, model updates, monitoring, and recovery across the same end-to-end system.

What an AIoT architecture includes

AIoT combines artificial intelligence, data capabilities, and the Internet of Things across connected devices, edge infrastructure, and cloud systems. It is best understood as a distributed system: data and decisions can move between these domains, and each domain can perform different parts of the workload.

ITU-T Y.4618, published in June 2026, describes an AIoT reference model spanning device, edge, and cloud domains. It assigns no universal division of labor; functions are distributed according to application requirements. The standard is a useful architectural reference, not a finished design for a particular product or sector.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Device domain

A device may sense its environment, preprocess data, run lightweight inference, make local closed-loop decisions, or control an actuator autonomously. These functions can reduce dependence on a remote connection, but their feasibility depends on the device’s compute, memory, energy, and other resource limits.

#1 Best Overall
ELEGOO 3PCS ESP-32 Dev Boards, ESP-WROOM-32, USB-C, WiFi Bluetooth 4.2
  • Dual-Core Performance Up to 240 MHz: Run sensor processing, wireless communication, automation logic and connected-device tasks on a 32-bit dual-core ESP32 platform designed for responsive embedded and IoT projects
  • Built-in Wi-Fi and Bluetooth 4.2: Connect to 2.4 GHz Wi-Fi networks or use Bluetooth Classic and BLE for wireless sensors, smart devices, remote controls, home automation and other connected projects
  • Flexible Power-Saving Modes: ESP32 power-management features support dynamic clock scaling and low-power operating modes, helping developers reduce energy use in compatible sensing, monitoring and connected-device applications, suitable for battery-powered Internet of Things (IoT) devices.
  • USB-C Programming with CP2102: Connect through USB-C for power, sketch uploads and serial monitoring, while GPIO, UART, SPI and I2C interfaces support sensors, displays, motor drivers and other modules (USB-C cable not included)
  • Over-the-Air Update Support: Configure OTA functionality through a compatible ESP-32 software framework to update deployed firmware over Wi-Fi without reconnecting the board by USB for every revision

Edge domain

An edge system can provide contextual inference, coordinate nearby devices, manage deployments, and support observability or local adaptation when its resources allow. Its value depends on the need for local coordination and the capacity to operate and secure another layer of infrastructure.

Cloud domain

Cloud systems can support large-scale data management, centralized training, global orchestration, and model lifecycle functions. They can aggregate information across deployments, but workloads that rely on a cloud connection must account for connectivity and the consequences of an interruption.

How to decide what runs where

Make placement decisions for individual functions, not for an entire system in one stroke. A single application may preprocess on a device, coordinate at an edge node, and train or aggregate in the cloud. For each function, weigh the following factors together:

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Rank #2
2 Pack ESP32-DevKitC-32E Development Board for IoT Smart Home/Industrial Control, Dual-Core 240MHz Wi-Fi + Bluetooth 5.0 with USB-C, Original ESP32-WROOM-32E Module (Arduino/Python/IDF) (8M)
  • Certified & Future-Ready: Espressif-certified ESP32-WROOM-32E ensures full hardware compatibility and lifetime firmware support. Upgraded 8MB Flash handles IoT data and OTA updates.
  • Dual-Core Speed: 240MHz dual-core processor runs Wi-Fi/BLE and sensors 2x faster. 38 GPIO pins (10 RTC) support SPI/I2C/UART for LCDs, motors, and industrial sensors.
  • Plug & Play Dev: USB-C driver pre-installed: upload code instantly on Windows/Mac/Linux. Works with Arduino IDE, MicroPython, and Espressif IDF.
  • All-Environment Ready: Run Wi-Fi smart switches (Home Assistant) and BLE tracking on one board. Industrial-grade stability (-40°C~85°C) for outdoor/automated systems.
  • Advantages: The ESP32 development board offers high performance, low power consumption, and rich wireless connectivity, making it suitable for developers of all levels, especially beginners.
  • Response and control: If a decision must be made locally or promptly, consider device or edge execution when resources permit. Establish what the system should do if the chosen compute location or its connection is unavailable.
  • Privacy and data locality: Decide which data needs to leave the device or local site, for what purpose, and where it may be processed or retained. Local processing can support data-locality requirements, but does not by itself establish that a system is private or secure.
  • Compute and energy: Match the workload to the capacity of the device or edge environment. If it exceeds local resources, consider whether to simplify, defer, or move the work rather than assuming the device can run it.
  • Connectivity and bandwidth: Identify which functions need a live connection and what data must cross it. A design that sends all inputs to the cloud has different bandwidth and outage dependencies from one that filters or acts locally.
  • Scale and coordination: Consider whether a function needs information or control across many devices or sites. Cloud services can support global aggregation and orchestration; edge coordination may be more appropriate for nearby devices.
  • Operations: Account for who will deploy, observe, update, and recover devices, edge components, cloud services, and models. A placement that is technically possible may still be unsuitable if it cannot be operated reliably.

These are design implications of the ITU-T Y.4618 reference model and the placement guidance in ITU-T YSTP.AIoT (September 2023), not a claim that edge execution is best for every workload.

Compare architecture patterns against the workload

The patterns below are starting points, not scores. Actual latency, privacy, reliability, energy use, cost, and accuracy depend on the application and implementation; the cited standards do not provide a sector-specific deployment result to use as a universal benchmark.

Pattern Where work is concentrated Potential fit Trade-offs to examine
Device-first Preprocessing, inference, and local decisions run mainly on devices. Workloads that need local action or data locality, provided device resources are sufficient. Device compute and energy limits, fleet-wide model management, and how devices behave when they cannot reach shared services.
Edge-coordinated Devices handle sensing or local functions; an edge layer performs contextual inference, nearby coordination, or deployment management. Systems that need coordination close to a group of devices and have the capacity to operate an edge environment. Edge resource limits, edge availability, connectivity between devices and edge, and added deployment and observability responsibilities.
Cloud-centered Devices collect or forward data; cloud systems handle most inference, aggregation, training, and orchestration. Functions that benefit from centralized data management or global scale and can tolerate dependence on cloud connectivity. Network availability and bandwidth, data locality requirements, cloud dependence, and the behavior of the system during disconnection.
Hybrid Functions are divided among device, edge, and cloud according to their different requirements. Workloads with both local response or coordination needs and centralized lifecycle or scale needs. More placement boundaries to secure, observe, version, test, and recover consistently.

Use the comparison dimensions identified by AIOTI HLA Report R7 (released 24 November 2025) as a review checklist: response latency, privacy and data locality, device and edge compute and energy limits, network availability and bandwidth, cloud dependence, resilience during disconnection, scalability, model update and rollback controls, operational observability, and interoperability. The available sources establish these as relevant design concerns, but do not specify a workload against which to rank the patterns.

Design the data and control loop end to end

Trace both data and decisions through the system. A useful implementation narrative is a loop rather than a diagram of isolated tiers:

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
  1. Sense and actuate: Identify what the device measures, what it can control, and which decisions must remain local for the application to function.
  2. Preprocess and infer on the device: Specify which data transformations and lightweight inference belong on-device, and what output or event should be passed onward.
  3. Communicate securely and coordinate at the edge: Define what crosses the device boundary, what nearby devices or edge services coordinate, and how the system handles unavailable links.
  4. Aggregate and train in the cloud: Identify what information is needed centrally for large-scale data management, training, or global orchestration; avoid assuming every raw input must be sent there.
  5. Validate and distribute models: Define how a model is checked, versioned, approved, delivered to the intended devices or edge systems, and tied to the software or configuration it depends on.
  6. Monitor, roll back, and govern updates: Observe system and model behavior, retain a way to identify deployed versions, and establish how to pause or reverse a problematic release.

Keep reference requirements separate from project decisions. ITU-T Y.4618 and the other architecture references help frame domains and concerns; they do not choose a protocol, topology, hardware platform, cloud service, or deployment provider for an unspecified application.

Build security, privacy, and trust into every layer

Network encryption is only one part of AIoT security. ITU-T Y.4618 identifies mutual authentication and encryption, secure data and model lifecycle management, transparency and accountability, resilience, and model validation, version control, and auditability as system concerns. ITU-T XSTR.saAIoT (December 2025) addresses security threat analysis for AIoT on devices. Together, these references support treating trust as an end-to-end property of devices, edge services, cloud systems, data flows, and models.

Rank #4
ESP-WROOM-32 ESP32 ESP-32S Development Board 2.4GHz Dual-Mode WiFi + Bluetooth Dual Cores Microcontroller Processor Integrated with Antenna RF AMP Filter AP STA Compatible with Arduino IDE (3PCS)
  • 2.4GHz Dual Mode WiFi + Bluetooth Development Board
  • Support LWIP protocol, Freertos
  • SupportThree Modes: AP, STA, and AP+STA
  • Ultra-Low power consumption, Compatible with Arduino IDE
  • ESP32 is a safe, reliable, and scalable to a variety of applications
  • Define how devices, edge components, and cloud services authenticate one another, and protect communications between them.
  • Protect data and models throughout their lifecycle, including movement, storage, deployment, and retirement.
  • Record which model version is deployed where and preserve enough audit information to investigate changes and outcomes.
  • Plan for resilience: specify safe behavior when a device, edge service, cloud service, or connection is unavailable.
  • Provide human oversight where the application needs it. Y.4618 also recommends understandable explanations as a user-centric capability where appropriate.

Privacy needs its own data-flow decisions: what is collected, what leaves a local boundary, where processing occurs, and who can access the result. Moving computation closer to a sensor may help meet a locality requirement, but it does not replace controls over access, retention, or model handling.

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Use standards to define boundaries, not to prescribe a stack

ITU-T Y.4618 is the newest directly relevant AIoT reference in the cited material. AIOTI HLA Report R7 places IoT and edge architecture in a broader context that includes Big Data, virtualization, security, privacy, deployment options, and interoperability. ISO/IEC 30141:2024 provides common IoT vocabulary, reusable designs, and architecture views. These references can help teams describe system boundaries consistently; they do not select a vendor or implementation for an unspecified use case.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Use the shared vocabulary to make design reviews precise: document which components belong to device, edge, and cloud domains; which data and control paths cross those boundaries; and which party owns operation of each component. Then choose protocols, hardware, topology, and services against the actual application requirements.

Best Value
Type-C D1 Mini NodeMCU ESP32 WLAN WiFi Bluetooth IoT Development Board 5V Compatible for Arduino (3pcs Type-C)
  • D1 Mini NodeMCU Type-C ESP32 WLAN WiFi Bluetooth IoT Development Board 5V Compatible for Arduino
  • Designed with ultra-low power technology, it offers the full range of performance and features of the ESP32 chip. The pin arrangement provides compatibility with the modules developed for the D1 Mini ESP8266 while also offering fast WLAN, enhanced GPIO, Bluetooth functionality, and with its higher performance, a wider range of applications.
  • 100% compatible with Arudino IDE, Lua and Micropython, it shows robustness, versatility, and reliability in a wide variety of applications and power scenarios.
  • All I/O pins have interrupt, PWM, I2C and one-wire capability, except the pin DO.
  • Designed with ultra-low power technology, it offers the full range of performance and features of the ESP32 chip. The pin arrangement provides compatibility with the modules developed for the D1 Mini ESP8266 while also offering fast WLAN, enhanced GPIO, Bluetooth functionality, and with its higher performance, a wider range of applications.

Turn the architecture into a reviewable design

Before implementation, create a short placement and lifecycle record for each important function. It should be specific enough to challenge assumptions and revisit them when requirements change.

  • Function and owner: What does the function do, and which system component is responsible?
  • Placement rationale: Why does it run on the device, edge, cloud, or across multiple domains, considering response, privacy, resources, connectivity, scale, and operations?
  • Inputs and outputs: What data enters and leaves the function, and what crosses a domain boundary?
  • Failure behavior: What happens when compute or connectivity is unavailable, and which local behavior remains possible?
  • Lifecycle controls: How are the associated data and model validated, versioned, deployed, monitored, audited, and rolled back?
  • Interoperability boundary: Which interfaces must remain compatible across devices, edge systems, and cloud services?

Review the design against the workload rather than accepting a default topology. If requirements change—for example, if local autonomy becomes essential or a device cannot support its assigned inference—the placement decision and its operational consequences should be revisited together.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.