Edge Intelligence in the IoT Era: A Review of Architectural Paradigms

Abstract

The exponential growth of the Internet of Things (IoT) has generated massive data streams traditionally processed by centralized cloud architectures, which increasingly face latency, bandwidth, and privacy limitations. Shifting artificial intelligence to resource-constrained edge nodes, known as TinyML, offers a robust decentralized alternative, though it introduces severe memory, compute, and energy bottlenecks. To map this transition, a systematic literature review was conducted following PRISMA guidelines, analyzing peer-reviewed studies published between 2021 and 2026 across major databases. The analysis identifies primary architectural paradigms and evaluates the efficacy of state-of-the-art model compression techniques, such as quantization, pruning, and knowledge distillation. Furthermore, the findings reveal that hardware–software co-design and custom neural accelerators are crucial for overcoming operational bottlenecks, while also highlighting persistent security and privacy challenges in on-device learning. Ultimately, while deploying complex models on microcontrollers is increasingly viable, achieving optimal performance demands holistic optimization strategies. This review synthesizes current research gaps and provides a strategic roadmap to guide future interdisciplinary efforts toward resilient, energy-efficient, and secure next-generation intelligent edge systems.