Federated reinforcement learning for energy-aware load balancing in edge-fog-cloud IoT continuum

Communication-Aware Federated Learning for Energy Management in Edge-Cloud Autonomous Systems

Reinforcement Learning for Resource Allocation in Energy-Harvesting Cooperative IoT Networks

This work exploits the concept of cooperative communication and radio frequency-based energy-harvesting to improve the network throughput while maintaining power supply to the IoTDs and employs the reinforcement learning frameworks, particularly state–action–reward–state–action (SARSA) and Q-learning.

A Personalized Federated Deep RL Framework for Carbon-Aware and Battery-Safe Smart Microgrid Intelligence in Edge-IoT Environments

The distribution of renewable energy resources and Edge-IoT infrastructures have brought new challenges in intelligent smart microgrid management, such as dynamic-energy-demand changes, carbon-heavy energy-scheduling, communication overhead, and battery degradation. The deployment of renewable energy resources, distributed battery storage systems, and Edge-IoT infrastructures has created a number of challenges in the management of smart microgrids, such as dynamic changes in energy demand, carbon-heavy energy-scheduling, communication overhead, and battery degradation. To tackle these challenges, this paper introduces a personalized Federated Deep Reinforcement Learning (GridMind-FDRL) framework for carbon-aware and battery-safe decentralized smart microgrid optimization. The proposed framework combines federated learning, deep reinforcement learning, edge intelligence, carbon-aware energy scheduling and battery-aware adaptive optimization with a centralized framework for energy management. Unlike traditional centralized optimization methods, GridMind-FDRL allows for collaborative learning among distributed microgrid nodes while maintaining privacy and enabling low latency real-time optimization in dynamic Edge-IoT environments. The framework was tested with different operating conditions of intermittent renewables, varying load levels, and battery stress conditions. The results of the experiment showed that the energy efficiency could be 93.86%, carbon reduction 24.36%, battery health preservation 90.42%, communication efficiency 88.08%, and decision latency reduction 34.21%. The acquired results support the scalability, sustainability, and smart energy optimization ability of the suggested framework for the next-generation decentralized smart energy ecosystems.

Stability-Aware and Feasibility-Sensitive Aggregation in Federated Reinforcement Learning for Edge-IoT Systems: A Review

Federated Reinforcement Learning (FRL) provides a useful basis for distributed policy learning in Edge-IoT systems, where clients interact with local environments without transferring raw operational data to a central server. Yet aggregation becomes difficult when clients operate under different transition dynamics, workloads, resource capacities, communication conditions, and operational constraints. In these settings, local policy updates may not differ only in magnitude or direction; they may also differ in stability, reliability, resource support, and operational feasibility. Conventional averaging is therefore limited, since it does not distinguish stable and feasible updates from unstable or constraint-violating ones. This paper examines aggregation stability and feasibility-sensitive aggregation in FRL for Edge-IoT systems. It reviews and synthesizes related literature across four connected streams: heterogeneous Federated Learning, FRL-based edge decision-making, constrained and safe Reinforcement Learning, and adaptive or reliability-aware aggregation. The reviewed studies are analyzed through six dimensions: learning paradigm, type of heterogeneity, role of policy learning, treatment of operational constraints, aggregation strategy, and whether local feasibility signals influence global aggregation weights. The analysis indicates that existing studies provide valuable foundations, but they usually treat heterogeneity, constraint handling, and aggregation adaptation as separate concerns. The paper identifies a need for aggregation mechanisms that jointly account for update stability, update reliability, resource availability, and constraint feasibility. It positions aggregation as adaptive client influence regulation rather than passive averaging in future Edge-IoT FRL systems.

Can Federated Learning Go Green? EcoFL: A System-Level Energy-Aware Benchmark for IoT Edge Intelligence

The proliferation of Internet of Things (IoT) devices operating at the network edge has created unprecedented demand for distributed machine learning capable of functioning under severe resource constraints. Federated learning (FL) has emerged as a promising paradigm for privacy-preserving collaborative model training across distributed nodes; however, its application to energy-constrained edge environments remains insufficiently characterized at the system level, particularly with respect to reproducible evaluation of resource consumption and communication efficiency. In this paper, we present EcoFL (Energy-Conscious Federated Learning), a modular, energy-aware benchmarking and orchestration framework for systematic evaluation of lightweight machine learning models under emulated edge hardware constraints. Rather than proposing a new federated optimization algorithm, EcoFL extends a standard FedAvg-based training pipeline with three principal components: (i) an energy-aware communication scheduler that dynamically adapts aggregation rounds and client participation based on per-node resource availability; (ii) a comprehensive system-level profiling pipeline capturing CPU utilization, RAM consumption, inference latency, communication overhead, and estimated computational energy consumption per training round; and (iii) a reproducible benchmarking methodology enabling fair comparison of centralized, standard federated (FedAvg), and energy-aware federated configurations. We evaluate five lightweight model families—Logistic Regression, Random Forest, XGBoost, Multilayer Perceptron, and Isolation Forest—under emulated Raspberry Pi 4 hardware constraints using an anomaly detection task on synthetic IoT sensor telemetry (50,000 samples, 12 features, Dirichlet non-IID partitioning). Experimental results across five independent seeds show that, within the evaluated benchmark setting, EcoFL reduces estimated federated training energy by 79.9–92.9% (mean 84.4%) relative to standard FedAvg through adaptive round termination (4–7 rounds versus 20 fixed rounds), while showing no statistically significant F1-score degradation for four of the five evaluated model families under the tested seed regime. Notably, EcoFL achieves a higher F1-score than FedAvg for Random Forest (+0.052), which we attribute to reduced overfitting resulting from earlier convergence under non-IID data distributions. The full EcoFL framework is released as open-source software to promote reproducibility in energy-aware federated learning research and to facilitate systematic investigation of the trade-offs between predictive performance, resource utilization, and communication overhead in resource-constrained edge environments.

A dynamic reward framework for scalable and efficient IoT-WSN routing using deep reinforcement learning.

A dynamic reward structuring framework within deep reinforcement learning to enable adaptive and balanced routing in IoT-WSNs and achieves significant performance gains, including approximately 30% improvement in energy efficiency, 25% reduction in latency, and 35% increase in network throughput compared with baseline methods.