This paper investigates an energy efficiency maximization problem in a UAV-assisted WPCN by jointly optimizing the UAV trajectory, hovering altitude, and hybrid TDMA/NOMA resource allocation and proposes a deep reinforcement learning-driven Hierarchical Energy-Efficient Data Collection scheme, which is named DRL-HEEC.
Abstract
Unmanned aerial vehicle (UAV)-assisted wireless-powered communication networks (WPCNs) have emerged as a promising solution for energy-constrained Industrial Internet of Things systems, where ground sensor nodes are often deployed in harsh and hard-to-reach environments. However, efficient UAV-assisted data collection remains challenging due to limited UAV onboard energy, realistic propulsion consumption, and varying quality-of-service requirements of industrial nodes. This paper investigates an energy efficiency maximization problem in a UAV-assisted WPCN by jointly optimizing the UAV trajectory, hovering altitude, and hybrid TDMA/NOMA resource allocation. To solve the resulting high-dimensional and highly coupled problem, we propose a deep reinforcement learning-driven Hierarchical Energy-Efficient Data Collection scheme, which we name DRL-HEEC. Specifically, a Double Deep Q-Network is employed at the upper level to optimize the UAV trajectory with altitude state inheritance, while a lower-level optimization engine based on the Dinkelbach method, block coordinate descent, and successive convex approximation is developed to handle heterogeneous resource allocation. Simulation results show that the proposed DRL-HEEC scheme outperforms other baselines. In particular, DRL-HEEC improves the system energy efficiency by approximately 9% to 12% compared to other reinforcement learning-based algorithms while ensuring QoS satisfaction on the part of emergency nodes.
In this paper, we propose a deep learning (DL)-based framework for optimizing three-dimensional (3D) trajectory planning and resource allocation in unmanned aerial vehicle (UAV)-enabled wireless networks composed of heterogeneous UAVs with varying capabilities. Unlike conventional approaches that assume uniform UAV cha...
Woongsup Lee, Kisong Lee· IEEE Transactions on Wireles...· 0 citations
Unmanned Aerial Vehicle (UAV)-aided Integrated Sensing, Communication, and Computation (ISCC) networks have emerged as a core component of the low-altitude network, providing an efficient mobile platform for complex tasks. In UAV coverage missions, jointly optimizing the trajectory and ISCC resources under global energ...
Peng Hou, Ya-Peng Zhao, Hong-Bin Zhu et al.· IEEE Transactions on Communi...· 0 citations
This paper proposes a heterogeneous multi-agent proximal policy optimization (MAPPO)-based framework where both user devices and UAVs act as heterogeneous agents and utilizes a centralized training and decentralized execution (CTDE) paradigm to enable collaborative strategies between computing requesters and providers.
Ming Cheng, Canlin Zhu, Jian-Hang Tang et al.· Journal of King Saud Univers...· 0 citations
With the development of AI-native radio access network (RAN), multi-unmanned aerial vehicle (UAV) cooperative wireless data collection based on multi-agent deep reinforcement learning (MADRL) has attracted wide attention. Existing studies rarely model the combined effects of multiple obstacles, interference, and dynami...
Zhen-Jia Xu, Nan Qi, Sa Xiao et al.· IEEE International Symposium...· 0 citations
This paper jointly optimizes UAV trajectory, user association, and radio resource management (RRM) to minimize the uplink weighted sum transmit powers, where each device’s weight is dynamically and inversely related to its residual energy, while treating UAV propulsion energy as a feasibility constraint.
Yang Yu, Xiao-Qing Tang, Gui-Hui Xie· Applied Sciences· 0 citations