2026· IEEE Transactions on Cognitive Communications and Networking· Vol 12, pp. 12005-12020· 0 citations· 43 references
Abstract
Autonomous aerial vehicle (AAV)-assisted data collection in wireless sensor networks (WSNs) is challenging under uncertain topology and limited prior information. This paper investigates such scenarios and formulates AAV trajectory planning as a multi-objective partially observable Markov decision process (POMDP) that jointly optimizes age of information (AoI), energy consumption, and coverage ratio. We introduce a graph encoder that enables structural reasoning over heterogeneous random topologies and supports generalization to unseen deployments. Built upon temporal difference learning for model predictive control v2 (TDMPC2), a world-model-based deep reinforcement learning (DRL) algorithm, we develop TDMPC2-Graph (TDMPC2-G), which executes multi-step predictive rollouts to improve trajectory planning efficiency and quality. Simulation results show that model-free baselines SAC and TD3 fail to learn effective policies in this challenging setting, whereas TDMPC2-G demonstrates robust performance across all prior information levels. Compared to exhaustive coverage strategies, TDMPC2-G reduces terminal AoI by $10- -14\%$ , while maintaining comparable energy consumption and coverage ratios, thereby validating its robustness across structurally heterogeneous random topologies.
A physics-prior-driven decentralized deep reinforcement learning (DRL) framework Functioning as a scalable distributed computing paradigm via decentralized training with decentralized execution (DTDE), the framework mitigates the curse of dimensionality.
Jian-Hua Liu, Hai-Tao Zhou, Jia-Jia Liu et al.· Journal of Supercomputing· 0 citations
MA-PMBRL, a novel Multi-Agent Pessimistic Model-Based Reinforcement Learning framework for CAVs, incorporating a max-min optimization approach to enhance robustness and decision-making is proposed, demonstrating that the proposed framework represents a significant step toward scalable, efficient, and reliable multi-age...
Ruo-Qi Wen, Rong-Peng Li, Xing Xu et al.· IEEE Transactions on Mobile...· 1 citation
UAVs have emerged as highly flexible platforms for data sensing in Wireless Sensor Networks (WSNs). Path planning for UAVs in such tasks plays a key role to assure remote sensing effectiveness and friendly energy consumption. However, existing approaches show two key limitations: i) they are primarily hand-crafted with...
Si-Jie Ma, Ze-Yuan Ma, Wei-Jia Cao et al.· 1 citation
Underwater wireless sensor networks form the foundation of the marine Internet of Things, but timely data delivery remains challenging in deep and remote deployments. Although AUV-assisted data collection reduces reliance on energy-constrained multi-hop acoustic relays, slow vehicle mobility and repeated surfacing for...
Yu-Hui Han, Peng Jin, Xiao Huang et al.· IEEE Transactions on Cogniti...· 0 citations
This paper investigates an energy efficiency maximization problem in a UAV-assisted WPCN by jointly optimizing the UAV trajectory, hovering altitude, and hybrid TDMA/NOMA resource allocation and proposes a deep reinforcement learning-driven Hierarchical Energy-Efficient Data Collection scheme, which is named DRL-HEEC.
Si-Liang Gong, Kai-Yang Qu, Qi-Sen Wang et al.· Electronics· 0 citations
Uncrewed aerial vehicle (UAV)-assisted networks provide a versatile paradigm for on-demand connectivity. However, in multi-operator aerial networks (MOANs), the joint optimization of cooperative resource sharing and 3D trajectory control to maintain information freshness is a complex combinatorial problem, which can be...
Atefeh Hajijamali Arani, M. Shirvanimoghaddam, A. Mehbodniya et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.