Skip to content

Topology-Adaptive World-Model DRL for AAV Data Collection With Incomplete Information

2026 · IEEE Transactions on Cognitive Communications and Networking · Vol 12, pp. 12005-12020 · 0 citations · 43 references

Abstract

Autonomous aerial vehicle (AAV)-assisted data collection in wireless sensor networks (WSNs) is challenging under uncertain topology and limited prior information. This paper investigates such scenarios and formulates AAV trajectory planning as a multi-objective partially observable Markov decision process (POMDP) that jointly optimizes age of information (AoI), energy consumption, and coverage ratio. We introduce a graph encoder that enables structural reasoning over heterogeneous random topologies and supports generalization to unseen deployments. Built upon temporal difference learning for model predictive control v2 (TDMPC2), a world-model-based deep reinforcement learning (DRL) algorithm, we develop TDMPC2-Graph (TDMPC2-G), which executes multi-step predictive rollouts to improve trajectory planning efficiency and quality. Simulation results show that model-free baselines SAC and TD3 fail to learn effective policies in this challenging setting, whereas TDMPC2-G demonstrates robust performance across all prior information levels. Compared to exhaustive coverage strategies, TDMPC2-G reduces terminal AoI by $10- -14\%$ , while maintaining comparable energy consumption and coverage ratios, thereby validating its robustness across structurally heterogeneous random topologies.

View source

Similar papers

Physics-prior-driven distributed deep reinforcement learning for multi-UAV path planning

A physics-prior-driven decentralized deep reinforcement learning (DRL) framework Functioning as a scalable distributed computing paradigm via decentralized training with decentralized execution (DTDE), the framework mitigates the curse of dimensionality.

Jian-Hua Liu, Hai-Tao Zhou, Jia-Jia Liu et al. · 0 citations
Open access Mar 2025

Multi-Agent Uncertainty-Aware Pessimistic Model-Based Reinforcement Learning for Connected Autonomous Vehicles

MA-PMBRL, a novel Multi-Agent Pessimistic Model-Based Reinforcement Learning framework for CAVs, incorporating a max-min optimization approach to enhance robustness and decision-making is proposed, demonstrating that the proposed framework represents a significant step toward scalable, efficient, and reliable multi-age...

Ruo-Qi Wen, Rong-Peng Li, Xing Xu et al. · 1 citation
Preprint Sep 2026

Learning to Optimize UAV Path Planning for Data Sensing in Wireless Sensor Networks

UAVs have emerged as highly flexible platforms for data sensing in Wireless Sensor Networks (WSNs). Path planning for UAVs in such tasks plays a key role to assure remote sensing effectiveness and friendly energy consumption. However, existing approaches show two key limitations: i) they are primarily hand-crafted with...

Si-Jie Ma, Ze-Yuan Ma, Wei-Jia Cao et al. · 1 citation
2026

Hierarchical Multi-Agent Reinforcement Learning for Networked Multi-AUV Data Collection in UWSNs

Underwater wireless sensor networks form the foundation of the marine Internet of Things, but timely data delivery remains challenging in deep and remote deployments. Although AUV-assisted data collection reduces reliance on energy-constrained multi-hop acoustic relays, slow vehicle mobility and repeated surfacing for...

Yu-Hui Han, Peng Jin, Xiao Huang et al. · 0 citations
Open access Sep 2026

Joint Trajectory Design and Resource Allocation for QoS-Aware Emergency Data Collection in UAV-Assisted WPCNs: A Hierarchical DRL Approach

This paper investigates an energy efficiency maximization problem in a UAV-assisted WPCN by jointly optimizing the UAV trajectory, hovering altitude, and hybrid TDMA/NOMA resource allocation and proposes a deep reinforcement learning-driven Hierarchical Energy-Efficient Data Collection scheme, which is named DRL-HEEC.

Si-Liang Gong, Kai-Yang Qu, Qi-Sen Wang et al. · 0 citations
Preprint Sep 2026

AoI-Driven Hierarchical Learning for Cooperative Resource Sharing in Multi-Operator UAV Networks

Uncrewed aerial vehicle (UAV)-assisted networks provide a versatile paradigm for on-demand connectivity. However, in multi-operator aerial networks (MOANs), the joint optimization of cooperative resource sharing and 3D trajectory control to maintain information freshness is a complex combinatorial problem, which can be...

Atefeh Hajijamali Arani, M. Shirvanimoghaddam, A. Mehbodniya et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.