Skip to content

A DDPG-Based Offline–Online Joint Optimization Framework for RIS-Assisted UAV-Enabled ISEC in Dynamic Vehicular Networks

2026 · IEEE Transactions on Communications · Vol 74, pp. 13930-13945 · 0 citations · 40 references

Abstract

Intelligent transportation systems face dual challenges in achieving efficient synergy between sensing and edge computing, arising from dynamic environments and unstable communication channels. Unlike existing approaches that rely on perfect channel state information (CSI) or assume static environments, this paper proposes a deep deterministic policy gradient (DDPG)-based offline-online joint optimization (OOJO) framework for trajectory optimization and resource allocation in a reconfigurable intelligent surface-assisted unmanned aerial vehicle (UAV) integrated sensing and edge computation system. Imperfect CSI and highly dynamic vehicle mobility are explicitly modeled, formulating a mixed-integer non-convex problem to minimize the total sum of the maximum end-to-end latency across all UAVs. The proposed centralized single-agent OOJO framework employs an actor-critic network to output continuous control actions, enabling closed-loop optimization from sensing to scheduling. During offline learning, general policies are learned from historical data; during online learning, strategies are rapidly adapted to dynamic environmental changes. Simulation results show that the proposed DDPG algorithm outperforms the Deep Q-Network by 21.2% while maintaining low latency across varying vehicle speeds and imperfect CSI, validating its practicality and efficiency in complex dynamic traffic scenarios.

View source

Similar papers

#edge computing Open access Aug 2026

Collaborative resource allocation in UAV-assisted MEC networks: A heterogeneous MAPPO scheme

This paper proposes a heterogeneous multi-agent proximal policy optimization (MAPPO)-based framework where both user devices and UAVs act as heterogeneous agents and utilizes a centralized training and decentralized execution (CTDE) paradigm to enable collaborative strategies between computing requesters and providers.

Ming Cheng, Canlin Zhu, Jian-Hang Tang et al. · 0 citations
Preprint Aug 2026

AERIS: Offline Policy Improvement for Multi-UAV Integrated Sensing and Communication

This paper proposes AERIS, an offline policy improvement framework for multi-UAV ISAC that learns from fixed flight logs under centralized training and decentralized execution and designs STAR-CRDT, an offline multi-agent RL algorithm that performs support-aware local action rectification and distills only trusted impr...

Ziyuan Wang, Yi-Fan Sui, Wei Wei et al. · 0 citations
Open access Sep 2026

Joint Trajectory Design and Resource Allocation for QoS-Aware Emergency Data Collection in UAV-Assisted WPCNs: A Hierarchical DRL Approach

This paper investigates an energy efficiency maximization problem in a UAV-assisted WPCN by jointly optimizing the UAV trajectory, hovering altitude, and hybrid TDMA/NOMA resource allocation and proposes a deep reinforcement learning-driven Hierarchical Energy-Efficient Data Collection scheme, which is named DRL-HEEC.

Si-Liang Gong, Kai-Yang Qu, Qi-Sen Wang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.