Sep 2026· International Conference on Aerospace Electronics Information and Intelligent Systems· Vol 14356, pp. 143560D - 143560D-6· 0 citations· 16 references
Engineering
TL;DR
An improved deep Q-network (DQN) algorithm is proposed, introducing a priority experience replay mechanism to improve sample utilization, and designing a composite reward function including arrival reward, step penalty, direction guidance, and safety penalty to guide the UAV to plan safe and efficient flight paths in complex urban environments.
Abstract
Urban fire rescue poses severe challenges to the real-time performance and obstacle avoidance capabilities of unmanned aerial vehicle (UAV) path planning. Existing methods (such as A*, RRT, and standard DQN) have problems such as low search efficiency, insufficient obstacle avoidance ability, or slow convergence in complex environments. This paper proposes an improved deep Q-network (DQN) algorithm, introducing a priority experience replay mechanism to improve sample utilization, and designing a composite reward function including arrival reward, step penalty, direction guidance, and safety penalty to guide the UAV to plan safe and efficient flight paths in complex urban environments. A threedimensional grid simulation environment was constructed based on the real fire incident at Chongqing California Garden. Experimental results show that the improved DQN algorithm outperforms the traditional DQN and RRT algorithms. This method provides a feasible technical solution for multi-UAV collaborative rescue in urban fire scenarios.
Simulation experiments show that in a complex obstacle environment of 100m × 100m× 100m, the IAGA algorithm can effectively plan the optimal path, and the convergence speed is significantly improved compared to traditional genetic algorithms, verifying the effectiveness and robustness of this method in handling multi-c...
Qian Wan, Tian-En Lu, Liquan Huang et al.· International Conference on...· 0 citations
The Personal History Memory Mechanism is introduced, which replaces random perturbation with weighted historical experience to enhance the directional search capability of the algorithm, and a greedy selection strategy is embedded to ensure the monotonically non-deteriorating quality of population solutions.
This paper develops a hybrid path-planning method, rapidly-exploring random tree star (RRT*)-deep Q-network (DQN), which combines the fast global search capability of RRT* with the deep learning-based heuristic prediction of a DQN.
Abhishek Bajpai, Abhinav, N. Tiwari· Engineering Research Express· 0 citations
A dynamic path planning method for low-altitude Unmanned Aerial Vehicles (UAVs) tailored for urban inspection missions and constrains the average response latency for high-priority emergency tasks to within 40 s even under 50 concurrent dynamic tasks is proposed.
Changqi Yang, Hongjie Hu, Yi Ai· Drones· 0 citations
UAV path planning is a crucial component of autonomous navigation and logistics delivery, and its performance directly affects both operational safety and efficiency. However, the standard A* algorithm often suffers from redundant node expansions and limited path smoothness in cluttered environments, which constrains r...
Duo Ding, Da-Long Liu· Journal of Physics, Conferen...· 0 citations
Simulation results demonstrate that, compared to traditional methods, GS-MADDPG improves the navigation success rate, robustness, and generalization performance, and verifies its effectiveness in multi-UAV cooperative navigation for search and rescue tasks.
Li Tan, Hai-Xia Zhao, Jia-Qin Chai et al.· Unmanned Systems· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.