A Hierarchical Visual Navigation Algorithm for UAVs Integrating Artificial Potential Field and Deep Reinforcement Learning
TL;DR
This paper proposes a vision-based navigation algorithm that enables efficient navigation and obstacle avoidance in dynamic environments by combining the strengths of deep reinforcement learning (DRL) and convolutional neural networks (CNNs).
Abstract
To address the challenge of rapid and precise obstacle avoidance for unmanned aerial vehicles (UAVs) in complex urban environments, rugged canyons, and other unstructured environments, this paper proposes a vision-based navigation algorithm. By combining the strengths of deep reinforcement learning (DRL) and convolutional neural networks (CNNs), this algorithm enables efficient navigation and obstacle avoidance in dynamic environments. First, to improve training efficiency, an autoencoder is used to extract latent spatial vectors from depth images, which are then used as input features for DRL. Second, an artificial potential field (APF) is introduced into the reward function to enhance obstacle avoidance performance in dynamic environments. Third, a CNN-based adaptive mode-switching mechanism is designed to meet navigation requirements under different environmental conditions. This mechanism can automatically identify environmental features based on real-time input data and dynamically adjust the UAV’s navigation strategy. To evaluate the proposed method, simulation experiments were conducted in static and dynamic scenarios, together with a preliminary indoor flight test. Under the evaluated conditions, the proposed method achieved favorable navigation success rates and path efficiency compared with the selected visual DRL baselines. The results also indicate cross-scenario transferability to the tested environments without environment-specific retraining.