Autonomous Stable Hovering Control of Remotely Operated Vehicle Via Wave-Disturbance Preview-Enhanced Reinforcement Learning
Abstract
To address the fixed-point hovering problem of a Remotely Operated Vehicle (ROV) near the free surface under significant wave conditions, this paper proposes a disturbance-rejection control framework that integrates wavedisturbance preview with reinforcement learning. Exploiting the deterministic propagation and dispersion properties of irregular waves, the Deterministic Sea Wave Prediction (DSWP) is employed to infer a future disturbance sequence at the ROV location from upstream wave-elevation measurements. Furthermore, using group-velocity bounds of the principal energy band in the wave spectrum, an Effective Preview Window (EPW) is deterministically computed to retain physically credible segments of the prediction and discard unreliable long-horizon parts distorted by dispersion. To avoid the dimensionality explosion and training instability caused by directly concatenating long disturbance sequences, an in-window exponentially weighted aggregation and a lowdimensional feature compression mechanism are designed, converting the future disturbance preview into an interpretable, low-dimensional input that enhances the policy's feedforward disturbance-rejection capability. A 2D hovering scenario (surge-heave-pitch) is built with JONSWAPspectrum-driven waves and Morison-equation-based load modeling, and the proposed method is systematically compared against no-preview RL, full-sequence-preview RL, and a PID baseline across multiple sea states ($H_{s}=0.20$ and 0.40 m). The results show that the EPW-based compressed preview significantly improves hovering accuracy and robustness.