HESVI: Event-Based Stereo Visual–Inertial SLAM with Hybrid Marginalization and Adaptive Heterogeneous Kernel for UAV Remote-Sensing Applications

Abstract

Unmanned aerial vehicles (UAVs) have become essential platforms for remote sensing in challenging environments such as high-dynamic-range (HDR) scenes and low-texture areas. However, conventional frame-based visual–inertial simultaneous localization and mapping (SLAM) systems often suffer from motion blur and overexposure during high-speed UAV flight, leading to state estimation failure. To address numerical instability in marginalization, weak scene adaptability, and insufficient outlier suppression in event-based stereo visual–inertial SLAM systems for aerial applications, we propose HESVI, a hybrid marginalization and adaptive heterogeneous kernel state estimation method for UAV remote sensing. Our method first establishes a focal-length-driven cross-modal inverse depth consistency constraint to couple image and event inverse depths, providing high-quality priors for optimization. Such lightweight prior generation is designed with the limited onboard computing resources of UAV platforms in mind. A hybrid marginalization strategy is then introduced, employing block-parallel tall–skinny QR (TSQR) acceleration based on Householder reflections alongside dynamic Tikhonov regularization and first-estimates Jacobian (FEJ) linearization to balance computational efficiency and numerical stability. Furthermore, an adaptive heterogeneous Cauchy kernel maps differentiated thresholds to image and event features according to their average effective tracking lengths, enabling dynamic outlier suppression. Experiments on the VECtor, MVSEC, and HKU datasets demonstrate that HESVI achieves the best absolute trajectory error (ATE) on the vast majority of the evaluated sequences, with average ATE reductions of 47.2%, 41.2%, and 26.8% over PL-EVIO, ESIO, and ESVIO, where each average is computed only over the sequences on which the corresponding baseline runs successfully. The method also exhibits excellent performance in complex remote-sensing scenarios and generalization tests. HESVI effectively enhances the numerical stability, scene adaptability, and localization accuracy of event-based stereo visual–inertial SLAM systems in challenging UAV remote-sensing environments.