Experiments show improved depth accuracy and temporal consistency over scale-only calibration, demonstrating how localization geometry can support both pose recovery and dense robot perception.
Abstract
Render--match--PnP relocalization establishes correspondences between query image pixels and 3D map points for camera pose recovery, but their potential to support dense depth estimation is often overlooked. To exploit this geometric information, we present RIDE, which estimates dense metric depth from a robot's RGB stream. Given a metrically scaled 3D Gaussian Splatting (3DGS) model, RIDE combines sparse metric depth observations derived from PnP-RANSAC inlier correspondences with the geometric prior of a pretrained video-depth model. To handle uneven and intermittent observations, it integrates global and local depth correction with temporal memory, supporting depth estimation through short observation gaps after metric scale initialization. Trained on public RGB-D videos, RIDE is evaluated on robot sequences without fine tuning. Experiments show improved depth accuracy and temporal consistency over scale-only calibration, demonstrating how localization geometry can support both pose recovery and dense robot perception.
Event cameras hold excellent dynamic properties, showing great potential for monocular depth estimation (MDE). However, existing methods mainly improve performance by optimizing contextual features, but still struggle with the ill-posed and nonlinear nature of direct full-depth regression. In this paper, we propose Hyp...
GeoWeaver, a unified framework comprising a Geometric Prior Model (GPM) and Test-Time Adaptation (TTA) and a robust CDF-style objective jointly optimizes weighted 2D reprojection and 3D consistency residuals, is presented.
Tinghao Jiang, Sheng Tang, Shengzhe Wei et al.· 0 citations
Robot manipulation models primarily reason from 2D observations while acting in the 3D physical world. To bridge this gap, recent work has augmented robot data with geometric priors such as depth, point clouds, and 3D trajectories, while renderable 3D Gaussian representations provide another promising form of 3D superv...
DUDG-SLAM is proposed, a Dynamic Replay and Depth-Uncertainty-Guided Gaussian SLAM framework that selectively replays historical keyframes according to reconstruction error, forgetting degree, and Gaussian visibility, thereby restoring supervision in previously reconstructed regions.
Jing-Wen Liu, Tao Zuo, Ai-Bo Tian et al.· Italian National Conference...· 0 citations
Reliable 3D spatial understanding is essential for autonomous navigation, obstacle avoidance, and scene reconstruction. While state-of-the-art learned depth estimation techniques achieve high accuracy in-distribution, they often generalize poorly to novel viewpoints and altitudes. This paper presents a geometrically de...
Diksha Aggarwal, Rutvik Dagadkhair, Sanjana Srivastava et al.· 0 citations
Monocular Gaussian SLAM must recover camera motion, surface structure, and appearance from an RGB sequence without metric depth input or benchmark geometry during reconstruction. This setting is challenged by scale-ambiguous predictions, spatially varying reliability, and the tendency of an unconstrained Gaussian map t...
