Skip to content

GD-OCC: Geometry-Driven 3D Occupancy Prediction With Integrated View Transformation and Sparse Representation

2026 · IEEE Transactions on Automation Science and Engineering · Vol 23, pp. 16512-16524 · 0 citations · 53 references

Abstract

3D occupancy prediction involves estimating the spatial structure and occupancy state of each voxel within a scene. Vision-centric approaches have attracted increasing attention for their cost-effectiveness and ease of deployment. However, a key challenge remains in accurately inferring the 3D scene structure from planar view information, primarily due to the difficulties in precise depth modeling during view transformation and the neglect of geometric sparsity in dense occupancy representations. To overcome the above challenges, a novel geometry-driven framework for occupancy prediction (GD-OCC) is proposed. A geometry-driven view transformation module is introduced, which integrates geometric cues into both explicit transformation and voxel-based implicit view transformation, thereby enhancing the quality of occupancy features. This design enables geometry-consistent 3D structure recovery of a scene from multi-view 2D images. Furthermore, a geometry-guided sparse voxel proposal strategy is presented to directly retain potentially non-empty voxels, facilitating a sparse occupancy representation with improved geometric fidelity. The effectiveness of our proposed GD-OCC is demonstrated through extensive experiments on the Occ3D-nuScenes dataset, achieving a RayIoU of 37.9% and outperforming existing methods, with particularly strong performance in long-tail scenarios. The code and models are available on github. Note to Practitioners—Accurate 3D scene perception is critical for autonomous vehicles, mobile robots, and other automation systems. Traditional camera-based methods are often affected by depth errors during view transformation and redundant voxels, limiting reliability and robustness. GD-OCC integrates geometric information into view transformation and focuses on potentially non-empty voxels, effectively improving perception accuracy, reducing unnecessary computation, and enhancing safe navigation and environment understanding. The method relies on multi-view images but can be easily extended to multi-sensor systems. Other potential applications include warehouse automation, robotic inspection, infrastructure monitoring, construction site management, and any automation tasks requiring reliable and efficient 3D environment modeling.

View source

Similar papers

Preprint Sep 2026

Planning Oriented 3D Scene Completion via Coupled TUDF Occupancy Representation Learning from Partial Observations

Partial observability remains a fundamental challenge in robotic navigation, where limited sensor coverage and occlusions leave large portions of the environment unobserved. Existing scene completion methods primarily focus on improving incomplete mapping or reconstructing partially observed 3D structures, but rarely i...

Tian-You Yu, Peng-Fei Zhao, Chao Xu · 0 citations
Preprint Oct 2026

SelectOccFlow: Selective Spatiotemporal Aggregation for 3D Occupancy and Scene Flow Prediction

Comprehensive 3D scene understanding for autonomous driving requires modeling geometry, semantics, and motion. However, camera-based occupancy and scene flow prediction are sensitive to unreliable spatial and temporal aggregation, caused by semantically incompatible image features, misaligned historical observations, a...

Yu-Hang Wang, Kai Luo, Yuan-Fan Zheng et al. · 0 citations
Preprint Aug 2026

Geometry-Grounded Unified 3D Perception for Autonomous Driving

A Geometry-grounded Unified 3D Perception (GeoUP) framework that adapts the reconstruction-oriented latent of VGGT to calibrated, streaming multi-camera driving scenes and achieves SOTA performance across detection, occupancy, and depth estimation is presented.

Longfei Xu, Xiao-Hui Wang, Ze-Hao Huang et al. · 2 citations
Preprint Aug 2026

OccAnyScene: Towards Unified Indoor-Outdoor 3D Occupancy Prediction

OccAnyScene is proposed, a pixel-frustum-centered Gaussian framework built upon a pretrained depth foundation model which employs Pixel-Aligned Frustum Feature Aggregation to construct a camera-aware frustum query for each feature pixel, and Frustum-Parameterized Gaussian Construction to decode each query into multiple...

Junjie Liu, Wan-Shui Gan, Zi-Tong Dai et al. · 0 citations
Preprint Sep 2026

AdaOcc: Adaptive 3D Occupancy Prediction for Embodied Tasks

Embodied tasks demand accurate, flexible, and semantically rich 3D scene representations. 3D semantic occupancy is well suited to this requirement, as it can model holistic 3D spaces by encoding geometric occupancy along with semantic categories. However, existing occupancy prediction methods struggle to meet practical...

Jing-Long Wang, Yun-Jie Wang, Zhi-Yang Zhang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.