Skip to content
Review Open access

Bird’s-Eye-View Road Occupancy Prediction for Autonomous Driving: A Survey of Representations, Methods, and Benchmarks

Jul 2026 · Mathematics · Vol 14, pp. 2720 · 0 citations · 11 references

TL;DR

The intent is to bridge the historically separate BEV-segmentation and 3D-occupancy literatures within a single taxonomy and identify open problems in label efficiency, robustness, temporal forecasting, and deployment.

Abstract

Bird’s-eye-view (BEV) perception has become the dominant paradigm for camera-centric scene understanding in autonomous driving, as well as road occupancy prediction, which involves the dense estimation of which regions of space are occupied and by what has emerged as its most expressive form. Between 2020 and 2026, the field underwent three overlapping transitions: from two-dimensional BEV semantic map segmentation to dense three-dimensional voxel-based 3D semantic occupancy, catalyzed by the 2022 industrial adoption of “occupancy networks,” and, most recently, to efficient, generative, and four-dimensional forecasting formulations. This survey organizes the literature along six orthogonal axes output representation, view-transformation mechanism, input modality, supervision paradigm, temporal scope, and efficiency strategy and uses the representation lineage as a primary spine connecting the 2020 BEV-segmentation works to the 2026 Gaussian and 4D frontier. Alongside the ego-centric mainstream, we review the parallel multi-view and infrastructure-side lineage from multi-view pedestrian occupancy to roadside traffic occupancy, which shares the BEV occupancy-map output and contributes generalization tools the ego-centric thread has yet to absorb. We review the canonical methods at each stage, summarize the standard datasets (CARLA, GMVD, MultiviewX, WildTrack, nuScenes, SemanticKITTI, Occ3D, OpenOccupancy) and evaluation metrics (MODA, mIoU, RayIoU, RayPQ), and consolidate reported results on the Occ3D-nuScenes benchmark into a single comparison. We close by identifying open problems in label efficiency, robustness, temporal forecasting, and deployment. Our intent is to bridge the historically separate BEV-segmentation and 3D-occupancy literatures within a single taxonomy.

Read PDF

Similar papers

Preprint Sep 2026

MC-DeTra: Motion-Consistent Joint Object Detection and Socially-Aware Trajectory Forecasting in Bird's-Eye-View Images

MC-DeTra improves dynamic, socially-situated trajectory forecasting while preserving or improving detection accuracy; a gradient-based loss-calibration analysis exposes how the auxiliary objectives compete at the shared backbone, and the ablation identifies which signals contribute most.

Vladislav Diuzhev, Dmitry Yudin · 0 citations
#artificial intelligence Preprint Sep 2026

Closed-Loop Evaluation of Bird's-Eye-View Maps from Cross-View Transformers as Inputs to Behavior-Cloning Policies

In autonomous driving, Bird's-Eye View (BEV) representations provide a structured, top-down abstraction of the vehicle's surroundings and have become a key input modality for Behavioral Cloning (BC) policies. While ground-truth BEV maps are readily available in simulation, real-world deployment requires replacing them...

Felipe Dos Santos, Eric A. Antonelo, Gustavo Claudio Karl Couto · 0 citations
Preprint Sep 2026

Exploring 2D backbone effects for indoor semantic occupancy prediction

The results indicate that the image backbone is not a secondary engineering detail in embodied semantic occupancy, but a major source of variation in the final 3D prediction.

Shizhang Fanga, Wanling Yea, Qi Zheng · 0 citations
Book Open access Sep 2026

Pedestrian Crossing Prediction for Automated Vehicles: A Geometry-aware Method Using Surface Normal

A geometry-aware framework that incorporates surface normal maps encoding pixel-level 3D surface orientation is proposed that incorporates surface normal maps encoding pixel-level 3D surface orientation and highlights the importance of geometry-informed features as an effective complement to conventional visual inputs.

A. Eskandari, Mahdi Rezaei, Mohsen Azarmi et al. · 0 citations
Open access Oct 2026

WalkScapes: A Pedestrian-View Urban Semantic Segmentation Dataset for Public-Space Monitoring and Autonomous Mobility

Pedestrian-level semantic segmentation supports autonomous mobility, assistive navigation, and safety-oriented perception in public spaces. However, widely used urban segmentation datasets predominantly adopt vehicle-centered viewpoints that differ from those in pedestrian environments in scene geometry, object scale,...

Kacper Chabros, Tomasz Jastrzębski, Patryk Oleś et al. · 0 citations
Open access Aug 2026

Lightweight multi task learning for joint birds eye view instance mapping and trajectory prediction

BEV-IMTP is presented, a lightweight instance mapping and trajectory prediction network designed for Bird's-Eye-View representations that achieves a 4.6% improvement in semantic map mIoU and a 1.8% gain in instance motion mIoU compared to state-of-the-art methods.

N. Harivinod, S. Abhilash, M. Muneshwara et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.