Skip to content

Beyond Safety: An Attention-Based Subjective--Objective Mapping Model for Autonomous Driving Intelligence Evaluation

Aug 2026 · IEEE transactions on intelligent transportation systems (Print) · Vol 27, pp. 10353-10360 · 0 citations · 52 references
Computer Science

Abstract

As autonomous driving systems advance beyond Level 3, traditional unidimensional evaluation methodologies are proving insufficient. A critical need exists for a reliable and trustworthy evaluation framework that aligns with human subjective judgment. Current approaches, however, often lack consensus on the relative importance of key performance dimensions and fail to capture how these evaluation priorities shift under varying scenario complexities. To address these gaps, a novel human-centered autonomous driving intelligence evaluation model, termed the Subjective-Objective Mapping Model (SOMM), is proposed. An evaluation index system is first established through the Delphi method, comprising five performance dimensions (safety, efficiency, comfort, regulatory compliance, traffic coordination) and one scenario dimension (scenario complexity). The SOMM is developed to map objective vehicle metrics onto subjective evaluation scores, demonstrating high predictive accuracy. Weight analysis quantifies the relative importance of performance dimensions, identifying safety and efficiency as the dominant factors in overall intelligence. Furthermore, a sensitivity analysis confirms that evaluation priorities are highly dynamic and scenario-dependent, shifting from traffic coordination and compliance in simple scenarios to safety and efficiency in complex environments. The proposed SOMM provides an accurate, interpretable, and dynamic evaluation framework that effectively quantifies autonomous driving intelligence by aligning it with human-centered criteria.

View source

Similar papers

May 2025

Behavioral Safety Assessment towards Large-scale Deployment of Autonomous Vehicles

Autonomous vehicles (AVs) have significantly advanced in real-world deployment in recent years, yet safety continues to be a critical barrier to widespread adoption. Traditional functional safety approaches, which primarily verify the reliability, robustness, and adequacy of AV hardware and software systems from a vehi...

Henry X. Liu, Xin-Tao Yan, Hao-Wei Sun et al. · 6 citations
Preprint Sep 2026

From Proxy Learning to Driving Decisions: A Transfer-Based Framework for Evaluating Future-Aware Autonomous Driving Planners

The Proxy-to-Decision Transfer (PDT) Framework is proposed, an analysis framework that evaluates when learned future information supports a reliable driving-performance improvement claim, and identifies where decision transfer fails or remains indeterminate across proxy, subset, aggregate, and selection evidence.

Yi-Kai Wu · 0 citations
Conference Sep 2026

Safety risk assessment of human–vehicle collaboration in advanced driver assistance systems based on AHP-ANN

Advanced Driver Assistance Systems (ADAS) play an increasingly important role in intelligent transportation systems. However, under partial automation conditions, the safety of human–vehicle collaboration is jointly influenced by system perception, driver behavior, vehicle execution, and road environment. Traditional A...

Ying Wang, Yong-Lai Lu, Jia-Jian Wang · 0 citations
Review Sep 2026

Passenger comfort in autonomous vehicles: a comprehensive review of influencing factors, assessment methods, and enhancement strategies.

This review examines factors, methodologies, and evaluation techniques for passenger comfort in autonomous vehicles (AVs). Current research in this area is often fragmented and inappropriately extrapolates methodologies from traditional vehicle studies without accounting for the unique constraints of driverless travel,...

Liu Yang, Xin Zhang, Hui Zhang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Towards Safer Autonomous Driving in an Open World: A Dual-Process Approach

Before autonomous driving systems can be deployed on public roads, it is vital that these systems comply with safety standards, traffic rules, and social norms. Although neural networks trained on large amounts of driving data perform well in routine driving tasks, these models often struggle in novel situations that a...

Simon Janssen, Michiel Braat, C. van der Ploeg et al. · 0 citations
Conference Aug 2026

A Review of Scenario Complexity Assessment for Automated Vehicles

As automated vehicles (AVs) transition towards Levels 3 and 4 of automation, their Operational Design Domain (ODD) inevitably expands. Consequently, the assessment of scenario complexity has emerged as a critical prerequisite for delineating the performance boundaries of AVs, facilitating critical functions such as eme...

Zi-Yang Wang, Chen Chen · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.