Aug 2026· Proceedings of the Institution of mechanical engineers. Part C, journal of mechanical engineering science· 0 citations· 22 references
TL;DR
A novel hierarchical decision-making and planning framework is presented, underpinned by a Spatiotemporal Attention Mechanism that adaptively weights and integrates macro-scale traffic flow information with micro-scale vehicle kinematics, offering a transparent and robust solution for intelligent vehicle decision-making in collaborative vehicle-road-cloud ecosystems.
Abstract
The operational efficacy of Connected and Automated Vehicles (CAVs) in mixed traffic flows critically depends on advanced decision-making systems capable of synthesizing high-dimensional environmental states. To address the limitations of existing methods in dynamically fusing lane-level traffic dynamics with vehicle-level interaction features, we present a novel hierarchical decision-making and planning framework. The framework is underpinned by a Spatiotemporal Attention Mechanism (STAM) that adaptively weights and integrates macro-scale traffic flow information with micro-scale vehicle kinematics. We trained a Deep Deterministic Policy Gradient (DDPG) agent as a high-level planner to generate cooperative lane-changing strategies, using multi-objective reward optimization. In a simulated highway scenario with 190 human-driven vehicles and 10 CAVs under varying penetration rates, results demonstrate that the proposed system effectively enhances mixed-traffic performance: under low CAV penetration (5%), ineffective lane-change maneuvers are reduced by up to 85.7%, while at medium-to-high penetration rates (30%–50%), cooperative interactions increase by a factor of up to 6.2. Across multiple independent runs, the hazardous TTC proportion remains within a narrow range, indicating a stable safety margin. The STAM also provides interpretable insights into what the system focuses on, offering a transparent and robust solution for intelligent vehicle decision-making in collaborative vehicle-road-cloud ecosystems.
Simulation experiments demonstrate that the proposed joint optimization model effectively reduces delays across most movements even at low CAV penetration rates, and as the CAV penetration rate increases, consistent and more pronounced reductions in both delay and energy consumption are observed for all movements.
Findings indicate that combining learning-based decision-making with lightweight short-horizon predictive safety supervision can improve overtaking efficiency and lane-change consistency while maintaining safe vehicle interactions.
A hierarchical framework for behavior decision-making and motion planning that explicitly accounts for the dynamic balance between safety and driving efficiency is proposed, and achieves a highly comparable safety-efficiency trade-off frontier to constrained MDP benchmarks but under a single unified network framework.
Wei Liu, Yong-Qing Jia, Chu-Dong Lin et al.· Proceedings of the Instituti...· 0 citations
Connected and automated vehicle (CAV) platooning offers a promising approach to improving road safety and traffic capacity. However, platoon control in real-world traffic is challenging due to uncertainty and heterogeneous driving behaviors. Reinforcement learning (RL) has strong potential for addressing such control p...
An integrated safety-control framework that combines real-world-data-driven behavior modeling with deep reinforcement learning to design longitudinal AV control strategies for mixed traffic containing aggressive human drivers is proposed.
This study proposes a distributed traffic signal control framework built upon a Machine Learning (ML) paradigm utilizing Reinforcement Learning (RL), and demonstrates the effectiveness of the proposed approach, with vehicle queue lengths and average waiting times reduced by 35% on roads leading to the junctions, compar...
Alireza Rezaee, Amirhossein Safdari· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.