Skip to content
Conference Open access

Self-Improving Autonomous Vehicles via Real-World Reinforcement Learning

Sep 2026 · Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence · 0 citations · 32 references

TL;DR

This paper introduces a novel real-world RL algorithm that allows autonomous vehicles to collect informative scenarios and learn from them with minimal human intervention, and considers the learning progress of autonomous vehicles to identify informative scenarios and abort episodes before they enter unsafe states.

Abstract

End-to-end autonomous driving systems have demonstrated advantages over traditional modular systems. Despite this progress, these end-to-end systems still struggle to be deployed in real-world driving environments, as they inevitably encounter undertrained scenarios in which autonomous vehicles may take unsafe actions. Reinforcement Learning (RL) provides a theoretical framework for addressing this challenge by enabling autonomous vehicles to self-improve: continuously collecting additional scenarios and learning from them. However, training autonomous vehicles with RL is not straightforward in the real world. Collecting real-world driving data involves costly interactions with the environment, and significant human intervention is required both to prevent autonomous vehicles from entering unsafe states and to reset them for subsequent episodes. In this paper, we introduce a novel real-world RL algorithm that allows autonomous vehicles to collect informative scenarios and learn from them with minimal human intervention. Our algorithm considers the learning progress of autonomous vehicles to identify informative scenarios and abort episodes before they enter unsafe states. To evaluate our algorithm, we introduce challenging urban driving tasks that require autonomous vehicles to reset themselves to initial states. The experimental results show that our real-world RL algorithm outperforms baselines with much less human intervention.

Read PDF

Similar papers

Preprint Sep 2026

DriveZero: End-to-End Driving Beyond Human Demonstrations

DriveZero is presented, an end-to-end system that learns driving behavior beyond human demonstrations that achieves state-of-the-art performance on NAVSIMv1, NAVSIMv2 and the closed-loop HUGSIM benchmark without any human trajectory supervision.

Hao He, Cheng-Cheng Hu, Zi-Run Su et al. · 3 citations
Sep 2026

RoXDrive: Closed-Loop Reinforcement Learning for End-to-End Autonomous Driving via Action-Faithful Rollouts

RoXDrive is introduced, a plug-and-play closed-loop RL framework that enables reliable policy optimization by identifying action-faithful world-model rollouts and an Action-Vision Faithfulness Evaluator for inverse dynamics estimation with geometry-aware auxiliary trajectory supervision, enabling long-horizon assessmen...

Hong-Bin Lin, Chao-Da Zheng, Yi-Ming Yang et al. · 1 citation
#reinforcement learning Review Open access Sep 2026

Recent Advances of Reinforcement Learning Algorithms for Autonomous Driving System

This survey examines RL-based AD in modular and end-to-end pipelines and relates reported methods to task formulation and deployment evidence and examines deployment barriers, including safety, Sim2Real generalization, data efficiency, computation, embodied alignment, and evaluation readiness.

B. Shuai, Min Hua, Le-Tian Tao et al. · 0 citations
Open access Mar 2025

Multi-Agent Uncertainty-Aware Pessimistic Model-Based Reinforcement Learning for Connected Autonomous Vehicles

MA-PMBRL, a novel Multi-Agent Pessimistic Model-Based Reinforcement Learning framework for CAVs, incorporating a max-min optimization approach to enhance robustness and decision-making is proposed, demonstrating that the proposed framework represents a significant step toward scalable, efficient, and reliable multi-age...

Ruo-Qi Wen, Rong-Peng Li, Xing Xu et al. · 1 citation
Preprint Aug 2026

Multi-Agent Orchestration with the Common-Sense Reasoning Capabilities of LLMs for Autonomous Driving

A hybrid framework uses an orchestrator to coordinate PPO-trained reinforcement learning and PID control, with LLM common-sense reasoning applied throughout the framework to demonstrate the potential of integrating LLM-based reasoning with conventional autonomous driving methods while retaining structured control and s...

Mehdi Azarafza, Faezeh Pasandideh, Ali Ehteshami Bejnordi et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.