Skip to content
Log in

Multi-Intersection Traffic Signal Control Based on Multi-agent Reinforcement Learning: A Cooperative Approach

T. Haddad
Aug 2026 · Transportation Research Record · 0 citations · 27 references

TL;DR

A novel cooperative MARL-based approach for adaptive traffic signal control in multi-intersection networks that significantly outperforms existing methods in relation to average pheromone intensity, average noise emission, and average waiting time is proposed.

Abstract

Adaptive traffic signal control has been widely investigated for several decades as an effective solution to mitigate urban traffic congestion. Recently, Multi-agent Reinforcement Learning (MARL) has emerged as a promising approach for optimizing traffic signal control in complex urban networks. However, the decision-making process becomes significantly more challenging in dynamic traffic environments involving multiple interconnected intersections. In such settings, effectively coordinating traffic signals using information collected from the Internet of Things remains a major challenge for improving the overall efficiency of road networks. Despite recent advances, existing MARL-based approaches still exhibit several limitations. First, many methods struggle to effectively integrate heterogeneous traffic information from complex traffic environments. Second, they often neglect the correlations among agents and fail to adequately capture the spatial–temporal dependencies between neighboring intersections. To address these challenges, this paper proposes a novel cooperative MARL-based approach for adaptive traffic signal control in multi-intersection networks. The proposed framework employs double deep Q-network architecture for each agent and introduces a cooperation mechanism that enables agents to share aggregated traffic information from neighboring intersections. Furthermore, a pheromone-based state representation is incorporated to model the collective traffic conditions and enhance coordination among agents. Extensive experiments conducted under different traffic scenarios demonstrate that the proposed approach significantly outperforms existing methods in relation to average pheromone intensity, average noise emission, and average waiting time. These results highlight the effectiveness of the proposed cooperative MARL framework in improving traffic efficiency and reducing congestion in multi-intersection urban traffic networks.

DOI Semantic Scholar
View source

Similar papers

Review Open access Aug 2026

Reinforcement learning for traffic signal control in large-scale transportation networks: a systematic literature review

Effective Traffic Signal Control (TSC) in large-scale transportation networks is essential for enhancing urban mobility, reducing congestion, and improving safety. However, traditional control methods often fail to effectively address the complexity, dynamic conditions, and multimodal demands of modern urban traffic systems. In recent years, Reinforcement Learning (RL) has emerged as a promising solution for achieving adaptive and scalable TSC. This paper presents a systematic and up-to-date review of RL-based methods for large-scale TSC. We analyze representative studies published between 2013 and 2025, presenting a comprehensive analysis of traffic simulation environments, transportation modalities, and advances in methodologies. Key aspects include multi-agent paradigms, state and action representations, reward mechanisms, RL frameworks, as well as advanced representation learning and cooperative strategies for large-scale transportation networks. We also provide a critical discussion on performance evaluation and opportunities for improvement, and conclude by summarizing the current challenges and outlining future research directions. This review aims to inform and guide the development of next-generation RL-based TSC systems that promote sustainable, safe, and efficient urban transportation.

Xiaocai Zhang, Zhe Xiao, Tao Liu et al. · 0 citations
Open access Aug 2026

Deep reinforcement learning-based traffic signal control in multi-intersection environments: a comparative study of DQN variants

The findings demonstrate the potential of DRL-based traffic signal control in controlled simulation conditions and highlight that algorithm performance is strongly influenced by traffic policy design and environmental complexity.

D. Prastiyanto, A. A. Manaf, Muhammad Ahnaf Maulana et al. · 0 citations
Open access Aug 2026

Optimizing Traffic Signal Control Using Reinforcement Learning Methods: Hybrid Approach

Urban traffic congestion remains a major challenge for modern cities, requiring intelligent traffic signal control (TSC) strategies capable of adapting to dynamic traffic conditions. This paper proposes a hybrid reinforcement learning approach for traffic signal control that combines the complementary learning mechanisms of Q-learning, SARSA, and Monte Carlo algorithms to improve both learning efficiency and control performance. The proposed approach is implemented and evaluated using the Simulation of Urban MObility (SUMO) simulator on a realistic road network corresponding to the “Route de Sefrou” in Fez, Morocco. The traffic signal controller is trained through continuous interaction with the simulated environment and compared with the three individual reinforcement learning algorithms under identical experimental conditions. The experimental results demonstrate that the proposed hybrid approach provides more efficient traffic management, faster convergence, and greater learning stability than the individual algorithms. These findings demonstrate the potential of hybrid reinforcement learning as an effective solution for adaptive traffic signal control in realistic urban environments.

Azzeddine Ben Moussa, A. Khazari · 0 citations