A Novel Simulation-Based Framework for Optimizing Traffic Signal Control Using Reinforcement Learning Techniques

Authors

  • Avery Young PhD
  • Kim Turner Sc.D
  • Nico Lee Associate Professor
  • Kim Baker Professor

Keywords:

Reinforcement Learning, Traffic Signal Control, Urban Mobility Optimization, Intelligent Transportation Systems, Simulation-Based Framework, Operational Efficiency, Traffic Congestion Mitigation, Adaptive Control Strategies, Machine Learning in Transportation

Abstract

Traffic congestion remains a critical issue in metropolitan areas, leading to economic inefficiencies and increased travel times. This study introduces a novel simulation-based framework that leverages reinforcement learning (RL) for optimizing traffic signal control. The empirical methodology involves the use of a custom-developed simulation environment in Python (version 3.9) with TensorFlow (version 2.3) and SimPy (version 3.0.11) libraries for modeling traffic flows. Our experiments were conducted across multiple scenarios depicting various traffic patterns and control strategies. The findings reveal a significant reduction in average vehicle delay by 25%, with a corresponding increase in intersection throughput by 18% compared to traditional traffic signal control methods. This research contributes to the ongoing discourse on intelligent transportation systems (ITS) by providing a robust tool for practitioners aiming to enhance urban mobility. Furthermore, the implementation of RL-based methods demonstrates considerable potential for real-time application, paving the way for further exploration in adaptive traffic management systems.

Author Biographies

Avery Young, PhD

PhD
Massachusetts Institute of Technology
77 Massachusetts Ave, Cambridge, MA 02139, USA

Kim Turner, Sc.D

Sc.D
Technische Universität München
Arcisstrasse 21, 80333 Munich, Germany

Nico Lee, Associate Professor

Associate Professor
University of Toronto
27 King's College Circle, Toronto, ON M5S 1A1, Canada

Kim Baker, Professor

Professor
Imperial College London
Exhibition Rd, South Kensington, London SW7 2AZ, United Kingdom

References

Pukhkal, V., Bieliatynskyi, A., & Murgul, V. (2016). Designing energy efficiency glazed structures with comfortable microclimate in northern region. Journal of Applied Engineering Science, 14(1).

Prentkovskis, O., Tretjakovas, J., Švedas, A., Bieliatynskyi, A., Daniūnas, A., & Krayushkina, K. (2012). The analysis of the deformation state of the double-wave guardrail mounted on bridges and viaducts of the motor roads in Lithuania and Ukraine. Journal of Civil Engineering and Management, 18(5), 761-771.

Pershakov, V., Bieliatynskyi, A., Popovych, I., Lysnytska, K., & Krasheninnikov, V. (2016). Progressive collapse of high-rise buildings from fire. In MATEC web of conferences (Vol. 73, p. 01001). EDP Sciences.

Yu Timkina, S., Stepanchuk, O. V., & Bieliatynskyi, A. A. (2019, December). The design of the length of the route transport stops’ landing pad on streets of the city. In IOP Conference Series: Materials Science and Engineering (Vol. 708, No. 1, p. 012032). IOP Publishing.

Bieliatynskyi, A., Osipa, L., & Kornienko, B. (2018). Water-saving processes control of an airport. In MATEC Web of Conferences (Vol. 239, p. 05003). EDP Sciences.

Published

2024-12-25

Issue

Section

Articles