S&M2827 Research Paper of Special Issue
Published in advance: January 24, 2022
Published: February 14, 2022
NCCLight: Neighborhood Cognitive Consistency for Traffic Signal Control [PDF]
Yan Kong and Shan Cong
(Received July 7, 2021; Accepted November 25, 2021)
Keywords: multi-agent reinforcement learning, traffic signal control, neighborhood cognitive consistency
Multi-agent reinforcement learning (MARL) is gradually becoming an attractive research field of adaptive traffic signal control (ATSC). Nevertheless, in a multi-agent environment, some inherent disadvantages exist, such as the partial observability and non-stationarity caused by the constantly changing decision-making strategies of agents, which have been extensively researched but remain challenging. Herein, NCCLight, which is a fully scalable decentralized MARL model built around an independent advantage actor-critic (IA2C) under the background of ATSC, is rationally designed and validated to offer a feasible approach to realizing communication and coordination between multiple agents. In addition, guided by cognitive consistency theory, the constraint of neighborhood cognitive consistency (NCC) is constructed to achieve communication and coordination between multiple agents. More significantly, cognitive consistency theory is employed in MARL for ATSC for the first time, which is validated by a large number of experiments on both real and synthetic data. We hope that this work can serve as a pioneering reference owing to the better performance of NCCLight than of the most advanced ATSC based on MARL.Corresponding author: Yan Kong
This work is licensed under a Creative Commons Attribution 4.0 International License.
Cite this article
Yan Kong and Shan Cong, NCCLight: Neighborhood Cognitive Consistency for Traffic Signal Control, Sens. Mater., Vol. 34, No. 2, 2022, p. 545-562.