Hierarchal Clusters Based Traffic Control System | ||||
| Menoufia Journal of Electronic Engineering Research | ||||
| Article 1, Volume 29, Issue 1, January 2020, Page 1-12 PDF (1.44 MB) | ||||
| Document Type: Original Article | ||||
| DOI: 10.21608/mjeer.2020.68928 | ||||
 View on SCiNiTO | ||||
| Authors | ||||
Fady Taher* 1; Ayman EL-SAYED 2; Ahmed Shouman1; Ahmed Elmahalawy 1
| ||||
| 1Dept. of Computer Science and Eng., Faculty of Elect., Eng., Menoufia University | ||||
| 2Computer science and Engineering, Faculty of Electronic Engineering, Menoufia University, Menouf 32952, Egypt. | ||||
| Abstract | ||||
| Traffic jam is a crucial issue affecting cities around the world. They are only getting worse as the population and number of vehicles continues to increase significantly. Traffic signal controllers are considered as the most important mechanism to control the traffic, specifically at intersections, the field of Machine Learning offers more advanced techniques which can be applied to provide more flexibility and make the controllers more adaptive to the traffic state. Efficient and adaptive traffic controllers can be designed using a multi-agent reinforcement learning approach, in which, each controller is considered as an agent and is responsible for controlling traffic lights around a single junction. A major problem of reinforcement learning approach is the need for coordination between agents and exponential growth in the state-action space. This paper proposes using machine learning clustering algorithm, namely, hierarchal clustering, in order to divide the targeted network into smaller sub-networks, using real traffic data of 65 intersection of the city of Ottawa to build our simulations, the paper shows that applying the proposed methodology helped solving the curse of dimensionality problem and improved the overall network performance. | ||||
| Keywords | ||||
| Adaptive traffic signal control; Clustering; Multi-agent system; Reinforcement Learning; Simulation; Traffic controller | ||||
| References | ||||
|
[1]Kuyer, Lior, et al. "Multiagent reinforcement learning for urban traffic control using coordination graphs." Machine Learning and Knowledge Discovery in Databases. Springer Berlin Heidelberg, 2008. 656-671. [2] El-Tantawy, Samah, BaherAbdulhai, and HossamAbdelgawad. "Multiagent reinforcement learning for integrated network of adaptive traffic signal controllers (MARLIN-ATSC): methodology and large-scale application on downtown toronto." Intelligent Transportation Systems, IEEE Transactions on14.3 (2013): 1140-1150. [3] Labadie, John W. "Advances in Water Resources Systems Engineering: Applications of Machine Learning." Modern Water Resources Engineering. Humana Press, 2014. 467-523. [4] Messer, Carroll J., and Ramanan V. Nageswara. Improved Traffic Signal Coordination Strategies for Actuated Control. No. [5] Vital, Allan Saldanha, et al. "Development of Intelligenet traffic Lights using Multi Agent Systems." 12th WCTR july 11-15, 2010 lisbon, portugal [6] Almejalli, Khaled, KeshavDahal, and M. AlamgirHossain. "Intelligent traffic control decision support system." Applications of Evolutionary Computing. Springer Berlin Heidelberg, 2007. 688-701. [7] Wiering, M. (2000, June). Multi-agent reinforcement learning for traffic light control. In ICML (pp. 1151-1158). SWITCH/96/465110-1. Southwest Region University Transportation Center, Center for Transportation Research, University of Texas, 1996 [8] Cichosz, Pawel. Data Mining Algorithms: Explained Using R. John Wiley & Sons, 2015. [9] McKenney, Dave, and Tony White. "Distributed and adaptive traffic signal control within a realistic traffic simulation." Engineering Applications of Artificial Intelligence 26.1 (2013): 574-583. [10] Behrisch, Michael, et al. "SUMO–Simulation of Urban MObility." The Third International Conference on Advances in System Simulation (SIMUL 2011), Barcelona, Spain. 2011. [11] Wu, Xiaoping, et al. "Green-Wave Traffic Theory Optimization and Analysis." World Journal of Engineering and Technology 2.03 (2014): 14. [12] Tan, Ming. "Multi-agent reinforcement learning: Independent vs. cooperative agents." Proceedings of the tenth international conference on machine learning. 1993. [13] Jain, Anil K., and Richard C. Dubes. Algorithms for clustering data. Prentice-Hall, Inc., 1988. [14] Jain, Anil K., M. NarasimhaMurty, and Patrick J. Flynn. "Data clustering: a review." ACM computing surveys (CSUR) 31.3 (1999): 264-323. [15] Carbonell, Jaime G., Ryszard S. Michalski, and Tom M. Mitchell. "An overview of machine learning." Machine learning. Springer Berlin Heidelberg, 1983. 3-23. [16] Whitehead, Steven D. "A Complexity Analysis of Cooperative Mechanisms in Reinforcement Learning." AAAI. 1991. [17] Balaji, P. G., X. German, and D. Srinivasan. "Urban traffic signal control using reinforcement learning agents." IET Intelligent Transport Systems 4.3 (2010): 177-188. [18] OpenStreetMap, February2011. /http://www.openstreetmap.orgS. [19] Comparing different techniques for controlling traffic signals vol 7 No.3 2016 [20] Mousavi, SeyedSajad, et al. "Traffic Light Control Using Deep Policy-Gradient and Value-Function Based Reinforcement Learning." arXiv preprint arXiv:1704.08883 (2017). [21] Watkins, Christopher JCH, and Peter Dayan. "Qlearning." Machine learning 8, no. 3-4 (1992): 279-292. [22] Sutton, Richard S., and Andrew G. Barto. Reinforcement learning: An introduction. MIT press, 1998. [23] García-Nieto, José, Enrique Alba, and A. Carolina Olivera. "Swarm intelligence for traffic light scheduling: Application to real urban areas." Engineering Applications of Artificial Intelligence 25, no. 2 (2012): 274-283. [24] Passos, Lúcio Sanchez, and Rosaldo Rossetti. "Traffic light control using reactive agents." In Information Systems and Technologies (CISTI), 2010 5th Iberian Conference on, pp. 1-6. IEEE, 2010. [25] Lin, Yilun, Xingyuan Dai, Li Li, and Fei-Yue Wang. "An Efficient Deep Reinforcement Learning Model for Urban Traffic Control." arXiv preprint arXiv:1808.01876 (2018). | ||||
|
Statistics Article View: 414 PDF Download: 235 |
||||
