Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
126 tokens/sec
GPT-4o
28 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

DynamicLight: Two-Stage Dynamic Traffic Signal Timing (2211.01025v2)

Published 2 Nov 2022 in cs.LG and cs.AI

Abstract: Reinforcement learning (RL) is gaining popularity as an effective approach for traffic signal control (TSC) and is increasingly applied in this domain. However, most existing RL methodologies are confined to a single-stage TSC framework, primarily focusing on selecting an appropriate traffic signal phase at fixed action intervals, leading to inflexible and less adaptable phase durations. To address such limitations, we introduce a novel two-stage TSC framework named DynamicLight. This framework initiates with a phase control strategy responsible for determining the optimal traffic phase, followed by a duration control strategy tasked with determining the corresponding phase duration. Experimental results show that DynamicLight outperforms state-of-the-art TSC models and exhibits exceptional model generalization capabilities. Additionally, the robustness and potential for real-world implementation of DynamicLight are further demonstrated and validated through various DynamicLight variants. The code is released at https://github.com/LiangZhang1996/DynamicLight.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (28)
  1. Toward a thousand lights: Decentralized deep reinforcement learning for large-scale traffic signal control. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pp.  3414–3421, 2020.
  2. PRGLight: A novel traffic light control framework with pressure-based-reinforcement learning and graph neural network. In IJCAI 2021 Reinforcement Learning for Intelligent Transportation Systems (RL4ITS) Workshop, 2021.
  3. Self-organizing traffic lights: A realistic simulation. In Advances in applied self-organizing systems, pp.  45–55. Springer, 2013.
  4. Model-agnostic meta-learning for fast adaptation of deep networks. In International conference on machine learning, pp. 1126–1135. PMLR, 2017.
  5. Generative adversarial imitation learning. Advances in neural information processing systems, 29, 2016.
  6. The SCOOT on-line traffic signal optimisation technique. Traffic Engineering & Control, 23(4), 1982.
  7. Traffic signal timing manual. Technical report, United States. Federal Highway Administration, 2008.
  8. Hierarchical deep reinforcement learning: Integrating temporal abstraction and intrinsic motivation. Advances in neural information processing systems, 29, 2016.
  9. Lowrie, P. Scats: A traffic responsive method of controlling urban traffic. Sales information brochure published by Roads & Traffic Authority, Sydney, Australia, 1990.
  10. Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602, 2013.
  11. AttendLight: Universal attention-based reinforcement learning model for traffic signal control. Advances in Neural Information Processing Systems, 33:4079–4090, 2020.
  12. The green wave model of two-dimensional traffic: Transitions in the flow properties and in the geometry of the traffic jam. Physica A: Statistical Mechanics and its Applications, 231(4):515–533, 1996.
  13. Deep reinforcement learning with double Q-learning. In Proceedings of the AAAI conference on artificial intelligence, volume 30, 2016.
  14. Varaiya, P. Max pressure control of a network of signalized intersections. Transportation Research Part C: Emerging Technologies, 36:177–195, 11 2013.
  15. Attention is all you need. Advances in neural information processing systems, 30, 2017.
  16. Graph attention networks. stat, 1050:20, 2017.
  17. Dueling network architectures for deep reinforcement learning. In International conference on machine learning, pp. 1995–2003. PMLR, 2016.
  18. IntelliLight: A reinforcement learning approach for intelligent traffic light control. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp.  2496–2505, 2018.
  19. PressLight: Learning max pressure control to coordinate traffic signals in arterial network. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp.  1290–1298, 2019a.
  20. CoLight: Learning network-level cooperation for traffic signal control. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pp.  1913–1922, 2019b.
  21. Learning traffic signal control from demonstrations. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pp.  2289–2292, 2019.
  22. Hierarchically and cooperatively learning traffic signal control. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pp.  669–677, 2021.
  23. MetaLight: Value-based meta-reinforcement learning for traffic signal control. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pp.  1153–1160, 2020.
  24. CityFlow: A multi-agent reinforcement learning environment for large scale city traffic scenario. In The World Wide Web Conference, pp.  3620–3624, 2019.
  25. Expression might be enough: Representing pressure and demand for reinforcement learning based traffic signal control. In Proceedings of the 39th International Conference on Machine Learning, volume 162 of Proceedings of Machine Learning Research, pp.  26645–26654. PMLR, 17–23 Jul 2022.
  26. Leveraging queue length and attention mechanisms for enhanced traffic signal control optimization. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases, pp.  141–156. Springer, 2023.
  27. Learning phase competition for traffic signal control. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pp.  1963–1972, 2019a.
  28. Diagnosing reinforcement learning for traffic signal control. arXiv preprint arXiv:1905.04716, 2019b.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets