A GPT-based Decision Transformer for Multi-Vehicle Coordination at Unsignalized Intersections (2410.05829v1)
Abstract: In this paper, we explore the application of the Decision Transformer, a decision-making algorithm based on the Generative Pre-trained Transformer (GPT) architecture, to multi-vehicle coordination at unsignalized intersections. We formulate the coordination problem so as to find the optimal trajectories for multiple vehicles at intersections, modeling it as a sequence prediction task to fully leverage the power of GPTs as a sequence model. Through extensive experiments, we compare our approach to a reservation-based intersection management system. Our results show that the Decision Transformer can outperform the training data in terms of total travel time and can be generalized effectively to various scenarios, including noise-induced velocity variations, continuous interaction environments, and different vehicle numbers and road configurations.
- K. Dresner and P. Stone, “A multiagent approach to autonomous intersection management,” Jour. of Artificial Intelligence Research, vol. 31, pp. 591–656, 2008.
- M. O. Sayin, C.-W. Lin, S. Shiraishi, J. Shen, and T. Başar, “Information-driven autonomous intersection control via incentive compatible mechanisms,” IEEE Trans. Intell. Transp. Syst., vol. 20, no. 3, pp. 912–924, 2018.
- C. Wuthishuwong and A. Traechtler, “Consensus-based local information coordination for the networked control of the autonomous intersection management,” Complex & Intell. Syst., vol. 3, no. 1, pp. 17–32, 2017.
- R. Tachet, P. Santi, S. Sobolevsky, L. I. Reyes-Castro, E. Frazzoli, D. Helbing, and C. Ratti, “Revisiting street intersections using slot-based systems,” PloS one, vol. 11, no. 3, p. e0149607, 2016.
- H. Ahn and A. Colombo, “Abstraction-based safety verification and control of cooperative vehicles at road intersections,” IEEE Trans. Autom. Control, vol. 65, no. 10, pp. 4061–4074, 2019.
- A. Gholamhosseinian and J. Seitz, “A comprehensive survey on cooperative intersection management for heterogeneous connected vehicles,” IEEE Access, vol. 10, pp. 7937–7972, 2022.
- Q. Liu, X. Li, Z. Li, J. Wu, G. Du, X. Gao, F. Yang, and S. Yuan, “Graph reinforcement learning application to co-operative decision-making in mixed autonomy traffic: Framework, survey, and challenges,” arXiv preprint arXiv:2211.03005, 2022.
- A. P. Capasso, P. Maramotti, A. Dell’Eva, and A. Broggi, “End-to-end intersection handling using multi-agent deep reinforcement learning,” in 2021 IEEE Intell. Vehicles Symp. (IV), 2021, pp. 443–450.
- U. Gunarathna, S. Karunasekera, R. Borovica-Gajic, and E. Tanin, “Real-time intelligent autonomous intersection management using reinforcement learning,” in 2022 IEEE Intell. Vehicles Symp. (IV), 2022, pp. 135–144.
- S. Levine, A. Kumar, G. Tucker, and J. Fu, “Offline reinforcement learning: Tutorial, review, and perspectives on open problems,” arXiv preprint arXiv:2005.01643, 2020.
- A. Radford, J. Wu, R. Child, D. Luan, D. Amodei, I. Sutskever et al., “Language models are unsupervised multitask learners,” OpenAI blog, vol. 1, no. 8, p. 9, 2019.
- J. Liu, P. Hang, X. Qi, J. Wang, and J. Sun, “Mtd-gpt: A multi-task decision-making gpt model for autonomous driving at unsignalized intersections,” in 2023 IEEE 26th Int. Conf. Intell. Transp. Syst. (ITSC). IEEE, 2023, pp. 5154–5161.
- L. Chen, K. Lu, A. Rajeswaran, K. Lee, A. Grover, M. Laskin, P. Abbeel, A. Srinivas, and I. Mordatch, “Decision transformer: Reinforcement learning via sequence modeling,” Advances in Neural Infor. Proc. Syst. (NeurIPS), vol. 34, pp. 15 084–15 097, 2021.
- United Nations Economic Commission for Europe, “UN Regulation No. 79 (Revision 5),” https://unece.org/transport/documents/2023/10/working-documents/un-regulation-no-79-revision-5, 2023, accessed: 2024-09-12.
Sponsor
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.