Interaction-Aware Decision-Making for Autonomous Vehicles in Forced Merging Scenario Leveraging Social Psychology Factors (2309.14497v1)
Abstract: Understanding the intention of vehicles in the surrounding traffic is crucial for an autonomous vehicle to successfully accomplish its driving tasks in complex traffic scenarios such as highway forced merging. In this paper, we consider a behavioral model that incorporates both social behaviors and personal objectives of the interacting drivers. Leveraging this model, we develop a receding-horizon control-based decision-making strategy, that estimates online the other drivers' intentions using Bayesian filtering and incorporates predictions of nearby vehicles' behaviors under uncertain intentions. The effectiveness of the proposed decision-making strategy is demonstrated and evaluated based on simulation studies in comparison with a game theoretic controller and a real-world traffic dataset.
- M. Hügle, G. Kalweit, M. Werling, and J. Boedecker, “Dynamic interaction-aware scene understanding for reinforcement learning in autonomous driving,” in International Conference on Robotics and Automation (ICRA). IEEE, 2020, pp. 4329–4335.
- A. Mavrogiannis, R. Chandra, and D. Manocha, “B-gap: Behavior-rich simulation and navigation for autonomous driving,” Robotics and Automation Letters, vol. 7, no. 2, pp. 4718–4725, 2022.
- Y. Pan, C.-A. Cheng, K. Saigol, K. Lee, X. Yan, E. Theodorou, and B. Boots, “Agile autonomous driving using end-to-end deep imitation learning,” arXiv preprint arXiv:1709.07174, 2017.
- X. Mei, Y. Sun, Y. Chen, C. Liu, and M. Liu, “Autonomous navigation through intersections with graph convolutionalnetworks and conditional imitation learning for self-driving cars,” arXiv preprint arXiv:2102.00675, 2021.
- B. R. Kiran, I. Sobh, V. Talpaert, P. Mannion, A. A. Al Sallab, S. Yogamani, and P. Pérez, “Deep reinforcement learning for autonomous driving: A survey,” Transactions on Intelligent Transportation Systems, vol. 23, no. 6, pp. 4909–4926, 2021.
- D. Sadigh, S. Sastry, S. A. Seshia, and A. D. Dragan, “Planning for autonomous cars that leverage effects on human actions.” in Robotics: Science and systems, vol. 2. Ann Arbor, MI, USA, 2016, pp. 1–9.
- C. You, J. Lu, D. Filev, and P. Tsiotras, “Advanced planning for autonomous vehicles using reinforcement learning and deep inverse reinforcement learning,” Robotics and Autonomous Systems, vol. 114, pp. 1–18, 2019.
- A. Gupta, J. Johnson, L. Fei-Fei, S. Savarese, and A. Alahi, “Social gan: Socially acceptable trajectories with generative adversarial networks,” in Conference on Computer Vision and Pattern Recognition (CVPR), 2018, pp. 2255–2264.
- J. L. V. Espinoza, A. Liniger, W. Schwarting, D. Rus, and L. Van Gool, “Deep interactive motion prediction and planning: Playing games with motion prediction models,” in Learning for Dynamics and Control Conference (L4DC). PMLR, 2022, pp. 1006–1019.
- S. Bae, D. Isele, A. Nakhaei, P. Xu, A. M. Añon, C. Choi, K. Fujimura, and S. Moura, “Lane-change in dense traffic with model predictive control and neural networks,” Transactions on Control Systems Technology, 2022.
- M. Liang, B. Yang, R. Hu, Y. Chen, R. Liao, S. Feng, and R. Urtasun, “Learning lane graph representations for motion forecasting,” in European Conference on Computer Vision (ECCV). Springer, 2020, pp. 541–556.
- B. Ivanovic, K. Leung, E. Schmerling, and M. Pavone, “Multimodal deep generative models for trajectory prediction: A conditional variational autoencoder approach,” Robotics and Automation Letters, vol. 6, no. 2, pp. 295–302, 2020.
- N. Li, D. Oyler, M. Zhang, Y. Yildiz, A. Girard, and I. Kolmanovsky, “Hierarchical reasoning game theory based approach for evaluation and testing of autonomous vehicle control systems,” in Conference on Decision and Control (CDC). IEEE, 2016, pp. 727–733.
- M. Liu, I. Kolmanovsky, H. E. Tseng, S. Huang, D. Filev, and A. Girard, “Potential game-based decision-making for autonomous driving,” Transactions on Intelligent Transportation Systems, pp. 1–14, 2023.
- P. Hang, C. Lv, Y. Xing, C. Huang, and Z. Hu, “Human-like decision making for autonomous driving: A noncooperative game theoretic approach,” Transactions on Intelligent Transportation Systems, vol. 22, no. 4, pp. 2076–2087, 2020.
- J. F. Fisac, E. Bronstein, E. Stefansson, D. Sadigh, S. S. Sastry, and A. D. Dragan, “Hierarchical game-theoretic planning for autonomous vehicles,” in International Conference on Robotics and Automation (ICRA). IEEE, 2019, pp. 9590–9596.
- K. Liu, N. Li, H. E. Tseng, I. Kolmanovsky, and A. Girard, “Interaction-aware trajectory prediction and planning for autonomous vehicles in forced merge scenarios,” Transactions on Intelligent Transportation Systems, 2022.
- K. Liu, N. Li, H. E. Tseng, I. Kolmanovsky, A. Girard, and D. Filev, “Cooperation-aware decision making for autonomous vehicles in merge scenarios,” in Conference on Decision and Control (CDC). IEEE, 2021, pp. 5006–5012.
- D. M. Kuhlman and A. F. Marshello, “Individual differences in game motivation as moderators of preprogrammed strategy effects in prisoner’s dilemma.” Journal of Personality and Social Psychology, vol. 32, no. 5, p. 922, 1975.
- W. B. Liebrand, “The effect of social motives, communication and group size on behaviour in an n-person multi-stage mixed-motive game,” European Journal of Social Psychology, vol. 14, no. 3, pp. 239–264, 1984.
- D. M. Messick and C. G. McClintock, “Motivational bases of choice in experimental games,” Journal of Experimental Social Psychology, vol. 4, no. 1, pp. 1–25, 1968.
- W. B. Liebrand, R. W. Jansen, V. M. Rijken, and C. J. Suhre, “Might over morality: Social values and the perception of other players in experimental games,” Journal of Experimental Social Psychology, vol. 22, no. 3, pp. 203–215, 1986.
- D. W. Griesinger and J. W. Livingston Jr, “Toward a model of interpersonal motivation in experimental games,” Behavioral science, vol. 18, no. 3, pp. 173–188, 1973.
- W. Schwarting, A. Pierson, J. Alonso-Mora, S. Karaman, and D. Rus, “Social behavior for autonomous vehicles,” Proceedings of the National Academy of Sciences, vol. 116, no. 50, pp. 24 972–24 978, 2019.
- R. Krajewski, J. Bock, L. Kloeker, and L. Eckstein, “The highd dataset: A drone dataset of naturalistic vehicle trajectories on german highways for validation of highly automated driving systems,” in International Conference on Intelligent Transportation Systems. IEEE, 2018, pp. 2118–2125.
- I. Papadimitriou and M. Tomizuka, “Fast lane changing computations using polynomials,” in Proceedings of the 2003 American Control Conference, 2003., vol. 1. IEEE, 2003, pp. 48–53.
- Xiao Li (354 papers)
- Kaiwen Liu (8 papers)
- H. Eric Tseng (33 papers)
- Anouck Girard (45 papers)
- Ilya Kolmanovsky (107 papers)