Deep Reinforcement Learning for Advanced Longitudinal Control and Collision Avoidance in High-Risk Driving Scenarios (2404.19087v1)
Abstract: Existing Advanced Driver Assistance Systems primarily focus on the vehicle directly ahead, often overlooking potential risks from following vehicles. This oversight can lead to ineffective handling of high risk situations, such as high speed, closely spaced, multi vehicle scenarios where emergency braking by one vehicle might trigger a pile up collision. To overcome these limitations, this study introduces a novel deep reinforcement learning based algorithm for longitudinal control and collision avoidance. This proposed algorithm effectively considers the behavior of both leading and following vehicles. Its implementation in simulated high risk scenarios, which involve emergency braking in dense traffic where traditional systems typically fail, has demonstrated the algorithm ability to prevent potential pile up collisions, including those involving heavy duty vehicles.
- M. Galvani, “History and future of driver assistance,” IEEE Instrumentation & Measurement Magazine, vol. 22, no. 1, pp. 11–16, 2019.
- V. K. Kukkala, J. Tunnell, S. Pasricha, and T. Bradley, “Advanced driver-assistance systems: A path toward autonomous vehicles,” IEEE Consumer Electronics Magazine, vol. 7, no. 5, pp. 18–25, 2018.
- D. Burton, A. Delaney, S. Newstead, D. Logan, and B. Fildes, “Evaluation of anti-lock braking systems effectiveness,” Accident Analysis and Prevention, vol. 29, no. 6, pp. 745–757, 1997.
- L. Yang, Y. Yang, G. Wu, X. Zhao, S. Fang, X. Liao, R. Wang, M. Zhang et al., “A systematic review of autonomous emergency braking system: impact factor, technology, and performance evaluation,” Journal of advanced transportation, vol. 2022, 2022.
- S. A. Ferguson, “The effectiveness of electronic stability control in reducing real-world crashes: a literature review,” Traffic injury prevention, vol. 8, no. 4, pp. 329–338, 2007.
- G. Liu, L. Wang, and S. Zou, “A radar-based blind spot detection and warning system for driver assistance,” in 2017 IEEE 2nd Advanced Information Technology, Electronic and Automation Control Conference (IAEAC). IEEE, 2017, pp. 2204–2208.
- M. Á. Sotelo and J. Barriga, “Blind spot detection using vision for automotive applications,” Journal of Zhejiang university-SCIENCE A, vol. 9, pp. 1369–1372, 2008.
- K. Kozak, J. Pohl, W. Birk, J. Greenberg, B. Artz, M. Blommer, L. Cathey, and R. Curry, “Evaluation of lane departure warnings for drowsy drivers,” in Proceedings of the human factors and ergonomics society annual meeting, vol. 50, no. 22. Sage Publications Sage CA: Los Angeles, CA, 2006, pp. 2400–2404.
- A. Vahidi and A. Eskandarian, “Research advances in intelligent collision avoidance and adaptive cruise control,” IEEE transactions on intelligent transportation systems, vol. 4, no. 3, pp. 143–153, 2003.
- C. C. De Wit and P. Tsiotras, “Dynamic tire friction models for vehicle traction control,” in Proceedings of the 38th IEEE conference on decision and control (Cat. no. 99CH36304), vol. 4. IEEE, 1999, pp. 3746–3751.
- J. Nidamanuri, C. Nibhanupudi, R. Assfalg, and H. Venkataraman, “A progressive review: Emerging technologies for adas driven solutions,” IEEE Transactions on Intelligent Vehicles, vol. 7, no. 2, pp. 326–341, 2021.
- National Highway Traffic Safety Administration, “Federal motor vehicle safety standards: Automatic emergency braking systems for light vehicles,” Federal Register, pp. 38 632–38 736, 6 2023, available from: ProQuest® Congressional; Accessed: 4/23/2024.
- C. Lu, J. Dong, and L. Hu, “Energy-efficient adaptive cruise control for electric connected and autonomous vehicles,” IEEE Intelligent Transportation Systems Magazine, vol. 11, no. 3, pp. 42–55, 2019.
- L. Yu and R. Wang, “Researches on adaptive cruise control system: A state of the art review,” Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering, vol. 236, no. 2-3, pp. 211–240, 2022.
- B. Fildes, M. Keall, N. Bos, A. Lie, Y. Page, C. Pastor, L. Pennisi, M. Rizzi, P. Thomas, and C. Tingvall, “Effectiveness of low speed autonomous emergency braking in real-world rear-end crashes,” Accident Analysis & Prevention, vol. 81, pp. 24–29, 2015.
- A. Moujahid, M. E. Tantaoui, M. D. Hina, A. Soukane, A. Ortalda, A. ElKhadimi, and A. Ramdane-Cherif, “Machine learning techniques in adas: A review,” in 2018 International Conference on Advances in Computing and Communication Engineering (ICACCE). IEEE, 2018, pp. 235–242.
- I.-H. Kim, J.-H. Bong, J. Park, and S. Park, “Prediction of driver’s intention of lane change by augmenting sensor information using machine learning techniques,” Sensors, vol. 17, no. 6, p. 1350, 2017.
- X. Wang, S. Wang, X. Liang, D. Zhao, J. Huang, X. Xu, B. Dai, and Q. Miao, “Deep reinforcement learning: A survey,” IEEE Transactions on Neural Networks and Learning Systems, 2022.
- A. Dosovitskiy, G. Ros, F. Codevilla, A. Lopez, and V. Koltun, “Carla: An open urban driving simulator,” in Conference on robot learning. PMLR, 2017, pp. 1–16.
- A. Moujahid, M. ElAraki Tantaoui, M. D. Hina, A. Soukane, A. Ortalda, A. ElKhadimi, and A. Ramdane-Cherif, “Machine learning techniques in adas: A review,” in 2018 International Conference on Advances in Computing and Communication Engineering (ICACCE), 2018, pp. 235–242.
- C. Desjardins and B. Chaib-Draa, “Cooperative adaptive cruise control: A reinforcement learning approach,” IEEE Transactions on intelligent transportation systems, vol. 12, no. 4, pp. 1248–1260, 2011.
- A. E. Sallab, M. Abdou, E. Perot, and S. Yogamani, “End-to-end deep reinforcement learning for lane keeping assist,” arXiv preprint arXiv:1612.04340, 2016.
- Y. Fu, C. Li, F. R. Yu, T. H. Luan, and Y. Zhang, “A decision-making strategy for vehicle autonomous braking in emergency via deep reinforcement learning,” IEEE transactions on vehicular technology, vol. 69, no. 6, pp. 5876–5888, 2020.
- H. Chae, C. M. Kang, B. Kim, J. Kim, C. C. Chung, and J. W. Choi, “Autonomous braking system via deep reinforcement learning,” in 2017 IEEE 20th International conference on intelligent transportation systems (ITSC). IEEE, 2017, pp. 1–6.
- D. Chen, E. Yurtsever, K. A. Redmill, and Ü. Özgüner, “Using collision momentum in deep reinforcement learning based adversarial pedestrian modeling,” in 2023 IEEE Intelligent Vehicles Symposium (IV). IEEE, 2023, pp. 1–6.
- T. Zhou, M. Chen, and J. Zou, “Reinforcement learning based data fusion method for multi-sensors,” IEEE/CAA Journal of Automatica Sinica, vol. 7, no. 6, pp. 1489–1497, 2020.
- T. P. Lillicrap, J. J. Hunt, A. Pritzel, N. Heess, T. Erez, Y. Tassa, D. Silver, and D. Wierstra, “Continuous control with deep reinforcement learning,” arXiv preprint arXiv:1509.02971, 2015.
- M. Makridis, K. Mattas, and B. Ciuffo, “Response time and time headway of an adaptive cruise control. an empirical characterization and potential impacts on road capacity,” IEEE Transactions on Intelligent Transportation Systems, vol. 21, no. 4, pp. 1677–1686, 2020.
- E. T. Donnell, S. C. Hines, K. M. Mahoney, R. J. Porter, H. McGee et al., “Speed concepts: Informational guide,” United States. Federal Highway Administration. Office of Safety, Tech. Rep., 2009.