Enhancing Accuracy and Robustness of Steering Angle Prediction with Attention Mechanism (2211.11133v4)
Abstract: In this paper, our focus is on enhancing steering angle prediction for autonomous driving tasks. We initiate our exploration by investigating two veins of widely adopted deep neural architectures, namely ResNets and InceptionNets. Within both families, we systematically evaluate various model sizes to understand their impact on performance. Notably, our key contribution lies in the incorporation of an attention mechanism to augment steering angle prediction accuracy and robustness. By introducing attention, our models gain the ability to selectively focus on crucial regions within the input data, leading to improved predictive outcomes. Our findings showcase that our attention-enhanced models not only achieve state-of-the-art results in terms of steering angle Mean Squared Error (MSE) but also exhibit enhanced adversarial robustness, addressing critical concerns in real-world deployment. For example, in our experiments on the Kaggle SAP and our created publicly available datasets, attention can lead to over 6% error reduction in steering angle prediction and boost model robustness by up to 56.09%.
- P. J. Navarro, L. Miller, F. Rosique, C. Fernández-Isla, and A. Gila-Navarro, “End-to-end deep neural network architectures for speed and steering wheel angle prediction in autonomous driving,” Electronics, vol. 10, no. 11, p. 1266, 2021.
- J. Klender, “Tesla tells new fsd beta member their cars will use pure vision, axing radar altogether,” https://www.teslarati.com/tesla-fsd-beta-members-pure-vision-no-radar-beta-pool-expansion/, October 2021, last accessed 27-July-2022.
- U. M. Gidado, H. Chiroma, N. Aljojo, S. Abubakar, S. I. Popoola, and M. A. Al-Garadi, “A survey on deep learning for steering angle prediction in autonomous vehicles,” IEEE Access, vol. 8, pp. 163 797–163 817, 2020.
- A. Oussama and T. Mohamed, “A literature review of steering angle prediction algorithms for self-driving cars,” in International Conference on Advanced Intelligent Systems for Sustainable Development. Springer, 2019, pp. 30–38.
- M. K. Islam, M. N. Yeasmin, C. Kaushal, M. Al Amin, M. R. Islam, and M. I. H. Showrov, “Comparative analysis of steering angle prediction for automated object using deep neural network,” in 2021 9th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions)(ICRITO). IEEE, 2021, pp. 1–7.
- F. Munir, S. Azam, B.-G. Lee, and M. Jeon, “Multi-modal fusion for sensorimotor coordination in steering angle prediction,” arXiv preprint arXiv:2202.05500, 2022.
- S. Du, H. Guo, and A. Simpson, “Self-driving car steering angle prediction based on image recognition,” arXiv preprint arXiv:1912.05440, 2019.
- M. Al-Qizwini, I. Barjasteh, H. Al-Qassab, and H. Radha, “Deep learning algorithm for autonomous driving using googlenet,” in 2017 IEEE Intelligent Vehicles Symposium (IV). IEEE, 2017, pp. 89–96.
- D. McNeely-White, J. R. Beveridge, and B. A. Draper, “Inception and resnet features are (almost) equivalent,” Cognitive Systems Research, vol. 59, pp. 312–318, 2020.
- S. He, D. Kangin, Y. Mi, and N. Pugeault, “Aggregated sparse attention for steering angle prediction,” in 2018 24th International Conference on Pattern Recognition (ICPR). IEEE, 2018, pp. 2398–2403.
- K. Zhu, W. Chen, W. Zhang, R. Song, and Y. Li, “Autonomous robot navigation based on multi-camera perception,” in 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2020, pp. 5879–5885.
- F. Wang, M. Jiang, C. Qian, S. Yang, C. Li, H. Zhang, X. Wang, and X. Tang, “Residual attention network for image classification,” in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 6450–6458.
- J. Long, E. Shelhamer, and T. Darrell, “Fully convolutional networks for semantic segmentation,” 2014.
- I. J. Goodfellow, J. Shlens, and C. Szegedy, “Explaining and harnessing adversarial examples,” arXiv preprint arXiv:1412.6572, 2014.
- Y. Deng, X. Zheng, T. Zhang, C. Chen, G. Lou, and M. Kim, “An analysis of adversarial attacks and defenses on autonomous driving models,” in 2020 IEEE international conference on pervasive computing and communications (PerCom). IEEE, 2020, pp. 1–10.
- A. Madry, A. Makelov, L. Schmidt, D. Tsipras, and A. Vladu, “Towards deep learning models resistant to adversarial attacks,” arXiv preprint arXiv:1706.06083, 2017.
- K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770–778.
- C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, “Going deeper with convolutions,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, pp. 1–9.
- http://www.osc.edu.
- Kaggle, “Self-driving car simulator,” https://www.kaggle.com/datasets/zaynena/selfdriving-car-simulator, 2019, last accessed 20220724.
- N. Ijaz and Y. Wang, “Automatic steering angle and direction prediction for autonomous driving using deep learning,” in 2021 International Symposium on Computer Science and Intelligent Controls (ISCSIC). IEEE, 2021, pp. 280–283.
- C. Oinar and E. Kim, “Self-driving car steering angle prediction: Let transformer be a car again,” arXiv preprint arXiv:2204.12748, 2022.
- P. Barua, “Attention-aware automatic steering angle prediction,” https://github.com/PramitiBarua/Attention-based-Steering-Angle-Prediction, 2023.