Papers
Topics
Authors
Recent
Search
2000 character limit reached

Towards Increasing the Robustness of Predictive Steering-Control Autonomous Navigation Systems Against Dash Cam Image Angle Perturbations Due to Pothole Encounters

Published 6 Oct 2023 in cs.CV | (2310.03959v1)

Abstract: Vehicle manufacturers are racing to create autonomous navigation and steering control algorithms for their vehicles. These software are made to handle various real-life scenarios such as obstacle avoidance and lane maneuvering. There is some ongoing research to incorporate pothole avoidance into these autonomous systems. However, there is very little research on the effect of hitting a pothole on the autonomous navigation software that uses cameras to make driving decisions. Perturbations in the camera angle when hitting a pothole can cause errors in the predicted steering angle. In this paper, we present a new model to compensate for such angle perturbations and reduce any errors in steering control prediction algorithms. We evaluate our model on perturbations of publicly available datasets and show our model can reduce the errors in the estimated steering angle from perturbed images to 2.3%, making autonomous steering control robust against the dash cam image angle perturbations induced when one wheel of a car goes over a pothole.

Authors (1)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (39)
  1. S. Meyer, “Average miles driven per year in the u.s. (2022) - the zebra,” Mar 2023. [Online]. Available: https://www.thezebra.com/resources/driving/average-miles-driven-per-year/
  2. C. Pires, K. Torfs, A. Areal, C. Goldenbeld, W. Vanlaar, M.-A. Granié, Y. A. Stürmer, D. S. Usami, S. Kaiser, D. Jankowska-Karpa, et al., “Car drivers’ road safety performance: A benchmark across 32 countries,” IATSS research, vol. 44, no. 3, pp. 166–179, 2020.
  3. C. Bodden, “Car accident caused by a pothole, what can you do?” Dec 2021. [Online]. Available: https://boddenbennettlaw.com/car-accident-caused-by-a-pothole-what-can-you-do
  4. E. Edmonds, “Aaa: Potholes pack a punch as drivers pay $26.5 billion in related vehicle repairs,” Mar 2022. [Online]. Available: https://newsroom.aaa.com/2022/03/aaa-potholes-pack-a-punch-as-drivers-pay-26-5-billion-in-related-vehicle-repairs/
  5. V. Kaushik and B. S. Kalyan, “Pothole detection system: A review of different methods used for detection,” in 2022 Second International Conference on Computer Science, Engineering and Applications (ICCSEA).   IEEE, 2022, pp. 1–4.
  6. G. Raja, S. Anbalagan, S. Senthilkumar, K. Dev, and N. M. F. Qureshi, “Spas: Smart pothole-avoidance strategy for autonomous vehicles,” IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 10, pp. 19 827–19 836, 2022.
  7. T. Wang, Y. Luo, J. Liu, R. Chen, and K. Li, “End-to-end self-driving approach independent of irrelevant roadside objects with auto-encoder,” IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 1, pp. 641–650, 2020.
  8. Y. Shen, L. Zheng, M. Shu, W. Li, T. Goldstein, and M. Lin, “Gradient-free adversarial training against image corruption for learning-based steering,” Advances in Neural Information Processing Systems, vol. 34, pp. 26 250–26 263, 2021.
  9. A. Mednis, G. Strazdins, R. Zviedris, G. Kanonirs, and L. Selavo, “Real time pothole detection using android smartphones with accelerometers,” in 2011 International conference on distributed computing in sensor systems and workshops (DCOSS).   IEEE, 2011, pp. 1–6.
  10. J. Lekshmipathy, S. Velayudhan, and S. Mathew, “Effect of combining algorithms in smartphone based pothole detection,” International Journal of Pavement Research and Technology, vol. 14, pp. 63–72, 2021.
  11. A. Kulkarni, N. Mhalgi, S. Gurnani, and N. Giri, “Pothole detection system using machine learning on android,” International Journal of Emerging Technology and Advanced Engineering, vol. 4, no. 7, pp. 360–364, 2014.
  12. J. Eriksson, L. Girod, B. Hull, R. Newton, S. Madden, and H. Balakrishnan, “The pothole patrol: using a mobile sensor network for road surface monitoring,” in Proceedings of the 6th International Conference on Mobile Systems, Applications, and Services, 2008, pp. 29–39.
  13. S. K. Sharma and R. C. Sharma, “Pothole detection and warning system for indian roads,” in Advances in Interdisciplinary Engineering: Select Proceedings of FLAME 2018.   Springer, 2019, pp. 511–519.
  14. M. R. Carlos, M. E. Aragón, L. C. González, H. J. Escalante, and F. Martínez, “Evaluation of detection approaches for road anomalies based on accelerometer readings—addressing who’s who,” IEEE Transactions on Intelligent Transportation Systems, vol. 19, no. 10, pp. 3334–3343, 2018.
  15. B. Varona, A. Monteserin, and A. Teyseyre, “A deep learning approach to automatic road surface monitoring and pothole detection,” Personal and Ubiquitous Computing, vol. 24, no. 4, pp. 519–534, 2020.
  16. A. Kumar, D. J. Kalita, V. P. Singh, et al., “A modern pothole detection technique using deep learning,” in 2nd International Conference on Data, Engineering and Applications (IDEA).   IEEE, 2020, pp. 1–5.
  17. A. K. Pandey, R. Iqbal, T. Maniak, C. Karyotis, S. Akuma, and V. Palade, “Convolution neural networks for pothole detection of critical road infrastructure,” Computers and Electrical Engineering, vol. 99, p. 107725, 2022.
  18. H.-W. Wang, C.-H. Chen, D.-Y. Cheng, C.-H. Lin, C.-C. Lo, et al., “A real-time pothole detection approach for intelligent transportation system,” Mathematical Problems in Engineering, vol. 2015, 2015.
  19. Z. Li, I. Kolmanovsky, E. Atkins, J. Lu, and D. Filev, “Road anomaly estimation: Model based pothole detection,” in 2015 American Control Conference (ACC).   IEEE, 2015, pp. 1315–1320.
  20. T. Kim and S.-K. Ryu, “Review and analysis of pothole detection methods,” Journal of Emerging Trends in Computing and Information Sciences, vol. 5, no. 8, pp. 603–608, 2014.
  21. V. Rishiwal and H. Khan, “Automatic pothole and speed breaker detection using android system,” in 2016 39th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO).   IEEE, 2016, pp. 1270–1273.
  22. H. B. SALAU, A. J. ONUMANYİ, A. M. AİBİNU, E. N. ONWUKA, J. J. DUKİYA, and H. Ohize, “A survey of accelerometer-based techniques for road anomalies detection and characterization,” International Journal of Engineering Science and Application, vol. 3, no. 1, pp. 8–20, 2019.
  23. R. Fan, X. Ai, and N. Dahnoun, “Road surface 3d reconstruction based on dense subpixel disparity map estimation,” IEEE Transactions on Image Processing, vol. 27, no. 6, pp. 3025–3035, 2018.
  24. R. Fan, U. Ozgunalp, B. Hosking, M. Liu, and I. Pitas, “Pothole detection based on disparity transformation and road surface modeling,” IEEE Transactions on Image Processing, vol. 29, pp. 897–908, 2020.
  25. R. Fan and M. Liu, “Road damage detection based on unsupervised disparity map segmentation,” IEEE Transactions on Intelligent Transportation Systems, vol. 21, no. 11, pp. 4906–4911, 2020.
  26. Z. Zhang, X. Ai, C. Chan, and N. Dahnoun, “An efficient algorithm for pothole detection using stereo vision,” in 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).   IEEE, 2014, pp. 564–568.
  27. Y. Li, C. Papachristou, and D. Weyer, “Road pothole detection system based on stereo vision,” in NAECON 2018-IEEE National Aerospace and Electronics Conference.   IEEE, 2018, pp. 292–297.
  28. N. K. B. Ramaiah and S. Kundu, “Stereo vision based pothole detection system for improved ride quality,” SAE International Journal of Advances and Current Practices in Mobility, vol. 3, no. 2021-01-0085, pp. 2603–2610, 2021.
  29. B.-h. Kang and S.-i. Choi, “Pothole detection system using 2d lidar and camera,” in 2017 Ninth International Conference on Ubiquitous and Future Networks (ICUFN).   IEEE, 2017, pp. 744–746.
  30. G. Jog, C. Koch, M. Golparvar-Fard, and I. Brilakis, “Pothole properties measurement through visual 2d recognition and 3d reconstruction,” in Computing in Civil Engineering (2012), 2012, pp. 553–560.
  31. R. Borgalli, “Smart pothole detection and mapping system,” Journal of Ubiquitous Computing and Communication Technologies, vol. 2, no. 3, pp. 136–144, 2020.
  32. D. Desai, A. Soni, D. Panchal, and S. Gajjar, “Design, development and testing of automatic pothole detection and alert system,” in 2019 IEEE 16th India council international conference (INDICON).   IEEE, 2019, pp. 1–4.
  33. M. Kamalesh, B. Chokkalingam, J. Arumugam, G. Sengottaiyan, S. Subramani, M. A. Shah, et al., “An intelligent real time pothole detection and warning system for automobile applications based on iot technology,” Journal of Applied Science and Engineering, vol. 24, no. 1, pp. 77–81, 2021.
  34. D. Joubert, A. Tyatyantsi, J. Mphahlehle, and V. Manchidi, “Pothole tagging system,” 2011.
  35. Statista, “Best-selling passenger car worldwide in 2022 (in million units),” Jan 2023. [Online]. Available: https://www.statista.com/statistics/239229/most-sold-car-models-worldwide/
  36. Macrovector, “Car blueprint. vehicle engineering blueprint. illustration structure of sedan model,” 2022. [Online]. Available: https://www.freepik.com/free-vector
  37. M. Villarreal, B. Poudel, R. Wickman, Y. Shen, and W. Li, “Autojoin: Efficient adversarial training for robust maneuvering via denoising autoencoder and joint learning,” arXiv preprint arXiv:2205.10933, 2022.
  38. J. Geyer, Y. Kassahun, M. Mahmudi, X. Ricou, R. Durgesh, A. S. Chung, L. Hauswald, V. H. Pham, M. Mühlegg, S. Dorn, et al., “A2d2: Audi autonomous driving dataset,” arXiv preprint arXiv:2004.06320, 2020.
  39. V. Ramanishka, Y.-T. Chen, T. Misu, and K. Saenko, “Toward driving scene understanding: A dataset for learning driver behavior and causal reasoning,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 7699–7707.

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up