Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
125 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Towards Automated Driving Violation Cause Analysis in Scenario-Based Testing for Autonomous Driving Systems (2401.10443v1)

Published 19 Jan 2024 in cs.SE

Abstract: The rapid advancement of Autonomous Vehicles (AVs), exemplified by companies like Waymo and Cruise offering 24/7 paid taxi services, highlights the paramount importance of ensuring AVs' compliance with various policies, such as safety regulations, traffic rules, and mission directives. Despite significant progress in the development of Autonomous Driving System (ADS) testing tools, there has been a notable absence of research on attributing the causes of driving violations. Counterfactual causality analysis has emerged as a promising approach for identifying the root cause of program failures. While it has demonstrated effectiveness in pinpointing error-inducing inputs, its direct application to the AV context to determine which computation result, generated by which component, serves as the root cause poses a considerable challenge. A key obstacle lies in our inability to straightforwardly eliminate the influence of a specific internal message to establish the causal relationship between the output of each component and a system-level driving violation. In this work, we propose a novel driving violation cause analysis (DVCA) tool. We design idealized component substitutes to enable counterfactual analysis of ADS components by leveraging the unique opportunity provided by the simulation. We evaluate our tool on a benchmark with real bugs and injected faults. The results show that our tool can achieve perfect component-level attribution accuracy (100%) and almost (>98%) perfect message-level accuracy. Our tool can reduce the debugging scope from hundreds of complicated interdependent messages to one single computation result generated by one component.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (62)
  1. “California just opened the floodgates for self-driving cars,” https://www.washingtonpost.com/technology/2023/08/10/san-francisco-robotaxi-approved-waymo-cruise/.
  2. “Death of Elaine Herzberg,” https://en.wikipedia.org/wiki/Death_of_Elaine_Herzberg.
  3. “Tesla In Taiwan Crashes Directly Into Overturned Truck, Ignores Pedestrian, With Autopilot On,” https://tinyurl.com/r94yvyas.
  4. “Two People Killed in Fiery Tesla Crash with No One Driving,” https://tinyurl.com/2p9a3dat.
  5. “Tesla on Autopilot Crashes into Michigan Cop’s Patrol Car,” https://tinyurl.com/2p994vc5.
  6. “Waymo Safety Report,” https://storage.googleapis.com/waymo-uploads/files/documents/safety/2021-12-waymo-safety-report.pdf.
  7. “GM Cruise Safety Report,” https://www.gm.com/content/dam/company/docs/us/en/gmcom/gmsafetyreport.pdf.
  8. “Argo Developing a Self-Driving System You Can Trust,” https://www.argo.ai/wp-content/uploads/2021/04/ArgoSafetyReport.pdf.
  9. “Ponyai Safety Report,” https://tinyurl.com/48v4b6pk.
  10. “Armed with traffic cones, protesters are immobilizing driverless cars,” https://www.npr.org/2023/08/26/1195695051/driverless-cars-san-francisco-waymo-cruise.
  11. Z. Zhong, Y. Tang, Y. Zhou, V. d. O. Neves, Y. Liu, and B. Ray, “A survey on scenario-based testing for automated driving systems in high-fidelity simulation,” 2021. [Online]. Available: https://arxiv.org/abs/2112.00964
  12. “Apollo: An Open Autonomous Driving Platform,” https://github.com/ApolloAuto/apollo.
  13. S. Kato, S. Tokunaga, Y. Maruyama, S. Maeda, M. Hirabayashi, Y. Kitsukawa, A. Monrroy, T. Ando, Y. Fujii, and T. Azumi, “Autoware On Board: Enabling Autonomous Vehicles with Embedded Systems,” in ICCPS’18.   IEEE Press, 2018, pp. 287–296.
  14. C. Jung, A. Ahad, Y. Jeon, and Y. Kwon, “Swarmflawfinder: Discovering and exploiting logic flaws of swarm algorithms,” in 2022 IEEE Symposium on Security and Privacy (SP).   IEEE, 2022, pp. 1808–1825.
  15. C. Jung, A. Ahad, J. Jung, S. Elbaum, and Y. Kwon, “Swarmbug: debugging configuration bugs in swarm robotics,” in Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, 2021, pp. 868–880.
  16. M. von Stein and S. Elbaum, “Automated environment reduction for debugging robotic systems,” in 2021 IEEE International Conference on Robotics and Automation (ICRA), 2021, pp. 3985–3991.
  17. “Autonomous vehicle startup AutoX lands driverless testing permit in California,” https://techcrunch.com/2020/07/17/autonomous-vehicle-startup-autox-lands-driverless-testing-permit-in-california.
  18. “Waymo has launched its commercial self-driving service in Phoenix - and it’s called ‘Waymo One’,” www.businessinsider.com/waymo-one-driverless-car-service-launches-in-phoenix-arizona-2018-12.
  19. “Baidu To Operate 3,000 Driverless Apollo Go Robotaxis in 30 Cities in 3 Years,” https://www.torquenews.com/1/baidu-operate-3000-driverless-apollo-go-robotaxies-30-cities-3-years.
  20. “Baidu Has Been Working on Autonomous Vehicles. It Got the Green Light for Commercial Self-Driving Bus Service in China,” https://www.barrons.com/articles/baidu-gets-green-light-for-commercial-self-driving-bus-service-in-china-51618390800.
  21. “Britain’s first self-driving shuttle bus hits the streets, but scares passengers away,” https://thenextweb.com/news/uk-first-self-driving-shuttle-bus-scares-passengers-away.
  22. “UPS Joins Race for Future of Delivery Services by Investing in Self-driving Trucks,” https://tinyurl.com/2p886dud.
  23. “Aurora Expands Autonomous Trucking Tests in Texas,” https://www.ttnews.com/articles/aurora-expands-autonomous-trucking-tests-texas.
  24. “Nuro can now operate and charge for autonomous delivery services in California,” https://tcrn.ch/3mL70PI.
  25. “Tesla Sold 2 Million Electric Cars: First Automaker To Reach Milestone,” insideevs.com/news/542197/tesla-sold-2000000-electric-cars/.
  26. “Aurora Safety Report,” https://aurora.tech/vssa.
  27. M. Quigley, K. Conley, B. Gerkey, J. Faust, T. Foote, J. Leibs, R. Wheeler, and A. Y. Ng, “ROS: an Open-source Robot Operating System,” in ICRA workshop on open source software.   Kobe, Japan, 2009.
  28. N. Kalra and S. M. Paddock, “Driving to Safety: How Many Miles of Driving would it Take to Demonstrate Autonomous Vehicle Reliability?” Transportation Research Part A: Policy and Practice, vol. 94, pp. 182–193, 2016.
  29. “Aurora Scaling Simulation,” https://aurora.tech/blog/scaling-simulation.
  30. “Collision Between Vehicle Controlled by Developmental Automated Driving System and Pedestrian,” https://www.ntsb.gov/investigations/accidentreports/reports/har1903.pdf.
  31. Y. Huai, Y. Chen, S. Almanee, T. Ngo, X. Liao, Z. Wan, Q. A. Chen, and J. Garcia, “Doppelgänger test generation for revealing bugs in autonomous driving software,” in 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE).   IEEE, 2023, pp. 2591–2603.
  32. Z. Wan, J. Shen, J. Chuang, X. Xia, J. Garcia, J. Ma, and Q. A. Chen, “Too afraid to drive: Systematic discovery of semantic dos vulnerability in autonomous driving planning under physical-world attacks,” in ISOC Network and Distributed Systems Security (NDSS) Symposium, 2022.
  33. W. E. Wong, R. Gao, Y. Li, R. Abreu, and F. Wotawa, “A survey on software fault localization,” IEEE Transactions on Software Engineering, vol. 42, no. 8, pp. 707–740, 2016.
  34. Z. Zhong, G. Kaiser, and B. Ray, “Neural network guided evolutionary fuzzing for finding traffic violations of autonomous vehicles,” 2021. [Online]. Available: https://arxiv.org/abs/2109.06126
  35. G. Li, Y. Li, S. Jha, T. Tsai, M. Sullivan, S. K. S. Hari, Z. Kalbarczyk, and R. Iyer, “Av-fuzzer: Finding safety violations in autonomous driving systems,” in 2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE).   IEEE, 2020, pp. 25–36.
  36. D. Liu, C. He, X. Peng, F. Lin, C. Zhang, S. Gong, Z. Li, J. Ou, and Z. Wu, “Microhecl: High-efficient root cause localization in large-scale microservice systems,” in 2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP).   IEEE, 2021, pp. 338–347.
  37. H. Malik, H. Hemmati, and A. E. Hassan, “Automatic detection of performance deviations in the load testing of large scale systems,” in 2013 35th international conference on software engineering (ICSE).   IEEE, 2013, pp. 1012–1021.
  38. V. Murali, E. Yao, U. Mathur, and S. Chandra, “Scalable statistical root cause analysis on app telemetry,” in 2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP).   IEEE, 2021, pp. 288–297.
  39. B. Johnson, Y. Brun, and A. Meliou, “Causal testing: understanding defects’ root causes,” in Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering, 2020, pp. 87–99.
  40. T. Dreossi, A. Donzé, and S. A. Seshia, “Compositional Falsification of Cyber-Physical Systems with Machine Learning Components,” Journal of Automated Reasoning, vol. 63, no. 4, pp. 1031–1053, 2019.
  41. S. A. Seshia, S. Jha, and T. Dreossi, “Semantic Adversarial Deep Learning,” IEEE Design & Test, vol. 37, no. 2, pp. 8–18, 2020.
  42. Y. Jia, Y. Lu, J. Shen, Q. A. Chen, H. Chen, Z. Zhong, and T. Wei, “Fooling Detection Alone is Not Enough: Adversarial Attack against Multiple Object Tracking,” in ICLR, 2020.
  43. E. Khalastchi and M. Kalech, “On fault detection and diagnosis in robotic systems,” ACM Computing Surveys (CSUR), vol. 51, no. 1, pp. 1–24, 2018.
  44. T. Yamaguchi, B. Hoxha, D. Prokhorov, and J. V. Deshmukh, “Specification-guided software fault localization for autonomous mobile systems,” in 2020 18th ACM-IEEE International Conference on Formal Methods and Models for System Design (MEMOCODE).   IEEE, 2020, pp. 1–12.
  45. A. Zeller and R. Hildebrandt, “Simplifying and isolating failure-inducing input,” IEEE Transactions on Software Engineering, vol. 28, no. 2, pp. 183–200, 2002.
  46. B. Paden, M. Čáp, S. Z. Yong, D. Yershov, and E. Frazzoli, “A survey of motion planning and control techniques for self-driving urban vehicles,” IEEE Transactions on intelligent vehicles, vol. 1, no. 1, pp. 33–55, 2016.
  47. Y. Luo, X.-Y. Zhang, P. Arcaini, Z. Jin, H. Zhao, F. Ishikawa, R. Wu, and T. Xie, “Targeting requirements violations of autonomous driving systems by dynamic evolutionary search,” in 2021 36th IEEE/ACM International Conference on Automated Software Engineering (ASE).   IEEE, 2021, pp. 279–291.
  48. H. Tian, Y. Jiang, G. Wu, J. Yan, J. Wei, W. Chen, S. Li, and D. Ye, “Mosat: finding safety violations of autonomous driving systems using multi-objective genetic algorithm,” in Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, 2022, pp. 94–106.
  49. Y. Deng, X. Zheng, M. Zhang, G. Lou, and T. Zhang, “Scenario-based test reduction and prioritization for multi-module autonomous driving systems,” in Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, 2022, pp. 82–93.
  50. Y. Tang, Y. Zhou, T. Zhang, F. Wu, Y. Liu, and G. Wang, “Systematic testing of autonomous driving systems using map topology-based scenario classification,” in 2021 36th IEEE/ACM International Conference on Automated Software Engineering (ASE).   IEEE, 2021, pp. 1342–1346.
  51. Y. Sun, C. M. Poskitt, J. Sun, Y. Chen, and Z. Yang, “Lawbreaker: An approach for specifying traffic laws and fuzzing autonomous vehicles,” in Proceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering, 2022, pp. 1–12.
  52. H. Tian, G. Wu, J. Yan, Y. Jiang, J. Wei, W. Chen, S. Li, and D. Ye, “Generating critical test scenarios for autonomous driving systems via influential behavior patterns,” in Proceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering, 2022, pp. 1–12.
  53. X. Zhang and Y. Cai, “Building critical testing scenarios for autonomous driving from real accidents,” in Proceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis, 2023, pp. 462–474.
  54. M. Cheng, Y. Zhou, and X. Xie, “Behavexplor: Behavior diversity guided testing for autonomous driving systems,” in Proceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis, 2023, pp. 488–500.
  55. “NHSTA’s self driving vehicle crash report,” https://www.nhtsa.gov/technology-innovation/automated-vehicles-safety.
  56. J. Garcia, Y. Feng, J. Shen, S. Almanee, Y. Xia, and Q. A. Chen, “A comprehensive study of autonomous vehicle bugs,” in ICSE ’20: 42nd International Conference on Software Engineering, Seoul, South Korea, 27 June - 19 July, 2020, G. Rothermel and D. Bae, Eds.   ACM, 2020, pp. 385–396. [Online]. Available: https://doi.org/10.1145/3377811.3380397
  57. J. A. Jones and M. J. Harrold, “Empirical evaluation of the tarantula automatic fault-localization technique,” in Proceedings of the 20th IEEE/ACM international Conference on Automated software engineering, 2005, pp. 273–282.
  58. Z. He, Y. Chen, E. Huang, Q. Wang, Y. Pei, and H. Yuan, “A system identification based oracle for control-cps software fault localization,” in 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE).   IEEE, 2019, pp. 116–127.
  59. S. Jha, S. S. Banerjee, J. Cyriac, Z. T. Kalbarczyk, and R. K. Iyer, “Avfi: Fault injection for autonomous vehicles,” in 2018 48th annual ieee/ifip international conference on dependable systems and networks workshops (dsn-w).   IEEE, 2018, pp. 55–56.
  60. S. Jha, T. Tsai, S. Hari, M. Sullivan, Z. Kalbarczyk, S. W. Keckler, and R. K. Iyer, “Kayotee: A fault injection-based system to assess the safety and reliability of autonomous vehicles to faults and errors,” arXiv preprint arXiv:1907.01024, 2019.
  61. S. Jha, S. Banerjee, T. Tsai, S. K. Hari, M. B. Sullivan, Z. T. Kalbarczyk, S. W. Keckler, and R. K. Iyer, “Ml-based fault injection for autonomous vehicles: A case for bayesian fault injection,” in 2019 49th annual IEEE/IFIP international conference on dependable systems and networks (DSN).   IEEE, 2019, pp. 112–124.
  62. “Exploring the 5 W’s of Full AV Stacks,” https://www.eetasia.com/exploring-the-5-ws-of-full-av-stacks/.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets