Developing a Taxonomy of Elements Adversarial to Autonomous Vehicles (2403.00136v1)
Abstract: As highly automated vehicles reach higher deployment rates, they find themselves in increasingly dangerous situations. Knowing that the consequence of a crash is significant for the health of occupants, bystanders, and properties, as well as to the viability of autonomy and adjacent businesses, we must search for more efficacious ways to comprehensively and reliably train autonomous vehicles to better navigate the complex scenarios with which they struggle. We therefore introduce a taxonomy of potentially adversarial elements that may contribute to poor performance or system failures as a means of identifying and elucidating lesser-seen risks. This taxonomy may be used to characterize failures of automation, as well as to support simulation and real-world training efforts by providing a more comprehensive classification system for events resulting in disengagement, collision, or other negative consequences. This taxonomy is created from and tested against real collision events to ensure comprehensive coverage with minimal class overlap and few omissions. It is intended to be used both for the identification of harm-contributing adversarial events and in the generation thereof (to create extreme edge- and corner-case scenarios) in training procedures.
- K. Othman, “Exploring the implications of autonomous vehicles: A comprehensive review,” Innovative Infrastructure Solutions, vol. 7, no. 2, p. 165, 2022.
- S. of Automotive Engineers, “Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles,” SAE International, Tech. Rep. J3016_201609, 2016. [Online]. Available: https://www.sae.org/standards/content/j3016_202104/
- T. Tadani, “Freak accident in san francisco traps pedestrian under robotaxi,” The Washington Post, 3 Oct 2023. [Online]. Available: https://www.washingtonpost.com/technology/2023/10/03/cruise-self-driving-car-san-francisco/
- K. Karur, N. Sharma, C. Dharmatti, and J. E. Siegel, “A survey of path planning algorithms for mobile robots,” Vehicles, vol. 3, no. 3, pp. 448–468, 2021. [Online]. Available: https://www.mdpi.com/2624-8921/3/3/27
- W. Huang, K. Wang, Y. Lv, and F. Zhu, “Autonomous vehicles testing methods review,” in 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC), 2016, pp. 163–168.
- F. Rosique, P. J. Navarro, C. Fernández, and A. Padilla, “A systematic review of perception system and simulators for autonomous vehicles research,” Sensors, vol. 19, no. 3, 2019. [Online]. Available: https://www.mdpi.com/1424-8220/19/3/648
- P. Gupta, D. Coleman, and J. E. Siegel, “Towards physically adversarial intelligent networks (pains) for safer self-driving,” IEEE Control Systems Letters, vol. 7, pp. 1063–1068, 2023.
- F. Ellsaesser, G. Fioretti, and G. E. James, “Measuring non-probabilistic uncertainty: A cognitive, logical and computational assessment of known and unknown unknowns,” 2023.
- P. J. Talbot, “Automated discovery of unknown unknowns,” in MILCOM 2006 - 2006 IEEE Military Communications conference, 2006, pp. 1–7.
- H. Alambeigi, A. D. McDonald, and S. R. Tankasala, “Crash themes in automated vehicles: A topic modeling analysis of the california department of motor vehicles automated vehicle crash database,” 2020.
- M. Capallera, Q. Meteier, E. de Salis, L. Angelini, S. Carrino, O. A. Khaled, and E. Mugellini, “Owner manuals review and taxonomy of adas limitations in partially automated vehicles,” in Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, ser. AutomotiveUI ’19. New York, NY, USA: Association for Computing Machinery, 2019, p. 156–164. [Online]. Available: https://doi.org/10.1145/3342197.3344530
- A. J. Ramirez, A. C. Jensen, and B. H. C. Cheng, “A taxonomy of uncertainty for dynamically adaptive systems,” in 2012 7th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS), 2012, pp. 99–108.
- G. Bagschik, T. Menzel, and M. Maurer, “Ontology based scene creation for the development of automated vehicles,” in 2018 IEEE Intelligent Vehicles Symposium (IV), 2018, pp. 1813–1820.
- J. Sauerbier, J. Bock, H. Weber, and L. Eckstein, “Definition of scenarios for safety validation of automated driving functions,” ATZ worldwide, vol. 121, pp. 42–45, 01 2019.
- Q. Liu, X. Wang, X. Wu, Y. Glaser, and L. He, “Crash comparison of autonomous and conventional vehicles using pre-crash scenario typology,” Accident Analysis & Prevention, vol. 159, p. 106281, 2021. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0001457521003122
- L. Halilaj, I. Dindorkar, J. Lüttin, and S. Rothermel, “A knowledge graph-based approach for situation comprehension in driving scenarios,” in The Semantic Web. Springer International Publishing, 2021, pp. 699–716.
- S. Riedmaier, T. Ponn, D. Ludwig, B. Schick, and F. Diermeyer, “Survey on scenario-based safety assessment of automated vehicles,” IEEE Access, vol. 8, pp. 87 456–87 477, 2020.
- W. Ding, C. Xu, M. Arief, H. Lin, B. Li, and D. Zhao, “A survey on safety-critical driving scenario generation—a methodological perspective,” IEEE Transactions on Intelligent Transportation Systems, vol. 24, no. 7, pp. 6971–6988, 2023.
- State of California Department of Motor Vehicles, “Autonomous vehicle collision reports.” [Online]. Available: https://www.dmv.ca.gov/portal/vehicle-industry-services/autonomous-vehicles/autonomous-vehicle-collision-reports/
- Z. Zhong, Y. Tang, Y. Zhou, V. de Oliveira Neves, Y. Liu, and B. Ray, “A survey on scenario-based testing for automated driving systems in high-fidelity simulation,” ArXiv, vol. abs/2112.00964, 2021. [Online]. Available: https://api.semanticscholar.org/CorpusID:244798609
- Q. Chao, H. Bi, W. Li, T. Mao, Z. Wang, and M. Lin, “A survey on visual traffic simulation: Models, evaluations, and applications in autonomous driving,” Computer Graphics Forum, vol. 39, 07 2019.
- M. Vanžura, M. Bureš, and K. Metivier, “Autonomous vehicle crashes.” [Online]. Available: https://www.avcrashes.net/
- International Organization of Standards, “Road vehicles — functional safety,” International Organization of Standards, Tech. Rep. 26262-1:2018, Dec 2018. [Online]. Available: https://www.iso.org/standard/68383.html
- J. Siegel, S. Kumar, I. Ehrenberg, and S. Sarma, “Engine misfire detection with pervasive mobile audio,” in Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2016, Riva del Garda, Italy, September 19-23, 2016, Proceedings, Part III 16. Springer International Publishing, 2016, pp. 226–241.
- J. Siegel, R. Bhattacharyya, A. Deshpande, and S. Sarma, “Vehicular engine oil service life characterization using on-board diagnostic (obd) sensor data,” in SENSORS, 2014 IEEE, 2014, pp. 1722–1725.
- ——, “Smartphone-based wheel imbalance detection,” in Dynamic Systems and Control Conference, 2015.
- ——, “Smartphone-based vehicular tire pressure and condition monitoring,” in SAI Intelligent Systems Conference. IEEE, 2016, pp. 446–455.
- J. E. Siegel, R. Bhattacharyya, S. Kumar, and S. E. Sarma, “Air filter particulate loading detection using smartphone audio and optimized ensemble classification,” Engineering Applications of Artificial Intelligence, vol. 66, pp. 104–112, 2017.
- J. Siegel, Y. Sun, and S. Sarma, “Automotive diagnostics as a service: An artificially intelligent mobile application for tire condition assessment,” in Lecture Notes in Computer Science: Artificial Intelligence and Mobile Services (AIMS) 2018, 2018.
- J. Siegel, U. Coda, and A. Terwilliger, “Surveying off-board and extra-vehicular monitoring and progress towards pervasive diagnostics,” SAE International Journal of Connected and Automated Vehicles, 2021.
- A. M. Terwilliger and J. E. Siegel, “The ai mechanic: Acoustic vehicle characterization neural networks,” arXiv preprint arXiv:2205.09667, 2022.
- ——, “Improving misfire fault diagnosis with cascading architectures via acoustic vehicle characterization,” Sensors, vol. 22, no. 20, p. 7736, 2022.
- A. Morando, P. Gershon, B. Mehler, and B. Reimer, “Visual attention and steering wheel control: From engagement to disengagement of tesla autopilot,” Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 65, no. 1, pp. 1390–1394, 2021. [Online]. Available: https://doi.org/10.1177/1071181321651118
- National Highway Traffic Safety Administration, “Federal motor vehicle safety standards,” Code of Federal Regulations, Tech. Rep., 1967. [Online]. Available: https://www.ecfr.gov/current/title-49/subtitle-B/chapter-V/part-571
- ——, “Test procedures,” National Highway Traffic Safety Administration, Tech. Rep. [Online]. Available: https://www.nhtsa.gov/vehicle-manufacturers/test-procedures
- Insurance Institute for Highway Safety and Highway Loss Data Institute, “Test protocols and technical information,” Insurance Institute for Highway Safety and Highway Loss Data Institute, Tech. Rep. [Online]. Available: https://www.iihs.org/ratings/about-our-tests/test-protocols-and-technical-information
- Reginald Stuart, “Ford orders recall of 1.5 million pintos for safety changes,” The New York Times, 10 Jun 1078. [Online]. Available: https://www.nytimes.com/1978/06/10/archives/ford-orders-recall-of-15-million-pintos-for-safety-changes-inquiry.html
- S. Campbell, N. O’Mahony, L. Krpalcova, D. Riordan, J. Walsh, A. Murphy, and C. Ryan, “Sensor technology in autonomous vehicles : A review,” in 2018 29th Irish Signals and Systems Conference (ISSC), 2018, pp. 1–4.
- J. E. Siegel, D. C. Erb, and S. E. Sarma, “A survey of the connected vehicle landscape—architectures, enabling technologies, applications, and development areas,” IEEE Transactions on Intelligent Transportation Systems, vol. 19, no. 8, pp. 2391–2406, 2018.
- C. Miller and C. Valasek, “Securing self-driving cars (one company at a time),” https://illmatics.com/carhacking.html, Tech. Rep., Aug 2018. [Online]. Available: https://illmatics.com/securing_self_driving_cars.pdf
- V. L. Thing and J. Wu, “Autonomous vehicle security: A taxonomy of attacks and defences,” in 2016 IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData), 2016, pp. 164–170.
- E. Wilhelm, J. Siegel, S. Mayer, L. Sadamori, S. Dsouza, C.-K. Chau, and S. Sarma, “Cloudthink: A scalable secure platform for mirroring transportation systems in the cloud,” Transport, vol. 30, pp. 320–329, 07 2015.
- R. Elliott and G. Vipers, “Tesla to recall more than two million vehicles over autopilot safety concerns,” The Wall Street Journal, 13 Dec 2023. [Online]. Available: https://www.wsj.com/business/autos/tesla-recalls-more-than-two-million-vehicles-over-autopilot-safety-concerns-274eb6e6
- C. Miller and C. Valasek, “Remote exploitation of an unaltered passenger vehicle,” https://illmatics.com/carhacking.html, Tech. Rep., 10 Aug 2015. [Online]. Available: https://illmatics.com/Remote%20Car%20Hacking.pdf
- K. Koscher, A. Czeskis, F. Roesner, S. Patel, T. Kohno, S. Checkoway, D. McCoy, B. Kantor, D. Anderson, H. Shacham, and S. Savage, “Experimental security analysis of a modern automobile,” in 2010 IEEE Symposium on Security and Privacy, 2010, pp. 447–462.
- S. Bouchelaghem, A. Bouabdallah, and M. Omar, “Autonomous vehicle security: Literature review of real attack experiments,” in Risks and Security of Internet and Systems. Springer International Publishing, 2021, pp. 255–272.
- A. Nanda, D. Puthal, J. J. P. C. Rodrigues, and S. A. Kozlov, “Internet of autonomous vehicles communications security: Overview, issues, and directions,” IEEE Wireless Communications, vol. 26, no. 4, pp. 60–65, 2019.
- K. Kim, J. S. Kim, S. Jeong, J.-H. Park, and H. K. Kim, “Cybersecurity for autonomous vehicles: Review of attacks and defense,” Computers & Security, vol. 103, p. 102150, 2021. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0167404820304235
- J. Cui, L. S. Liew, G. Sabaliauskaite, and F. Zhou, “A review on safety failures, security attacks, and available countermeasures for autonomous vehicles,” Ad Hoc Networks, vol. 90, p. 101823, 2019, recent advances on security and privacy in Intelligent Transportation Systems. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S1570870518309260
- D. Suo, J. E. Siegel, and S. E. Sarma, “Merging safety and cybersecurity analysis in product design,” IET Intelligent Transport Systems, vol. 12, no. 9, pp. 1103–1109, 2018.
- G. Falco and J. E. Siegel, “A distributed ‘black box’ audit trail design specification for connected and automated vehicle data and software assurance,” SAE Journal of Transportation Cybersecurity and Privacy, 2020.
- D. Kent, B. H. Cheng, and J. Siegel, “Assuring vehicle update integrity using asymmetric public key infrastructure (pki) and public key cryptography (pkc),” SAE International Journal of Transportation Cybersecurity and Privacy, 2020.
- L. J. Moukahal, M. Zulkernine, and M. Soukup, “Vulnerability-oriented fuzz testing for connected autonomous vehicle systems,” IEEE Transactions on Reliability, vol. 70, no. 4, pp. 1422–1437, 2021.
- Safety Research & Strategies, “Nhtsa gets real on tire fatalities,” Safety Research & Strategies, 26 Sep 2018. [Online]. Available: https://www.safetyresearch.net/nhtsa-gets-real-on-tire-fatalities/
- “Vehicle in use inspection standards,” Code of Federal Regulations, Tech. Rep. [Online]. Available: https://www.ecfr.gov/current/title-49/subtitle-B/chapter-V/part-570
- New York State Department of Motor Vehicles, “New york state vehicle safety / emissions inspection program,” dmv.ny.gov. [Online]. Available: https://dmv.ny.gov/brochure/new-york-state-vehicle-safetyemissions-inspection-program
- H.-B. Jun, F. Conte, D. Kiritsis, and P. Xirouchakis, “A predictive algorithm for estimating the quality of vehicle engine oil,” International Journal of Industrial Engineering : Theory Applications and Practice, vol. 15, 12 2008.
- J. Siegel and R. Bhattacharyya, “Applying motion sensor data to wheel imbalance detection, tire pressure monitoring, and/or tread depth measurement,” 11 Oct 2020, u. S. Patent 10,830,908.
- National Highway Traffic Safety Administration, “Traffic safety facts - distracted driving in 2021,” U.S. Department of Transportation, Tech. Rep., May 2023. [Online]. Available: https://crashstats.nhtsa.dot.gov/Api/Public/ViewPublication/813443
- D. L. Bakowski, S. T. Davis, and W. F. Moroney, “Reaction time and glance behavior of visually distracted drivers to an imminent forward collision as a function of training, auditory warning, and gender,” Procedia Manufacturing, vol. 3, pp. 3238–3245, 2015. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S2351978915008768
- B.-G. Lee and W.-Y. Chung, “Driver alertness monitoring using fusion of facial features and bio-signals,” IEEE Sensors Journal, vol. 12, no. 7, pp. 2416–2422, 2012.
- E. Coelingh, A. Eidehall, and M. Bengtsson, “Collision warning with full auto brake and pedestrian detection - a practical example of automatic emergency braking,” in 13th International IEEE Conference on Intelligent Transportation Systems, 2010, pp. 155–160.
- A. Mammeri, G. Lu, and A. Boukerche, “Design of lane keeping assist system for autonomous vehicles,” in 2015 7th International Conference on New Technologies, Mobility and Security (NTMS), 2015, pp. 1–5.
- Euro NCAP, “Safety assist,” European New Car Assessment Programme. [Online]. Available: https://www.euroncap.com/en/car-safety/the-ratings-explained/
- K. Chan, S. Zilberman, N. Polanco, B. H. Cheng, and J. Siegel, “SafeDriveRL: Combining non-cooperative game theory with reinforcement learning to explore and mitigate human-based uncertainty for autonomous vehicles,” in 2024 IEEE/ACM 18th Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS). IEEE, 2024.
- T. Thadani, R. Lerman, I. Piper, F. Siddiqui, and I. Uraizee, “The final 11 seconds of a fatal tesla autopilot crash,” The Washington Post, 6 oct 2023. [Online]. Available: https://www.washingtonpost.com/technology/interactive/2023/tesla-autopilot-crash-analysis/
- Working Party on Lighting and Light-Signalling, World Forum for Harmonization of Vehicle Regulations. [Online]. Available: https://unece.org/transport/vehicle-regulations/documents-reference-only
- M. V. CODE, “257.684 Head lamps; lighting, distance, height,” Michigan Legislature, 1949. [Online]. Available: http://legislature.mi.gov/doc.aspx?mcl-257-684
- Revised Code of Washington, “When lighted lamps and signaling devices are required,” Washington State Legislature, 1977. [Online]. Available: https://app.leg.wa.gov/rcw/default.aspx?cite=46.37.020
- VEHICLE CODE, “Article 2. headlamps and auxiliary lamps,” California Legislature, 1959. [Online]. Available: https://leginfo.legislature.ca.gov/faces/codes_displayText.xhtml?lawCode=VEH\&division=12.\&title=\&part=\&chapter=2.\&article=2
- Driver and Vehicle Standards Agency, “Daytime running lights,” Department for Transport, 1 Nov 2010. [Online]. Available: https://www.gov.uk/government/publications/daytime-running-lights/daytime-running-lights
- B. Shahian Jahromi, T. Tulabandhula, and S. Cetin, “Real-time hybrid multi-sensor fusion framework for perception in autonomous vehicles,” Sensors, vol. 19, no. 20, 2019. [Online]. Available: https://www.mdpi.com/1424-8220/19/20/4357
- Y. Zhang, A. Carballo, H. Yang, and K. Takeda, “Perception and sensing for autonomous vehicles under adverse weather conditions: A survey,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 196, pp. 146–177, 2023. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0924271622003367
- D. Lavrinc, “This is how bad self-driving cars suck in rain,” Jalopnik, 3 Dec 2014. [Online]. Available: https://jalopnik.com/this-is-how-badself-driving-cars-suck-in-the-rain-1666268433
- M. Elhoseiny, S. Huang, and A. Elgammal, “Weather classification with deep convolutional neural networks,” in 2015 IEEE International Conference on Image Processing (ICIP), 2015, pp. 3349–3353.
- Z. Zhang and H. Ma, “Multi-class weather classification on single images,” in 2015 IEEE International Conference on Image Processing (ICIP), 2015, pp. 4396–4400.
- M. M. Dhananjaya, V. R. Kumar, and S. Yogamani, “Weather and light level classification for autonomous driving: Dataset, baseline and active learning,” in 2021 IEEE International Intelligent Transportation Systems Conference (ITSC), 2021, pp. 2816–2821.
- J. Wang, Z. Wu, Y. Liang, J. Tang, and H. Chen, “Perception methods for adverse weather based on vehicle infrastructure cooperation system: A review,” Sensors, vol. 24, no. 2, 2024. [Online]. Available: https://www.mdpi.com/1424-8220/24/2/374
- H. Du, P. Jones, E. Lucas Segarra, and C. Fernandez Bandera, “Development of a rest api for obtaining site-specific historical and near-future weather data in epw format,” 09 2018.
- E. Yurtsever, J. Lambert, A. Carballo, and K. Takeda, “A survey of autonomous driving: Common practices and emerging technologies,” IEEE Access, vol. 8, pp. 58 443–58 469, 2020.
- J. E. Siegel, D. C. Erb, and S. E. Sarma, “Algorithms and architectures: A case study in when, where and how to connect vehicles,” IEEE Transactions on Intelligent Transportation Systems Magazine, vol. 10, no. 1, pp. 74–87, 2018.
- J. R. Vargas Rivero, T. Gerbich, V. Teiluf, B. Buschardt, and J. Chen, “Weather classification using an automotive lidar sensor based on detections on asphalt and atmosphere,” Sensors, vol. 20, no. 15, 2020. [Online]. Available: https://www.mdpi.com/1424-8220/20/15/4306
- J. Barnett, N. Gizinski, E. Mondragón-Parra, J. Siegel, D. Morris, T. Gates, E. Kassens-Noor, and P. Savolainen, “Automated vehicles sharing the road: Surveying detection and localization of pedalcyclists,” IEEE Transactions on Intelligent Vehicles, vol. 6, no. 4, pp. 649–664, 2020.
- National Highway Traffic Safety Administration, “Traffic safety facts 2021 a compilation of motor vehicle traffic crash data,” U.S. Department of Transportation, Tech. Rep., 2023. [Online]. Available: https://crashstats.nhtsa.dot.gov/Api/Public/ViewPublication/813527
- J. Siegel and G. Pappas, “Morals, ethics, and the technology capabilities and limitations of automated and self-driving vehicles,” AI & Society, 2021.
- E. Kassens-Noor, J. Siegel, and T. Decaminada, “Choosing ethics over morals: A possible determinant to embracing artificial intelligence in future urban mobility,” Frontiers in Sustainable Cities, vol. 3, p. 108, 2021.
- G. Pappas, J. E. Siegel, E. Kassens-Noor, J. Rutkowski, K. Politopoulos, and A. A. Zorpas, “Game-based simulation and study of pedestrian-automated vehicle interactions,” Automation, 2022.
- F. Kunkle, “Fatal crash with self-driving car was a first — like bridget driscoll’s was 121 years ago with one of the first cars,” The Washington Post, 22 Mar 2018. [Online]. Available: https://www.washingtonpost.com/news/tripping/wp/2018/03/22/fatal-crash-with-self-driving-car-was-a-first-like-bridget-driscolls-was-121-years-ago-with-one-of-the-first-cars/
- W. L. Kelley, “Collision predicting and avoidance device for moving vehicles,” 15 May 1990, u.S. Patent 4,926,171. [Online]. Available: https://patents.justia.com/patent/4926171
- R. Mai, R. Bergholz, E. Lissel, and F. Van Meel, “Automatic emergency braking method and arrangement,” 4 July 2000, u.S. Patent 6,084,508 A. [Online]. Available: https://patents.google.com/patent/US6084508A/en
- S. Iftikhar, Z. Zhang, M. Asim, A. Muthanna, A. Koucheryavy, and A. A. Abd El-Latif, “Deep learning-based pedestrian detection in autonomous vehicles: Substantial issues and challenges,” Electronics, vol. 11, no. 21, 2022. [Online]. Available: https://www.mdpi.com/2079-9292/11/21/3551
- D. J. Green, G. R. Letendre, B. A. Parks, M. Schramm, R. Zlotnikov, B. W. Smith, M. P. Jordan, and M. J. Ravenberg, “Active vehicle hood system and method,” 4 Dec 2007, u.S. Patent 7,303,040 B2. [Online]. Available: https://patents.google.com/patent/US7303040B2/en
- M. Schratter, M. Hartmann, and D. Watzenig, “Pedestrian collision avoidance system for autonomous vehicles,” SAE International Journal of Connected and Automated Vehicles, vol. 2, no. 12-02-04-0021, pp. 279–293, 2019.
- G. Pappas, J. E. Siegel, J. Rutkowski, and A. Schaaf, “Game and simulation design for studying pedestrian-automated vehicle interactions,” 2021.
- N. C. d. Carvalho, M. O. Bordignon, and J. T. Shapiro, “Fast and furious: a look at the death of animals on the highway ms-080, southwestern brazil,” Iheringia. Série Zoologia, vol. 104, pp. 43–49, 2014.
- J. Kioko, C. Kiffner, N. Jenkins, and W. J. Collinson, “Wildlife roadkill patterns on a major highway in northern tanzania,” African Zoology, vol. 50, no. 1, pp. 17–22, 2015.
- R. Horowitch, “Self-driving waymo car kills dog amid increasing concern over robotaxis,” The Guardian, 7 Jun 2023. [Online]. Available: https://www.theguardian.com/us-news/2023/jun/07/waymo-car-kills-dog-self-driving-robotaxi-san-francisco
- C. Einhorn, “How do animals safely cross a highway? take a look,” The New York Times, 31 May 2021. [Online]. Available: https://www.nytimes.com/interactive/2021/05/31/climate/wildlife-crossings-animals.html
- A. Saxena, D. K. Gupta, and S. Singh, “An animal detection and collision avoidance system using deep learning,” in Advances in Communication and Computational Technology. Singapore: Springer Nature Singapore, 2021, pp. 1069–1084.
- I. Nandutu, M. Atemkeng, and P. Okouma, “Intelligent systems using sensors and/or machine learning to mitigate wildlife-vehicle collisions: A review, challenges, and new perspectives,” Sensors, vol. 22, no. 7, 2022. [Online]. Available: https://www.mdpi.com/1424-8220/22/7/2478
- D. Forslund and J. Bjärkefur, “Night vision animal detection,” in 2014 IEEE Intelligent Vehicles Symposium Proceedings, 2014, pp. 737–742.
- S. D. Meena and L. Agilandeeswari, “Smart animal detection and counting framework for monitoring livestock in an autonomous unmanned ground vehicle using restricted supervised learning and image fusion,” Neural Process. Lett., vol. 53, no. 2, p. 1253–1285, apr 2021. [Online]. Available: https://doi.org/10.1007/s11063-021-10439-4
- National Highway Traffic Safety Administration, “Traffic safety facts - critical reasons for crashes investigated in the national motor vehicle crash causation survey,” U.S. Department of Transportation, Tech. Rep., Mar 2018. [Online]. Available: https://crashstats.nhtsa.dot.gov/Api/Public/ViewPublication/812506
- J. Huang, P. K. Choudhury, S. Yin, and L. Zhu, “Real-time road curb and lane detection for autonomous driving using lidar point clouds,” IEEE Access, vol. 9, pp. 144 940–144 951, 2021.
- R. Kaddis, E. Stading, A. Bhuptani, H. Song, C.-J. Chung, and J. Siegel, “Developing, analyzing, and evaluating self-drive algorithms using electric vehicles on a test course,” in REU Research in Networking and Systems, 2022.
- S. Rao, A. Quezada, S. Rodriquez, C. Chinolla, C.-J. Chung, and J. Siegel, “Developing, analyzing, and evaluating vehicular lane keeping algorithms using electric vehicles,” Vehicles, vol. 4, no. 4, pp. 1012–1041, 2022.
- S. Shah, B. Franz, T. Forgach, M. Jostes, J. Siegel, and C.-J. Chung, “Comparing traditional computer vision algorithms and deep convolutional neural networks as self driving algorithms for use in dynamic conditions,” in 2023 IEEE MIT Undergraduate Research Technology Conference, 2023.
- Z. Kim, “Robust lane detection and tracking in challenging scenarios,” IEEE Transactions on Intelligent Transportation Systems, vol. 9, no. 1, pp. 16–26, 2008.
- A. Assidiq, O. O. Khalifa, M. R. Islam, and S. Khan, “Real time lane detection for autonomous vehicles,” in 2008 International Conference on Computer and Communication Engineering, 2008, pp. 82–88.
- A. de la Escalera, L. Moreno, M. Salichs, and J. Armingol, “Road traffic sign detection and classification,” IEEE Transactions on Industrial Electronics, vol. 44, no. 6, pp. 848–859, 1997.
- S. B. Wali, M. A. Abdullah, M. A. Hannan, A. Hussain, S. A. Samad, P. J. Ker, and M. B. Mansor, “Vision-based traffic sign detection and recognition systems: Current trends and challenges,” Sensors, vol. 19, no. 9, 2019. [Online]. Available: https://www.mdpi.com/1424-8220/19/9/2093
- L. H. Angelica F. Magnussen, Nathan Le and W. E. Wong, “A survey of the inadequacies in traffic sign recognition systems for autonomous vehicles,” International Journal of Performability Engineering, vol. 16, no. 10, p. 1588, 2020. [Online]. Available: https://www.ijpe-online.com/EN/abstract/article_4490.shtml
- K. Eykholt, I. Evtimov, E. Fernandes, B. Li, A. Rahmati, C. Xiao, A. Prakash, T. Kohno, and D. Song, “Robust physical-world attacks on deep learning visual classification,” in 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018, pp. 1625–1634.
- J. Lu, H. Sibai, E. Fabry, and D. Forsyth, “No need to worry about adversarial examples in object detection in autonomous vehicles,” 2017.
- S. Mayer and J. Siegel, “Conversations with connected vehicles,” in Internet of Things, 2015.
- J. E. Siegel, “Cloudthink and the avacar: Embedded design to create virtual vehicles for cloud-based informatics, telematics, and infotainment,” Ph.D. dissertation, Massachusetts Institute of Technology, 2013.
- ——, “Data proxies, the cognitive layer, and application locality: enablers of cloud-connected vehicles and next-generation internet of things,” Ph.D. dissertation, Massachusetts Institute of Technology, 2016.
- ——, “Design, development, and validation of a remotely reconfigurable vehicle telemetry system for consumer and government applications,” Ph.D. dissertation, Massachusetts Institute of Technology, 2011.
- G. Pappas, J. Siegel, and K. Politopoulos, “Virtualcar: Virtual mirroring of iot-enabled avacars in ar, vr and desktop applications,” 2018.
- A. Soley, J. Siegel, D. Suo, and S. Sarma, “Value in vehicles: Economic assessment of automotive data,” Digital Policy, Regulation and Governance, 2018.
- F. Masud, “Car breakdowns due to potholes soar in rainy july,” BBC, 21 Aug 2023. [Online]. Available: https://www.bbc.com/news/business-66569152
- J. Eriksson, L. Girod, B. Hull, R. Newton, S. Madden, and H. Balakrishnan, “The pothole patrol: using a mobile sensor network for road surface monitoring,” in Proceedings of the 6th International Conference on Mobile Systems, Applications, and Services, ser. MobiSys ’08. New York, NY, USA: Association for Computing Machinery, 2008, p. 29–39. [Online]. Available: https://doi.org/10.1145/1378600.1378605
- D. K. Dewangan and S. P. Sahu, “Potnet: Pothole detection for autonomous vehicle system using convolutional neural network,” Electronics Letters, vol. 57, no. 2, pp. 53–56, 2021.
- A. Talha, M. Karasneh, D. Manasreh, A. Oide, and M. Nazzal, “A lidar-camera fusion approach for automated detection and assessment of potholes using an autonomous vehicle platform,” Innovative Infrastructure Solutions, vol. 8, 09 2023.
- R. Madli, S. Hebbar, P. Pattar, and V. Golla, “Automatic detection and notification of potholes and humps on roads to aid drivers,” IEEE Sensors Journal, vol. 15, no. 8, pp. 4313–4318, 2015.
- X. Yu and M. Marinov, “A study on recent developments and issues with obstacle detection systems for automated vehicles,” Sustainability, vol. 12, no. 8, 2020. [Online]. Available: https://www.mdpi.com/2071-1050/12/8/3281
- M. Islam, M. Chowdhury, H. Li, and H. Hu, “Vision-based navigation of autonomous vehicles in roadway environments with unexpected hazards,” Transportation Research Record, vol. 2673, no. 12, pp. 494–507, 2019. [Online]. Available: https://doi.org/10.1177/0361198119855606
- M. A. Abbas, R. Milman, and J. M. Eklund, “Obstacle avoidance in real time with nonlinear model predictive control of autonomous vehicles,” Canadian Journal of Electrical and Computer Engineering, vol. 40, no. 1, pp. 12–22, 2017.
- M. Khalfin, J. Volgren, L. LeGoullon, S. Shah, T. Forgach, M. Jones, M. Jostes, R. Kaddis, C.-J. Chung, and J. Siegel, “Vehicle-to-everything communication using a roadside unit for over-the-horizon object awareness,” in IEOM International Conference on Smart Mobility and Vehicle Electrification, 2023.
- D. Walker, L. Entine, and S. Kummer, “Pavement surface evaluation and rating manual,” University of Wisconsin-Madison Transportation Information Center, 2002. [Online]. Available: https://www.apa-mi.org/docs/Asphalt-PASERManual.pdf
- K. Berntorp, R. Quirynen, T. Uno, and S. Di Cairano, “Trajectory tracking for autonomous vehicles on varying road surfaces by friction-adaptive nonlinear model predictive control,” Vehicle System Dynamics, vol. 58, no. 5, pp. 705–725, 2020.
- Z. Zhu, N. Li, R. Sun, D. Xu, and H. Zhao, “Off-road autonomous vehicles traversability analysis and trajectory planning based on deep inverse reinforcement learning,” in 2020 IEEE Intelligent Vehicles Symposium (IV), 2020, pp. 971–977.
- A. Olia, S. Razavi, B. Abdulhai, and H. Abdelgawad, “Traffic capacity implications of automated vehicles mixed with regular vehicles,” Journal of Intelligent Transportation Systems, vol. 22, no. 3, pp. 244–262, 2018.
- N. E. Boudette, “Federal safety agency expands its investigation of tesla’s autopilot system,” The New York Times, 9 Jun 2022. [Online]. Available: https://www.nytimes.com/2022/06/09/business/tesla-autopilot-nhtsa-investigation.html
- H. Sun, X. Liu, K. Xu, J. Miao, and Q. Luo, “Emergency vehicles audio detection and localization in autonomous driving,” 2021.
- T. Jackman, O. Daniels, and I. Duncan, “Commuter plane lands on loudoun county parkway, with no one hurt,” The Washington Post, 19 Jan 2024. [Online]. Available: https://www.washingtonpost.com/dc-md-va/2024/01/19/small-plane-lands-loudoun-county-parkway-no-one-hurt/
- A. Rozantsev, V. Lepetit, and P. Fua, “Detecting flying objects using a single moving camera,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 39, no. 5, pp. 879–892, 2017.
- M. Vrba, V. Walter, V. Pritzl, M. Pliska, T. Báča, V. Spurný, D. Heřt, and M. Saska, “On onboard lidar-based flying object detection,” 2023.
- B. Anderson, “Overpass collapses on car after being hit by concrete truck,” Carscoops, 12 Nov 2020. [Online]. Available: https://www.carscoops.com/2020/11/overpass-collapses-on-car-after-being-hit-by-concrete-truck/
- S. Sun and Y. D. Zhang, “4d automotive radar sensing for autonomous vehicles: A sparsity-oriented approach,” IEEE Journal of Selected Topics in Signal Processing, vol. 15, no. 4, pp. 879–891, 2021.
- M. Saffary, “Evaluation Data for Taxonomy of Adversarial Elements to Autonomous Vehicles,” 2024. [Online]. Available: https://doi.org/10.7910/DVN/RTX36U
Collections
Sign up for free to add this paper to one or more collections.