Scoping Out the Scalability Issues of Autonomous Vehicle-Pedestrian Interaction (2403.05727v1)
Abstract: Autonomous vehicles (AVs) may use external interfaces, such as LED light bands, to communicate with pedestrians safely and intuitively. While previous research has demonstrated the effectiveness of these interfaces in simple traffic scenarios involving one pedestrian and one vehicle, their performance in more complex scenarios with multiple road users remains unclear. The scalability of AV external communication has therefore attracted increasing attention, prompting the need for further investigation. This scoping review synthesises information from 54 papers to identify seven key scalability issues in multi-vehicle and multi-pedestrian environments, with Clarity of Recipients, Information Overload, and Multi-Lane Safety emerging as the most pressing concerns. To guide future research in scalable AV-pedestrian interactions, we propose high-level design directions focused on three communication loci: vehicle, infrastructure, and pedestrian. Our work contributes the groundwork and a roadmap for designing simplified, coordinated, and targeted external AV communication, ultimately improving safety and efficiency in complex traffic scenarios.
- An experimental study to investigate design and assessment criteria: What is important for communication between pedestrians and automated vehicles? Applied Ergonomics 75 (2019), 272–282. https://doi.org/10.1016/j.apergo.2018.11.002
- The Effects of Explicit Intention Communication, Conspicuous Sensors, and Pedestrian Attitude in Interactions with Automated Vehicles. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376197
- Autonomous vehicle technology: A guide for policymakers. Rand Corporation, Santa Monica, CA, USA.
- Hello human, can you read my mind? ERCIM News 109 (2017), 36–37.
- Hilary Arksey and Lisa O’Malley. 2005. Scoping studies: towards a methodological framework. International Journal of Social Research Methodology 8, 1 (2005), 19–32. https://doi.org/10.1080/1364557032000119616
- Co-Designing Interactions between Pedestrians in Wheelchairs and Autonomous Vehicles. In Designing Interactive Systems Conference 2021 (Virtual Event, USA) (DIS ’21). Association for Computing Machinery, New York, NY, USA, 339–351. https://doi.org/10.1145/3461778.3462068
- Ronald T. Azuma. 2019. The road to ubiquitous consumer augmented reality systems. Human Behavior and Emerging Technologies 1, 1 (2019), 26–32. https://doi.org/10.1002/hbe2.113
- Coupled simulator for research on the interaction between pedestrians and (automated) vehicles. In Driving Simulation Conference Europe. Driving Simulation Association, Antibes, France, 2 pages.
- The Best Rated Human–Machine Interface Design for Autonomous Vehicles in the 2016 Grand Cooperative Driving Challenge. IEEE Transactions on Intelligent Transportation Systems 19, 4 (2017), 1302–1307. https://doi.org/10.1109/TITS.2017.2749970
- Mark Billinghurst. 2021. Grand challenges for augmented reality. Frontiers in Virtual Reality 2 (2021), 12. https://doi.org/10.3389/frvir.2021.578080
- SAV2P: Exploring the Impact of an Interface for Shared Automated Vehicles on Pedestrians’ Experience. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications Adjunct (Oldenburg, Germany) (AutomotiveUI ’17). Association for Computing Machinery, New York, NY, USA, 136–140. https://doi.org/10.1145/3131726.3131765
- Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (2006), 77–101. https://doi.org/10.1191/1478088706qp063oa
- Volvo Cars. 2018. 360c – a new way to travel. https://www.volvocars.com/intl/v/cars/concept-models/360c
- Autonomous Vehicle Visual Signals for Pedestrians: Experiments and Design Recommendations. In 2020 IEEE Intelligent Vehicles Symposium (IV). IEEE, New Jersey, NJ, USA, 1819–1826. https://doi.org/10.1109/IV47402.2020.9304628
- Effects of Pedestrian Behavior, Time Pressure, and Repeated Exposure on Crossing Decisions in Front of Automated Vehicles Equipped with External Communication. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 367, 11 pages. https://doi.org/10.1145/3491102.3517571
- Investigating the Effects of Feedback Communication of Autonomous Vehicles. In 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Leeds, United Kingdom) (AutomotiveUI ’21). Association for Computing Machinery, New York, NY, USA, 263–273. https://doi.org/10.1145/3409118.3475133
- Evaluating Highly Automated Trucks as Signaling Lights. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Virtual Event, DC, USA) (AutomotiveUI ’20). Association for Computing Machinery, New York, NY, USA, 111–121. https://doi.org/10.1145/3409120.3410647
- Mark Colley and Enrico Rukzio. 2020. A Design Space for External Communication of Autonomous Vehicles. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Virtual Event, DC, USA) (AutomotiveUI ’20). Association for Computing Machinery, New York, NY, USA, 212–222. https://doi.org/10.1145/3409120.3410646
- Towards Inclusive External Communication of Autonomous Vehicles for Pedestrians with Vision Impairments. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376472
- Unveiling the Lack of Scalability in Research on External Communication of Autonomous Vehicles. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3334480.3382865
- Andrew M Colman. 2015. A dictionary of psychology. Oxford University Press, Oxford, UK.
- Joost de Winter and Dimitra Dodou. 2022. External human–machine interfaces: Gimmick or necessity? Transportation Research Interdisciplinary Perspectives 15 (2022), 100643. https://doi.org/10.1016/j.trip.2022.100643
- Investigating the Need for Explicit Communication of Non-Yielding Intent through a Slow-Pulsing Light Band (SPLB) EHMI in AV-Pedestrian Interaction. In Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Seoul, Republic of Korea) (AutomotiveUI ’22). Association for Computing Machinery, New York, NY, USA, 307–318. https://doi.org/10.1145/3543174.3546086
- Taming the eHMI jungle: A classification taxonomy to guide, compare, and assess the design principles of automated vehicles’ external human-machine interfaces. Transportation Research Interdisciplinary Perspectives 7 (2020), 100174. https://doi.org/10.1016/j.trip.2020.100174
- Distance-Dependent EHMIs for the Interaction Between Automated Vehicles and Pedestrians. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Virtual Event, DC, USA) (AutomotiveUI ’20). Association for Computing Machinery, New York, NY, USA, 192–204. https://doi.org/10.1145/3409120.3410642
- Interface Concepts for Intent Communication from Autonomous Vehicles to Vulnerable Road Users. In Adjunct Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Toronto, ON, Canada) (AutomotiveUI ’18). Association for Computing Machinery, New York, NY, USA, 82–86. https://doi.org/10.1145/3239092.3265946
- Towards Scalable EHMIs: Designing for AV-VRU Communication Beyond One Pedestrian. In 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Leeds, United Kingdom) (AutomotiveUI ’21). Association for Computing Machinery, New York, NY, USA, 274–286. https://doi.org/10.1145/3409118.3475129
- Projection-Based External Human Machine Interfaces – Enabling Interaction between Automated Vehicles and Pedestrians. In Proceedings of the Driving Simulation Conference 2018 Europe VR. Driving Simulation Association, Antibes, France, 43–50.
- External human-machine interfaces: Effects of message perspective. Transportation research part F: traffic psychology and behaviour 78 (2021), 30–41. https://doi.org/10.1016/j.trf.2021.01.013
- Martin J Eppler and Jeanne Mengis. 2004. The Concept of Information Overload: A Review of Literature from Organization Science, Accounting, Marketing, MIS, and Related Disciplines. The Information Society 20, 5 (2004), 325–344. https://doi.org/10.1080/01972240490507974
- Interaction of automated driving systems with pedestrians: challenges, current solutions, and recommendations for eHMIs. Transport Reviews 41, 6 (2021), 788–813. https://doi.org/10.1080/01441647.2021.1914771
- A Longitudinal Video Study on Communicating Status and Intent for Self-Driving Vehicle – Pedestrian Interaction. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376484
- Daniel J Fagnant and Kara Kockelman. 2015. Preparing a nation for autonomous vehicles: opportunities, barriers and policy recommendations. Transportation Research Part A: Policy and Practice 77 (2015), 167–181. https://doi.org/10.1016/j.tra.2015.04.003
- Scott Fitzgerald. 2020. Australia’s first vehicle-to-pedestrian technology trial. https://imoveaustralia.com/news-articles/personal-public-mobility/australia-first-vehicle-to-pedestrian-technology-trial/
- International Organization for Standardization. 2018. ISO/TR 23049:2018 Road Vehicles — Ergonomic aspects of external visual communication from automated vehicles to other road users. https://www.iso.org/obp/ui/#iso:std:iso:tr:23049
- Rebecca Greenfield. 2016. Google’s self-driving cars lack a human’s intuition for what other drivers will do. https://slate.com/technology/2016/03/google-self-driving-cars-lack-a-humans-intuition-for-what-other-drivers-will-do.html
- Bertram Myron Gross. 1964. The managing of organizations: The administrative struggle. Vol. 2. Free Press of Glencoe, New York, NY, USA.
- “I Am Going This Way”: Gazing Eyes on Self-Driving Car Show Multiple Driving Directions. In Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Seoul, Republic of Korea) (AutomotiveUI ’22). Association for Computing Machinery, New York, NY, USA, 319–329. https://doi.org/10.1145/3543174.3545251
- Communicating intent of automated vehicles to pedestrians. Frontiers in psychology 9 (2018), 1336. https://doi.org/10.3389/fpsyg.2018.01336
- Effects of a light-based communication approach as an external HMI for Automated Vehicles–a Wizard-of-Oz Study. Transactions on Transport Sciences 10, 2 (2019), 18–32. https://doi.org/10.5507/tots.2019.012
- Don’t Panic! Guiding Pedestrians in Autonomous Traffic with Augmented Reality. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (Barcelona, Spain) (MobileHCI ’18). Association for Computing Machinery, New York, NY, USA, 261–268. https://doi.org/10.1145/3236112.3236148
- Marius Hoggenmueller and Martin Tomitsch. 2019. Enhancing Pedestrian Safety through In-Situ Projections: A Hyperreal Design Approach. In Proceedings of the 8th ACM International Symposium on Pervasive Displays (Palermo, Italy) (PerDis ’19). Association for Computing Machinery, New York, NY, USA, Article 29, 2 pages. https://doi.org/10.1145/3321335.3329682
- Designing Interactions with Shared AVs in Complex Urban Mobility Scenarios. Frontiers in Computer Science 4 (2022), 59. https://doi.org/10.3389/fcomp.2022.866258
- Investigating the Influence of External Car Displays on Pedestrians’ Crossing Behavior in Virtual Reality. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (Taipei, Taiwan) (MobileHCI ’19). Association for Computing Machinery, New York, NY, USA, Article 27, 11 pages. https://doi.org/10.1145/3338286.3340138
- A Taxonomy of Vulnerable Road Users for HCI Based On A Systematic Literature Review. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 158, 13 pages. https://doi.org/10.1145/3411764.3445480
- Take It to the Curb: Scalable Communication Between Autonomous Cars and Vulnerable Road Users Through Curbstone Displays. Frontiers Comput. Sci. 4 (2022), 844245. https://doi.org/10.3389/fcomp.2022.844245
- Save the Smombies: App-Assisted Street Crossing. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services (Oldenburg, Germany) (MobileHCI ’20). Association for Computing Machinery, New York, NY, USA, Article 22, 11 pages. https://doi.org/10.1145/3379503.3403547
- Overtrust in External Cues of Automated Vehicles: An Experimental Investigation. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Utrecht, Netherlands) (AutomotiveUI ’19). Association for Computing Machinery, New York, NY, USA, 211–221. https://doi.org/10.1145/3342197.3344528
- External communication of automated vehicles in mixed traffic: Addressing the right human interaction partner in multi-agent simulation. Transportation research part F: traffic psychology and behaviour 87 (2022), 365–378. https://doi.org/10.1016/j.trf.2022.04.017
- Communication of Automated Vehicles and Pedestrian Groups: An Intercultural Study on Pedestrians’ Street Crossing Decisions. In Proceedings of Mensch Und Computer 2021. Association for Computing Machinery, New York, NY, USA, 49–53. https://doi.org/10.1145/3473856.3474004
- External human–machine interfaces can be misleading: an examination of trust development and misuse in a CAVE-based pedestrian simulation environment. Human factors 64, 6 (2022), 1070–1085. https://doi.org/10.1177/0018720820970751
- Standardized test procedure for external Human–Machine Interfaces of automated vehicles. Information 11, 3 (2020), 173. https://doi.org/10.3390/info11030173
- interACT D4. 3–Final design and HMI solutions for the interaction of AVs with user on-board and other traffic participants ready for final implementation.
- Tobias Lagström and Victor Malmsten Lundgren. 2016. AVIP-Autonomous vehicles’ interaction with pedestrians-An investigation of pedestrian-driver communication and development of a vehicle external interface. Master’s thesis. Chalmers University of Technology.
- Learning to interpret novel eHMI: The effect of vehicle kinematics and eHMI familiarity on pedestrian crossing behavior. Journal of safety research 80 (2022), 270–280. https://doi.org/10.1016/j.jsr.2021.12.010
- To Cross or Not to Cross: Urgency-Based External Warning Displays on Autonomous Vehicles to Improve Pedestrian Crossing Safety. In Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Toronto, ON, Canada) (AutomotiveUI ’18). Association for Computing Machinery, New York, NY, USA, 188–197. https://doi.org/10.1145/3239060.3239082
- Dokshin Lim and Byungwoo Kim. 2022. UI Design of eHMI of Autonomous Vehicles. International Journal of Human–Computer Interaction 38, 18-20 (2022), 1944–1961. https://doi.org/10.1080/10447318.2022.2061123
- How Should Automated Vehicles Interact with Pedestrians? A Comparative Analysis of Interaction Concepts in Virtual Reality. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Utrecht, Netherlands) (AutomotiveUI ’19). Association for Computing Machinery, New York, NY, USA, 262–274. https://doi.org/10.1145/3342197.3344544
- Investigating User Requirements for Communication Between Automated Vehicles and Vulnerable Road Users. In 2019 IEEE Intelligent Vehicles Symposium (IV). IEEE, New Jersey, NJ, USA, 879–884. https://doi.org/10.1109/IVS.2019.8814027
- Cheyenne Macdonald. 2018. The self-driving car with screens to warn pedestrians: Drive.ai launches its standout cars in Texas. https://www.dailymail.co.uk/sciencetech/article-6008793/The-self-driving-car-screens-warn-pedestrians-Drive-ai-launches-standout-cars-Texas.html
- AV-Pedestrian Interaction Design Using a Pedestrian Mixed Traffic Simulator. In Proceedings of the 2019 on Designing Interactive Systems Conference (San Diego, CA, USA) (DIS ’19). Association for Computing Machinery, New York, NY, USA, 475–486. https://doi.org/10.1145/3322276.3322328
- Communicating Awareness and Intent in Autonomous Vehicle-Pedestrian Interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3174003
- Mercedes-Benz. 2015. The Mercedes-Benz F 015 Luxury in Motion. https://www.mercedes-benz.com.au/passengercars/mercedes-benz-cars/campaigns/mercedes-benz-f-015.html
- Stopping by looking: A driver-pedestrian interaction study in a coupled simulator using head-mounted displays with eye-tracking. Applied Ergonomics 105 (2022), 103825. https://doi.org/10.1016/j.apergo.2022.103825
- The Case for Implicit External Human-Machine Interfaces for Autonomous Vehicles. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Utrecht, Netherlands) (AutomotiveUI ’19). Association for Computing Machinery, New York, NY, USA, 295–307. https://doi.org/10.1145/3342197.3345320
- Designing for Projection-Based Communication between Autonomous Vehicles and Pedestrians. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Utrecht, Netherlands) (AutomotiveUI ’19). Association for Computing Machinery, New York, NY, USA, 284–294. https://doi.org/10.1145/3342197.3344543
- Nissan. 2015. Nissan IDS Concept: Nissan’s vision for the future of EVs and autonomous driving. https://europe.nissannews.com/en-GB/releases/release-139047
- Korea Now. 2021. This is how Korea innovates to prevent traffic accidents. https://www.youtube.com/watch?v=op6L4cW4oIQ
- Comparing State-of-the-Art and Emerging Augmented Reality Interfaces for Autonomous Vehicle-to-Pedestrian Communication. IEEE Transactions on Vehicular Technology 70, 2 (2021), 1157–1168. https://doi.org/10.1109/TVT.2021.3054312
- Amir Rasouli and John K. Tsotsos. 2020. Autonomous Vehicles That Interact With Pedestrians: A Survey of Theory and Practice. IEEE Transactions on Intelligent Transportation Systems 21, 3 (2020), 900–918. https://doi.org/10.1109/TITS.2019.2901817
- Human-vehicle interfaces: The power of vehicle movement gestures in human road user coordination. In Driving Assessment Conference, Vol. 9. University of Iowa, IA, Iowa, USA, 186–192. https://doi.org/10.17077/drivingassessment.1633
- Lionel P. Robert. 2019. The Future of Pedestrian-Automated Vehicle Interactions. XRDS 25, 3 (apr 2019), 30–33. https://doi.org/10.1145/3313115
- Impact of Highly Automated Vehicle (L4/5 AV) External Communication on Other Road User Behavior. Technical Report. Safety through Disruption (Safe-D) University Transportation Center (UTC).
- Alexandros Rouchitsas and Håkan Alm. 2019. External human–machine interfaces for autonomous vehicle-to-pedestrian communication: A review of empirical work. Frontiers in Psychology 10 (2019), 2757. https://doi.org/10.3389/fpsyg.2019.02757
- Parag Sewalkar and Jochen Seitz. 2019. Vehicle-to-pedestrian communication for vulnerable road users: Survey, design considerations, and challenges. Sensors 19, 2 (2019), 358. https://doi.org/10.3390/s19020358
- Displaying the Driving State of Automated Vehicles to Other Road Users: An International, Virtual Reality-Based Study as a First Step for the Harmonized Regulations of Novel Signaling Devices. IEEE Transactions on Intelligent Transportation Systems 23, 4 (2022), 2904–2918. https://doi.org/10.1109/TITS.2020.3032777
- Augmented reality through wearable computing. Presence: Teleoperators & Virtual Environments 6, 4 (1997), 386–398. https://doi.org/10.1162/pres.1997.6.4.386
- Designing for social experiences with and within autonomous vehicles – exploring methodological directions. Design Science 4 (2018), e13. https://doi.org/10.1017/dsj.2018.9
- Vulnerable road users and the coming wave of automated vehicles: Expert perspectives. Transportation Research Interdisciplinary Perspectives 9 (2021), 100293. https://doi.org/10.1016/j.trip.2020.100293
- Towards Future Pedestrian-Vehicle Interactions: Introducing Theoretically-Supported AR Prototypes. In 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Leeds, United Kingdom) (AutomotiveUI ’21). Association for Computing Machinery, New York, NY, USA, 209–218. https://doi.org/10.1145/3409118.3475149
- An augmented warning system for pedestrians: user interface design and algorithm development. Applied Sciences 11, 16 (2021), 7197. https://doi.org/10.3390/app11167197
- System and method implementing virtual pedestrian traffic lights. US Patent App. 17/190,983.
- A Review of Virtual Reality Studies on Autonomous Vehicle–Pedestrian Interaction. IEEE Transactions on Human-Machine Systems 51, 6 (2021), 641–652. https://doi.org/10.1109/THMS.2021.3107517
- Designing Wearable Augmented Reality Concepts to Support Scalability in Autonomous Vehicle-Pedestrian Interaction. Frontiers in Computer Science 4 (2022), 39. https://doi.org/10.3389/fcomp.2022.866516
- EHMI Positioning for Autonomous Vehicle/Pedestrians Interaction. In Adjunct Proceedings of the 31st Conference on l’Interaction Homme-Machine (Grenoble, France) (IHM ’19 Adjunct). Association for Computing Machinery, New York, NY, USA, Article 1, 8 pages. https://doi.org/10.1145/3366551.3370340
- Umbrellium. 2017. Case study - make roads safer, more responsive & dynamic. https://umbrellium.co.uk/case-studies/south-london-starling-cv/
- Pedestrians and Visual Signs of Intent: Towards Expressive Autonomous Passenger Shuttles. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 3, Article 107 (sep 2019), 31 pages. https://doi.org/10.1145/3351265
- CommDisk: A Holistic 360° EHMI Concept to Facilitate Scalable, Unambiguous Interactions between Automated Vehicles and Other Road Users. In 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Leeds, United Kingdom) (AutomotiveUI ’21 Adjunct). Association for Computing Machinery, New York, NY, USA, 132–136. https://doi.org/10.1145/3473682.3480280
- The adaptability and challenges of autonomous vehicles to pedestrians in urban China. Accident Analysis & Prevention 145 (2020), 105692. https://doi.org/10.1016/j.aap.2020.105692
- Scaling up Automated Vehicles’ EHMI Communication Designs to Interactions with Multiple Pedestrians – Putting EHMIs to the Test. In 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Leeds, United Kingdom) (AutomotiveUI ’21 Adjunct). Association for Computing Machinery, New York, NY, USA, 119–122. https://doi.org/10.1145/3473682.3480277