Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
126 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

"It Must Be Gesturing Towards Me": Gesture-Based Interaction between Autonomous Vehicles and Pedestrians (2402.14455v1)

Published 22 Feb 2024 in cs.HC

Abstract: Interacting with pedestrians understandably and efficiently is one of the toughest challenges faced by autonomous vehicles (AVs) due to the limitations of current algorithms and external human-machine interfaces (eHMIs). In this paper, we design eHMIs based on gestures inspired by the most popular method of interaction between pedestrians and human drivers. Eight common gestures were selected to convey AVs' yielding or non-yielding intentions at uncontrolled crosswalks from previous literature. Through a VR experiment (N1 = 31) and a following online survey (N2 = 394), we discovered significant differences in the usability of gesture-based eHMIs compared to current eHMIs. Good gesture-based eHMIs increase the efficiency of pedestrian-AV interaction while ensuring safety. Poor gestures, however, cause misinterpretation. The underlying reasons were explored: ambiguity regarding the recipient of the signal and whether the gestures are precise, polite, and familiar to pedestrians. Based on this empirical evidence, we discuss potential opportunities and provide valuable insights into developing comprehensible gesture-based eHMIs in the future to support better interaction between AVs and other road users.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (75)
  1. Deceleration parameters and their applicability as informal communication signal between pedestrians and automated vehicles. Transportation research part F: traffic psychology and behaviour 62 (2019), 757–768.
  2. An experimental study to investigate design and assessment criteria: What is important for communication between pedestrians and automated vehicles? Applied ergonomics 75 (2019), 272–282.
  3. Survey on eHMI concepts: The effect of text, color, and perspective. Transportation research part F: traffic psychology and behaviour 67 (2019), 175–194.
  4. Mercedes Benz. 2015. Der Mercedes-Benz F 015 Luxury in Motion. (2015).
  5. TARGET ARTICLE: Immersive Virtual Environment Technology as a Methodological Tool for Social Psychology. Psychological Inquiry 13, 2 (April 2002), 103–124. https://doi.org/10.1207/S15327965PLI1302_01
  6. Catching eyes: Effects of social and nonsocial cues on attention capture. Psychological science 25, 3 (2014), 720–727.
  7. A guide for analysing electrodermal activity (EDA) & skin conductance responses (SCRs) for psychological experiments. Psychophysiology 49, 1 (2013), 1017–1034.
  8. Rodney Brooks. 2017. The big problem with self-driving cars is people. IEEE spectrum: technology, engineering, and science News 27, 8 (2017).
  9. eHMI: Review and guidelines for deployment on autonomous vehicles. Sensors 21, 9 (2021), 2912.
  10. Work with AI and Work for AI: Autonomous Vehicle Safety Drivers’ Lived Experiences. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 753, 16 pages. https://doi.org/10.1145/3544548.3581564
  11. Unveiling the lack of scalability in research on external communication of autonomous vehicles. In Extended abstracts of the 2020 chi conference on human factors in computing systems. 1–9.
  12. User gesticulation inside an automated vehicle with external communication can cause confusion in pedestrians and a lower willingness to cross. Transportation research part F: traffic psychology and behaviour 87 (2022), 120–137.
  13. Effects of pedestrian prompts on motorist yielding at crosswalks. Journal of applied behavior analysis 44, 1 (2011), 121–126.
  14. AG Daimler. 2017. Autonomous concept car smart vision EQ fortwo: welcome to the future ofcar sharing-Daimler global media site.
  15. How communicating features can help pedestrian safety in the presence of self-driving vehicles: virtual reality experiment. IEEE Transactions on Human-Machine Systems 50, 2 (2020), 176–186.
  16. Investigating the Need for Explicit Communication of Non-Yielding Intent through a Slow-Pulsing Light Band (SPLB) eHMI in AV-Pedestrian Interaction. In Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 307–318.
  17. Color and Animation Preferences for a Light Band eHMI in Interactions Between Automated Vehicles and Pedestrians. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376325
  18. Color and animation preferences for a light band eHMI in interactions between automated vehicles and pedestrians. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1–13.
  19. Distance-dependent eHMIs for the interaction between automated vehicles and pedestrians. In 12th international conference on automotive user interfaces and interactive vehicular applications. 192–204.
  20. Debargha Dey and Jacques Terken. 2017. Pedestrian interaction with vehicles: roles of explicit and implicit communication. In Proceedings of the 9th international conference on automotive user interfaces and interactive vehicular applications. 109–113.
  21. Projection-Based External Human Machine Interfaces – Enabling Interaction between Automated Vehicles and Pedestrians. In Proceedings of the Driving Simulation Conference 2018 Europe VR. Driving Simulation Association, Antibes, France, 43–50.
  22. CARLA: An Open Urban Driving Simulator. In Proceedings of the 1st Annual Conference on Robot Learning. 1–16.
  23. Pedestrian support in intelligent transportation systems: challenges, solutions and open issues. Transportation research part C: emerging technologies 121 (2020), 102856.
  24. An Aligned Rank Transform Procedure for Multifactor Contrast Tests. In The 34th Annual ACM Symposium on User Interface Software and Technology (UIST ’21). Association for Computing Machinery, New York, NY, USA, 754–768. https://doi.org/10.1145/3472749.3474784
  25. I See Your Gesture: A VR-Based Study of Bidirectional Communication between Pedestrians and Automated Vehicles. Journal of Advanced Transportation 2021 (April 2021), e5573560. https://doi.org/10.1155/2021/5573560 Publisher: Hindawi.
  26. A longitudinal video study on communicating status and intent for self-driving vehicle–pedestrian interaction. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1–14.
  27. Berthold Färber. 2016. Communication and communication problems between autonomous vehicles and human drivers. Autonomous driving: Technical, legal and social aspects (2016), 125–144.
  28. Ernest H. Forman and Saul I. Gass. 2001a. The Analytic Hierarchy Process—An Exposition. Operations Research 49, 4 (2001), 469–486. https://doi.org/10.1287/opre.49.4.469.11231 _eprint: https://doi.org/10.1287/opre.49.4.469.11231.
  29. Ernest H Forman and Saul I Gass. 2001b. The analytic hierarchy process—an exposition. Operations research 49, 4 (2001), 469–486.
  30. To Walk or Not to Walk: Crowdsourced Assessment of External Vehicle-to-Pedestrian Displays. https://doi.org/10.48550/arXiv.1707.02698 arXiv:1707.02698 [cs].
  31. To walk or not to walk: Crowdsourced assessment of external vehicle-to-pedestrian displays. arXiv preprint arXiv:1707.02698 (2017).
  32. VRoad: gesture-based interaction between pedestrians and automated vehicles in virtual reality. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings. 399–404.
  33. External Human–Machine Interfaces for Autonomous Vehicles from Pedestrians’ Perspective: A Survey Study. Sensors (Basel, Switzerland) 22, 9 (April 2022), 3339. https://doi.org/10.3390/s22093339
  34. Communicating intent of automated vehicles to pedestrians. Frontiers in psychology 9 (2018), 1336.
  35. Investigating the influence of external car displays on pedestrians’ crossing behavior in virtual reality. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services. 1–11.
  36. Save the Smombies: App-assisted street crossing. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services. 1–11.
  37. Evaluating the user experience of omnidirectional VR walking simulators. Entertainment Computing 34 (May 2020), 100352. https://doi.org/10.1016/j.entcom.2020.100352
  38. An experimental study of driver and pedestrian interaction during the crossing conflict. Human Factors 17, 5 (1975), 514–527.
  39. Do they want to cross? understanding pedestrian intention for behavior prediction. In 2020 IEEE Intelligent Vehicles Symposium (IV). IEEE, 1688–1693.
  40. Toward a holistic communication approach to an automated vehicle’s communication with pedestrians: combining vehicle kinematics with external human-machine interfaces for differently sized automated vehicles. Frontiers in psychology 13 (2022), 882394.
  41. Learning to interpret novel eHMI: The effect of vehicle kinematics and eHMI familiarity on pedestrian’ crossing behavior. Journal of Safety Research 80 (Feb. 2022), 270–280. https://doi.org/10.1016/j.jsr.2021.12.010
  42. Hailong Liu and Takatsugu Hirayama. 2023. Pre-instruction for Pedestrians Interacting Autonomous Vehicles with an eHMI: Effects on Their Psychology and Walking Behavior. arXiv preprint arXiv:2303.08380 (2023).
  43. Calibrating pedestrians’ trust in automated vehicles: does an intent display in an external HMI support trust calibration and safe crossing behavior?. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–17.
  44. AV-Pedestrian interaction design using a pedestrian mixed traffic simulator. In Proceedings of the 2019 on designing interactive systems conference. 475–486.
  45. Communicating awareness and intent in autonomous vehicle-pedestrian interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–12.
  46. Adam Millard-Ball. 2018. Pedestrians, Autonomous Vehicles, and Cities. Journal of Planning Education and Research 38, 1 (2018), 6–12. https://doi.org/10.1177/0739456X16675674 arXiv:https://doi.org/10.1177/0739456X16675674
  47. The Case for Implicit External Human-Machine Interfaces for Autonomous Vehicles. Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Sept. 2019), 295–307. https://doi.org/10.1145/3342197.3345320 Conference Name: AutomotiveUI ’19: 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications ISBN: 9781450368841 Place: Utrecht Netherlands Publisher: ACM.
  48. Action and intention recognition in human interaction with autonomous vehicles. In ” Experiencing Autonomous Vehicles: Crossing the Boundaries between a Drive and a Ride” workshop in conjunction with CHI2015.
  49. HyeJin Oh and GyuChang Lee. 2021. Feasibility of full immersive virtual reality video game on balance and cybersickness of healthy adolescents. Neuroscience Letters 760 (2021), 136063.
  50. Heart rate variability in psychology: A review of HRV indices and an analysis tutorial. Sensors 21, 12 (2021), 3998.
  51. Understanding Pedestrian Behavior in Complex Traffic Scenes. IEEE Transactions on Intelligent Vehicles 3, 1 (2018), 61–70. https://doi.org/10.1109/TIV.2017.2788193
  52. Human-vehicle interfaces: The power of vehicle movement gestures in human road user coordination. In Driving assessment conference, Vol. 9. University of Iowa.
  53. Jaguar Land Rover. 2018. The virtual eyes have it. Retrieved March 22 (2018), 2022.
  54. Thomas L. Saaty. 1990. An Exposition of the AHP in Reply to the Paper “Remarks on the Analytic Hierarchy Process”. Management Science 36, 3 (March 1990), 259–268. https://doi.org/10.1287/mnsc.36.3.259
  55. Thomas L Saaty. 2008. Decision making with the analytic hierarchy process. International journal of services sciences 1, 1 (2008), 83–98.
  56. Ultra short term analysis of heart rate variability for monitoring mental stress in mobile settings. In 2007 29th annual international conference of the ieee engineering in medicine and biology society. IEEE, 4656–4659.
  57. Friederike Schneemann and Irene Gohl. 2016. Analyzing driver-pedestrian interaction at crosswalks: A contribution to autonomous driving in urban environments. In 2016 IEEE intelligent vehicles symposium (IV). IEEE, 38–43.
  58. Study the Effect of eHMI Projection Distance and Contrast on People Acceptance in Blind-Spot Detection Scenario. Applied Sciences 12, 13 (2022). https://doi.org/10.3390/app12136730
  59. Pedestrians/bicyclists and autonomous vehicles: how will they communicate? Transportation research record 2672, 22 (2018), 58–66.
  60. Grounded Theory in Software Engineering Research: A Critical Review and Guidelines. In Proceedings of the 38th International Conference on Software Engineering (Austin, Texas) (ICSE ’16). Association for Computing Machinery, New York, NY, USA, 120–131. https://doi.org/10.1145/2884781.2884833
  61. Matúš Šucha. 2014. Road users’ strategies and communication: driver-pedestrian interaction. Transport Research Arena (TRA) 1 (2014).
  62. Pedestrian-driver communication and decision strategies at marked crossings. Accident Analysis & Prevention 102 (2017), 41–50.
  63. Towards future pedestrian-vehicle interactions: Introducing theoretically-supported AR prototypes. In 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 209–218.
  64. A review of cybersickness in head-mounted displays: raising attention to individual susceptibility. Virtual Reality 26, 4 (2022), 1409–1441.
  65. Peter Trautman and Andreas Krause. 2010. Unfreezing the robot: Navigation in dense, interacting crowds. In 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems. 797–803. https://doi.org/10.1109/IROS.2010.5654369
  66. Omkarprasad S. Vaidya and Sushil Kumar. 2006a. Analytic hierarchy process: An overview of applications. European Journal of Operational Research 169, 1 (Feb. 2006), 1–29. https://doi.org/10.1016/j.ejor.2004.04.028
  67. Omkarprasad S Vaidya and Sushil Kumar. 2006b. Analytic hierarchy process: An overview of applications. European Journal of operational research 169, 1 (2006), 1–29.
  68. Fatal and serious injuries related to vulnerable road users in Canada. Journal of safety research 58 (2016), 67–77.
  69. Crosswalk cooperation: A phone-integrated driver-vehicle cooperation approach to predict the crossing intentions of pedestrians in automated driving. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 74–77.
  70. Crossing the Street Across the Globe: A Study on the Effects of eHMI on Pedestrians in the US, Germany and China. In HCI in Mobility, Transport, and Automotive Systems: First International Conference, MobiTAS 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Orlando, FL, USA, July 26-31, 2019, Proceedings 21. Springer, 515–530.
  71. Annette Werner. 2018. New colours for autonomous driving: An evaluation of chromaticities for the external lighting equipment of autonomous vehicles. Colour Turn 1 (2018).
  72. Han ZHANG and Seung Hee LEE. 2020. A User-centered Auditory Design in Interaction Between Electric Vehicle and Pedestrian. International Journal of Affective Engineering 19, 3 (2020), 217–226.
  73. Communication between autonomous vehicles and pedestrians: an experimental study using virtual reality. Sensors 23, 3 (2023), 1049.
  74. Xiangling Zhuang and Changxu Wu. 2014. Pedestrian gestures increase driver yielding at uncontrolled mid-block road crossings. Accident Analysis & Prevention 70 (2014), 235–244.
  75. 5G-enabled V2X communications for vulnerable road users safety applications: a review. Wireless Networks 29, 3 (2023), 1237–1267.
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets