Papers
Topics
Authors
Recent
Search
2000 character limit reached

Portobello: Extending Driving Simulation from the Lab to the Road

Published 12 Feb 2024 in cs.HC | (2402.08061v1)

Abstract: In automotive user interface design, testing often starts with lab-based driving simulators and migrates toward on-road studies to mitigate risks. Mixed reality (XR) helps translate virtual study designs to the real road to increase ecological validity. However, researchers rarely run the same study in both in-lab and on-road simulators due to the challenges of replicating studies in both physical and virtual worlds. To provide a common infrastructure to port in-lab study designs on-road, we built a platform-portable infrastructure, Portobello, to enable us to run twinned physical-virtual studies. As a proof-of-concept, we extended the on-road simulator XR-OOM with Portobello. We ran a within-subjects, autonomous-vehicle crosswalk cooperation study (N=32) both in-lab and on-road to investigate study design portability and platform-driven influences on study outcomes. To our knowledge, this is the first system that enables the twinning of studies originally designed for in-lab simulators to be carried out in an on-road platform.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (59)
  1. GENIVI Alliance. 2021. Genivi Vehicle Simulator. https://github.com/GENIVI/genivi-vehicle-simulator.
  2. The RRADS platform: a real road autonomous driving simulator. In Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, New York, NY, USA, 281–288.
  3. Personal navi: Benefits of an augmented reality navigational aid using a see-thru 3d volumetric hud. In Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, New York, NY, USA, 1–8.
  4. Giovanni Bertolini and Dominik Straumann. 2016. Moving in a moving world: a review on vestibular motion sickness. Frontiers in neurology 7 (2016), 14.
  5. VEmotion: Using Driving Context for Indirect Emotion Prediction in Real-Time. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21). Association for Computing Machinery, New York, NY, USA, 638–651. https://doi.org/10.1145/3472749.3474775
  6. Augmented and mixed reality as a tool for evaluation of vehicle active safety systems. In RSS2013 Road Safety and Simulation-International Conference. Aracne, Rome, Italy, 7 pages.
  7. Hyung-jun Cho and Gerard J. Kim. 2020. RoadVR: Mitigating the Effect of Vection and Sickness by Distortion of Pathways for In-Car Virtual Reality. In Proceedings of the 26th ACM Symposium on Virtual Reality Software and Technology (VRST ’20). Association for Computing Machinery, New York, NY, USA, 1–3. https://doi.org/10.1145/3385956.3422115
  8. Feedback Strategies for Crowded Intersections in Automated Traffic — A Desirable Future?. In Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Seoul, Republic of Korea) (AutomotiveUI ’22). Association for Computing Machinery, New York, NY, USA, 243–252. https://doi.org/10.1145/3543174.3545255
  9. Effects of Semantic Segmentation Visualization on Trust, Situation Awareness, and Cognitive Load in Highly Automated Vehicles. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 155, 11 pages. https://doi.org/10.1145/3411764.3445351
  10. Swivr-car-seat: Exploring vehicle motion effects on interaction quality in virtual reality automated driving using a motorized swivel seat. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 4 (2021), 1–26.
  11. SwiVR-Car-Seat: Exploring Vehicle Motion Effects on Interaction Quality in Virtual Reality Automated Driving Using a Motorized Swivel Seat. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 4, Article 150 (dec 2022), 26 pages. https://doi.org/10.1145/3494968
  12. Advantages and disadvantages of driving simulators: A discussion. In Proceedings of measuring behavior, Vol. 2012. 8th.
  13. Using cooperative vehicle systems to collect near collision incidents events: a simulation study. In 2nd International Workshop on Traffic Data Collection & its Standardisation.
  14. Lorin Dole and Wendy Ju. 2019. Face and Ecological Validity in Simulations: Lessons from Search-and-Rescue HRI. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/3290605.3300681
  15. ARCAR: On-Road Driving in Mixed Reality by Volvo Cars. In Adjunct Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’20 Adjunct). Association for Computing Machinery, New York, NY, USA, 62–64. https://doi.org/10.1145/3379350.3416186
  16. XR-OOM: MiXed Reality Driving Simulation with Real Cars for Research and Design. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 107, 13 pages. https://doi.org/10.1145/3491102.3517704
  17. Vr-oom: Virtual reality on-road driving simulation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–11.
  18. Paul Allan Green. 2005. How driving simulator data quality can be improved. University of Michigan Transportation Research Institute, Human Factors Division.
  19. The effect of lateral motion cues during simulated driving. Proceedings of DSC North America (2003), 8–10.
  20. Verbal and spatial loading effects on eye movements in driving simulators: A comparison to real world driving. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 46. SAGE Publications, Los Angeles, CA, USA, 2174–2178.
  21. CarVR: Enabling In-Car Virtual Reality Entertainment. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 4034–4044. https://doi.org/10.1145/3025453.3025665
  22. Introducing VAMPIRE – Using Kinaesthetic Feedback in Virtual Reality for Automated Driving Experiments. In Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Seoul, Republic of Korea) (AutomotiveUI ’22). Association for Computing Machinery, New York, NY, USA, 204–214. https://doi.org/10.1145/3543174.3545252
  23. Autonomous Vehicle-Cyclist Interaction: Peril and Promise. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376884
  24. Maura Houtenbos. 2009. Interacting drivers at intersections: what can make them more safe and more efficient. In Proceedings of the 21st International Technical Conference on the Enhance Safety Vehicles. Citeseer, Citeseer.
  25. Samantha L Jamson and A Hamish Jamson. 2010. The validity of a low-cost simulator for the assessment of the effects of in-vehicle information systems. Safety Science 48, 10 (2010), 1477–1483.
  26. AutoVis: Enabling Mixed-Immersive Analysis of Automotive User Interface Interaction Studies. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, 15 pages. https://doi.org/10.1145/3544548.3580760 conditionally accepted.
  27. A Design Space for Human Sensor and Actuator Focused In-Vehicle Interaction Based on a Systematic Literature Review. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 2, Article 56 (jul 2022), 51 pages. https://doi.org/10.1145/3534617
  28. Harold Jeffreys. 1998. The theory of probability. OUP Oxford.
  29. Unity: A general platform for intelligent agents. arXiv preprint arXiv:1809.02627 (2018).
  30. SoundsRide: Affordance-Synchronized Music Mixing for In-Car Audio Augmented Reality. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21). Association for Computing Machinery, New York, NY, USA, 118–133. https://doi.org/10.1145/3472749.3474739
  31. Robert E Kass and Adrian E Raftery. 1995. Bayes factors. Journal of the American statistical association 90, 430 (1995), 773–795.
  32. SeungJun Kim and Anind K Dey. 2009. Simulated augmented reality windshield display as a cognitive mapping aid for elder driver navigation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 133–142.
  33. A portable three-dimensional LIDAR-based system for long-term and wide-area people behavior measurement. International Journal of Advanced Robotic Systems 16, 2 (2019), 1729881419841532.
  34. Georgios K Kountouriotis and Natasha Merat. 2016. Leading to distraction: Driver distraction, lead car, and road environment. Accident Analysis & Prevention 89 (2016), 22–30.
  35. How people experience autonomous intersections: taking a first-person perspective. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, New York, NY, USA, 275–283.
  36. Validation of a driving simulator study on driver behavior at passive rail level crossings. Human factors 60, 6 (2018), 743–754.
  37. Driver interaction at intersections: A hybrid dynamic game based model. In 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE, IEEE, New York, NY, USA, 2269–2276.
  38. AV-Pedestrian Interaction Design Using a Pedestrian Mixed Traffic Simulator. In Proceedings of the 2019 on Designing Interactive Systems Conference (San Diego, CA, USA) (DIS ’19). Association for Computing Machinery, New York, NY, USA, 475–486. https://doi.org/10.1145/3322276.3322328
  39. PassengXR: A Low Cost Platform for Any-Car, Multi-User, Motion-Based Passenger XR Experiences. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (Bend, OR, USA) (UIST ’22). Association for Computing Machinery, New York, NY, USA, Article 2, 15 pages. https://doi.org/10.1145/3526113.3545657
  40. Richard Morey. 2022. Richarddmorey/BayesFactor. Retrieved 6 September, 2022 from https://github.com/richarddmorey/BayesFactor
  41. Augmented reality navigation systems. Universal Access in the Information Society 4 (2006), 177–187.
  42. Fred GWC Paas and Jeroen JG Van Merriënboer. 1993. The efficiency of instructional conditions: An approach to combine mental effort and performance measures. Human factors 35, 4 (1993), 737–743.
  43. The development of driving simulators: Toward a multisensory solution. Le travail humain 71, 1 (2008), 62–95.
  44. ROS: an open-source Robot Operating System. In ICRA workshop on open source software, Vol. 3. Kobe, Japan, Japan, 5.
  45. Bringing simulation to life: A mixed reality autonomous intersection. In 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, New York, NY, USA, 6083–6088. https://doi.org/10.1109/IROS.2010.5651993
  46. A research agenda for mixed reality in automated vehicles. In 19th International Conference on Mobile and Ubiquitous Multimedia. ACM, New York, NY, USA, 119–131.
  47. Collection and comparison of driver/passenger physiologic and behavioural data in simulation and on-road driving. In 2017 5th IEEE International Conference on Models and Technologies for Intelligent Transportation Systems (MT-ITS). IEEE, New York, NY, USA, 403–408.
  48. Hiroaki Sawano and Minoru Okada. 2005. A car-navigation system based on augmented reality. In ACM SIGGRAPH 2005 Sketches. ACM, New York, NY, USA, 119–es.
  49. Augmented reality cues and elderly driver hazard perception. Human factors 55, 3 (2013), 643–658.
  50. Friederike Schneemann and Irene Gohl. 2016. Analyzing driver-pedestrian interaction at crosswalks: A contribution to autonomous driving in urban environments. In 2016 IEEE intelligent vehicles symposium (IV). IEEE, IEEE, New York, NY, USA, 38–43.
  51. LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mapping. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, IEEE, New York, NY, USA, 5135–5142.
  52. Observation of drivers’ behavior at narrow roads using immersive car driving simulator. In Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI ’10). Association for Computing Machinery, New York, NY, USA, 391–396. https://doi.org/10.1145/1900179.1900263
  53. Experimental evaluation of an augmented reality visualization for directing a car driver’s attention. In Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’05). IEEE, New York, NY, USA, 56–59.
  54. Increasing Trust in Fully Automated Driving: Route Indication on an Augmented Reality Head-up Display. In Proceedings of the 8th ACM International Symposium on Pervasive Displays (Palermo, Italy) (PerDis ’19). Association for Computing Machinery, New York, NY, USA, Article 6, 7 pages. https://doi.org/10.1145/3321335.3324947
  55. Crosswalk cooperation: A phone-integrated driver-vehicle cooperation approach to predict the crossing intentions of pedestrians in automated driving. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, New York, NY, USA, 74–77.
  56. Cooperative Overtaking: Overcoming Automated Vehicles’ Obstructed Sensor Range via Driver Help. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Utrecht, Netherlands) (AutomotiveUI ’19). Association for Computing Machinery, New York, NY, USA, 144–155. https://doi.org/10.1145/3342197.3344531
  57. Systematic review of driving simulator validation studies. Safety Science 117 (2019), 138–151. https://doi.org/10.1016/j.ssci.2019.04.004
  58. MAXIM: Mixed-reality Automotive Driving XIMulation. In 2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE, IEEE, New York, NY, USA, 460–464.
  59. Toward immersive self-driving simulations: Reports from a user study across six platforms. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–12.
Citations (3)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Summarize

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up for Free