Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
125 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Evaluation of Eye Tracking Signal Quality for Virtual Reality Applications: A Case Study in the Meta Quest Pro (2403.07210v1)

Published 11 Mar 2024 in cs.HC

Abstract: We present an extensive, in-depth analysis of the eye tracking capabilities of the Meta Quest Pro virtual reality headset using a dataset of eye movement recordings collected from 78 participants. In addition to presenting classical signal quality metrics--spatial accuracy, spatial precision and linearity--in ideal settings, we also study the impact of background luminance and headset slippage on device performance. We additionally present a user-centered analysis of eye tracking signal quality, where we highlight the potential differences in user experience as a function of device performance. This work contributes to a growing understanding of eye tracking signal quality in virtual reality headsets, where the performance of applications such as gaze-based interaction, foveated rendering, and social gaze are directly dependent on the quality of eye tracking signal.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (42)
  1. An assessment of the eye tracking signal quality captured in the hololens 2. In 2022 Symposium on Eye Tracking Research and Applications, ETRA ’22, New York, NY, USA, 2022. Association for Computing Machinery.
  2. Virtual gaze. a pilot study on the effects of computer simulated gaze in avatar-based conversations. In Randall Shumaker, editor, Virtual Reality, pages 185–194, Berlin, Heidelberg, 2007. Springer Berlin Heidelberg.
  3. Advantages of eye-gaze over head-gaze-based selection in virtual and augmented reality under varying field of views. In Proceedings of the Workshop on Communication by Gaze Interaction, COGAIN ’18, New York, NY, USA, 2018. Association for Computing Machinery.
  4. Eye-tracking data quality as affected by ethnicity and experimental design. Behavior Research Methods, 46(1):67–80, Mar 2014.
  5. Visual discomfort under various brightness conditions using eye movements in watching stereoscopic 3D video. In Andrew J. Woods, Nicolas S. Holliman, and Gregg E. Favalora, editors, Stereoscopic Displays and Applications XXV, volume 9011, page 901123. International Society for Optics and Photonics, SPIE, 2014.
  6. Minimal reporting guideline for research involving eye tracking (2023 edition). Behavior Research Methods, Jul 2023.
  7. Effects of dark mode graphics on visual acuity and fatigue with virtual reality head-mounted displays. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pages 434–442, 2020.
  8. Toward everyday gaze input: Accuracy and precision of eye tracking and implications for design. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI ’17, page 1118–1130, New York, NY, USA, 2017. Association for Computing Machinery.
  9. Leveling the playing field: A comparative reevaluation of unmodified eye tracking as an input and interaction modality for vr. IEEE Transactions on Visualization and Computer Graphics, 29(5):2269–2279, 2023.
  10. The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’03, page 529–536, New York, NY, USA, 2003. Association for Computing Machinery.
  11. Stephen J Guastello. Human factors engineering and ergonomics: A systems approach. CRC Press, 2023.
  12. Foveated 3d graphics. ACM Trans. Graph., 31(6), nov 2012.
  13. Understanding, addressing, and analysing digital eye strain in virtual reality head-mounted displays. ACM Trans. Comput.-Hum. Interact., 29(4), mar 2022.
  14. Kenneth Holmqvist. Common predictors of accuracy, precision and data loss in 12 eye-trackers. In The 7th scandinavian workshop on eye tracking, pages 1–25, 2017.
  15. Eye tracking: A comprehensive guide to methods and measures. OUP Oxford, 2011.
  16. Eye tracker data quality: What it is and how to measure it. In Proceedings of the Symposium on Eye Tracking Research and Applications, ETRA ’12, page 45–52, New York, NY, USA, 2012. Association for Computing Machinery.
  17. Cleaning up systematic error in eye-tracking data by using required fixation locations. Behavior Research Methods, Instruments, & Computers, 34(4):592–604, Nov 2002.
  18. S. B. Hutton. Eye Tracking Methodology, pages 277–308. Springer International Publishing, Cham, 2019.
  19. The “social gaze space”: A taxonomy for gaze-based communication in triadic interactions. Frontiers in psychology, 9:226, 2018.
  20. Adaptive eye-gaze-guided interfaces: Design & performance evaluation. In CHI ’11 Extended Abstracts on Human Factors in Computing Systems, CHI EA ’11, page 1255–1260, New York, NY, USA, 2011. Association for Computing Machinery.
  21. Eye movement prediction by kalman filter with integrated linear horizontal oculomotor plant mechanical model. In Proceedings of the 2008 Symposium on Eye Tracking Research & Applications, ETRA ’08, page 229–236, New York, NY, USA, 2008. Association for Computing Machinery.
  22. Evaluating the data quality of eye tracking signals from a virtual reality system: Case study using smi’s eye-tracking htc vive, 2019.
  23. A comparison of smooth pursuit-and dwell-based selection at multiple levels of spatial accuracy. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pages 2760–2766, 2017.
  24. The tipping point of animacy: How, when, and where we perceive life in a face. Psychological Science, 21(12):1854–1862, 2010. PMID: 21097720.
  25. Realistic luminance in vr. In SIGGRAPH Asia 2022 Conference Papers, SA ’22, New York, NY, USA, 2022. Association for Computing Machinery.
  26. Meta. Eye tracking for movement sdk for unity, April 2023.
  27. Pinch, click, or dwell: Comparing different selection techniques for eye-gaze-based pointing in virtual reality. In ACM Symposium on Eye Tracking Research and Applications, ETRA ’21 Short Papers, New York, NY, USA, 2021. Association for Computing Machinery.
  28. What to expect from your remote eye-tracker when participants are unrestrained. Behavior Research Methods, 50(1):213–227, Feb 2018.
  29. The impact of slippage on the data quality of head-worn eye trackers. Behavior Research Methods, 52(3):1140–1160, Jun 2020.
  30. Pupil size influences the eye-tracker signal during saccades. Vision Research, 121:95–103, 2016.
  31. Gaze + pinch interaction in virtual reality. In Proceedings of the 5th Symposium on Spatial User Interaction, SUI ’17, page 99–108, New York, NY, USA, 2017. Association for Computing Machinery.
  32. Empirical evaluation of gaze-enhanced menus in virtual reality. In Proceedings of the 26th ACM Symposium on Virtual Reality Software and Technology, VRST ’20, New York, NY, USA, 2020. Association for Computing Machinery.
  33. Chapter 7 - applied human factors in design. In Mary Beth Privitera, editor, Applied Human Factors in Medical Device Design, pages 85–115. Academic Press, 2019.
  34. Get a grip: Slippage-robust and glint-free gaze estimation for real-time pervasive head-mounted eye tracking. In Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications, ETRA ’19, New York, NY, USA, 2019. Association for Computing Machinery.
  35. Eye tracking in virtual reality: Vive pro eye spatial accuracy, precision, and calibration reliability. Journal of Eye Movement Research, 15(3), Sep. 2022.
  36. Eye tracking for avatar eye gaze control during object-focused multiparty interaction in immersive collaborative virtual environments. In 2009 IEEE Virtual Reality Conference, pages 83–90, 2009.
  37. Eye-tracking for avatar eye-gaze and interactional analysis in immersive collaborative virtual environments. In Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work, CSCW ’08, page 197–200, New York, NY, USA, 2008. Association for Computing Machinery.
  38. User, metric, and computational evaluation of foveated rendering methods. In Proceedings of the ACM Symposium on Applied Perception, SAP ’16, page 7–14, New York, NY, USA, 2016. Association for Computing Machinery.
  39. Joseph Tao-yi Wang. Pupil dilation and eye tracking. A handbook of process tracing methods for decision research: A critical review and user’s guide, pages 185–204, 2011.
  40. A preliminary study of the eye tracker in the meta quest pro. In Proceedings of the 2023 ACM International Conference on Interactive Media Experiences, IMX ’23, page 216–221, New York, NY, USA, 2023. Association for Computing Machinery.
  41. Evaluating eye tracking with iso 9241 - part 9. In Julie A. Jacko, editor, Human-Computer Interaction. HCI Intelligent Multimodal Interaction Environments, pages 779–788, Berlin, Heidelberg, 2007. Springer Berlin Heidelberg.
  42. Mode-of-disparities error correction of eye-tracking data. Behavior Research Methods, 43(3):834–842, Sep 2011.
Citations (8)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets