Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

The Shortest Route Is Not Always the Fastest: Probability-Modeled Stereoscopic Eye Movement Completion Time in VR (2309.15183v2)

Published 26 Sep 2023 in cs.GR and cs.HC

Abstract: Speed and consistency of target-shifting play a crucial role in human ability to perform complex tasks. Shifting our gaze between objects of interest quickly and consistently requires changes both in depth and direction. Gaze changes in depth are driven by slow, inconsistent vergence movements which rotate the eyes in opposite directions, while changes in direction are driven by ballistic, consistent movements called saccades, which rotate the eyes in the same direction. In the natural world, most of our eye movements are a combination of both types. While scientific consensus on the nature of saccades exists, vergence and combined movements remain less understood and agreed upon. We eschew the lack of scientific consensus in favor of proposing an operationalized computational model which predicts the speed of any type of gaze movement during target-shifting in 3D. To this end, we conduct a psychophysical study in a stereo VR environment to collect more than 12,000 gaze movement trials, analyze the temporal distribution of the observed gaze movements, and fit a probabilistic model to the data. We perform a series of objective measurements and user studies to validate the model. The results demonstrate its predictive accuracy, generalization, as well as applications for optimizing visual performance by altering content placement. Lastly, we leverage the model to measure differences in human target-changing time relative to the natural world, as well as suggest scene-aware projection depth. By incorporating the complexities and randomness of human oculomotor control, we hope this research will support new behavior-aware metrics for VR/AR display design, interface layout, and gaze-contingent rendering.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (75)
  1. The statistics of eye movements and binocular disparities during VR gaming: Implications for headset design. ACM Transactions on Graphics (TOG) 42, 1 (2022), 15 pages.
  2. Saccade landing position prediction for gaze-contingent rendering. ACM Transactions on Graphics (TOG) 36, 4 (2017), 1–12.
  3. Most naturally occurring human saccades have magnitudes of 15 degrees or less. Investigative Ophthalmology 14, 6 (1975), 468–469.
  4. The main sequence, a tool for studying human eye movements. Mathematical biosciences 24, 3-4 (1975), 191–204.
  5. Eye movements of radiologists reflect expertise in CT study interpretation: A potential tool to measure resident development. Radiology 281, 3 (2016), 805–815.
  6. J Alejandro Betancur. 2011. Physical Variable Analysis Involved in Head-Up Display Systems Applied to Automobiles. Augmented Reality-Some Emerging Application Areas 13 (2011), 244–266.
  7. Velocity characteristics of normal human saccades. Investigative Ophthalmology & Visual Science 13, 8 (1974), 619–623.
  8. Latency of saccades, vergence, and combined movements in children with early onset convergent or divergent strabismus. Vision Research 46, 8-9 (2006), 1384–1392.
  9. Stephen Butterworth et al. 1930. On the theory of filter amplifiers. Wireless Engineer 7, 6 (1930), 536–541.
  10. Optimizing stereo-to-multiview conversion for autostereoscopic displays. In Computer graphics forum, Vol. 33. Wiley Online Library, The Eurographics Association and John Wiley and Sons Ltd., 63–72.
  11. Stereo from Shading. In EGSR (EI&I). 119–125.
  12. Behaviors, models, and clinical applications of vergence eye movements. J Med Biol Eng 30, 1 (2010), 1–15.
  13. Voluntary binocular gaze-shifts in the plane of regard: dynamics of version and vergence. Vision research 35, 23-24 (1995), 3335–3358.
  14. Olivier A Coubard. 2013. Saccade and vergence eye movements: a review of motor and premotor commands. European journal of neuroscience 38, 10 (2013), 3384–3397.
  15. Kathleen E Cullen and Marion R Van Horn. 2011. The neural control of fast vs. slow vergence eye movements. European Journal of Neuroscience 33, 11 (2011), 2147–2154.
  16. FoV-NeRF: Foveated Neural Radiance Fields for Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 28, 11 (2022), 3854–3864.
  17. The bimodality of saccade duration during the exploration of visual scenes. Visual Cognition 28, 9 (2020), 484–512.
  18. Image Features Influence Reaction Time: A Learned Probabilistic Perceptual Model for Saccade Latency. ACM Trans. Graph. 41, 4, Article 144 (jul 2022), 15 pages. https://doi.org/10.1145/3528223.3530055
  19. Ocular vergence under natural conditions. II. Gaze shifts between real targets differing in distance and direction. Proceedings of the Royal Society of London. B. Biological Sciences 236, 1285 (1989), 441–465.
  20. The interaction of pupil response with the vergence system. Graefe’s archive for clinical and experimental ophthalmology 255 (2017), 2247–2253.
  21. Normal interpupillary distance values in an Iranian population. Journal of ophthalmic & vision research 7, 3 (2012), 231.
  22. Are we ready for autonomous driving? the kitti vision benchmark suite. In 2012 IEEE conference on computer vision and pattern recognition. IEEE, 3354–3361.
  23. The effect of task on visual attention in interactive virtual environments. ACM Transactions on Applied Perception (TAP) 16, 3 (2019), 1–17.
  24. Dynamics of the accommodation response to abrupt changes in target vergence as a function of age. Vision research 41, 4 (2001), 507–519.
  25. Vergence–accommodation conflicts hinder visual performance and cause visual fatigue. Journal of vision 8, 3 (2008), 33–33.
  26. Ehtask: Recognizing user tasks from eye and head movements in immersive virtual reality. IEEE Transactions on Visualization and Computer Graphics (2021).
  27. Fixationnet: Forecasting eye fixations in task-oriented virtual environments. IEEE Transactions on Visualization and Computer Graphics 27, 5 (2021), 2681–2690.
  28. Wolfgang Jaschinski. 2016. Pupil size affects measures of eye position in video eye tracking: implications for recording vergence accuracy. Journal of Eye Movement Research 9, 4 (2016).
  29. Bela Julesz. 1971. Foundations of cyclopean perception. (1971).
  30. DeepFovea: Neural reconstruction for foveated rendering and video compression using learned statistics of natural videos. ACM Transactions on Graphics (TOG) 38, 6 (2019), 1–13.
  31. GazeStereo3D: Seamless disparity manipulations. ACM Transactions on Graphics (TOG) 35, 4 (2016), 1–13.
  32. Motion parallax in stereo 3D: Model and applications. ACM Transactions on Graphics (TOG) 35, 6 (2016), 1–12.
  33. Display Size and Targeting Performance: Small Hurts, Large May Help. In SIGGRAPH Asia 2022 Conference Papers. 1–8.
  34. WM King. 2011. Binocular coordination of eye movements–Hering’s Law of equal innervation or uniocular control? European Journal of Neuroscience 33, 11 (2011), 2139–2146.
  35. Gaze-contingent ocular parallax rendering for virtual reality. ACM Transactions on Graphics (TOG) 39, 2 (2020), 1–12.
  36. Gaze-in-wild: A dataset for studying eye and head coordination in everyday activities. Scientific reports 10, 1 (2020), 1–18.
  37. Optimizing depth perception in virtual and augmented reality through gaze-contingent stereo rendering. ACM Transactions on Graphics (TOG) 39, 6 (2020), 1–10.
  38. A perceptual model for eccentricity-dependent spatio-temporal flicker fusion and its applications to foveated graphics. ACM Transactions on Graphics (TOG) 40, 4 (2021), 1–11.
  39. Towards Attention–aware Foveated Rendering. ACM Transactions on Graphics (TOG) 42, 4 (2023), 1–10.
  40. Saccade-vergence properties remain more stable over short-time repetition under overlap than under gap task: a preliminary study. Frontiers in Human Neuroscience 8 (2014), 372.
  41. Visual attention saccadic models learn to emulate gaze patterns from childhood to adulthood. IEEE Transactions on Image Processing 26, 10 (2017), 4777–4789.
  42. Gain control of saccadic eye movements is probabilistic. Proceedings of the National Academy of Sciences 116, 32 (2019), 16137–16142.
  43. Impact of correct and simulated focus cues on perceived realism. In SIGGRAPH Asia 2022 Conference Papers. 1–9.
  44. Generalised exponential-Gaussian distribution: a method for neural reaction time analysis. Cognitive Neurodynamics 17, 1 (2023), 221–237.
  45. ScanGAN360: A Generative Model of Realistic Scanpaths for 360° Images. IEEE Transactions on Visualization and Computer Graphics 28, 5 (2022), 2003–2013.
  46. Frank J Massey Jr. 1951. The Kolmogorov-Smirnov test for goodness of fit. Journal of the American statistical Association 46, 253 (1951), 68–78.
  47. Lawrence E Mays. 1984. Neural control of vergence eye movements: convergence and divergence neurons in midbrain. Journal of Neurophysiology 51, 5 (1984), 1091–1108.
  48. Pupil size influences the eye-tracker signal during saccades. Vision research 121 (2016), 95–103.
  49. Kenneth N Ogle. 1952. On the limits of stereoscopic vision. Journal of experimental psychology 44, 4 (1952), 253.
  50. Response of supraoculomotor area neurons during combined saccade-vergence movements. Journal of Neurophysiology 119, 2 (2018), 585–596.
  51. Towards foveated rendering for gaze-tracked virtual reality. ACM Transactions on Graphics (TOG) 35, 6 (2016), 1–12.
  52. Neural control of rapid binocular eye movements: Saccade-vergence burst neurons. Proceedings of the National Academy of Sciences 117, 46 (2020), 29123–29132.
  53. Eric E Sabelman and Roger Lam. 2015. The real-life dangers of augmented reality. IEEE Spectrum 52, 7 (2015), 48–53.
  54. Optimal control of natural eye-head movements minimizes the impact of noise. Journal of Neuroscience 31, 45 (2011), 16185–16193.
  55. Dario D Salvucci and Andrew Liu. 2002. The time course of a lane change: Driver control and eye-movement behavior. Transportation research part F: traffic psychology and behaviour 5, 2 (2002), 123–132.
  56. Dynamics of the disparity vergence slow (fusion sustaining) component. Journal of eye movement research 12, 4 (2019).
  57. Stereo-consistent screen-space ambient occlusion. Proc. ACM Comput. Graph. Interact. Tech. 5, 1 (2022), 2–1.
  58. Indoor segmentation and support inference from rgbd images. In European conference on computer vision. Springer, 746–760.
  59. Saliency in VR: How do people explore virtual environments? IEEE transactions on visualization and computer graphics 24, 4 (2018), 1633–1642.
  60. A simple physical representation for saccadic eye movement data. In European Congress on Computational Methods in Applied Sciences and Engineering. Springer, 854–861.
  61. Eccentricity effects on blur and depth perception. Optics express 28, 5 (2020), 6734–6739.
  62. Modeling and optimizing eye vergence response to stereoscopic cuts. ACM Transactions on Graphics (TOG) 33, 4 (2014), 1–8.
  63. Perceptually-motivated stereoscopic film grain. In Computer Graphics Forum, Vol. 33. Wiley Online Library, The Eurographics Association and John Wiley and Sons Ltd., 349–358.
  64. What is the best fixation target? The effect of target shape on stability of fixational eye movements. Vision research 76 (2013), 31–42.
  65. Robert J van Beers. 2007. The sources of variability in saccadic eye movements. Journal of Neuroscience 27, 33 (2007), 8757–8770.
  66. Robert J van Beers. 2008. Saccadic eye movements minimize the consequences of motor noise. PloS one 3, 4 (2008), e2070.
  67. DIODE: A Dense Indoor and Outdoor DEpth Dataset. CoRR abs/1908.00463 (2019). http://arxiv.org/abs/1908.00463
  68. Bayesian motion estimation accounts for a surprising bias in 3D vision. Proceedings of the National Academy of Sciences 105, 33 (2008), 12087–12092.
  69. Dark Stereo: Improving Depth Perception under Low Luminance. ACM Trans. Graph. 41, 4, Article 146 (jul 2022), 12 pages. https://doi.org/10.1145/3528223.3530136
  70. The latency of saccades, vergence, and combined eye movements in children and in adults. Investigative Ophthalmology & Visual Science 43, 9 (2002), 2939–2949.
  71. Qing Yang and Zoï Kapoula. 2004. Saccade–vergence dynamics and interaction in children and in adults. Experimental Brain Research 156 (2004), 212–223.
  72. Central crosstalk for somatic tinnitus: abnormal vergence eye movements. PLoS One 5, 7 (2010), e11845.
  73. Alfred L Yarbus. 2013. Eye movements and vision. Springer.
  74. Saccade-vergence interactions in humans. Journal of Neurophysiology 68, 5 (1992), 1624–1641.
  75. Reproducing reality with a high-dynamic-range multi-focal stereo display. ACM Transactions on Graphics 40, 6 (2021), 241.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (5)
  1. Budmonde Duinkharjav (6 papers)
  2. Benjamin Liang (3 papers)
  3. Anjul Patney (10 papers)
  4. Rachel Brown (4 papers)
  5. Qi Sun (114 papers)
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now