Exploring Users Pointing Performance on Large Displays with Different Curvatures in Virtual Reality (2310.06296v1)
Abstract: Large curved displays inside Virtual Reality environments are becoming popular for visualizing high-resolution content during analytical tasks, gaming or entertainment. Prior research showed that such displays provide a wide field of view and offer users a high level of immersion. However, little is known about users' performance (e.g., pointing speed and accuracy) on them. We explore users' pointing performance on large virtual curved displays. We investigate standard pointing factors (e.g., target width and amplitude) in combination with relevant curve-related factors, namely display curvature and both linear and angular measures. Our results show that the less curved the display, the higher the performance, i.e., faster movement time. This result holds for pointing tasks controlled via their visual properties (linear widths and amplitudes) or their motor properties (angular widths and amplitudes). Additionally, display curvatures significantly affect the error rate for both linear and angular conditions. Furthermore, we observe that curved displays perform better or similar to flat displays based on throughput analysis. Finally, we discuss our results and provide suggestions regarding pointing tasks on large curved displays in VR.
- A research on curved display comparing to flat display regarding posture, tilt angle, focusing area and satisfaction. Journal of the Ergonomics Society of Korea, 33(3):191–202, 2014. doi: 10 . 5143/jesk . 2014 . 33 . 3 . 191
- H. Akaike. A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19(6):716–723, 1974. doi: 10 . 1109/TAC . 1974 . 1100705
- Information visualization on large, high-resolution displays: Issues, challenges, and opportunities. Information Visualization, 10(4):341–355, 2011. doi: 10 . 1177/1473871611415997
- Interaction with large displays: A survey. ACM Comput. Surv., 47(3), feb 2015. doi: 10 . 1145/2682623
- Effect of stereo deficiencies on virtual distal pointing. In Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology, VRST ’22. Association for Computing Machinery, New York, NY, USA, 2022. doi: 10 . 1145/3562939 . 3565621
- Do head-mounted display stereo deficiencies affect 3d pointing tasks in ar and vr? In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 585–592, 2019. doi: 10 . 1109/VR . 2019 . 8797975
- A. U. Batmaz and W. Stuerzlinger. Effect of fixed and infinite ray length on distal 3d pointing in virtual reality. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, CHI EA ’20, p. 1–10. ACM, USA, 2020. doi: 10 . 1145/3334480 . 3382796
- Multimodel inference: Understanding aic and bic in model selection. Sociological Methods & Research, 33(2):261–304, 2004. doi: 10 . 1177/0049124104268644
- A large curved display system in virtual reality for immersive data interaction. In 2019 IEEE Games, Entertainment, Media Conference (GEM), pp. 1–4, 2019. doi: 10 . 1109/GEM . 2019 . 8811550
- Peephole pointing: Modeling acquisition of dynamically revealed targets. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’08, p. 1699–1708. ACM, USA, 2008. doi: 10 . 1145/1357054 . 1357320
- Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys for text selection on a crt. Ergonomics, 21(8):601–613, 1978. doi: 10 . 1080/00140137808931762
- Dataspace: A reconfigurable hybrid reality environment for collaborative information analysis. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 145–153, 2019. doi: 10 . 1109/VR . 2019 . 8797733
- Interacting with the big screen: Pointers to ponder. In CHI ’02 Extended Abstracts on Human Factors in Computing Systems, CHI EA ’02, p. 678–679. ACM, USA, 2002. doi: 10 . 1145/506443 . 506542
- 53.2: Visual search and attention: What eye-tracking reveals about visual performance in the curved display. In SID symposium digest of technical papers, vol. 46, pp. 798–801. Wiley Online Library, 2015.
- Wriarm: Leveraging wrist movement to design wrist+arm based teleportation in vr. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 317–325, 2022. doi: 10 . 1109/ISMAR55827 . 2022 . 00047
- E. Crossman. The speed and accuracy of simple hand movements. The nature and acquisition of industrial skills, 1957.
- E. R. Crossman. The measurement of perceptual load in manual operations. PhD thesis, University of Birmingham, 1956.
- Toward characterizing the productivity benefits of very large displays. In Interact, vol. 3, pp. 9–16, 2003.
- J. Davis and X. Chen. Lumipoint: multi-user laser-based interaction on large tiled displays. Displays, 23(5):205–211, 2002. doi: 10 . 1016/S0141-9382(02)00039-2
- Moving ahead with peephole pointing: Modelling object selection with head-worn display field of view limitations. In Proc. of the 2016 Symposium on Spatial User Interaction, SUI ’16, p. 107–110. ACM, USA, 2016. doi: 10 . 1145/2983310 . 2985756
- P. M. Fitts. The information capacity of the human motor system in controlling the amplitude of movement. Journal of experimental psychology, 47(6):381, 1954. doi: 10 . 1037/h0055392
- P. M. Fitts. The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology: General, 121(3):262, 1992. doi: 10 . 1037/0096-3445 . 121 . 3 . 262
- Google. Firebase realtime database: store and sync data in real time, 2023. Retrieved January 15, 2023 from https://firebase.google.com/products/realtime-database.
- Speed-accuracy tradeoff: A formal information-theoretic transmission scheme (fitts). ACM Trans. Comput.-Hum. Interact., 25(5), sep 2018. doi: 10 . 1145/3231595
- T. Grossman and R. Balakrishnan. Pointing at trivariate targets in 3d environments. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’04, p. 447–454. ACM, USA, 2004. doi: 10 . 1145/985692 . 985749
- A fitts’ law study of click and dwell interaction by gaze, head and mouse with a head-mounted display. In Proc. of the Workshop on Communication by Gaze Interaction, COGAIN ’18. ACM, USA, 2018. doi: 10 . 1145/3206343 . 3206344
- Myopoint: Pointing and clicking using forearm mounted electromyography and inertial motion sensors. In Proc. of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI ’15, p. 3653–3656. ACM, USA, 2015. doi: 10 . 1145/2702123 . 2702133
- Investigating pointing tasks across angularly coupled display areas. In P. Kotzé, G. Marsden, G. Lindgaard, J. Wesson, and M. Winckler, eds., Human-Computer Interaction – INTERACT 2013, pp. 720–727. Springer Berlin Heidelberg, Berlin, Heidelberg, 2013. doi: 10 . 1007/978-3-642-40483-2_50
- E. R. HOFFMANN. Effective target tolerance in an inverted fitts task. Ergonomics, 38(4):828–836, 1995. doi: 10 . 1080/00140139508925153
- Performance in one-, two- and three-dimensional terminal aiming tasks. Ergonomics, 54(12):1175–1185, 2011. PMID: 22103725. doi: 10 . 1080/00140139 . 2011 . 614356
- Effect of varying target height in a fitts’ movement task. Ergonomics, 37(6):1071–1088, 1994.
- J. P. Hourcade and N. Bullock-Rest. How small can you go? analyzing the effect of visual angle in pointing tasks. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’12, p. 213–216. ACM, USA, 2012. doi: 10 . 1145/2207676 . 2207706
- I. ISO. 9241-9 ergonomic requirements for office work with visual display terminals (vdts)-part 9: Requirements for non-keyboard input devices (fdis-final draft international standard), 2000. International Organization for Standardization, 2000.
- Modeling the impact of depth on pointing performance. In Proc. of the 2016 CHI Conference on Human Factors in Computing Systems, CHI ’16, p. 188–199. ACM, USA, 2016. doi: 10 . 1145/2858036 . 2858244
- Direct pointer: Direct manipulation for large-display interaction using handheld cameras. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’06, p. 1107–1110. ACM, USA, 2006. doi: 10 . 1145/1124772 . 1124937
- Modeling angle-based pointing tasks in augmented reality interfaces. IEEE Access, 8:192597–192607, 2020. doi: 10 . 1109/ACCESS . 2020 . 3031957
- The effects of virtual reality, augmented reality, and motion parallax on egocentric depth perception. In Proc. of the 5th Symposium on Applied Perception in Graphics and Visualization, APGV ’08, p. 9–14. ACM, USA, 2008. doi: 10 . 1145/1394281 . 1394283
- A comparison of ray pointing techniques for very large displays. In Proc. of Graphics Interface 2010, GI ’10, p. 269–276. Canadian Information Processing Society, CAN, 2010. doi: 10 . 5555/1839214 . 1839261
- G. Kondraske. An angular motion fitt’s law for human performance modeling and prediction. In Proceedings of 16th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, vol. 1, pp. 307–308 vol.1, 1994. doi: 10 . 1109/IEMBS . 1994 . 412031
- A human motor behavior model for distal pointing tasks. International Journal of Human-Computer Studies, 68(10):603–615, 2010. doi: 10 . 1016/j . ijhcs . 2010 . 05 . 001
- R. A. P. Kopper. Understanding and improving distal pointing interaction. PhD thesis, Virginia Tech, 2011.
- Perceptual influences on fitts’ law. Experimental Brain Research, 190(1):99–103, 2008. doi: 10 . 1007/s00221-008-1497-3
- On motor performance in virtual 3d object manipulation. IEEE Transactions on Visualization and Computer Graphics, 26(5):2041–2050, 2020. doi: 10 . 1109/TVCG . 2020 . 2973034
- G. Kyung and S. Park. Curved versus flat monitors: Interactive effects of display curvature radius and display size on visual search performance and visual fatigue. Human Factors, 63(7):1182–1195, 2021. doi: 10 . 1177/0018720820922717
- Factors associated with visual fatigue from curved monitor use: A prospective study of healthy subjects. PLOS ONE, 11(10):1–12, 10 2016. doi: 10 . 1371/journal . pone . 0164022
- J. Leusmann and S. M. K. Angerbauer. A literature review on distant object selection methods. 2021. doi: 10 . 18419/opus-12060
- Magic-pointing on large high-resolution displays. In Proc. of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA ’16, p. 1706–1712. ACM, USA, 2016. doi: 10 . 1145/2851581 . 2892479
- I. S. MacKenzie. Fitts’ law as a research and design tool in human-computer interaction. Hum.-Comput. Interact., 7(1):91–139, mar 1992. doi: 10 . 1207/s15327051hci0701_3
- I. S. MacKenzie and W. Buxton. Extending fitts’ law to two-dimensional tasks. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’92, p. 219–226. ACM, USA, 1992. doi: 10 . 1145/142750 . 142794
- Meta. Meta quest 2: Advanced all-in-one vr headset., 2023. Retrieved January 15, 2023 from https://www.meta.com/gb/en/quest/products/quest-2.
- Depth perception within virtual environments: comparison between two display technologies. International Journ. on Advances in Intelligent Systems, 3, 2010.
- High-precision pointing on large wall displays using small handheld devices. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’13, p. 831–840. ACM, USA, 2013. doi: 10 . 1145/2470654 . 2470773
- Designing large-display workspaces for cooperative travel consultancy. In CHI ’08 Extended Abstracts on Human Factors in Computing Systems, CHI EA ’08, p. 2877–2882. ACM, USA, 2008. doi: 10 . 1145/1358628 . 1358777
- J.-Y. Oh and W. Stuerzlinger. Laser pointers as collaborative pointing devices. In Graphics Interface, vol. 2002, pp. 141–149. Citeseer, 2002.
- A. E. Raftery. Bayesian model selection in social research. Sociological methodology, pp. 111–163, 1995.
- M. Rohs and A. Oulasvirta. Target acquisition with camera phones when used as magic lenses. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’08, p. 1409–1418. ACM, USA, 2008. doi: 10 . 1145/1357054 . 1357275
- G. Schwarz. Estimating the dimension of a model. The Annals of Statistics, 6(2):461–464, 1978.
- Pointing cursor interaction in virtual reality from the perspective of distance perception. Traitement du Signal, 39(2), 2022. doi: 10 . 18280/ts . 390209
- Two-part models capture the impact of gain on pointing performance. ACM Trans. Comput.-Hum. Interact., 19(4), dec 2012. doi: 10 . 1145/2395131 . 2395135
- Shaping the display of the future: The effects of display size and curvature on user performance and insights. Human–Computer Interaction, 24(1-2):230–272, 2009. doi: 10 . 1080/07370020902739429
- Pointing at a distance with everyday smart devices. In Proc. of the 2018 CHI Conference on Human Factors in Computing Systems, CHI ’18, p. 1–11. ACM, USA, 2018. doi: 10 . 1145/3173574 . 3173747
- Towards a standard for pointing device evaluation, perspectives on 27 years of fitts’ law research in hci. International Journal of Human-Computer Studies, 61(6):751–789, 2004. Fitts’ law 50 years later: applications and contributions from human-computer interaction. doi: 10 . 1016/j . ijhcs . 2004 . 09 . 001
- With similar visual angles, larger displays improve spatial performance. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’03, p. 217–224. ACM, USA, 2003. doi: 10 . 1145/642611 . 642650
- Freehand interaction with large displays: Effects of body posture, interaction distance and target size on task performance, perceived usability and workload. Applied Ergonomics, 93:103370, 2021. doi: 10 . 1016/j . apergo . 2021 . 103370
- U. technologies. Unity real-time development platform | 2d, 3d, vr & ar engine., 2023. Retrieved January 15, 2023 from https://unity.com/.
- E. Triantafyllidis and Z. Li. The challenges in modeling human performance in 3d space with fitts’ law. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, CHI EA ’21. ACM, USA, 2021. doi: 10 . 1145/3411763 . 3443442
- Exploring users’ pointing performance on virtual and physical large curved displays. In Proceedings of the 29th ACM Symposium on Virtual Reality Software and Technology, pp. 1–11, 2023. doi: 10 . 1145/3611659 . 3615710
- Comparing immersiveness and perceptibility of spherical and curved displays. Applied Ergonomics, 90:103271, 2021. doi: 10 . 1016/j . apergo . 2020 . 103271
- An error model for pointing based on fitts’ law. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’08, p. 1613–1622. ACM, USA, 2008. doi: 10 . 1145/1357054 . 1357306
- The effects of task dimensionality, endpoint deviation, throughput calculation, and experiment design on pointing measures and models. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’11, p. 1639–1648. ACM, USA, 2011. doi: 10 . 1145/1978942 . 1979181
- Speed–accuracy tradeoff in fitts’ law tasks—on the equivalency of actual and nominal pointing precision. International Journal of Human-Computer Studies, 61(6):823–856, 2004. Fitts’ law 50 years later: applications and contributions from human-computer interaction. doi: 10 . 1016/j . ijhcs . 2004 . 09 . 007