Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
194 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A Deep Cybersickness Predictor through Kinematic Data with Encoded Physiological Representation (2304.05984v2)

Published 11 Apr 2023 in cs.HC

Abstract: Users would experience individually different sickness symptoms during or after navigating through an immersive virtual environment, generally known as cybersickness. Previous studies have predicted the severity of cybersickness based on physiological and/or kinematic data. However, compared with kinematic data, physiological data rely heavily on biosensors during the collection, which is inconvenient and limited to a few affordable VR devices. In this work, we proposed a deep neural network to predict cybersickness through kinematic data. We introduced the encoded physiological representation to characterize the individual susceptibility; therefore, the predictor could predict cybersickness only based on a user's kinematic data without counting on biosensors. Fifty-three participants were recruited to attend the user study to collect multimodal data, including kinematic data (navigation speed, head tracking), physiological signals (e.g., electrodermal activity, heart rate), and Simulator Sickness Questionnaire (SSQ). The predictor achieved an accuracy of 97.8\% for cybersickness prediction by involving the pre-computed physiological representation to characterize individual differences, providing much convenience for the current cybersickness measurement.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (61)
  1. Postural stability predicts the likelihood of cybersickness in active hmd-based virtual reality. Displays, 58:3–11, 2019.
  2. F. Argelaguet and M. Maignant. Giant: stereoscopic-compliant multi-scale navigation in ves. In Proceedings of the 22nd acm conference on virtual reality software and technology, pp. 269–277, 2016.
  3. Motion sickness: only one provocative conflict? Brain research bulletin, 47(5):481–487, 1998.
  4. A theory on visually induced motion sickness. Displays, 29(2):47–57, 2008.
  5. Cybersickness in current-generation virtual reality head-mounted displays: systematic review and outlook. Virtual Reality, 25(4):1153–1170, 2021.
  6. Virtual reality sickness: a review of causes and measurements. International Journal of Human–Computer Interaction, 36(17):1658–1682, 2020.
  7. Predicting cybersickness based on user’s gaze behaviors in hmd-based virtual reality. Journal of Computational Design and Engineering, 8(2):728–739, 2021.
  8. Visually induced motion sickness estimation and prediction in virtual reality using frequency components analysis of postural sway signal. In International conference on artificial reality and telexistence eurographics symposium on virtual environments, pp. 9–16, 2015.
  9. Control of a virtual ambulation influences body movement and motion sickness. In BIO Web of Conferences, vol. 1, p. 00016. EDP Sciences, 2011.
  10. Better than the real thing: Eliciting fear with moving and static computer-generated stimuli. International Journal of Psychophysiology, 78(2):107–114, 2010.
  11. Use of physiological signals to predict cybersickness. Displays, 44:42–52, 2016.
  12. P. DiZio and J. R. Lackner. Circumventing side effects of immersive virtual environments. Advances in human factors/ergonomics, 21:893–896, 1997.
  13. X. Dong and T. A. Stoffregen. Postural activity and motion sickness among drivers and passengers in a console video game. In Proceedings of the human factors and ergonomics society annual meeting, vol. 54, pp. 1340–1344. SAGE Publications Sage CA: Los Angeles, CA, 2010.
  14. Learning from deep stereoscopic attention for simulator sickness prediction. IEEE Transactions on Visualization and Computer Graphics, 29(2):1415–1423, 2021.
  15. Sick moves! motion parameters as indicators of simulator sickness. IEEE transactions on visualization and computer graphics, 25(11):3146–3157, 2019.
  16. Combating vr sickness through subtle dynamic field-of-view modification. In 2016 IEEE symposium on 3D user interfaces (3DUI), pp. 201–210. IEEE, 2016.
  17. Development of a classifier to determine factors causing cybersickness in virtual reality environments. Games for health journal, 8(6):439–444, 2019.
  18. Profiling subjective symptoms and autonomic changes associated with cybersickness. Autonomic Neuroscience, 203:41–50, 2017.
  19. J. F. Golding. Phasic skin conductance activity and motion sickness. Aviation, space, and environmental medicine, 1992.
  20. J. F. Golding. Motion sickness susceptibility questionnaire revised and its relationship to other forms of sickness. Brain research bulletin, 47(5):507–516, 1998.
  21. Could okan be an objective indicator of the susceptibility to visually induced motion sickness? In 2011 IEEE Virtual Reality Conference, pp. 87–90. IEEE, 2011.
  22. Prediction of cybersickness in virtual environments using topological data analysis and machine learning. 2022. doi: 10 . 3389/frvir . 2022 . 973236
  23. IMotions. Galvanic skin response—the complete pocket guide, 2017.
  24. Cybersickness prediction from integrated hmd’s sensors: A multimodal deep fusion approach using eye-tracking and head-tracking data. In 2021 IEEE international symposium on mixed and augmented reality (ISMAR), pp. 31–40. IEEE, 2021.
  25. Towards forecasting the onset of cybersickness by fusing physiological, head-tracking and eye-tracking with multimodal deep fusion network. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 121–130. IEEE, 2022.
  26. Automatic detection and prediction of cybersickness severity using deep neural networks from user’s physiological signals. In 2020 IEEE international symposium on mixed and augmented reality (ISMAR), pp. 400–411. IEEE, 2020.
  27. Automatic prediction of cybersickness for virtual reality games. In 2018 IEEE Games, Entertainment, Media Conference (GEM), pp. 1–9. IEEE, 2018.
  28. Motion sickness symptomatology of labyrinthine defective and normal subjects during zero gravity maneuvers. Technical report, AEROSPACE MEDICAL RESEARCH LABS WRIGHT-PATTERSON AFB OHIO, 1964.
  29. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The international journal of aviation psychology, 3(3):203–220, 1993.
  30. B. Keshavarz and H. Hecht. Validating an efficient method to quantify motion sickness. Human factors, 53(4):415–426, 2011.
  31. A deep cybersickness predictor based on brain signal analysis for virtual reality contents. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 10580–10589, 2019.
  32. J. Kim and S. Lee. Deep learning of human visual sensitivity in image quality assessment framework. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1676–1684, 2017.
  33. The application of biosignal feedback for reducing cybersickness from exposure to a virtual environment. Presence: Teleoperators and Virtual Environments, 17(1):1–16, 2008.
  34. Characteristic changes in the physiological components of cybersickness. Psychophysiology, 42(5):616–625, 2005.
  35. J. J. LaViola Jr. A discussion of cybersickness in virtual environments. ACM Sigchi Bulletin, 32(1):47–56, 2000.
  36. B. D. Lawson et al. Motion sickness symptomatology and origins., 2014.
  37. Motion sickness prediction in stereoscopic videos using 3d convolutional neural networks. IEEE transactions on visualization and computer graphics, 25(5):1919–1927, 2019.
  38. Human kinematic, kinetic and emg data during different walking and stair ascending and descending tasks. Scientific data, 6(1):309, 2019.
  39. A study of sickness induced within a 3d virtual store and combated with fuzzy control in the elderly. In 2012 9th International Conference on Fuzzy Systems and Knowledge Discovery, pp. 334–338. IEEE, 2012.
  40. Eye thought you were sick! exploring eye behaviors for cybersickness detection in vr. In Proceedings of the 13th ACM SIGGRAPH Conference on Motion, Interaction and Games, pp. 1–10, 2020.
  41. NeuroKit2: A python toolbox for neurophysiological signal processing. Behavior Research Methods, 53(4):1689–1696, feb 2021. doi: 10 . 3758/s13428-020-01516-y
  42. Presence and cybersickness in immersive content: Effects of content type, exposure time and gender. Computers & Graphics, 71:159–165, 2018.
  43. Cybersickness provoked by head-mounted display affects cutaneous vascular tone, heart rate and reaction time. Physiology & behavior, 151:583–590, 2015.
  44. Towards a machine-learning approach for sickness prediction in 360 stereoscopic videos. IEEE transactions on visualization and computer graphics, 24(4):1594–1603, 2018.
  45. Effects of age, gender, familiarity with the content, and exposure time on cybersickness in immersive head-mounted display based virtual reality. American Journal of Biomedical Sciences, 12(2), 2020.
  46. Effect of proprioceptive vibrations on simulator sickness during navigation task in virtual environment. 2015.
  47. Bio-physiological-signals-based vr cybersickness detection. CCF Transactions on Pervasive Computing and Interaction, 4(3):268–284, 2022.
  48. Motion sickness. Academic press, 1975.
  49. E. Regan and A. Ramsey. Some side-effects of immersion virtual reality: The results of four immersions. APRE report 94R012, 1994.
  50. How feelings of unpleasantness develop during the progression of motion sickness symptoms. Experimental Brain Research, 239(12):3615–3624, 2021.
  51. D. Risi and S. Palmisano. Effects of postural stability, active control, exposure duration and repeated exposures on hmd induced cybersickness. Displays, 60:9–17, 2019.
  52. B. M. Silva and P. Fernando. Early prediction of cybersickness in virtual, augmented & mixed reality applications: a review. In 2019 IEEE 5th International Conference for Convergence in Technology (I2CT), pp. 1–6. IEEE, 2019.
  53. Cybersickness is not simulator sickness. In Proceedings of the Human Factors and Ergonomics Society annual meeting, vol. 41, pp. 1138–1142. SAGE Publications Sage CA: Los Angeles, CA, 1997.
  54. D. Van Krevelen and R. Poelman. A survey of augmented reality technologies, applications and limitations. International journal of virtual reality, 9(2):1–20, 2010.
  55. Postural instability and motion sickness in a virtual moving room. Human factors, 50(2):332–345, 2008.
  56. Vr sickness prediction for navigation in immersive virtual environments using a deep long short term memory model. In 2019 IEEE conference on virtual reality and 3D user interfaces (VR), pp. 1874–1881. IEEE, 2019. doi: 10 . 1109/VR . 2019 . 8798213
  57. Development of a speed protector to optimize user experience in 3d virtual environments. International Journal of Human-Computer Studies, 147:102578, 2021. doi: 10 . 1016/j . ijhcs . 2020 . 102578
  58. Using fuzzy logic to involve individual differences for predicting cybersickness during vr navigation. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR), pp. 373–381. IEEE, 2021. doi: 10 . 1109/VR50410 . 2021 . 00060
  59. Assessing postural instability and cybersickness through linear and angular displacement. Human factors, 63(2):296–311, 2021.
  60. Motion sickness susceptibility associated with visually induced postural instability and cardiac autonomic responses in healthy subjects. Acta oto-laryngologica, 125(3):280–285, 2005.
  61. Dynamic field of view reduction related to subjective sickness measures in an hmd-based data analysis task. In Proc. of IEEE VR Workshop on Everyday Virtual Reality, vol. 2, 2018.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now