Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

ShareYourReality: Investigating Haptic Feedback and Agency in Virtual Avatar Co-embodiment (2403.08363v1)

Published 13 Mar 2024 in cs.HC and cs.CY

Abstract: Virtual co-embodiment enables two users to share a single avatar in Virtual Reality (VR). During such experiences, the illusion of shared motion control can break during joint-action activities, highlighting the need for position-aware feedback mechanisms. Drawing on the perceptual crossing paradigm, we explore how haptics can enable non-verbal coordination between co-embodied participants. In a within-subjects study (20 participant pairs), we examined the effects of vibrotactile haptic feedback (None, Present) and avatar control distribution (25-75%, 50-50%, 75-25%) across two VR reaching tasks (Targeted, Free-choice) on participants Sense of Agency (SoA), co-presence, body ownership, and motion synchrony. We found (a) lower SoA in the free-choice with haptics than without, (b) higher SoA during the shared targeted task, (c) co-presence and body ownership were significantly higher in the free-choice task, (d) players hand motions synchronized more in the targeted task. We provide cautionary considerations when including haptic feedback mechanisms for avatar co-embodiment experiences.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (69)
  1. The role of interaction in virtual embodiment: Effects of the virtual hand representation. In 2016 IEEE Virtual Reality (VR). IEEE, Greenville, SC, USA, 3–10. https://doi.org/10.1109/VR.2016.7504682
  2. Perceptual interactions in a minimalist virtual environment. New Ideas in Psychology 27, 1 (April 2009), 32–47. https://doi.org/10.1016/j.newideapsych.2007.12.002
  3. Malika Auvray and Marieke Rohde. 2012. Perceptual crossing: the simplest online paradigm. Frontiers in human neuroscience 6 (2012), 181.
  4. How Does HCI Understand Human Agency and Autonomy?. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 375, 18 pages. https://doi.org/10.1145/3544548.3580651
  5. The mirror neuron system in post-stroke rehabilitation. International archives of medicine 6, 1 (2013), 1–7.
  6. Thematic analysis. In APA Handbook of Research Methods in Psychology: Vol. 2. Research Designs. American Psychological Association, Washington, 57–71. https://doi.org/10.1037/13620-000
  7. The sense of agency in emerging technologies for human-computer integration: A review. Front. Neurosci. 16 (Sept. 2022), 949138.
  8. BreatheWithMe: Exploring Visual and Vibrotactile Displays for Social Breath Awareness during Colocated, Collaborative Tasks. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI EA ’23). Association for Computing Machinery, New York, NY, USA, Article 58, 8 pages. https://doi.org/10.1145/3544549.3585589
  9. An Aligned Rank Transform Procedure for Multifactor Contrast Tests. https://doi.org/10.48550/arXiv.2102.11824 arXiv:2102.11824 [cs, stat].
  10. Avatar and Sense of Embodiment: Studying the Relative Preference Between Appearance, Control and Point of View. IEEE Transactions on Visualization and Computer Graphics 26, 5 (May 2020), 2062–2072. https://doi.org/10.1109/TVCG.2020.2973077
  11. Virtual Co-Embodiment: Evaluation of the Sense of Agency While Sharing the Control of a Virtual Body Among Two Individuals. IEEE Transactions on Visualization and Computer Graphics 27, 10 (Oct. 2021), 4023–4038. https://doi.org/10.1109/TVCG.2020.2999197
  12. Embodied social interaction constitutes social cognition in pairs of humans: a minimalist virtual reality experiment. Scientific reports 4, 1 (2014), 3672.
  13. Using minimal human-computer interfaces for studying the interactive development of social awareness. Frontiers in psychology 5 (2014), 1061.
  14. Immersive Mixed Reality for Manufacturing Training. Frontiers in Robotics and AI 4 (2017). https://www.frontiersin.org/articles/10.3389/frobt.2017.00003
  15. Shared Body by Action Integration of Two Persons: Body Ownership, Sense of Agency and Task Performance. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Osaka, Japan, 954–955. https://doi.org/10.1109/VR.2019.8798222
  16. Ayah Hamad and Bochen Jia. 2022. How Virtual Reality Technology Has Changed Our Lives: An Overview of the Current and Potential Applications and Limitations. International Journal of Environmental Research and Public Health 19, 18 (2022). https://doi.org/10.3390/ijerph191811278
  17. Effect of connection induced upper body movements on embodiment towards a limb controlled by another during virtual co-embodiment. PLOS ONE 18, 1 (Jan. 2023), e0278022. https://doi.org/10.1371/journal.pone.0278022
  18. Harin Hapuarachchi and Michiteru Kitazaki. 2022. Knowing the intention behind limb movements of a partner increases embodiment towards the limb of joint avatar. Scientific Reports 12, 1 (July 2022), 11453. https://doi.org/10.1038/s41598-022-15932-x
  19. Exploring the role of virtual reality in military decision training. Frontiers in Virtual Reality 4 (2023). https://www.frontiersin.org/articles/10.3389/frvir.2023.1165030
  20. Influence of avatar appearance on presence in social VR. In 3D User Interfaces (3DUI), 2017 IEEE Symposium on. IEEE, Los Angeles, CA, USA, 233–234.
  21. Cyborgs, Human Augmentation, Cybernetics, and JIZAI Body. In Augmented Humans 2022 (Kashiwa, Chiba, Japan) (AHs 2022). Association for Computing Machinery, New York, NY, USA, 230?242. https://doi.org/10.1145/3519391.3519401
  22. “Do You Feel in Control?”: Towards Novel Approaches to Characterise, Manipulate and Measure the Sense of Agency in Virtual Environments. IEEE Transactions on Visualization and Computer Graphics 24, 4 (April 2018), 1486–1495. https://doi.org/10.1109/TVCG.2018.2794598
  23. Immersive virtual reality for upper limb rehabilitation: comparing hand and controller interaction. Virtual Reality 27, 2 (2023), 1157–1171.
  24. On the Use of Multi-sensory Cues in Symmetric and Asymmetric Shared Collaborative Virtual Spaces. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (April 2021), 1–25. https://doi.org/10.1145/3449146
  25. My body until proven otherwise: Exploring the time course of the full body illusion. Consciousness and Cognition 78 (2020), 102882. https://doi.org/10.1016/j.concog.2020.102882
  26. Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. The International Journal of Aviation Psychology 3, 3 (1993), 203–220. https://doi.org/10.1207/s15327108ijap0303_3 Place: US Publisher: Lawrence Erlbaum.
  27. The Sense of Embodiment in Virtual Reality. Presence: Teleoperators and Virtual Environments 21, 4 (Nov. 2012), 373–387. https://doi.org/10.1162/PRES_a_00124
  28. Enhancing the Sense of Agency by Transitional Weight Control in Virtual Co-Embodiment. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, Singapore, Singapore, 278–286. https://doi.org/10.1109/ISMAR55827.2022.00043
  29. Effects of Collaborative Training Using Virtual Co-embodiment on Motor Skill Learning. IEEE Transactions on Visualization and Computer Graphics 29, 5 (May 2023), 2304–2314. https://doi.org/10.1109/TVCG.2023.3247112
  30. A sensorimotor signature of the transition to conscious social perception: co-regulation of active and passive touch. Frontiers in Psychology 8 (2017), 1778.
  31. A Systematic Review of the Use of Technology for Reminiscence Therapy. Health Education & Behavior 41, 1_suppl (2014), 51S–61S. https://doi.org/10.1177/1090198114537067 arXiv:https://doi.org/10.1177/1090198114537067 PMID: 25274711.
  32. Charles Lenay. 2021. Perceiving at a distance: enaction, exteriority and possibility–a tribute to John Stewart. Adaptive Behavior 29, 5 (2021), 485–503.
  33. “You never fail to surprise me”: the hallmark of the Other: Experimental study and simulations of perceptual crossing. Interaction Studies. Social Behaviour and Communication in Biological and Artificial Systems 12, 3 (Nov. 2011), 373–396. https://doi.org/10.1075/is.12.3.01len
  34. Measuring and Understanding Photo Sharing Experiences in Social Virtual Reality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). ACM, New York, NY, USA, 1?14. https://doi.org/10.1145/3290605.3300897
  35. Sohye Lim and Byron Reeves. 2009. Being in the Game: Effects of Avatar Choice and Point of View on Psychophysiological Responses During Play. Media Psychology 12, 4 (2009), 348–370. https://doi.org/10.1080/15213260903287242 arXiv:https://doi.org/10.1080/15213260903287242
  36. Development and testing of a virtual reality mirror therapy system for the sensorimotor performance of upper extremity: A pilot randomized controlled trial. IEEE Access 9 (2021), 14725–14734.
  37. A novel fully immersive virtual reality environment for upper extremity rehabilitation in patients with stroke. Annals of the New York Academy of Sciences 1493, 1 (2021), 75–89.
  38. Do multisensory stimuli benefit the virtual reality experience? A systematic review. IEEE Transactions on Visualization and Computer Graphics 28, 2 (2020), 1428–1442.
  39. Jonas Moll and Eva-Lotta Sallnäs. 2009. Communicative functions of haptic feedback. In International Conference on Haptic and Audio Interaction Design. Springer, Springer, Berlin, Heidelberg, 1–10.
  40. Next Steps for Human-Computer Integration. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1?15. https://doi.org/10.1145/3313831.3376242
  41. Virtual Hand Realism Affects Object Size Perception in Body-Based Scaling. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Osaka, Japan, 519–528. https://doi.org/10.1109/VR.2019.8798040
  42. A Systematic Review of Social Presence: Definition, Antecedents, and Implications. Frontiers in Robotics and AI 5 (Oct. 2018), 114. https://doi.org/10.3389/frobt.2018.00114
  43. Zizi Papacharissi. 2005. The Real-Virtual Dichotomy in Online Interaction: New Media Uses and Consequences Revisited. Annals of the International Communication Association 29, 1 (Jan. 2005), 216–238. https://doi.org/10.1080/23808985.2005.11679048
  44. Tabitha C. Peck and Mar Gonzalez-Franco. 2021. Avatar Embodiment. A Standardized Questionnaire. Frontiers in Virtual Reality 1 (Feb. 2021), 575943. https://doi.org/10.3389/frvir.2020.575943
  45. Tekla S. Perry. 2016. Virtual reality goes social. IEEE Spectrum 53, 1 (2016), 56–57. https://doi.org/10.1109/MSPEC.2016.7367470
  46. Daniel Pimentel and Charlotte Vinkers. 2021. Copresence With Virtual Humans in Mixed Reality: The Impact of Contextual Responsiveness on Social Perceptions. Frontiers in Robotics and AI 8 (April 2021), 634520. https://doi.org/10.3389/frobt.2021.634520
  47. Breaking The Experience: Effects of Questionnaires in VR User Studies. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1?15. https://doi.org/10.1145/3313831.3376144
  48. Going, Going, Gone: Exploring Intention Communication for Multi-User Locomotion in Virtual Reality. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, Hamburg Germany, 1–13. https://doi.org/10.1145/3544548.3581259
  49. Da Vinci Effect - multiplayer Virtual Reality experience. In Eurographics Workshop on Graphics and Cultural Heritage, Federico Ponchio and Ruggero Pintus (Eds.). The Eurographics Association, . https://doi.org/10.2312/gch.20221229
  50. Social touch experience in different contexts: A review. Neuroscience & Biobehavioral Reviews 131 (2021), 360–372. https://doi.org/10.1016/j.neubiorev.2021.09.027
  51. The experience of presence: Factor analytic insights. Presence: Teleoperators & Virtual Environments 10, 3 (2001), 266–281.
  52. ”These Are Not My Hands!”: Effect of Gender on the Perception of Avatar Hands in Virtual Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 1577–1582. https://doi.org/10.1145/3025453.3025602
  53. VibViz: Organizing, visualizing and navigating vibration libraries. In 2015 IEEE World Haptics Conference (WHC). IEEE, , 254–259.
  54. Harrison Jesse Smith and Michael Neff. 2018. Communication Behavior in Embodied Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). ACM, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173863
  55. Mandayam A Srinivasan and Cagatay Basdogan. 1997. Haptics in virtual environments: Taxonomy, research status, and challenges. Computers & Graphics 21, 4 (1997), 393–404.
  56. From Gaze Perception to Social Cognition: The Shared-Attention System. Perspectives on Psychological Science 16, 3 (2021), 553–576. https://doi.org/10.1177/1745691620953773 arXiv:https://doi.org/10.1177/1745691620953773 PMID: 33567223.
  57. Nonverbal synchrony in virtual reality. PLOS ONE 14, 9 (09 2019), 1–28. https://doi.org/10.1371/journal.pone.0221803
  58. Developing an Interactive VR CAVE for Immersive Shared Gaming Experiences. Virtual Worlds 2, 2 (May 2023), 162–181. https://doi.org/10.3390/virtualworlds2020010
  59. Joint action: Mental representations, shared information and general mechanisms for coordinating with others. Frontiers in psychology 7 (2017), 2039.
  60. Haptic Interfaces for Virtual Reality: Challenges and Research Directions. IEEE Access 9 (2021), 112145–112162. https://doi.org/10.1109/ACCESS.2021.3103598 Conference Name: IEEE Access.
  61. Improving Virtual Reality Ergonomics Through Reach-Bounded Non-Linear Input Amplification. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376687
  62. Norbert Wiener. 1948. Cybernetics: or Control and Communication in the Animal and the Machine (2 ed.). MIT Press, Cambridge, MA.
  63. The aligned rank transform for nonparametric factorial analyses using only anova procedures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’11). Association for Computing Machinery, New York, NY, USA, 143–146. https://doi.org/10.1145/1978942.1978963
  64. Synchrony to a beat predicts synchrony with other minds. Scientific Reports 13, 1 (2023), 3591.
  65. Recent Advances and Opportunities of Active Materials for Haptic Technologies in Virtual and Augmented Reality. Advanced Functional Materials 31, 39 (2021), 2008831. https://doi.org/10.1002/adfm.202008831 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/adfm.202008831
  66. Ungyeon Yang and Gerard Jounghyun Kim. 2002. Implementation and Evaluation of ”Just Follow Me”: An Immersive, VR-Based, Motion-Training System. Presence: Teleoper. Virtual Environ. 11, 3 (jun 2002), 304–323. https://doi.org/10.1162/105474602317473240
  67. Neural3Points: Learning to Generate Physically Realistic Full-body Motion for Virtual Reality Users. https://doi.org/10.48550/arXiv.2209.05753 arXiv:2209.05753 [cs].
  68. RemoteTouch: Enhancing Immersive 3D Video Communication with Hand Touch. http://arxiv.org/abs/2302.14365 arXiv:2302.14365 [cs].
  69. Effects of Virtual Reality Intervention on Cognition and Motor Function in Older Adults With Mild Cognitive Impairment or Dementia: A Systematic Review and Meta-Analysis. Frontiers in Aging Neuroscience 13 (2021). https://doi.org/10.3389/fnagi.2021.586999
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (5)
  1. Karthikeya Puttur Venkatraj (3 papers)
  2. Wo Meijer (3 papers)
  3. Gijs Huisman (2 papers)
  4. Abdallah El Ali (14 papers)
  5. Monica Perusquía-Hernández (3 papers)
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets