Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
102 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Am I the Odd One? Exploring (In)Congruencies in the Realism of Avatars and Virtual Others in Virtual Reality (2403.07122v2)

Published 11 Mar 2024 in cs.HC

Abstract: Virtual humans play a pivotal role in social virtual environments, shaping users' VR experiences. The diversity in available options and users' preferences can result in a heterogeneous mix of appearances among a group of virtual humans. The resulting variety in higher-order anthropomorphic and realistic cues introduces multiple (in)congruencies, eventually impacting the plausibility of the experience. In this work, we consider the impact of (in)congruencies in the realism of a group of virtual humans, including co-located others and one's self-avatar. In a 2 x 3 mixed design, participants embodied either (1) a personalized realistic or (2) a customized stylized self-avatar across three consecutive VR exposures in which they were accompanied by a group of virtual others being either (1) all realistic, (2) all stylized, or (3) mixed. Our results indicate groups of virtual others of higher realism, i.e., potentially more congruent with participants' real-world experiences and expectations, were considered more human-like, increasing the feeling of co-presence and the impression of interaction possibilities. (In)congruencies concerning the homogeneity of the group did not cause considerable effects. Furthermore, our results indicate that a self-avatar's congruence with the participant's real-world experiences concerning their own physical body yielded notable benefits for virtual body ownership and self-identification for realistic personalized avatars. Notably, the incongruence between a stylized self-avatar and a group of realistic virtual others resulted in diminished ratings of self-location and self-identification. We conclude on the implications of our findings and discuss our results within current theories of VR experiences, considering (in)congruent visual cues and their impact on the perception of virtual others, self-representation, and spatial presence.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (98)
  1. Fast generation of realistic virtual humans. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology (New York, NY, USA: Association for Computing Machinery), 1–10. 10.1145/3139131.3139154
  2. Adobe Systems Inc. (2023). Mixamo. https://www.mixamo.com/ [Accessed November, 2023]
  3. Agisoft (2021). Metashape Pro. http://www.agisoft.com/ [Accessed November, 2023]
  4. Avatars. In Encyclopedia of Human-Computer Interaction (Great Barrington, MA, USA: Berkshire Publishing Group). 64–68
  5. Equilibrium theory revisited: Mutual gaze and personal space in virtual environments. Presence 10, 583–598. 10.1162/105474601753272844
  6. The independent and interactive effects of embodied-agent appearance and behavior on self-report, cognitive, and behavioral markers of copresence in immersive virtual environments. Presence 14, 379–393. 10.1162/105474605774785235
  7. Bakeman, R. (2005). Recommended effect size statistics for repeated measures designs. Behavior Research Methods 37, 379–384. 10.3758/BF03192707
  8. Encyclopedia of Social Psychology (SAGE Publications, Inc.). 276–276. 10.4135/9781412956253
  9. Avatar-mediated networking: Increasing social presence and interpersonal trust in net-based collaborations. Human Communication Research 34, 287–318. 10.1111/j.1468-2958.2008.00322.x
  10. The plausibility of a string quartet performance in virtual reality. IEEE Transactions on Visualization and Computer Graphics 23, 1352–1359. 10.1109/TVCG.2017.2657138
  11. Blender Foundation (2019). Blender - An open source 3D creation suite. Version 2.8.0 https://www.blender.org/ [Accessed November, 2023]
  12. Dynamic 2D/3D registration. In Eurographics Tutorials. 1–17. 10.1145/2504435.2504456
  13. Reliability and validity of a single-item measure of presence in vr. In The 3rd IEEE International Workshop on Haptic, Audio and Visual Environments and Their Applications (IEEE), 59–61. 10.1109/HAVE.2004.1391882
  14. Fast approximate energy minimization via graph cuts. ACM Transactions on Pattern Analysis and Machine Intelligence 23, 1222–1239. 10.1109/34.969114
  15. Virtual humans: Today and tomorrow (CRC Press)
  16. Influence of visual appearance of agents on presence, attractiveness, and agency in virtual reality. In ArtsIT, Interactivity and Game Creation (Springer International Publishing), 44–60
  17. Beyond my real body: Characterization, impacts, applications and perspectives of “dissimilar” avatars in virtual reality. IEEE Transactions on Visualization and Computer Graphics 29, 4426–4437. 10.1109/TVCG.2023.3320209
  18. Cohen, J. (2013). Statistical Power Analysis for the Behavioral Sciences (Routledge), 0 edn. 10.4324/9780203771587
  19. On the plausibility of virtual body animation features in virtual reality. vol. 28, 1880–1893. 10.1109/TVCG.2020.3025175
  20. Virtual and Augmented Reality (VR/AR): Foundations and Methods of Extended Realities (XR) (Springer International Publishing). 10.1007/978-3-030-79062-2
  21. Body and mind: a study of avatar personalization in three virtual worlds. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (New York, NY, USA: Association for Computing Machinery), CHI ’09, 1151–1160. 10.1145/1518701.1518877
  22. “if it’s not me it doesn’t make a difference” - the impact of avatar personalization on user experience and body awareness in virtual reality. In 2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 483–492. 10.1109/ISMAR59233.2023.00063
  23. ViTraS - virtual reality therapy by stimulation of modulated body image - project outline. In Mensch und computer 2019 - workshopband, hamburg, germany, september 8-11, 2019. 10.18420/muc2019-ws-633
  24. G* Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. https://doi.org/10.3758/BF03193146. Publisher: Springer
  25. Embodiment and personalization for self-identification with virtual humans. In 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 799–800. 10.1109/VRW58643.2023.00242
  26. Body, avatar, and me: The presentation and perception of self in social virtual reality. In Proc. ACM on Human-Computer Interaction (New York, NY, USA: Association for Computing Machinery), 239:1–239:27. 10.1145/3432938
  27. Avatar and sense of embodiment: Studying the relative preference between appearance, control and point of view. IEEE Transactions on Visualization and Computer Graphics 26, 2062–2072. 10.1109/TVCG.2020.2973077
  28. The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment. In Proceedings of the conference on Human factors in computing systems - CHI ’03 (ACM Press), 529. 10.1145/642611.642703
  29. Using facial animation to increase the enfacement illusion and avatar self-identification. IEEE Transactions on Visualization and Computer Graphics 26, 2023–2029
  30. From robot to virtual doppelganger: Impact of visual fidelity of avatars controlled in third-person perspective on embodiment and behavior in immersive virtual environments. Frontiers in Robotics and AI 6. 10.3389/frobt.2019.00008
  31. Aspects of visual avatar appearance: Self-representation, display type, and uncanny valley. The Visual Computer 38, 1227–1244. 10.1007/s00371-021-02151-0
  32. Measuring the Uncanny Valley Effect. International Journal of Social Robotics 9, 129–139. 10.1007/s12369-016-0380-9
  33. Kassambara, A. (2023). rstatix: Pipe-Friendly Framework for Basic Statistical Tests. R package version 0.7.2. https://CRAN.R-project.org/package=rstatix/ [Accessed November, 2023]
  34. The sense of embodiment in virtual reality. Presence: Teleoperators and Virtual Environments 21, 373–387. 10.1162/PRES_a_00124
  35. The effects of virtual human’s spatial and behavioral coherence with physical objects on social presence in AR. Computer Animation and Virtual Worlds 28, e1771. 10.1002/cav.1771
  36. Understanding Emerging Design Practices for Avatar Systems in the Commercial Social VR Ecology. In Proceedings of the 2019 on Designing Interactive Systems Conference (New York, NY, USA: Association for Computing Machinery), 241–252. 10.1145/3322276.3322352
  37. An evaluation of other-avatar facial animation methods for social VR. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 10.1145/3544549.3585617
  38. Social interaction with agents and avatars in immersive virtual environments: A survey. Frontiers in Virtual Reality 2. 10.3389/frvir.2021.786665
  39. Not alone here?! Scalability and user experience of embodied ambient crowds in distributed social virtual reality. IEEE Transactions on Visualization and Computer Graphics 25, 2134–2144. 10.1109/TVCG.2019.2899250
  40. The effect of avatar realism in immersive social virtual realities. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology (Gothenburg, Sweden: Association for Computing Machinery), 1–10. 10.1145/3139131.3139156
  41. Congruence and plausibility, not presence?! Pivotal conditions for XR experiences and effects, a novel approach. Frontiers in Virtual Reality 3. 10.3389/frvir.2022.694433
  42. How avatar identification affects enjoyment in the metaverse: The roles of avatar customization and social engagement. Cyberpsychology, Behavior, and Social Networking 26, 255–262. 10.1089/cyber.2022.0257
  43. LimeSurvey GmbH (2020). LimeSurvey: An open source survey tool. Version 4.5. https://www.limesurvey.org/ [Accessed November, 2023]
  44. Social virtual reality platform comparison and evaluation using a guided group walkthrough method. Frontiers in Virtual Reality 2. 10.3389/frvir.2021.668181
  45. What is embodiment? a psychometric approach. Cognition 107, 978–998. 10.1016/j.cognition.2007.12.004
  46. Anthropomorphism and illusion of virtual body ownership. In Proceedings of the 25th International Conference on Artificial Reality and Telexistence and 20th Eurographics Symposium on Virtual Environments (Kyoto, Japan: Eurographics Association), 1–8
  47. Mal, D. (2020). [dc] the impact of social interactions on an embodied individual’s self-perception in virtual environments. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 545–546. 10.1109/VRW50115.2020.00124
  48. Virtual human coherence and plausibility – towards a validated scale. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 788–789. 10.1109/VRW55335.2022.00245
  49. The impact of avatar and environment congruence on plausibility, embodiment, presence, and the proteus effect in virtual reality. IEEE Transactions on Visualization and Computer Graphics 29, 2358–2368. 10.1109/TVCG.2023.3247089
  50. The building blocks of the full body ownership illusion. Frontiers in Human Neuroscience 7. 10.3389/fnhum.2013.00083
  51. Render me real? Investigating the effect of render style on the perception of animated virtual humans. ACM Transactions on Graphics 31, 91:1–91:11. 10.1145/2185520.2185587
  52. Shaping pro-social interaction in VR: An emerging design Framework. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow Scotland Uk: ACM), 1–12. 10.1145/3290605.3300794
  53. Monk, E. (2019). Monk skin tone scale. https://skintone.google/ [Accessed November, 2023]
  54. The uncanny valley [from the field]. IEEE Robotics & Automation Magazine 19, 98–100. 10.1109/MRA.2012.2192811
  55. A systematic review and meta-analysis of the effectiveness of body ownership illusions in virtual reality. ACM Trans. Comput.-Hum. Interact. 10.1145/3590767
  56. Movella Inc. (2022). Xsens MVN Record. Version 2022.0.0 https://www.xsens.com/ [Accessed November, 2023]
  57. Nowak, K. (2004). The influence of anthropomorphism and agency on social judgment in virtual environments. Journal of Computer-Mediated Communication 9. 10.1111/j.1083-6101.2004.tb00284.x
  58. Avatars and computer-mediated communication: A review of the definitions, uses, and effects of digital representations. Review of Communication Research 6, 30–53. 10.12840/issn.2255-4165.2018.06.01.015
  59. Orel, M. (2022). The virtual reality workplace. In Collaboration potential in virtual reality (VR) office space: Transforming the workplace of tomorrow (Cham: Springer International Publishing). 35–73. 10.1007/978-3-031-08180-4_4
  60. Poisson image editing. ACM Transactions on Computer Graphics 22, 313–318. 10.1145/1201775.882269
  61. Measuring co-presence and social presence in virtual environments – Psychometric construction of a German scale for a fear of public speaking scenario. Annual Review of Cybertherapy and Telemedicine 2015 , 58–6310.3233/978-1-61499-595-1-58
  62. R Core Team (2023). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing. https://www.r-project.org/ [Accessed November, 2023]
  63. Avatar characteristics induce users’ behavioral conformity with small-to-medium effect sizes: A meta-analysis of the Proteus effect. Media Psychology , 1–2510.1080/15213269.2019.1623698
  64. Rootmotion (2019). FinalIK. Version 2.1. http://root-motion.com/ [Accessed November, 2023]
  65. Construction of the virtual embodiment questionnaire (veq). IEEE Transactions on Visualization and Computer Graphics 26, 3546–3556. 10.1109/TVCG.2020.3023603
  66. The Effect of Presence and Appearance of Guides in Virtual Reality Exhibitions. In Proceedings of Mensch und Computer 2019 (New York, NY, USA: Association for Computing Machinery), MuC ’19. 10.1145/3340764.3340802
  67. Meeting your virtual twin: Effects of photorealism and personalization on embodiment, self-identification and perception of self-avatars in virtual reality. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–16. 10.1145/3544548.3581182
  68. Virtual reality and augmented reality in social learning spaces: a literature review. Virtual Reality 25. 10.1007/s10055-020-00444-8
  69. Schroeder, R. (2002). Social Interaction in Virtual Environments: Key Issues, Common Themes, and a Framework for Research (Springer London). 1–18. 10.1007/978-1-4471-0277-9_1
  70. The experience of presence: Factor analytic insights. Presence: Teleoperators and Virtual Environments 10, 266–281. 10.1162/105474601300343603
  71. Schulz, R. (2023). Welcome to the metaverse: A comprehensive list of social VR/AR platforms and virtual worlds. https://ryanschultz.com/list-of-social-vr-virtual-worlds/ [Accessed November, 2023]
  72. Immersion and coherence: Research agenda and early results. IEEE Transactions on Visualization and Computer Graphics 27, 3839–3850. 10.1109/TVCG.2020.2983701
  73. A survey of presence and related concepts. ACM Computing Surveys 50, 96:1–96:39. 10.1145/3134301
  74. A psychophysical experiment regarding components of the plausibility illusion. IEEE Transactions on Visualization and Computer Graphics 23, 1369–1378. 10.1109/TVCG.2017.2657158
  75. Slater, M. (2009). Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philosophical Transactions of the Royal Society B: Biological Sciences 364, 3549–3557. https://royalsocietypublishing.org/doi/10.1098/rstb.2009.0138
  76. A separate reality: An update on place illusion and plausibility in virtual reality. Frontiers in Virtual Reality 3. 10.3389/frvir.2022.914392
  77. Inducing illusory ownership of a virtual body. Frontiers in Neuroscience 3. 10.3389/neuro.01.029.2009
  78. First person experience of body transfer in virtual reality. PLOS ONE 5, 1–9. 10.1371/journal.pone.0010564
  79. A framework for immersive virtual environments (FIVE): Speculations on the role of presence in virtual environments. Presence: Teleoperators and Virtual Environments 6, 603–616. 10.1162/pres.1997.6.6.603
  80. Latency and cybersickness: Impact, causes, and measures. A review. Frontiers in Virtual Reality 1. 10.3389/frvir.2020.582204
  81. Fast articulated motion tracking using a sums of gaussians body model. In 2011 International Conference on Computer Vision. 951–958. 10.1109/ICCV.2011.6126338
  82. The Captury (2021). Captury Live. Version 254b. https://captury.com [Accessed November, 2023]
  83. Unity Technologies (2020). Unity. Version 2020.3.25f1. https://unity.com [Accessed November, 2023]
  84. Valve Corporation (2021). SteamVR. https://store.steampowered.com/app/250820/SteamVR [Accessed November, 2023]
  85. Valve Corporation (2022). Index. https://store.steampowered.com/valveindex [Accessed November, 2023]
  86. The impact of avatar personalization and immersion on virtual body ownership, presence, and emotional response. IEEE Transactions on Visualization and Computer Graphics 24, 1643–1652. 10.1109/TVCG.2018.2794629
  87. A systematic review on the visualization of avatars and agents in AR & VR displayed using head-mounted displays. IEEE Transactions on Visualization and Computer Graphics 29, 2596–2606. 10.1109/TVCG.2023.3247072
  88. Realistic virtual humans from smartphone videos. In Proceedings of the 26th ACM Symposium on Virtual Reality Software and Technology (Association for Computing Machinery), VRST ’20. 10.1145/3385956.3418940
  89. Behavioral framework of immersive technologies (BehaveFIT): How and why virtual reality can support behavioral change processes. Frontiers in Virtual Reality 2. 10.3389/frvir.2021.627194
  90. Perception of lighting and shading for animated virtual characters. In Proceedings of the ACM Symposium on Applied Perception (New York, NY, USA: Association for Computing Machinery), SAP ’16, 25–29. 10.1145/2931002.2931015
  91. Does distance matter? Embodiment and perception of personalized avatars in relation to the self-observation distance in virtual reality. Frontiers in Virtual Reality 3. 10.3389/frvir.2022.1031093
  92. Body weight perception of females using photorealistic avatars in virtual and augmented reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 462–473. 10.1109/ISMAR50242.2020.00071
  93. Exploring presence, avatar embodiment, and body perception with a holographic augmented reality mirror. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 350–359. 10.1109/VR51125.2022.00054
  94. Plausibility and perception of personalized virtual humans between virtual and augmented reality. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 489–498. 10.1109/ISMAR55827.2022.00065
  95. To stylize or not to stylize? the effect of shape and material stylization on the perception of computer-generated faces 34. 10.1145/2816795.2818126
  96. Perception of virtual characters. In ACM SIGGRAPH 2019 Courses (New York, NY, USA: Association for Computing Machinery), SIGGRAPH ’19. 10.1145/3305366.3328101
  97. Don’t stand so close to me: investigating the effect of control on the appeal of virtual humans using immersion and a proximity-based behavioral task. In Proceedings of the ACM Symposium on Applied Perception. SAP ’17, 1–11. 10.1145/3119881.3119887
  98. Is photorealism important for perception of expressive virtual humans in virtual reality? ACM Transactions on Applied Perception 16, 14:1–14:19. 10.1145/3349609
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (7)
  1. David Mal (2 papers)
  2. Nina Döllinger (2 papers)
  3. Erik Wolf (2 papers)
  4. Stephan Wenninger (4 papers)
  5. Mario Botsch (11 papers)
  6. Carolin Wienrich (8 papers)
  7. Marc Erich Latoschik (13 papers)