Am I the Odd One? Exploring (In)Congruencies in the Realism of Avatars and Virtual Others in Virtual Reality (2403.07122v2)
Abstract: Virtual humans play a pivotal role in social virtual environments, shaping users' VR experiences. The diversity in available options and users' preferences can result in a heterogeneous mix of appearances among a group of virtual humans. The resulting variety in higher-order anthropomorphic and realistic cues introduces multiple (in)congruencies, eventually impacting the plausibility of the experience. In this work, we consider the impact of (in)congruencies in the realism of a group of virtual humans, including co-located others and one's self-avatar. In a 2 x 3 mixed design, participants embodied either (1) a personalized realistic or (2) a customized stylized self-avatar across three consecutive VR exposures in which they were accompanied by a group of virtual others being either (1) all realistic, (2) all stylized, or (3) mixed. Our results indicate groups of virtual others of higher realism, i.e., potentially more congruent with participants' real-world experiences and expectations, were considered more human-like, increasing the feeling of co-presence and the impression of interaction possibilities. (In)congruencies concerning the homogeneity of the group did not cause considerable effects. Furthermore, our results indicate that a self-avatar's congruence with the participant's real-world experiences concerning their own physical body yielded notable benefits for virtual body ownership and self-identification for realistic personalized avatars. Notably, the incongruence between a stylized self-avatar and a group of realistic virtual others resulted in diminished ratings of self-location and self-identification. We conclude on the implications of our findings and discuss our results within current theories of VR experiences, considering (in)congruent visual cues and their impact on the perception of virtual others, self-representation, and spatial presence.
- Fast generation of realistic virtual humans. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology (New York, NY, USA: Association for Computing Machinery), 1–10. 10.1145/3139131.3139154
- Adobe Systems Inc. (2023). Mixamo. https://www.mixamo.com/ [Accessed November, 2023]
- Agisoft (2021). Metashape Pro. http://www.agisoft.com/ [Accessed November, 2023]
- Avatars. In Encyclopedia of Human-Computer Interaction (Great Barrington, MA, USA: Berkshire Publishing Group). 64–68
- Equilibrium theory revisited: Mutual gaze and personal space in virtual environments. Presence 10, 583–598. 10.1162/105474601753272844
- The independent and interactive effects of embodied-agent appearance and behavior on self-report, cognitive, and behavioral markers of copresence in immersive virtual environments. Presence 14, 379–393. 10.1162/105474605774785235
- Bakeman, R. (2005). Recommended effect size statistics for repeated measures designs. Behavior Research Methods 37, 379–384. 10.3758/BF03192707
- Encyclopedia of Social Psychology (SAGE Publications, Inc.). 276–276. 10.4135/9781412956253
- Avatar-mediated networking: Increasing social presence and interpersonal trust in net-based collaborations. Human Communication Research 34, 287–318. 10.1111/j.1468-2958.2008.00322.x
- The plausibility of a string quartet performance in virtual reality. IEEE Transactions on Visualization and Computer Graphics 23, 1352–1359. 10.1109/TVCG.2017.2657138
- Blender Foundation (2019). Blender - An open source 3D creation suite. Version 2.8.0 https://www.blender.org/ [Accessed November, 2023]
- Dynamic 2D/3D registration. In Eurographics Tutorials. 1–17. 10.1145/2504435.2504456
- Reliability and validity of a single-item measure of presence in vr. In The 3rd IEEE International Workshop on Haptic, Audio and Visual Environments and Their Applications (IEEE), 59–61. 10.1109/HAVE.2004.1391882
- Fast approximate energy minimization via graph cuts. ACM Transactions on Pattern Analysis and Machine Intelligence 23, 1222–1239. 10.1109/34.969114
- Virtual humans: Today and tomorrow (CRC Press)
- Influence of visual appearance of agents on presence, attractiveness, and agency in virtual reality. In ArtsIT, Interactivity and Game Creation (Springer International Publishing), 44–60
- Beyond my real body: Characterization, impacts, applications and perspectives of “dissimilar” avatars in virtual reality. IEEE Transactions on Visualization and Computer Graphics 29, 4426–4437. 10.1109/TVCG.2023.3320209
- Cohen, J. (2013). Statistical Power Analysis for the Behavioral Sciences (Routledge), 0 edn. 10.4324/9780203771587
- On the plausibility of virtual body animation features in virtual reality. vol. 28, 1880–1893. 10.1109/TVCG.2020.3025175
- Virtual and Augmented Reality (VR/AR): Foundations and Methods of Extended Realities (XR) (Springer International Publishing). 10.1007/978-3-030-79062-2
- Body and mind: a study of avatar personalization in three virtual worlds. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (New York, NY, USA: Association for Computing Machinery), CHI ’09, 1151–1160. 10.1145/1518701.1518877
- “if it’s not me it doesn’t make a difference” - the impact of avatar personalization on user experience and body awareness in virtual reality. In 2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 483–492. 10.1109/ISMAR59233.2023.00063
- ViTraS - virtual reality therapy by stimulation of modulated body image - project outline. In Mensch und computer 2019 - workshopband, hamburg, germany, september 8-11, 2019. 10.18420/muc2019-ws-633
- G* Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. https://doi.org/10.3758/BF03193146. Publisher: Springer
- Embodiment and personalization for self-identification with virtual humans. In 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 799–800. 10.1109/VRW58643.2023.00242
- Body, avatar, and me: The presentation and perception of self in social virtual reality. In Proc. ACM on Human-Computer Interaction (New York, NY, USA: Association for Computing Machinery), 239:1–239:27. 10.1145/3432938
- Avatar and sense of embodiment: Studying the relative preference between appearance, control and point of view. IEEE Transactions on Visualization and Computer Graphics 26, 2062–2072. 10.1109/TVCG.2020.2973077
- The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment. In Proceedings of the conference on Human factors in computing systems - CHI ’03 (ACM Press), 529. 10.1145/642611.642703
- Using facial animation to increase the enfacement illusion and avatar self-identification. IEEE Transactions on Visualization and Computer Graphics 26, 2023–2029
- From robot to virtual doppelganger: Impact of visual fidelity of avatars controlled in third-person perspective on embodiment and behavior in immersive virtual environments. Frontiers in Robotics and AI 6. 10.3389/frobt.2019.00008
- Aspects of visual avatar appearance: Self-representation, display type, and uncanny valley. The Visual Computer 38, 1227–1244. 10.1007/s00371-021-02151-0
- Measuring the Uncanny Valley Effect. International Journal of Social Robotics 9, 129–139. 10.1007/s12369-016-0380-9
- Kassambara, A. (2023). rstatix: Pipe-Friendly Framework for Basic Statistical Tests. R package version 0.7.2. https://CRAN.R-project.org/package=rstatix/ [Accessed November, 2023]
- The sense of embodiment in virtual reality. Presence: Teleoperators and Virtual Environments 21, 373–387. 10.1162/PRES_a_00124
- The effects of virtual human’s spatial and behavioral coherence with physical objects on social presence in AR. Computer Animation and Virtual Worlds 28, e1771. 10.1002/cav.1771
- Understanding Emerging Design Practices for Avatar Systems in the Commercial Social VR Ecology. In Proceedings of the 2019 on Designing Interactive Systems Conference (New York, NY, USA: Association for Computing Machinery), 241–252. 10.1145/3322276.3322352
- An evaluation of other-avatar facial animation methods for social VR. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 10.1145/3544549.3585617
- Social interaction with agents and avatars in immersive virtual environments: A survey. Frontiers in Virtual Reality 2. 10.3389/frvir.2021.786665
- Not alone here?! Scalability and user experience of embodied ambient crowds in distributed social virtual reality. IEEE Transactions on Visualization and Computer Graphics 25, 2134–2144. 10.1109/TVCG.2019.2899250
- The effect of avatar realism in immersive social virtual realities. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology (Gothenburg, Sweden: Association for Computing Machinery), 1–10. 10.1145/3139131.3139156
- Congruence and plausibility, not presence?! Pivotal conditions for XR experiences and effects, a novel approach. Frontiers in Virtual Reality 3. 10.3389/frvir.2022.694433
- How avatar identification affects enjoyment in the metaverse: The roles of avatar customization and social engagement. Cyberpsychology, Behavior, and Social Networking 26, 255–262. 10.1089/cyber.2022.0257
- LimeSurvey GmbH (2020). LimeSurvey: An open source survey tool. Version 4.5. https://www.limesurvey.org/ [Accessed November, 2023]
- Social virtual reality platform comparison and evaluation using a guided group walkthrough method. Frontiers in Virtual Reality 2. 10.3389/frvir.2021.668181
- What is embodiment? a psychometric approach. Cognition 107, 978–998. 10.1016/j.cognition.2007.12.004
- Anthropomorphism and illusion of virtual body ownership. In Proceedings of the 25th International Conference on Artificial Reality and Telexistence and 20th Eurographics Symposium on Virtual Environments (Kyoto, Japan: Eurographics Association), 1–8
- Mal, D. (2020). [dc] the impact of social interactions on an embodied individual’s self-perception in virtual environments. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 545–546. 10.1109/VRW50115.2020.00124
- Virtual human coherence and plausibility – towards a validated scale. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 788–789. 10.1109/VRW55335.2022.00245
- The impact of avatar and environment congruence on plausibility, embodiment, presence, and the proteus effect in virtual reality. IEEE Transactions on Visualization and Computer Graphics 29, 2358–2368. 10.1109/TVCG.2023.3247089
- The building blocks of the full body ownership illusion. Frontiers in Human Neuroscience 7. 10.3389/fnhum.2013.00083
- Render me real? Investigating the effect of render style on the perception of animated virtual humans. ACM Transactions on Graphics 31, 91:1–91:11. 10.1145/2185520.2185587
- Shaping pro-social interaction in VR: An emerging design Framework. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow Scotland Uk: ACM), 1–12. 10.1145/3290605.3300794
- Monk, E. (2019). Monk skin tone scale. https://skintone.google/ [Accessed November, 2023]
- The uncanny valley [from the field]. IEEE Robotics & Automation Magazine 19, 98–100. 10.1109/MRA.2012.2192811
- A systematic review and meta-analysis of the effectiveness of body ownership illusions in virtual reality. ACM Trans. Comput.-Hum. Interact. 10.1145/3590767
- Movella Inc. (2022). Xsens MVN Record. Version 2022.0.0 https://www.xsens.com/ [Accessed November, 2023]
- Nowak, K. (2004). The influence of anthropomorphism and agency on social judgment in virtual environments. Journal of Computer-Mediated Communication 9. 10.1111/j.1083-6101.2004.tb00284.x
- Avatars and computer-mediated communication: A review of the definitions, uses, and effects of digital representations. Review of Communication Research 6, 30–53. 10.12840/issn.2255-4165.2018.06.01.015
- Orel, M. (2022). The virtual reality workplace. In Collaboration potential in virtual reality (VR) office space: Transforming the workplace of tomorrow (Cham: Springer International Publishing). 35–73. 10.1007/978-3-031-08180-4_4
- Poisson image editing. ACM Transactions on Computer Graphics 22, 313–318. 10.1145/1201775.882269
- Measuring co-presence and social presence in virtual environments – Psychometric construction of a German scale for a fear of public speaking scenario. Annual Review of Cybertherapy and Telemedicine 2015 , 58–6310.3233/978-1-61499-595-1-58
- R Core Team (2023). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing. https://www.r-project.org/ [Accessed November, 2023]
- Avatar characteristics induce users’ behavioral conformity with small-to-medium effect sizes: A meta-analysis of the Proteus effect. Media Psychology , 1–2510.1080/15213269.2019.1623698
- Rootmotion (2019). FinalIK. Version 2.1. http://root-motion.com/ [Accessed November, 2023]
- Construction of the virtual embodiment questionnaire (veq). IEEE Transactions on Visualization and Computer Graphics 26, 3546–3556. 10.1109/TVCG.2020.3023603
- The Effect of Presence and Appearance of Guides in Virtual Reality Exhibitions. In Proceedings of Mensch und Computer 2019 (New York, NY, USA: Association for Computing Machinery), MuC ’19. 10.1145/3340764.3340802
- Meeting your virtual twin: Effects of photorealism and personalization on embodiment, self-identification and perception of self-avatars in virtual reality. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–16. 10.1145/3544548.3581182
- Virtual reality and augmented reality in social learning spaces: a literature review. Virtual Reality 25. 10.1007/s10055-020-00444-8
- Schroeder, R. (2002). Social Interaction in Virtual Environments: Key Issues, Common Themes, and a Framework for Research (Springer London). 1–18. 10.1007/978-1-4471-0277-9_1
- The experience of presence: Factor analytic insights. Presence: Teleoperators and Virtual Environments 10, 266–281. 10.1162/105474601300343603
- Schulz, R. (2023). Welcome to the metaverse: A comprehensive list of social VR/AR platforms and virtual worlds. https://ryanschultz.com/list-of-social-vr-virtual-worlds/ [Accessed November, 2023]
- Immersion and coherence: Research agenda and early results. IEEE Transactions on Visualization and Computer Graphics 27, 3839–3850. 10.1109/TVCG.2020.2983701
- A survey of presence and related concepts. ACM Computing Surveys 50, 96:1–96:39. 10.1145/3134301
- A psychophysical experiment regarding components of the plausibility illusion. IEEE Transactions on Visualization and Computer Graphics 23, 1369–1378. 10.1109/TVCG.2017.2657158
- Slater, M. (2009). Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philosophical Transactions of the Royal Society B: Biological Sciences 364, 3549–3557. https://royalsocietypublishing.org/doi/10.1098/rstb.2009.0138
- A separate reality: An update on place illusion and plausibility in virtual reality. Frontiers in Virtual Reality 3. 10.3389/frvir.2022.914392
- Inducing illusory ownership of a virtual body. Frontiers in Neuroscience 3. 10.3389/neuro.01.029.2009
- First person experience of body transfer in virtual reality. PLOS ONE 5, 1–9. 10.1371/journal.pone.0010564
- A framework for immersive virtual environments (FIVE): Speculations on the role of presence in virtual environments. Presence: Teleoperators and Virtual Environments 6, 603–616. 10.1162/pres.1997.6.6.603
- Latency and cybersickness: Impact, causes, and measures. A review. Frontiers in Virtual Reality 1. 10.3389/frvir.2020.582204
- Fast articulated motion tracking using a sums of gaussians body model. In 2011 International Conference on Computer Vision. 951–958. 10.1109/ICCV.2011.6126338
- The Captury (2021). Captury Live. Version 254b. https://captury.com [Accessed November, 2023]
- Unity Technologies (2020). Unity. Version 2020.3.25f1. https://unity.com [Accessed November, 2023]
- Valve Corporation (2021). SteamVR. https://store.steampowered.com/app/250820/SteamVR [Accessed November, 2023]
- Valve Corporation (2022). Index. https://store.steampowered.com/valveindex [Accessed November, 2023]
- The impact of avatar personalization and immersion on virtual body ownership, presence, and emotional response. IEEE Transactions on Visualization and Computer Graphics 24, 1643–1652. 10.1109/TVCG.2018.2794629
- A systematic review on the visualization of avatars and agents in AR & VR displayed using head-mounted displays. IEEE Transactions on Visualization and Computer Graphics 29, 2596–2606. 10.1109/TVCG.2023.3247072
- Realistic virtual humans from smartphone videos. In Proceedings of the 26th ACM Symposium on Virtual Reality Software and Technology (Association for Computing Machinery), VRST ’20. 10.1145/3385956.3418940
- Behavioral framework of immersive technologies (BehaveFIT): How and why virtual reality can support behavioral change processes. Frontiers in Virtual Reality 2. 10.3389/frvir.2021.627194
- Perception of lighting and shading for animated virtual characters. In Proceedings of the ACM Symposium on Applied Perception (New York, NY, USA: Association for Computing Machinery), SAP ’16, 25–29. 10.1145/2931002.2931015
- Does distance matter? Embodiment and perception of personalized avatars in relation to the self-observation distance in virtual reality. Frontiers in Virtual Reality 3. 10.3389/frvir.2022.1031093
- Body weight perception of females using photorealistic avatars in virtual and augmented reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 462–473. 10.1109/ISMAR50242.2020.00071
- Exploring presence, avatar embodiment, and body perception with a holographic augmented reality mirror. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 350–359. 10.1109/VR51125.2022.00054
- Plausibility and perception of personalized virtual humans between virtual and augmented reality. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 489–498. 10.1109/ISMAR55827.2022.00065
- To stylize or not to stylize? the effect of shape and material stylization on the perception of computer-generated faces 34. 10.1145/2816795.2818126
- Perception of virtual characters. In ACM SIGGRAPH 2019 Courses (New York, NY, USA: Association for Computing Machinery), SIGGRAPH ’19. 10.1145/3305366.3328101
- Don’t stand so close to me: investigating the effect of control on the appeal of virtual humans using immersion and a proximity-based behavioral task. In Proceedings of the ACM Symposium on Applied Perception. SAP ’17, 1–11. 10.1145/3119881.3119887
- Is photorealism important for perception of expressive virtual humans in virtual reality? ACM Transactions on Applied Perception 16, 14:1–14:19. 10.1145/3349609
- David Mal (2 papers)
- Nina Döllinger (2 papers)
- Erik Wolf (2 papers)
- Stephan Wenninger (4 papers)
- Mario Botsch (11 papers)
- Carolin Wienrich (8 papers)
- Marc Erich Latoschik (13 papers)