Collaboration in Immersive Environments: Challenges and Solutions (2311.00689v4)
Abstract: Virtual Reality (VR) and Augmented Reality (AR) tools have been applied in all engineering fields in order to avoid the use of physical prototypes, to train in high-risk situations, and to interpret real or simulated results. In order to complete a shared task or assign tasks to the agents in such immersive environments, collaboration or Shared Cooperative Activities are a necessity. Collaboration in immersive environments is an emerging field of research that aims to study and enhance the ways in which people interact and work together in Virtual and Augmented Reality settings. Collaboration in immersive environments is a complex process that involves different factors such as communication, coordination, and social presence. This paper provides an overview of the current state of research on collaboration in immersive environments. It discusses the different types of immersive environments, including VR and AR, and the different forms of collaboration that can occur in these environments. The paper also highlights the challenges and limitations of collaboration in immersive environments, such as the lack of physical cues, cost and usability and the need for further research in this area. Overall, collaboration in immersive environments is a promising field with a wide range of potential applications, from education to industry, and it can benefit both individuals and groups by enhancing their ability to work together effectively.
- Virtual environments and interactivity: Windows to the future. In ACM SIGGRAPH 89 Panel Proceedings, SIGGRAPH ’89, page 7–18, New York, NY, USA, 1989. Association for Computing Machinery.
- European activities in virtual reality. IEEE Computer Graphics and Applications, 14(1):66–74, 1994.
- Virtual reality training in laparoscopic surgery: a systematic review & meta-analysis. International Journal of Surgery, 29:85–94, 2016.
- A study of real-time information on user behaviors during search and rescue (sar) training of firefighters. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), pages 387–394, 2022.
- Creating a stressful decision making environment for aerial firefighter training in virtual reality. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pages 181–189, 2019.
- Michael E. Bratman. Shared cooperative activity. The Philosophical Review, 101(2):327–341, 1992.
- V. Theoktisto and M. Fairen. On extending collaboration in virtual reality environments. In Proceedings. 17th Brazilian Symposium on Computer Graphics and Image Processing, pages 324–331, 2004.
- Subjective and objective analyses of collaboration and co-presence in a virtual reality remote environment. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), pages 485–487, 2022.
- A framework for immersive virtual environments five: Speculations on the role of presence in virtual environments. Presence: Teleoper. Virtual Environ., 6(6):603–616, dec 1997.
- Nazli Cila. Designing human-agent collaborations: Commitment, responsiveness, and support. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, CHI ’22, New York, NY, USA, 2022. Association for Computing Machinery.
- Using virtual interactions to explore leadership and collaboration in globally distributed teams. In Proceedings of the 3rd International Conference on Intercultural Collaboration, ICIC ’10, page 9–18, New York, NY, USA, 2010. Association for Computing Machinery.
- A literature overview of virtual reality (vr) in treatment of psychiatric disorders: recent advances and limitations. Frontiers in psychiatry, 10:505, 2019.
- A collaborative virtual reality environment for liver surgery planning. Computers & Graphics, 99:234–246, 2021.
- A systematic literature review of virtual, augmented, and mixed reality game applications in healthcare. ACM Transactions on Computing for Healthcare (HEALTH), 3(2):1–27, 2022.
- Toward a collaboration model for smart spaces. In 2012 Third International Workshop on Software Engineering for Sensor Network Applications (SESENA), pages 37–42, 2012.
- Design of an immersive simulator for assisted power wheelchair driving. In 2017 International Conference on Rehabilitation Robotics (ICORR), pages 995–1000, 2017.
- Virtual reality in education: Structural design of an adaptable virtual reality system. In 2022 6th International Conference on Computer, Software and Modeling (ICCSM), pages 76–79, 2022.
- Hailin Liu. Research on the development of 5g industry assisted by virtual reality technology. In 2021 IEEE International Conference on Power, Intelligent Computing and Systems (ICPICS), pages 480–483, 2021.
- Augmented reality and mixed reality for healthcare education beyond surgery: an integrative review. International journal of medical education, 11:1, 2020.
- A new reality: Exploring continuance intention to use mobile augmented reality for entertainment purposes. Technology in Society, 67:101757, 2021.
- Creating augmented and virtual reality applications: Current practices, challenges, and opportunities. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, CHI ’20, page 1–13, New York, NY, USA, 2020. Association for Computing Machinery.
- An exploration of managers and leaders using coaching skills. Consulting Psychology Journal: Practice and Research, 71(3):195, 2019.
- R Delecta Jenifer and GP Raman. Cross-cultural communication barriers in the workplace. International Journal of Management, 6(1):348–351, 2015.
- Interactivity in online chat: Conversational cues and visual cues in the service recovery process. International Journal of Information Management, 60:102360, 2021.
- Deborah Tannen. Cross-cultural communication. Corporate Communications: an international journal, 1983.
- Elanor Colleoni. Csr communication strategies for organizational legitimacy in social media. Corporate Communications: an international journal, 18(2):228–248, 2013.
- A survey of augmented reality technologies, applications and limitations. International journal of virtual reality, 9(2):1–20, 2010.
- Network-induced temporal disturbances in virtual reality applications. In 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX), pages 1–3, 2019.
- Augmenting the learning experience in primary and secondary school education: A systematic review of recent trends in augmented reality game-based learning. Virtual Reality, 23(4):329–346, 2019.
- IEEE. Ieee standard for head-mounted display (hmd)-based virtual reality(vr) sickness reduction technology. IEEE Std 3079-2020, pages 1–74, 2021.
- How late is too late? effects of network latency on audio-visual perception during ar remote musical collaboration. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), pages 686–687, 2022.
- Low-latency mobile virtual reality content delivery for unmanned aerial vehicle-enabled wireless networks with energy constraints. IEEE Transactions on Vehicular Technology, 72(2):2189–2201, 2023.
- Latency and cybersickness: Impact, causes, and measures. a review. Frontiers in Virtual Reality, 1:582204, 2020.
- Communication-and-computing latency minimization for uav-enabled virtual reality delivery systems. IEEE Transactions on Communications, 69(3):1723–1735, 2021.
- Accuracy evaluation of touch tasks in commodity virtual and augmented reality head-mounted displays. In Proceedings of the 2021 ACM Symposium on Spatial User Interaction, SUI ’21, New York, NY, USA, 2021. Association for Computing Machinery.
- Comparison of gaze accuracy and precision in real-world and virtual reality. Virtual Reality, 25:175–189, 2021.
- Impact of interpupillary distance mismatch on visual aftereffects of virtual reality gameplay. In Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR) IV, volume 12449, pages 377–380. SPIE, 2023.
- The implications of interpupillary distance variability for virtual reality. In 2020 International Conference on 3D Immersion (IC3D), pages 1–7, 2020.
- Do head-mounted display stereo deficiencies affect 3d pointing tasks in ar and vr? In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pages 585–592, 2019.
- Wayfinding behaviour in a multi-level building: A comparative study of hmd vr and desktop vr. Advanced Engineering Informatics, 51:101475, 2022.
- Benchmarking vulkan vs opengl rendering on low-power edge gpus. In 2021 International Conference on Graphics and Interaction (ICGI), pages 1–8. IEEE, 2021.
- Informing the use of visual assets in industrial augmented reality. In Design Tools and Methods in Industrial Engineering: Proceedings of the International Conference on Design Tools and Methods in Industrial Engineering, ADM 2019, September 9–10, 2019, Modena, Italy, pages 106–117. Springer, 2020.
- A research agenda for augmented and virtual reality in architecture, engineering and construction. Advanced Engineering Informatics, 45:101122, 2020.
- A survey of industrial augmented reality. Computers & Industrial Engineering, 139:106159, 2020.
- The perception of egocentric distances in virtual environments - a review. ACM Comput. Surv., 46(2), dec 2013.
- Effects of field of view on egocentric distance perception in virtual reality. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, pages 1–10, 2022.
- The effect of narrow field of view and information density on visual search performance in augmented reality. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pages 575–584. IEEE, 2019.
- Improving teleoperation robots performance by eliminating view limit using 360 camera and enhancing the immersive experience utilizing vr headset. In IOP Conference Series: Materials Science and Engineering, volume 1073, page 012037. IOP Publishing, 2021.
- Comparative cost of virtual reality training and live exercises for training hospital workers for evacuation. Computers, informatics, nursing: CIN, 37(9):446, 2019.
- Immersive virtual reality in the age of the metaverse: A hybrid-narrative review based on the technology affordance perspective. The journal of strategic information systems, 31(2):101717, 2022.
- Openbim based ive ontology: an ontological approach to improve interoperability for virtual reality applications. In Advances in Informatics and Computing in Civil and Construction Engineering: Proceedings of the 35th CIB W78 2018 Conference: IT in Design, Construction, and Management, pages 129–136. Springer, 2019.
- Bim compatibility and its differentiation with interoperability challenges as an innovation factor. Automation in Construction, 112:103086, 2020.
- Autonomic responses during motion sickness induced by virtual reality. Auris Nasus Larynx, 34(3):303–306, 2007.
- You’re making me sick: A systematic review of how virtual reality research considers gender ; cybersickness. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, CHI ’21, New York, NY, USA, 2021. Association for Computing Machinery.
- Quantitative orientation preference and susceptibility to space motion sickness simulated in a virtual reality environment. Brain Research Bulletin, 113:17–26, 2015.
- Len Losik. Using the brain’s fight-or-flight response for predicting mental illness on the human space flight program. In 2013 IEEE Aerospace Conference, pages 1–20, 2013.
- I-Jui Lee. Kinect-for-windows with augmented reality in an interactive roleplay system for children with an autism spectrum disorder. Interactive Learning Environments, 29(4):688–704, 2021.
- Augmented reality aided analysis of customer satisfaction based on taste-induced facial expression recognition using affdex software developer’s kit. In Proceedings of the 2019 9th International Conference on Biomedical Engineering and Technology, pages 204–209, 2019.
- Anton Nijholt. Capturing obstructed nonverbal cues in augmented reality interactions: a short survey. In Proceedings of International Conference on Industrial Instrumentation and Control: ICI2C 2021, pages 1–9. Springer, 2022.
- Online, vr, ar, lab, and in-situ: comparison of research methods to evaluate smart artifacts. In Proceedings of the 2019 chi conference on human factors in computing systems, pages 1–12, 2019.
- The potential of virtual reality for spatial navigation research across the adult lifespan. Journal of Experimental Biology, 222(Suppl_1):jeb187252, 2019.
- How much of what we learn in virtual reality transfers to real-world navigation? Multisensory Research, 33(4-5):479–503, 2020.
- How video game locomotion methods affect navigation in virtual environments. In ACM Symposium on Applied Perception 2019, SAP ’19, New York, NY, USA, 2019. Association for Computing Machinery.
- Gesture interaction in virtual reality. Virtual Reality & Intelligent Hardware, 1(1):84–112, 2019.
- Security and privacy approaches in mixed reality: A literature survey. ACM Comput. Surv., 52(6), oct 2019.
- Privacy concerns and benefits of engagement with social media-enabled apps: A privacy calculus perspective. Computers in Human Behavior, 107:106260, 2020.
- Privacy and security issues in online social networks. Future Internet, 10(12):114, 2018.
- Understanding the scope and impact of the california consumer privacy act of 2018. Journal of Data Protection & Privacy, 2(3):234–253, 2019.
- Metaverse for 6g and beyond: The next revolution and deployment challenges. IEEE Internet of Things Magazine, 6(1):32–39, 2023.
- Coalition of 6g and blockchain in ar/vr space: Challenges and future directions. IEEE Access, 9:168455–168484, 2021.
- Toward 6g networks: Use cases and technologies. IEEE Communications Magazine, 58(3):55–61, 2020.
- A cloud based augmented reality framework-enabling user-centered interactive systems development. In Human Systems Engineering and Design II: Proceedings of the 2nd International Conference on Human Systems Engineering and Design (IHSED2019): Future Trends and Applications, September 16-18, 2019, Universität der Bundeswehr München, Munich, Germany, pages 417–422. Springer, 2020.
- Coexistence of wi-fi 6e and 5g nr-u: Can we do better in the 6 ghz bands? In IEEE INFOCOM 2021 - IEEE Conference on Computer Communications, pages 1–10, 2021.
- Joint caching and computing resource reservation for edge-assisted location-aware augmented reality. Arxive, 2021.
- Network function virtualization: State-of-the-art and research challenges. IEEE Communications Surveys and Tutorials, 18(1):236–262, 2016.
- Jianting Liu. Design and implementation of vo ipqos model combining intserv and diffserv based on network processor ixp2400. In 2021 7th Annual International Conference on Network and Information Systems for Computers (ICNISC), pages 60–64, 2021.
- Quantifying the value of 5g and edge cloud on qoe for ar/vr. In 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX), pages 1–4. IEEE, 2020.
- Steve Aukstakalnis. Practical augmented reality: A guide to the technologies, applications, and human factors for AR and VR. Addison-Wesley Professional, 2016.
- Evaluation of eye response using a wearable display with automatic interpupillary distance adjustment. Optics Express, 30(5):8151–8164, 2022.
- Choose your own training adventure: designing a gamified seta artefact for improving information security and privacy through interactive storytelling. European Journal of Information Systems, 29(6):669–687, 2020.
- Progress of display performances: Ar, vr, qled, oled, and tft. Journal of Information Display, 20(1):1–8, 2019.
- Augmented reality and virtual reality displays: perspectives and challenges. Iscience, 23(8):101397, 2020.
- Augmented reality and virtual reality displays: emerging technologies and future perspectives. Light: Science & Applications, 10(1):216, 2021.
- Foveated ar: dynamically-foveated augmented reality display. ACM Trans. Graph., 38(4):99–1, 2019.
- Distortion correction and image registration of ultralarge field of view near-eye display device. Applied Optics, 59(14):4422–4431, 2020.
- 56-2: A distraction-free display system using embedded asynchronous time warp. In SID Symposium Digest of Technical Papers, volume 53, pages 736–739. Wiley Online Library, 2022.
- Evaluation of performance on variable rate shading. Applied Optics, 2020.
- Franziska Trillmich and FH Wedel. The evolution of collaboration tools to facilitate internal collaboration. IEEE Transactions on Visualization and Computer Graphics, 2019.
- Multimodal data integration for interactive and realistic avatar simulation in augmented reality. In 2021 IEEE 22nd International Conference on Information Reuse and Integration for Data Science (IRI), pages 362–369, 2021.
- Point-cloud avatars to improve spatial communication in immersive collaborative virtual environments. Personal and Ubiquitous Computing, 25:467–484, 2021.
- Enhancing customer trust in peer-to-peer accommodation: A “soft” strategy via social presence. International Journal of Hospitality Management, 79:1–10, 2019.
- Photorealistic audio-driven video portraits. IEEE Transactions on Visualization and Computer Graphics, 26(12):3457–3466, 2020.
- A study on the presence of immersive user interface in collaborative virtual environments application. Symmetry, 11(4):476, 2019.
- The challenges of evaluating the usability of augmented reality (ar). In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, volume 65, pages 994–998. SAGE Publications Sage CA: Los Angeles, CA, 2021.
- Comparative study of icon design for mobile application. In Journal of Physics: Conference Series, volume 1551, page 012007. IOP Publishing, 2020.
- Authar: concurrent authoring of tutorials for ar assembly guidance. In Graphics Interface 2020, 2020.
- Can data visualizations change minds? identifying mechanisms of elaborative thinking and persuasion. In 2022 IEEE Workshop on Visualization for Social Good (VIS4Good), pages 1–5, 2022.
- Gan-based tabular data generator for constructing synopsis in approximate query processing: Challenges and solutions. Machine Learning and Knowledge Extraction, 6(1):171–198, 2024.
- Trends in augmented reality tracking, interaction and display: A review of ten years of ismar. In 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, pages 193–202, 2008.
- Accurate 6dof pose tracking for texture-less objects. IEEE Transactions on Circuits and Systems for Video Technology, 31(5):1834–1848, 2021.
- Dodecapen: Accurate 6dof tracking of a passive stylus. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, UIST ’17, page 365–374, New York, NY, USA, 2017. Association for Computing Machinery.
- Measuring the accuracy of inside-out tracking in xr devices using a high-precision robotic arm. In HCI International 2020-Posters: 22nd International Conference, HCII 2020, Copenhagen, Denmark, July 19–24, 2020, Proceedings, Part I, pages 19–26. Springer, 2020.
- Optical and electromagnetic tracking systems for biomedical applications: A critical review on potentialities and limitations. IEEE reviews in biomedical engineering, 13:212–232, 2019.
- Pattern identification of different human joints for different human walking styles using inertial measurement unit (imu) sensor. Artificial Intelligence Review, 55(2):1149–1169, 2022.
- A robust magnetic tracking approach based on graph optimization. IEEE Transactions on Instrumentation and Measurement, 69(10):7933–7940, 2020.
- Low cost augmented reality framework for construction applications. In ISARC. Proceedings of the International Symposium on Automation and Robotics in Construction, volume 33, page 1. IAARC Publications, 2016.
- Creating a low-cost virtual reality surgical simulation to increase surgical oncology capacity and capability. ecancermedicalscience, 13, 2019.
- Potentials of augmented reality in training. Procedia Manufacturing, 31:85–90, 2019.
- Collaborative virtual reality for laparoscopic liver surgery training. In 2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), pages 1–17, 2019.
- Design and usability testing of an augmented reality (ar) environment in pharmacy education—presenting a pilot study on comparison between ar smart glasses and a mobile device in a laboratory course. Education Sciences, 12(12):854, 2022.
- Near-contact person-to-3d character dance training: Comparing ar and vr for interactive entertainment. In 2021 IEEE Conference on Games (CoG), pages 1–5, 2021.
- Application of artificial intelligence in basketball sport. Journal of Education, Health and Sport, 11(7):54–67, 2021.
- Towards an understanding of situated ar visualization for basketball free-throw training. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, CHI ’21, New York, NY, USA, 2021. Association for Computing Machinery.
- Jane Thomason. Metahealth-how will the metaverse change health care? Journal of Metaverse, 1(1):13–16, 2021.
- Telemedicine use and health-related concerns of patients with chronic conditions during covid-19: survey of members of online health communities. Journal of Medical Internet Research, 23(2):e23795, 2021.
- Shared surfaces and spaces: Collaborative data visualisation in a co-located immersive environment. IEEE Transactions on Visualization and Computer Graphics, 27(2):1171–1181, 2021.
- Examining the potential of virtual reality to deliver remote rehabilitation. Computers in Human Behavior, 105:106223, 2020.
- Augmented reality in medicine: systematic and bibliographic review. JMIR mHealth and uHealth, 7(4):e10967, 2019.
- Applications of virtual reality in maintenance during the industrial product lifecycle: A systematic review. Journal of Manufacturing Systems, 56:525–538, 2020.
- Technology acceptance model for 3d virtual reality system in luxury brands online stores. IEEE Access, 7:64053–64062, 2019.
- A virtual market in your pocket: How does mobile augmented reality (mar) influence consumer decision making? Journal of Retailing and Consumer Services, 58:102337, 2021.
- Joseph Bates. Virtual reality, art, and entertainment. Presence: Teleoperators & Virtual Environments, 1(1):133–138, 1992.
- Gaming in virtual reality: What changes in terms of usability, emotional response and sense of presence compared to non-immersive video games? Simulation & Gaming, 50(2):136–159, 2019.
- Donghee Shin. How does immersion work in augmented reality games? a user-centric view of immersion and engagement. Information, Communication & Society, 22(9):1212–1229, 2019.
- Personal augmented reality for information visualization on large interactive displays. IEEE Transactions on Visualization and Computer Graphics, 27(2):1182–1192, 2021.