All One Needs to Know about Metaverse: A Complete Survey on Technological Singularity, Virtual Ecosystem, and Research Agenda (2110.05352v3)

Abstract: Since the popularisation of the Internet in the 1990s, the cyberspace has kept evolving. We have created various computer-mediated virtual environments including social networks, video conferencing, virtual 3D worlds (e.g., VR Chat), augmented reality applications (e.g., Pokemon Go), and Non-Fungible Token Games (e.g., Upland). Such virtual environments, albeit non-perpetual and unconnected, have bought us various degrees of digital transformation. The term metaverse' has been coined to further facilitate the digital transformation in every aspect of our physical lives. At the core of the metaverse stands the vision of an immersive Internet as a gigantic, unified, persistent, and shared realm. While the metaverse may seem futuristic, catalysed by emerging technologies such as Extended Reality, 5G, and Artificial Intelligence, the digitalbig bang' of our cyberspace is not far away. This survey paper presents the first effort to offer a comprehensive framework that examines the latest metaverse development under the dimensions of state-of-the-art technologies and metaverse ecosystems, and illustrates the possibility of the digital `big bang'. First, technologies are the enablers that drive the transition from the current Internet to the metaverse. We thus examine eight enabling technologies rigorously - Extended Reality, User Interactivity (Human-Computer Interaction), Artificial Intelligence, Blockchain, Computer Vision, IoT and Robotics, Edge and Cloud computing, and Future Mobile Networks. In terms of applications, the metaverse ecosystem allows human users to live and play within a self-sustaining, persistent, and shared realm. Therefore, we discuss six user-centric factors -- Avatar, Content Creation, Virtual Economy, Social Acceptability, Security and Privacy, and Trust and Accountability. Finally, we propose a concrete research agenda for the development of the metaverse.

Insights on "All One Needs to Know about Metaverse: A Complete Survey on Technological Singularity, Virtual Ecosystem, and Research Agenda"

The paper "All One Needs to Know about Metaverse: A Complete Survey on Technological Singularity, Virtual Ecosystem, and Research Agenda" coauthored by Lik-Hang Lee, Tristan Braud and colleagues, presents a detailed survey on the components, current state, and future prospects of the metaverse. The survey extensively covers both technology enablers and ecosystem drivers of the metaverse, offering a comprehensive overview beneficial to experienced researchers.

Overview and Contributions

The fundamental contribution of this paper is the structured framework it proposes, categorizing the latest metaverse developments into technology enablers and ecosystem drivers. This framework is illustrated through a combination of figures and a discussion on potential research directions. The paper identifies fourteen key areas within two primary categories: technology and ecosystem.

Technology Enablers

Extended Reality (XR):

The survey underscores XR, including VR, AR, and MR, as key technologies that shape immersive experiences within the metaverse. The discussion highlights existing limitations such as restricted Field of View (FOV) in AR headsets, technical challenges in real-time processing for VR, and MR's lack of a definitive definition. It suggests a need for practical technology solutions to improve user immersion and interaction, presenting eight specific areas warranting further research.

User Interactivity:

Techniques for mobile input and multi-modal feedback are examined in-depth. The authors emphasize the challenges and opportunities in providing lightweight, intuitive interfaces that support seamless interactivity through gestures, wearables, and freehand techniques. Haptic feedback is discussed as a potent factor to enhance realism and immersive experiences.

IoT and Robotics:

The integration of IoT devices and robotics with AR/VR is crucial for advanced user-interaction scenarios, such as smart homes and autonomous vehicles. The paper details challenges in visualizing IoT data through AR interfaces and the need for collaborative mechanisms involving mobile robots and drones.

Artificial Intelligence:

AI's pivotal role in automating digital twin processes, enhancing NPC behavior, and developing autonomous avatars is critically analyzed. The paper notes the need for efficient AI models that can operate within the computational limitations of mobile devices, suggesting a convergence of edge computing and AI as a potential solution to this bottleneck.

Blockchain:

Blockchain is identified as a secure, decentralized approach to data storage, sharing, and interoperability within the metaverse. Challenges involve improving proof of work efficiencies, addressing privacy issues, and integrating data interoperability across diverse systems.

Computer Vision:

Techniques for scene understanding, human pose tracking, and depth estimation are key to creating an authentic metaverse. The authors underline the necessity for robust, real-time computer vision methods that can accurately interpret and integrate physical and virtual environments.

Edge and Cloud Computing:

The synergy between edge and cloud computing is touted as essential for meeting the metaverse's demands for low latency and high-throughput data processing. Challenges include optimizing last-mile latency and ensuring robust security for distributed edge environments.

Network:

Emphasizing the critical role of future mobile networking technologies such as 5G, the paper discusses expected advancements in network slicing and URLLC to support the metaverse's stringent requirements for latencies and bandwidth. The necessity of human-centric networking, integrating QoE into traffic management, is also highlighted.

Ecosystem Drivers

Avatars:

Avatars are seen as digital representations crucial for user interaction within the metaverse. The paper highlights existing gaps in creating realistic avatars that can accurately convey human expressions and behaviors. Ethical considerations in avatar design, including identity representation and digital immortality, are also discussed.

Content Creation:

The creation of virtual content by users is fundamental to the metaverse. Current authoring systems are evaluated, and the need for more intuitive, collaborative, and inclusive content creation tools is outlined. Censorship mechanisms and fostering a creator culture within the metaverse are also explored.

Virtual Economy:

The paper discusses the varying roles that virtual economies play, from in-platform ecosystems to broader economic models, including the use of cryptocurrency. The challenges in establishing a stable and trusted virtual economy are analyzed, alongside potential market structures within the metaverse.

Social Acceptability:

The social implications of the metaverse are vast, covering privacy threats, user addiction, cyberbullying, device acceptability, and cross-generational design. Addressing these issues is critical for wide-scale adoption and acceptance of the metaverse.

Privacy and Security:

Security challenges specific to the metaverse, such as continuous monitoring and deep-fake avatars, are dissected. The role of blockchain in ensuring data integrity and the ethical design of systems to protect biometric data is emphasized.

Trust and Accountability:

The mechanisms to ensure trust and accountability within the metaverse are vital for user adoption. The paper discusses informed consent, algorithmic transparency, and the importance of regulatory frameworks to protect users' rights and data.

Future Directions

The paper concludes by proposing a detailed research agenda aimed at addressing the grand challenges identified. It envisions the technological enablers and ecosystem drivers working synergistically to develop a seamless, sustainable, and inclusive metaverse. Notably, the need for scalable, efficient algorithms, robust security frameworks, interdisciplinary research, standardization efforts, and ethical considerations form the cornerstone of future developments.

Overall, this paper serves as an essential guide for researchers focused on the metaverse, providing a holistic analysis of current advancements and outlining the necessary steps to move towards an interconnected and immersive future.