Experimental Studies of Metaverse Streaming (2403.15256v1)
Abstract: Metaverse aims to construct a large, unified, immersive, and shared digital realm by combining various technologies, namely XR (extended reality), blockchain, and digital twin, among others. This article explores the Metaverse from the perspective of multimedia communication by conducting and analyzing real-world experiments on four different Metaverse platforms: VR (virtual reality) Vircadia, VR Mozilla Hubs, VRChat, and MR (mixed reality) Virtual City. We first investigate the traffic patterns and network performance in the three VR platforms. After raising the challenges of the Metaverse streaming and investigating the potential methods to enhance Metaverse performance, we propose a remote rendering architecture and verify its advantages through a prototype involving the campus network and MR multimodal interaction by comparison with local rendering.
- I. M. W. BUANA, “Metaverse: Threat or opportunity for our social world? in understanding Metaverse on sociological context,” Journal of Metaverse, vol. 3, no. 1, pp. 28–33, 2023.
- R. Cheng, N. Wu, M. Varvello, S. Chen, and B. Han, “Are we ready for Metaverse? A measurement study of social virtual reality platforms,” in Proceedings of the ACM Internet Measurement Conference, 2022, pp. 504–518.
- M. Xu, W. C. Ng, W. Y. B. Lim, J. Kang, Z. Xiong, D. Niyato, Q. Yang, X. Shen, and C. Miao, “A full dive into realizing the edge-enabled metaverse: Visions, enabling technologies, and challenges,” IEEE Communications Surveys & Tutorials, vol. 25, no. 1, pp. 656–700, 2023.
- M. Aloqaily, O. Bouachir, F. Karray, I. A. Ridhawi, and A. El Saddik, “Integrating digital twin and advanced intelligent technologies to realize the metaverse,” IEEE Consumer Electronics Magazine, pp. 1–8, 2022.
- T. Huynh-The, T. R. Gadekallu, W. Wang, G. Yenduri, P. Ranaweera, Q.-V. Pham, D. B. da Costa, and M. Liyanage, “Blockchain for the Metaverse: A review,” Future Generation Computer Systems, vol. 143, no. C, pp. 401–419, 2023.
- V. Holzwarth, J. Gisler, C. Hirt, and A. Kunz, “Comparing the accuracy and precision of SteamVR tracking 2.0 and Oculus Quest 2 in a room scale setup,” in Proceedings of the International Conference on Virtual and Augmented Reality Simulations, 2021, pp. 42–46.
- H. Wang, H. Ning, Y. Lin, W. Wang, S. Dhelim, F. Farha, J. Ding, and M. Daneshmand, “A survey on the metaverse: The state-of-the-art, technologies, applications, and challenges,” IEEE Internet of Things Journal, vol. 10, no. 16, pp. 14 671–14 688, 2023.
- H. Dong and Y. Liu, “Metaverse meets consumer electronics,” IEEE Consumer Electronics Magazine, vol. 12, no. 3, pp. 17–19, 2023.
- Y. Zhang, Y. Guan, K. Bian, Y. Liu, H. Tuo, L. Song, and X. Li, “EPASS360: QoE-aware 360-degree video streaming over mobile devices,” IEEE Transactions on Mobile Computing, vol. 20, no. 7, pp. 2338–2353, 2021.
- Z. Long, H. Dong, and A. El Saddik, “Human-centric resource allocation for the metaverse with multiaccess edge computing,” IEEE Internet of Things Journal, vol. 10, no. 22, pp. 19 993–20 005, 2023.
- J. Chakareski, “Viewport-adaptive scalable multi-user virtual reality mobile-edge streaming,” IEEE Transactions on Image Processing, vol. 29, pp. 6330–6342, 2020.
- S. Shi and C.-H. Hsu, “A survey of interactive remote rendering systems,” ACM Computing Surveys, vol. 47, no. 4, 2015.
- T. R. Henderson, M. Lacage, G. F. Riley, C. Dowell, and J. Kopena, “Network simulations with the ns-3 simulator,” SIGCOMM demonstration, vol. 14, no. 14, pp. 527–527, 2008.
- Haopeng Wang (10 papers)
- Roberto Martinez-Velazquez (1 paper)
- Haiwei Dong (26 papers)
- Abdulmotaleb El Saddik (49 papers)