Papers
Topics
Authors
Recent
Search
2000 character limit reached

Human-Centric Resource Allocation for the Metaverse With Multiaccess Edge Computing

Published 23 Dec 2023 in cs.MM, cs.AI, and cs.NI | (2312.15313v1)

Abstract: Multi-access edge computing (MEC) is a promising solution to the computation-intensive, low-latency rendering tasks of the metaverse. However, how to optimally allocate limited communication and computation resources at the edge to a large number of users in the metaverse is quite challenging. In this paper, we propose an adaptive edge resource allocation method based on multi-agent soft actor-critic with graph convolutional networks (SAC-GCN). Specifically, SAC-GCN models the multi-user metaverse environment as a graph where each agent is denoted by a node. Each agent learns the interplay between agents by graph convolutional networks with self-attention mechanism to further determine the resource usage for one user in the metaverse. The effectiveness of SAC-GCN is demonstrated through the analysis of user experience, balance of resource allocation, and resource utilization rate by taking a virtual city park metaverse as an example. Experimental results indicate that SAC-GCN outperforms other resource allocation methods in improving overall user experience, balancing resource allocation, and increasing resource utilization rate by at least 27%, 11%, and 8%, respectively.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (40)
  1. Y. Wang, Z. Su, N. Zhang, R. Xing, D. Liu, T. H. Luan, and X. Shen, “A survey on metaverse: Fundamentals, security, and privacy,” IEEE Communications Surveys & Tutorials, 2022.
  2. A. El Saddik, “Digital twins: The convergence of multimedia technologies,” IEEE Multimedia, vol. 25, no. 2, pp. 87–92, 2018.
  3. W. H. Guss, B. Houghton, N. Topin, P. Wang, C. Codel, M. Veloso, and R. Salakhutdinov, “Minerl: A large-scale dataset of Minecraft demonstrations,” arXiv preprint arXiv:1907.13440, 2019.
  4. P. A. Rospigliosi, “Metaverse or simulacra? Roblox, Minecraft, Meta and the turn to virtual reality for education, socialisation and work,” Interactive Learning Environments, vol. 30, no. 1, pp. 1–3, 2022.
  5. J. Gauci, E. Conti, Y. Liang, K. Virochsiri, Y. He, Z. Kaden, V. Narayanan, X. Ye, Z. Chen, and S. Fujimoto, “Horizon: Facebook’s open source applied reinforcement learning platform,” arXiv preprint arXiv:1811.00260, 2018.
  6. M. Xu, W. C. Ng, W. Y. B. Lim, J. Kang, Z. Xiong, D. Niyato, Q. Yang, X. S. Shen, and C. Miao, “A full dive into realizing the edge-enabled metaverse: Visions, enabling technologies, and challenges,” arXiv preprint arXiv:2203.05471, 2022.
  7. L. Liu, R. Zhong, W. Zhang, Y. Liu, J. Zhang, L. Zhang, and M. Gruteser, “Cutting the cord: Designing a high-quality untethered vr system with low latency remote rendering,” in Proceedings of International Conference on Mobile Systems, Applications, and Services, 2018, pp. 68–80.
  8. F. Tang, X. Chen, M. Zhao, and N. Kato, “The roadmap of communication and networking in 6G for the metaverse,” IEEE Wireless Communications, 2022.
  9. H. Dong and J. Lee, “The metaverse from a multimedia communications perspective,” IEEE Multimedia Magazine, vol. 29, no. 4, pp. 123–127, 2022.
  10. T. Taleb, K. Samdanis, B. Mada, H. Flinck, S. Dutta, and D. Sabella, “On multi-access edge computing: A survey of the emerging 5G network edge cloud architecture and orchestration,” IEEE Communications Surveys & Tutorials, vol. 19, no. 3, pp. 1657–1681, 2017.
  11. D. Georgakopoulos, P. P. Jayaraman, M. Fazia, M. Villari, and R. Ranjan, “Internet of things and edge cloud computing roadmap for manufacturing,” IEEE Cloud Computing, vol. 3, no. 4, pp. 66–73, 2016.
  12. H. Dong and Y. Liu, “Metaverse meets consumer electronics,” IEEE Consumer Electronics Magazine, vol. 12, no. 3, 2023.
  13. M. S. Elbamby, C. Perfecto, M. Bennis, and K. Doppler, “Toward low-latency and ultra-reliable virtual reality,” IEEE Network, vol. 32, no. 2, pp. 78–84, 2018.
  14. Q. Luo, S. Hu, C. Li, G. Li, and W. Shi, “Resource scheduling in edge computing: A survey,” IEEE Communications Surveys & Tutorials, vol. 23, no. 4, pp. 2131–2165, 2021.
  15. P. Ravindra, A. Khochare, S. P. Reddy, S. Sharma, P. Varshney, and Y. Simmhan, “ECHO: An adaptive orchestration platform for hybrid dataflows across cloud and edge,” in Proceedings of International Conference on Service-Oriented Computing, 2017, pp. 395–410.
  16. Y. Wu, “Cloud-edge orchestration for the internet of things: Architecture and AI-powered data processing,” IEEE Internet of Things Journal, vol. 8, no. 16, pp. 12 792–12 805, 2020.
  17. M. Xu, D. Niyato, J. Kang, Z. Xiong, C. Miao, and D. I. Kim, “Wireless edge-empowered metaverse: A learning-based incentive mechanism for virtual reality,” in Proceedings of IEEE International Conference on Communications, 2022, pp. 5220–5225.
  18. R. Cheng, N. Wu, M. Varvello, S. Chen, and B. Han, “Are we ready for metaverse? A measurement study of social virtual reality platforms,” in Proceedings of the 22nd ACM Internet Measurement Conference, 2022, pp. 504–518.
  19. Y. Cai, J. Llorca, A. M. Tulino, and A. F. Molisch, “Compute-and data-intensive networks: The key to the metaverse,” arXiv preprint arXiv:2204.02001, 2022.
  20. Y. Han, D. Niyato, C. Leung, D. I. Kim, K. Zhu, S. Feng, S. X. Shen, and C. Miao, “A dynamic hierarchical framework for IoT-assisted digital twin synchronization in the metaverse,” IEEE Internet of Things Journal, vol. 10, no. 1, pp. 268–284, 2022.
  21. B. Han, P. Pathak, S. Chen, and L.-F. C. Yu, “Comic: A collaborative mobile immersive computing infrastructure for conducting multi-user XR research,” IEEE Network, 2022.
  22. D. Ungureanu, F. Bogo, S. Galliani, P. Sama, X. Duan, C. Meekhof, J. Stühmer, T. J. Cashman, B. Tekin, J. L. Schönberger, et al., “Hololens 2 research mode as a tool for computer vision research,” arXiv preprint arXiv:2008.11239, 2020.
  23. S. Dong and T. Hollerer, “Real-time re-textured geometry modeling using Microsoft HoloLens,” in Proceedings of Conference on Virtual Reality and 3D User Interfaces, 2018, pp. 231–237.
  24. J. Wang, L. Zhao, J. Liu, and N. Kato, “Smart resource allocation for mobile edge computing: A deep reinforcement learning approach,” IEEE Transactions on Emerging Topics in Computing, vol. 9, no. 3, pp. 1529–1541, 2019.
  25. W. Ren, Y. Sun, H. Luo, and M. Guizani, “A novel control plane optimization strategy for important nodes in SDN-IoT networks,” IEEE Internet of Things Journal, vol. 6, no. 2, pp. 3558–3571, 2018.
  26. X. Liu, J. Yu, Z. Feng, and Y. Gao, “Multi-agent reinforcement learning for resource allocation in IoT networks with edge computing,” China Communications, vol. 17, no. 9, pp. 220–236, 2020.
  27. R. Lowe, Y. I. Wu, A. Tamar, J. Harb, O. Pieter Abbeel, and I. Mordatch, “Multi-agent actor-critic for mixed cooperative-competitive environments,” Advances in Neural Information Processing Systems, vol. 30, pp. 6382–6393, 2017.
  28. J. Jiang, C. Dun, T. Huang, and Z. Lu, “Graph convolutional reinforcement learning,” arXiv preprint arXiv:1810.09202, 2018.
  29. Y. Yang, R. Luo, M. Li, M. Zhou, W. Zhang, and J. Wang, “Mean field multi-agent reinforcement learning,” in Proceedings of International Conference on Machine Learning, 2018, pp. 5571–5580.
  30. C. Yu, A. Velu, E. Vinitsky, Y. Wang, A. Bayen, and Y. Wu, “The surprising effectiveness of PPO in cooperative, multi-agent games,” arXiv preprint arXiv:2103.01955, 2021.
  31. S. Ross, J. Pineau, S. Paquet, and B. Chaib-Draa, “Online planning algorithms for POMDPs,” Journal of Artificial Intelligence Research, vol. 32, pp. 663–704, 2008.
  32. Z. Long, H. Dong, and A. E. Saddik, “Interacting with New York City data by HoloLens through remote rendering,” IEEE Consumer Electronics Magazine, vol. 11, no. 5, pp. 64–72, 2022.
  33. T. Haarnoja, A. Zhou, P. Abbeel, and S. Levine, “Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor,” in Proceedings of International Conference on Machine Learning, 2018, pp. 1861–1870.
  34. H. Van Hasselt, A. Guez, and D. Silver, “Deep reinforcement learning with double Q-learning,” in Proceedings of AAAI Conference on Artificial Intelligence, 2016, p. 2094–2100.
  35. A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” Advances in Neural Information Processing Systems, pp. 5998–6008, 2017.
  36. J. K. Nurminen, A. J. Meyn, E. Jalonen, Y. Raivio, and R. G. Marrero, “P2P media streaming with HTML5 and WebRTC,” in Proceedings of Conference on Computer Communications Workshops, 2013, pp. 63–64.
  37. V. Mnih, K. Kavukcuoglu, D. Silver, A. Graves, I. Antonoglou, D. Wierstra, and M. Riedmiller, “Playing Atari with deep reinforcement learning,” arXiv preprint arXiv:1312.5602, 2013.
  38. Y.-C. Wu, T. Q. Dinh, Y. Fu, C. Lin, and T. Q. Quek, “A hybrid DQN and optimization approach for strategy and resource allocation in MEC networks,” IEEE Transactions on Wireless Communications, vol. 20, no. 7, pp. 4282–4295, 2021.
  39. G. Carlucci, L. De Cicco, S. Holmer, and S. Mascolo, “Analysis and design of the google congestion control for web real-time communication (WebRTC),” in Proceedings of International Conference on Multimedia Systems, 2016, pp. 1–12.
  40. H. Du, J. Liu, D. Niyato, J. Kang, Z. Xiong, J. Zhang, and D. I. Kim, “Attention-aware resource allocation and QoE analysis for metaverse xURLLC services,” arXiv preprint arXiv:2208.05438, 2022.
Citations (13)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up