Multi-Gigabit Interactive Extended Reality over Millimeter-Wave: An End-to-End System Approach (2405.15570v1)
Abstract: Achieving high-quality wireless interactive Extended Reality (XR) will require multi-gigabit throughput at extremely low latency. The Millimeter-Wave (mmWave) frequency bands, between 24 and 300GHz, can achieve such extreme performance. However, maintaining a consistently high Quality of Experience with highly mobile users is challenging, as mmWave communications are inherently directional. In this work, we present and evaluate an end-to-end approach to such a mmWave-based mobile XR system. We perform a highly realistic simulation of the system, incorporating accurate XR data traffic, detailed mmWave propagation models and actual user motion. We evaluate the impact of the beamforming strategy and frequency on the overall performance. In addition, we provide the first system-level evaluation of the CoVRage algorithm, a proactive and spatially aware user-side beamforming approach designed specifically for highly mobile XR environments.
- A. Hazarika and M. Rahmati, “Towards an evolved immersive experience: Exploring 5G- and beyond-enabled ultra-low-latency communications for augmented and virtual reality,” Sensors, vol. 23, no. 7, 2023.
- S. Gupta, J. Chakareski, and P. Popovski, “mmWave networking and edge computing for scalable 360° video multi-user virtual reality,” IEEE Transactions on Image Processing, vol. 32, pp. 377–391, 2023.
- E. A. Shudayfat, Y. Sharrab, M. Tarawneh, and F. Alzyoud, “Towards virtual university based on virtual reality and terabits internet speed: A review paper,” International Journal of Emerging Technologies in Learning (iJET), vol. 17, no. 24, p. pp. 57–68, Dec. 2022.
- M. S. Elbamby, C. Perfecto, M. Bennis, and K. Doppler, “Toward low-latency and ultra-reliable virtual reality,” IEEE Network, vol. 32, no. 2, pp. 78–84, 2018.
- J. Struye, F. Lemic, and J. Famaey, “Towards ultra-low-latency mmWave Wi-Fi for multi-user interactive virtual reality,” in GLOBECOM 2020 - 2020 IEEE Global Communications Conference, 2020, pp. 1–6.
- ——, “CoVRage: Millimeter-wave beamforming for mobile interactive virtual reality,” IEEE Transactions on Wireless Communications, vol. 22, no. 7, pp. 4828–4842, 2023.
- J. Morais, S. Braam, R. Litjens, S. Kizhakkekundil, and H. van Den Berg, “Performance modelling and assessment for social VR conference applications in 5G radio networks,” in 2021 17th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob), 2021, pp. 225–232.
- T. Nitsche, C. Cordeiro, A. B. Flores, E. W. Knightly, E. Perahia, and J. C. Widmer, “IEEE 802.11ad: directional 60 ghz communication for multi-gigabit-per-second Wi-Fi [invited paper],” IEEE Communications Magazine, vol. 52, no. 12, pp. 132–141, 2014.
- A. Zhou, L. Wu, S. Xu, H. Ma, T. Wei, and X. Zhang, “Following the shadow: Agile 3-D beam-steering for 60 ghz wireless networks,” in IEEE INFOCOM 2018 - IEEE Conference on Computer Communications, 2018, pp. 2375–2383.
- M. Gapeyenko, V. Petrov, S. Paris, A. Marcano, and K. I. Pedersen, “Standardization of extended reality (XR) over 5G and 5G-advanced 3GPP new radio,” IEEE Network, vol. 37, no. 4, pp. 22–28, 2023.
- J. Chakareski, M. Khan, T. Ropitault, and S. Blandino, “6DOF virtual reality dataset and performance evaluation of millimeter wave vs. free-space-optical indoor communications systems for lifelike mobile VR streaming,” in 2020 54th Asilomar Conference on Signals, Systems, and Computers, 2020, pp. 1051–1058.
- J. Zhang, S. Blandino, N. Varshney, J. Wang, C. Gentile, and N. Golmie, “Multi-user mimo enabled virtual reality in ieee 802.11ay wlan,” in 2022 IEEE Wireless Communications and Networking Conference (WCNC), 2022, pp. 2595–2600.
- Y. Liu, J. Liu, A. Argyriou, and S. Ci, “MEC-assisted panoramic VR video streaming over millimeter wave mobile networks,” IEEE Transactions on Multimedia, vol. 21, no. 5, pp. 1302–1316, 2019.
- Z. Wu, C.-Y. Huang, and P. Ramanathan, “Measuring millimeter wave based link bandwidth fluctuations during indoor immersive experience,” IEEE Networking Letters, vol. 4, no. 3, pp. 113–117, 2022.
- K. Zeman, M. Stusek, J. Pokorny, P. Masek, J. Hosek, S. Andreev, P. Dvorak, and R. Josth, “Emerging 5G applications over mmWave: Hands-on assessment of WiGig radios,” in 40th International Conference on Telecommunications and Signal Processing (TSP), 2017, pp. 86–90.
- W. Na, N.-N. Dao, J. Kim, E.-S. Ryu, and S. Cho, “Simulation and measurement: Feasibility study of tactile internet applications for mmWave virtual reality,” ETRI Journal, vol. 42, no. 2, pp. 163–174, 2020.
- J. Struye, H. K. Ravuri, H. Assasa, C. Fiandrino, F. Lemic, J. Widmer, J. Famaey, and M. Torres Vega, “Opportunities and challenges for virtual reality streaming over millimeter-wave: An experimental analysis,” in 13th International Conference on Network of the Future, 2022, pp. 1–5.
- H. Assasa and J. Widmer, “Implementation and evaluation of a wlan IEEE 802.11ad model in ns-3,” in Proceedings of the 2016 Workshop on Ns-3, 2016, p. 57–64.
- H. Assasa, N. Grosheva, T. Ropitault, S. Blandino, N. Golmie, and J. Widmer, “Implementation and evaluation of a wlan IEEE 802.11ay model in network simulator ns-3,” in Proceedings of the 2021 Workshop on Ns-3, 2021, p. 9–16.
- M. Lecci, A. Zanella, and M. Zorzi, “An ns-3 implementation of a bursty traffic framework for virtual reality sources,” in Proceedings of the 2021 Workshop on Ns-3, 2021, p. 73–80.
- H. Assasa, J. Widmer, T. Ropitault, A. Bodi, and N. Golmie, “High fidelity simulation of IEEE 802.11ad in ns-3 using a quasi-deterministic channel model,” in Proceedings of the 2019 Workshop on Next-Generation Wireless with Ns-3, 2019, p. 22–25.
- R. Gentile, “Array synthesis examples,” https://www.mathworks.com/matlabcentral/fileexchange/61588, MathWorks.
- F. Lemic, J. Struye, and J. Famaey, “User mobility simulator for full-immersive multiuser virtual reality with redirected walking,” in Proceedings of the 12th ACM Multimedia Systems Conference, 2021, p. 293–299.
- N. C. Nilsson, T. Peck, G. Bruder, E. Hodgson, S. Serafin, M. Whitton, F. Steinicke, and E. S. Rosenberg, “15 years of research on redirected walking in immersive virtual environments,” IEEE Computer Graphics and Applications, vol. 38, no. 2, pp. 44–56, 2018.
- S. M. LaValle, A. Yershova, M. Katsev, and M. Antonov, “Head tracking for the oculus rift,” in 2014 IEEE International Conference on Robotics and Automation (ICRA), 2014, pp. 187–194.