Reliability-Optimized User Admission Control for URLLC Traffic: A Neural Contextual Bandit Approach (2401.03059v1)
Abstract: Ultra-reliable low-latency communication (URLLC) is the cornerstone for a broad range of emerging services in next-generation wireless networks. URLLC fundamentally relies on the network's ability to proactively determine whether sufficient resources are available to support the URLLC traffic, and thus, prevent so-called cell overloads. Nonetheless, achieving accurate quality-of-service (QoS) predictions for URLLC user equipment (UEs) and preventing cell overloads are very challenging tasks. This is due to dependency of the QoS metrics (latency and reliability) on traffic and channel statistics, users' mobility, and interdependent performance across UEs. In this paper, a new QoS-aware UE admission control approach is developed to proactively estimate QoS for URLLC UEs, prior to associating them with a cell, and accordingly, admit only a subset of UEs that do not lead to a cell overload. To this end, an optimization problem is formulated to find an efficient UE admission control policy, cognizant of UEs' QoS requirements and cell-level load dynamics. To solve this problem, a new machine learning based method is proposed that builds on (deep) neural contextual bandits, a suitable framework for dealing with nonlinear bandit problems. In fact, the UE admission controller is treated as a bandit agent that observes a set of network measurements (context) and makes admission control decisions based on context-dependent QoS (reward) predictions. The simulation results show that the proposed scheme can achieve near-optimal performance and yield substantial gains in terms of cell-level service reliability and efficient resource utilization.
- H. Alves et al., “Beyond 5G URLLC evolution: New service modes and practical considerations,” 2021. [Online]. Available: https://arxiv.org/abs/2106.11825.
- W. Saad, M. Bennis, and M. Chen, “A vision of 6G wireless systems: Applications, trends, technologies, and open research problems,” IEEE Network, vol. 34, no. 3, pp. 134–142, 2020.
- O. Semiari, W. Saad, M. Bennis, and M. Debbah, “Integrated millimeter wave and sub-6 ghz wireless networks: A roadmap for joint mobile broadband and ultra-reliable low-latency communications,” IEEE Wireless Communications, vol. 26, no. 2, pp. 109–115, 2019.
- O. López, N. Mahmood, M. Shehab, H. Alves, O. Rosabal, L. Marata, and M. Latva-aho, “Statistical tools and methodologies for URLLC – a tutorial,” 2022.
- M. Angjelichinoski, K. F. Trillingsgaard, and P. Popovski, “A statistical learning approach to ultra-reliable low latency communication,” IEEE Transactions on Communications, vol. 67, no. 7, pp. 5153–5166, 2019.
- M. K. Luka, A. A. Atayero, and O. I. Oshin, “Call admission control techniques for 3GPP LTE: A survey,” in 2016 SAI Computing Conference (SAI), 2016, pp. 691–700.
- D. Niyato and E. Hossain, “Call admission control for QoS provisioning in 4G wireless networks: issues and approaches,” IEEE Network, vol. 19, no. 5, pp. 5–11, 2005.
- S. J. Bae, B.-G. Choi, M. Y. Chung, J. J. Lee, and S. Kwon, “Delay-aware call admission control algorithm in 3GPP LTE system,” in TENCON 2009 - 2009 IEEE Region 10 Conference, 2009, pp. 1–6.
- M. Qian et al., “A novel radio admission control scheme for multiclass services in LTE systems,” in IEEE Global Telecommunications Conference, 2009, pp. 1–6.
- B. Epstein and M. Schwartz, “Predictive QoS-based admission control for multiclass traffic in cellular wireless networks,” IEEE Journal on Selected Areas in Communications, vol. 18, no. 3, pp. 523–534, 2000.
- 3GPP, “Network slice admission control services,” TS 29.536, v 17.0.0, 2022.
- N. U. Ginige, K. B. Shashika Manosha, N. Rajatheva, and M. Latva-aho, “Admission control in 5G networks for the coexistence of eMBB-URLLC users,” in IEEE 91st Vehicular Technology Conference, 2020, pp. 1–6.
- Y. Zhang, W. Li, and W. K. Seah, “Admission control with latency considerations for 5G mobile edge computing,” in 2023 IEEE 24th International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM), 2023, pp. 167–174.
- Y. Raaijmakers, S. Mandelli, and M. Doll, “Reinforcement learning for admission control in 5G wireless networks,” in 2021 IEEE Global Communications Conference (GLOBECOM), 2021, pp. 1–6.
- Y. Zhou, Q. Ye, H. Huang, and H. Du, “Deep reinforcement learning based admission control for throughput maximization in mobile edge computing,” in 2021 IEEE 94th Vehicular Technology Conference (VTC2021-Fall), 2021, pp. 1–6.
- M. Raeis, A. Tizghadam, and A. Leon-Garcia, “Reinforcement learning-based admission control in delay-sensitive service systems,” in IEEE Global Communications Conference, 2020, pp. 1–6.
- R. Allesiardo, R. Féraud, and D. Bouneffouf, “A neural networks committee for the contextual bandit problem,” in Neural Information Processing, 2014, pp. 374–381.
- 3GPP, “Study on scenarios and requirements for next generation access technologies,” 3GPP TR 38.913, v 16.0.0, 2020.
- E. B. Wilson, “Probable inference, the law of succession, and statistical inference,” Journal of the American Statistical Association, vol. 22, no. 158, pp. 209–212, 1927.
- D. C. Moreira, “Simulation of Digital Communication (physical layer) in Python,” https://pypi.org/project/pyphysim/.