Energy-Efficient Sleep Mode Optimization of 5G mmWave Networks Using Deep Contextual MAB (2405.09528v1)
Abstract: Millimeter-wave (mmWave) networks, integral to 5G communication, offer a vast spectrum that addresses the issue of spectrum scarcity and enhances peak rate and capacity. However, their dense deployment, necessary to counteract propagation losses, leads to high power consumption. An effective strategy to reduce this energy consumption in mobile networks is the sleep mode optimization (SMO) of base stations (BSs). In this paper, we propose a novel SMO approach for mmWave BSs in a 3D urban environment. This approach, which incorporates a neural network (NN) based contextual multi-armed bandit (C-MAB) with an epsilon decay algorithm, accommodates the dynamic and diverse traffic of user equipment (UE) by clustering the UEs in their respective tracking areas (TAs). Our strategy includes beamforming, which helps reduce energy consumption from the UE side, while SMO minimizes energy use from the BS perspective. We extended our investigation to include Random, Epsilon Greedy, Upper Confidence Bound (UCB), and Load Based sleep mode (SM) strategies. We compared the performance of our proposed C-MAB based SM algorithm with those of All On and other alternative approaches. Simulation results show that our proposed method outperforms all other SM strategies in terms of the $10{th}$ percentile of user rate and average throughput while demonstrating comparable average throughput to the All On approach. Importantly, it outperforms all approaches in terms of energy efficiency (EE).
- H. Shokri-Ghadikolaei, C. Fischione, G. Fodor, P. Popovski, and M. Zorzi, “Millimeter wave cellular networks: A MAC layer perspective,” IEEE Trans. Commun., vol. 63, no. 10, pp. 3437–3458, 2015.
- R. Baldemair, T. Irnich, K. Balachandran, E. Dahlman, G. Mildh, Y. Selén, S. Parkvall, M. Meyer, and A. Osseiran, “Ultra-dense networks in millimeter-wave frequencies,” IEEE Commun. Mag., vol. 53, no. 1, pp. 202–208, 2015.
- A. Alkhateeb, G. Leus, and R. W. Heath, “Limited feedback hybrid precoding for multi-user millimeter wave systems,” IEEE Trans. Wirel. Commun., vol. 14, no. 11, pp. 6481–6494, 2015.
- M. Feng, S. Mao, and T. Jiang, “Dynamic base station sleep control and RF chain activation for energy-efficient millimeter-wave cellular systems,” IEEE Trans. Veh. Technol., vol. 67, no. 10, pp. 9911–9921, 2018.
- A. S. Andrae and T. Edler, “On global electricity usage of communication technology: trends to 2030,” Challenges, vol. 6, no. 1, pp. 117–157, 2015.
- M. A. Marsan, L. Chiaraviglio, D. Ciullo, and M. Meo, “Optimal energy savings in cellular access networks,” in Proc. IEEE Int. Conf. Commun. Workshops, Jun 2009, pp. 1–5.
- E. Oh, B. Krishnamachari, X. Liu, and Z. Niu, “Toward dynamic energy-efficient operation of cellular network infrastructure,” IEEE Commun. Mag., vol. 49, no. 6, pp. 56–61, 2011.
- H. Celebi, Y. Yapıcı, I. Güvenç, and H. Schulzrinne, “Load-based on/off scheduling for energy-efficient delay-tolerant 5G networks,” IEEE Trans. Green Commun. Netw., vol. 3, no. 4, pp. 955–970, 2019.
- Z. Niu, J. Zhang, X. Guo, and S. Zhou, “On energy-delay tradeoff in base station sleep mode operation,” in Proc. IEEE Int. Conf. Commun. Syst. (ICCS), Jan 2012, pp. 235–239.
- X. Guo, S. Zhou, Z. Niu, and P. Kumar, “Optimal wake-up mechanism for single base station with sleep mode,” in Proc. IEEE Int. Teletraffic Congr. (ITC), 2013, pp. 1–8.
- J. García-Morales, G. Femenias, and F. Riera-Palou, “Energy-efficient access-point sleep-mode techniques for cell-free mmWave massive MIMO networks with non-uniform spatial traffic density,” IEEE Access, vol. 8, pp. 137 587–137 605, 2020.
- M. N. Soorki, A. B. MacKenzie, and W. Saad, “Millimeter wave network coverage with stochastic user orientation,” in Proc. IEEE Annu. Int. Symp. Pers., Indoor, Mob. Radio Commun. (PIMRC), 2017, pp. 1–6.
- C.-H. Ho, A. Huang, P.-J. Hsieh, and H.-Y. Wei, “Energy-efficient millimeter-wave M2M 5G systems with beam-aware DRX mechanism,” in Proc. IEEE Veh. Technol. Conf. (VTC-Fall), 2017, pp. 1–5.
- S. Maghsudi and E. Hossain, “Multi-armed bandits with application to 5G small cells,” IEEE Wirel. Commun., vol. 23, no. 3, pp. 64–73, 2016.
- F. Li, D. Yu, H. Yang, J. Yu, H. Karl, and X. Cheng, “Multi-armed-bandit-based spectrum scheduling algorithms in wireless networks: A survey,” IEEE Wirel. Commun., vol. 27, no. 1, pp. 24–30, 2020.
- J. Liu, B. Krishnamachari, S. Zhou, and Z. Niu, “Deepnap: Data-driven base station sleeping operations through deep reinforcement learning,” IEEE Internet Things J., vol. 5, no. 6, pp. 4273–4282, 2018.
- M. Haklay and P. Weber, “Openstreetmap: User-generated street maps,” EEE Pervasive Comput., vol. 7, no. 4, pp. 12–18, 2008.
- A. Messerli and A. Grinsted, “Image georectification and feature tracking toolbox: Imgraft,” Geoscientific Instrumentation, Methods and Data Systems, vol. 4, no. 1, pp. 23–34, 2015.
- Q. Zhu, C.-X. Wang, B. Hua, K. Mao, S. Jiang, and M. Yao, “3GPP TR 38.901 channel model,” in Wiley 5G Ref: The Essential 5G Reference Online. Wiley Press, 2021, pp. 1–35.
- H. Gao, X. Xu, and D. Liu, “Energy efficiency analysis for Sub-6G and mmWave massive MIMO systems,” in Int. Conf. Signal Process. Syst. Springer, Mar 2021, pp. 1121–1130.
- T. Lu, D. Pál, and M. Pál, “Contextual multi-armed bandits,” in Proc. Int. Conf. Artif. Intell. Stat. JMLR Workshop and Conference Proceedings, May 2010, pp. 485–492.
- S. Masrur, “Outage capacity and throughput maximization using theoretical and learning-based approaches,” Ph.D. dissertation, Bilkent University, 2023.