Open RAN LSTM Traffic Prediction and Slice Management using Deep Reinforcement Learning (2401.06922v1)
Abstract: With emerging applications such as autonomous driving, smart cities, and smart factories, network slicing has become an essential component of 5G and beyond networks as a means of catering to a service-aware network. However, managing different network slices while maintaining quality of services (QoS) is a challenge in a dynamic environment. To address this issue, this paper leverages the heterogeneous experiences of distributed units (DUs) in ORAN systems and introduces a novel approach to ORAN slicing xApp using distributed deep reinforcement learning (DDRL). Additionally, to enhance the decision-making performance of the RL agent, a prediction rApp based on long short-term memory (LSTM) is incorporated to provide additional information from the dynamic environment to the xApp. Simulation results demonstrate significant improvements in network performance, particularly in reducing QoS violations. This emphasizes the importance of using the prediction rApp and distributed actors' information jointly as part of a dynamic xApp.
- 3GPP TR 38.912 version 14.1.0 Release 14, “Study on new radio access technology: Radio access architecture and interfaces,” Tech. Rep, , no. 3, 2017.
- “Semantic-aware collaborative deep reinforcement learning over wireless cellular networks,” in ICC 2022-IEEE International Conference on Communications. IEEE, 2022, pp. 5256–5261.
- “Inter-cell interference in multi-tier heterogeneous cellular networks: modeling and constraints,” Telecommunication Systems, vol. 81, no. 1, pp. 67–81, 2022.
- O-RAN Working Group 1, “Study on o-ran slicing-v2.00,” O-RAN.WG1.Study-on-O-RAN-Slicing-v02.00 Technical Specification, April 2020.
- “Triplet loss-less center loss sampling strategies in facial expression recognition scenarios,” in 2023 57th Annual Conference on Information Sciences and Systems (CISS). IEEE, 2023, pp. 1–6.
- P. Samanipour and H. Poonawala, “Stability analysis and controller synthesis using single-hidden-layer relu neural networks,” IEEE Transactions on Automatic Control, 2023.
- P. Ghadermazi and S. Chan, “Microbial interactions from a new perspective: Reinforcement learning reveals new insights into microbiome evolution,” bioRxiv, pp. 2023–05, 2023.
- “Diversity maximized scheduling in roadside units for traffic monitoring applications,” arXiv preprint arXiv:2306.16481, 2023.
- “Meta-learning for wireless interference identification,” in 2023 IEEE Wireless Communications and Networking Conference (WCNC), 2023, pp. 1–6.
- “Automated stability analysis of piecewise affine dynamics using vertices,” arXiv preprint arXiv:2307.03868, 2023.
- “Evolutionary deep reinforcement learning for dynamic slice management in O-RAN,” in 2022 IEEE Globecom Workshops (GC Wkshps). IEEE, 2022, pp. 227–232.
- “Attention-based open ran slice management using deep reinforcement learning,” arXiv preprint arXiv:2306.09490, 2023.
- “Reinforcement learning based resource allocation for network slices in o-ran midhaul,” arXiv preprint arXiv:2211.07466, 2022.
- “Synergies between federated learning and o-ran: Towards an elastic virtualized architecture for multiple distributed machine learning services,” arXiv preprint arXiv:2305.02109, 2023.
- “Team learning-based resource allocation for open radio access network (o-ran),” in ICC 2022-IEEE International Conference on Communications. IEEE, 2022, pp. 4938–4943.
- “Federated deep reinforcement learning for resource allocation in o-ran slicing,” in GLOBECOM 2022-2022 IEEE Global Communications Conference. IEEE, 2022, pp. 958–963.
- “Predictive closed-loop service automation in o-ran based network slicing,” IEEE Communications Standards Magazine, vol. 6, no. 3, pp. 8–14, 2022.
- “Intelligent traffic steering in beyond 5g open ran based on lstm traffic prediction,” IEEE Transactions on Wireless Communications, 2023.
- “Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor,” in International conference on machine learning. PMLR, 2018, pp. 1861–1870.