Latency and Energy Minimization in NOMA-Assisted MEC Network: A Federated Deep Reinforcement Learning Approach (2405.04012v1)
Abstract: Multi-access edge computing (MEC) is seen as a vital component of forthcoming 6G wireless networks, aiming to support emerging applications that demand high service reliability and low latency. However, ensuring the ultra-reliable and low-latency performance of MEC networks poses a significant challenge due to uncertainties associated with wireless links, constraints imposed by communication and computing resources, and the dynamic nature of network traffic. Enabling ultra-reliable and low-latency MEC mandates efficient load balancing jointly with resource allocation. In this paper, we investigate the joint optimization problem of offloading decisions, computation and communication resource allocation to minimize the expected weighted sum of delivery latency and energy consumption in a non-orthogonal multiple access (NOMA)-assisted MEC network. Given the formulated problem is a mixed-integer non-linear programming (MINLP), a new multi-agent federated deep reinforcement learning (FDRL) solution based on double deep Q-network (DDQN) is developed to efficiently optimize the offloading strategies across the MEC network while accelerating the learning process of the Internet-of-Thing (IoT) devices. Simulation results show that the proposed FDRL scheme can effectively reduce the weighted sum of delivery latency and energy consumption of IoT devices in the MEC network and outperform the baseline approaches.
- “Integrated millimeter wave and sub-6 GHz wireless networks: A roadmap for joint mobile broadband and ultra-reliable low-latency communications,” IEEE Wireless Communications, vol. 26, no. 2, pp. 109–115, 2019.
- A. Ahmadi and O. Semiari, “Reinforcement learning for optimized beam training in multi-hop terahertz communications,” in ICC 2021-IEEE International Conference on Communications. IEEE, 2021, pp. 1–6.
- 3GPP, “Study on scenarios and requirements for next generation access technologies,” Technical Report (TR) 38.913, Version 15.0.0, 2018.
- Q. Pham et al., “A survey of multi-access edge computing in 5G and beyond: Fundamentals, technology integration, and state-of-the-art,” IEEE Access, vol. 8, pp. 116974–117017, 2020.
- “A survey on mobile edge computing: The communication perspective,” IEEE Communications Surveys & Tutorials, vol. 19, no. 4, pp. 2322–2358, 2017.
- “Joint resource allocation and offloading decision in mobile edge computing,” IEEE Communications Letters, vol. 23, no. 4, pp. 684–687, 2019.
- “Variational autoencoders for reliability optimization in multi-access edge computing networks,” in 2022 IEEE Wireless Communications and Networking Conference (WCNC). IEEE, 2022, pp. 752–757.
- “Robust resource allocation using edge computing for vehicle to infrastructure (V2I) networks,” in 2019 IEEE 3rd International Conference on Fog and Edge Computing (ICFEC). IEEE, 2019, pp. 1–6.
- “Latency minimization for d2d-enabled partial computation offloading in mobile edge computing,” IEEE Transactions on Vehicular Technology, vol. 69, no. 4, pp. 4472–4486, 2020.
- “Reinforcement learning for intelligent online computation offloading in wireless powered edge networks,” Cluster Computing, vol. 26, no. 2, pp. 1053–1062, 2023.
- “Federated multi-agent deep reinforcement learning for resource allocation of vehicle-to-vehicle communications,” IEEE Transactions on Vehicular Technology, vol. 71, no. 8, pp. 8810–8824, 2022.
- “Deep reinforcement learning for computation and communication resource allocation in multiaccess mec assisted railway iot networks,” IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 12, pp. 23797–23808, 2022.
- “Experienced deep reinforcement learning with generative adversarial networks (gans) for model-free ultra reliable low latency communication,” IEEE Transactions on Communications, vol. 69, no. 2, pp. 884–899, 2020.
- “A machine learning approach for task and resource allocation in mobile-edge computing-based networks,” IEEE Internet of Things Journal, vol. 8, no. 3, pp. 1358–1372, 2020.
- “Wireless network intelligence at the edge,” Proceedings of the IEEE, vol. 107, no. 11, pp. 2204–2239, 2019.
- H Brendan McMahan et al., “Advances and open problems in federated learning,” Foundations and Trends® in Machine Learning, vol. 14, no. 1, 2021.
- “Towards federated learning at scale: System design,” arXiv preprint arXiv:1902.01046, 2019.
- “Distributed federated learning for ultra-reliable low-latency vehicular communications,” IEEE Transactions on Communications, vol. 68, no. 2, pp. 1146–1159, 2019.
- “Federated learning over wireless iot networks with optimized communication and resources,” IEEE Internet of Things Journal, vol. 9, no. 17, pp. 16592–16605, 2022.
- “Federated learning encounters 6g wireless communication in the scenario of internet of things,” IEEE Communications Standards Magazine, vol. 7, no. 1, pp. 94–100, 2023.
- “Communication-efficient federated learning for wireless edge intelligence in iot,” IEEE Internet of Things Journal, vol. 7, no. 7, pp. 5986–5994, 2019.
- “Federated learning-based computation offloading optimization in edge computing-supported internet of things,” in Proceedings of the ACM Turing Celebration Conference-China, 2019, pp. 1–5.
- “Ultra reliable, low latency vehicle-to-infrastructure wireless communications with edge computing,” in 2018 IEEE Global Communications Conference (GLOBECOM). IEEE, 2018, pp. 1–7.
- “Communication-efficient learning of deep networks from decentralized data,” in Artificial intelligence and statistics. PMLR, 2017, pp. 1273–1282.
- “Federated reinforcement learning: Techniques, applications, and open challenges,” arXiv preprint arXiv:2108.11887, 2021.
- “Deep reinforcement learning for energy-efficient multi-channel transmissions in 5g cognitive hetnets: Centralized, decentralized and transfer learning based solutions,” IEEE Access, vol. 9, pp. 129358–129374, 2021.