Energy Efficient Offloading Policies in Multi-Access Edge Computing Systems with Task Handover (2306.15185v3)
Abstract: The rapid growth of mobile devices and the increasing complexity of tasks have made energy efficiency a critical challenge in Multi-Access Edge Computing (MEC) systems. This paper explores energy-efficient offloading strategies in large-scale MEC systems with heterogeneous mobile users, diverse network components, and frequent task handovers to capture user mobility. The problem is inherently complex due to the system's scale, task and resource diversity, and the need to maintain real-time performance. Traditional optimization approaches are often computationally infeasible for such scenarios. To tackle these challenges, we model the offloading problem using the restless multi-armed bandit (RMAB) framework and develop two scalable online policies that prioritize resources based on their marginal costs. The proposed policies dynamically adapt to the system's heterogeneity and mobility while ensuring near-optimal energy efficiency. Through extensive numerical simulations, we demonstrate that the policies significantly outperform baseline methods in power conservation and show robust performance under non-exponentially distributed task lifespans. These results highlight the practical applicability and scalability of our approach in dynamic MEC environments.
- T. Taleb, K. Samdanis, B. Mada, H. Flinck, S. Dutta, and D. Sabella, “On Multi-access edge computing: A survey of the emerging 5G network edge cloud architecture and orchestration,” IEEE Communications Surveys and Tutorials, vol. 19, no. 3, pp. 1657–1681, 2017.
- T. M. Ho and K.-K. Nguyen, “Joint server selection, cooperative offloading and handover in multi-access edge computing wireless network: A deep reinforcement learning approach,” IEEE Transactions on Mobile Computing, vol. 21, no. 7, pp. 2421–2435, 2022.
- H. Maleki, M. Başaran, and L. Durak-Ata, “Handover-enabled dynamic computation offloading for vehicular edge computing networks,” IEEE Transactions on Vehicular Technology, vol. 72, no. 7, pp. 9394–9405, 2023.
- D. Lin and Y. Tang, “Edge computing-based mobile health system: Network architecture and resource allocation,” IEEE Systems Journal, vol. 14, no. 2, pp. 1716–1727, 2020.
- J. Ren, Y. He, G. Huang, G. Yu, Y. Cai, and Z. Zhang, “An edge-computing based architecture for mobile augmented reality,” IEEE Network, vol. 33, no. 4, pp. 162–169, 2019.
- L. Zhang and J. Chakareski, “UAV-assisted edge computing and streaming for wireless virtual reality: Analysis, algorithm design, and performance guarantees,” IEEE Transactions on Vehicular Technology, vol. 71, no. 3, pp. 3267–3275, 2022.
- M. Li, J. Gao, L. Zhao, and X. Shen, “Deep reinforcement learning for collaborative edge computing in vehicular networks,” IEEE Transactions on Cognitive Communications and Networking, vol. 6, no. 4, pp. 1122–1135, 2020.
- N. Jing, M. Yang, S. Cheng, Q. Dong, and H. Xiong, “An efficient svm-based method for multi-class network traffic classification,” in 30th IEEE International performance computing and communications conference. IEEE, 2011, pp. 1–8.
- Z. Li, R. Yuan, and X. Guan, “Accurate classification of the internet traffic based on the svm method,” in 2007 IEEE International Conference on Communications. IEEE, 2007, pp. 1373–1378.
- A. Mohamed, O. Onireti, S. A. Hoseinitabatabaei, M. Imran, A. Imran, and R. Tafazolli, “Mobility prediction for handover management in cellular networks with control/data separation,” in 2015 IEEE International Conference on Communications (ICC). IEEE, 2015, pp. 3939–3944.
- A. Magnano, X. Fei, A. Boukerche, and A. A. Loureiro, “A novel predictive handover protocol for mobile ip in vehicular networks,” IEEE Transactions on Vehicular Technology, vol. 65, no. 10, pp. 8476–8495, 2015.
- F. Davoli, M. Marchese, and F. Patrone, “Flow assignment and processing on a distributed edge computing platform,” IEEE Transactions on Vehicular Technology, vol. 71, no. 8, pp. 8783–8795, 2022.
- L. Wang, J. Zhang, J. Chuan, R. Ma, and A. Fei, “Edge intelligence for mission cognitive wireless emergency networks,” IEEE Wireless Communications, vol. 27, no. 4, pp. 103–109, 2020.
- T. Hewa, A. Braeken, M. Ylianttila, and M. Liyanage, “Multi-access edge computing and blockchain-based secure telehealth system connected with 5G and IoT,” in GLOBECOM 2020 - 2020 IEEE Global Communications Conference, 2020, pp. 1–6.
- T. Deng, Y. Chen, G. Chen, M. Yang, and L. Du, “Task offloading based on edge collaboration in mec-enabled IoV networks,” Journal of Communications and Networks, vol. 25, no. 2, pp. 197–207, 2023.
- M. D. Hossain, T. Sultana, S. Akhter, M. I. Hossain, G.-W. Lee, C. S. Hong, and E.-N. Huh, “Computation offloading strategy based on multi-armed bandit learning in microservice-enabled vehicular edge computing networks,” in 2023 International Conference on Information Networking (ICOIN), 2023, pp. 769–774.
- N. Monir, M. M. Toraya, A. Vladyko, A. Muthanna, M. A. Torad, F. E. A. El-Samie, and A. A. Ateya, “Seamless handover scheme for MEC/SDN-based vehicular networks,” Journal of Sensor and Actuator Networks, vol. 11, no. 1, 2022.
- W. Shu and Y. Li, “Joint offloading strategy based on quantum particle swarm optimization for mec-enabled vehicular networks,” Digital Communications and Networks, vol. 9, no. 1, pp. 56–66, 2023.
- P. Whittle, “Restless bandits: Activity allocation in a changing world,” J. Appl. Probab., vol. 25, pp. 287–298, 1988.
- J. Fu, B. Moran, and P. G. Taylor, “A restless bandit model for resource allocation, competition, and reservation,” Operations Research, vol. 70, no. 1, pp. 416–431, Mar. 2021.
- Z. Sun and M. R. Nakhai, “An online learning algorithm for distributed task offloading in multi-access edge computing,” IEEE Transactions on Signal Processing, vol. 68, pp. 3090–3102, 2020.
- M. Zhao, J.-J. Yu, W.-T. Li, D. Liu, S. Yao, W. Feng, C. She, and T. Q. S. Quek, “Energy-aware task offloading and resource allocation for time-sensitive services in mobile edge computing systems,” IEEE Transactions on Vehicular Technology, vol. 70, no. 10, pp. 10 925–10 940, 2021.
- T. Liu, D. Guo, Q. Xu, H. Gao, Y. Zhu, and Y. Yang, “Joint task offloading and dispatching for mec with rational mobile devices and edge nodes,” IEEE Transactions on Cloud Computing, pp. 1–12, 2023.
- H. Song, B. Gu, K. Son, and W. Choi, “Joint optimization of edge computing server deployment and user offloading associations in wireless edge network via a genetic algorithm,” IEEE Transactions on Network Science and Engineering, vol. 9, no. 4, pp. 2535–2548, 2022.
- B. Xiang, J. Elias, F. Martignon, and E. D. Nitto, “Joint planning of network slicing and mobile edge computing: Models and algorithms,” IEEE Transactions on Cloud Computing, vol. 11, no. 1, pp. 620–638, 2023.
- R. Xie, J. Fang, J. Yao, X. Jia, and K. Wu, “Sharing-aware task offloading of remote rendering for interactive applications in mobile edge computing,” IEEE Transactions on Cloud Computing, vol. 11, no. 1, pp. 997–1010, 2023.
- P. Zhao, J. Tao, L. Kangjie, G. Zhang, and F. Gao, “Deep reinforcement learning-based joint optimization of delay and privacy in multiple-user mec systems,” IEEE Transactions on Cloud Computing, pp. 1–1, 2022.
- M. Z. Alam and A. Jamalipour, “Multi-agent DRL-based hungarian algorithm (MADRLHA) for task offloading in multi-access edge computing internet of vehicles (IoVs),” IEEE Transactions on Wireless Communications, vol. 21, no. 9, pp. 7641–7652, 2022.
- X. Xiong, K. Zheng, L. Lei, and L. Hou, “Resource allocation based on deep reinforcement learning in IoT edge computing,” IEEE Journal on Selected Areas in Communications, vol. 38, no. 6, pp. 1133–1146, 2020.
- J. Wang, L. Zhao, J. Liu, and N. Kato, “Smart resource allocation for mobile edge computing: A deep reinforcement learning approach,” IEEE Transactions on Emerging Topics in Computing, vol. 9, no. 3, pp. 1529–1541, 2021.
- Z. Ning, P. Dong, X. Wang, J. J. Rodrigues, and F. Xia, “Deep reinforcement learning for vehicular edge computing: An intelligent offloading system,” ACM Transactions on Intelligent Systems and Technology (TIST), vol. 10, no. 6, pp. 1–24, 2019.
- J. Chen, S. Chen, Q. Wang, B. Cao, G. Feng, and J. Hu, “iRAF: A deep reinforcement learning approach for collaborative mobile edge computing IoT networks,” IEEE Internet of Things Journal, vol. 6, no. 4, pp. 7011–7024, 2019.
- E. F. Maleki, L. Mashayekhy, and S. M. Nabavinejad, “Mobility-aware computation offloading in edge computing using machine learning,” IEEE Transactions on Mobile Computing, vol. 22, no. 1, pp. 328–340, 2023.
- L. Chen, J. Wu, J. Zhang, H.-N. Dai, X. Long, and M. Yao, “Dependency-aware computation offloading for mobile edge computing with edge-cloud cooperation,” IEEE Transactions on Cloud Computing, vol. 10, no. 4, pp. 2451–2468, 2022.
- Y. Lin, Y. Zhang, J. Li, F. Shu, and C. Li, “Popularity-aware online task offloading for heterogeneous vehicular edge computing using contextual clustering of bandits,” IEEE Internet of Things Journal, vol. 9, no. 7, pp. 5422–5433, 2022.
- Y. Chen, N. Zhang, Y. Zhang, X. Chen, W. Wu, and X. Shen, “Energy efficient dynamic offloading in mobile edge computing for Internet of things,” IEEE Transactions on Cloud Computing, vol. 9, no. 3, pp. 1050–1060, 2021.
- G. Wu, H. Wang, H. Zhang, Y. Zhao, S. Yu, and S. Shen, “Computation offloading method using stochastic games for software-defined-network-based multiagent mobile edge computing,” IEEE Internet of Things Journal, vol. 10, no. 20, pp. 17 620–17 634, 2023.
- D. T. Nguyen, L. B. Le, and V. Bhargava, “Price-based resource allocation for edge computing: A market equilibrium approach,” IEEE Transactions on Cloud Computing, vol. 9, no. 1, pp. 302–317, 2021.
- Y. Su, W. Fan, Y. Liu, and F. Wu, “A truthful combinatorial auction mechanism towards mobile edge computing in industrial Internet of Things,” IEEE Transactions on Cloud Computing, vol. 11, no. 2, pp. 1678–1691, 2023.
- N. Uniyal, A. Bravalheri, X. Vasilakos, R. Nejabati, D. Simeonidou, W. Featherstone, S. Wu, and D. Warren, “Intelligent mobile handover prediction for zero downtime edge application mobility,” in 2021 IEEE Global Communications Conference (GLOBECOM), 2021, pp. 1–6.
- X. Yuan, M. Sun, and W. Lou, “A dynamic deep-learning-based virtual edge node placement scheme for edge cloud systems in mobile environment,” IEEE Transactions on Cloud Computing, vol. 10, no. 2, pp. 1317–1328, 2022.
- L. Gillam, K. Katsaros, M. Dianati, and A. Mouzakitis, “Exploring edges for connected and autonomous driving,” in IEEE INFOCOM 2018 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), April 2018, pp. 148–153.
- M. Mukherjee, L. Shu, and D. Wang, “Survey of fog computing: Fundamental, network applications, and research challenges,” IEEE Communications Surveys Tutorials, vol. 20, no. 3, pp. 1826–1857, thirdquarter 2018.
- G. Lee, W. Saad, and M. Bennis, “An online secretary framework for fog network formation with minimal latency,” in 2017 IEEE International Conference on Communications (ICC), May 2017, pp. 1–6.
- C. You, K. Huang, H. Chae, and B. Kim, “Energy-efficient resource allocation for mobile-edge computation offloading,” IEEE Transactions on Wireless Communications, vol. 16, no. 3, pp. 1397–1411, March 2017.
- R. Deng, R. Lu, C. Lai, and T. H. Luan, “Towards power consumption-delay tradeoff by workload allocation in cloud-fog computing,” in 2015 IEEE International Conference on Communications (ICC), June 2015, pp. 3909–3914.
- F. Jalali, K. Hinton, R. Ayre, T. Alpcan, and R. S. Tucker, “Fog computing may help to save energy in cloud computing,” IEEE Journal on Selected Areas in Communications, vol. 34, no. 5, pp. 1728–1739, May 2016.
- J. Wu, E. W. M. Wong, Y.-C. Chan, and M. Zukerman, “Power consumption and GoS tradeoff in cellular mobile networks with base station sleeping and related performance studies,” IEEE Transactions on Green Communications and Networking, vol. 4, no. 4, pp. 1024–1036, 2020.
- Q. Wang, J. Fu, J. Wu, B. Moran, and M. Zukerman, “Energy-efficient priority-based scheduling for wireless network slicing,” in Proc. IEEE GLOBECOM 2018, Abu Dhabi, UAE, Dec. 2018.
- J. Fu and B. Moran, “Energy-efficient job-assignment policy with asymptotically guaranteed performance deviation,” IEEE/ACM Transactions on Networking, vol. 28, no. 3, pp. 1325–1338, 2020.
- J. Wilkes, “More Google cluster data,” Google research blog, Nov. 2011, posted at http://googleresearch.blogspot.com/2011/11/more-google-cluster-data.html, accessed at Jul. 8, 2019.
- C. Reiss, J. Wilkes, and J. L. Hellerstein, “Google cluster-usage traces: format + schema,” Google Inc., Mountain View, CA, USA, Technical Report, Nov. 2011, revised 2014-11-17 for version 2.1. Posted at https://github.com/google/cluster-data, accessed at Jul. 8, 2019.
- J. Fu, B. Moran, P. G. Taylor, and C. Xing, “Resource competition in virtual network embedding,” Stochastic Models, vol. 37, no. 1, pp. 231–263, 2020.
- P. Zhang, H. Yao, and Y. Liu, “Virtual network embedding based on computing, network, and storage resource constraints,” IEEE Internet of Things Journal, vol. 5, no. 5, pp. 3298–3304, 2017.
- M. E. Crovella and A. Bestavros, “Self-similarity in World Wide Web traffic: evidence and possible causes,” IEEE/ACM Trans. Netw., vol. 5, no. 6, pp. 835–846, Dec. 1997.