QEdgeProxy: QoS-Aware Load Balancing for IoT Services in the Computing Continuum (2405.10788v1)
Abstract: While various service orchestration aspects within Computing Continuum (CC) systems have been extensively addressed, including service placement, replication, and scheduling, an open challenge lies in ensuring uninterrupted data delivery from IoT devices to running service instances in this dynamic environment, while adhering to specific Quality of Service (QoS) requirements and balancing the load on service instances. To address this challenge, we introduce QEdgeProxy, an adaptive and QoS-aware load balancing framework specifically designed for routing client requests to appropriate IoT service instances in the CC. QEdgeProxy integrates naturally within Kubernetes, adapts to changes in dynamic environments, and manages to seamlessly deliver data to IoT service instances while consistently meeting QoS requirements and effectively distributing load across them. This is verified by extensive experiments over a realistic K3s cluster with instance failures and network variability, where QEdgeProxy outperforms both Kubernetes built-in mechanisms and a state-of-the-art solution, while introducing minimal computational overhead.
- L. Wojciechowski, K. Opasiak, J. Latusek, M. Wereski, V. Morales, T. Kim, and M. Hong, “Netmarks: Network metrics-aware kubernetes scheduler powered by service mesh,” in Proc. IEEE INFOCOM, 2021.
- J. Santos, T. Wauters, B. Volckaert, and F. D. Turck, “Towards network-aware resource provisioning in kubernetes for fog computing applications,” in Proc. IEEE NetSoft, 2019.
- K. Toczé, A. J. Fahs, G. Pierre, and S. Nadjm-Tehrani, “Violinn: Proximity-aware edge placementwith dynamic and elastic resource provisioning,” ACM Trans. Internet Things, vol. 4, no. 1, 2023.
- P. Krivic, M. Kusek, I. Čavrak, and P. Skocir, “Dynamic scheduling of contextually categorised internet of things services in fog computing environment,” Sensors, vol. 22, 01 2022.
- T. W. Pusztai, S. Nastic, A. Morichetta, V. Casamayor-Pujol, P. Raith, S. Dustdar, D. Vij, Y. Xiong, and Z. Zhang, “Polaris scheduler: SLO- and topology-aware microservices scheduling at the edge,” in Proc. 15th IEEE/ACM UCC, 2022.
- Cloud Native Computing Foundation, “Kubernetes,” https://kubernetes.io/.
- A. Kapsalis, P. Kasnesis, I. S. Venieris, D. I. Kaklamani, and C. Z. Patrikakis, “A cooperative fog approach for effective workload balancing,” IEEE Cloud Computing, vol. 4, no. 2, 2017.
- A. J. Fahs and G. Pierre, “Proximity-aware traffic routing in distributed fog computing platforms,” in Proc. IEEE/ACM CCGrid, 2019.
- Q.-M. Nguyen, L.-A. Phan, and T. Kim, “Load-balancing of kubernetes-based edge computing infrastructure using resource adaptive proxy,” Sensors, vol. 22, no. 8, 2022.
- Cloud Native Computing Foundation, “K3s - lightweight kubernetes,” https://docs.k3s.io/.
- Z. Rejiba, X. Masip-Bruin, and E. Marín-Tordera, “Towards user-centric, switching cost-aware fog node selection strategies,” Future Gener. Comput. Syst., vol. 117, 2021.
- V. Karagiannis, P. A. Frangoudis, S. Dustdar, and S. Schulte, “Context-aware routing in fog computing systems,” IEEE Trans. Cloud Comput., vol. 11, no. 1, 2023.
- M. Boban, A. Kousaridas, K. Manolakis, J. Eichinger, and W. Xu, “Connected roads of the future: Use cases, requirements, and design considerations for vehicle-to-everything communications,” IEEE Veh. Technol. Mag., vol. 13, no. 3, 2018.
- F. Alam, A. N. Toosi, M. A. Cheema, C. Cicconetti, P. Serrano, A. Iosup, Z. Tari, and M. Sarvi, “Serverless vehicular edge computing for the internet of vehicles,” IEEE Internet Comput., vol. 27, no. 4, 2023.
- I. Čilić, P. Krivić, I. Podnar Žarko, and M. Kušek, “Performance evaluation of container orchestration tools in edge computing environments,” Sensors, vol. 23, no. 8, 2023.
- “Kubernetes documentation: Network policies,” https://kubernetes.io/docs/concepts/services-networking/network-policies/.
- “Istio service mesh,” https://istio.io/latest/about/service-mesh/.
- “IMUNES: integrated multiprotocol network emulator/simulator,” http://imunes.net/.
Sponsor
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.