Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
162 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Intelligent Client Selection for Federated Learning using Cellular Automata (2310.00627v2)

Published 1 Oct 2023 in cs.LG, cs.AI, and cs.DC

Abstract: Federated Learning (FL) has emerged as a promising solution for privacy-enhancement and latency minimization in various real-world applications, such as transportation, communications, and healthcare. FL endeavors to bring Machine Learning (ML) down to the edge by harnessing data from million of devices and IoT sensors, thus enabling rapid responses to dynamic environments and yielding highly personalized results. However, the increased amount of sensors across diverse applications poses challenges in terms of communication and resource allocation, hindering the participation of all devices in the federated process and prompting the need for effective FL client selection. To address this issue, we propose Cellular Automaton-based Client Selection (CA-CS), a novel client selection algorithm, which leverages Cellular Automata (CA) as models to effectively capture spatio-temporal changes in a fast-evolving environment. CA-CS considers the computational resources and communication capacity of each participating client, while also accounting for inter-client interactions between neighbors during the client selection process, enabling intelligent client selection for online FL processes on data streams that closely resemble real-world scenarios. In this paper, we present a thorough evaluation of the proposed CA-CS algorithm using MNIST and CIFAR-10 datasets, while making a direct comparison against a uniformly random client selection scheme. Our results demonstrate that CA-CS achieves comparable accuracy to the random selection approach, while effectively avoiding high-latency clients.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (20)
  1. B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y. Arcas, “Communication-Efficient Learning of Deep Networks from Decentralized Data,” in Proceedings of the 20th AISTATS Conference.
  2. A. M. Elbir, B. Soner, S. Coleri, D. Gunduz, and M. Bennis, “Federated learning in vehicular networks,” 2022.
  3. V. Perifanis and P. S. Efraimidis, “Federated neural collaborative filtering,” Knowledge-Based Systems, vol. 242, p. 108441, 2022.
  4. V. Perifanis, G. Drosatos, G. Stamatelatos, and P. S. Efraimidis, “Fedpoirec: Privacy-preserving federated poi recommendation with social influence,” Information Sciences, vol. 623, pp. 767–790, 2023.
  5. V. Perifanis, N. Pavlidis, R.-A. Koutsiamanis, and P. S. Efraimidis, “Federated learning for 5g base station traffic forecasting,” Computer Networks, p. 109950, 2023.
  6. M. Joshi, A. Pal, and M. Sankarasubbu, “Federated learning for healthcare domain - pipeline, applications and challenges,” ACM Trans. Comput. Healthcare, vol. 3, no. 4, nov 2022.
  7. POLARIS Market Research, “Federated learning market share, size, trends, industry analysis report.” 2021.
  8. X. Ma, J. Zhu, Z. Lin, S. Chen, and Y. Qin, “A state-of-the-art survey on solving non-iid data in federated learning,” Future Generation Computer Systems, vol. 135, pp. 244–258, 2022.
  9. S. Bano, N. Tonellotto, P. Cassarà, and A. Gotta, “Fedtcs: Federated learning with time-based client selection to optimize edge resources,” 2022.
  10. L. Fu, H. Zhang, G. Gao, H. Wang, M. Zhang, and X. Liu, “Client selection in federated learning: Principles, challenges, and opportunities,” 2022.
  11. S. K. Lo, Q. Lu, L. Zhu, H.-Y. Paik, X. Xu, and C. Wang, “Architectural patterns for the design of federated learning systems,” Journal of Systems and Software, vol. 191, p. 111357, 2022.
  12. S. Wolfram, “Statistical mechanics of cellular automata,” Reviews of Modern Physics, vol. 55, no. 3, pp. 601–644, Jul. 1983.
  13. G. Sirakoulis, I. Karafyllidis, and A. Thanailakis, “A cellular automaton model for the effects of population movement and vaccination on epidemic propagation,” Ecological Modelling, vol. 133, no. 3, pp. 209–223, 2000.
  14. M.-A. Tsompanas, T. P. Chatzinikolaou, and G. C. Sirakoulis, “Cellular automata application on chemical computing logic circuits,” in Cellular Automata.   Cham: Springer International Publishing, 2022, pp. 3–14.
  15. T. P. Chatzinikolaou, R.-E. Karamani, and G. C. Sirakoulis, “Irregular learning cellular automata for the resolution of complex logic puzzles,” in Cellular Automata.   Springer International Publishing, 2022.
  16. Y. J. Cho, S. Gupta, G. Joshi, and O. Yağan, “Bandit-based communication-efficient client selection strategies for federated learning,” 2020.
  17. Y. Fraboni, R. Vidal, L. Kameni, and M. Lorenzi, “Clustered sampling: Low-variance and improved representativity for clients selection in federated learning,” 2021.
  18. G. Shen, D. Gao, D. Song, L. Yang, X. Zhou, S. Pan, W. Lou, and F. Zhou, “Fast heterogeneous federated learning with hybrid client selection,” 2022.
  19. T. Huang, W. Lin, L. Shen, K. Li, and A. Y. Zomaya, “Stochastic client selection for federated learning with volatile clients,” 2022.
  20. N. Cha, Z. Du, C. Wu, T. Yoshinaga, L. Zhong, J. Ma, F. Liu, and Y. Ji, “Fuzzy logic based client selection for federated learning in vehicular networks,” IEEE Open Journal of the Computer Society, vol. 3, pp. 39–50, 2022.
Citations (2)

Summary

We haven't generated a summary for this paper yet.