2000 character limit reached
Efficient Collaborations through Weight-Driven Coalition Dynamics in Federated Learning Systems
Published 22 Jan 2024 in cs.LG, cs.DC, and cs.GT | (2401.12356v1)
Abstract: In the era of the Internet of Things (IoT), decentralized paradigms for machine learning are gaining prominence. In this paper, we introduce a federated learning model that capitalizes on the Euclidean distance between device model weights to assess their similarity and disparity. This is foundational for our system, directing the formation of coalitions among devices based on the closeness of their model weights. Furthermore, the concept of a barycenter, representing the average of model weights, helps in the aggregation of updates from multiple devices. We evaluate our approach using homogeneous and heterogeneous data distribution, comparing it against traditional federated learning averaging algorithm. Numerical results demonstrate its potential in offering structured, outperformed and communication-efficient model for IoT-based machine learning.
- L. Cui, S. Yang, F. Chen, Z. Ming, N. Lu, and J. Qin, “A survey on application of machine learning for internet of things,” International Journal of Machine Learning and Cybernetics, vol. 9, pp. 1399–1417, 2018.
- A. Abouaomar, Z. Mlika, A. Filali, S. Cherkaoui, and A. Kobbane, “A deep reinforcement learning approach for service migration in mec-enabled vehicular networks,” in 2021 IEEE 46th conference on local computer networks (LCN). IEEE, 2021, pp. 273–280.
- D. C. Nguyen, M. Ding, P. N. Pathirana, A. Seneviratne, J. Li, and H. V. Poor, “Federated learning for internet of things: A comprehensive survey,” IEEE Communications Surveys & Tutorials, vol. 23, no. 3, pp. 1622–1658, 2021.
- L. U. Khan, W. Saad, Z. Han, E. Hossain, and C. S. Hong, “Federated learning for internet of things: Recent advances, taxonomy, and open challenges,” IEEE Communications Surveys & Tutorials, vol. 23, no. 3, pp. 1759–1799, 2021.
- A. Abouaomar, A. Taik, A. Filali, and S. Cherkaoui, “Federated deep reinforcement learning for open ran slicing in 6g networks,” IEEE Communications Magazine, vol. 61, no. 2, pp. 126–132, 2022.
- F. Sattler, S. Wiedemann, K.-R. Müller, and W. Samek, “Robust and communication-efficient federated learning from non-iid data,” IEEE transactions on neural networks and learning systems, vol. 31, no. 9, pp. 3400–3413, 2019.
- A. Taik, A. Abouaomar, and S. Cherkaoui, “Green federated learning-based models and protocols,” in Green Machine Learning Protocols for Future Communication Networks. CRC Press, 2024, pp. 63–102.
- A. A. Abdellatif, N. Mhaisen, A. Mohamed, A. Erbad, M. Guizani, Z. Dawy, and W. Nasreddine, “Communication-efficient hierarchical federated learning for iot heterogeneous systems with imbalanced data,” Future Generation Computer Systems, vol. 128, pp. 406–419, 2022.
- B. B. Elallid, A. Abouaomar, N. Benamar, and A. Kobbane, “Vehicles control: Collision avoidance using federated deep reinforcement learning,” arXiv preprint arXiv:2308.02614, 2023.
- L. Zhang, X. Lei, Y. Shi, H. Huang, and C. Chen, “Federated learning for iot devices with domain generalization,” IEEE Internet of Things Journal, vol. 10, no. 11, pp. 9622–9633, 2023.
- A. Imteaj, U. Thakker, S. Wang, J. Li, and M. H. Amini, “A survey on federated learning for resource-constrained iot devices,” IEEE Internet of Things Journal, vol. 9, no. 1, pp. 1–24, 2021.
- H. Kabbaj, M. El Hanjri, A. Kobbane, R. El-Azouzi, and A. Abouaomar, “Distfl: An enhanced fl approach for non trusted setting in water distribution networks,” in ICC 2023-IEEE International Conference on Communications. IEEE, 2023, pp. 2486–2491.
- M. El Hanjri, H. Kabbaj, A. Kobbane, and A. Abouaomar, “Federated learning for water consumption forecasting in smart cities,” in ICC 2023-IEEE International Conference On Communications. IEEE, 2023, pp. 1798–1803.
- H. Reguieg, M. El Hanjri, M. El Kamili, and A. Kobbane, “A comparative evaluation of fedavg and per-fedavg algorithms for dirichlet distributed heterogeneous data,” in 2023 10th International Conference on Wireless Networks and Mobile Communications (WINCOM). IEEE, 2023, pp. 1–6.
- Z. Chen, L. Zhang, Y. Wu, J. Li, Y. Ji, G. Chen, and M. Guizani, “Dim-ds: Dynamic incentive model for data sharing in federated learning based on smart contracts and evolutionary game theory,” IoT Journal, 2022. [Online]. Available: https://dblp.org/rec/journals/iotj/ChenZWWLJCG22
- B. Wehbi, E. Al-Shaer, O. Oyedele, A. Oyedele, and A. Meddeb-Makhlouf, “Towards bilateral client selection in federated learning using matching game theory,” in GLOBECOM, 2022. [Online]. Available: https://dblp.org/rec/conf/globecom/WehbiA0OOM22
- M. Houda, A. Boudhir, A. Kobbane, S. Krit, and D. Gaiti, “When federated learning meets game theory: A cooperative framework to secure iiot applications on edge computing,” TII Journal, 2022. [Online]. Available: https://dblp.org/rec/journals/tii/HoudaBKKG22
- P. Pene, W. Liao, and W. Yu, “Incentive design for heterogeneous client selection: A robust federated learning approach,” IEEE Internet of Things Journal, pp. 1–1, 2023.
- J. Pang, Y. Huang, Z. Xie, Q. Han, and Z. Cai, “Realizing the heterogeneity: A self-organized federated learning framework for iot,” IEEE Internet of Things Journal, vol. 8, no. 5, pp. 3088–3098, 2021.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.