Distributed client selection with multi-objective in federated learning assisted Internet of Vehicles (2401.03159v1)
Abstract: Federated learning is an emerging distributed machine learning framework in the Internet of Vehicles (IoV). In IoV, millions of vehicles are willing to train the model to share their knowledge. Maintaining an active state means the participants must update their state to the FL server in a fixed interval and participate to next round. However, the cost by maintaining an active state is very large when there are a huge number of participating vehicles. In this paper, we proposed a distributed client selection scheme to reduce the cost of maintaining the active state for all participants. The clients with the highest evaluation are elected among the neighbours. In the evaluator, four variables are considered including sample quantity, throughput available, computational capability and the quality of the local dataset. We adopted fuzzy logic as the evaluator since the closed-form solution over four variables does not exist. Extensive simulation results show our proposal approximates the centralized client selection in terms of accuracy and can significantly reduce the communication overhead.
- B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas, “Communication-efficient learning of deep networks from decentralized data,” in Artificial intelligence and statistics. PMLR, 2017, pp. 1273–1282.
- A. Hard, K. Rao, R. Mathews, F. Beaufays, S. Augenstein, H. Eichner, C. Kiddon, and D. Ramage, “Federated learning for mobile keyboard prediction,” CoRR, vol. abs/1811.03604, 2018.
- J. Hamer, M. Mohri, and A. T. Suresh, “Fedboost: A communication-efficient algorithm for federated learning,” in International Conference on Machine Learning. PMLR, 2020, pp. 3973–3983.
- J. Konečnỳ, H. B. McMahan, F. X. Yu, P. Richtárik, A. T. Suresh, and D. Bacon, “Federated learning: Strategies for improving communication efficiency,” arXiv preprint arXiv:1610.05492, 2016.
- L. WANG, W. WANG, and B. LI, “Cmfl: Mitigating communication overhead for federated learning,” in 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS), 2019, pp. 954–964.
- S. Niknam, H. S. Dhillon, and J. H. Reed, “Federated learning for wireless communications: Motivation, opportunities and challenges,” 2020.
- Y. J. Cho, J. Wang, and G. Joshi, “Towards understanding biased client selection in federated learning,” in International Conference on Artificial Intelligence and Statistics. PMLR, 2022, pp. 10 351–10 375.
- T. Nishio and R. Yonetani, “Client selection for federated learning with heterogeneous resources in mobile edge,” in IEEE International Conference on Communications (ICC), 2019, pp. 1–7.
- H. Wang, Z. Kaplan, D. Niu, and B. Li, “Optimizing federated learning on non-iid data with reinforcement learning,” in IEEE INFOCOM 2020 - IEEE Conference on Computer Communications, 2020, pp. 1698–1707.
- P. Zhang, C. Wang, C. Jiang, and Z. Han, “Deep reinforcement learning assisted federated learning algorithm for data management of iiot,” IEEE Transactions on Industrial Informatics, vol. 17, no. 12, pp. 8475–8484, 2021.
- O. R. A. Almanifi, C.-O. Chow, M.-L. Tham, J. H. Chuah, and J. Kanesan, “Communication and computation efficiency in federated learning: A survey,” Internet of Things, vol. 22, p. 100742, 2023.
- X. Zhou, X. Ye, K. I.-K. Wang, W. Liang, N. K. C. Nair, S. Shimizu, Z. Yan, and Q. Jin, “Hierarchical federated learning with social context clustering-based participant selection for internet of medical things applications,” IEEE Transactions on Computational Social Systems, pp. 1–10, 2023.
- J. Xu and H. Wang, “Client selection and bandwidth allocation in wireless federated learning networks: A long-term perspective,” IEEE Transactions on Wireless Communications, vol. 20, no. 2, pp. 1188–1200, 2021.
- S. Abdulrahman, H. Tout, A. Mourad, and C. Talhi, “Fedmccs: Multicriteria client selection model for optimal iot federated learning,” IEEE Internet of Things Journal, vol. 8, no. 6, pp. 4723–4735, 2021.
- T. Huang, W. Lin, W. Wu, L. He, K. Li, and A. Y. Zomaya, “An efficiency-boosting client selection scheme for federated learning with fairness guarantee,” IEEE Transactions on Parallel and Distributed Systems, vol. 32, no. 7, pp. 1552–1564, 2021.
- N. Cha, Z. Du, C. Wu, T. Yoshinaga, L. Zhong, J. Ma, F. Liu, and Y. Ji, “Fuzzy logic based client selection for federated learning in vehicular networks,” IEEE Open Journal of the Computer Society, vol. 3, pp. 39–50, 2022.
- T. Li, A. K. Sahu, M. Zaheer, M. Sanjabi, A. Talwalkar, and V. Smith, “Federated optimization in heterogeneous networks,” Proceedings of Machine learning and systems, vol. 2, pp. 429–450, 2020.
- S. P. Karimireddy, S. Kale, M. Mohri, S. Reddi, S. Stich, and A. T. Suresh, “Scaffold: Stochastic controlled averaging for federated learning,” in International conference on machine learning. PMLR, 2020, pp. 5132–5143.
- D. M. Manias and A. Shami, “Making a case for federated learning in the internet of vehicles and intelligent transportation systems,” IEEE Network, vol. 35, no. 3, pp. 88–94, 2021.
- A. Hammoud, H. Otrok, A. Mourad, and Z. Dziong, “On demand fog federations for horizontal federated learning in iov,” IEEE Transactions on Network and Service Management, vol. 19, no. 3, pp. 3062–3075, 2022.
- Y. Lu, X. Huang, K. Zhang, S. Maharjan, and Y. Zhang, “Blockchain empowered asynchronous federated learning for secure data sharing in internet of vehicles,” IEEE Transactions on Vehicular Technology, vol. 69, no. 4, pp. 4298–4311, 2020.
- X. Hu, R. Li, Y. Ning, K. Ota, and L. Wang, “A data sharing scheme based on federated learning in iov,” IEEE Transactions on Vehicular Technology, pp. 1–13, 2023.
- L. Yu, R. Albelaihi, X. Sun, N. Ansari, and M. Devetsikiotis, “Jointly optimizing client selection and resource management in wireless federated learning for internet of things,” IEEE Internet of Things Journal, pp. 1–1, 2021.
- A. G. Roy, S. Siddiqui, S. Pölsterl, N. Navab, and C. Wachinger, “Braintorrent: A peer-to-peer environment for decentralized federated learning,” arXiv preprint arXiv:1905.06731, 2019.
- Y. Li, C. Chen, N. Liu, H. Huang, Z. Zheng, and Q. Yan, “A blockchain-based decentralized federated learning framework with committee consensus,” IEEE Network, vol. 35, no. 1, pp. 234–241, 2020.
- H. Ye, L. Liang, and G. Y. Li, “Decentralized federated learning with unreliable communications,” IEEE journal of selected topics in signal processing, vol. 16, no. 3, pp. 487–500, 2022.
- H. Xu, J. Li, H. Xiong, and H. Lu, “Fedmax: Enabling a highly-efficient federated learning framework,” in 2020 IEEE 13th International Conference on Cloud Computing (CLOUD), 2020, pp. 426–434.
- A. Paszke, S. Gross, F. Massa, A. Lerer, J. Bradbury, G. Chanan, T. Killeen, Z. Lin, N. Gimelshein, L. Antiga et al., “Pytorch: An imperative style, high-performance deep learning library,” Advances in neural information processing systems, vol. 32, 2019.
- A. Varga and R. Hornig, “An overview of the omnet++ simulation environment,” in 1st International ICST Conference on Simulation Tools and Techniques for Communications, Networks and Systems, 2010.
- A. Virdis, G. Stea, and G. Nardini, “Simulte-a modular system-level simulator for lte/lte-a networks based on omnet++,” in 2014 4th International Conference On Simulation And Modeling Methodologies, Technologies And Applications (SIMULTECH). IEEE, 2014, pp. 59–70.
- P. A. Lopez, M. Behrisch, L. Bieker-Walz, J. Erdmann, Y.-P. Flötteröd, R. Hilbrich, L. Lücken, J. Rummel, P. Wagner, and E. Wießner, “Microscopic traffic simulation using sumo,” in 2018 21st international conference on intelligent transportation systems (ITSC). IEEE, 2018, pp. 2575–2582.
- L. Deng, “The mnist database of handwritten digit images for machine learning research,” IEEE Signal Processing Magazine, vol. 29, no. 6, pp. 141–142, 2012.
- “Number of registered motor vehicles in tokyo, japan from 2012 to 2021,” https://www.statista.com/statistics/1191244/japan-number-motor-vehicles-in-use-tokyo/, accessed: 2023-08-16.
- L. Fu, H. Zhang, G. Gao, M. Zhang, and X. Liu, “Client selection in federated learning: Principles, challenges, and opportunities,” IEEE Internet of Things Journal, 2023.
- Y. Shi, H. Yu, and C. Leung, “Towards fairness-aware federated learning,” IEEE Transactions on Neural Networks and Learning Systems, 2023.
- Y. H. Ezzeldin, S. Yan, C. He, E. Ferrara, and A. S. Avestimehr, “Fairfed: Enabling group fairness in federated learning,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 37, no. 6, 2023, pp. 7494–7502.
- J. Posner, L. Tseng, M. Aloqaily, and Y. Jararweh, “Federated learning in vehicular networks: Opportunities and solutions,” IEEE Network, vol. 35, no. 2, pp. 152–159, 2021.
- S. AbdulRahman, H. Tout, H. Ould-Slimane, A. Mourad, C. Talhi, and M. Guizani, “A survey on federated learning: The journey from centralized to distributed on-site learning and beyond,” IEEE Internet of Things Journal, vol. 8, no. 7, pp. 5476–5497, 2020.
- S. Wang, F. Liu, and H. Xia, “Content-based vehicle selection and resource allocation for federated learning in iov,” in 2021 IEEE Wireless Communications and Networking Conference Workshops (WCNCW). IEEE, 2021, pp. 1–7.
- X. Zhang, A. Mavromatics, A. Vafeas, R. Nejabati, and D. Simeonidou, “Federated feature selection for horizontal federated learning in iot networks,” IEEE Internet of Things Journal, 2023.
- S. R. Pokhrel and J. Choi, “A decentralized federated learning approach for connected autonomous vehicles,” in 2020 IEEE Wireless Communications and Networking Conference Workshops (WCNCW). IEEE, 2020, pp. 1–6.
- P. Kairouz, H. B. McMahan, B. Avent, A. Bellet, M. Bennis, A. N. Bhagoji, K. Bonawitz, Z. Charles, G. Cormode, R. Cummings et al., “Advances and open problems in federated learning,” Foundations and Trends® in Machine Learning, vol. 14, no. 1–2, pp. 1–210, 2021.