Hierarchical Federated Learning in Multi-hop Cluster-Based VANETs (2401.10361v1)
Abstract: The usage of federated learning (FL) in Vehicular Ad hoc Networks (VANET) has garnered significant interest in research due to the advantages of reducing transmission overhead and protecting user privacy by communicating local dataset gradients instead of raw data. However, implementing FL in VANETs faces challenges, including limited communication resources, high vehicle mobility, and the statistical diversity of data distributions. In order to tackle these issues, this paper introduces a novel framework for hierarchical federated learning (HFL) over multi-hop clustering-based VANET. The proposed method utilizes a weighted combination of the average relative speed and cosine similarity of FL model parameters as a clustering metric to consider both data diversity and high vehicle mobility. This metric ensures convergence with minimum changes in cluster heads while tackling the complexities associated with non-independent and identically distributed (non-IID) data scenarios. Additionally, the framework includes a novel mechanism to manage seamless transitions of cluster heads (CHs), followed by transferring the most recent FL model parameter to the designated CH. Furthermore, the proposed approach considers the option of merging CHs, aiming to reduce their count and, consequently, mitigate associated overhead. Through extensive simulations, the proposed hierarchical federated learning over clustered VANET has been demonstrated to improve accuracy and convergence time significantly while maintaining an acceptable level of packet overhead compared to previously proposed clustering algorithms and non-clustered VANET.
- R. Chen, W.-L. Jin, and A. Regan, “Broadcasting safety information in vehicular networks: issues and approaches,” IEEE Network, vol. 24, no. 1, pp. 20–25, 2010.
- A. M. Elbir, B. Soner, S. Çöleri, D. Gündüz, and M. Bennis, “Federated learning in vehicular networks,” in 2022 IEEE International Mediterranean Conference on Communications and Networking (MeditCom), pp. 72–77, 2022.
- T. Li, A. K. Sahu, A. Talwalkar, and V. Smith, “Federated learning: Challenges, methods, and future directions,” IEEE Signal Processing Magazine, vol. 37, no. 3, pp. 50–60, 2020.
- S. Liu, J. Yu, X. Deng, and S. Wan, “Fedcpf: An efficient-communication federated learning approach for vehicular edge computing in 6g communication networks,” IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 2, pp. 1616–1629, 2022.
- A. Taïk, Z. Mlika, and S. Cherkaoui, “Clustered vehicular federated learning: Process and optimization,” IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 12, pp. 25371–25383, 2022.
- M. S. H. Abad, E. Ozfatura, D. Gunduz, and O. Ercetin, “Hierarchical federated learning across heterogeneous cellular networks,” in ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 8866–8870, 2020.
- I. Jabri, T. Mekki, A. Rachedi, and M. B. Jemaa, “Vehicular fog gateways selection on the internet of vehicles: A fuzzy logic with ant colony optimization based approach,” Ad Hoc Networks, vol. 91, p. 101879, 2019.
- D. Zhang, H. Ge, T. Zhang, Y.-Y. Cui, X. Liu, and G. Mao, “New multi-hop clustering algorithm for vehicular ad hoc networks,” IEEE Transactions on Intelligent Transportation Systems, vol. 20, no. 4, pp. 1517–1530, 2019.
- F. Sattler, K.-R. Müller, and W. Samek, “Clustered federated learning: Model-agnostic distributed multitask optimization under privacy constraints,” IEEE Transactions on Neural Networks and Learning Systems, vol. 32, no. 8, pp. 3710–3722, 2021.
- B. Li, Y. Jiang, Q. Pei, T. Li, L. Liu, and R. Lu, “Feel: Federated end-to-end learning with non-iid data for vehicular ad hoc networks,” IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 9, pp. 16728–16740, 2022.
- A. Tak and S. Cherkaoui, “Federated edge learning: Design issues and challenges,” IEEE Network, vol. 35, no. 2, pp. 252–258, 2021.
- B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas, “Communication-efficient learning of deep networks from decentralized data,” in Artificial intelligence and statistics, pp. 1273–1282, PMLR, 2017.
- A. Ghosh, J. Chung, D. Yin, and K. Ramchandran, “An efficient framework for clustered federated learning,” Advances in Neural Information Processing Systems, vol. 33, pp. 19586–19597, 2020.
- C. Briggs, Z. Fan, and P. Andras, “Federated learning with hierarchical clustering of local updates to improve training on non-iid data,” in 2020 International Joint Conference on Neural Networks (IJCNN), pp. 1–9, 2020.
- J. B. Kenney, “Dedicated short-range communications (dsrc) standards in the united states,” Proceedings of the IEEE, vol. 99, no. 7, pp. 1162–1182, 2011.
- M. Noor-A-Rahim, Z. Liu, H. Lee, M. O. Khyam, J. He, D. Pesch, K. Moessner, W. Saad, and H. V. Poor, “6g for vehicle-to-everything (v2x) communications: Enabling technologies, challenges, and opportunities,” Proceedings of the IEEE, vol. 110, no. 6, pp. 712–734, 2022.
- H. Seo, K.-D. Lee, S. Yasukawa, Y. Peng, and P. Sartori, “Lte evolution for vehicle-to-everything services,” IEEE Communications Magazine, vol. 54, no. 6, pp. 22–28, 2016.
- H. Bagheri, M. Noor-A-Rahim, Z. Liu, H. Lee, D. Pesch, K. Moessner, and P. Xiao, “5g nr-v2x: Toward connected and cooperative autonomous driving,” IEEE Communications Standards Magazine, vol. 5, no. 1, pp. 48–54, 2021.
- S. Ucar, S. C. Ergen, and O. Ozkasap, “Multihop-cluster-based ieee 802.11p and lte hybrid architecture for vanet safety message dissemination,” IEEE Transactions on Vehicular Technology, vol. 65, no. 4, pp. 2621–2636, 2016.
- J. Posner, L. Tseng, M. Aloqaily, and Y. Jararweh, “Federated learning in vehicular networks: Opportunities and solutions,” IEEE Network, vol. 35, no. 2, pp. 152–159, 2021.
- “VANET repository.” https://github.com/SaeedHaghighi/VANET. Accessed: [31/08/2023].
- “Simulation of Urban MObility, SUMO. [Online]. Available: http:// sumo.sourceforge.net.”
- K. Burlachenko, S. Horváth, and P. Richtárik, “Fl_pytorch: Optimization research simulator for federated learning,” in Proceedings of the 2nd ACM International Workshop on Distributed Machine Learning, DistributedML ’21, (New York, NY, USA), p. 1–7, Association for Computing Machinery, 2021.
- “TensorFlow. [Online]. Available: https://www.tensorflow.org/federated.”
- “APACHE KAFKA. [Online]. Available: https://kafka.apache.org/.”
- M. Sepulcre, M. Gonzalez-Martín, J. Gozalvez, R. Molina-Masegosa, and B. Coll-Perales, “Analytical models of the performance of ieee 802.11p vehicle to vehicle communications,” IEEE Transactions on Vehicular Technology, vol. 71, no. 1, pp. 713–724, 2022.
- 3rd Generation Partnership Project (3GPP), “Study on channel model for frequencies from 0.5 to 100 ghz,” Tech. Rep. TR 38.901, 3GPP, 2017.
- Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner, “Gradient-based learning applied to document recognition,” Proceedings of the IEEE, vol. 86, no. 11, pp. 2278–2324, 1998.
- MIT Press, 2016.
- M. Saeid HaghighiFard (3 papers)
- Sinem Coleri (45 papers)