Data-Heterogeneous Hierarchical Federated Learning with Mobility (2306.10692v1)
Abstract: Federated learning enables distributed training of ML models across multiple devices in a privacy-preserving manner. Hierarchical federated learning (HFL) is further proposed to meet the requirements of both latency and coverage. In this paper, we consider a data-heterogeneous HFL scenario with mobility, mainly targeting vehicular networks. We derive the convergence upper bound of HFL with respect to mobility and data heterogeneity, and analyze how mobility impacts the performance of HFL. While mobility is considered as a challenge from a communication point of view, our goal here is to exploit mobility to improve the learning performance by mitigating data heterogeneity. Simulation results verify the analysis and show that mobility can indeed improve the model accuracy by up to 15.1\% when training a convolutional neural network on the CIFAR-10 dataset using HFL.
- A. M. Elbir, B. Soner, S. Çöleri, D. Gündüz, and M. Bennis, “Federated learning in vehicular networks,” in IEEE Int. Mediterranean Conf. on Communications and Networking (MeditCom), Athens, Greece, Sep. 2022, pp. 72–77.
- Y. Sun, B. Xie, S. Zhou, and Z. Niu, “MEET: Mobility-Enhanced Edge inTelligence for Smart and Green 6G Networks,” IEEE Commun. Mag., vol. 61, no. 1, pp. 64–70, Jan. 2023.
- K. Tan, D. Bremner, J. Le Kernec, and M. Imran, “Federated machine learning in vehicular networks: A summary of recent applications,” in Int. Conf. on UK-China Emerging Technologies (UCET), Glasgow, UK, Aug. 2020, pp. 1–4.
- L. Liang, H. Ye, and G. Y. Li, “Toward intelligent vehicular networks: A machine learning framework,” IEEE Internet Things J., vol. 6, no. 1, pp. 124–135, Feb. 2019.
- D. Ye, R. Yu, M. Pan, and Z. Han, “Federated learning in vehicular edge computing: A selective model aggregation approach,” IEEE Access, vol. 8, pp. 23920–23935, 2020.
- J. Posner, L. Tseng, M. Aloqaily, and Y. Jararweh, “Federated learning in vehicular networks: Opportunities and solutions,” IEEE Netw., vol. 35, no. 2, pp. 152–159, Mar. 2021.
- H. Zhou, Y. Zheng, H. Huang, J. Shu, and X. Jia, “Toward robust hierarchical federated learning in internet of vehicles,” IEEE Trans. Intell. Transp. Syst., vol. 24, no. 5, pp. 5600–5614, May 2023.
- B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas, “Communication-efficient learning of deep networks from decentralized data,” in Proc. Artificial Intelligence and Statistics (AIStats), Apr. 2017.
- L. Liu, J. Zhang, S. Song, and K. B. Letaief, “Client-edge-cloud hierarchical federated learning,” in Proc. IEEE Int. Conf. Commun. (ICC), Dublin, Ireland, Jun. 2020, pp. 1–6.
- M. S. H. Abad, E. Ozfatura, D. Gunduz, and O. Ercetin, “Hierarchical federated learning across heterogeneous cellular networks,” in IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain, May 2020, pp. 8866–8870.
- G. Ayache, V. Dassari, and S. El Rouayheb, “Walk for learning: A random walk approach for federated learning from heterogeneous data,” IEEE J. Sel. Areas Commun., vol. 41, no. 4, pp. 929–940, Apr. 2023.
- W. Shi, S. Zhou, Z. Niu, M. Jiang, and L. Geng, “Joint device scheduling and resource allocation for latency constrained wireless federated learning,” IEEE Trans. Wireless Commun., vol. 20, no. 1, pp. 453–467, Jan. 2021.
- L. Wang, S. Xu, X. Wang, and Q. Zhu, “Addressing class imbalance in federated learning,” in Proc. AAAI Conf. Artif. Intell., Feb. 2021, vol. 35, pp. 10165–10173.
- Y. Deng, F. Lyu, J. Ren, Y. Zhang, Y. Zhou, Y. Zhang, and Y. Yang, “Share: Shaping data distribution at edge for communication-efficient hierarchical federated learning,” in IEEE 41st Int. Conf. on Distributed Computing Systems (ICDCS), DC, USA, Jul. 2021, pp. 24–34.
- S. Liu, G. Yu, X. Chen, and M. Bennis, “Joint user association and resource allocation for wireless hierarchical federated learning with iid and non-iid data,” IEEE Trans. Wireless Commun., vol. 21, no. 10, pp. 7852–7866, Oct. 2022.
- C. Feng, H. H. Yang, D. Hu, Z. Zhao, T. Q. Quek, and G. Min, “Mobility-aware cluster federated learning in hierarchical wireless networks,” IEEE Trans. Wireless Commun., vol. 21, no. 10, pp. 8441–8458, Oct. 2022.
- S. Wang, T. Tuor, T. Salonidis, K. K. Leung, C. Makaya, T. He, and K. Chan, “Adaptive federated learning in resource constrained edge computing systems,” IEEE J. Sel. Areas Commun., vol. 37, no. 6, pp. 1205–1221, Jun. 2019.
- T. Tuor, S. Wang, K. K. Leung, and K. Chan, “Distributed machine learning in coalition environments: overview of techniques,” in 21st Int. Conf. on Information Fusion (FUSION), Cambridge, UK, Jul. 2018, pp. 814–821.
- Tan Chen (17 papers)
- Jintao Yan (6 papers)
- Yuxuan Sun (79 papers)
- Sheng Zhou (186 papers)
- Deniz Gunduz (506 papers)
- Zhisheng Niu (97 papers)