Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
GPT-4o
12 tokens/sec
Gemini 2.5 Pro Pro
o3 Pro
5 tokens/sec
GPT-4.1 Pro
37 tokens/sec
DeepSeek R1 via Azure Pro
33 tokens/sec
Gemini 2.5 Flash Deprecated
12 tokens/sec
2000 character limit reached

Ranking-based Client Selection with Imitation Learning for Efficient Federated Learning (2405.04122v1)

Published 7 May 2024 in cs.LG and cs.DC

Abstract: Federated Learning (FL) enables multiple devices to collaboratively train a shared model while ensuring data privacy. The selection of participating devices in each training round critically affects both the model performance and training efficiency, especially given the vast heterogeneity in training capabilities and data distribution across devices. To address these challenges, we introduce a novel device selection solution called FedRank, which is an end-to-end, ranking-based approach that is pre-trained by imitation learning against state-of-the-art analytical approaches. It not only considers data and system heterogeneity at runtime but also adaptively and efficiently chooses the most suitable clients for model training. Specifically, FedRank views client selection in FL as a ranking problem and employs a pairwise training strategy for the smart selection process. Additionally, an imitation learning-based approach is designed to counteract the cold-start issues often seen in state-of-the-art learning-based approaches. Experimental results reveal that \model~ boosts model accuracy by 5.2\% to 56.9\%, accelerates the training convergence up to $2.01 \times$ and saves the energy consumption up to $40.1\%$.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (46)
  1. Diverse client selection for federated learning via submodular maximization. In International Conference on Learning Representations, 2022.
  2. Learning to rank using gradient descent. In Proceedings of the 22nd international conference on Machine learning, pp.  89–96, 2005.
  3. Casalegno, F. Learning to rank: A complete guide to ranking using machine learning. https://towardsdatascience.com, 2022.
  4. Tifl: A tier-based federated learning system. In Proceedings of the 29th international symposium on high-performance parallel and distributed computing, pp.  125–136, 2020.
  5. Client selection in federated learning: Convergence analysis and power-of-choice selection strategies. arXiv preprint arXiv:2010.01243, 2020.
  6. Cinic-10 is not imagenet or cifar-10. arXiv preprint arXiv:1810.03505, 2018.
  7. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition, pp.  248–255. Ieee, 2009.
  8. Heterofl: Computation and communication efficient federated learning for heterogeneous clients. In International Conference on Learning Representations, 2021.
  9. Active federated learning. arXiv preprint arXiv:1909.12641, 2019.
  10. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.  770–778, 2016.
  11. Long short-term memory. Neural computation, 9(8):1735–1780, 1997.
  12. Fedmg: A federated multi-global optimization framework for autonomous driving control. In 2024 IEEE/ACM 32st International Symposium on Quality of Service (IWQoS), pp.  1–10. IEEE, 2024.
  13. Joachims, T. Optimizing search engines using clickthrough data. In Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, pp.  133–142, 2002.
  14. Autofl: Enabling heterogeneity-aware energy efficient federated learning. In MICRO-54: 54th Annual IEEE/ACM International Symposium on Microarchitecture, pp.  183–198, 2021.
  15. Learning multiple layers of features from tiny images. Citeseer, 2009.
  16. Oort: Efficient federated learning via guided participant selection. In OSDI, pp.  19–35, 2021.
  17. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278–2324, 1998.
  18. The mnist database of handwritten digits. http://yann.lecun.com/exdb/mnist/, 1998.
  19. Li, H. A short introduction to learning to rank. IEICE TRANSACTIONS on Information and Systems, 94(10):1854–1862, 2011.
  20. Smartpc: Hierarchical pace control in real-time federated learning system. In 2019 IEEE Real-Time Systems Symposium (RTSS), pp.  406–418. IEEE, 2019.
  21. Model-contrastive federated learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.  10713–10722, 2021.
  22. Bat: Behavior-aware human-like trajectory prediction for autonomous driving. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pp.  10332–10340, 2024.
  23. An imitation learning approach for cache replacement. In International Conference on Machine Learning, pp.  6237–6247. PMLR, 2020.
  24. Liu, T.-Y. et al. Learning to rank for information retrieval. Foundations and Trends® in Information Retrieval, 3(3):225–331, 2009.
  25. Communication-efficient learning of deep networks from decentralized data. In Artificial intelligence and statistics, pp.  1273–1282. PMLR, 2017.
  26. Monsoon. Monsoon high voltage power monitor. https://www.msoon.com/online-store/High-Voltage-Power-Monitor-p90002590, 2023.
  27. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems, 32, 2019.
  28. Letor: A benchmark collection for research on learning to rank for information retrieval. Information Retrieval, 13:346–374, 2010.
  29. Reinforcement and imitation learning via interactive no-regret learning. arXiv preprint arXiv:1406.5979, 2014.
  30. Optimal completion distillation for sequence learning. arXiv preprint arXiv:1810.01398, 2018.
  31. Livelab: measuring wireless networks and smartphone users in the field. ACM SIGMETRICS Performance Evaluation Review, 38(3):15–20, 2011.
  32. Simonyan. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.
  33. Deeply aggrevated: Differentiable imitation learning for sequential prediction. In International conference on machine learning, pp.  3309–3318. PMLR, 2017.
  34. Value-decomposition networks for cooperative multi-agent learning. arXiv preprint arXiv:1706.05296, 2017.
  35. Reinforcement learning: An introduction. MIT press, 2018.
  36. Federated noisy client learning. IEEE Transactions on Neural Networks and Learning Systems, 2023a.
  37. Fedcoop: Cooperative federated learning for noisy labels. In Gal, K., Nowé, A., Nalepa, G. J., Fairstein, R., and Radulescu, R. (eds.), ECAI 2023 - 26th European Conference on Artificial Intelligence, September 30 - October 4, 2023, Kraków, Poland - Including 12th Conference on Prestigious Applications of Intelligent Systems (PAIS 2023), volume 372 of Frontiers in Artificial Intelligence and Applications, pp.  2298–2306. IOS Press, 2023b. doi: 10.3233/FAIA230529. URL https://doi.org/10.3233/FAIA230529.
  38. Harmony: Heterogeneity-aware hierarchical management for federated learning system. In 2022 55th IEEE/ACM International Symposium on Microarchitecture (MICRO), pp.  631–645. IEEE, 2022.
  39. Learn to select: Efficient cross-device federated learning via reinforcement learning. In Maughan, K., Liu, R., and Burns, T. F. (eds.), The First Tiny Papers Track at ICLR 2023, Tiny Papers @ ICLR 2023, Kigali, Rwanda, May 5, 2023. OpenReview.net, 2023. URL https://openreview.net/pdf?id=wecTsVkrjit.
  40. Optimizing federated learning on non-iid data with reinforcement learning. In IEEE INFOCOM 2020-IEEE Conference on Computer Communications, pp.  1698–1707. IEEE, 2020a.
  41. Tackling the objective inconsistency problem in heterogeneous federated optimization. Advances in neural information processing systems, 33:7611–7623, 2020b.
  42. Breaking the memory wall for heterogeneous federated learning with progressive training. arXiv preprint arXiv:2404.13349, 2024.
  43. Experience-driven computational resource allocation of federated learning by deep reinforcement learning. In 2020 IEEE International Parallel and Distributed Processing Symposium (IPDPS), pp.  234–243. IEEE, 2020.
  44. A multi-agent reinforcement learning approach for efficient client selection in federated learning. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 36, pp.  9091–9099, 2022.
  45. Shufflenet: An extremely efficient convolutional neural network for mobile devices. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.  6848–6856, 2018.
  46. Federated learning with non-iid data. arXiv preprint arXiv:1806.00582, 2018.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets