Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
158 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A Comprehensive Survey of Federated Transfer Learning: Challenges, Methods and Applications (2403.01387v1)

Published 3 Mar 2024 in cs.LG and cs.DC

Abstract: Federated learning (FL) is a novel distributed machine learning paradigm that enables participants to collaboratively train a centralized model with privacy preservation by eliminating the requirement of data sharing. In practice, FL often involves multiple participants and requires the third party to aggregate global information to guide the update of the target participant. Therefore, many FL methods do not work well due to the training and test data of each participant may not be sampled from the same feature space and the same underlying distribution. Meanwhile, the differences in their local devices (system heterogeneity), the continuous influx of online data (incremental data), and labeled data scarcity may further influence the performance of these methods. To solve this problem, federated transfer learning (FTL), which integrates transfer learning (TL) into FL, has attracted the attention of numerous researchers. However, since FL enables a continuous share of knowledge among participants with each communication round while not allowing local data to be accessed by other participants, FTL faces many unique challenges that are not present in TL. In this survey, we focus on categorizing and reviewing the current progress on federated transfer learning, and outlining corresponding solutions and applications. Furthermore, the common setting of FTL scenarios, available datasets, and significant related research are summarized in this survey.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (286)
  1. Communication-efficient learning of deep networks from decentralized data. In: Artificial intelligence and statistics. 2017, 1273–1282
  2. Semi-supervised federated heterogeneous transfer learning. Knowledge-Based Systems, 2022, 252: 109384
  3. A survey on federated learning. Knowledge-Based Systems, 2021, 216: 106775
  4. Feddc: Federated learning with non-iid data via local drift decoupling and correction. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2022, 10112–10121
  5. Optimization strategies for client drift in federated learning: A review. Procedia Computer Science, 2022, 214: 1168–1173
  6. Vertical federated learning. arXiv preprint arXiv:2211.12814, 2022
  7. A comprehensive survey on transfer learning. Proceedings of the IEEE, 2020, 109(1): 43–76
  8. Federated machine learning: Concept and applications. ACM Trans. Intell. Syst. Technol., 2019, 10(2)
  9. Challenges, applications and design aspects of federated learning: A survey. IEEE Access, 2021, 9: 124682–124700
  10. From distributed machine learning to federated learning: A survey. Knowledge and Information Systems, 2022, 64(4): 885–917
  11. A survey on federated learning. In: 2020 IEEE 16th International Conference on Control & Automation (ICCA). 2020, 791–796
  12. A survey of incentive mechanism design for federated learning. IEEE Transactions on Emerging Topics in Computing, 2021, 10(2): 1035–1044
  13. A comprehensive survey of privacy-preserving federated learning: A taxonomy, review, and future directions. ACM Computing Surveys (CSUR), 2021, 54(6): 1–36
  14. Threats to federated learning: A survey. arXiv preprint arXiv:2003.02133, 2020
  15. Federated learning in a medical context: a systematic literature review. ACM Transactions on Internet Technology (TOIT), 2021, 21(2): 1–31
  16. Federated learning for smart healthcare: A survey. ACM Computing Surveys (CSUR), 2022, 55(3): 1–37
  17. Federated learning in mobile edge networks: A comprehensive survey. IEEE Communications Surveys & Tutorials, 2020, 22(3): 2031–2063
  18. Federated learning for internet of things: A comprehensive survey. IEEE Communications Surveys & Tutorials, 2021, 23(3): 1622–1658
  19. Federated learning on non-iid data: A survey. Neurocomputing, 2021, 465: 371–390
  20. Towards personalized federated learning. IEEE Transactions on Neural Networks and Learning Systems, 2022
  21. Pan S J, Yang Q. A survey on transfer learning. IEEE Transactions on knowledge and data engineering, 2009, 22(10): 1345–1359
  22. Federated optimization: Distributed machine learning for on-device intelligence. arXiv preprint arXiv:1610.02527, 2016
  23. Domain invariant transfer kernel learning. IEEE Transactions on Knowledge and Data Engineering, 2014, 27(6): 1519–1532
  24. Learning transferable features with deep adaptation networks. In: International conference on machine learning. 2015, 97–105
  25. Bengio Y. Deep learning of representations for unsupervised and transfer learning. In: Proceedings of ICML workshop on unsupervised and transfer learning. 2012, 17–36
  26. Self-taught learning: transfer learning from unlabeled data. In: Proceedings of the 24th international conference on Machine learning. 2007, 759–766
  27. Advances and open problems in federated learning. Foundations and Trends® in Machine Learning, 2021, 14(1–2): 1–210
  28. Younis R, Fisichella M. Fly-smote: Re-balancing the non-iid iot edge devices data in federated learning system. IEEE Access, 2022, 10: 65092–65102
  29. Fedhome: Cloud-edge based personalized federated learning for in-home health monitoring. IEEE Transactions on Mobile Computing, 2020, 21(8): 2818–2832
  30. Communication-efficient on-device machine learning: Federated distillation and augmentation under non-iid private data. arXiv preprint arXiv:1811.11479, 2018
  31. Sample-level data selection for federated learning. In: IEEE INFOCOM 2021-IEEE Conference on Computer Communications. 2021, 1–10
  32. Elastic aggregation for federated optimization. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2023, 12187–12197
  33. Chen H Y, Chao W L. Fedbe: Making bayesian model ensemble applicable to federated learning. arXiv preprint arXiv:2009.01974, 2020
  34. 16 federated knowledge distillation. Machine Learning and Wireless Communications, 2022, 457
  35. Geodesic flow kernel for unsupervised domain adaptation. In: 2012 IEEE conference on computer vision and pattern recognition. 2012, 2066–2073
  36. Moment matching for multi-source domain adaptation. In: Proceedings of the IEEE/CVF international conference on computer vision. 2019, 1406–1415
  37. The open images dataset v4: Unified image classification, object detection, and visual relationship detection at scale. International Journal of Computer Vision, 2020, 128(7): 1956–1981
  38. Federated feature selection for cyber-physical systems of systems. IEEE Transactions on Vehicular Technology, 2022, 71(9): 9937–9950
  39. Cinic-10 is not imagenet or cifar-10. arXiv preprint arXiv:1810.03505, 2018
  40. Deep learning face attributes in the wild. In: Proceedings of the IEEE international conference on computer vision. 2015, 3730–3738
  41. Adaptive federated optimization. arXiv preprint arXiv:2003.00295, 2020
  42. Federated semi-supervised medical image classification via inter-client relation matching. In: Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part III 24. 2021, 325–335
  43. Clustered federated learning: Model-agnostic distributed multitask optimization under privacy constraints. IEEE transactions on neural networks and learning systems, 2020, 32(8): 3710–3722
  44. Collaborative federated learning for healthcare: Multi-modal covid-19 diagnosis at the edge. IEEE Open Journal of the Computer Society, 2022, 3: 172–184
  45. Three approaches for personalization with applications to federated learning. arXiv preprint arXiv:2002.10619, 2020
  46. Patient clustering improves efficiency of federated machine learning to predict mortality and hospital stay time using distributed electronic medical records. Journal of biomedical informatics, 2019, 99: 103291
  47. Clusterfl: A clustering-based federated learning system for human activity recognition. ACM Transactions on Sensor Networks, 2022, 19(1): 1–32
  48. Self-balancing federated learning with global imbalanced data in mobile systems. IEEE Transactions on Parallel and Distributed Systems, 2020, 32(1): 59–71
  49. Federated feature selection for horizontal federated learning in iot networks. IEEE Internet of Things Journal, 2023
  50. A federated feature selection algorithm based on particle swarm optimization under privacy protection. Knowledge-Based Systems, 2023, 260: 110122
  51. Federated semi-supervised learning with inter-client consistency & disjoint learning. arXiv preprint arXiv:2006.12097, 2020
  52. Learning to collaborate in decentralized learning of personalized models. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022, 9766–9775
  53. Fedsampling: A better sampling strategy for federated learning. arXiv preprint arXiv:2306.14245, 2023
  54. A joint learning and communications framework for federated learning over wireless networks. IEEE Transactions on Wireless Communications, 2020, 20(1): 269–283
  55. Auction: Automated and quality-aware client selection framework for efficient federated learning. IEEE Transactions on Parallel and Distributed Systems, 2021, 33(8): 1996–2009
  56. Age-based scheduling policy for federated learning in mobile edge networks. In: ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 2020, 8743–8747
  57. An online learning approach for client selection in federated edge learning under budget constraint. In: Proceedings of the 51st International Conference on Parallel Processing. 2022, 1–11
  58. Communication-efficient federated learning via knowledge distillation. Nature communications, 2022, 13(1): 2032
  59. Data selection for federated learning with relevant and irrelevant data at clients. ArXiv, 2020, abs/2001.08300
  60. Fedgroup: Efficient clustered federated learning via decomposed data-driven measure. arXiv preprint arXiv:2010.06870, 2020
  61. Nagalapatti L, Narayanam R. Game of gradients: Mitigating irrelevant clients in federated learning. In: Proceedings of the AAAI Conference on Artificial Intelligence. 2021, 9046–9054
  62. Fedmix: Approximation of mixup under mean augmented federated learning. arXiv preprint arXiv:2107.00233, 2021
  63. Towards fair federated learning with zero-shot data augmentation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2021, 3310–3319
  64. Think locally, act globally: Federated learning with local and global representations. arXiv preprint arXiv:2001.01523, 2020
  65. Federated learning with hierarchical clustering of local updates to improve training on non-iid data. In: 2020 International Joint Conference on Neural Networks (IJCNN). 2020, 1–9
  66. Pfa: Privacy-preserving federated adaptation for effective model personalization. In: Proceedings of the Web Conference 2021. 2021, 923–934
  67. Fedproto: Federated prototype learning across heterogeneous clients. In: Proceedings of the AAAI Conference on Artificial Intelligence. 2022, 8432–8440
  68. Federated mutual learning. arXiv preprint arXiv:2006.16765, 2020
  69. Federated learning with personalization layers. arXiv preprint arXiv:1912.00818, 2019
  70. Personalized federated learning with theoretical guarantees: A model-agnostic meta-learning approach. Advances in Neural Information Processing Systems, 2020, 33: 3557–3568
  71. Federated learning: Challenges, methods, and future directions. IEEE signal processing magazine, 2020, 37(3): 50–60
  72. Adaptive personalized federated learning. arXiv preprint arXiv:2003.13461, 2020
  73. Personalized federated learning with moreau envelopes. Advances in Neural Information Processing Systems, 2020, 33: 21394–21405
  74. Hanzely F, Richtárik P. Federated learning of a mixture of global and local models. arXiv preprint arXiv:2002.05516, 2020
  75. Federated learning with proximal stochastic variance reduced gradient algorithms. In: Proceedings of the 49th International Conference on Parallel Processing. 2020, 1–11
  76. Lower bounds and optimal algorithms for personalized federated learning. Advances in Neural Information Processing Systems, 2020, 33: 2304–2315
  77. Ditto: Fair and robust federated learning through personalization. In: International Conference on Machine Learning. 2021, 6357–6368
  78. Scaffold: Stochastic controlled averaging for federated learning. In: International conference on machine learning. 2020, 5132–5143
  79. Fast-convergent federated learning with class-weighted aggregation. Journal of Systems Architecture, 2021, 117: 102125
  80. Exploiting shared representations for personalized federated learning. In: International conference on machine learning. 2021, 2089–2099
  81. Fedbabu: Towards enhanced representation for federated image classification. arXiv preprint arXiv:2106.06042, 2021
  82. Fedclassavg: Local representation learning for personalized federated learning on heterogeneous neural networks. In: Proceedings of the 51st International Conference on Parallel Processing. 2022, 1–10
  83. Collaborative unsupervised visual representation learning from decentralized data. In: Proceedings of the IEEE/CVF international conference on computer vision. 2021, 4912–4921
  84. How to prevent the poor performance clients for personalized federated learning? In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2023, 12167–12176
  85. Flexifed: Personalized federated learning for edge clients with heterogeneous model architectures. In: Proceedings of the ACM Web Conference 2023. 2023, 2979–2990
  86. Fedmask: Joint computation and communication-efficient personalized federated learning via heterogeneous masking. In: Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems. 2021, 42–55
  87. Yang Z, Sun Q. Personalized heterogeneity-aware federated search towards better accuracy and energy efficiency. In: Proceedings of the 41st IEEE/ACM International Conference on Computer-Aided Design. 2022, 1–9
  88. Heterofl: Computation and communication efficient federated learning for heterogeneous clients. arXiv preprint arXiv:2010.01264, 2020
  89. Fedcav: contribution-aware model aggregation on distributed heterogeneous data in federated learning. In: Proceedings of the 50th International Conference on Parallel Processing. 2021, 1–10
  90. Confidence-aware personalized federated learning via variational expectation maximization. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2023, 24542–24551
  91. Federated learning with positive and unlabeled data. In: International Conference on Machine Learning. 2022, 13344–13355
  92. Implicit model specialization through dag-based decentralized federated learning. In: Proceedings of the 22nd International Middleware Conference. 2021, 310–322
  93. Personalized federated learning with first order model optimization. arXiv preprint arXiv:2012.08565, 2020
  94. Feddwa: Personalized federated learning with dynamic weight adjustment. In: 32nd International Joint Conference on Artificial Intelligence, IJCAI 2023. 2023, 3993–4001
  95. Optimizing federated learning on non-iid data with reinforcement learning. In: IEEE INFOCOM 2020-IEEE Conference on Computer Communications. 2020, 1698–1707
  96. Nishio T, Yonetani R. Client selection for federated learning with heterogeneous resources in mobile edge. In: ICC 2019-2019 IEEE international conference on communications (ICC). 2019, 1–7
  97. Cmfl: Mitigating communication overhead for federated learning. In: 2019 IEEE 39th international conference on distributed computing systems (ICDCS). 2019, 954–964
  98. Multi-armed bandit-based client scheduling for federated learning. IEEE Transactions on Wireless Communications, 2020, 19(11): 7108–7123
  99. Federated learning with class imbalance reduction. In: 2021 29th European Signal Processing Conference (EUSIPCO). 2021, 2174–2178
  100. Tifl: A tier-based federated learning system. In: Proceedings of the 29th international symposium on high-performance parallel and distributed computing. 2020, 125–136
  101. Fedsae: A novel self-adaptive federated learning framework in heterogeneous systems. In: 2021 International Joint Conference on Neural Networks (IJCNN). 2021, 1–10
  102. Aergia: leveraging heterogeneity in federated learning systems. In: Proceedings of the 23rd ACM/IFIP International Middleware Conference. 2022, 107–120
  103. Federated class-incremental learning. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2022, 10164–10173
  104. Architecture agnostic federated learning for neural networks. In: International Conference on Machine Learning. 2022, 14860–14870
  105. Personalized cross-silo federated learning on non-iid data. In: Proceedings of the AAAI conference on artificial intelligence. 2021, 7865–7873
  106. Fednkd: A dependable federated learning using fine-tuned random noise and knowledge distillation. In: Proceedings of the 2022 International Conference on Multimedia Retrieval. 2022, 185–193
  107. Fedat: A high-performance and communication-efficient federated learning system with asynchronous tiers. In: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis. 2021, 1–16
  108. Spread: Decentralized model aggregation for scalable federated learning. In: Proceedings of the 51st International Conference on Parallel Processing. 2022, 1–12
  109. Personalized federated learning via variational bayesian inference. In: International Conference on Machine Learning. 2022, 26293–26310
  110. Feddrl: Deep reinforcement learning-based adaptive aggregation for non-iid data in federated learning. In: Proceedings of the 51st International Conference on Parallel Processing. 2022, 1–11
  111. Federated continual learning with weighted inter-client transfer. In: International Conference on Machine Learning. 2021, 12073–12086
  112. Context-aware online client selection for hierarchical federated learning. IEEE Transactions on Parallel and Distributed Systems, 2022, 33(12): 4353–4367
  113. Personalized federated learning through local memorization. In: International Conference on Machine Learning. 2022, 15070–15092
  114. Few-shot model agnostic federated learning. In: Proceedings of the 30th ACM International Conference on Multimedia. 2022, 7309–7316
  115. Distillation-based semi-supervised federated learning for communication-efficient collaborative training with non-iid private data. IEEE Transactions on Mobile Computing, 2021, 22(1): 191–205
  116. Towards data-independent knowledge transfer in model-heterogeneous federated learning. IEEE Transactions on Computers, 2023
  117. Divergence-aware federated self-supervised learning. arXiv preprint arXiv:2204.04385, 2022
  118. Fedftha: a fine-tuning and head aggregation method in federated learning. IEEE Internet of Things Journal, 2023
  119. Preserving privacy in federated learning with ensemble cross-domain knowledge distillation. In: Proceedings of the AAAI Conference on Artificial Intelligence. 2022, 11891–11899
  120. Ensemble distillation for robust model fusion in federated learning. Advances in Neural Information Processing Systems, 2020, 33: 2351–2363
  121. Semifed: Semi-supervised federated learning with consistency and pseudo-labeling. arXiv preprint arXiv:2108.09412, 2021
  122. Orchestra: Unsupervised federated learning via globally consistent clustering. arXiv preprint arXiv:2205.11506, 2022
  123. Rscfed: Random sampling consensus federated semi-supervised learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022, 10154–10163
  124. Class balanced adaptive pseudo labeling for federated semi-supervised learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2023, 16292–16301
  125. Fedzkt: Zero-shot knowledge transfer towards resource-constrained federated learning with heterogeneous on-device models. In: 2022 IEEE 42nd International Conference on Distributed Computing Systems (ICDCS). 2022, 928–938
  126. Zhou T, Konukoglu E. Fedfa: Federated feature augmentation. arXiv preprint arXiv:2301.12995, 2023
  127. Neural tangent kernel empowered federated learning. In: International Conference on Machine Learning. 2022, 25783–25803
  128. Multi-center federated learning: clients clustering for better personalization. World Wide Web, 2023, 26(1): 481–500
  129. Model-contrastive federated learning. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2021, 10713–10722
  130. Chen H Y, Chao W L. On bridging generic and personalized federated learning for image classification. arXiv preprint arXiv:2107.00778, 2021
  131. Yao X, Sun L. Continual local training for better initialization of federated models. In: 2020 IEEE International Conference on Image Processing (ICIP). 2020, 1736–1740
  132. Tackling the objective inconsistency problem in heterogeneous federated optimization. Advances in neural information processing systems, 2020, 33: 7611–7623
  133. Spatl: salient parameter aggregation and transfer learning for heterogeneous federated learning. In: SC22: International Conference for High Performance Computing, Networking, Storage and Analysis. 2022, 1–14
  134. Completely heterogeneous federated learning. arXiv preprint arXiv:2210.15865, 2022
  135. Scalefl: Resource-adaptive federated learning with heterogeneous clients. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2023, 24532–24541
  136. Deep neural network fusion via graph matching with applications to model ensemble and federated learning. In: International Conference on Machine Learning. 2022, 13857–13869
  137. Client selection in federated learning: Convergence analysis and power-of-choice selection strategies. arXiv preprint arXiv:2010.01243, 2020
  138. An efficiency-boosting client selection scheme for federated learning with fairness guarantee. IEEE Transactions on Parallel and Distributed Systems, 2020, 32(7): 1552–1564
  139. Dafkd: Domain-aware federated knowledge distillation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2023, 20412–20421
  140. Federated learning with privacy-preserving ensemble attention distillation. IEEE Transactions on Medical Imaging, 2022
  141. Practical one-shot federated learning for cross-silo setting. arXiv preprint arXiv:2010.01017, 2020
  142. Communication-efficient federated distillation. arXiv preprint arXiv:2012.00632, 2020
  143. Data-free knowledge distillation for heterogeneous federated learning. In: International conference on machine learning. 2021, 12878–12889
  144. Fine-tuning global model via data-free knowledge distillation for non-iid federated learning. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2022, 10174–10183
  145. Fedack: Federated adversarial contrastive knowledge distillation for cross-lingual and cross-model social bot detection. In: Proceedings of the ACM Web Conference 2023. 2023, 1314–1323
  146. Fedhisyn: A hierarchical synchronous federated learning framework for resource and data heterogeneity. In: Proceedings of the 51st International Conference on Parallel Processing. 2022, 1–11
  147. Fedx: Unsupervised federated learning with cross knowledge distillation. In: European Conference on Computer Vision. 2022, 691–707
  148. Pyramidfl: A fine-grained client selection framework for efficient federated learning. In: Proceedings of the 28th Annual International Conference on Mobile Computing And Networking. 2022, 158–171
  149. Dubhe: Towards data unbiasedness with homomorphic encryption in federated learning client selection. In: Proceedings of the 50th International Conference on Parallel Processing. 2021, 1–10
  150. Fraug: Tackling federated learning with non-iid features via representation augmentation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. 2023, 4849–4859
  151. Feddg: Federated domain generalization on medical image segmentation via episodic learning in continuous frequency space. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2021, 1013–1023
  152. Fedbn: Federated learning on non-iid features via local batch normalization. arXiv preprint arXiv:2102.07623, 2021
  153. Federated semi-supervised learning for covid region segmentation in chest ct using multi-national data from china, italy, japan. Medical image analysis, 2021, 70: 101992
  154. Fedkc: Federated knowledge composition for multilingual natural language understanding. In: Proceedings of the ACM Web Conference 2022. 2022, 1839–1850
  155. Federated evaluation of on-device personalization. arXiv preprint arXiv:1910.10252, 2019
  156. Federated learning with partial model personalization. In: International Conference on Machine Learning. 2022, 17716–17758
  157. Hermes: an efficient federated learning framework for heterogeneous mobile clients. In: Proceedings of the 27th Annual International Conference on Mobile Computing and Networking. 2021, 420–437
  158. Joint optimization in edge-cloud continuum for federated unsupervised person re-identification. In: Proceedings of the 29th ACM International Conference on Multimedia. 2021, 433–441
  159. Federated domain generalization with generalization adjustment. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2023, 3954–3963
  160. Ruan Y, Joe-Wong C. Fedsoft: Soft clustered federated learning with proximal local updating. In: Proceedings of the AAAI Conference on Artificial Intelligence. 2022, 8124–8131
  161. Federated node classification over graphs with latent link-type heterogeneity. In: Proceedings of the ACM Web Conference 2023. 2023, 556–566
  162. Donahue K, Kleinberg J. Optimality and stability in federated learning: A game-theoretic approach. Advances in Neural Information Processing Systems, 2021, 34: 1287–1298
  163. Federated bayesian optimization via thompson sampling. Advances in Neural Information Processing Systems, 2020, 33: 9687–9699
  164. Li D, Wang J. Fedmd: Heterogenous federated learning via model distillation. arXiv preprint arXiv:1910.03581, 2019
  165. Fedh2l: Federated learning with model and statistical heterogeneity. arXiv preprint arXiv:2101.11296, 2021
  166. Fedcg: Leverage conditional gan for protecting privacy and maintaining competitive performance in federated learning. arXiv preprint arXiv:2111.08211, 2021
  167. Mckd: Mutually collaborative knowledge distillation for federated domain adaptation and generalization. In: ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 2023, 1–5
  168. Rethinking federated learning with domain shift: A prototype view. In: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2023, 16312–16322
  169. Federated learning with matched averaging. arXiv preprint arXiv:2002.06440, 2020
  170. An efficient framework for clustered federated learning. Advances in Neural Information Processing Systems, 2020, 33: 19586–19597
  171. Feddl: Federated learning via dynamic layer sharing for human activity recognition. In: Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems. 2021, 15–28
  172. Donahue K, Kleinberg J. Model-sharing games: Analyzing federated learning under voluntary participation. In: Proceedings of the AAAI Conference on Artificial Intelligence. 2021, 5303–5311
  173. Privacy-preserving heterogeneous federated transfer learning. In: 2019 IEEE international conference on big data (Big Data). 2019, 2552–2559
  174. Privacy-preserving federated adversarial domain adaptation over feature groups for interpretability. IEEE Transactions on Big Data, 2022
  175. Feast: A communication-efficient federated feature selection framework for relational data. Proceedings of the ACM on Management of Data, 2023, 1(1): 1–28
  176. Fed-fis: A novel information-theoretic federated feature selection for learning stability. In: International Conference on Neural Information Processing. 2021, 480–487
  177. Practical vertical federated learning with unsupervised representation learning. IEEE Transactions on Big Data, 2022
  178. A hybrid self-supervised learning framework for vertical federated learning. arXiv preprint arXiv:2208.08934, 2022
  179. Feng S, Yu H. Multi-participant multi-class vertical federated learning. arXiv preprint arXiv:2001.11154, 2020
  180. Feng S. Vertical federated learning-based feature selection with non-overlapping sample utilization. Expert Systems with Applications, 2022, 208: 118097
  181. Vf-ps: How to select important participants in vertical federated learning, efficiently and securely? Advances in Neural Information Processing Systems, 2022, 35: 2088–2101
  182. Less-vfl: Communication-efficient feature selection for vertical federated learning. arXiv preprint arXiv:2305.02219, 2023
  183. Towards taming the resource and data heterogeneity in federated learning. In: 2019 USENIX conference on operational machine learning (OpML 19). 2019, 19–21
  184. Heterogeneous federated learning: State-of-the-art and research challenges. ACM Computing Surveys, 2023, 56(3): 1–44
  185. Codedpaddedfl and codedsecagg: Straggler mitigation and secure aggregation in federated learning. IEEE Transactions on Communications, 2023
  186. Incremental learning meets transfer learning: Application to multi-site prostate mri segmentation. In: International Workshop on Distributed, Collaborative, and Federated Learning. 2022, 3–16
  187. Fedhealth: A federated transfer learning framework for wearable healthcare. IEEE Intelligent Systems, 2020, 35(4): 83–93
  188. Ditzler G, Polikar R. Incremental learning of concept drift from streaming imbalanced data. IEEE transactions on knowledge and data engineering, 2012, 25(10): 2283–2301
  189. Elwell R, Polikar R. Incremental learning of concept drift in nonstationary environments. IEEE Transactions on Neural Networks, 2011, 22(10): 1517–1531
  190. Incremental learning of multi-domain image-to-image translations. IEEE Transactions on Circuits and Systems for Video Technology, 2020, 31(4): 1526–1539
  191. A survey of incremental transfer learning: Combining peer-to-peer federated learning and domain incremental learning for multicenter collaboration. arXiv preprint arXiv:2309.17192, 2023
  192. Using domain adaptation for incremental svm classification of drift data. Mathematics, 2022, 10(19): 3579
  193. Fedrolex: Model-heterogeneous federated learning with rolling sub-model extraction. Advances in Neural Information Processing Systems, 2022, 35: 29677–29690
  194. Heterogeneous federated learning. arXiv preprint arXiv:2008.06767, 2020
  195. Towards utilizing unlabeled data in federated learning: A survey and prospective. arXiv preprint arXiv:2002.11545, 2020
  196. Semifl: Semi-supervised federated learning for unlabeled clients with alternate training. In: Koyejo S, Mohamed S, Agarwal A, Belgrave D, Cho K, Oh A, eds, Advances in Neural Information Processing Systems. 2022, 17871–17884
  197. Smote: synthetic minority over-sampling technique. Journal of artificial intelligence research, 2002, 16: 321–357
  198. Adasyn: Adaptive synthetic sampling approach for imbalanced learning. In: 2008 IEEE international joint conference on neural networks (IEEE world congress on computational intelligence). 2008, 1322–1328
  199. Borderline-smote: a new over-sampling method in imbalanced data sets learning. In: International conference on intelligent computing. 2005, 878–887
  200. Addressing the curse of imbalanced training sets: one-sided selection. In: Icml. 1997, 179
  201. Yen S J, Lee Y S. Cluster-based under-sampling approaches for imbalanced data distributions. Expert Systems with Applications, 2009, 36(3): 5718–5727
  202. Under-sampling class imbalanced datasets by combining clustering analysis and instance selection. Information Sciences, 2019, 477: 47–54
  203. Crowdbuy: Privacy-friendly image dataset purchasing via crowdsourcing. In: IEEE INFOCOM 2018-IEEE Conference on Computer Communications. 2018, 2735–2743
  204. Todqa: Efficient task-oriented data quality assessment. In: 2019 15th International Conference on Mobile Ad-Hoc and Sensor Networks (MSN). 2019, 81–88
  205. Katharopoulos A, Fleuret F. Not all samples are created equal: Deep learning with importance sampling. In: International conference on machine learning. 2018, 2525–2534
  206. Variance reduction in sgd by distributed importance sampling. arXiv preprint arXiv:1511.06481, 2015
  207. Loshchilov I, Hutter F. Online batch selection for faster training of neural networks. arXiv preprint arXiv:1511.06343, 2015
  208. Prioritized experience replay. arXiv preprint arXiv:1511.05952, 2015
  209. Sampling matters in deep embedding learning. In: Proceedings of the IEEE international conference on computer vision. 2017, 2840–2848
  210. Fedbalancer: data and pace control for efficient federated learning on heterogeneous clients. In: Proceedings of the 20th Annual International Conference on Mobile Systems, Applications and Services. 2022, 436–449
  211. Li K, Xiao C. Cbfl: a communication-efficient federated learning framework from data redundancy perspective. IEEE Systems Journal, 2021, 16(4): 5572–5583
  212. Domain adaptation from multiple sources via auxiliary classifiers. In: Proceedings of the 26th annual international conference on machine learning. 2009, 289–296
  213. Domain adaptation from multiple sources: A domain-dependent regularization approach. IEEE Transactions on neural networks and learning systems, 2012, 23(3): 504–518
  214. Cross-domain learning from multiple sources: A consensus regularization perspective. IEEE Transactions on Knowledge and Data Engineering, 2009, 22(12): 1664–1678
  215. Transfer learning from multiple source domains via consensus regularization. In: Proceedings of the 17th ACM conference on Information and knowledge management. 2008, 103–112
  216. Federated optimization in heterogeneous networks. Proceedings of Machine learning and systems, 2020, 2: 429–450
  217. Overcoming catastrophic forgetting in neural networks. Proceedings of the national academy of sciences, 2017, 114(13): 3521–3526
  218. The devil is the classifier: Investigating long tail relation classification with decoupling analysis. arXiv preprint arXiv:2009.07022, 2020
  219. Decoupling representation and classifier for long-tailed recognition. arXiv preprint arXiv:1910.09217, 2019
  220. How transferable are features in deep neural networks? Advances in neural information processing systems, 2014, 27
  221. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805, 2018
  222. On the convergence of fedavg on non-iid data. arXiv preprint arXiv:1907.02189, 2019
  223. Federated learning with data-agnostic distribution fusion. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2023, 8074–8083
  224. Feature selection using stochastic gates. In: International Conference on Machine Learning. 2020, 10648–10659
  225. Domain generalization with mixstyle. arXiv preprint arXiv:2104.02008, 2021
  226. Feature-distribution perturbation and calibration for generalized person reid. arXiv preprint arXiv:2205.11197, 2022
  227. Huang X, Belongie S. Arbitrary style transfer in real-time with adaptive instance normalization. In: Proceedings of the IEEE international conference on computer vision. 2017, 1501–1510
  228. Co-mda: Federated multi-source domain adaptation on black-box models. IEEE Transactions on Circuits and Systems for Video Technology, 2023
  229. Co-teaching: Robust training of deep neural networks with extremely noisy labels. Advances in neural information processing systems, 2018, 31
  230. Federated many-task bayesian optimization. IEEE Transactions on Evolutionary Computation, 2023
  231. Differentially private federated bayesian optimization with distributed exploration. Advances in Neural Information Processing Systems, 2021, 34: 9125–9139
  232. A secure federated transfer learning framework. IEEE Intelligent Systems, 2020, 35(4): 70–82
  233. Fedsteg: A federated transfer learning framework for secure image steganalysis. IEEE Transactions on Network Science and Engineering, 2020, 8(2): 1084–1094
  234. Deep feature selection: theory and application to identify enhancers and promoters. Journal of Computational Biology, 2016, 23(5): 322–336
  235. Learning sparse neural networks through l⁢_⁢0𝑙_0l\_0italic_l _ 0 regularization. arXiv preprint arXiv:1712.01312, 2017
  236. Pilla L L. Optimal task assignment for heterogeneous federated learning devices. In: 2021 IEEE International Parallel and Distributed Processing Symposium (IPDPS). 2021, 661–670
  237. Bitwidth heterogeneous federated learning with progressive weight dequantization. In: International Conference on Machine Learning. 2022, 25552–25565
  238. Draftfed: A draft-based personalized federated learning approach for heterogeneous convolutional neural networks. IEEE Transactions on Mobile Computing, 2023
  239. Feature correlation-guided knowledge transfer for federated self-supervised learning. arXiv preprint arXiv:2211.07364, 2022
  240. Cronus: Robust and heterogeneous collaborative learning with black-box knowledge transfer. arXiv preprint arXiv:1912.11279, 2019
  241. Towards federated unsupervised representation learning. In: Proceedings of the third ACM international workshop on edge systems, analytics and networking. 2020, 31–36
  242. Federated unsupervised representation learning. arXiv e-prints, 2020, arXiv–2010
  243. Exploiting aesthetic preference in deep cross networks for cross-domain recommendation. In: Proceedings of The Web Conference 2020. 2020, 2768–2774
  244. Li P, Tuzhilin A. Ddtcdr: Deep dual transfer cross domain recommendation. In: Proceedings of the 13th International Conference on Web Search and Data Mining. 2020, 331–339
  245. Federated collaborative filtering for privacy-preserving personalized recommendation system. arXiv preprint arXiv:1901.09888, 2019
  246. Stronger privacy for federated collaborative filtering with implicit feedback. In: Proceedings of the 15th ACM Conference on Recommender Systems. 2021, 342–350
  247. Secure federated matrix factorization. IEEE Intelligent Systems, 2020, 36(5): 11–20
  248. Federated matrix factorization for privacy-preserving recommender systems. Applied Soft Computing, 2021, 111: 107700
  249. Federated matrix factorization with privacy guarantee. Proceedings of the VLDB Endowment, 2021, 15(4)
  250. Fedgnn: Federated graph neural network for privacy-preserving recommendation. arXiv preprint arXiv:2102.04925, 2021
  251. Dual personalization on federated recommendation. arXiv preprint arXiv:2301.08143, 2023
  252. Hierarchical personalized federated learning for user modeling. In: Proceedings of the Web Conference 2021. 2021, 957–968
  253. Fedcdr: federated cross-domain recommendation for privacy-preserving rating prediction. In: Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 2022, 2179–2188
  254. Personalized federated recommendation via joint representation learning, user clustering, and model adaptation. In: Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 2022, 4289–4293
  255. Secure, privacy-preserving and federated machine learning in medical imaging. Nature Machine Intelligence, 2020, 2(6): 305–311
  256. Feded: Federated learning via ensemble distillation for medical relation extraction. In: Proceedings of the 2020 conference on empirical methods in natural language processing (EMNLP). 2020, 2118–2128
  257. Federated learning in distributed medical databases: Meta-analysis of large-scale subcortical brain data. In: 2019 IEEE 16th international symposium on biomedical imaging (ISBI 2019). 2019, 270–274
  258. Cross-cluster federated learning and blockchain for internet of medical things. IEEE Internet of Things Journal, 2021, 8(21): 15776–15784
  259. Auto-fedavg: learnable federated averaging for multi-institutional medical image segmentation. arXiv preprint arXiv:2104.10195, 2021
  260. Fair federated medical image segmentation via client contribution estimation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2023, 16302–16311
  261. Federated learning based on dynamic regularization. arXiv preprint arXiv:2111.04263, 2021
  262. Personalized retrogress-resilient federated learning toward imbalanced medical data. IEEE Transactions on Medical Imaging, 2022, 41(12): 3663–3674
  263. Closing the generalization gap of cross-silo federated medical image segmentation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022, 20866–20875
  264. Iop-fl: Inside-outside personalization for federated medical image segmentation. IEEE Transactions on Medical Imaging, 2023
  265. Feddp: Dual personalization in federated medical image segmentation. IEEE Transactions on Medical Imaging, 2023
  266. Federated learning and differential privacy for medical image analysis. Scientific reports, 2022, 12(1): 1953
  267. Federated contrastive learning for volumetric medical image segmentation. In: Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part III 24. 2021, 367–377
  268. Li Y, Wen G. Research and practice of financial credit risk management based on federated learning. Engineering Letters, 2023, 31(1)
  269. Mses credit risk assessment model based on federated learning and feature selection. Computers, Materials & Continua, 2023, 75(3)
  270. Federated learning for credit risk assessment. In: Proceedings of the 56th Hawaii International Conference on System Sciences. 2023,  10
  271. Ffd: A federated learning based method for credit card fraud detection. In: Big Data–BigData 2019: 8th International Congress, Held as Part of the Services Conference Federation, SCF 2019, San Diego, CA, USA, June 25–30, 2019, Proceedings 8. 2019, 18–32
  272. A novel federated learning approach with knowledge transfer for credit scoring. Decision Support Systems, 2024, 177: 114084
  273. A federated learning-enabled predictive analysis to forecast stock market trends. Journal of Ambient Intelligence and Humanized Computing, 2023, 14(4): 4529–4535
  274. Multi-participant vertical federated learning based time series prediction. In: Proceedings of the 8th International Conference on Computing and Artificial Intelligence. 2022, 165–171
  275. Reduction in data imbalance for client-side training in federated learning for the prediction of stock market prices. Journal of Sensor and Actuator Networks, 2023, 13(1): 1
  276. Robust collaborative fraudulent transaction detection using federated learning. In: 2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA). 2021, 373–378
  277. Starlit: Privacy-preserving federated learning to enhance financial fraud detection. arXiv preprint arXiv:2401.10765, 2024
  278. Privacy-preserving traffic flow prediction: A federated learning approach. IEEE Internet of Things Journal, 2020, 7(8): 7751–7763
  279. Dual attention-based federated learning for wireless traffic prediction. In: IEEE INFOCOM 2021-IEEE conference on computer communications. 2021, 1–10
  280. Multi-task federated learning for traffic prediction and its application to route planning. In: 2021 IEEE Intelligent Vehicles Symposium (IV). 2021, 451–457
  281. A communication-efficient federated learning scheme for iot-based traffic forecasting. IEEE Internet of Things Journal, 2021, 9(14): 11918–11931
  282. Fedagcn: A traffic flow prediction framework based on federated learning and asynchronous graph convolutional network. Applied Soft Computing, 2023, 138: 110175
  283. Multi-slice privacy-aware traffic forecasting at ran level: A scalable federated-learning approach. IEEE Transactions on Network and Service Management, 2023
  284. Short-term traffic flow prediction based on graph convolutional networks and federated learning. IEEE Transactions on Intelligent Transportation Systems, 2022, 24(1): 1191–1203
  285. Efficient wireless traffic prediction at the edge: A federated meta-learning approach. IEEE Communications Letters, 2022, 26(7): 1573–1577
  286. A federated learning-based framework for ride-sourcing traffic demand prediction. IEEE Transactions on Vehicular Technology, 2023
Citations (6)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now