Where to Begin? From Random to Foundation Model Instructed Initialization in Federated Learning for Medical Image Segmentation
Abstract: In medical image analysis, Federated Learning (FL) stands out as a key technology that enables privacy-preserved, decentralized data processing, crucial for handling sensitive medical data. Currently, most FL models employ random initialization, which has been proven effective in various instances. However, given the unique challenges posed by non-IID (independently and identically distributed) data in FL, we propose a novel perspective: exploring the impact of using the foundation model with enormous pre-trained knowledge, such as the Segment Anything Model (SAM), as an instructive teacher for FL model initialization in medical image segmentation task. This work for the first time attempts to utilize the foundation model as an instructive teacher for initialization in FL, assessing its impact on the performance of FL models, especially in non-IID data scenarios. Our empirical evaluation on chest x-ray lung segmentation showcases that FL with foundation model instructed initialization not only achieves faster convergence but also improves performance in complex data contexts. These findings offer a new perspective for model initialization in FL.
- “Deep learning-based automated left ventricular ejection fraction assessment using 2-d echocardiography,” American Journal of Physiology-Heart and Circulatory Physiology, vol. 321, no. 2, pp. H390–H399, 2021.
- “Mv-ran: Multiview recurrent aggregation network for echocardiographic sequences segmentation and full cardiac cycle analysis,” Computers in biology and medicine, vol. 120, pp. 103728, 2020.
- “Recurrent aggregation learning for multi-view echocardiographic sequences segmentation,” in Medical Image Computing and Computer Assisted Intervention–MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part II 22. Springer, 2019, pp. 678–686.
- “Communication-efficient learning of deep networks from decentralized data,” in Artificial intelligence and statistics. PMLR, 2017, pp. 1273–1282.
- “Data-free distillation improves efficiency and privacy in federated thorax disease analysis,” arXiv preprint arXiv:2310.18346, 2023.
- “Holistic and deep feature pyramids for saliency detection.,” in BMVC, 2018, vol. 67.
- “Unified model for interpreting multi-view echocardiographic sequences without temporal information,” Applied Soft Computing, vol. 88, pp. 106049, 2020.
- “Knowledge distillation with segment anything (sam) model for planetary geological mapping,” arXiv preprint arXiv:2305.07586, 2023.
- “Segment anything model is a good teacher for local feature learning,” arXiv preprint arXiv:2309.16992, 2023.
- “On the opportunities and risks of foundation models,” arXiv preprint arXiv:2108.07258, 2021.
- “Segment anything,” arXiv:2304.02643, 2023.
- “On the importance and applicability of pre-training for federated learning,” in The Eleventh International Conference on Learning Representations, 2023.
- “Where to begin? on the impact of pre-training and initialization in federated learning,” in The Eleventh International Conference on Learning Representations, 2023.
- “Sam-med2d,” arXiv preprint arXiv:2308.16184, 2023.
- “Distilling the knowledge in a neural network,” arXiv preprint arXiv:1503.02531, 2015.
- “Explainable covid-19 infections identification and delineation using calibrated pseudo labels,” IEEE Transactions on Emerging Topics in Computational Intelligence, vol. 7, no. 1, pp. 26–35, 2022.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.
