Multi-organ Self-supervised Contrastive Learning for Breast Lesion Segmentation (2402.14114v1)
Abstract: Self-supervised learning has proven to be an effective way to learn representations in domains where annotated labels are scarce, such as medical imaging. A widely adopted framework for this purpose is contrastive learning and it has been applied to different scenarios. This paper seeks to advance our understanding of the contrastive learning framework by exploring a novel perspective: employing multi-organ datasets for pre-training models tailored to specific organ-related target tasks. More specifically, our target task is breast tumour segmentation in ultrasound images. The pre-training datasets include ultrasound images from other organs, such as the lungs and heart, and large datasets of natural images. Our results show that conventional contrastive learning pre-training improves performance compared to supervised baseline approaches. Furthermore, our pre-trained models achieve comparable performance when fine-tuned with only half of the available labelled data. Our findings also show the advantages of pre-training on diverse organ data for improving performance in the downstream task.
- Dataset of breast ultrasound images. Data in Brief 2020 .
- Development of a deep-learning-based method for breast ultrasound image segmentation, in: 17th IEEE International Conference on Machine Learning and Applications, ICMLA 2018.
- Self-supervised learning for cardiac MR image segmentation by anatomical position prediction, in: MICCAI 2019.
- Breast lesion segmentation in ultrasound images with limited annotated data, in: 17th IEEE International Symposium on Biomedical Imaging, ISBI 2020.
- L2 accelerating covid-19 differential diagnosis with explainable ultrasound image analysis: an ai tool. Thorax .
- Accelerating detection of lung pathologies with explainable ultrasound image analysis. Applied Sciences .
- Breast mass segmentation in ultrasound with selective kernel u-net convolutional neural network. Biomedical Signal Processing and Control .
- Contrastive learning of global and local features for medical image segmentation with limited annotations, in: NeurIPS 2020.
- Self-supervised learning for medical image analysis using image context restoration. Medical Image Anal. .
- A simple framework for contrastive learning of visual representations, in: Proceedings of the 37th International Conference on Machine Learning, ICML 2020.
- Big self-supervised models are strong semi-supervised learners, in: NeurIPS 2020.
- Improved baselines with momentum contrastive learning. CoRR .
- Exploring simple siamese representation learning, in: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, virtual, June 19-25, 2021, Computer Vision Foundation / IEEE. pp. 15750–15758. doi:10.1109/CVPR46437.2021.01549.
- Unsupervised visual representation learning by context prediction, in: 2015 IEEE International Conference on Computer Vision, ICCV 2015.
- The pascal visual object classes (VOC) challenge. Int. J. Comput. Vis. .
- Breast cancer statistics, 2022. CA: a cancer journal for clinicians 72, 524–541.
- Unsupervised representation learning by predicting image rotations, in: ICLR 2018, Conference Track Proceedings.
- Dimensionality reduction by learning an invariant mapping, in: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2006).
- Momentum contrast for unsupervised visual representation learning, in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020.
- Learning multiple layers of features from tiny images .
- Deep learning for segmentation using an open large-scale dataset in 2d echocardiography. IEEE Trans. Medical Imaging .
- The benefits and harms of breast cancer screening: an independent review. British journal of cancer 108, 2205–2240.
- CR-SSL: A closely related self-supervised learning based approach for improving breast ultrasound tumor segmentation. Int. J. Imaging Syst. Technol. .
- Unsupervised learning of visual representations by solving jigsaw puzzles, in: Computer Vision - ECCV 2016 - 14th European Conference.
- Representation learning with contrastive predictive coding. CoRR .
- Context encoders: Feature learning by inpainting, in: 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016.
- Self-paced contrastive learning for semi-supervised medical image segmentation with meta-labels, in: NeurIPS 2021, virtual.
- U-net: Convolutional networks for biomedical image segmentation, in: MICCAI 2015.
- Imagenet large scale visual recognition challenge. Int. J. Comput. Vis. .
- U-net and its variants for medical image segmentation: A review of theory and applications. IEEE Access .
- Cost–effectiveness of risk-based breast cancer screening programme, china. Bulletin of the World Health Organization 96, 568.
- Unext: Mlp-based rapid medical image segmentation network, in: MICCAI 2022.
- Matching networks for one shot learning, in: Lee, D.D., Sugiyama, M., von Luxburg, U., Guyon, I., Garnett, R. (Eds.), Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016, December 5-10, 2016, Barcelona, Spain, pp. 3630–3638.
- Tripled-uncertainty guided mean teacher model for semi-supervised medical image segmentation, in: MICCAI 2021.
- MPS-AMS: masked patches selection and adaptive masking strategy based self-supervised medical image segmentation. CoRR .
- Uncertainty-aware multi-view co-training for semi-supervised medical image segmentation and domain adaptation. Medical Image Anal. .
- Self-supervised feature learning for 3d medical images by playing a rubik’s cube, in: MICCAI 2019.
- Hugo Figueiras (1 paper)
- Helena Aidos (1 paper)
- Nuno Cruz Garcia (1 paper)