Self-Supervised Learning Featuring Small-Scale Image Dataset for Treatable Retinal Diseases Classification (2404.10166v1)
Abstract: Automated medical diagnosis through image-based neural networks has increased in popularity and matured over years. Nevertheless, it is confined by the scarcity of medical images and the expensive labor annotation costs. Self-Supervised Learning (SSL) is an good alternative to Transfer Learning (TL) and is suitable for imbalanced image datasets. In this study, we assess four pretrained SSL models and two TL models in treatable retinal diseases classification using small-scale Optical Coherence Tomography (OCT) images ranging from 125 to 4000 with balanced or imbalanced distribution for training. The proposed SSL model achieves the state-of-art accuracy of 98.84% using only 4,000 training images. Our results suggest the SSL models provide superior performance under both the balanced and imbalanced training scenarios. The SSL model with MoCo-v2 scheme has consistent good performance under the imbalanced scenario and, especially, surpasses the other models when the training set is less than 500 images.
- Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis. NPJ digital medicine, 4(1):65, 2021.
- R Andreeva et al. Dr detection using optical coherence tomography angiography (octa): A transfer learning approach with robustness analysis. In Lecture Notes in Computer Science. Springer, 2021.
- R Arefin et al. Non-transfer deep learning of optical coherence tomography for post-hoc explanation of macular disease classification. In IEEE International Conference on Healthcare Informatics. IEEE, 2021.
- Evaluation measures for models assessment over imbalanced data sets. J Inf Eng Appl, 3(10), 2013.
- Optical coherence tomography angiography in diabetic patients: a systematic review. Biomedicines, 10(1):88, 2021.
- Unsupervised learning of visual features by contrasting cluster assignments. In H. Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan, and H. Lin, editors, Advances in Neural Information Processing Systems, volume 33, pages 9912–9924. Curran Associates, Inc., 2020.
- Transfer learning for diabetic macular edema (dme) detection on optical coherence tomography (oct) images. In 2017 IEEE International Conference on Signal and Image Processing Applications (ICSIPA), pages 493–496, 2017a. 10.1109/ICSIPA.2017.8120662.
- Earlier implementation of tl for oct data using alexnet. In 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), page 8120662. IEEE, 2017b.
- A simple framework for contrastive learning of visual representations. In International conference on machine learning, pages 1597–1607. PMLR, 2020a.
- Improved baselines with momentum contrastive learning, 2020b.
- Ai for radiographic covid-19 detection selects shortcuts over signal. Nature Machine Intelligence, 3(7):610–619, 2021.
- Quantitative classification of eyes with and without intermediate age-related macular degeneration using optical coherence tomography. Ophthalmology, 121(1):162–172, 2014.
- Dynamically weighted balanced loss: class imbalanced learning and confidence calibration of deep neural networks. IEEE Transactions on Neural Networks and Learning Systems, 33(7):2940–2951, 2021.
- Bootstrap your own latent-a new approach to self-supervised learning. Advances in neural information processing systems, 33:21271–21284, 2020.
- Momentum contrast for unsupervised visual representation learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 9729–9738, 2020.
- Retinal image understanding emerges from self-supervised multimodal reconstruction. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2018: 21st International Conference, Granada, Spain, September 16-20, 2018, Proceedings, Part I, pages 321–328. Springer, 2018.
- Labeled optical coherence tomography (oct) and chest x-ray images for classification. https://data.mendeley.com/datasets/rscbjbr9sj/2, 2018a.
- Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell, 172(5):1122–1131, 2018b.
- Epidemiology of diabetic retinopathy, diabetic macular edema and related vision loss. Eye and vision, 2(1):1–25, 2015.
- Octx: Ensembled deep learning model to detect retinal disorders. In 2020 IEEE 33rd International Symposium on Computer-Based Medical Systems (CBMS), pages 526–531. IEEE, 2020.
- Detection of retinal disorders in optical coherence tomography using deep learning. In 2019 10th International Conference on Computing, Communication and Networking Technologies (ICCCNT), pages 1–7. IEEE, 2019.
- Prevalence of age-related macular degeneration in the us in 2019. JAMA ophthalmology, 140(12):1202–1208, 2022.
- Transfer learning-based platform for detecting multi-classification retinal disorders using optical coherence tomography images. Imaging Science Journal, 69(6):555–564, 2021.
- Dry and wet age-related macular degeneration classification using oct images and deep learning. In 2019 Scientific meeting on electrical-electronics & biomedical engineering and computer science (EBBT), pages 1–4. IEEE, 2019.
- Multi-scale convolutional neural network for automated amd classification using retinal oct images. Computers in biology and medicine, 144:105368, 2022.
- Moco pretraining improves representation and transferability of chest x-ray models. In Medical Imaging with Deep Learning, pages 728–744. PMLR, 2021.
- Fully automated detection of diabetic macular edema and dry age-related macular degeneration from optical coherence tomography images. Biomedical optics express, 5(10):3568–3577, 2014.
- Covid-19 prognosis via self-supervised representation learning and multi-image prediction. arXiv preprint arXiv:2101.04909, 2021.
- Rethinking the inception architecture for computer vision. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 2818–2826, 2016.
- Automated staging of age-related macular degeneration using optical coherence tomography. Investigative ophthalmology & visual science, 58(4):2318–2328, 2017.
- A review of predictive and contrastive self-supervised learning for medical images. Machine Intelligence Research, 20(4):483–513, 2023a. ISSN 2731-538X. 10.1007/s11633-022-1406-4. URL https://www.mi-research.net/en/article/doi/10.1007/s11633-022-1406-4.
- Wei-Chien Wang et al. A review of predictive and contrastive self-supervised learning for medical images. arXiv preprint arXiv:2302.05043, 2023b.
- Transfer learning or self-supervised learning? a tale of two pretraining paradigms. arXiv preprint arXiv:2007.04234, 2020.
- Rethinking the value of labels for improving class-imbalanced learning. Advances in neural information processing systems, 33:19290–19301, 2020.
- Luffina C. Huang (2 papers)
- Darren J. Chiu (1 paper)
- Manish Mehta (2 papers)