DRStageNet: Deep Learning for Diabetic Retinopathy Staging from Fundus Images (2312.14891v1)
Abstract: Diabetic retinopathy (DR) is a prevalent complication of diabetes associated with a significant risk of vision loss. Timely identification is critical to curb vision impairment. Algorithms for DR staging from digital fundus images (DFIs) have been recently proposed. However, models often fail to generalize due to distribution shifts between the source domain on which the model was trained and the target domain where it is deployed. A common and particularly challenging shift is often encountered when the source- and target-domain supports do not fully overlap. In this research, we introduce DRStageNet, a deep learning model designed to mitigate this challenge. We used seven publicly available datasets, comprising a total of 93,534 DFIs that cover a variety of patient demographics, ethnicities, geographic origins and comorbidities. We fine-tune DINOv2, a pretrained model of self-supervised vision transformer, and implement a multi-source domain fine-tuning strategy to enhance generalization performance. We benchmark and demonstrate the superiority of our method to two state-of-the-art benchmarks, including a recently published foundation model. We adapted the grad-rollout method to our regression task in order to provide high-resolution explainability heatmaps. The error analysis showed that 59\% of the main errors had incorrect reference labels. DRStageNet is accessible at URL [upon acceptance of the manuscript].
- “Global, regional, and national burden and trend of diabetes in 195 countries and territories: an analysis from 1990 to 2025” In Scientific Reports 10.1, 2020, pp. 14790
- “IDF Diabetes Atlas: Global, regional and country-level diabetes prevalence estimates for 2021 and projections for 2045” In Diabetes research and clinical practice 183 Diabetes Res Clin Pract, 2022
- “Global Prevalence and Major Risk Factors of Diabetic Retinopathy” In Diabetes Care 35.3, 2012, pp. 556–564
- “Classification of Human Retinal Microaneurysms Using Adaptive Optics Scanning Light Ophthalmoscope Fluorescein Angiography” In Investigative Opthalmology & Visual Science 55.3, 2014, pp. 1299
- “Development and Validation of a Deep Learning System for Diabetic Retinopathy and Related Eye Diseases Using Retinal Images From Multiethnic Populations With Diabetes” In JAMA 318.22, 2017, pp. 2211
- “Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs” In JAMA 316.22 American Medical Association, 2016, pp. 2402–2410
- Mike Voets, Kajsa Møllersen and Lars Ailo Bongo “Replication study: Development and validation of deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs” In PLoS One 14.6 Public Library of Science, 2018, pp. e0217541
- “Automated analysis of retinal images for detection of referable diabetic retinopathy” In JAMA ophthalmology 131.3 JAMA Ophthalmol, 2013, pp. 351–357
- “Improved Automated Detection of Diabetic Retinopathy on a Publicly Available Dataset Through Integration of Deep Learning” In Investigative Ophthalmology & Visual Science 57.13 The Association for Research in VisionOphthalmology, 2016, pp. 5200–5206
- Alexandros Papadopoulos, Fotis Topouzis and Anastasios Delopoulos “An interpretable multiple-instance approach for the detection of referable diabetic retinopathy in fundus images” In Scientific Reports 2021 11:1 11.1 Nature Publishing Group, 2021, pp. 1–15
- “A Lightweight Robust Deep Learning Model Gained High Accuracy in Classifying a Wide Range of Diabetic Retinopathy Images” In IEEE Access 11 Institute of ElectricalElectronics Engineers Inc., 2023, pp. 42361–42388
- “A novel deep transfer learning based computerized diagnostic Systems for Multi-class imbalanced diabetic retinopathy severity classification” In Multimedia Tools and Applications 82.22 Springer, 2023, pp. 34847–34884
- “Deep residual transfer learning for automatic diagnosis and grading of diabetic retinopathy” In Neurocomputing 452 Elsevier, 2021, pp. 424–434
- “A convolutional neural network for the screening and staging of diabetic retinopathy” In PLoS ONE 15.6 PLOS, 2020, pp. e0233514
- “A Regression-Based Approach to Diabetic Retinopathy Diagnosis Using Efficientnet” In Diagnostics 2023, Vol. 13, Page 774 13.4 Multidisciplinary Digital Publishing Institute, 2023, pp. 774
- “Proposed international clinical diabetic retinopathy and diabetic macular edema disease severity scales” In Ophthalmology 110.9, 2003, pp. 1677–1682
- “A foundation model for generalizable disease detection from retinal images” In Nature 2023 Nature Publishing Group, 2023, pp. 1–8
- Jacob Gildenblat “Exploring Explainability for Vision Transformers” URL: https://jacobgil.github.io/deeplearning/vision-transformer-explainability
- “DINOv2: Learning Robust Visual Features without Supervision” In arXiv: 2304.07193, 2023
- “The Challenge of Diabetic Retinopathy Standardization in an Ophthalmological Dataset” In Journal of Diabetes Science and Technology 15.6, 2021, pp. 1410–1411
- “Diabetic Retinopathy Detection” In Kaggle, 2015 URL: https://kaggle.com/competitions/diabetic-retinopathy-detection
- “EyePACS: An Adaptable Telemedicine System for Diabetic Retinopathy Screening” In Journal of diabetes science and technology (Online) 3.3 Diabetes Technology Society, 2009, pp. 509
- “Diagnostic assessment of deep learning algorithms for diabetic retinopathy screening” In Information Sciences 501 Elsevier, 2019, pp. 511–522
- “APTOS 2019 Blindness Detection” In Kaggle, 2019 URL: https://kaggle.com/competitions/aptos2019-blindness-detection
- “A Brazilian Multilabel Ophthalmological Dataset (BRSET) (version 1.0.0)” In PhysioNet, 2023 DOI: https://doi.org/10.13026/xcxw-8198
- “Grader Variability and the Importance of Reference Standards for Evaluating Machine Learning Models for Diabetic Retinopathy” In Ophthalmology 125.8 Ophthalmology, 2018, pp. 1264–1272
- “Indian Diabetic Retinopathy Image Dataset (IDRiD)” In IEEE Dataport, 2018 DOI: https://dx.doi.org/10.21227/H25W98
- “Cross-Field Transformer for Diabetic Retinopathy Grading on Two-field Fundus Images” In 2022 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) IEEE Computer Society, 2022, pp. 985–990
- Ben Graham “Kaggle Diabetic Retinopathy Detection Competition Report”, 2015 URL: https://kaggle-forum-message-attachments.storage.googleapis.com/88655/2795/competitionreport.pdf
- “Collaborative learning of semi-supervised segmentation and classification for medical images” In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2019-June IEEE Computer Society, 2019, pp. 2074–2083
- “Automated diabetic retinopathy detection based on binocular siamese-like convolutional neural network” In IEEE Access 7 Institute of ElectricalElectronics Engineers Inc., 2019, pp. 30744–30753
- “An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale” In International Conference on Learning Representations, 2020
- “Gaussian Error Linear Units (GELUs)” In arXiv:1606.08415, 2016
- Diederik P. Kingma and Jimmy Lei Ba “Adam: A Method for Stochastic Optimization” In 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings International Conference on Learning Representations, ICLR, 2014
- “Shortcut learning in deep neural networks” In Nature Machine Intelligence 2020 2:11 2.11 Nature Publishing Group, 2020, pp. 665–673
- “ImageNet: A large-scale hierarchical image database” In 2009 IEEE Conference on Computer Vision and Pattern Recognition IEEE, 2009, pp. 248–255
- Mingxing Tan and Quoc V. Le “EfficientNetV2: Smaller Models and Faster Training” In Proceedings of the 38th International Conference on Machine Learning PMLR, 2021, pp. 10096–10106
- “Masked Autoencoders Are Scalable Vision Learners” In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2022-June IEEE Computer Society, 2021, pp. 15979–15988
- “Robust and data-efficient generalization of self-supervised machine learning for diagnostic imaging” In Nature Biomedical Engineering 2023 7:6 7.6 Nature Publishing Group, 2023, pp. 756–779
- “Self-supervised Feature Learning via Exploiting Multi-modal Data for Retinal Disease Diagnosis” In IEEE Transactions on Medical Imaging 39.12 Institute of ElectricalElectronics Engineers Inc., 2020, pp. 4023–4033
- Tuan Truong, Sadegh Mohammadi and Matthias Lenga “How Transferable Are Self-supervised Features in Medical Image Classification Tasks?” In Proceedings of Machine Learning Research 158 ML Research Press, 2021, pp. 54–74
- “Self-supervised retinal thickness prediction enables deep learning from unlabelled data to boost classification of diabetic retinopathy” In Nature Machine Intelligence 2020 2:11 2.11 Nature Publishing Group, 2020, pp. 719–726
- “Detecting Anomalies in Retinal Diseases Using Generative, Discriminative, and Self-supervised Deep Learning” In JAMA ophthalmology 140.2 JAMA Ophthalmol, 2022, pp. 185–189
- “Quantifying Attention Flow in Transformers” In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics Stroudsburg, PA, USA: Association for Computational Linguistics, 2020, pp. 4190–4197
- “Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization” In International Journal of Computer Vision 128.2 Springer, 2016, pp. 336–359
- “DRGen: Domain Generalization in Diabetic Retinopathy Classification” In Medical Image Computing and Computer Assisted Intervention – MICCAI 2022 13432 LNCS Springer Nature Switzerland, 2022, pp. 635–644
- Mohammad Z. Atwany, Abdulwahab H. Sahyoun and Mohammad Yaqub “Deep Learning Techniques for Diabetic Retinopathy Classification: A Survey” In IEEE Access 10, 2022, pp. 28642–28655
- Yevgeniy Men (4 papers)
- Jonathan Fhima (8 papers)
- Leo Anthony Celi (49 papers)
- Lucas Zago Ribeiro (1 paper)
- Luis Filipe Nakayama (10 papers)
- Joachim A. Behar (33 papers)