Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
102 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

DRStageNet: Deep Learning for Diabetic Retinopathy Staging from Fundus Images (2312.14891v1)

Published 22 Dec 2023 in eess.IV, cs.CV, and cs.LG

Abstract: Diabetic retinopathy (DR) is a prevalent complication of diabetes associated with a significant risk of vision loss. Timely identification is critical to curb vision impairment. Algorithms for DR staging from digital fundus images (DFIs) have been recently proposed. However, models often fail to generalize due to distribution shifts between the source domain on which the model was trained and the target domain where it is deployed. A common and particularly challenging shift is often encountered when the source- and target-domain supports do not fully overlap. In this research, we introduce DRStageNet, a deep learning model designed to mitigate this challenge. We used seven publicly available datasets, comprising a total of 93,534 DFIs that cover a variety of patient demographics, ethnicities, geographic origins and comorbidities. We fine-tune DINOv2, a pretrained model of self-supervised vision transformer, and implement a multi-source domain fine-tuning strategy to enhance generalization performance. We benchmark and demonstrate the superiority of our method to two state-of-the-art benchmarks, including a recently published foundation model. We adapted the grad-rollout method to our regression task in order to provide high-resolution explainability heatmaps. The error analysis showed that 59\% of the main errors had incorrect reference labels. DRStageNet is accessible at URL [upon acceptance of the manuscript].

Definition Search Book Streamline Icon: https://streamlinehq.com
References (47)
  1. “Global, regional, and national burden and trend of diabetes in 195 countries and territories: an analysis from 1990 to 2025” In Scientific Reports 10.1, 2020, pp. 14790
  2. “IDF Diabetes Atlas: Global, regional and country-level diabetes prevalence estimates for 2021 and projections for 2045” In Diabetes research and clinical practice 183 Diabetes Res Clin Pract, 2022
  3. “Global Prevalence and Major Risk Factors of Diabetic Retinopathy” In Diabetes Care 35.3, 2012, pp. 556–564
  4. “Classification of Human Retinal Microaneurysms Using Adaptive Optics Scanning Light Ophthalmoscope Fluorescein Angiography” In Investigative Opthalmology & Visual Science 55.3, 2014, pp. 1299
  5. “Development and Validation of a Deep Learning System for Diabetic Retinopathy and Related Eye Diseases Using Retinal Images From Multiethnic Populations With Diabetes” In JAMA 318.22, 2017, pp. 2211
  6. “Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs” In JAMA 316.22 American Medical Association, 2016, pp. 2402–2410
  7. Mike Voets, Kajsa Møllersen and Lars Ailo Bongo “Replication study: Development and validation of deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs” In PLoS One 14.6 Public Library of Science, 2018, pp. e0217541
  8. “Automated analysis of retinal images for detection of referable diabetic retinopathy” In JAMA ophthalmology 131.3 JAMA Ophthalmol, 2013, pp. 351–357
  9. “Improved Automated Detection of Diabetic Retinopathy on a Publicly Available Dataset Through Integration of Deep Learning” In Investigative Ophthalmology & Visual Science 57.13 The Association for Research in VisionOphthalmology, 2016, pp. 5200–5206
  10. Alexandros Papadopoulos, Fotis Topouzis and Anastasios Delopoulos “An interpretable multiple-instance approach for the detection of referable diabetic retinopathy in fundus images” In Scientific Reports 2021 11:1 11.1 Nature Publishing Group, 2021, pp. 1–15
  11. “A Lightweight Robust Deep Learning Model Gained High Accuracy in Classifying a Wide Range of Diabetic Retinopathy Images” In IEEE Access 11 Institute of ElectricalElectronics Engineers Inc., 2023, pp. 42361–42388
  12. “A novel deep transfer learning based computerized diagnostic Systems for Multi-class imbalanced diabetic retinopathy severity classification” In Multimedia Tools and Applications 82.22 Springer, 2023, pp. 34847–34884
  13. “Deep residual transfer learning for automatic diagnosis and grading of diabetic retinopathy” In Neurocomputing 452 Elsevier, 2021, pp. 424–434
  14. “A convolutional neural network for the screening and staging of diabetic retinopathy” In PLoS ONE 15.6 PLOS, 2020, pp. e0233514
  15. “A Regression-Based Approach to Diabetic Retinopathy Diagnosis Using Efficientnet” In Diagnostics 2023, Vol. 13, Page 774 13.4 Multidisciplinary Digital Publishing Institute, 2023, pp. 774
  16. “Proposed international clinical diabetic retinopathy and diabetic macular edema disease severity scales” In Ophthalmology 110.9, 2003, pp. 1677–1682
  17. “A foundation model for generalizable disease detection from retinal images” In Nature 2023 Nature Publishing Group, 2023, pp. 1–8
  18. Jacob Gildenblat “Exploring Explainability for Vision Transformers” URL: https://jacobgil.github.io/deeplearning/vision-transformer-explainability
  19. “DINOv2: Learning Robust Visual Features without Supervision” In arXiv: 2304.07193, 2023
  20. “The Challenge of Diabetic Retinopathy Standardization in an Ophthalmological Dataset” In Journal of Diabetes Science and Technology 15.6, 2021, pp. 1410–1411
  21. “Diabetic Retinopathy Detection” In Kaggle, 2015 URL: https://kaggle.com/competitions/diabetic-retinopathy-detection
  22. “EyePACS: An Adaptable Telemedicine System for Diabetic Retinopathy Screening” In Journal of diabetes science and technology (Online) 3.3 Diabetes Technology Society, 2009, pp. 509
  23. “Diagnostic assessment of deep learning algorithms for diabetic retinopathy screening” In Information Sciences 501 Elsevier, 2019, pp. 511–522
  24. “APTOS 2019 Blindness Detection” In Kaggle, 2019 URL: https://kaggle.com/competitions/aptos2019-blindness-detection
  25. “A Brazilian Multilabel Ophthalmological Dataset (BRSET) (version 1.0.0)” In PhysioNet, 2023 DOI: https://doi.org/10.13026/xcxw-8198
  26. “Grader Variability and the Importance of Reference Standards for Evaluating Machine Learning Models for Diabetic Retinopathy” In Ophthalmology 125.8 Ophthalmology, 2018, pp. 1264–1272
  27. “Indian Diabetic Retinopathy Image Dataset (IDRiD)” In IEEE Dataport, 2018 DOI: https://dx.doi.org/10.21227/H25W98
  28. “Cross-Field Transformer for Diabetic Retinopathy Grading on Two-field Fundus Images” In 2022 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) IEEE Computer Society, 2022, pp. 985–990
  29. Ben Graham “Kaggle Diabetic Retinopathy Detection Competition Report”, 2015 URL: https://kaggle-forum-message-attachments.storage.googleapis.com/88655/2795/competitionreport.pdf
  30. “Collaborative learning of semi-supervised segmentation and classification for medical images” In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2019-June IEEE Computer Society, 2019, pp. 2074–2083
  31. “Automated diabetic retinopathy detection based on binocular siamese-like convolutional neural network” In IEEE Access 7 Institute of ElectricalElectronics Engineers Inc., 2019, pp. 30744–30753
  32. “An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale” In International Conference on Learning Representations, 2020
  33. “Gaussian Error Linear Units (GELUs)” In arXiv:1606.08415, 2016
  34. Diederik P. Kingma and Jimmy Lei Ba “Adam: A Method for Stochastic Optimization” In 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings International Conference on Learning Representations, ICLR, 2014
  35. “Shortcut learning in deep neural networks” In Nature Machine Intelligence 2020 2:11 2.11 Nature Publishing Group, 2020, pp. 665–673
  36. “ImageNet: A large-scale hierarchical image database” In 2009 IEEE Conference on Computer Vision and Pattern Recognition IEEE, 2009, pp. 248–255
  37. Mingxing Tan and Quoc V. Le “EfficientNetV2: Smaller Models and Faster Training” In Proceedings of the 38th International Conference on Machine Learning PMLR, 2021, pp. 10096–10106
  38. “Masked Autoencoders Are Scalable Vision Learners” In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2022-June IEEE Computer Society, 2021, pp. 15979–15988
  39. “Robust and data-efficient generalization of self-supervised machine learning for diagnostic imaging” In Nature Biomedical Engineering 2023 7:6 7.6 Nature Publishing Group, 2023, pp. 756–779
  40. “Self-supervised Feature Learning via Exploiting Multi-modal Data for Retinal Disease Diagnosis” In IEEE Transactions on Medical Imaging 39.12 Institute of ElectricalElectronics Engineers Inc., 2020, pp. 4023–4033
  41. Tuan Truong, Sadegh Mohammadi and Matthias Lenga “How Transferable Are Self-supervised Features in Medical Image Classification Tasks?” In Proceedings of Machine Learning Research 158 ML Research Press, 2021, pp. 54–74
  42. “Self-supervised retinal thickness prediction enables deep learning from unlabelled data to boost classification of diabetic retinopathy” In Nature Machine Intelligence 2020 2:11 2.11 Nature Publishing Group, 2020, pp. 719–726
  43. “Detecting Anomalies in Retinal Diseases Using Generative, Discriminative, and Self-supervised Deep Learning” In JAMA ophthalmology 140.2 JAMA Ophthalmol, 2022, pp. 185–189
  44. “Quantifying Attention Flow in Transformers” In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics Stroudsburg, PA, USA: Association for Computational Linguistics, 2020, pp. 4190–4197
  45. “Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization” In International Journal of Computer Vision 128.2 Springer, 2016, pp. 336–359
  46. “DRGen: Domain Generalization in Diabetic Retinopathy Classification” In Medical Image Computing and Computer Assisted Intervention – MICCAI 2022 13432 LNCS Springer Nature Switzerland, 2022, pp. 635–644
  47. Mohammad Z. Atwany, Abdulwahab H. Sahyoun and Mohammad Yaqub “Deep Learning Techniques for Diabetic Retinopathy Classification: A Survey” In IEEE Access 10, 2022, pp. 28642–28655
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (6)
  1. Yevgeniy Men (4 papers)
  2. Jonathan Fhima (8 papers)
  3. Leo Anthony Celi (49 papers)
  4. Lucas Zago Ribeiro (1 paper)
  5. Luis Filipe Nakayama (10 papers)
  6. Joachim A. Behar (33 papers)
Citations (2)

Summary

We haven't generated a summary for this paper yet.