Spatial-aware Transformer-GRU Framework for Enhanced Glaucoma Diagnosis from 3D OCT Imaging (2403.05702v1)
Abstract: Glaucoma, a leading cause of irreversible blindness, necessitates early detection for accurate and timely intervention to prevent irreversible vision loss. In this study, we present a novel deep learning framework that leverages the diagnostic value of 3D Optical Coherence Tomography (OCT) imaging for automated glaucoma detection. In this framework, we integrate a pre-trained Vision Transformer on retinal data for rich slice-wise feature extraction and a bidirectional Gated Recurrent Unit for capturing inter-slice spatial dependencies. This dual-component approach enables comprehensive analysis of local nuances and global structural integrity, crucial for accurate glaucoma diagnosis. Experimental results on a large dataset demonstrate the superior performance of the proposed method over state-of-the-art ones, achieving an F1-score of 93.58%, Matthews Correlation Coefficient (MCC) of 73.54%, and AUC of 95.24%. The framework's ability to leverage the valuable information in 3D OCT data holds significant potential for enhancing clinical decision support systems and improving patient outcomes in glaucoma management.
- Deep learning and computer vision for glaucoma detection: A review. arXiv preprint arXiv:2307.16528, 2023.
- Glaucoma Hemifield Test: Automated Visual Field Evaluation. Archives of Ophthalmology, 110(6):812–819, 1992.
- Combination of enhanced depth imaging optical coherence tomography and fundus images for glaucoma screening. Journal of Medical Systems, 43:1–12, 2019.
- An image is worth 16x16 words: Transformers for image recognition at scale. In International Conference on Learning Representations, 2021.
- Glaucoma detection from raw circumpapillary oct images using fully convolutional neural networks. In 2020 IEEE International Conference on Image Processing (ICIP), pages 2526–2530, 2020.
- Circumpapillary oct-focused hybrid learning for glaucoma grading using tailored prototypical neural networks. Artificial Intelligence in Medicine, 118:102132, 2021.
- Glaucoma detection from raw sd-oct volumes: A novel approach focused on spatial dependencies. Computer Methods and Programs in Biomedicine, 200:105855, 2021.
- Attention-guided 3d-cnn framework for glaucoma detection and structural-functional association using volumetric images. IEEE Journal of Biomedical and Health Informatics, 24(12):3421–3430, 2020.
- Deep residual learning for image recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 770–778, 2016.
- Brain age estimation using lstm on children’s brain mri. In 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI), pages 1–4, 2020.
- Deep learning on fundus images detects glaucoma beyond the optic disc. Scientific Reports, 11(1):20313, 2021.
- Optical coherence tomography. Science, 254(5035):1178–1181, 1991.
- Glaucoma. The Lancet, 390(10108):2183–2193, 2017.
- Fused framework for glaucoma diagnosis using optical coherence tomography (oct) images. Expert Systems with Applications, 201:117202, 2022.
- Adam: A method for stochastic optimization. In Third International Conference on Learning Representations, ICLR, pages 1––15, 2015.
- Fused detection of retinal biomarkers in oct volumes. In Dinggang Shen, Tianming Liu, Terry M. Peters, Lawrence H. Staib, Caroline Essert, Sean Zhou, Pew-Thian Yap, and Ali Khan, editors, Medical Image Computing and Computer Assisted Intervention – MICCAI 2019, pages 255–263. Springer International Publishing, 2019.
- Diagnosing glaucoma with spectral-domain optical coherence tomography using deep learning classifier. Journal of glaucoma, 29(4):287–294, 2020.
- Focal loss for dense object detection. In Proceedings of the IEEE International Conference on Computer Vision (ICCV), Oct 2017.
- Classification of alzheimer’s disease by combination of convolutional and recurrent neural networks using fdg-pet images. Frontiers in Neuroinformatics, 12, 2018.
- A feature agnostic approach for glaucoma detection in oct volumes. PLOS ONE, 14(7):1–12, 2019.
- From machine to machine: An oct-trained deep learning algorithm for objective quantification of glaucomatous damage in fundus photographs. Ophthalmology, 126(4):513–521, 2019.
- Prediction of visual field progression from oct structural measures in moderate to advanced glaucoma. American Journal of Ophthalmology, 226:172–181, 2021.
- Deep Learning for Glaucoma Detection and Identification of Novel Diagnostic Areas in Diverse Real-World Datasets. Translational Vision Science & Technology, 11(5):11–11, 2022.
- Data on oct and fundus images for the detection of glaucoma. Data in Brief, 29:105342, 2020.
- Clinically verified hybrid deep learning system for retinal ganglion cells aware grading of glaucomatous progression. IEEE Transactions on Biomedical Engineering, 68(7):2140–2151, 2021.
- Detection of glaucomatous optic neuropathy with spectral-domain optical coherence tomography: a retrospective training and validation deep-learning analysis. The Lancet Digital Health, 1(4):e172–e182, 2019.
- Biceph-net: A robust and lightweight framework for the diagnosis of alzheimer’s disease using 2d-mri scans and deep similarity learning. IEEE Journal of Biomedical and Health Informatics, 27(3):1205–1213, 2023.
- A 3D Deep Learning System for Detecting Referable Glaucoma Using Full OCT Macular Cube Scans. Translational Vision Science & Technology, 9(2):12–12, 2020.
- Deep Relation Transformer for Diagnosing Glaucoma With Optical Coherence Tomography and Visual Field Function. IEEE Transactions on Medical Imaging, 40(9):2392–2402, 2021.
- Jaimie D. Steinmetz et al. Causes of blindness and vision impairment in 2020 and trends over 30 years, and prevalence of avoidable blindness in relation to VISION 2020: the Right to Sight: an analysis for the Global Burden of Disease Study. The Lancet Global Health, 9(2):e144–e160, 2021.
- Laurens van der Maaten and Geoffrey Hinton. Visualizing data using t-sne. Journal of Machine Learning Research, 9(86):2579–2605, 2008.
- A brain tumor identification and classification using deep learning based on cnn-lstm method. Computers and Electrical Engineering, 101:107960, 2022.
- Towards multi-center glaucoma oct image screening with semi-supervised joint structure and function multi-task learning. Medical Image Analysis, 63:101695, 2020.
- The Pathophysiology and Treatment of Glaucoma: A Review. JAMA, 311(18):1901–1911, 05 2014.
- Yukun Zhou et al. A foundation model for generalizable disease detection from retinal images. Nature, 622(7981):156–163, 2023.