Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
102 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Automatic Detection of Alzheimer's Disease with Multi-Modal Fusion of Clinical MRI Scans (2311.18245v1)

Published 30 Nov 2023 in eess.IV and cs.CV

Abstract: The aging population of the U.S. drives the prevalence of Alzheimer's disease. Brookmeyer et al. forecasts approximately 15 million Americans will have either clinical AD or mild cognitive impairment by 2060. In response to this urgent call, methods for early detection of Alzheimer's disease have been developed for prevention and pre-treatment. Notably, literature on the application of deep learning in the automatic detection of the disease has been proliferating. This study builds upon previous literature and maintains a focus on leveraging multi-modal information to enhance automatic detection. We aim to predict the stage of the disease - Cognitively Normal (CN), Mildly Cognitive Impairment (MCI), and Alzheimer's Disease (AD), based on two different types of brain MRI scans. We design an AlexNet-based deep learning model that learns the synergy of complementary information from both T1 and FLAIR MRI scans.

PDF HTML Abstract
Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Bookmark Chat Bubble Oval Streamline Icon: https://streamlinehq.com Chat (Pro)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (29)
  1. J. Ashburner. A fast diffeomorphic image registration algorithm. Neuroimage, 38(1):95–113, 2007.
  2. Forecasting the prevalence of preclinical and clinical alzheimer’s disease in the united states. Alzheimer’s & Dementia, 14(2):121–129, 2018.
  3. Locality-sensitive deconvolution networks with gated fusion for rgb-d indoor semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 3029–3037, 2017.
  4. Y. Dai and Y. Gao. Transmed: Transformers advance multi-modal medical image classification, 2021.
  5. 3d statistical neuroanatomical models from 305 mri volumes. In 1993 IEEE conference record nuclear science symposium and medical imaging conference, pages 1813–1817. IEEE, 1993.
  6. B. Fischl. Freesurfer. Neuroimage, 62(2):774–781, 2012.
  7. Fusenet: Incorporating depth into semantic segmentation via fusion-based cnn architecture. In Asian conference on computer vision, pages 213–228. Springer, 2016.
  8. The alzheimer’s disease neuroimaging initiative (adni): Mri methods. Journal of Magnetic Resonance Imaging: An Official Journal of the International Society for Magnetic Resonance in Medicine, 27(4):685–691, 2008.
  9. M. Jenkinson and S. Smith. A global optimisation method for robust affine registration of brain images. Medical image analysis, 5(2):143–156, 2001.
  10. Improved optimization for the robust and accurate linear registration and motion correction of brain images. Neuroimage, 17(2):825–841, 2002.
  11. Convolutional networks for images, speech, and time series. The handbook of brain theory and neural networks, 3361(10):1995, 1995.
  12. Inter-modality relationship constrained multi-modality multi-task feature selection for alzheimer’s disease and mild cognitive impairment identification. NeuroImage, 84:466–475, 2014a.
  13. Multi-modality cascaded convolutional neural networks for alzheimer’s disease diagnosis. Neuroinformatics, 16(3):295–308, 2018.
  14. Multimodal neuroimaging feature learning for multiclass diagnosis of alzheimer’s disease. IEEE transactions on biomedical engineering, 62(4):1132–1140, 2014b.
  15. On the design of convolutional neural networks for automatic detection of alzheimer’s disease. In Machine Learning for Health Workshop, pages 184–201. PMLR, 2020.
  16. Development of a deep learning model for early alzheime’s disease detection from structural mris and external validation on an independent cohort. medRxiv, 2021.
  17. Age and diagnostic performance of alzheimer disease csf biomarkers. Neurology, 78(7):468–476, 2012.
  18. Brain inflammation in alzheimer disease and the therapeutic implications. Current pharmaceutical design, 5:821–836, 1999.
  19. A. Ng et al. Sparse autoencoder. CS294A Lecture notes, 72(2011):1–19, 2011.
  20. Multimodal deep learning. In ICML, 2011.
  21. Application of deep learning in detecting neurological disorders from magnetic resonance images: a survey on the detection of alzheimer’s disease, parkinson’s disease and schizophrenia. Brain informatics, 7(1):1–21, 2020.
  22. Statistical parametric mapping: the analysis of functional brain images. Elsevier, 2011.
  23. Clinica: An open-source software platform for reproducible clinical neuroscience studies. Frontiers in Neuroinformatics, 15:39, 2021. ISSN 1662-5196. doi: 10.3389/fninf.2021.689675. URL https://www.frontiersin.org/article/10.3389/fninf.2021.689675.
  24. Modality compensation network: Cross-modal adaptation for action recognition. IEEE Transactions on Image Processing, 29:3957–3969, 2020.
  25. Multimodal learning using convolution neural network and sparse autoencoder. In 2017 IEEE International Conference on Big Data and Smart Computing (BigComp), pages 309–312. IEEE, 2017.
  26. Learning common and specific features for rgb-d semantic segmentation with deconvolutional networks. In European Conference on Computer Vision, pages 664–679. Springer, 2016.
  27. Bayesian analysis of neuroimaging data in fsl. Neuroimage, 45(1):S173–S186, 2009.
  28. Deep surface normal estimation with hierarchical rgb-d fusion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 6153–6162, 2019.
  29. Multimodal classification of alzheimer’s disease and mild cognitive impairment. Neuroimage, 55(3):856–867, 2011.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (5)
  1. Long Chen (395 papers)
  2. Liben Chen (2 papers)
  3. Binfeng Xu (4 papers)
  4. Wenxin Zhang (27 papers)
  5. Narges Razavian (19 papers)