Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
194 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Brain Anatomy Prior Modeling to Forecast Clinical Progression of Cognitive Impairment with Structural MRI (2306.11837v2)

Published 20 Jun 2023 in eess.IV and cs.CV

Abstract: Brain structural MRI has been widely used to assess the future progression of cognitive impairment (CI). Previous learning-based studies usually suffer from the issue of small-sized labeled training data, while there exist a huge amount of structural MRIs in large-scale public databases. Intuitively, brain anatomical structures derived from these public MRIs (even without task-specific label information) can be used to boost CI progression trajectory prediction. However, previous studies seldom take advantage of such brain anatomy prior. To this end, this paper proposes a brain anatomy prior modeling (BAPM) framework to forecast the clinical progression of cognitive impairment with small-sized target MRIs by exploring anatomical brain structures. Specifically, the BAPM consists of a pretext model and a downstream model, with a shared brain anatomy-guided encoder to model brain anatomy prior explicitly. Besides the encoder, the pretext model also contains two decoders for two auxiliary tasks (i.e., MRI reconstruction and brain tissue segmentation), while the downstream model relies on a predictor for classification. The brain anatomy-guided encoder is pre-trained with the pretext model on 9,344 auxiliary MRIs without diagnostic labels for anatomy prior modeling. With this encoder frozen, the downstream model is then fine-tuned on limited target MRIs for prediction. We validate the BAPM on two CI-related studies with T1-weighted MRIs from 448 subjects. Experimental results suggest the effectiveness of BAPM in (1) four CI progression prediction tasks, (2) MR image reconstruction, and (3) brain tissue segmentation, compared with several state-of-the-art methods.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (56)
  1. UK Biobank Data: Come and Get It. Science Translational Medicine 6, 224ed4–224ed4.
  2. SPM: a history. NeuroImage 62, 791–800.
  3. A multi-stream convolutional neural network for classification of progressive MCI in Alzheimer’s disease using structural MCI images. IEEE Journal of Biomedical and Health Informatics 26, 3918–3926.
  4. Automated classification of Alzheimer’s disease and mild cognitive impairment using a single MRI and deep neural networks. NeuroImage: Clinical 21, 101645.
  5. Cross-cohort generalizability of deep and conventional machine learning for MRI-based diagnosis and prediction of Alzheimer’s disease. NeuroImage: Clinical 31, 102712.
  6. Med3D: Transfer learning for 3D medical image analysis. arXiv preprint arXiv:1904.00625 .
  7. XGBoost: A scalable tree boosting system, in: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 785–794.
  8. Imagenet: A large-scale hierarchical image database, in: 2009 IEEE Conference on Computer Vision and Pattern Recognition, Ieee. pp. 248–255.
  9. OpenBHB: A Large-Scale Multi-Site Brain MRI Data-set for Age Prediction and Debiasing. NeuroImage 263, 119637.
  10. A personalized computer-aided diagnosis system for mild cognitive impairment (MCI) using structural MRI (sMRI). Sensors 21, 5416.
  11. The Australian Imaging, Biomarkers and Lifestyle (AIBL) study of aging: Methodology and baseline characteristics of 1112 individuals recruited for a longitudinal study of Alzheimer’s disease. International Psychogeriatrics 21, 672–687.
  12. MRI radiomics classification and prediction in Alzheimer’s disease and mild cognitive impairment: A review. Current Alzheimer Research 17, 297–309.
  13. FreeSurfer. NeuroImage 62, 774–781.
  14. Artificial intelligence in brain MRI analysis of Alzheimer’s disease over the past 12 years: A systematic review. Ageing Research Reviews , 101614.
  15. Brain signatures based on structural MRI: Classification for MCI, PMCI, and AD. Human Brain Mapping 43, 2845–2860.
  16. Domain adaptation for medical image analysis: A survey. IEEE Transactions on Biomedical Engineering 69, 1173–1185.
  17. A novel conversion prediction method of MCI to AD based on longitudinal dynamic morphological features using ADNI structural MRIs. Journal of Neurology 267, 2983–2997.
  18. Deep residual learning for image recognition, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778.
  19. Reliability of structural MRI measurements: The effects of scan session, head tilt, inter-scan interval, acquisition sequence, FreeSurfer version and processing stream. NeuroImage 246, 118751.
  20. MobileNets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 .
  21. Squeeze-and-Excitation Networks, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7132–7141.
  22. SynthSR: A public AI tool to turn heterogeneous clinical brain scans into high-resolution T1-weighted images for 3D morphometry. Science Advances 9, eadd3607.
  23. The Alzheimer’s disease neuroimaging initiative (ADNI): MRI methods. Journal of Magnetic Resonance Imaging: An Official Journal of the International Society for Magnetic Resonance in Medicine 27, 685–691.
  24. FSL. NeuroImage 62, 782–790.
  25. Structural brain changes and neuroticism in late-life depression: A neural basis for depression subtypes. International Psychogeriatrics 33, 515–520.
  26. Unsupervised domain adaptation in brain lesion segmentation with adversarial networks, in: International Conference on Information Processing in Medical Imaging, Springer. pp. 597–609.
  27. Transfer learning for medical image classification: A literature review. BMC Medical Imaging 22, 69.
  28. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 .
  29. MRI-based classification models in prediction of mild cognitive impairment and dementia in late-life depression. Frontiers in Aging Neuroscience , 13.
  30. Structural magnetic resonance imaging for the early diagnosis of dementia due to Alzheimer’s disease in people with mild cognitive impairment. Cochrane Database of Systematic Reviews .
  31. Brain magnetic resonance imaging correlates of impaired cognition in patients with type 2 diabetes. Diabetes 55, 1106–1113.
  32. Transfer learning assisted classification and detection of Alzheimer’s disease stages using 3D MRI scans. Sensors 19, 2645.
  33. Open Access Series of Imaging Studies (OASIS): cross-sectional MRI data in young, middle aged, nondemented, and demented older adults. Journal of Cognitive Neuroscience 19, 1498–1507.
  34. Comparison of transfer learning and conventional machine learning applied to structural brain MRI for the early diagnosis and prognosis of Alzheimer’s disease. Frontiers in Neurology 11, 576194.
  35. Detecting neurodegenerative disease from MRI: A brief review on a deep learning perspective, in: Brain Informatics: 12th International Conference, BI 2019, Haikou, China, December 13–15, 2019, Proceedings 12, Springer. pp. 115–125.
  36. Support Vector Machine, in: Machine Learning. Elsevier, pp. 101–121.
  37. Automatic classification of cognitively normal, mild cognitive impairment and Alzheimer’s disease using structural MRI analysis. Informatics in Medicine Unlocked 18, 100305.
  38. Automated anatomical labelling atlas 3. NeuroImage 206, 116189.
  39. What magnetic resonance imaging reveals–A systematic review of the relationship between type II diabetes and associated brain distortions of structure and cognitive functioning. Frontiers in Neuroendocrinology 52, 79–112.
  40. Anatomy-guided brain tumor segmentation and classification, in: Second International Workshop, BrainLes 2016, Athens, Greece, October 17, 2016, Springer. pp. 162–170.
  41. Negative affectivity, aging, and depression: Results from the Neurobiology of Late-Life Depression (NBOLD) study. The American Journal of Geriatric Psychiatry 25, 1135–1149.
  42. Methodology and preliminary results from the neurocognitive outcomes of depression in the elderly study. Journal of Geriatric Psychiatry and Neurology 17, 202–211.
  43. Lower regional gray matter volume in the absence of higher cortical amyloid burden in late-life depression. Scientific Reports 11, 1–11.
  44. Application of deep transfer learning for automated brain abnormality classification using MR images. Cognitive Systems Research 54, 176–188.
  45. EfficientNet: Rethinking model scaling for convolutional neural networks, in: International Conference on Machine Learning, PMLR. pp. 6105–6114.
  46. Convolutional Neural Networks for Classification of T2DM Cognitive Impairment Based on Whole Brain Structural Features. Frontiers in Neuroscience 16.
  47. A multi-site, multi-disorder resting-state magnetic resonance image database. Scientific Data 8, 227.
  48. Imbalanced domain generalization for robust single cell classification in hematological cytomorphology. arXiv preprint arXiv:2303.07771 .
  49. iBEAT V2.0: A multisite-applicable, deep learning-based pipeline for infant cerebral cortical surface reconstruction. Nature Protocols 18, 1488–1509.
  50. Prognostic classification of mild cognitive impairment and Alzheimer’ s disease: MRI independent component analysis. Psychiatry Research: Neuroimaging 224, 81–88.
  51. MRI segmentation and classification of human brain using deep learning for diagnosis of Alzheimer’s disease: A survey. Sensors 20, 3243.
  52. An ensemble learning system for a 4-way classification of Alzheimer’s disease and mild cognitive impairment. Journal of Neuroscience Methods 302, 75–81.
  53. Anatomically interpretable deep learning of brain age captures domain-specific cognitive impairment. Proceedings of the National Academy of Sciences 120, e2214634120.
  54. Input augmentation with SAM: Boosting medical image segmentation with segmentation foundation model. arXiv preprint arXiv:2304.11332 .
  55. Preservational learning improves self-supervised medical image models by reconstructing diverse contexts, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 3499–3509.
  56. Models Genesis. Medical Image Analysis 67, 101840.

Summary

We haven't generated a summary for this paper yet.