Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Longformer: Longitudinal Transformer for Alzheimer's Disease Classification with Structural MRIs (2302.00901v4)

Published 2 Feb 2023 in cs.CV

Abstract: Structural magnetic resonance imaging (sMRI) is widely used for brain neurological disease diagnosis; while longitudinal MRIs are often collected to monitor and capture disease progression, as clinically used in diagnosing Alzheimer's disease (AD). However, most current methods neglect AD's progressive nature and only take a single sMRI for recognizing AD. In this paper, we consider the problem of leveraging the longitudinal MRIs of a subject for AD identification. To capture longitudinal changes in sMRIs, we propose a novel model Longformer, a spatiotemporal transformer network that performs attention mechanisms spatially on sMRIs at each time point and integrates brain region features over time to obtain longitudinal embeddings for classification. Our Longformer achieves state-of-the-art performance on two binary classification tasks of separating different stages of AD using the ADNI dataset. Our source code is available at https://github.com/Qybc/LongFormer.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (43)
  1. Layer normalization. arXiv preprint arXiv:1607.06450, 2016.
  2. Voxelmorph: a learning framework for deformable medical image registration. IEEE transactions on medical imaging, 38(8):1788–1800, 2019.
  3. Learning to exploit temporal structure for biomedical vision-language processing. arXiv preprint arXiv:2301.04558, 2023.
  4. Deep-learning-assisted diagnosis for knee magnetic resonance imaging: development and retrospective validation of mrnet. PLoS medicine, 15(11):e1002699, 2018.
  5. End-to-end object detection with transformers. In European conference on computer vision, pages 213–229. Springer, 2020.
  6. Patterns of temporal lobe atrophy in semantic dementia and alzheimer’s disease. Annals of neurology, 49(4):433–442, 2001.
  7. Med3d: Transfer learning for 3d medical image analysis. arXiv preprint arXiv:1904.00625, 2019.
  8. Rnn-based longitudinal analysis for diagnosis of alzheimer’s disease. Computerized Medical Imaging and Graphics, 73:1–10, 2019.
  9. Fast predictive simple geodesic regression. Medical image analysis, 56:193–209, 2019.
  10. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929, 2020.
  11. Convit: Improving vision transformers with soft convolutional inductive biases. In International Conference on Machine Learning, pages 2286–2296. PMLR, 2021.
  12. Introducing transfer learning to 3d resnet-18 for alzheimer’s disease detection on mri images. In 2020 35th international conference on image and vision computing New Zealand (IVCNZ), pages 1–6. IEEE, 2020.
  13. The australian imaging, biomarkers and lifestyle (aibl) study of aging: methodology and baseline characteristics of 1112 individuals recruited for a longitudinal study of alzheimer’s disease. International psychogeriatrics, 21(4):672–687, 2009.
  14. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 770–778, 2016.
  15. Fast geodesic regression for population-based image analysis. In Medical Image Computing and Computer Assisted Intervention- MICCAI 2017: 20th International Conference, Quebec City, QC, Canada, September 11-13, 2017, Proceedings, Part I 20, pages 317–325. Springer, 2017.
  16. Vgg-tswinformer: Transformer-based deep learning model for early alzheimer’s disease prediction. Computer Methods and Programs in Biomedicine, 229:107291, 2023.
  17. Densely connected convolutional networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 4700–4708, 2017.
  18. Densenet: Implementing efficient convnet descriptor pyramids. arXiv preprint arXiv:1404.1869, 2014.
  19. The alzheimer’s disease neuroimaging initiative (adni): Mri methods. Journal of Magnetic Resonance Imaging: An Official Journal of the International Society for Magnetic Resonance in Medicine, 27(4):685–691, 2008.
  20. M3t: Three-dimensional medical image classifier using multi-plane and multi-slice transformer. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 20718–20729, 2022.
  21. Deep 3d convolutional neural network architectures for alzheimer’s disease diagnosis. In Intelligent Information and Database Systems: 10th Asian Conference, ACIIDS 2018, Dong Hoi City, Vietnam, March 19-21, 2018, Proceedings, Part I 10, pages 287–296. Springer, 2018.
  22. Residual and plain convolutional neural networks for 3d brain mri classification. In 2017 IEEE 14th international symposium on biomedical imaging (ISBI 2017), pages 835–838. IEEE, 2017.
  23. Trans-resnet: Integrating transformers and cnns for alzheimer’s disease classification. In 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI), pages 1–5. IEEE, 2022.
  24. Comparison of machine learning approaches for enhancing alzheimer’s disease classification. PeerJ, 9:e10549, 2021.
  25. Hierarchical fully convolutional network for joint atrophy localization and alzheimer’s disease diagnosis using structural mri. IEEE transactions on pattern analysis and machine intelligence, 42(4):880–893, 2018.
  26. Open access series of imaging studies (oasis): cross-sectional mri data in young, middle aged, nondemented, and demented older adults. Journal of cognitive neuroscience, 19(9):1498–1507, 2007.
  27. How do vision transformers work? arXiv preprint arXiv:2202.06709, 2022.
  28. Predicting diagnosis 4 years prior to alzheimer’s disease incident. NeuroImage: Clinical, 34:102993, 2022.
  29. Development and validation of an interpretable deep learning framework for alzheimer’s disease classification. Brain, 143(6):1920–1933, 2020.
  30. 3d densenet ensemble in 4-way classification of alzheimer’s disease. In Brain Informatics: 13th International Conference, BI 2020, Padua, Italy, September 19, 2020, Proceedings 13, pages 85–96. Springer, 2020.
  31. Reinforcement learning based disease progression model for alzheimer’s disease. Advances in Neural Information Processing Systems, 34:20903–20915, 2021.
  32. Dynamics of gray matter loss in alzheimer’s disease. Journal of neuroscience, 23(3):994–1005, 2003.
  33. Training data-efficient image transformers & distillation through attention. In International Conference on Machine Learning, pages 10347–10357. PMLR, 2021.
  34. Attention is all you need. Advances in neural information processing systems, 30, 2017.
  35. Seqformer: Sequential transformer for video instance segmentation. In European Conference on Computer Vision, pages 553–569. Springer, 2022.
  36. Vision transformer with deformable attention. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 4794–4803, 2022.
  37. Visual explanations from deep 3d convolutional neural networks for alzheimer’s disease classification. In AMIA annual symposium proceedings, volume 2018, page 1571. American Medical Informatics Association, 2018.
  38. Upgrading optical flow to 3d scene flow through optical expansion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1334–1343, 2020.
  39. A 3d densely connected convolution neural network with connection-wise attention mechanism for alzheimer’s disease classification. Magnetic Resonance Imaging, 78:119–126, 2021.
  40. 3d global fourier network for alzheimer’s disease diagnosis using structural mri. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 34–43. Springer, 2022.
  41. Rethinking semantic segmentation from a sequence-to-sequence perspective with transformers. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 6881–6890, 2021.
  42. Dual attention multi-instance deep learning for alzheimer’s disease diagnosis with structural mri. IEEE Transactions on Medical Imaging, 40(9):2354–2366, 2021.
  43. Deformable detr: Deformable transformers for end-to-end object detection. arXiv preprint arXiv:2010.04159, 2020.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (2)
  1. Qiuhui Chen (9 papers)
  2. Yi Hong (63 papers)
Citations (6)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now