wmh_seg: Transformer based U-Net for Robust and Automatic White Matter Hyperintensity Segmentation across 1.5T, 3T and 7T (2402.12701v1)
Abstract: White matter hyperintensity (WMH) remains the top imaging biomarker for neurodegenerative diseases. Robust and accurate segmentation of WMH holds paramount significance for neuroimaging studies. The growing shift from 3T to 7T MRI necessitates robust tools for harmonized segmentation across field strengths and artifacts. Recent deep learning models exhibit promise in WMH segmentation but still face challenges, including diverse training data representation and limited analysis of MRI artifacts' impact. To address these, we introduce wmh_seg, a novel deep learning model leveraging a transformer-based encoder from SegFormer. wmh_seg is trained on an unmatched dataset, including 1.5T, 3T, and 7T FLAIR images from various sources, alongside with artificially added MR artifacts. Our approach bridges gaps in training diversity and artifact analysis. Our model demonstrated stable performance across magnetic field strengths, scanner manufacturers, and common MR imaging artifacts. Despite the unique inhomogeneity artifacts on ultra-high field MR images, our model still offers robust and stable segmentation on 7T FLAIR images. Our model, to date, is the first that offers quality white matter lesion segmentation on 7T FLAIR images.
- White matter hyperintensities are a core feature of alzheimer’s disease: evidence from the dominantly inherited alzheimer network. Annals of neurology, 79(6):929–939, 2016.
- Diagnostic criteria for multiple sclerosis: 2010 revisions to the mcdonald criteria. Annals of neurology, 69(2):292–302, 2011.
- Changes in white matter as determinant of global functional decline in older independent outpatients: three year follow-up of ladis (leukoaraiosis and disability) study cohort. Bmj, 339, 2009.
- Lesion location matters: the relationships between white matter hyperintensities on cognition in the healthy elderly. Journal of Cerebral Blood Flow & Metabolism, 39(1):36–43, 2019.
- Cerebrovascular disease and threshold for dementia in the early stages of alzheimer’s disease. The Lancet, 354(9182):919–920, 1999.
- Cerebral infarcts in patients with autopsy-proven alzheimer’s disease: Cerad, part xviii. Neurology, 51(1):159–162, 1998.
- Cerebral infarctions and the likelihood of dementia from alzheimer disease pathology. Neurology, 62(7):1148–1155, 2004.
- Brain infarction and the clinical expression of alzheimer disease: the nun study. Jama, 277(10):813–817, 1997.
- Aliza Bitton Ben-Zacharia. Therapeutics for multiple sclerosis symptoms. Mount Sinai Journal of Medicine: A Journal of Translational and Personalized Medicine, 78(2):176–191, 2011.
- Measuring progression of cerebral white matter lesions on mri: visual rating and volumetrics. Neurology, 62(9):1533–1539, 2004.
- Fully automatic segmentation of white matter hyperintensities in mr images of the elderly. Neuroimage, 28(3):607–617, 2005.
- White matter hyperintensities segmentation: a new semi-automated method. Frontiers in aging neuroscience, 5:76, 2013.
- Lst: A lesion segmentation tool for spm. Manual/Documentation for version, 2:15, 2017.
- A fully automated method for quantifying and localizing white matter hyperintensities on mr images. Psychiatry Research: Neuroimaging, 148(2-3):133–142, 2006.
- Fluid attenuated inversion recovery (flair) mri at 7.0 tesla: comparison with 1.5 and 3.0 tesla. European radiology, 20:915–922, 2010.
- Hypertension correlates with lenticulostriate arteries visualized by 7t magnetic resonance angiography. Hypertension, 54(5):1050–1056, 2009.
- A paired dataset of t1-and t2-weighted mri at 3 tesla and 7 tesla. Scientific Data, 10(1):489, 2023.
- Statistical power comparisons at 3t and 7t with a go/nogo task. NeuroImage, 175:100–110, 2018.
- U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, pages 234–241. Springer, 2015.
- Skip connection u-net for white matter hyperintensities segmentation from mri. IEEE Access, 7:155194–155202, 2019.
- Standardized assessment of automatic segmentation of white matter hyperintensities and results of the wmh segmentation challenge. IEEE transactions on medical imaging, 38(11):2556–2568, 2019.
- Segformer: Simple and efficient design for semantic segmentation with transformers. Advances in Neural Information Processing Systems, 34:12077–12090, 2021.
- Bruce Fischl. Freesurfer. Neuroimage, 62(2):774–781, 2012.
- Bianca (brain intensity abnormality classification algorithm): A new tool for automated segmentation of white matter hyperintensities. Neuroimage, 141:191–205, 2016.
- White matter hyperintensities segmentation using the ensemble u-net with multi-scale highlighting foregrounds. Neuroimage, 237:118140, 2021.
- Data augmentation for medical imaging: A systematic literature review. Computers in Biology and Medicine, 152:106391, 2023.
- Improving deep learning with generic data augmentation. In 2018 IEEE symposium series on computational intelligence (SSCI), pages 1542–1547. IEEE, 2018.
- Torchio: a python library for efficient loading, preprocessing, augmentation and patch-based sampling of medical images in deep learning. Computer Methods and Programs in Biomedicine, 208:106236, 2021.
- Do vision transformers see like convolutional neural networks? Advances in Neural Information Processing Systems, 34:12116–12128, 2021.
- Vishal Rajput. Robustness of different loss functions and their impact on network’s learning. Available at SSRN 4065778.
- Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.