TABSurfer: a Hybrid Deep Learning Architecture for Subcortical Segmentation (2312.08267v1)
Abstract: Subcortical segmentation remains challenging despite its important applications in quantitative structural analysis of brain MRI scans. The most accurate method, manual segmentation, is highly labor intensive, so automated tools like FreeSurfer have been adopted to handle this task. However, these traditional pipelines are slow and inefficient for processing large datasets. In this study, we propose TABSurfer, a novel 3D patch-based CNN-Transformer hybrid deep learning model designed for superior subcortical segmentation compared to existing state-of-the-art tools. To evaluate, we first demonstrate TABSurfer's consistent performance across various T1w MRI datasets with significantly shorter processing times compared to FreeSurfer. Then, we validate against manual segmentations, where TABSurfer outperforms FreeSurfer based on the manual ground truth. In each test, we also establish TABSurfer's advantage over a leading deep learning benchmark, FastSurferVINN. Together, these studies highlight TABSurfer's utility as a powerful tool for fully automated subcortical segmentation with high fidelity.
- “Subcortical shape alterations in major depressive disorder: Findings from the ENIGMA major depressive disorder working group,” Human Brain Mapping, vol. 43, no. 1, pp. 341–351, 2022.
- “Subcortical brain structures and the risk of dementia in the Rotterdam Study,” Alzheimer’s & Dementia, vol. 19, no. 2, pp. 646–657, 2023.
- “A meta-analysis of deep brain structural shape and asymmetry abnormalities in 2,833 individuals with schizophrenia compared with 3,929 healthy volunteers via the ENIGMA Consortium,” Human Brain Mapping, vol. 43, no. 1, pp. 352–372, 2022.
- “Whole Brain Segmentation: Automated Labeling of Neuroanatomical Structures in the Human Brain,” Neuron, vol. 33, no. 3, pp. 341–355, 2002.
- “U-Net: Convolutional Networks for Biomedical Image Segmentation,” in Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015. Springer, 2015, pp. 234–241.
- “3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation,” in Medical Image Computing and Computer-Assisted Intervention – MICCAI 2016. Springer, 2016, pp. 424–432.
- “Fastsurfer - a fast and accurate deep learning based neuroimaging pipeline,” NeuroImage, vol. 219, pp. 117012, Oct. 2020.
- “FastSurferVINN: Building resolution-independence into deep learning segmentation methods—A solution for HighRes brain MRI,” NeuroImage, vol. 251, pp. 118933, 2022.
- “TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation,” 2021.
- “UNETR: Transformers for 3D Medical Image Segmentation,” in Proceedings of the IEEE/CVF winter conference on applications of computer vision, 2022, pp. 574–584.
- “Improving across-dataset brain tissue segmentation for MRI imaging using transformer,” Frontiers in Neuroimaging, vol. 1, pp. 1023481, 2022.
- “Road Extraction by Deep Residual U-Net,” IEEE Geoscience and Remote Sensing Letters, vol. 15, no. 5, pp. 749–753, May 2018.
- “Estimating brain age based on a uniform healthy population with deep learning and structural magnetic resonance imaging,” Neurobiology of Aging, vol. 91, pp. 15–25, 2020.
- “101 labeled brain images and a consistent human cortical labeling protocol,” Frontiers in Neuroscience, vol. 6, pp. 171, 2012.
- “TransBTS: Multimodal Brain Tumor Segmentation Using Transformer,” in Medical Image Computing and Computer Assisted Intervention – MICCAI 2021. Springer, 2021, pp. 109–119.
- “Attention Is All You Need,” Advances in Neural Information Processing Systems, vol. 30, 2017.