Unsupervised Segmentation of Fetal Brain MRI using Deep Learning Cascaded Registration (2307.03579v1)
Abstract: Accurate segmentation of fetal brain magnetic resonance images is crucial for analyzing fetal brain development and detecting potential neurodevelopmental abnormalities. Traditional deep learning-based automatic segmentation, although effective, requires extensive training data with ground-truth labels, typically produced by clinicians through a time-consuming annotation process. To overcome this challenge, we propose a novel unsupervised segmentation method based on multi-atlas segmentation, that accurately segments multiple tissues without relying on labeled data for training. Our method employs a cascaded deep learning network for 3D image registration, which computes small, incremental deformations to the moving image to align it precisely with the fixed image. This cascaded network can then be used to register multiple annotated images with the image to be segmented, and combine the propagated labels to form a refined segmentation. Our experiments demonstrate that the proposed cascaded architecture outperforms the state-of-the-art registration methods that were tested. Furthermore, the derived segmentation method achieves similar performance and inference time to nnU-Net while only using a small subset of annotated data for the multi-atlas segmentation task and none for training the network. Our pipeline for registration and multi-atlas segmentation is publicly available at https://github.com/ValBcn/CasReg.
- Combination strategies in multi-atlas image segmentation: application to brain mr data. IEEE Transactions on Medical Imaging, 28(8):1266–1277, 2009.
- A reproducible evaluation of ANTs similarity metric performance in brain image registration. NeuroImage, 54(3):2033–2044, 2011.
- Voxelmorph: A learning framework for deformable medical image registration. CoRR, abs/1809.05231, 2018.
- A novel approach to multiple anatomical shape analysis: application to fetal ventriculomegaly. Medical Image Analysis, 64:101750, 2020.
- Cortical folding alterations in fetuses with isolated non-severe ventriculomegaly. NeuroImage: Clinical, 18:103–114, 2018.
- Toward the automatic quantification of in utero brain development in 3d structural MRI: A review. Human Brain Mapping, 38(5):2772–2787, 2017.
- Transmorph: Transformer for unsupervised medical image registration. Medical Image Analysis, page 102615, 2022.
- Volumetric transformation of brain anatomy. IEEE Transactions on Medical Imaging, 16(6):864–877, 1997.
- Automatic 3-d model-based neuroanatomical segmentation. Human Brain Mapping, 3(3):190–208, 1995.
- Effects of mediterranean diet or mindfulness-based stress reduction on prevention of small-for-gestational age birth weights in newborns born to at-risk pregnant individuals: the impact bcn randomized clinical trial. Jama, 326(21):2150–2160, 2021.
- Lee R Dice. Measures of the amount of ecologic association between species. Ecology, 26(3):297–302, 1945.
- An automated framework for localization, segmentation and super-resolution reconstruction of fetal brain MRI. NeuroImage, 206:116324, 2020.
- Adversarial similarity network for evaluating image alignment in deep learning based registration. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 739–746. Springer, 2018.
- Global and regional changes in cortical development assessed by MRI in fetuses with isolated nonsevere ventriculomegaly correlate with neonatal neurobehavior. American Journal of Neuroradiology, 40(9):1567–1574, 2019.
- Automatic anatomical brain MRI segmentation combining label propagation and decision fusion. NeuroImage, 33(1):115–126, 2006.
- Multi-atlas segmentation of biomedical images: a survey. Medical Image Analysis, 24(1):205–219, 2015.
- nnu-net: a self-configuring method for deep learning-based biomedical image segmentation. Nature Methods, 18(2):203–211, 2021.
- Spatial transformer networks. Advances in Neural Information Processing Systems, 28, 2015.
- Josef Kittler. Combining classifiers: A theoretical framework. Pattern Analysis and Applications, 1(1):18–27, 1998.
- Mindboggle: automated brain labeling with multiple atlases. BMC Medical Imaging, 5(1):1–14, 2005.
- Elastix: a toolbox for intensity-based medical image registration. IEEE Transactions on Medical Imaging, 29(1):196–205, 2009.
- Learning a probabilistic model for diffeomorphic registration. IEEE Transactions on Medical Imaging, 38(9):2165–2176, 2019.
- Reconstruction of fetal brain MRI with intensity matching and complete outlier removal. Medical Image Analysis, 16(8):1550–1564, 2012.
- Automated labeling of the human brain: A preliminary report on the development and evaluation of a forward-transform method. Human Brain Mapping, 5(4):238–242, 1997.
- Non-rigid image registration using self-supervised fully convolutional networks without training data. In 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), pages 1075–1078. IEEE, 2018.
- The developing human connectome project: A minimal processing pipeline for neonatal cortical surface reconstruction. NeuroImage, 173:88–112, 2018.
- An automatic multi-tissue human fetal brain segmentation benchmark using the fetal tissue annotation dataset. Scientific Data, 8(1):1–14, 2021.
- Evaluation of atlas selection strategies for atlas-based image segmentation with application to confocal microscopy images of bee brains. NeuroImage, 21(4):1428–1442, 2004.
- Multi-classifier framework for atlas-based image segmentation. Pattern Recognition Letters, 26(13):2070–2079, 2005.
- U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention, pages 234–241. Springer, 2015.
- Nonrigid registration using free-form deformations: application to breast mr images. IEEE Transactions on Medical Imaging, 18(8):712–721, 1999.
- Segmentation and classification in MRI and USfetal imaging: recent trends and future prospects. Medical Image Analysis, 51:61–88, 2019.
- An automatic pipeline for atlas-based fetal and neonatal brain segmentation and analysis. Computer Methods and Programs in Biomedicine, 230:107334, 2023.
- Visualizing and understanding convolutional networks. In European conference on computer vision, pages 818–833. Springer, 2014.
- Recursive cascaded networks for unsupervised medical image registration. In Proceedings of the IEEE/CVF international conference on computer vision, pages 10600–10610, 2019.
- Unsupervised 3d end-to-end medical image registration with volume tweening network. IEEE Journal of Biomedical and Health Informatics, 24(5):1394–1404, 2019.