Anatomically Constrained Tractography of the Fetal Brain (2403.02444v1)
Abstract: Diffusion-weighted Magnetic Resonance Imaging (dMRI) is increasingly used to study the fetal brain in utero. An important computation enabled by dMRI is streamline tractography, which has unique applications such as tract-specific analysis of the brain white matter and structural connectivity assessment. However, due to the low fetal dMRI data quality and the challenging nature of tractography, existing methods tend to produce highly inaccurate results. They generate many false streamlines while failing to reconstruct streamlines that constitute the major white matter tracts. In this paper, we advocate for anatomically constrained tractography based on an accurate segmentation of the fetal brain tissue directly in the dMRI space. We develop a deep learning method to compute the segmentation automatically. Experiments on independent test data show that this method can accurately segment the fetal brain tissue and drastically improve tractography results. It enables the reconstruction of highly curved tracts such as optic radiations. Importantly, our method infers the tissue segmentation and streamline propagation direction from a diffusion tensor fit to the dMRI data, making it applicable to routine fetal dMRI scans. The proposed method can lead to significant improvements in the accuracy and reproducibility of quantitative assessment of the fetal brain with dMRI.
- The cellular and molecular landscapes of the developing human central nervous system. Neuron, 89(2):248–268, 2016.
- The human brain during the second trimester. CRC Press, 2005.
- Guusje Collin and Martijn P Van Den Heuvel. The ontogeny of the human connectome: development and dynamic changes of brain connectivity across the life span. The Neuroscientist, 19(6):616–628, 2013.
- The early development of brain white matter: a review of imaging studies in fetuses, newborns and infants. Neuroscience, 276:48–71, 2014.
- Emerging cerebral connectivity in the human fetal brain: an mr tractography study. Cerebral cortex, 22(2):455–464, 2012.
- Human fetal brain connectome: structural network development from middle fetal stage to birth. Frontiers in neuroscience, 11:561, 2017.
- Impact of congenital heart disease on fetal brain development and injury. Current opinion in pediatrics, 23(5):502–511, 2011.
- John Kylan Lynch. Epidemiology and classification of perinatal stroke. Seminars in Fetal and Neonatal Medicine, 14(5):245–249, 2009.
- Maternal lifestyle factors in pregnancy risk of attention deficit hyperactivity disorder and associated behaviors: review of the current evidence. American Journal of Psychiatry, 160(6):1028–1040, 2003.
- How accurate are prenatal tractography results? a postnatal in vivo follow-up study using diffusion tensor imaging. Pediatric radiology, 48:486–498, 2018.
- Anatomical characterization of human fetal brain development with diffusion tensor magnetic resonance imaging. Journal of Neuroscience, 29(13):4263–4273, 2009.
- Assessing prenatal white matter connectivity in commissural agenesis. Brain, 136(1):168–179, 2013.
- Radial coherence of diffusion tractography in the cerebral white matter of the human fetus: neuroanatomic insights. Cerebral cortex, 24(3):579–592, 2014.
- Feasibility and added value of fetal dti tractography in the evaluation of an isolated short corpus callosum: Preliminary results. American Journal of Neuroradiology, 43(1):132–138, 2022.
- Delineation of early brain development from fetuses to infants with diffusion mri and beyond. Neuroimage, 185:836–850, 2019.
- White and gray matter development in human fetal, newborn and pediatric brains. Neuroimage, 33(1):27–38, 2006.
- Disrupted developmental organization of the structural connectome in fetuses with corpus callosum agenesis. Neuroimage, 111:277–288, 2015.
- Automated delineation of white matter fiber tracts with a multiple region-of-interest approach. Neuroimage, 59(4):3690–3700, 2012.
- Recognition of white matter bundles using local and global streamline-based registration and clustering. NeuroImage, 170:283–295, 2018.
- Registration-free analysis of diffusion mri tractography data across subjects through the human lifespan. NeuroImage, 214:116703, 2020.
- Brain graphs: graphical models of the human brain connectome. Annual review of clinical psychology, 7:113–140, 2011.
- Building connectomes using diffusion mri: why, how and but. NMR in Biomedicine, 32(4):e3752, 2019.
- White matter integrity, fiber count, and other fallacies: the do’s and don’ts of diffusion mri. Neuroimage, 73:239–254, 2013.
- Derek K Jones. Challenges and limitations of quantifying brain connectivity in vivo with diffusion mri. Imaging in Medicine, 2(3):341, 2010.
- Diffusion mri tractography for neurosurgery: the basics, current state, technical reliability and challenges. Physics in Medicine & Biology, 66(15):15TR01, 2021.
- Dti tractography of the human brain’s language pathways. Cerebral cortex, 18(11):2471–2482, 2008.
- White matter tractography for neurosurgical planning: A topography-based review of the current state of the art. NeuroImage: Clinical, 15:659–672, 2017.
- Diffusion-based tractography in neurological disorders: concepts, applications, and future developments. The Lancet Neurology, 7(8):715–727, 2008.
- Diffusion tensor tractography reveals abnormal topological organization in structural cortical networks in alzheimer’s disease. Journal of Neuroscience, 30(50):16876–16885, 2010.
- Structural mri connectome in development: challenges of the changing brain. The British journal of radiology, 87(1039):20140086, 2014.
- Fetal brain growth portrayed by a spatiotemporal diffusion tensor mri atlas computed from in utero images. NeuroImage, 185:593–608, 2019.
- Development of human white matter pathways in utero over the second and third trimester. Proceedings of the National Academy of Sciences, 118(20), 2021.
- In utero diffusion tensor imaging of the fetal brain: a reproducibility study. NeuroImage: Clinical, 15:601–612, 2017.
- Diffusion tensor imaging for understanding brain development in early life. Annual review of psychology, 66:853–876, 2015.
- In utero tractography of fetal white matter development. Neuroimage, 43(2):213–224, 2008.
- In vivo tractography of fetal association fibers. PloS one, 10(3):e0119536, 2015.
- White matter maturation of normal human fetal brain. an in vivo diffusion tensor tractography study. Brain and behavior, 1(2):95–108, 2011.
- Development of cerebellar connectivity in human fetal brains revealed by high angular resolution diffusion tractography. Neuroimage, 96:326–333, 2014.
- Radial and tangential neuronal migration pathways in the human fetal brain: anatomically distinct patterns of diffusion mri coherence. Neuroimage, 79:412–422, 2013.
- Exploring early human brain development with structural and physiological neuroimaging. Neuroimage, 187:226–254, 2019.
- Asymmetry of white matter pathways in developing human brains. Cerebral cortex, 25(9):2883–2893, 2015.
- In vivo characterization of emerging white matter microstructure in the fetal brain in the third trimester. Human brain mapping, 41(12):3177–3185, 2020.
- Tractography of the cerebellar peduncles in second-and third-trimester fetuses. American Journal of Neuroradiology, 42(1):194–200, 2021.
- Development of axonal pathways in the human fetal fronto-limbic brain: histochemical characterization and diffusion tensor imaging. Journal of anatomy, 217(4):400–417, 2010.
- Validation of in utero tractography of human fetal commissural and internal capsule fibers with histological structure tensor analysis. Frontiers in neuroanatomy, 9:164, 2015.
- Third-trimester in utero fetal brain diffusion tensor imaging fiber tractography: a prospective longitudinal characterization of normal white matter tract development. Pediatric radiology, 50:973–983, 2020.
- Spatiotemporal changes in diffusivity and anisotropy in fetal brain tractography. Human brain mapping, 42(17):5771–5784, 2021.
- Brain volume and metabolism in fetuses with congenital heart disease: evaluation with quantitative magnetic resonance imaging and spectroscopy. Circulation, 121(1):26–33, 2010.
- Association of isolated congenital heart disease with fetal brain maturation. American Journal of Neuroradiology, 41(8):1525–1531, 2020.
- Prenatal mr diffusion tractography in a fetus with complete corpus callosum agenesis. Neuropediatrics, 42(03):122–123, 2011.
- Spatiotemporal tissue maturation of thalamocortical pathways in the human fetal brain. Elife, 12:e83727, 2023.
- Motion-robust diffusion-weighted brain mri reconstruction through slice-level registration-based motion tracking. IEEE transactions on medical imaging, 35(10):2258–2269, 2016.
- Common misconceptions, hidden biases and modern challenges of dmri tractography. Journal of neural engineering, 17(1):011001, 2020.
- Mapping structural connectivity using diffusion mri: Challenges and opportunities. Journal of Magnetic Resonance Imaging, 53(6):1666–1682, 2021.
- Multiple fibers: beyond the diffusion tensor. In Diffusion Mri, pages 105–123. Elsevier, 2014.
- Asymmetric fiber trajectory distribution estimation using streamline differential equation. Medical image analysis, 63:101686, 2020.
- Multi-component atlas of fetal brain development via decomposition of diffusion mri. In ISMRM Virtual Conference & Exhibition, Date: 2020/08/08-2020/08/13, Location: online, volume 28, 2020.
- Higher order spherical harmonics reconstruction of fetal diffusion mri with intensity correction. IEEE transactions on medical imaging, 39(4):1104–1113, 2019.
- A unifying theoretical and algorithmic framework for least squares methods of estimation in diffusion tensor imaging. Journal of magnetic resonance, 182(1):115–125, 2006.
- Reconstruction of the orientation distribution function in single-and multiple-shell q-ball imaging within constant solid angle. Magnetic resonance in medicine, 64(2):554–566, 2010.
- Maxime Descoteaux. High angular resolution diffusion MRI: from local estimation to segmentation and tractography. PhD thesis, Université Nice Sophia Antipolis, 2008.
- Anatomically-constrained tractography: improved diffusion mri streamlines tractography through effective use of anatomical information. Neuroimage, 62(3):1924–1938, 2012.
- Brain tissue classification based on dti using an improved fuzzy c-means algorithm with spatial constraints. Magnetic Resonance Imaging, 31(9):1623–1630, 2013.
- Brain tissue segmentation based on diffusion mri using l0 sparse-group representation classification. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, pages 132–139. Springer, 2015.
- Automated pixel-wise brain tissue segmentation of diffusion-weighted images via machine learning. NMR in Biomedicine, 31(7):e3931, 2018.
- Q-space deep learning: twelve-fold shorter and model-free diffusion mri scans. IEEE transactions on medical imaging, 35(5):1344–1351, 2016.
- Deep learning based segmentation of brain tissue from diffusion mri. NeuroImage, 233:117934, 2021.
- Deep learning based brain tissue segmentation from novel diffusion kurtosis imaging features. In Annual Meeting of the International Society for Magnetic Resonance in Medicine, 2020.
- Deep convolutional neural networks for multi-modality isointense infant brain image segmentation. NeuroImage, 108:214–224, 2015.
- A review on automatic fetal and neonatal brain mri segmentation. NeuroImage, 170:231–248, 2018.
- A deep attentive convolutional neural network for automatic cortical plate segmentation in fetal mri. IEEE transactions on medical imaging, 40(4):1123–1133, 2020.
- Segmentation of the cortical plate in fetal brain mri with a topological loss. In Uncertainty for Safe Utilization of Machine Learning in Medical Imaging, and Perinatal Imaging, Placental and Preterm Image Analysis, pages 200–209. Springer, 2021.
- Distributionally robust segmentation of abnormal fetal brain 3d mri. In Uncertainty for Safe Utilization of Machine Learning in Medical Imaging, and Perinatal Imaging, Placental and Preterm Image Analysis, pages 263–273. Springer, 2021.
- Fetal brain tissue annotation and segmentation challenge results. Medical Image Analysis, 88:102833, 2023.
- Learning to segment fetal brain tissue from noisy annotations. Medical Image Analysis, 85:102731, 2023.
- Detailed anatomic segmentations of a fetal brain diffusion tensor imaging atlas between 23 and 30 weeks of gestation. Human Brain Mapping, 44(4):1593–1602, 2023.
- Deformable registration of diffusion tensor mr images with explicit orientation optimization. Medical image analysis, 10(5):764–785, 2006.
- A generic interpolator for multi-label images. Insight J, 950, 2014.
- Simultaneous truth and performance level estimation through fusion of probabilistic segmentations. IEEE transactions on medical imaging, 32(10):1840–1852, 2013.
- An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929, 2020.
- Attention is all you need. In Advances in neural information processing systems, pages 5998–6008, 2017.
- Barlow twins: Self-supervised learning via redundancy reduction. In International Conference on Machine Learning, pages 12310–12320. PMLR, 2021.
- Vicreg: Variance-invariance-covariance regularization for self-supervised learning. arXiv preprint arXiv:2105.04906, 2021.
- Contrast to divide: Self-supervised pre-training for learning with noisy labels. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 1657–1667, 2022.
- Contrastive learning improves model robustness under label noise. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2703–2708, 2021.
- Matteo Bastiani et al. Automated processing pipeline for neonatal diffusion mri in the developing human connectome project. NeuroImage, 185:750–763, 2019.
- Adam: A method for stochastic optimization. In Proceedings of the 3rd International Conference on Learning Representations (ICLR), 2014.
- Improved probabilistic streamlines tractography by 2nd order integration over fibre orientation distributions. In Proceedings of the international society for magnetic resonance in medicine, volume 1670. John Wiley & Sons, Inc, New Jersey, 2010.
- Mrtrix3: A fast, flexible and open software framework for medical image processing and visualisation. Neuroimage, 202:116137, 2019.
- Diffusion toolkit: a software package for diffusion imaging data processing and tractography. In Proc Intl Soc Mag Reson Med, volume 15. Berlin, 2007.
- The white matter query language: a novel approach for describing human white matter anatomy. Brain Structure and Function, 221:4705–4721, 2016.
- Parcellation of the healthy neonatal brain into 107 regions using atlas propagation through intermediate time points in childhood. Frontiers in neuroscience, 10:220, 2016.
- Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain. Medical image analysis, 12(1):26–41, 2008.
- Three-dimensional tracking of axonal projections in the brain by magnetic resonance imaging. Annals of Neurology: Official Journal of the American Neurological Association and the Child Neurology Society, 45(2):265–269, 1999.
- Tractseg-fast and accurate white matter tract segmentation. NeuroImage, 183:239–253, 2018.
- Tractography of fetal visual pathway. Ultrasound in Obstetrics & Gynecology, 62(4):614–615, 2023.
- Camilo Calixto (5 papers)
- Camilo Jaimes (6 papers)
- Matheus D. Soldatelli (2 papers)
- Simon K. Warfield (27 papers)
- Ali Gholipour (34 papers)
- Davood Karimi (35 papers)