Train-Free Segmentation in MRI with Cubical Persistent Homology (2401.01160v1)
Abstract: We describe a new general method for segmentation in MRI scans using Topological Data Analysis (TDA), offering several advantages over traditional machine learning approaches. It works in three steps, first identifying the whole object to segment via automatic thresholding, then detecting a distinctive subset whose topology is known in advance, and finally deducing the various components of the segmentation. Although convoking classical ideas of TDA, such an algorithm has never been proposed separately from deep learning methods. To achieve this, our approach takes into account, in addition to the homology of the image, the localization of representative cycles, a piece of information that seems never to have been exploited in this context. In particular, it offers the ability to perform segmentation without the need for large annotated data sets. TDA also provides a more interpretable and stable framework for segmentation by explicitly mapping topological features to segmentation components. By adapting the geometric object to be detected, the algorithm can be adjusted to a wide range of data segmentation challenges. We carefully study the examples of glioblastoma segmentation in brain MRI, where a sphere is to be detected, as well as myocardium in cardiac MRI, involving a cylinder, and cortical plate detection in fetal brain MRI, whose 2D slices are circles. We compare our method to state-of-the-art algorithms.
- Identifying the best machine learning algorithms for brain tumor segmentation, progression assessment, and overall survival prediction in the brats challenge. arXiv preprint arXiv:1811.02629, 2018.
- 2014 esc guidelines on diagnosis and management of hypertrophic cardiomyopathy. Kardiologia Polska (Polish Heart Journal), 72(11):1054–1126, 2014.
- A review on automatic fetal and neonatal brain mri segmentation. NeuroImage, 170:231–248, 2018.
- Glioma segmentation with cascaded UNet. In International MICCAI Brainlesion Workshop, pages 189–198. Springer, 2018.
- Deep learning techniques for automatic mri cardiac multi-structures segmentation and diagnosis: is the problem solved? IEEE transactions on medical imaging, 37(11):2514–2525, 2018.
- An automatic multi-tissue human fetal brain segmentation benchmark using the fetal tissue annotation dataset. Scientific data, 8(1):167, 2021.
- A persistent homology-based topological loss function for multi-class cnn segmentation of cardiac mri. In International Workshop on Statistical Atlases and Computational Models of the Heart, pages 3–13. Springer, 2021.
- Cardiac segmentation with strong anatomical guarantees. IEEE transactions on medical imaging, 39(11):3703–3713, 2020.
- Topology-preserving deep image segmentation. Advances in neural information processing systems, 32, 2019.
- Segmentation of the cortical plate in fetal brain mri with a topological loss. In Uncertainty for Safe Utilization of Machine Learning in Medical Imaging, and Perinatal Imaging, Placental and Preterm Image Analysis: 3rd International Workshop, UNSURE 2021, and 6th International Workshop, PIPPI 2021, Held in Conjunction with MICCAI 2021, Strasbourg, France, October 1, 2021, Proceedings 3, pages 200–209. Springer, 2021.
- Development of prediction models for one-year brain tumour survival using machine learning: a comparison of accuracy and interpretability. Computer methods and programs in biomedicine, 233:107482, 2023.
- Ujjwal Baid and et al. The RSNA-ASNR-MICCAI BraTS 2021 benchmark on brain tumor segmentation and radiogenomic classification. arXiv:2107.02314, 2021.
- Bjoern H. Menze and et al. The multimodal brain tumor image segmentation benchmark (brats). IEEE Transactions on Medical Imaging, 34(10):1993–2024, 2015.
- Advancing the cancer genome atlas glioma MRI collections with expert segmentation labels and radiomic features. Scientific Data, 4(1), 2017.
- Simultaneous truth and performance level estimation (staple): an algorithm for the validation of image segmentation. IEEE transactions on medical imaging, 23(7):903–921, 2004.
- nnu-net: a self-configuring method for deep learning-based biomedical image segmentation. Nature methods, 18(2):203–211, 2021.
- Ensembles of densely-connected cnns with label-uncertainty for brain tumor segmentation. In Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries: 4th International Workshop, BrainLes 2018, Held in Conjunction with MICCAI 2018, Granada, Spain, September 16, 2018, Revised Selected Papers, Part II 4, pages 456–465. Springer, 2019.
- Efficient multi-scale 3d cnn with fully connected crf for accurate brain lesion segmentation. Medical image analysis, 36:61–78, 2017.
- Clinicopathological analysis of t2-flair mismatch sign in lower-grade gliomas. Scientific reports, 10(1):1–6, 2020.
- Quantification of left ventricular indices from ssfp cine imaging: impact of real-world variability in analysis methodology and utility of geometric modeling. Journal of Magnetic Resonance Imaging, 37(5):1213–1222, 2013.
- A normative spatiotemporal mri atlas of the fetal brain for automatic segmentation and analysis of early brain growth. Scientific reports, 7(1):476, 2017.
- Atlas-based segmentation of brain tumor images using a markov random field-based tumor growth model and non-rigid registration. In 2010 annual international conference of the IEEE engineering in medicine and biology, pages 4080–4083. IEEE, 2010.
- Decision forests for tissue-specific segmentation of high-grade gliomas in multi-channel mr. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2012: 15th International Conference, Nice, France, October 1-5, 2012, Proceedings, Part III 15, pages 369–376. Springer, 2012.
- Brain tumor detection and segmentation in a crf (conditional random fields) framework with pixel-pairwise affinity and superpixel-level features. International journal of computer assisted radiology and surgery, 9:241–253, 2014.
- Detection and classification of brain tumor based on multilevel segmentation with convolutional neural network. Journal of Biomedical Science and Engineering, 13(4):45–53, 2020.
- 3d brain glioma segmentation in mri through integrating multiple densely connected 2d convolutional neural networks. Journal of Zhejiang University-SCIENCE B, 22(6):462–475, 2021.
- Canet: Context aware network for brain glioma segmentation. IEEE Transactions on Medical Imaging, 40(7):1763–1777, 2021.
- Extending nn-unet for brain tumor segmentation. In International MICCAI Brainlesion Workshop, pages 173–186. Springer, 2022.
- Yading Yuan. Evaluating scale attention network for automatic brain tumor segmentation with large multi-parametric mri database. In International MICCAI Brainlesion Workshop, pages 42–53. Springer, 2022.
- Optimized u-net for brain tumor segmentation. In International MICCAI Brainlesion Workshop, pages 15–29. Springer, 2022.
- Redundancy reduction in semantic segmentation of 3d brain tumor mris. arXiv preprint arXiv:2111.00742, 2021.
- Nnunet with region-based training and loss ensembles for brain tumor segmentation. In International MICCAI Brainlesion Workshop, pages 421–430. Springer, 2022.
- Coupling nnu-nets with expert knowledge for accurate brain tumor segmentation from mri. In International MICCAI Brainlesion Workshop, pages 197–209. Springer, 2022.
- Ensemble outperforms single models in brain tumor segmentation. In International MICCAI Brainlesion Workshop, pages 451–462. Springer, 2022.
- Hnf-netv2 for brain tumor segmentation using multi-modal mr imaging. arXiv preprint arXiv:2202.05268, 2022.
- Automatic cardiac disease assessment on cine-mri via time-series segmentation and domain specific features. In Statistical Atlases and Computational Models of the Heart. ACDC and MMWHS Challenges: 8th International Workshop, STACOM 2017, Held in Conjunction with MICCAI 2017, Quebec City, Canada, September 10-14, 2017, Revised Selected Papers 8, pages 120–129. Springer, 2018.
- Fetal brain tissue annotation and segmentation challenge results. Medical Image Analysis, 88:102833, 2023.
- A deep attentive convolutional neural network for automatic cortical plate segmentation in fetal mri. IEEE transactions on medical imaging, 40(4):1123–1133, 2020.
- Steve Y Oudot. Persistence theory: from quiver representations to data analysis. Mathematical Surveys and Monographs, 209:218, 2015.
- Topological data analysis in biomedicine: A review. Journal of Biomedical Informatics, 130:104082, 2022.
- Topological data analysis in medical imaging: current state of the art. Insights into Imaging, 14(1):1–10, 2023.
- Gunnar Carlsson. Topology and data. Bulletin of the American Mathematical Society, 46(2):255–308, 2009.
- An introduction to Topological Data Analysis: fundamental and practical aspects for data scientists. Frontiers in Artificial Intelligence, 4, 2021.
- Explicit topological priors for deep-learning based image segmentation using persistent homology. In International Conference on Information Processing in Medical Imaging, pages 16–28. Springer, 2019.
- A topological loss function for deep-learning based image segmentation using persistent homology. IEEE TPAMI, 2020.
- A topological loss function for deep-learning based image segmentation using persistent homology. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020.
- Multi-dimensional topological loss for cortical plate segmentation in fetal brain mri. arXiv preprint arXiv:2208.07566, 2022.
- Topology-aware focal loss for 3d image segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 580–589, 2023.
- Topology preserving compositionality for robust medical image segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 543–552, 2023.
- Topology-sensitive weighting model for myocardial segmentation. Computers in Biology and Medicine, 165:107286, 2023.
- Fetal cortex segmentation with topology and thickness loss constraints. In Workshop on the Ethical and Philosophical Issues in Medical Imaging, pages 123–133. Springer, 2022.
- Persistent homology for fast tumor segmentation in whole slide histology images. Procedia Computer Science, 90:119–124, 2016.
- Fast and accurate tumor segmentation of histology images using persistent homology and deep convolutional features. Medical image analysis, 55:1–14, 2019.
- 3d region segmentation using topological persistence. In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 1079–1084. IEEE, 2016.
- Persistent homology for object segmentation in multidimensional grayscale images. Pattern Recognition Letters, 112:277–284, 2018.
- Persistence-based segmentation of deformable shapes. In 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, pages 45–52. IEEE, 2010.
- Persistence-based clustering in riemannian manifolds. Journal of the ACM (JACM), 60(6):1–38, 2013.
- Fast glioblastoma detection in fluid-attenuated inversion recovery (flair) images by topological explainable automatic machine learning. arXiv preprint arXiv:1912.08167, 2019.
- Towards personalized diagnosis of glioblastoma in fluid-attenuated inversion recovery (flair) by topological interpretable machine learning. Mathematics, 8(5):770, 2020.
- Predicting clinical outcomes in glioblastoma: an application of topological and functional data analysis. Journal of the American Statistical Association, 115(531):1139–1150, 2020.
- Topological detection of alzheimer’s disease using betti curves. In Interpretability of Machine Intelligence in Medical Image Computing, and Topological Data Analysis and Its Applications for Medical Data, pages 119–128. Springer, 2021.
- Hepatic tumor classification using texture and topology analysis of non-contrast-enhanced three-dimensional t1-weighted mr images with a radiomics approach. Scientific reports, 9(1):8764, 2019.
- Computer-aided classification of hepatocellular ballooning in liver biopsies from patients with nash using persistent homology. Computer Methods and Programs in Biomedicine, 195:105614, 2020.
- Persistent homology approach distinguishes potential pattern between “early” and “not early” hepatic decompensation groups using mri modalities. Current Directions in Biomedical Engineering, 7(2):488–491, 2021.
- Persistent homology of tumor ct scans is associated with survival in lung cancer. Medical physics, 48(11):7043–7051, 2021.
- Using persistent homology topological features to characterize medical images: Case studies on lung and brain cancers. The Annals of Applied Statistics, 17(3):2192–2211, 2023.
- Persistent brain network homology from the perspective of dendrogram. IEEE transactions on medical imaging, 31(12):2267–2277, 2012.
- Tracing the evolution of multi-scale functional networks in a mouse model of depression using persistent brain network homology. NeuroImage, 101:351–363, 2014.
- A topological classifier to characterize brain states: When shape matters more than variance. Plos one, 18(10):e0292049, 2023.
- Persistent homology analysis of brain artery trees. The annals of applied statistics, 10(1):198, 2016.
- Decorated merge trees for persistent topology. Journal of Applied and Computational Topology, pages 1–58, 2022.
- Topological persistence and simplification. In Proceedings 41st annual symposium on foundations of computer science, pages 454–463. IEEE, 2000.
- Computing persistent homology. Discrete & Computational Geometry, 33(2):249–274, 2005.
- Finding the homology of submanifolds with high confidence from random samples. Discrete & Computational Geometry, 39(1-3):419–441, 2008.
- Allen Hatcher. Algebraic topology. Cambridge Univ. Press, Cambridge, 2000.
- giotto-tda:: A topological data analysis toolkit for machine learning and data exploration. J. Mach. Learn. Res., 22(39):1–6, 2021.
- Cubical ripser: Software for computing persistent homology of image and volume data. arXiv preprint arXiv:2005.12692, 2020.
- The gudhi library: Simplicial complexes and persistent homology. In International congress on mathematical software, pages 167–174. Springer, 2014.
- Duality in persistent homology of images. arXiv preprint arXiv:2005.04597, 2020.
- Minimal cycle representatives in persistent homology using linear programming: an empirical study with user’s guide. Frontiers in artificial intelligence, 4:681117, 2021.
- The SRI24 multichannel atlas of normal adult human brain structure. Human brain mapping, 31(5):798–819, 2010.
- SciPy 1.0: Fundamental Algorithms for Scientific Computing in Python. Nature Methods, 17:261–272, 2020.
- Optimal homologous cycles, total unimodularity, and linear programming. In Proceedings of the forty-second ACM symposium on Theory of computing, pages 221–230, 2010.
- Optimal cycles for persistent homology via linear programming. In Optimization in the Real World: Toward Solving Real-World Optimization Problems, pages 79–96. Springer, 2016.
- Ippei Obayashi. Volume-optimal cycle: Tightest representative cycle of a generator in persistent homology. SIAM Journal on Applied Algebra and Geometry, 2(4):508–534, 2018.
- Hardness results for homology localization. Discrete & Computational Geometry, 45(3):425–448, 2011.
- Lexicographic optimal homologous chains and applications to point cloud triangulations. Discrete & Computational Geometry, 68(4):1155–1174, 2022.
- Persistent 1-cycles: Definition, computation, and its application. In Computational Topology in Image Context: 7th International Workshop, CTIC 2019, Málaga, Spain, January 24-25, 2019, Proceedings 7, pages 123–136. Springer, 2019.
- Persistent homology analysis for materials research and persistent homology software: Homcloud. journal of the physical society of japan, 91(9):091013, 2022.
- The structure and stability of persistence modules, volume 10. Springer, 2016.
- 3d shape analysis of the brain’s third ventricle using a midplane encoded symmetric template model. Computer methods and programs in biomedicine, 129:51–62, 2016.
Collections
Sign up for free to add this paper to one or more collections.