Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

CUTS: A Deep Learning and Topological Framework for Multigranular Unsupervised Medical Image Segmentation (2209.11359v7)

Published 23 Sep 2022 in cs.CV

Abstract: Segmenting medical images is critical to facilitating both patient diagnoses and quantitative research. A major limiting factor is the lack of labeled data, as obtaining expert annotations for each new set of imaging data and task can be labor intensive and inconsistent among annotators. We present CUTS, an unsupervised deep learning framework for medical image segmentation. CUTS operates in two stages. For each image, it produces an embedding map via intra-image contrastive learning and local patch reconstruction. Then, these embeddings are partitioned at dynamic granularity levels that correspond to the data topology. CUTS yields a series of coarse-to-fine-grained segmentations that highlight features at various granularities. We applied CUTS to retinal fundus images and two types of brain MRI images to delineate structures and patterns at different scales. When evaluated against predefined anatomical masks, CUTS improved the dice coefficient and Hausdorff distance by at least 10% compared to existing unsupervised methods. Finally, CUTS showed performance on par with Segment Anything Models (SAM, MedSAM, SAM-Med2D) pre-trained on gigantic labeled datasets.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (58)
  1. Fu, Y. et al. A review of deep learning based methods for medical image multi-organ segmentation. Physica Medica 85, 107–122 (2021).
  2. Study and comparison of different edge detectors for image segmentation. Global Journal of Computer Science and Technology (2012).
  3. A survey of graph cuts/graph search based medical image segmentation. IEEE reviews in biomedical engineering 11, 112–124 (2018).
  4. El Naqa, I. et al. Concurrent multimodality image segmentation by active contours for radiotherapy treatment planning a. Medical physics 34, 4738–4749 (2007).
  5. Watersheds in digital spaces: an efficient algorithm based on immersion simulations. IEEE Transactions on Pattern Analysis & Machine Intelligence 13, 583–598 (1991).
  6. An improved binarization algorithm based on a water flow model for document image with inhomogeneous backgrounds. Pattern Recognition 38, 2612–2625 (2005).
  7. Efficient graph-based image segmentation. International journal of computer vision 59, 167–181 (2004).
  8. Isgum, I. et al. Multi-atlas-based segmentation with local decision fusion—application to cardiac and aortic segmentation in ct scans. IEEE transactions on medical imaging 28, 1000–1010 (2009).
  9. Multi-atlas based segmentation of brain images: atlas selection and its effect on accuracy. Neuroimage 46, 726–738 (2009).
  10. Multi-atlas segmentation of biomedical images: a survey. Medical image analysis 24, 205–219 (2015).
  11. Deep learning. nature 521, 436–444 (2015).
  12. Esteva, A. et al. A guide to deep learning in healthcare. Nature medicine 25, 24–29 (2019).
  13. Deep learning approaches to biomedical image segmentation. Informatics in Medicine Unlocked 18, 100297 (2020).
  14. Minaee, S. et al. Image segmentation using deep learning: A survey. IEEE transactions on pattern analysis and machine intelligence (2021).
  15. Pivotal trial of an autonomous ai-based diagnostic system for detection of diabetic retinopathy in primary care offices. NPJ digital medicine 1, 1–8 (2018).
  16. Tsai, A. et al. A shape-based approach to the segmentation of medical imagery using level sets. IEEE transactions on medical imaging 22, 137–154 (2003).
  17. Achanta, R. et al. Slic superpixels compared to state-of-the-art superpixel methods. IEEE transactions on pattern analysis and machine intelligence 34, 2274–2282 (2012).
  18. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention, 234–241 (Springer, 2015).
  19. Unet++: A nested u-net architecture for medical image segmentation. In Deep learning in medical image analysis and multimodal learning for clinical decision support, 3–11 (Springer, 2018).
  20. Oktay, O. et al. Attention u-net: Learning where to look for the pancreas. arXiv preprint arXiv:1804.03999 (2018).
  21. 3d u-net: learning dense volumetric segmentation from sparse annotation. In International conference on medical image computing and computer-assisted intervention, 424–432 (Springer, 2016).
  22. Kohl, S. et al. A probabilistic u-net for segmentation of ambiguous images. Advances in neural information processing systems 31 (2018).
  23. Yu, X. et al. Unest: local spatial representation learning with hierarchical transformer for efficient medical segmentation. Medical Image Analysis 90, 102939 (2023).
  24. nnu-net: a self-configuring method for deep learning-based biomedical image segmentation. Nature methods 18, 203–211 (2021).
  25. Few-shot 3d multi-modal medical image segmentation using generative adversarial learning. arXiv preprint arXiv:1810.12241 (2018).
  26. Data efficient unsupervised domain adaptation for cross-modality image segmentation. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part II 22, 669–677 (Springer, 2019).
  27. Yu, H. et al. Foal: Fast online adaptive learning for cardiac motion estimation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 4313–4323 (2020).
  28. Chen, C. et al. Realistic adversarial data augmentation for mr image segmentation. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2020: 23rd International Conference, Lima, Peru, October 4–8, 2020, Proceedings, Part I 23, 667–677 (Springer, 2020).
  29. Yang, Q. et al. Label efficient segmentation of single slice thigh ct with two-stage pseudo labels. Journal of Medical Imaging 9, 052405–052405 (2022).
  30. Ouyang, C. et al. Self-supervision with superpixels: Training few-shot medical image segmentation without annotation. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XXIX 16, 762–780 (Springer, 2020).
  31. Nan, Y. et al. Unsupervised tissue segmentation via deep constrained gaussian network. IEEE Transactions on Medical Imaging 41, 3799–3811 (2022).
  32. Data augmentation using learned transformations for one-shot medical image segmentation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 8543–8553 (2019).
  33. Wang, S. et al. Lt-net: Label transfer by learning reversible voxel-wise correspondence for one-shot medical image segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 9162–9171 (2020).
  34. A simple framework for contrastive learning of visual representations (2020). 2002.05709.
  35. Caron, M. et al. Unsupervised learning of visual features by contrasting cluster assignments. Advances in Neural Information Processing Systems 33, 9912–9924 (2020).
  36. Momentum contrast for unsupervised visual representation learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 9729–9738 (2020).
  37. Grill, J.-B. et al. Bootstrap your own latent-a new approach to self-supervised learning. Advances in neural information processing systems 33, 21271–21284 (2020).
  38. Barlow twins: Self-supervised learning via redundancy reduction. In International Conference on Machine Learning, 12310–12320 (PMLR, 2021).
  39. Exploring simple siamese representation learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 15750–15758 (2021).
  40. Contrastive learning of global and local features for medical image segmentation with limited annotations (2020). 2006.10511.
  41. Yan, K. et al. Self-supervised learning of pixel-wise anatomical embeddings in radiological images (2020). 2012.02383.
  42. Unsupervised learning of image segmentation based on differentiable feature clustering. IEEE Transactions on Image Processing 29, 8055–8068 (2020).
  43. Unsupervised semantic segmentation by distilling feature correspondences. In International Conference on Learning Representations (2022).
  44. Kirillov, A. et al. Segment anything. arXiv:2304.02643 (2023).
  45. Mazurowski, M. A. et al. Segment anything model for medical image analysis: an experimental study. Medical Image Analysis 102918 (2023).
  46. Kuchroo, M. et al. Multiscale phate identifies multimodal signatures of covid-19. Nature biotechnology 40, 681–691 (2022).
  47. Image quality metrics: Psnr vs. ssim. In 2010 20th international conference on pattern recognition, 2366–2369 (IEEE, 2010).
  48. Brugnone, N. et al. Coarse graining of data via inhomogeneous diffusion condensation. In 2019 IEEE International Conference on Big Data (Big Data), 2624–2633 (IEEE, 2019).
  49. Kuchroo, M. et al. Single-cell analysis reveals inflammatory interactions driving macular degeneration. Nature Communications 14, 2589 (2023).
  50. Diffusion maps. Applied and computational harmonic analysis 21, 5–30 (2006).
  51. Spectral relaxation for k-means clustering. Advances in neural information processing systems 14 (2001).
  52. Carmichael, O. T. et al. Ventricular volume and dementia progression in the cardiovascular health study. Neurobiology of aging 28, 389–397 (2007).
  53. Ott, B. R. et al. Brain ventricular volume and cerebrospinal fluid biomarkers of alzheimer’s disease. Journal of Alzheimer’s disease 20, 647–657 (2010).
  54. Davis, M. D. et al. The age-related eye disease study severity scale for age-related macular degeneration: Areds report no. 17. Archives of ophthalmology (Chicago, Ill.: 1960) 123, 1484–1498 (2005).
  55. Shen, L. L. et al. Relationship of topographic distribution of geographic atrophy to visual acuity in nonexudative age-related macular degeneration. Ophthalmology Retina 5, 761–774 (2021).
  56. Imagej for the next generation of scientific image data. Microscopy and Microanalysis 25, 142–143 (2019).
  57. The image and data archive at the laboratory of neuro imaging. Neuroimage 124, 1080–1083 (2016).
  58. Mueller, S. G. et al. The alzheimer’s disease neuroimaging initiative. Neuroimaging Clinics 15, 869–877 (2005).
Citations (11)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets