Papers
Topics
Authors
Recent
2000 character limit reached

Learning Geodesics of Geometric Shape Deformations From Images

Published 24 Oct 2024 in cs.CV | (2410.18797v1)

Abstract: This paper presents a novel method, named geodesic deformable networks (GDN), that for the first time enables the learning of geodesic flows of deformation fields derived from images. In particular, the capability of our proposed GDN being able to predict geodesics is important for quantifying and comparing deformable shape presented in images. The geodesic deformations, also known as optimal transformations that align pairwise images, are often parameterized by a time sequence of smooth vector fields governed by nonlinear differential equations. A bountiful literature has been focusing on learning the initial conditions (e.g., initial velocity fields) based on registration networks. However, the definition of geodesics central to deformation-based shape analysis is blind to the networks. To address this problem, we carefully develop an efficient neural operator to treat the geodesics as unknown mapping functions learned from the latent deformation spaces. A composition of integral operators and smooth activation functions is then formulated to effectively approximate such mappings. In contrast to previous works, our GDN jointly optimizes a newly defined geodesic loss, which adds additional benefits to promote the network regularizability and generalizability. We demonstrate the effectiveness of GDN on both 2D synthetic data and 3D real brain magnetic resonance imaging (MRI).

Definition Search Book Streamline Icon: https://streamlinehq.com
References (46)
  1. The learn2reg 2021 miccai grand challenge (pimed team). Biomedical Image Registration, Domain Generalisation and Out-of-Distribution Analysis: MICCAI 2021 Challenges: MIDOG 2021, MOOD 2021, and Learn2Reg 2021, Held in Conjunction with MICCAI 2021, Strasbourg, France, September 27–October 1, 2021, Proceedings, 13166:168, 2022.
  2. Vladimir Arnold. Sur la géométrie différentielle des groupes de lie de dimension infinie et ses applications à l’hydrodynamique des fluides parfaits. In Annales de l’institut Fourier, volume 16, pages 319–361, 1966.
  3. Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain. Medical image analysis, 12(1):26–41, 2008.
  4. Voxelmorph: a learning framework for deformable medical image registration. IEEE transactions on medical imaging, 2019.
  5. 3d regional shape analysis of left ventricle using mr images: Abnormal myocadium detection and classification. In 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019), pages 789–792. IEEE, 2019.
  6. Improving predictive ctv segmentation on ct and cbct for cervical cancer by diffeomorphic registration of a prior. Medical Physics, 49(3):1701–1711, 2022.
  7. Computing large deformation metric mappings via geodesic flows of diffeomorphisms. International journal of computer vision, 61(2):139–157, 2005.
  8. Model reduction and neural networks for parametric pdes. The SMAI journal of computational mathematics, 7:121–157, 2021.
  9. Transmorph: Transformer for unsupervised medical image registration. Medical image analysis, 82:102615, 2022.
  10. A deformable neuroanatomy textbook based on viscous fluid mechanics. In 27th Ann. Conf. on Inf. Sciences and Systems, pages 211–216, 1993.
  11. P Constantin. Navier-Stokes Equations. University of Chicago Press, 1988.
  12. Unsupervised learning of probabilistic diffeomorphic registration for images and surfaces. Medical image analysis, 57:226–236, 2019.
  13. Lee R Dice. Measures of the amount of ecologic association between species. Ecology, 26(3):297–302, 1945.
  14. Normative estimates of cross-sectional and longitudinal brain volume decline in aging and ad. Neurology, 64(6):1032–1039, 2005.
  15. Computational anatomy: An emerging discipline. Quarterly of applied mathematics, 56(4):617–694, 1998.
  16. Diffeomorphic autoencoders for LDDMM atlas building. In Medical Imaging with Deep Learning, 2018.
  17. Hierarchical multi-geodesic model for longitudinal analysis of temporal trajectories of anatomical shape and covariates. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part IV 22, pages 57–65. Springer, 2019.
  18. Fast geodesic regression for population-based image analysis. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 317–325. Springer, 2017.
  19. Comparing images using the hausdorff distance. IEEE Transactions on pattern analysis and machine intelligence, 15(9):850–863, 1993.
  20. The quick, draw!-ai experiment. Mount View, CA, accessed Feb, 17(2018):4, 2016.
  21. Diffusemorph: Unsupervised deformable image registration using diffusion model. In Computer Vision–ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part XXXI, pages 347–364. Springer, 2022.
  22. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
  23. Neural operator: Learning maps between function spaces. arXiv preprint arXiv:2108.08481, 2021.
  24. Yann LeCun. The mnist database of handwritten digits. http://yann. lecun. com/exdb/mnist/, 1998.
  25. Fourier neural operator for parametric partial differential equations. arXiv preprint arXiv:2010.08895, 2020a.
  26. Neural operator: Graph kernel network for partial differential equations. arXiv preprint arXiv:2003.03485, 2020b.
  27. 4d registration of serial brain’s mr images: a robust measure of changes applied to alzheimer’s disease. In Spatio Temporal Image Analysis Workshop (STIA), MICCAI, volume 1. Citeseer, 2010.
  28. Deeponet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators. arXiv preprint arXiv:1910.03193, 2019.
  29. Michael I Miller. Computational anatomy: shape, growth, and atrophy comparison via diffeomorphisms. NeuroImage, 23:S19–S33, 2004.
  30. Geodesic shooting for computational anatomy. Journal of Mathematical Imaging and Vision, 24(2):209–228, 2006.
  31. Geodesic regression for image time-series. In International conference on medical image computing and computer-assisted intervention, pages 655–662. Springer, 2011.
  32. Metric learning for image registration. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 8463–8472, 2019.
  33. Parallel transport in diffeomorphisms distinguishes the time-dependent pattern of hippocampal surface deformation due to healthy aging and the dementia of the alzheimer’s type. NeuroImage, 40(1):68–76, 2008.
  34. Principal component based diffeomorphic surface mapping. Medical Imaging, IEEE Transactions on, 31(2):302–311, 2012.
  35. Automatic construction of 3-d statistical deformation models of the brain using nonrigid registration. IEEE transactions on medical imaging, 22(8):1014–1025, 2003.
  36. A hierarchical geodesic model for diffeomorphic longitudinal shape analysis. In International Conference on Information Processing in Medical Imaging, pages 560–571. Springer, 2013.
  37. Topology-preserving shape reconstruction and registration via neural diffeomorphic flow. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 20845–20855, 2022.
  38. Diffeomorphic 3d image registration via geodesic shooting using an efficient adjoint calculation. International Journal of Computer Vision, 97(2):229–241, 2012a.
  39. Diffeomorphic 3d image registration via geodesic shooting using an efficient adjoint calculation. International Journal of Computer Vision, 97:229–241, 2012b.
  40. Deepflash: An efficient network for learning-based medical image registration. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2020.
  41. Large deformation diffeomorphism and momentum based hippocampal shape discrimination in dementia of the alzheimer type. IEEE transactions on medical imaging, 26(4):462–470, 2007.
  42. Multi-modal volume registration by maximization of mutual information. Medical image analysis, 1996.
  43. Neurepdiff: Neural operators to predict geodesics in deformation spaces. In International Conference on Information Processing in Medical Imaging, pages 588–600. Springer, 2023.
  44. Quicksilver: Fast predictive image registration–a deep learning approach. NeuroImage, 158:378–396, 2017.
  45. Evolutions equations in computational anatomy. NeuroImage, 45(1):S40–S50, 2009.
  46. Finite-dimensional lie algebras for fast diffeomorphic image registration. In International Conference on Information Processing in Medical Imaging, pages 249–260. Springer, 2015.

Summary

We haven't generated a summary for this paper yet.

Whiteboard

Paper to Video (Beta)

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Authors (2)

Collections

Sign up for free to add this paper to one or more collections.