Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
157 tokens/sec
GPT-4o
43 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

On Unsupervised Partial Shape Correspondence (2310.14692v3)

Published 23 Oct 2023 in cs.CV

Abstract: While dealing with matching shapes to their parts, we often apply a tool known as functional maps. The idea is to translate the shape matching problem into "convenient" spaces by which matching is performed algebraically by solving a least squares problem. Here, we argue that such formulations, though popular in this field, introduce errors in the estimated match when partiality is invoked. Such errors are unavoidable even for advanced feature extraction networks, and they can be shown to escalate with increasing degrees of shape partiality, adversely affecting the learning capability of such systems. To circumvent these limitations, we propose a novel approach for partial shape matching. Our study of functional maps led us to a novel method that establishes direct correspondence between partial and full shapes through feature matching bypassing the need for functional map intermediate spaces. The Gromov Distance between metric spaces leads to the construction of the first part of our loss functions. For regularization we use two options: a term based on the area preserving property of the mapping, and a relaxed version that avoids the need to resort to functional maps. The proposed approach shows superior performance on the SHREC'16 dataset, outperforming existing unsupervised methods for partial shape matching.Notably, it achieves state-of-the-art results on the SHREC'16 HOLES benchmark, superior also compared to supervised methods. We demonstrate the benefits of the proposed unsupervised method when applied to a new dataset PFAUST for part-to-full shape correspondence.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (41)
  1. On the optimality of shape and data representation in the spectral domain. SIAM Journal on Imaging Sciences, 8(2):1141–1160, 2015.
  2. Spectral generalized multi-dimensional scaling. International Journal of Computer Vision, 118:380–392, 2016.
  3. Understanding and improving features learned in deep functional maps. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1316–1326, 2023.
  4. DPFM: Deep partial functional maps. In 2021 International Conference on 3D Vision (3DV). IEEE, 2021.
  5. Partial shape similarity by multi-metric hamiltonian spectra matching. In International Conference on Scale Space and Variational Methods in Computer Vision, pages 717–729. Springer, 2023a.
  6. Partial matching of nonrigid shapes by learning piecewise smooth functions. In Computer Graphics Forum. Wiley Online Library, 2023b.
  7. Shape correspondence by aligning scale-invariant LBO eigenfunctions. In Eurographics Workshop on 3D Object Retrieval. The Eurographics Association, 2020.
  8. Efficient computation of isometry-invariant distances between surfaces. SIAM Journal on Scientific Computing, 28(5):1812–1836, 2006a.
  9. Generalized multidimensional scaling: a framework for isometry-invariant partial surface matching. Proceedings of the National Academy of Sciences, 103(5):1168–1172, 2006b.
  10. Numerical geometry of non-rigid shapes. Springer Science & Business Media, 2008.
  11. Partial similarity of objects, or how to compare a centaur to a horse. International Journal of Computer Vision, 84:163–183, 2009.
  12. A Gromov-Hausdorff framework with diffusion geometry for topologically-robust non-rigid shape matching. International Journal of Computer Vision, 89(2-3):266–286, 2010.
  13. Unsupervised learning of robust spectral shape matching. ACM Transactions on Graphics (TOG), 2023.
  14. Shrec’16: Partial matching of deformable shapes. Proc. 3DOR, 2(9):12, 2016.
  15. Deep geometric functional maps: Robust feature learning for shape correspondence. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 8592–8601, 2020.
  16. Neuromorph: Unsupervised shape interpolation and correspondence in one go. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 7473–7483, 2021.
  17. On bending invariant signatures for surfaces. IEEE Transactions on pattern analysis and machine intelligence, 25(10):1285–1295, 2003.
  18. Cyclic functional mapping: Self-supervised correspondence between non-isometric deformable shapes. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part V 16, pages 36–52. Springer, 2020.
  19. Unsupervised learning of dense shape correspondence. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 4370–4379, 2019.
  20. Blended intrinsic maps. ACM transactions on graphics (TOG), 30(4):1–12, 2011.
  21. Computing geodesic paths on manifolds. Proceedings of the national academy of Sciences, 95(15):8431–8435, 1998.
  22. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
  23. SRFeat: Learning locally accurate and globally consistent non-rigid shape correspondence. In International Conference on 3D Vision (3DV). IEEE, 2022.
  24. Shape correspondence using anisotropic chebyshev spectral cnns. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 14658–14667, 2020.
  25. Deep functional maps: Structured prediction for dense shape correspondence. In Proceedings of the IEEE international conference on computer vision, pages 5659–5667, 2017a.
  26. Fully spectral partial shape matching. In Computer Graphics Forum, pages 247–258. Wiley Online Library, 2017b.
  27. Sgdr: Stochastic gradient descent with warm restarts. In International Conference on Learning Representations, 2016.
  28. Correspondence learning via linearly-invariant embedding. Advances in Neural Information Processing Systems, 33:1608–1620, 2020.
  29. Zoomout: spectral upsampling for efficient shape correspondence. ACM Transactions on Graphics (TOG), 38(6):1–14, 2019.
  30. Facundo Mémoli. Some properties of Gromov–Hausdorff distances. Discrete & Computational Geometry, 48:416–440, 2012.
  31. Distance functions and geodesics on submanifolds of ℝdsuperscriptℝ𝑑\mathbb{R}^{d}blackboard_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT and point clouds. SIAM Journal on Applied Mathematics, 65(4):1227–1260, 2005a.
  32. A theoretical and computational framework for isometry invariant recognition of point cloud data. Foundations of Computational Mathematics, 5:313–347, 2005b.
  33. Functional maps: a flexible representation of maps between shapes. ACM Transactions on Graphics (ToG), 31(4):1–11, 2012.
  34. Unsupervised scale-invariant multispectral shape matching. arXiv preprint arXiv:2012.10685, 2020.
  35. Correspondence-free region localization for partial shape similarity via hamiltonian spectrum alignment. In 2019 International Conference on 3D Vision (3DV), pages 37–46. IEEE, 2019.
  36. Continuous and orientation-preserving correspondences via functional maps. ACM Transactions on Graphics (ToG), 37(6):1–16, 2018.
  37. Structured regularization of functional map computations. In Computer Graphics Forum, pages 39–53. Wiley Online Library, 2019.
  38. Partial functional correspondence. In Computer Graphics Forum, pages 222–236. Wiley Online Library, 2017.
  39. Unsupervised deep learning for structured shape matching. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 1617–1627, 2019.
  40. Weakly supervised deep functional maps for shape matching. Advances in Neural Information Processing Systems, 33:19264–19275, 2020.
  41. Diffusionnet: Discretization agnostic learning on surfaces. ACM Transactions on Graphics (TOG), 41(3):1–16, 2022.
Citations (2)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com