Partial Symmetry Detection for 3D Geometry using Contrastive Learning with Geodesic Point Cloud Patches (2312.08230v1)
Abstract: Symmetry detection, especially partial and extrinsic symmetry, is essential for various downstream tasks, like 3D geometry completion, segmentation, compression and structure-aware shape encoding or generation. In order to detect partial extrinsic symmetries, we propose to learn rotation, reflection, translation and scale invariant local shape features for geodesic point cloud patches via contrastive learning, which are robust across multiple classes and generalize over different datasets. We show that our approach is able to extract multiple valid solutions for this ambiguous problem. Furthermore, we introduce a novel benchmark test for partial extrinsic symmetry detection to evaluate our method. Lastly, we incorporate the detected symmetries together with a region growing algorithm to demonstrate a downstream task with the goal of computing symmetry-aware partitions of 3D shapes. To our knowledge, we are the first to propose a self-supervised data-driven method for partial extrinsic symmetry detection.
- Atallah. On symmetry detection. IEEE Transactions on Computers, 100(7):663–666, 1985.
- Method for registration of 3-d shapes. In Sensor fusion IV: control paradigms and data structures, pages 586–606. Spie, 1992.
- Symmetry detection using feature lines. In Comput. Graph. Forum, pages 697–706. Wiley Online Library, 2009.
- The heat method for distance computation. Communications of the ACM, 60(11):90–99, 2017.
- Vector neurons: A general framework for so (3)-equivariant networks. In ICCV, pages 12200–12209, 2021.
- A point set generation network for 3d object reconstruction from a single image. In CVPR, pages 605–613, 2017.
- Salient geometric features for partial shape matching and similarity. ACM Transactions on Graphics (TOG), 25(1):130–150, 2006.
- Sdm-net: Deep generative network for structured deformable mesh. ACM TOG, 38(6):1–15, 2019.
- Prs-net: Planar reflective symmetry detection net for 3d models. IEEE TVCG, 27(6):3007–3018, 2020.
- A fast and efficient 3d reflection symmetry detector based on neural networks. Multimedia Tools and Applications, 78:35471–35492, 2019.
- A reflective symmetry descriptor for 3d models. Algorithmica, 38:201–225, 2004.
- Deep metric learning beyond binary supervision. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2288–2297, 2019.
- Efficient 3d reflection symmetry detection: A view-based approach. Graphical Models, 83:2–14, 2016.
- Grass: Generative recursive autoencoders for shape structures. ACM TOG, 36(4):1–14, 2017.
- E3sym: Leveraging e (3) invariance for unsupervised 3d planar reflective symmetry detection. In ICCV, pages 14543–14553, 2023.
- Symmetry factored embedding and distance. ACM TOG, 2010.
- Accurate detection of symmetries in 3d shapes. ACM TOG, 25(2):439–464, 2006.
- hdbscan: Hierarchical density based clustering. The Journal of Open Source Software, 2(11):205, 2017.
- Partial and approximate symmetry detection for 3d geometry. ACM TOG, 25(3):560–568, 2006.
- Intrinsic regularity detection in 3d geometry. In Computer Vision–ECCV 2010: 11th European Conference on Computer Vision, Heraklion, Crete, Greece, September 5-11, 2010, Proceedings, Part III 11, pages 398–410. Springer, 2010.
- Symmetry in 3d geometry: Extraction and applications. In Comput. Graph. Forum, pages 1–23. Wiley Online Library, 2013.
- Structurenet: Hierarchical graph networks for 3d shape generation. ACM TOG, 38(6):Article 242, 2019a.
- Partnet: A large-scale benchmark for fine-grained and hierarchical part-level 3d object understanding. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 909–918, 2019b.
- Fast and accurate intrinsic symmetry detection. In ECCV, pages 417–434, 2018.
- Global intrinsic symmetries of shapes. In Computer graphics forum, pages 1341–1348. Wiley Online Library, 2008.
- Discovering structural regularity in 3D geometry. ACM Transactions on Graphics, 27(3):#43, 1–11, 2008.
- A planar-reflective symmetry transform for 3D shapes. ACM TOG, 25(3), 2006.
- Pointnet++: Deep hierarchical feature learning on point sets in a metric space. Advances in neural information processing systems, 30, 2017.
- Learning-based intrinsic reflectional symmetry detection. IEEE TVCG, 2022.
- Geometrycentral: A modern c++ library of data structures and algorithms for geometry processing. 2019.
- Approximate symmetry detection in partial 3d meshes. In Computer Graphics Forum, pages 131–140. Wiley Online Library, 2014.
- Kihyuk Sohn. Improved deep metric learning with multi-class n-pair loss objective. NeurIPS, 29, 2016.
- Group representation of global intrinsic symmetries. In Comput. Graph. Forum, pages 51–61. Wiley Online Library, 2017.
- Partial intrinsic reflectional symmetry of 3d shapes. In ACM SIGGRAPH Asia 2009 papers, pages 1–10. 2009.
- Multi-scale partial intrinsic symmetry detection. ACM TOG, 31(6):1–11, 2012.
- Dsg-net: Learning disentangled structure and geometry for 3d shape generation. ACM TOG, 42(1):1–17, 2022.
- Partnet: A recursive part decomposition network for fine-grained and hierarchical shape segmentation. In CVPR, pages 9491–9500, 2019.