Robust Extrinsic Symmetry Estimation in 3D Point Clouds (2109.09927v2)
Abstract: Detecting the reflection symmetry plane of an object represented by a 3D point cloud is a fundamental problem in 3D computer vision and geometry processing due to its various applications, such as compression, object detection, robotic grasping, 3D surface reconstruction, etc. There exist several efficient approaches for solving this problem for clean 3D point clouds. However, it is a challenging problem to solve in the presence of outliers and missing parts. The existing methods try to overcome this challenge mostly by voting-based techniques but do not work efficiently. In this work, we proposed a statistical estimator-based approach for the plane of reflection symmetry that is robust to outliers and missing parts. We pose the problem of finding the optimal estimator for the reflection symmetry as an optimization problem on a 2-Sphere that quickly converges to the global solution for an approximate initialization. We further adapt the heat kernel signature for symmetry invariant matching of mirror symmetric points. This approach helps us to decouple the chicken-and-egg problem of finding the optimal symmetry plane and correspondences between the reflective symmetric points. The proposed approach achieves comparable mean ground-truth error and 4.5\% increment in the F-score as compared to the state-of-the-art approaches on the benchmark dataset.
- Deep 3d semantic scene extrapolation. The Visual Computer, 35:271–279, 2019.
- Optimization algorithms on matrix manifolds. Princeton University Press, 2009.
- Robust and efficient estimation by minimising a density power divergence. Biometrika, 85(3):549–559, 1998.
- Constructing laplace operator from point clouds in rd. In Proceedings of the twentieth annual ACM-SIAM symposium on Discrete algorithms, pages 1031–1040. SIAM, 2009.
- A graph-based approach to symmetry detection. In Volume Graphics, volume 40, pages 1–8, 2008.
- Manopt, a matlab toolbox for optimization on manifolds. The Journal of Machine Learning Research, 15(1):1455–1459, 2014.
- Shapenet: An information-rich 3d model repository. arXiv preprint arXiv:1512.03012, 2015.
- Finding mirror symmetry via registration and optimal symmetric pairwise assignment of curves: Algorithm and results. In IEEE International Conference on Computer Vision Workshop (ICCVW), pages 1759–1763. IEEE, 2017.
- Discovering and exploiting 3d symmetries in structure from motion. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 1514–1521. IEEE, 2012.
- Automatic symmetry plane estimation of bilateral objects in point clouds. In Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, pages 1–8. IEEE, 2008.
- Shrec’16: Partial matching of deformable shapes. Proc. 3DOR, 2(9):12, 2016.
- Detecting reflectional symmetries in 3d data through symmetrical fitting. In Proceedings of the IEEE International Conference on Computer Vision Workshops, pages 1779–1783, 2017.
- Roger Fletcher. Practical methods of optimization. John Wiley & Sons, 2000.
- Symmetry recaptcha. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 5165–5174, 2016.
- 2017 iccv challenge: Detecting symmetry in the wild. In Proceedings of the IEEE International Conference on Computer Vision Workshops, pages 1692–1701, 2017.
- Prs-net: Planar reflective symmetry detection net for 3d models. IEEE Transactions on Visualization and Computer Graphics, 27(6):3007–3018, 2020.
- Combining appearance and gradient information for image symmetry detection. IEEE Transactions on Image Processing, 30:5708–5723, 2021.
- Image matching using local symmetry features. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 206–213. IEEE, 2012.
- Grassmann averages for scalable robust pca. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 3810–3817, 2014.
- Epos: estimating 6d pose of objects with symmetries. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 11703–11712, 2020.
- Plane space representation in context of mode-based symmetry plane detection. In International Conference on Computational Science, pages 509–523. Springer, 2020.
- Robust, fast and flexible symmetry plane detection based on differentiable symmetry measure. The Visual Computer, pages 1–17, 2021.
- Globally optimal point set registration by joint symmetry plane fitting. Journal of Mathematical Imaging and Vision, pages 1–19, 2021.
- Robust point set registration using gaussian mixture models. IEEE transactions on pattern analysis and machine intelligence, 33(8):1633–1645, 2010.
- A reflective symmetry descriptor. In European Conference on Computer Vision, pages 642–656. Springer, 2002.
- Möbius transformations for global intrinsic symmetry analysis. In Computer Graphics Forum, volume 29, pages 1689–1700. Wiley Online Library, 2010.
- Probably approximately symmetric: Fast rigid symmetry detection with global guarantees. In Computer Graphics Forum, volume 34, pages 2–13. Wiley Online Library, 2015.
- Dense 3d reconstruction of symmetric scenes from a single image. In Pattern Recognition, pages 266–275. Springer, 2011.
- A probabilistic framework for partial intrinsic symmetries in geometric data. In Computer Vision, 2009 IEEE 12th International Conference on, pages 963–970. IEEE, 2009.
- Efficient 3d reflection symmetry detection: A view-based approach. Graphical Models, 83:2–14, 2016.
- Anisotropic spectral manifold wavelet descriptor. In Computer Graphics Forum, volume 40, pages 81–96. Wiley Online Library, 2021.
- Symmetry factored embedding and distance. In ACM Transactions on Graphics (TOG), volume 29, page 103. ACM, 2010.
- Finding surface correspondences using symmetry axis curves. In Computer Graphics Forum, volume 31, pages 1607–1616. Wiley Online Library, 2012.
- Point-based manifold harmonics. IEEE Transactions on visualization and computer graphics, 18(10):1693–1703, 2012.
- Computational symmetry in computer vision and computer graphics. Foundations and Trends in Computer Graphics and Vision, 5(1-2):1–195, 2010.
- Nautilus: Recovering regional symmetry transformations for image editing. ACM Transactions on Graphics, 36(4), 2017.
- Robust estimation of nonrigid transformation for point set registration. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 2147–2154, 2013.
- Fast and automatic tumoral area localisation using symmetry. In Proceedings.(ICASSP’05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005., volume 2, pages 725–728. IEEE, 2005.
- Accurate detection of symmetries in 3d shapes. ACM Transactions on Graphics (TOG), 25(2):439–464, 2006.
- Zoomout: spectral upsampling for efficient shape correspondence. ACM Transactions on Graphics (TOG), 38(6):1–14, 2019.
- Symmetry based 3d reconstruction of repeated cylinders. In 2013 Fourth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG), pages 1–4. IEEE, 2013.
- Partial and approximate symmetry detection for 3d geometry. In ACM Transactions on Graphics (TOG), volume 25, pages 560–568. ACM, 2006.
- Symmetry in 3d geometry: Extraction and applications. In Computer Graphics Forum, volume 32, pages 1–23. Wiley Online Library, 2013.
- Local facial asymmetry for expression classification. In Computer Vision and Pattern Recognition, 2004. CVPR 2004. Proceedings of the 2004 IEEE Computer Society Conference on, volume 2, pages II–889. IEEE, 2004.
- Fast and accurate intrinsic symmetry detection. In Proceedings of the European Conference on Computer Vision (ECCV), pages 417–434, 2018.
- Detecting approximate reflection symmetry in a point set using optimization on manifold. IEEE Transactions on Signal Processing, 67(6):1582–1595, 2019.
- 3dsymm: robust and accurate 3d reflection symmetry detection. Pattern Recognition, 107:107483, 2020.
- Global intrinsic symmetries of shapes. In Computer graphics forum, volume 27, pages 1341–1348. Wiley Online Library, 2008.
- A planar-reflective symmetry transform for 3d shapes. ACM Transactions on Graphics (TOG), 25(3):549–559, 2006.
- Learning-based real-time detection of intrinsic reflectional symmetry. arXiv preprint arXiv:1911.00189, 2019.
- Maptree: recovering multiple solutions in the space of maps. ACM Transactions on Graphics (TOG), 39(6):1–17, 2020.
- Yusuf Sahillioğlu. Recent advances in shape correspondence. The Visual Computer, 36(8):1705–1721, 2020.
- Coarse-to-fine isometric shape correspondence by tracking symmetric flips. In Computer Graphics Forum, volume 32, pages 177–189. Wiley Online Library, 2013.
- Learning to discover reflection symmetry via polar matching convolution. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 1285–1294, 2021.
- A laplacian for nonmanifold triangle meshes. In Computer Graphics Forum, volume 39, pages 69–80. Wiley Online Library, 2020.
- Symmetrynet: learning to predict reflectional and rotational symmetries of 3d shapes from single-view rgb-d images. ACM Transactions on Graphics (TOG), 39(6):1–14, 2020.
- Symmetry and orbit detection via lie-algebra voting. In Computer Graphics Forum, volume 35, pages 217–227. Wiley Online Library, 2016.
- Approximate symmetry detection in partial 3d meshes. In Computer Graphics Forum, volume 33, pages 131–140. Wiley Online Library, 2014.
- A symmetry prior for convex variational 3d reconstruction. In European Conference on Computer Vision, pages 313–328. Springer, 2016.
- A concise and provably informative multi-scale signature based on heat diffusion. In Computer graphics forum, volume 28, pages 1383–1392. Wiley Online Library, 2009.
- Data-driven structural priors for shape completion. ACM Transactions on Graphics (TOG), 34(6):1–11, 2015.
- Automatic relevance determination in nonnegative matrix factorization with the/spl beta/-divergence. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(7):1592–1605, 2012.
- Multiscale symmetry detection in scalar fields by clustering contours. IEEE transactions on visualization and computer graphics, 20(12):2427–2436, 2014.
- Shape from symmetry. In Computer Vision, 2005. ICCV 2005. Tenth IEEE International Conference on, volume 2, pages 1824–1831. IEEE, 2005.
- Christopher W Tyler. Human symmetry perception and its computational analysis. Psychology Press, 2003.
- A survey on shape correspondence. In Computer graphics forum, volume 30, pages 1681–1707. Wiley Online Library, 2011.
- Group representation of global intrinsic symmetries. In Computer Graphics Forum, volume 36, pages 51–61. Wiley Online Library, 2017.
- Intrinsic symmetry detection on 3d models with skeleton-guided combination of extrinsic symmetries. In Computer Graphics Forum, volume 38, pages 617–628. Wiley Online Library, 2019.
- A robust local spectral descriptor for matching non-rigid shapes with incompatible shape structures. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 6231–6240, 2019.
- Mgcn: Descriptor learning using multiscale gcns. ACM Transactions on Graphics (TOG), 39(4):122–1, 2020.
- Unsupervised learning of probably symmetric deformable 3d objects from images in the wild. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1–10, 2020.
- Multi-scale partial intrinsic symmetry detection. ACM Transactions on Graphics (TOG), 31(6):181, 2012.
- Partial intrinsic reflectional symmetry of 3d shapes. In ACM SIGGRAPH Asia 2009 papers, pages 1–10. 2009.
- Symmetry as a continuous feature. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(12):1154–1166, 1995.
- Yu Zhong. Intrinsic shape signatures: A shape descriptor for 3d object recognition. In 2009 IEEE 12th international conference on computer vision workshops, ICCV workshops, pages 689–696. IEEE, 2009.
- Nerd: neural 3d reflection symmetry detector. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 15940–15949, 2021.