Deep-PE: A Learning-Based Pose Evaluator for Point Cloud Registration (2405.16085v1)
Abstract: In the realm of point cloud registration, the most prevalent pose evaluation approaches are statistics-based, identifying the optimal transformation by maximizing the number of consistent correspondences. However, registration recall decreases significantly when point clouds exhibit a low overlap rate, despite efforts in designing feature descriptors and establishing correspondences. In this paper, we introduce Deep-PE, a lightweight, learning-based pose evaluator designed to enhance the accuracy of pose selection, especially in challenging point cloud scenarios with low overlap. Our network incorporates a Pose-Aware Attention (PAA) module to simulate and learn the alignment status of point clouds under various candidate poses, alongside a Pose Confidence Prediction (PCP) module that predicts the likelihood of successful registration. These two modules facilitate the learning of both local and global alignment priors. Extensive tests across multiple benchmarks confirm the effectiveness of Deep-PE. Notably, on 3DLoMatch with a low overlap rate, Deep-PE significantly outperforms state-of-the-art methods by at least 8% and 11% in registration recall under handcrafted FPFH and learning-based FCGF descriptors, respectively. To the best of our knowledge, this is the first study to utilize deep learning to select the optimal pose without the explicit need for input correspondences.
- Spinnet: Learning a general surface descriptor for 3d point cloud registration. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 11748–11757, 2020.
- Pointdsc: Robust point cloud registration using deep spatial consistency. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 15854–15864, 2021.
- D3feat: Joint learning of dense detection and description of 3d local features. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 6358–6366, 2020.
- Graph-cut ransac. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 6733–6741, 2017.
- A method for registration of 3-d shapes. IEEE Trans. Pattern Anal. Mach. Intell., 14:239–256, 1992.
- Sc2-pcr++: Rethinking the generation and selection for efficient and robust point cloud registration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023.
- Sc2-pcr: A second order spatial compatibility for efficient and robust point cloud registration. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 13221–13231, 2022.
- Deep global registration. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 2511–2520, 2020.
- Fully convolutional geometric features. 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pages 8957–8965, 2019.
- Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM, 24:381–395, 1981.
- Are we ready for autonomous driving? the kitti vision benchmark suite. 2012 IEEE Conference on Computer Vision and Pattern Recognition, pages 3354–3361, 2012.
- The perfect match: 3d point cloud matching with smoothed densities. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 5540–5549, 2018.
- A benchmark for rgb-d visual odometry, 3d reconstruction and slam. 2014 IEEE International Conference on Robotics and Automation (ICRA), pages 1524–1531, 2014.
- Epipolar transformers. In Proceedings of the ieee/cvf conference on computer vision and pattern recognition, pages 7779–7788, 2020.
- Predator: Registration of 3d point clouds with low overlap. In Proceedings of the IEEE/CVF Conference on computer vision and pattern recognition, pages 4267–4276, 2021.
- Feature-metric registration: A fast semi-supervised approach for robust point cloud registration without correspondences. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 11363–11371, 2020.
- Robust point set registration using gaussian mixture models. IEEE transactions on pattern analysis and machine intelligence, 33(8):1633–1645, 2010.
- Robust outlier rejection for 3d registration with variational bayes. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 1148–1157, 2023.
- A spectral technique for correspondence problems using pairwise constraints. Tenth IEEE International Conference on Computer Vision (ICCV’05) Volume 1, 2:1482–1489 Vol. 2, 2005.
- Pointnetlk revisited. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 12758–12767, 2021.
- Deepvcp: An end-to-end deep neural network for point cloud registration. In Proceedings of the IEEE/CVF international conference on computer vision, pages 12–21, 2019.
- Unsupervised deep probabilistic approach for partial point cloud registration. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 13611–13620, 2023.
- Napsac: High noise, high dimensional robust estimation - it’s in the bag. In British Machine Vision Conference, 2002.
- 3dregnet: A deep neural network for 3d point registration. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 7191–7201, 2019.
- Théodore Papadopoulo and Manolis I. A. Lourakis. Estimating the jacobian of the singular value decomposition: Theory and applications. In European Conference on Computer Vision, 2000.
- Pointnet: Deep learning on point sets for 3d classification and segmentation. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 77–85, 2016.
- Geometric transformer for fast and robust point cloud registration. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 11133–11142, 2022.
- Fast point feature histograms (fpfh) for 3d registration. 2009 IEEE International Conference on Robotics and Automation, pages 3212–3217, 2009.
- Loftr: Detector-free local feature matching with transformers. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 8918–8927, 2021.
- Kpconv: Flexible and deformable convolution for point clouds. 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pages 6410–6419, 2019.
- Unique signatures of histograms for local surface description. In European Conference on Computer Vision, 2010.
- Attention is all you need. ArXiv, abs/1706.03762, 2017.
- Superglue: A stickier benchmark for general-purpose language understanding systems. ArXiv, abs/1905.00537, 2019.
- Roreg: Pairwise point cloud registration with oriented descriptors and local rotations. IEEE transactions on pattern analysis and machine intelligence, PP, 2023.
- Deep closest point: Learning representations for point cloud registration. 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pages 3522–3531, 2019.
- Dynamic graph cnn for learning on point clouds. ACM Transactions on Graphics (tog), 38(5):1–12, 2019.
- Toward efficient and robust metrics for ransac hypotheses and 3d rigid registration. IEEE Transactions on Circuits and Systems for Video Technology, 32:893–906, 2021.
- Rpm-net: Robust point matching using learned features. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 11821–11830, 2020.
- Cofinet: Reliable coarse-to-fine correspondences for robust point cloud registration. In Neural Information Processing Systems, 2021.
- Deepgmr: Learning latent gaussian mixture models for registration. In European Conference on Computer Vision, 2020.
- 3dmatch: Learning local geometric descriptors from rgb-d reconstructions. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 199–208, 2016.
- 3d registration with maximal cliques. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 17745–17754, 2023.