Q-REG: End-to-End Trainable Point Cloud Registration with Surface Curvature (2309.16023v1)
Abstract: Point cloud registration has seen recent success with several learning-based methods that focus on correspondence matching and, as such, optimize only for this objective. Following the learning step of correspondence matching, they evaluate the estimated rigid transformation with a RANSAC-like framework. While it is an indispensable component of these methods, it prevents a fully end-to-end training, leaving the objective to minimize the pose error nonserved. We present a novel solution, Q-REG, which utilizes rich geometric information to estimate the rigid pose from a single correspondence. Q-REG allows to formalize the robust estimation as an exhaustive search, hence enabling end-to-end training that optimizes over both objectives of correspondence matching and rigid pose estimation. We demonstrate in the experiments that Q-REG is agnostic to the correspondence matching method and provides consistent improvement both when used only in inference and in end-to-end training. It sets a new state-of-the-art on the 3DMatch, KITTI, and ModelNet benchmarks.
- GeoTransformer Github Page. https://github.com/qinzheng93/GeoTransformer. Accessed: 2022-11-11.
- PointDSC Github Page. https://github.com/XuyangBai/PointDSC. Accessed: 2023-03-02.
- Spinnet: Learning a general surface descriptor for 3d point cloud registration. In CVPR, 2021.
- Pointnetlk: Robust & efficient point cloud registration using pointnet. In CVPR, 2019.
- Least-squares fitting of two 3-d point sets. IEEE TPAMI, 1987.
- D3feat: Joint learning of dense detection and description of 3d local features. In CVPR, 2020.
- Pointdsc: Robust point cloud registration using deep spatial consistency. In CVPR, 2021.
- Method for registration of 3-d shapes. In Sensor fusion IV: control paradigms and data structures, pages 586–606. Spie, 1992.
- Dsac-differentiable ransac for camera localization. In CVPR, 2017.
- Pcam: Product of cross-attention matrices for rigid registration of point clouds. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 13229–13238, 2021.
- Sc2-pcr: A second order spatial compatibility for efficient and robust point cloud registration. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 13221–13231, 2022.
- Fully convolutional geometric features. In ICCV, 2019.
- Deep global registration. In CVPR, 2020.
- Stickypillars: Robust and efficient feature matching on point clouds using graph neural networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 313–323, 2021.
- Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communication of ACM, 1981.
- Are we ready for autonomous driving? the kitti vision benchmark suite. In 2012 IEEE conference on computer vision and pattern recognition, pages 3354–3361. IEEE, 2012.
- The perfect match: 3d point cloud matching with smoothed densities. In CVPR, 2019a.
- The perfect match: 3d point cloud matching with smoothed densities. In CVPR, 2019b.
- Learning multiview 3d point cloud registration. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 1759–1769, 2020.
- In defense of the triplet loss for person re-identification. arXiv preprint arXiv:1703.07737, 2017.
- Predator: Registration of 3d point clouds with low overlap. In CVPR, 2021.
- Using spin images for efficient object recognition in cluttered 3d scenes. PAMI, 1999.
- Fixing the locally optimized ransac–full experimental evaluation. In British machine vision conference. Citeseer, 2012.
- A hierarchical network for large-scale outdoor lidar point cloud registration. In Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada, pages 11–17, 2021.
- An iterative image registration technique with an application to stereo vision. Vancouver, 1981.
- Model-based classification of quadric surfaces. CVGIP: Image Understanding, 58(2):235–249, 1993.
- 3dregnet: A deep neural network for 3d point registration. In CVPR, 2020.
- Geometric transformer for fast and robust point cloud registration. In CVPR, 2022.
- Aligning point cloud views using persistent feature histograms. In IROS, 2008.
- Fast point feature histograms (FPFH) for 3D registration. In ICRA, 2009.
- Circle loss: A unified perspective of pair similarity optimization. In CVPR, 2020.
- Unique signatures of histograms for local surface description. In ECCV, 2010a.
- Unique shape context for 3D data description. In ACM Workshop on 3D Object Retrieval, 2010b.
- Shinji Umeyama. Least-squares estimation of transformation parameters between two point patterns. IEEE Transactions on Pattern Analysis & Machine Intelligence, 13(04):376–380, 1991.
- Deep closest point: Learning representations for point cloud registration. In ICCV, 2019a.
- Prnet: Self-supervised learning for partial-to-partial registration. NeurIPS, 2019b.
- Dynamic graph cnn for learning on point clouds. Acm Transactions On Graphics (tog), 38(5):1–12, 2019.
- 3d shapenets: A deep representation for volumetric shapes. In CVPR, 2015.
- Omnet: Learning overlapping mask for partial-to-partial point cloud registration. In ICCV, 2021.
- 3dfeat-net: Weakly supervised local 3d features for point cloud registration. In Proceedings of the European conference on computer vision (ECCV), pages 607–623, 2018.
- Rpm-net: Robust point matching using learned features. In CVPR, 2020.
- Regtr: End-to-end point cloud correspondences with transformers. In CVPR, 2022.
- Cofinet: Reliable coarse-to-fine correspondences for robust pointcloud registration. Advances in Neural Information Processing Systems, 34:23872–23884, 2021.
- 3dmatch: Learning local geometric descriptors from rgb-d reconstructions. In CVPR, 2017.