Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Q-REG: End-to-End Trainable Point Cloud Registration with Surface Curvature (2309.16023v1)

Published 27 Sep 2023 in cs.CV

Abstract: Point cloud registration has seen recent success with several learning-based methods that focus on correspondence matching and, as such, optimize only for this objective. Following the learning step of correspondence matching, they evaluate the estimated rigid transformation with a RANSAC-like framework. While it is an indispensable component of these methods, it prevents a fully end-to-end training, leaving the objective to minimize the pose error nonserved. We present a novel solution, Q-REG, which utilizes rich geometric information to estimate the rigid pose from a single correspondence. Q-REG allows to formalize the robust estimation as an exhaustive search, hence enabling end-to-end training that optimizes over both objectives of correspondence matching and rigid pose estimation. We demonstrate in the experiments that Q-REG is agnostic to the correspondence matching method and provides consistent improvement both when used only in inference and in end-to-end training. It sets a new state-of-the-art on the 3DMatch, KITTI, and ModelNet benchmarks.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (44)
  1. GeoTransformer Github Page. https://github.com/qinzheng93/GeoTransformer. Accessed: 2022-11-11.
  2. PointDSC Github Page. https://github.com/XuyangBai/PointDSC. Accessed: 2023-03-02.
  3. Spinnet: Learning a general surface descriptor for 3d point cloud registration. In CVPR, 2021.
  4. Pointnetlk: Robust & efficient point cloud registration using pointnet. In CVPR, 2019.
  5. Least-squares fitting of two 3-d point sets. IEEE TPAMI, 1987.
  6. D3feat: Joint learning of dense detection and description of 3d local features. In CVPR, 2020.
  7. Pointdsc: Robust point cloud registration using deep spatial consistency. In CVPR, 2021.
  8. Method for registration of 3-d shapes. In Sensor fusion IV: control paradigms and data structures, pages 586–606. Spie, 1992.
  9. Dsac-differentiable ransac for camera localization. In CVPR, 2017.
  10. Pcam: Product of cross-attention matrices for rigid registration of point clouds. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 13229–13238, 2021.
  11. Sc2-pcr: A second order spatial compatibility for efficient and robust point cloud registration. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 13221–13231, 2022.
  12. Fully convolutional geometric features. In ICCV, 2019.
  13. Deep global registration. In CVPR, 2020.
  14. Stickypillars: Robust and efficient feature matching on point clouds using graph neural networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 313–323, 2021.
  15. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communication of ACM, 1981.
  16. Are we ready for autonomous driving? the kitti vision benchmark suite. In 2012 IEEE conference on computer vision and pattern recognition, pages 3354–3361. IEEE, 2012.
  17. The perfect match: 3d point cloud matching with smoothed densities. In CVPR, 2019a.
  18. The perfect match: 3d point cloud matching with smoothed densities. In CVPR, 2019b.
  19. Learning multiview 3d point cloud registration. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 1759–1769, 2020.
  20. In defense of the triplet loss for person re-identification. arXiv preprint arXiv:1703.07737, 2017.
  21. Predator: Registration of 3d point clouds with low overlap. In CVPR, 2021.
  22. Using spin images for efficient object recognition in cluttered 3d scenes. PAMI, 1999.
  23. Fixing the locally optimized ransac–full experimental evaluation. In British machine vision conference. Citeseer, 2012.
  24. A hierarchical network for large-scale outdoor lidar point cloud registration. In Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada, pages 11–17, 2021.
  25. An iterative image registration technique with an application to stereo vision. Vancouver, 1981.
  26. Model-based classification of quadric surfaces. CVGIP: Image Understanding, 58(2):235–249, 1993.
  27. 3dregnet: A deep neural network for 3d point registration. In CVPR, 2020.
  28. Geometric transformer for fast and robust point cloud registration. In CVPR, 2022.
  29. Aligning point cloud views using persistent feature histograms. In IROS, 2008.
  30. Fast point feature histograms (FPFH) for 3D registration. In ICRA, 2009.
  31. Circle loss: A unified perspective of pair similarity optimization. In CVPR, 2020.
  32. Unique signatures of histograms for local surface description. In ECCV, 2010a.
  33. Unique shape context for 3D data description. In ACM Workshop on 3D Object Retrieval, 2010b.
  34. Shinji Umeyama. Least-squares estimation of transformation parameters between two point patterns. IEEE Transactions on Pattern Analysis & Machine Intelligence, 13(04):376–380, 1991.
  35. Deep closest point: Learning representations for point cloud registration. In ICCV, 2019a.
  36. Prnet: Self-supervised learning for partial-to-partial registration. NeurIPS, 2019b.
  37. Dynamic graph cnn for learning on point clouds. Acm Transactions On Graphics (tog), 38(5):1–12, 2019.
  38. 3d shapenets: A deep representation for volumetric shapes. In CVPR, 2015.
  39. Omnet: Learning overlapping mask for partial-to-partial point cloud registration. In ICCV, 2021.
  40. 3dfeat-net: Weakly supervised local 3d features for point cloud registration. In Proceedings of the European conference on computer vision (ECCV), pages 607–623, 2018.
  41. Rpm-net: Robust point matching using learned features. In CVPR, 2020.
  42. Regtr: End-to-end point cloud correspondences with transformers. In CVPR, 2022.
  43. Cofinet: Reliable coarse-to-fine correspondences for robust pointcloud registration. Advances in Neural Information Processing Systems, 34:23872–23884, 2021.
  44. 3dmatch: Learning local geometric descriptors from rgb-d reconstructions. In CVPR, 2017.
Citations (2)

Summary

We haven't generated a summary for this paper yet.