Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
149 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Coupled Laplacian Eigenmaps for Locally-Aware 3D Rigid Point Cloud Matching (2402.17372v2)

Published 27 Feb 2024 in cs.CV

Abstract: Point cloud matching, a crucial technique in computer vision, medical and robotics fields, is primarily concerned with finding correspondences between pairs of point clouds or voxels. In some practical scenarios, emphasizing local differences is crucial for accurately identifying a correct match, thereby enhancing the overall robustness and reliability of the matching process. Commonly used shape descriptors have several limitations and often fail to provide meaningful local insights about the paired geometries. In this work, we propose a new technique, based on graph Laplacian eigenmaps, to match point clouds by taking into account fine local structures. To deal with the order and sign ambiguity of Laplacian eigenmaps, we introduce a new operator, called Coupled Laplacian (https://github.com/matteo-bastico/CoupLap), that allows to easily generate aligned eigenspaces for multiple registered geometries. We show that the similarity between those aligned high-dimensional spaces provides a locally meaningful score to match shapes. We firstly evaluate the performance of the proposed technique in a point-wise manner, focusing on the task of object anomaly localization on the MVTec 3D-AD dataset. Additionally, we define a new medical task, called automatic Bone Side Estimation (BSE), which we address through a global similarity score derived from coupled eigenspaces. In order to test it, we propose a benchmark collecting bone surface structures from various public datasets. Our matching technique, based on Coupled Laplacian, outperforms other methods by reaching an impressive accuracy on both tasks.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (79)
  1. The wave kernel signature: A quantum mechanical approach to shape analysis. In 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), pages 1626–1633, Barcelona, Spain, 2011. IEEE.
  2. Anatomy, Bone Markings. In StatPearls. StatPearls Publishing, Treasure Island (FL), 2023.
  3. Real-time multimodal image registration with partial intraoperative point-set data. Medical Image Analysis, 74:102231, 2021.
  4. Laplacian Eigenmaps for Dimensionality Reduction and Data Representation. Neural Computation, 15(6):1373–1396, 2003.
  5. Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(4):509–522, 2002. Conference Name: IEEE Transactions on Pattern Analysis and Machine Intelligence.
  6. Anomaly Detection in 3D Point Clouds using Deep Geometric Descriptors. In 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pages 2612–2622, Waikoloa, HI, USA, 2023. IEEE.
  7. The MVTec 3D-AD Dataset for Unsupervised 3D Anomaly Detection and Localization. In Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, pages 202–213, 2022. arXiv:2112.09045 [cs].
  8. A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2):239–256, 1992. Conference Name: IEEE Transactions on Pattern Analysis and Machine Intelligence.
  9. A Novel Shape Retrieval Method for 3D Mechanical Components Based on Object Projection, Pre-Trained Deep Learning Models and Autoencoder. Computer-Aided Design, 154:103417, 2023.
  10. Point Pair Features Based Object Detection and Pose Estimation Revisited. In 2015 International Conference on 3D Vision, pages 527–535, 2015.
  11. Scale-invariant heat kernel signatures for non-rigid shape recognition. In 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 1704–1711, 2010. ISSN: 1063-6919.
  12. Michael C. Corballis. Bilaterally Symmetrical: To Be or Not to Be? Symmetry, 12(3):326, 2020. Number: 3 Publisher: Multidisciplinary Digital Publishing Institute.
  13. Estimation and Reduction of Target Registration Error. Medical image computing and computer-assisted intervention : MICCAI … International Conference on Medical Image Computing and Computer-Assisted Intervention, 15(0 3):139–146, 2012.
  14. PPF-FoldNet: Unsupervised Learning of Rotation Invariant 3D Local Descriptors, 2018a. arXiv:1808.10322 [cs].
  15. PPFNet: Global Context Aware Local Features for Robust 3D Point Matching, 2018b. arXiv:1802.02669 [cs].
  16. Fast and Accurate Point Cloud Registration using Trees of Gaussian Mixtures, 2018. arXiv:1807.02587 [cs].
  17. 3D Point Cloud Registration for Localization Using a Deep Neural Network Auto-Encoder. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2472–2481, Honolulu, HI, 2017. IEEE.
  18. Navigation in anterior cruciate ligament reconstruction: State of the art. Journal of ISAKOS, 8(1):47–53, 2023.
  19. A robust method for automatic identification of femoral landmarks, axes, planes and bone coordinate systems using surface models. Scientific Reports, 10(1):20859, 2020. Number: 1 Publisher: Nature Publishing Group.
  20. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24(6):381–395, 1981.
  21. FilterReg: Robust and Efficient Probabilistic Point-Set Registration using Gaussian Filter and Twist Parameterization, 2019. arXiv:1811.10136 [cs].
  22. SHREC 2023: Point cloud change detection for city scenes. Computers & Graphics, 115:35–42, 2023.
  23. Articulated Non-Rigid Point Set Registration for Human Pose Estimation from 3D Sensors. Sensors, 15(7):15218–15245, 2015. Number: 7 Publisher: Multidisciplinary Digital Publishing Institute.
  24. Laplacian-Based Dimensionality Reduction Including Spectral Clustering, Laplacian Eigenmap, Locality Preserving Projection, Graph Embedding, and Diffusion Map: Tutorial and Survey, 2022. arXiv:2106.02154 [cs, stat].
  25. The Perfect Match: 3D Point Cloud Matching With Smoothed Densities. In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 5540–5549, Long Beach, CA, USA, 2019. IEEE.
  26. Rotational Projection Statistics for 3D Local Surface Description and Object Recognition. International Journal of Computer Vision, 105(1):63–86, 2013. arXiv:1304.3192 [cs].
  27. A Comprehensive Performance Evaluation of 3D Local Feature Descriptors. International Journal of Computer Vision, 116(1):66–89, 2016.
  28. The manoeuvrability hypothesis to explain the maintenance of bilateral symmetry in animal evolution. Biology Direct, 7(1):22, 2012.
  29. Salient spectral geometric features for shape matching and retrieval. The Visual Computer, 25(5):667–675, 2009.
  30. Learning Local Shape Descriptors from Part Correspondences With Multi-view Convolutional Networks, 2017. arXiv:1706.04496 [cs].
  31. Robust Point Set Registration Using Gaussian Mixture Models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(8):1633–1645, 2011. Conference Name: IEEE Transactions on Pattern Analysis and Machine Intelligence.
  32. Geometric variation of the human tibia-fibula: a public dataset of tibia-fibula surface meshes and statistical shape model. PeerJ, 11:e14708, 2023. Publisher: PeerJ Inc.
  33. Sketch-based Medical Image Retrieval, 2023. arXiv:2303.03633 [cs].
  34. Artificial Intelligence Based Patient-Specific Preoperative Planning Algorithm for Total Knee Arthroplasty. Frontiers in robotics and AI, 9:840282, 2022.
  35. Rigid Point Set Registration Based on Cubature Kalman Filter and Its Application in Intelligent Vehicles. IEEE Transactions on Intelligent Transportation Systems, 19(6):1754–1765, 2018. Conference Name: IEEE Transactions on Intelligent Transportation Systems.
  36. A comparison of methods for non-rigid 3D shape retrieval. Pattern Recognition, 46(1):449–461, 2013.
  37. Non-rigid 3D shape retrieval. In Proceedings of the 2015 Eurographics Workshop on 3D Object Retrieval, pages 107–120, Goslar, DEU, 2015. Eurographics Association.
  38. Medical Imaging and Privacy in the Era of Artificial Intelligence: Myth, Fallacy, and the Future. Journal of the American College of Radiology : JACR, 17(9):1159–1162, 2020.
  39. David G. Lowe. Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision, 60(2):91–110, 2004.
  40. A wear model to predict damage of reconstructed ACL. Journal of the Mechanical Behavior of Biomedical Materials, page 105426, 2022.
  41. Recent developments and trends in point set registration methods. Journal of Visual Communication and Image Representation, 46:95–106, 2017.
  42. Articulated Shape Matching Using Laplacian Eigenfunctions and Unsupervised Point Registration. In 2008 IEEE Conference on Computer Vision and Pattern Recognition, pages 1–8, 2008. arXiv:2012.07340 [cs].
  43. Russell Merris. Laplacian matrices of graphs: a survey. Linear Algebra and its Applications, 197-198:143–176, 1994.
  44. Computer-aided Surgical Planning of Anterior Cruciate Ligament Reconstruction in MR Images. Procedia Computer Science, 60:1659–1667, 2015.
  45. Point-Set Registration: Coherent Point Drift. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(12):2262–2275, 2010. arXiv:0905.2635 [cs].
  46. Robot Object Retrieval with Contextual Natural Language Queries, 2020. arXiv:2006.13253 [cs].
  47. Non-linear scaling of a musculoskeletal model of the lower limb using statistical shape models. Journal of Biomechanics, 49(14):3576–3581, 2016.
  48. Abdol Hamid Pilevar. CBMIR: Content-based Image Retrieval Algorithm for Medical Image Databases. Journal of Medical Signals and Sensors, 1(1):12–18, 2011.
  49. PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation, 2017a. arXiv:1612.00593 [cs].
  50. PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space, 2017b. arXiv:1706.02413 [cs].
  51. Laplace-spectra as fingerprints for shape matching. In Proceedings of the 2005 ACM symposium on Solid and physical modeling, pages 101–106, New York, NY, USA, 2005. Association for Computing Machinery.
  52. Laplace–Beltrami spectra as ‘Shape-DNA’ of surfaces and solids. Computer-Aided Design, 38(4):342–366, 2006.
  53. Discrete Laplace–Beltrami operators for shape analysis and segmentation. Computers & Graphics, 33(3):381–390, 2009.
  54. A Survey on Data-Driven 3D Shape Descriptors. Computer Graphics Forum, 38(1):356–393, 2019. _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1111/cgf.13536.
  55. Raif M. Rustamov. Laplace-Beltrami Eigenfunctions for Deformation Invariant Shape Representation. The Eurographics Association, 2007. Accepted: 2014-01-29T09:43:15Z ISSN: 1727-8384.
  56. Aligning point cloud views using persistent feature histograms. In 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 3384–3391, 2008. ISSN: 2153-0866.
  57. Fast Point Feature Histograms (FPFH) for 3D registration. In 2009 IEEE International Conference on Robotics and Automation, pages 3212–3217, Kobe, 2009. IEEE.
  58. SHOT: Unique signatures of histograms for surface and texture description. Computer Vision and Image Understanding, 125:251–264, 2014.
  59. Point Transformer for Shape Classification and Retrieval of 3D and ALS Roof PointClouds, 2021. arXiv:2011.03921 [cs].
  60. 3D Shape Registration Using Spectral Graph Embedding and Probabilistic Matching, 2021. arXiv:2106.11166 [cs, stat].
  61. 3D registration of the point cloud data using ICP algorithm in medical image analysis. In 2018 ELEKTRO, pages 1–6, 2018.
  62. A Concise and Provably Informative Multi‐Scale Signature Based on Heat Diffusion. Computer Graphics Forum, 28(5):1383–1392, 2009.
  63. An evaluation of local shape descriptors for 3D shape retrieval. In Three-Dimensional Image Processing (3DIP) and Applications II, pages 217–231. SPIE, 2012.
  64. Track deformable objects from point clouds with structure preserved registration. The International Journal of Robotics Research, 41(6):599–614, 2022. Publisher: SAGE Publications Ltd STM.
  65. Johan W. H. Tangelder and Remco C. Veltkamp. A survey of content based 3D shape retrieval methods. Multimedia Tools and Applications, 39(3):441–471, 2008.
  66. Unique shape context for 3d data description. In Proceedings of the ACM workshop on 3D object retrieval, pages 57–62, New York, NY, USA, 2010. Association for Computing Machinery.
  67. Søren Toxvaerd. The Emergence of the Bilateral Symmetry in Animals: A Review and a New Hypothesis. Symmetry, 13(2):261, 2021. Number: 2 Publisher: Multidisciplinary Digital Publishing Institute.
  68. Deep Closest Point: Learning Representations for Point Cloud Registration, 2019. arXiv:1905.03304 [cs] version: 1.
  69. A Robust Local Spectral Descriptor for Matching Non-Rigid Shapes With Incompatible Shape Structures. In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 6224–6233, Long Beach, CA, USA, 2019. IEEE.
  70. Semantic 3D scene interpretation: A framework combining optimal neighborhood size selection with relevant features. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, II-3:181–188, 2014.
  71. Learning Robust Point Representation for 3D Non-Rigid Shape Retrieval. IEEE Transactions on Multimedia, pages 1–15, 2023. Conference Name: IEEE Transactions on Multimedia.
  72. DeepShape: Deep-Learned Shape Descriptor for 3D Shape Retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(7):1335–1345, 2017. Conference Name: IEEE Transactions on Pattern Analysis and Machine Intelligence.
  73. Shape retrieval using deep autoencoder learning representation. In 2016 13th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP), pages 227–230, 2016.
  74. Schubert Varieties and Distances between Subspaces of Different Dimensions. SIAM Journal on Matrix Analysis and Applications, 37(3):1176–1197, 2016.
  75. 3DFeat-Net: Weakly Supervised Local 3D Features for Point Cloud Registration. In Computer Vision – ECCV 2018, pages 630–646, Cham, 2018. Springer International Publishing.
  76. LIFT: Learned Invariant Feature Transform, 2016. arXiv:1603.09114 [cs].
  77. 3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions, 2017. arXiv:1603.08182 [cs].
  78. Efficient feature extraction for 2D/3D objects in mesh representation. In Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205), pages 935–938 vol.3, 2001.
  79. Spectral Mesh Processing. Computer Graphics Forum, 29(6):1865–1894, 2010.

Summary

We haven't generated a summary for this paper yet.