Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
156 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Learning the Geodesic Embedding with Graph Neural Networks (2309.05613v2)

Published 11 Sep 2023 in cs.CV and cs.GR

Abstract: We present GeGnn, a learning-based method for computing the approximate geodesic distance between two arbitrary points on discrete polyhedra surfaces with constant time complexity after fast precomputation. Previous relevant methods either focus on computing the geodesic distance between a single source and all destinations, which has linear complexity at least or require a long precomputation time. Our key idea is to train a graph neural network to embed an input mesh into a high-dimensional embedding space and compute the geodesic distance between a pair of points using the corresponding embedding vectors and a lightweight decoding function. To facilitate the learning of the embedding, we propose novel graph convolution and graph pooling modules that incorporate local geodesic information and are verified to be much more effective than previous designs. After training, our method requires only one forward pass of the network per mesh as precomputation. Then, we can compute the geodesic distance between a pair of points using our decoding function, which requires only several matrix multiplications and can be massively parallelized on GPUs. We verify the efficiency and effectiveness of our method on ShapeNet and demonstrate that our method is faster than existing methods by orders of magnitude while achieving comparable or better accuracy. Additionally, our method exhibits robustness on noisy and incomplete meshes and strong generalization ability on out-of-distribution meshes. The code and pretrained model can be found on https://github.com/IntelligentGeometry/GeGnn.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (78)
  1. Fast construction of discrete geodesic graphs. ACM Trans. Graph. 39, 2 (2020).
  2. G. H. Bendels and R. Klein. 2003. Mesh Forging: Editing of 3D-Meshes Using Implicitly Defined Occluders. In SGP.
  3. Geometric texture synthesis by example. In Symp. Geom. Proc.
  4. How Attentive are Graph Attention Networks?. In ICLR.
  5. J. Douglas Carroll and Phipps Arabie. 1998. Multidimensional scaling. Measurement, judgment and decision making (1998).
  6. ShapeNet: An information-rich 3D model repository. arXiv preprint arXiv:1512.03012 (2015).
  7. Jindong Chen and Yijie Han. 1990. Shortest paths on a polyhedron. In Proceedings of the sixth annual symposium on Computational geometry.
  8. Geometric diffusions as a tool for harmonic analysis and structure definition of data: Diffusion maps. Proceedings of the national academy of sciences 102, 21 (2005).
  9. Digital geometry processing with discrete exterior calculus. In ACM SIGGRAPH 2013 courses.
  10. A survey of algorithms for geodesic paths and distances. arXiv preprint arXiv:2007.10430 (2020).
  11. Geodesics in heat: A new approach to computing distance based on heat flow. ACM Trans. Graph. 32, 5 (2013).
  12. The Heat Method for Distance Computation. Commun. ACM 60, 11 (2017).
  13. Vector neurons: A general framework for so (3)-equivariant networks. In CVPR.
  14. Matthias Fey and Jan Eric Lenssen. 2019. Fast Graph Representation Learning with PyTorch Geometric. In ICLR Workshop.
  15. SplineCNN: Fast Geometric Deep Learning with Continuous B-Spline Kernels. In CVPR.
  16. Random-walk computation of similarities between nodes of a graph with application to collaborative recommendation. IEEE Transactions on knowledge and data engineering 19, 3 (2007).
  17. Michael Garland and Paul S Heckbert. 1997. Surface simplification using quadric error metrics. In SIGGRAPH.
  18. Neural message passing for quantum chemistry. In ICML.
  19. Craig Gotsman and Kai Hormann. 2022. Compressing Geodesic Information for Fast Point-to-Point Geodesic Distance Queries. In SIGGRAPH Asia.
  20. Inductive Representation Learning on Large Graphs. In NeurIPS.
  21. MeshCNN: A network with an edge. ACM Trans. Graph. (SIGGRAPH) 38, 4 (2019).
  22. Point2Mesh: A Self-Prior for Deformable Meshes. ACM Trans. Graph. (SIGGRAPH) 39, 4 (2020).
  23. Deep residual learning for image recognition. In CVPR.
  24. Mesh optimization. In SIGGRAPH.
  25. RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Clouds. CVPR.
  26. Subdivision-based mesh convolution networks. ACM Trans. Graph. 41, 3 (2022).
  27. Ron Kimmel and James A. Sethian. 1998. Computing geodesic paths on manifolds. Proceedings of the National Academy of Science 95, 15 (1998).
  28. Thomas N Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In ICLR.
  29. PointCNN: Convolution on X-transformed points. In NeurIPS.
  30. Biharmonic distance. ACM Trans. Graph. 29, 3 (2010).
  31. Neural Subdivision. ACM Trans. Graph. (SIGGRAPH) 39, 4 (2020).
  32. Charles Loop. 1987. Smooth subdivision surfaces based on triangles. Thesis, University of Utah (1987).
  33. Ilya Loshchilov and Frank Hutter. 2019. Decoupled weight decay regularization. In ICLR.
  34. Hiroshi Maehara. 2013. Euclidean embeddings of finite metric spaces. Discrete Mathematics 313, 23 (2013).
  35. 3D Shape Matching based on Geodesic Distance Distributions. In Vision, Modeling and Visualization.
  36. Facundo Mémoli and Guillermo Sapiro. 2001. Fast computation of weighted distance functions and geodesics on implicit hyper-surfaces. Journal of computational Physics 173, 2 (2001).
  37. Facundo Mémoli and Guillermo Sapiro. 2005. Distance Functions and Geodesics on Submanifolds of Rdsuperscript𝑅𝑑R^{d}italic_R start_POSTSUPERSCRIPT italic_d end_POSTSUPERSCRIPT and Point Clouds. SIAM J. Appl. Math. 65, 4 (2005).
  38. The discrete geodesic problem. SIAM J. Comput. 16, 4 (1987).
  39. Shape distributions. ACM Trans. Graph. 21, 4 (2002).
  40. Weighted averages on surfaces. ACM Trans. Graph. (SIGGRAPH) 32, 4 (2013).
  41. PyTorch: An Imperative Style, High-Performance Deep Learning Library. In NeurIPS.
  42. Learning Mesh-Based Simulation with Graph Networks. In ICLR.
  43. Andrew Pressley and Andrew Pressley. 2010. Gauss’ theorema egregium. Elementary differential geometry (2010).
  44. PointNet++: Deep hierarchical feature learning on point sets in a metric space. In NeurIPS.
  45. Fast and exact discrete geodesic computation based on triangle-oriented wavefront propagation. ACM Trans. Graph. (SIGGRAPH) 35, 4 (2016).
  46. Full and partial symmetries of non-rigid shapes. International Journal of Computer Vision 89, 1 (2010).
  47. U-Net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention.
  48. Interior distance using barycentric coordinates. Comput. Graph. Forum (SGP) 28, 5 (2009).
  49. Interactive Decal Compositing with Discrete Exponential Maps. In SIGGRAPH.
  50. James A. Sethian. 1999. Fast marching methods. SIAM review 41, 2 (1999).
  51. Efficient inter-geodesic distance computation and fast classical scaling. TPAMI 42, 1 (2018).
  52. Nicholas Sharp and Keenan Crane. 2020. You can find geodesic paths in triangle meshes by just flipping edges. ACM Trans. Graph. (SIGGRAPH ASIA) 39, 6 (2020).
  53. Martin Simonovsky and Nikos Komodakis. 2017. Dynamic edge-conditioned filters in convolutional neural networks on graphs. In CVPR.
  54. Earth mover’s distances on discrete surfaces. ACM Trans. Graph. (SIGGRAPH) 33, 4 (2014).
  55. Fast exact and approximate geodesics on meshes. ACM Trans. Graph. 24, 3 (2005).
  56. Parallel and scalable heat methods for geodesic distance computation. IEEE Trans. Pattern Anal. Mach. Intell. 43, 2 (2019).
  57. KPConv: Flexible and deformable convolution for point clouds. In ICCV.
  58. John N. Tsitsiklis. 1995. Efficient algorithms for globally optimal trajectories. IEEE transactions on Automatic Control 40, 9 (1995).
  59. Graph attention networks. stat 1050, 20 (2017).
  60. Pixel2Mesh: Generating 3D mesh models from single RGB images. In CVPR.
  61. Dual Octree Graph Networks for Learning Adaptive Volumetric Shape Representations. ACM Trans. Graph. (SIGGRAPH) 41, 4 (2022).
  62. Dynamic graph CNN for learning on point clouds. ACM Trans. Graph. 38, 5 (2019).
  63. Parallel algorithms for approximation of distance maps on parametric surfaces. ACM Transactions on Graphics (TOG) (2008).
  64. Yuxin Wu and Kaiming He. 2018. Group normalization. In ECCV.
  65. A comprehensive survey on graph neural networks. IEEE Transactions on Neural Networks and Learning Systems 32, 1 (2020).
  66. GeodesicEmbedding (GE): a high-dimensional embedding approach for fast geodesic distance queries. IEEE. T. Vis. Comput. Gr. (2021).
  67. Shi-Qing Xin and Guo-Jin Wang. 2009. Improving Chen and Han’s algorithm on the discrete geodesic problem. ACM Trans. Graph. (SIGGRAPH) 28, 4 (2009).
  68. Constant-time all-pairs geodesic distance query on triangle meshes. In I3D.
  69. Fast wavefront propagation (FWP) for computing exact geodesic distances on meshes. IEEE. T. Vis. Comput. Gr. 21, 7 (2015).
  70. How powerful are graph neural networks? arXiv preprint arXiv:1810.00826 (2018).
  71. Partial intrinsic reflectional symmetry of 3D shapes. In ACM Trans. Graph. (SIGGRAPH ASIA).
  72. SpiderCNN: Deep Learning on Point Sets with Parameterized Convolutional Filters. In ECCV.
  73. Graph nodes clustering based on the commute-time kernel. In Advances in Knowledge Discovery and Data Mining.
  74. SyncSpecCNN: Synchronized spectral CNN for 3D shape segmentation. In CVPR.
  75. Saddle vertex graph (SVG) a novel solution to the discrete geodesic problem. ACM Trans. Graph. (SIGGRAPH ASIA) 32, 6 (2013).
  76. Parallel Chen-Han (PCH) algorithm for discrete geodesics. ACM Trans. Graph. 33, 1 (2014).
  77. NeuroGF: A Neural Representation for Fast Geodesic Distance and Path Queries. arXiv preprint arXiv:2306.00658 (2023).
  78. Texture mapping using surface flattening via multidimensional scaling. IEEE. T. Vis. Comput. Gr. 8, 2 (2002).
Citations (4)

Summary

We haven't generated a summary for this paper yet.

Github Logo Streamline Icon: https://streamlinehq.com