Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
156 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Principal subbundles for dimension reduction (2307.03128v1)

Published 6 Jul 2023 in stat.ME, cs.CV, cs.LG, math.DG, math.ST, and stat.TH

Abstract: In this paper we demonstrate how sub-Riemannian geometry can be used for manifold learning and surface reconstruction by combining local linear approximations of a point cloud to obtain lower dimensional bundles. Local approximations obtained by local PCAs are collected into a rank $k$ tangent subbundle on $\mathbb{R}d$, $k<d$, which we call a principal subbundle. This determines a sub-Riemannian metric on $\mathbb{R}d$. We show that sub-Riemannian geodesics with respect to this metric can successfully be applied to a number of important problems, such as: explicit construction of an approximating submanifold $M$, construction of a representation of the point-cloud in $\mathbb{R}k$, and computation of distances between observations, taking the learned geometry into account. The reconstruction is guaranteed to equal the true submanifold in the limit case where tangent spaces are estimated exactly. Via simulations, we show that the framework is robust when applied to noisy data. Furthermore, the framework generalizes to observations on an a priori known Riemannian manifold.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (37)
  1. David G. Kendall “Shape manifolds, procrustean metrics, and complex projective spaces” In Bulletin of the London mathematical society 16.2 Wiley Online Library, 1984, pp. 81–121
  2. Ji-Guang Sun “Eigenvalues And Eigenvectors Of A Matrix Dependent On Several Parameters.” In Journal of Computational Mathematics 3.4, 1985, pp. 351
  3. Ji-guang Sun “Multiple eigenvalue sensitivity analysis” In Linear algebra and its applications 137 Elsevier, 1990, pp. 183–211
  4. “Numerical optimization” In Springer Science 35.67-68, 1999, pp. 7
  5. Wei-Liang Chow “Über Systeme von linearen partiellen Differential-gleichungen erster Ordnung” In The Collected Papers Of Wei-Liang Chow World Scientific, 2002, pp. 47–54
  6. “Automatic alignment of local representations” In Advances in neural information processing systems 15, 2002
  7. “Principal geodesic analysis for the study of nonlinear statistics of shape” In IEEE transactions on medical imaging 23.8 IEEE, 2004, pp. 995–1005
  8. “Principal manifolds and nonlinear dimensionality reduction via tangent space alignment” In SIAM journal on scientific computing 26.1 SIAM, 2004, pp. 313–338
  9. Lawrence Cayton “Algorithms for manifold learning” In Univ. of California at San Diego Tech. Rep 12.1-17, 2005, pp. 1
  10. “Geometric numerical integration” In Oberwolfach Reports 3.1, 2006, pp. 805–882
  11. Michael Kazhdan, Matthew Bolitho and Hugues Hoppe “Poisson surface reconstruction” In Proceedings of the fourth Eurographics symposium on Geometry processing 7, 2006
  12. Stephan Huckemann, Thomas Hotz and Axel Munk “Intrinsic shape analysis: Geodesic PCA for Riemannian manifolds modulo isometric Lie group actions” In Statistica Sinica JSTOR, 2010, pp. 1–58
  13. “Generalized PCA via the backward stepwise approach in image analysis” In Brain, Body and Machine Springer, 2010, pp. 111–123
  14. “Manifold valued statistics, exact principal geodesic analysis and the effect of linear approximations” In Computer Vision–ECCV 2010: 11th European Conference on Computer Vision, Heraklion, Crete, Greece, September 5-11, 2010, Proceedings, Part VI 11, 2010, pp. 43–56 Springer
  15. Laurent Younes “Shapes and diffeomorphisms” Springer, 2010
  16. Søren Hauberg, Oren Freifeld and Michael Black “A geometric take on metric learning” In Advances in Neural Information Processing Systems 25, 2012
  17. “Manifold learning theory and applications” CRC press Boca Raton, 2012
  18. “Vector diffusion maps and the connection Laplacian” In Communications on pure and applied mathematics 65.8 Wiley Online Library, 2012, pp. 1067–1144
  19. John M. Lee “Introduction to smooth manifolds” In Introduction to smooth manifolds Springer, 2013
  20. “Non-linear dimensionality reduction: Riemannian metric estimation and the problem of geometric discovery” In arXiv preprint arXiv:1305.7255, 2013
  21. Frédéric Jean “Control of nonholonomic systems: from sub-Riemannian geometry to motion planning” Springer, 2014
  22. Victor M. Panaretos, Tung Pham and Zhigang Yao “Principal flows” In Journal of the American Statistical Association 109.505 Taylor & Francis, 2014, pp. 424–436
  23. Ludovic Rifford “Sub-Riemannian geometry and optimal transport” Springer, 2014
  24. Aurélien Bellet, Amaury Habrard and Marc Sebban “Metric learning” In Synthesis lectures on artificial intelligence and machine learning 9.1 Morgan & Claypool Publishers, 2015, pp. 1–151
  25. Zhigang Yao, Benjamin Eltzner and Tung Pham “Principal Sub-manifolds” arXiv, 2016 DOI: 10.48550/ARXIV.1604.04318
  26. Roy Frostig, Matthew James Johnson and Chris Leary “Compiling machine learning programs via high-level tracing” In Systems for Machine Learning 4.9 SysML, 2018
  27. John M. Lee “Introduction to Riemannian manifolds” Springer, 2018
  28. Xavier Pennec “Barycentric subspace analysis on manifolds” In The Annals of Statistics 46.6A Institute of Mathematical Statistics, 2018, pp. 2711–2746
  29. Andrei Agrachev, Davide Barilari and Ugo Boscain “A comprehensive introduction to sub-Riemannian geometry” Cambridge University Press, 2019
  30. Xavier Pennec, Stefan Sommer and Tom Fletcher “Riemannian geometric statistics in medical image analysis” Academic Press, 2019
  31. “Implicit geometric regularization for learning shapes” In arXiv preprint arXiv:2002.10099, 2020
  32. “Geomstats: A Python Package for Riemannian Geometry in Machine Learning” In Journal of Machine Learning Research 21.223, 2020, pp. 1–9 URL: http://jmlr.org/papers/v21/19-027.html
  33. “A generic unfolding algorithm for manifolds estimated by local linear approximations” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020, pp. 854–855
  34. “Scikit-dimension: a python package for intrinsic dimension estimation” In Entropy 23.10 MDPI, 2021, pp. 1368
  35. “Recent advances in directional statistics” In Test 30.1 Springer, 2021, pp. 1–58
  36. “Surface Reconstruction from Point Clouds: A Survey and a Benchmark”, 2022 eprint: arXiv:2205.02413
  37. “Manifold Coordinates with Physical Meaning” In Journal of Machine Learning Research 23.133, 2022, pp. 1–57
Citations (1)

Summary

We haven't generated a summary for this paper yet.