Principal subbundles for dimension reduction (2307.03128v1)
Abstract: In this paper we demonstrate how sub-Riemannian geometry can be used for manifold learning and surface reconstruction by combining local linear approximations of a point cloud to obtain lower dimensional bundles. Local approximations obtained by local PCAs are collected into a rank $k$ tangent subbundle on $\mathbb{R}d$, $k<d$, which we call a principal subbundle. This determines a sub-Riemannian metric on $\mathbb{R}d$. We show that sub-Riemannian geodesics with respect to this metric can successfully be applied to a number of important problems, such as: explicit construction of an approximating submanifold $M$, construction of a representation of the point-cloud in $\mathbb{R}k$, and computation of distances between observations, taking the learned geometry into account. The reconstruction is guaranteed to equal the true submanifold in the limit case where tangent spaces are estimated exactly. Via simulations, we show that the framework is robust when applied to noisy data. Furthermore, the framework generalizes to observations on an a priori known Riemannian manifold.
- David G. Kendall “Shape manifolds, procrustean metrics, and complex projective spaces” In Bulletin of the London mathematical society 16.2 Wiley Online Library, 1984, pp. 81–121
- Ji-Guang Sun “Eigenvalues And Eigenvectors Of A Matrix Dependent On Several Parameters.” In Journal of Computational Mathematics 3.4, 1985, pp. 351
- Ji-guang Sun “Multiple eigenvalue sensitivity analysis” In Linear algebra and its applications 137 Elsevier, 1990, pp. 183–211
- “Numerical optimization” In Springer Science 35.67-68, 1999, pp. 7
- Wei-Liang Chow “Über Systeme von linearen partiellen Differential-gleichungen erster Ordnung” In The Collected Papers Of Wei-Liang Chow World Scientific, 2002, pp. 47–54
- “Automatic alignment of local representations” In Advances in neural information processing systems 15, 2002
- “Principal geodesic analysis for the study of nonlinear statistics of shape” In IEEE transactions on medical imaging 23.8 IEEE, 2004, pp. 995–1005
- “Principal manifolds and nonlinear dimensionality reduction via tangent space alignment” In SIAM journal on scientific computing 26.1 SIAM, 2004, pp. 313–338
- Lawrence Cayton “Algorithms for manifold learning” In Univ. of California at San Diego Tech. Rep 12.1-17, 2005, pp. 1
- “Geometric numerical integration” In Oberwolfach Reports 3.1, 2006, pp. 805–882
- Michael Kazhdan, Matthew Bolitho and Hugues Hoppe “Poisson surface reconstruction” In Proceedings of the fourth Eurographics symposium on Geometry processing 7, 2006
- Stephan Huckemann, Thomas Hotz and Axel Munk “Intrinsic shape analysis: Geodesic PCA for Riemannian manifolds modulo isometric Lie group actions” In Statistica Sinica JSTOR, 2010, pp. 1–58
- “Generalized PCA via the backward stepwise approach in image analysis” In Brain, Body and Machine Springer, 2010, pp. 111–123
- “Manifold valued statistics, exact principal geodesic analysis and the effect of linear approximations” In Computer Vision–ECCV 2010: 11th European Conference on Computer Vision, Heraklion, Crete, Greece, September 5-11, 2010, Proceedings, Part VI 11, 2010, pp. 43–56 Springer
- Laurent Younes “Shapes and diffeomorphisms” Springer, 2010
- Søren Hauberg, Oren Freifeld and Michael Black “A geometric take on metric learning” In Advances in Neural Information Processing Systems 25, 2012
- “Manifold learning theory and applications” CRC press Boca Raton, 2012
- “Vector diffusion maps and the connection Laplacian” In Communications on pure and applied mathematics 65.8 Wiley Online Library, 2012, pp. 1067–1144
- John M. Lee “Introduction to smooth manifolds” In Introduction to smooth manifolds Springer, 2013
- “Non-linear dimensionality reduction: Riemannian metric estimation and the problem of geometric discovery” In arXiv preprint arXiv:1305.7255, 2013
- Frédéric Jean “Control of nonholonomic systems: from sub-Riemannian geometry to motion planning” Springer, 2014
- Victor M. Panaretos, Tung Pham and Zhigang Yao “Principal flows” In Journal of the American Statistical Association 109.505 Taylor & Francis, 2014, pp. 424–436
- Ludovic Rifford “Sub-Riemannian geometry and optimal transport” Springer, 2014
- Aurélien Bellet, Amaury Habrard and Marc Sebban “Metric learning” In Synthesis lectures on artificial intelligence and machine learning 9.1 Morgan & Claypool Publishers, 2015, pp. 1–151
- Zhigang Yao, Benjamin Eltzner and Tung Pham “Principal Sub-manifolds” arXiv, 2016 DOI: 10.48550/ARXIV.1604.04318
- Roy Frostig, Matthew James Johnson and Chris Leary “Compiling machine learning programs via high-level tracing” In Systems for Machine Learning 4.9 SysML, 2018
- John M. Lee “Introduction to Riemannian manifolds” Springer, 2018
- Xavier Pennec “Barycentric subspace analysis on manifolds” In The Annals of Statistics 46.6A Institute of Mathematical Statistics, 2018, pp. 2711–2746
- Andrei Agrachev, Davide Barilari and Ugo Boscain “A comprehensive introduction to sub-Riemannian geometry” Cambridge University Press, 2019
- Xavier Pennec, Stefan Sommer and Tom Fletcher “Riemannian geometric statistics in medical image analysis” Academic Press, 2019
- “Implicit geometric regularization for learning shapes” In arXiv preprint arXiv:2002.10099, 2020
- “Geomstats: A Python Package for Riemannian Geometry in Machine Learning” In Journal of Machine Learning Research 21.223, 2020, pp. 1–9 URL: http://jmlr.org/papers/v21/19-027.html
- “A generic unfolding algorithm for manifolds estimated by local linear approximations” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020, pp. 854–855
- “Scikit-dimension: a python package for intrinsic dimension estimation” In Entropy 23.10 MDPI, 2021, pp. 1368
- “Recent advances in directional statistics” In Test 30.1 Springer, 2021, pp. 1–58
- “Surface Reconstruction from Point Clouds: A Survey and a Benchmark”, 2022 eprint: arXiv:2205.02413
- “Manifold Coordinates with Physical Meaning” In Journal of Machine Learning Research 23.133, 2022, pp. 1–57