Intrinsic Gaussian Vector Fields on Manifolds (2310.18824v2)
Abstract: Various applications ranging from robotics to climate science require modeling signals on non-Euclidean domains, such as the sphere. Gaussian process models on manifolds have recently been proposed for such tasks, in particular when uncertainty quantification is needed. In the manifold setting, vector-valued signals can behave very differently from scalar-valued ones, with much of the progress so far focused on modeling the latter. The former, however, are crucial for many applications, such as modeling wind speeds or force fields of unknown dynamical systems. In this paper, we propose novel Gaussian process models for vector-valued signals on manifolds that are intrinsically defined and account for the geometry of the space in consideration. We provide computational primitives needed to deploy the resulting Hodge-Mat\'ern Gaussian vector fields on the two-dimensional sphere and the hypertori. Further, we highlight two generalization directions: discrete two-dimensional meshes and "ideal" manifolds like hyperspheres, Lie groups, and homogeneous spaces. Finally, we show that our Gaussian vector fields constitute considerably more refined inductive biases than the extrinsic fields proposed before.
- Mauricio A Alvarez, Lorenzo Rosasco and Neil D Lawrence “Kernels for vector-valued functions: A review” In Foundations and Trends® in Machine Learning 4.3 Now Publishers, Inc., 2012, pp. 195–266
- “Stationary Kernels and Gaussian Processes on Lie Groups and their Homogeneous Spaces I: the compact case” In arXiv preprint arXiv:2208.14960, 2022
- “Stationary Kernels and Gaussian Processes on Lie Groups and their Homogeneous Spaces II: non-compact symmetric spaces” In arXiv preprint arXiv:2301.13088, 2023
- “Heat kernels and Dirac operators” In Jahresbericht der Deutschen Mathematiker Vereinigung 97.3 Springer, 1995, pp. 63–65
- “Gaussian processes at the Helm (holtz): A more fluid model for ocean currents” In arXiv preprint arXiv:2302.10364, 2023
- “Matérn Gaussian processes on Riemannian manifolds” In Advances in Neural Information Processing Systems, 2020
- Robert Bryant “Vector-Valued Stone–Weierstrass Theorem?” https://mathoverflow.net/q/371618 (version: 2020-09-14), MathOverflow, 2020
- Y. Canzani “Analysis on manifolds via the Laplacian” In Lecture Notes available at: http://www.math.harvard.edu/canzani/docs/Laplacian.pdf, 2013
- “Geostatistics: Modeling Spatial Uncertainty”, Wiley Series in Probability and Statistics Wiley & Sons, 2012
- “Gaussian process manifold interpolation for probabilistic atrial activation maps and uncertain conduction velocity” In Philosophical Transactions of the Royal Society A 378.2173 The Royal Society Publishing, 2020
- Ernesto De Vito, Nicole Mücke and Lorenzo Rosasco “Reproducing kernel Hilbert spaces on manifolds: Sobolev and diffusion spaces” In Analysis and Applications 19.03 World Scientific, 2021, pp. 363–396
- “ERA5 monthly averaged data on pressure levels from 1940 to present. Copernicus Climate Change Service (C3S) Climate Data Store (CDS)” DOI: 10.24381/cds.6860a573 (Accessed on 10-Oct-2023), 2023
- James R. Holton “An Introduction to Dynamic Meteorology” 88, International Geophysics Elsevier Academic Press, 2004
- “Vector-valued Gaussian Processes on Riemannian Manifolds via Gauge Independent Projected Kernels” In Advances in Neural Information Processing Systems 34, 2021
- “Spectra and eigenforms of the Laplacian on Snsuperscript𝑆𝑛S^{n}italic_S start_POSTSUPERSCRIPT italic_n end_POSTSUPERSCRIPT and Pn(ℂ)superscript𝑃𝑛ℂP^{n}(\mathbb{C})italic_P start_POSTSUPERSCRIPT italic_n end_POSTSUPERSCRIPT ( blackboard_C )” In Osaka Journal of Mathematics 15.3, 1978, pp. 515–546
- Andreas Krause, Ajit Singh and Carlos Guestrin “Near-optimal sensor placements in Gaussian processes: Theory, efficient algorithms and empirical studies.” In Journal of Machine Learning Research 9.2, 2008
- M. Lange-Hegermann “Algorithmic linearly constrained Gaussian processes” In Advances in Neural Information Processing Systems 31, 2018
- Jeffrey M Lee “Manifolds and Differential Geometry” 107, Graduate Studies in Mathematics American Mathematical Society, 2009
- Finn Lindgren, Håvard Rue and Johan Lindström “An explicit link between Gaussian fields and Gaussian Markov random fields: the stochastic partial differential equation approach” In Journal of the Royal Statistical Society Series B: Statistical Methodology 73.4, 2011, pp. 423–498
- “Bayesian optimization for demographic inference” In G3: Genes, Genomes, Genetics 13.7, 2023
- V K Patodi “Curvature and the eigenforms of the Laplace operator” In Journal of Differential Geometry 5.1-2 Lehigh University, 1971, pp. 233–249
- “Implicit Gaussian process representation of vector fields over arbitrary latent manifolds” In International Conference on Learning Representations, 2024
- João B Prolla “On the Weierstrass–Stone Theorem” In Journal of Approximation Theory 78.3 Elsevier, 1994, pp. 299–313
- Carl Edward Rasmussen and Christopher K I Williams “Gaussian Processes for Machine Learning” MIT Press, 2006
- “Posterior Contraction Rates for Matérn Gaussian Processes on Riemannian Manifolds” In arXiv preprint arXiv:2309.10918, 2023
- Steven Rosenberg “The Laplacian on a Riemannian manifold: an introduction to analysis on manifolds”, London Mathematical Society Student Texts 31 Cambridge University Press, 1997
- Nicholas Sharp, Yousuf Soliman and Keenan Crane “The vector heat method” In ACM Transactions on Graphics 38.3 ACM New York, NY, USA, 2019, pp. 1–19
- “Bayesian reaction optimization as a tool for chemical synthesis” In Nature 590.7844 Nature Publishing Group UK London, 2021, pp. 89–96
- Jasper Snoek, Hugo Larochelle and Ryan P Adams “Practical Bayesian Optimization of Machine Learning Algorithms” In Advances in Neural Information Processing Systems 25, 2012
- Michael L Stein “Interpolation of Spatial Data: Some Theory for Kriging” Springer, 1999
- Alexander Terenin “Gaussian processes and statistical decision-making in non-Euclidean spaces” In arXiv preprint arXiv:2202.10613, 2022
- Peter Whittle “Stochastic processes in several dimensions” In Bulletin of the International Statistical Institute 40.2, 1963, pp. 974–994
- Maosheng Yang, Viacheslav Borovitskiy and Elvin Isufi “Hodge-Compositional Edge Gaussian Processes” In International Conference on Artificial Intelligence and Statistics, 2024