Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Intrinsic Gaussian Vector Fields on Manifolds (2310.18824v2)

Published 28 Oct 2023 in stat.ML and cs.LG

Abstract: Various applications ranging from robotics to climate science require modeling signals on non-Euclidean domains, such as the sphere. Gaussian process models on manifolds have recently been proposed for such tasks, in particular when uncertainty quantification is needed. In the manifold setting, vector-valued signals can behave very differently from scalar-valued ones, with much of the progress so far focused on modeling the latter. The former, however, are crucial for many applications, such as modeling wind speeds or force fields of unknown dynamical systems. In this paper, we propose novel Gaussian process models for vector-valued signals on manifolds that are intrinsically defined and account for the geometry of the space in consideration. We provide computational primitives needed to deploy the resulting Hodge-Mat\'ern Gaussian vector fields on the two-dimensional sphere and the hypertori. Further, we highlight two generalization directions: discrete two-dimensional meshes and "ideal" manifolds like hyperspheres, Lie groups, and homogeneous spaces. Finally, we show that our Gaussian vector fields constitute considerably more refined inductive biases than the extrinsic fields proposed before.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (33)
  1. Mauricio A Alvarez, Lorenzo Rosasco and Neil D Lawrence “Kernels for vector-valued functions: A review” In Foundations and Trends® in Machine Learning 4.3 Now Publishers, Inc., 2012, pp. 195–266
  2. “Stationary Kernels and Gaussian Processes on Lie Groups and their Homogeneous Spaces I: the compact case” In arXiv preprint arXiv:2208.14960, 2022
  3. “Stationary Kernels and Gaussian Processes on Lie Groups and their Homogeneous Spaces II: non-compact symmetric spaces” In arXiv preprint arXiv:2301.13088, 2023
  4. “Heat kernels and Dirac operators” In Jahresbericht der Deutschen Mathematiker Vereinigung 97.3 Springer, 1995, pp. 63–65
  5. “Gaussian processes at the Helm (holtz): A more fluid model for ocean currents” In arXiv preprint arXiv:2302.10364, 2023
  6. “Matérn Gaussian processes on Riemannian manifolds” In Advances in Neural Information Processing Systems, 2020
  7. Robert Bryant “Vector-Valued Stone–Weierstrass Theorem?” https://mathoverflow.net/q/371618 (version: 2020-09-14), MathOverflow, 2020
  8. Y. Canzani “Analysis on manifolds via the Laplacian” In Lecture Notes available at: http://www.math.harvard.edu/canzani/docs/Laplacian.pdf, 2013
  9. “Geostatistics: Modeling Spatial Uncertainty”, Wiley Series in Probability and Statistics Wiley & Sons, 2012
  10. “Gaussian process manifold interpolation for probabilistic atrial activation maps and uncertain conduction velocity” In Philosophical Transactions of the Royal Society A 378.2173 The Royal Society Publishing, 2020
  11. Ernesto De Vito, Nicole Mücke and Lorenzo Rosasco “Reproducing kernel Hilbert spaces on manifolds: Sobolev and diffusion spaces” In Analysis and Applications 19.03 World Scientific, 2021, pp. 363–396
  12. “ERA5 monthly averaged data on pressure levels from 1940 to present. Copernicus Climate Change Service (C3S) Climate Data Store (CDS)” DOI: 10.24381/cds.6860a573 (Accessed on 10-Oct-2023), 2023
  13. James R. Holton “An Introduction to Dynamic Meteorology” 88, International Geophysics Elsevier Academic Press, 2004
  14. “Vector-valued Gaussian Processes on Riemannian Manifolds via Gauge Independent Projected Kernels” In Advances in Neural Information Processing Systems 34, 2021
  15. “Spectra and eigenforms of the Laplacian on Snsuperscript𝑆𝑛S^{n}italic_S start_POSTSUPERSCRIPT italic_n end_POSTSUPERSCRIPT and Pn⁢(ℂ)superscript𝑃𝑛ℂP^{n}(\mathbb{C})italic_P start_POSTSUPERSCRIPT italic_n end_POSTSUPERSCRIPT ( blackboard_C )” In Osaka Journal of Mathematics 15.3, 1978, pp. 515–546
  16. Andreas Krause, Ajit Singh and Carlos Guestrin “Near-optimal sensor placements in Gaussian processes: Theory, efficient algorithms and empirical studies.” In Journal of Machine Learning Research 9.2, 2008
  17. M. Lange-Hegermann “Algorithmic linearly constrained Gaussian processes” In Advances in Neural Information Processing Systems 31, 2018
  18. Jeffrey M Lee “Manifolds and Differential Geometry” 107, Graduate Studies in Mathematics American Mathematical Society, 2009
  19. Finn Lindgren, Håvard Rue and Johan Lindström “An explicit link between Gaussian fields and Gaussian Markov random fields: the stochastic partial differential equation approach” In Journal of the Royal Statistical Society Series B: Statistical Methodology 73.4, 2011, pp. 423–498
  20. “Bayesian optimization for demographic inference” In G3: Genes, Genomes, Genetics 13.7, 2023
  21. V K Patodi “Curvature and the eigenforms of the Laplace operator” In Journal of Differential Geometry 5.1-2 Lehigh University, 1971, pp. 233–249
  22. “Implicit Gaussian process representation of vector fields over arbitrary latent manifolds” In International Conference on Learning Representations, 2024
  23. João B Prolla “On the Weierstrass–Stone Theorem” In Journal of Approximation Theory 78.3 Elsevier, 1994, pp. 299–313
  24. Carl Edward Rasmussen and Christopher K I Williams “Gaussian Processes for Machine Learning” MIT Press, 2006
  25. “Posterior Contraction Rates for Matérn Gaussian Processes on Riemannian Manifolds” In arXiv preprint arXiv:2309.10918, 2023
  26. Steven Rosenberg “The Laplacian on a Riemannian manifold: an introduction to analysis on manifolds”, London Mathematical Society Student Texts 31 Cambridge University Press, 1997
  27. Nicholas Sharp, Yousuf Soliman and Keenan Crane “The vector heat method” In ACM Transactions on Graphics 38.3 ACM New York, NY, USA, 2019, pp. 1–19
  28. “Bayesian reaction optimization as a tool for chemical synthesis” In Nature 590.7844 Nature Publishing Group UK London, 2021, pp. 89–96
  29. Jasper Snoek, Hugo Larochelle and Ryan P Adams “Practical Bayesian Optimization of Machine Learning Algorithms” In Advances in Neural Information Processing Systems 25, 2012
  30. Michael L Stein “Interpolation of Spatial Data: Some Theory for Kriging” Springer, 1999
  31. Alexander Terenin “Gaussian processes and statistical decision-making in non-Euclidean spaces” In arXiv preprint arXiv:2202.10613, 2022
  32. Peter Whittle “Stochastic processes in several dimensions” In Bulletin of the International Statistical Institute 40.2, 1963, pp. 974–994
  33. Maosheng Yang, Viacheslav Borovitskiy and Elvin Isufi “Hodge-Compositional Edge Gaussian Processes” In International Conference on Artificial Intelligence and Statistics, 2024
Citations (5)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com