Papers
Topics
Authors
Recent
Search
2000 character limit reached

Perspectives on locally weighted ensemble Kalman methods

Published 6 Jan 2024 in math.NA, cs.NA, math.PR, and stat.CO | (2402.00027v3)

Abstract: This manuscript derives locally weighted ensemble Kalman methods from the point of view of ensemble-based function approximation. This is done by using pointwise evaluations to build up a local linear or quadratic approximation of a function, tapering off the effect of distant particles via local weighting. This introduces a candidate method (the locally weighted Ensemble Kalman method for inversion) with the motivation of combining some of the strengths of the particle filter (ability to cope with nonlinear maps and non-Gaussian distributions) and the Ensemble Kalman filter (no filter degeneracy). We provide some numerical evidence for the accuracy of locally weighted ensemble methods, both in terms of approximation and inversion.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (27)
  1. David Matthew Bortz and Carl Tim Kelley “The simplex gradient and noisy optimization problems” In Computational Methods for Optimal Design and Control: Proceedings of the AFOSR Workshop on Optimal Design and Control Arlington, Virginia 30 September–3 October, 1997, 1998, pp. 77–90 Springer
  2. “Well posedness and convergence analysis of the ensemble Kalman inversion” In Inverse Problems 35.8 IOP Publishing, 2019, pp. 085007
  3. Leon Bungert, Tim Roith and Philipp Wacker “Polarized consensus-based dynamics for optimization and sampling” In arXiv preprint arXiv:2211.05238, 2022
  4. AL Custódio, JE Dennis and Luıs Nunes Vicente “Using simplex gradients of nonsmooth functions in direct search methods” In IMA journal of numerical analysis 28.4 OUP, 2008, pp. 770–784
  5. Peter G Casazza, Gitta Kutyniok and Friedrich Philipp “Introduction to finite frame theory” In Finite frames: theory and applications Springer, 2013, pp. 1–53
  6. William S Cleveland “Robust locally weighted regression and smoothing scatterplots” In Journal of the American statistical association 74.368 Taylor & Francis, 1979, pp. 829–836
  7. Edoardo Calvello, Sebastian Reich and Andrew M Stuart “Ensemble Kalman methods: A mean field perspective” In arXiv preprint arXiv:2209.11371, 2022
  8. Neil K Chada, Andrew M Stuart and Xin T Tong “Tikhonov regularization within ensemble Kalman inversion” In SIAM Journal on Numerical Analysis 58.2 SIAM, 2020, pp. 1263–1294
  9. Andrew R Conn, Katya Scheinberg and Luis N Vicente “Introduction to derivative-free optimization” SIAM, 2009
  10. “Efficient calculation of regular simplex gradients” In Computational Optimization and Applications 72 Springer, 2019, pp. 561–588
  11. Oliver G Ernst, Björn Sprungk and Hans-Jörg Starkloff “Analysis of the ensemble and polynomial chaos Kalman filters in Bayesian inverse problems” In SIAM/ASA Journal on Uncertainty Quantification 3.1 SIAM, 2015, pp. 823–851
  12. Geir Evensen “The ensemble Kalman filter: Theoretical formulation and practical implementation” In Ocean dynamics 53 Springer, 2003, pp. 343–367
  13. Marco Frei and Hans R Künsch “Bridging the ensemble Kalman and particle filters” In Biometrika 100.4 Oxford University Press, 2013, pp. 781–800
  14. “Interacting Langevin diffusions: Gradient structure and ensemble Kalman sampler” In SIAM Journal on Applied Dynamical Systems 19.1 SIAM, 2020, pp. 412–441
  15. Alfredo Garbuno-Inigo, Nikolas Nüsken and Sebastian Reich “Affine invariant interacting Langevin dynamics for Bayesian inference” In SIAM Journal on Applied Dynamical Systems 19.3 SIAM, 2020, pp. 1633–1658
  16. Marco A Iglesias, Kody JH Law and Andrew M Stuart “Ensemble Kalman methods for inverse problems” In Inverse Problems 29.4 IOP Publishing, 2013, pp. 045001
  17. Rudolph Emil Kalman “A New Approach to Linear Filtering and Prediction Problems” In Transactions of the ASME–Journal of Basic Engineering 82.Series D, 1960, pp. 35–45
  18. Kaare Brandt Petersen and Michael Syskind Pedersen “The matrix cookbook” In Technical University of Denmark 7.15, 2008, pp. 510
  19. “Fokker–Planck particle systems for Bayesian inference: Computational approaches” In SIAM/ASA Journal on Uncertainty Quantification 9.2 SIAM, 2021, pp. 446–482
  20. Claudia Schillings and Andrew M Stuart “Analysis of the ensemble Kalman filter for inverse problems” In SIAM Journal on Numerical Analysis 55.3 SIAM, 2017, pp. 1264–1290
  21. Claudia Schillings, Björn Sprungk and Philipp Wacker “On the convergence of the Laplace approximation and noise-level-robustness of Laplace-based Monte Carlo methods for Bayesian inverse problems” In Numerische Mathematik 145 Springer, 2020, pp. 915–971
  22. “Bridging the ensemble Kalman filter and particle filters: the adaptive Gaussian mixture filter” In Computational Geosciences 15 Springer, 2011, pp. 293–305
  23. Claudia Schillings, Claudia Totzeck and Philipp Wacker “Ensemble-based gradient inference for particle methods in optimization and sampling” In SIAM/ASA Journal on Uncertainty Quantification 11.3 SIAM, 2023, pp. 757–787
  24. “Ensemble square root filters” In Monthly weather review 131.7 American Meteorological Society, 2003, pp. 1485–1490
  25. “Particle filters for high-dimensional geoscience applications: A review” In Quarterly Journal of the Royal Meteorological Society 145.723 Wiley Online Library, 2019, pp. 2335–2365
  26. Roderick Wong “Asymptotic approximations of integrals” SIAM, 2001
  27. Fabian Wagner, Iason Papaioannou and Elisabeth Ullmann “The ensemble Kalman filter for rare event estimation” In SIAM/ASA Journal on Uncertainty Quantification 10.1 SIAM, 2022, pp. 317–349

Summary

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Authors (1)

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 4 tweets with 1 like about this paper.