Perspectives on locally weighted ensemble Kalman methods
Abstract: This manuscript derives locally weighted ensemble Kalman methods from the point of view of ensemble-based function approximation. This is done by using pointwise evaluations to build up a local linear or quadratic approximation of a function, tapering off the effect of distant particles via local weighting. This introduces a candidate method (the locally weighted Ensemble Kalman method for inversion) with the motivation of combining some of the strengths of the particle filter (ability to cope with nonlinear maps and non-Gaussian distributions) and the Ensemble Kalman filter (no filter degeneracy). We provide some numerical evidence for the accuracy of locally weighted ensemble methods, both in terms of approximation and inversion.
- David Matthew Bortz and Carl Tim Kelley “The simplex gradient and noisy optimization problems” In Computational Methods for Optimal Design and Control: Proceedings of the AFOSR Workshop on Optimal Design and Control Arlington, Virginia 30 September–3 October, 1997, 1998, pp. 77–90 Springer
- “Well posedness and convergence analysis of the ensemble Kalman inversion” In Inverse Problems 35.8 IOP Publishing, 2019, pp. 085007
- Leon Bungert, Tim Roith and Philipp Wacker “Polarized consensus-based dynamics for optimization and sampling” In arXiv preprint arXiv:2211.05238, 2022
- AL Custódio, JE Dennis and Luıs Nunes Vicente “Using simplex gradients of nonsmooth functions in direct search methods” In IMA journal of numerical analysis 28.4 OUP, 2008, pp. 770–784
- Peter G Casazza, Gitta Kutyniok and Friedrich Philipp “Introduction to finite frame theory” In Finite frames: theory and applications Springer, 2013, pp. 1–53
- William S Cleveland “Robust locally weighted regression and smoothing scatterplots” In Journal of the American statistical association 74.368 Taylor & Francis, 1979, pp. 829–836
- Edoardo Calvello, Sebastian Reich and Andrew M Stuart “Ensemble Kalman methods: A mean field perspective” In arXiv preprint arXiv:2209.11371, 2022
- Neil K Chada, Andrew M Stuart and Xin T Tong “Tikhonov regularization within ensemble Kalman inversion” In SIAM Journal on Numerical Analysis 58.2 SIAM, 2020, pp. 1263–1294
- Andrew R Conn, Katya Scheinberg and Luis N Vicente “Introduction to derivative-free optimization” SIAM, 2009
- “Efficient calculation of regular simplex gradients” In Computational Optimization and Applications 72 Springer, 2019, pp. 561–588
- Oliver G Ernst, Björn Sprungk and Hans-Jörg Starkloff “Analysis of the ensemble and polynomial chaos Kalman filters in Bayesian inverse problems” In SIAM/ASA Journal on Uncertainty Quantification 3.1 SIAM, 2015, pp. 823–851
- Geir Evensen “The ensemble Kalman filter: Theoretical formulation and practical implementation” In Ocean dynamics 53 Springer, 2003, pp. 343–367
- Marco Frei and Hans R Künsch “Bridging the ensemble Kalman and particle filters” In Biometrika 100.4 Oxford University Press, 2013, pp. 781–800
- “Interacting Langevin diffusions: Gradient structure and ensemble Kalman sampler” In SIAM Journal on Applied Dynamical Systems 19.1 SIAM, 2020, pp. 412–441
- Alfredo Garbuno-Inigo, Nikolas Nüsken and Sebastian Reich “Affine invariant interacting Langevin dynamics for Bayesian inference” In SIAM Journal on Applied Dynamical Systems 19.3 SIAM, 2020, pp. 1633–1658
- Marco A Iglesias, Kody JH Law and Andrew M Stuart “Ensemble Kalman methods for inverse problems” In Inverse Problems 29.4 IOP Publishing, 2013, pp. 045001
- Rudolph Emil Kalman “A New Approach to Linear Filtering and Prediction Problems” In Transactions of the ASME–Journal of Basic Engineering 82.Series D, 1960, pp. 35–45
- Kaare Brandt Petersen and Michael Syskind Pedersen “The matrix cookbook” In Technical University of Denmark 7.15, 2008, pp. 510
- “Fokker–Planck particle systems for Bayesian inference: Computational approaches” In SIAM/ASA Journal on Uncertainty Quantification 9.2 SIAM, 2021, pp. 446–482
- Claudia Schillings and Andrew M Stuart “Analysis of the ensemble Kalman filter for inverse problems” In SIAM Journal on Numerical Analysis 55.3 SIAM, 2017, pp. 1264–1290
- Claudia Schillings, Björn Sprungk and Philipp Wacker “On the convergence of the Laplace approximation and noise-level-robustness of Laplace-based Monte Carlo methods for Bayesian inverse problems” In Numerische Mathematik 145 Springer, 2020, pp. 915–971
- “Bridging the ensemble Kalman filter and particle filters: the adaptive Gaussian mixture filter” In Computational Geosciences 15 Springer, 2011, pp. 293–305
- Claudia Schillings, Claudia Totzeck and Philipp Wacker “Ensemble-based gradient inference for particle methods in optimization and sampling” In SIAM/ASA Journal on Uncertainty Quantification 11.3 SIAM, 2023, pp. 757–787
- “Ensemble square root filters” In Monthly weather review 131.7 American Meteorological Society, 2003, pp. 1485–1490
- “Particle filters for high-dimensional geoscience applications: A review” In Quarterly Journal of the Royal Meteorological Society 145.723 Wiley Online Library, 2019, pp. 2335–2365
- Roderick Wong “Asymptotic approximations of integrals” SIAM, 2001
- Fabian Wagner, Iason Papaioannou and Elisabeth Ullmann “The ensemble Kalman filter for rare event estimation” In SIAM/ASA Journal on Uncertainty Quantification 10.1 SIAM, 2022, pp. 317–349
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.