Preserving linear invariants in ensemble filtering methods (2404.14328v1)
Abstract: Formulating dynamical models for physical phenomena is essential for understanding the interplay between the different mechanisms and predicting the evolution of physical states. However, a dynamical model alone is often insufficient to address these fundamental tasks, as it suffers from model errors and uncertainties. One common remedy is to rely on data assimilation, where the state estimate is updated with observations of the true system. Ensemble filters sequentially assimilate observations by updating a set of samples over time. They operate in two steps: a forecast step that propagates each sample through the dynamical model and an analysis step that updates the samples with incoming observations. For accurate and robust predictions of dynamical systems, discrete solutions must preserve their critical invariants. While modern numerical solvers satisfy these invariants, existing invariant-preserving analysis steps are limited to Gaussian settings and are often not compatible with classical regularization techniques of ensemble filters, e.g., inflation and covariance tapering. The present work focuses on preserving linear invariants, such as mass, stoichiometric balance of chemical species, and electrical charges. Using tools from measure transport theory (Spantini et al., 2022, SIAM Review), we introduce a generic class of nonlinear ensemble filters that automatically preserve desired linear invariants in non-Gaussian filtering problems. By specializing this framework to the Gaussian setting, we recover a constrained formulation of the Kalman filter. Then, we show how to combine existing regularization techniques for the ensemble Kalman filter (Evensen, 1994, J. Geophys. Res.) with the preservation of the linear invariants. Finally, we assess the benefits of preserving linear invariants for the ensemble Kalman filter and nonlinear ensemble filters.
- Ensemble Kalman Methods with Constraints. Inverse Problems, 35(9):095007, 2019.
- Constrained State Estimation – A Review. arXiv preprint arXiv:1807.03463, 2018.
- Data assimilation: methods, algorithms, and applications, volume 11. SIAM, 2016.
- Conditional sampling with monotone GANs: from generative models to likelihood-free inference. arXiv preprint arXiv:2006.06755, 2020.
- Curse-of-Dimensionality Revisited: Collapse of the Particle Filter in Very Large Scale Systems. In Probability and Statistics: Essays in Honor of David A. Freedman, volume 2, pages 316–335. Institute of Mathematical Statistics, 2008.
- D. P. Bertsekas. Projected Newton methods for optimization problems with simple constraints. SIAM Journal on control and Optimization, 20(2):221–246, 1982.
- Data-Driven Science and Engineering: Machine Learning, Dynamical Systems, and Control. Cambridge University Press, 2019.
- Analysis Scheme in the Ensemble Kalman Filter. Monthly Weather Review, 126(6), 1998.
- Data assimilation in the geosciences: An overview of methods, issues, and perspectives. Wiley Interdisciplinary Reviews: Climate Change, 9(5):e535, 2018.
- Data assimilation for a quasi-geostrophic model with circulation-preserving stochastic transport noise. Journal of Statistical Physics, 179(5-6):1186–1221, 2020.
- Fundamentals of structural dynamics. John Wiley & Sons, 2006.
- G. F. T. del Castillo. An Introduction to Hamiltonian Mechanics. Springer, 2018.
- G. Evensen. Sequential Data Assimilation with a Nonlinear Quasi-Geostrophic Model Using Monte Carlo Methods to Forecast Error Statistics. Journal of Geophysical Research: Oceans, 99(C5):10143–10162, 1994.
- Data assimilation fundamentals. Springer Nature, 2022.
- M. Frigo and S. G. Johnson. FFTW: An Adaptive Software Architecture for the FFT. In Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP’98 (Cat. No. 98CH36181), volume 3, pages 1381–1384. IEEE, 1998.
- Interacting Langevin diffusions: Gradient structure and ensemble Kalman sampler. SIAM Journal on Applied Dynamical Systems, 19(1):412–441, 2020.
- Matrix computations. JHU press, 2013.
- N. Gupta and R. Hauser. Kalman Filtering with Equality and Inequality State Constraints. arXiv preprint arXiv:0709.2791, 2007.
- Geometric numerical integration. Oberwolfach Reports, 3(1):805–882, 2006.
- A sequential ensemble Kalman filter for atmospheric data assimilation. Monthly Weather Review, 129(1):123–137, 2001.
- On the stability of strong-stability-preserving modified Patankar Runge-Kutta schemes. arXiv preprint arXiv:2205.01488, 2022.
- Ensemble Kalman methods for inverse problems. Inverse Problems, 29(4):045001, 2013.
- T. Izgin and P. Öffner. A study of the local dynamics of modified Patankar DeC and higher order modified Patankar–RK methods. ESAIM: Mathematical Modelling and Numerical Analysis, 57(4):2319–2348, 2023.
- A stability analysis of modified Patankar–Runge–Kutta methods for a nonlinear production–destruction system. PAMM, 22(1):e202200083, 2023.
- Conservation of mass and preservation of positivity with ensemble-type Kalman filter algorithms. Monthly Weather Review, 142(2):755–773, 2014.
- Computational Fluid Dynamics in Practice. CRC Press, 2016.
- R. E. Kalman. A New Approach to Linear Filtering and Prediction Problems. Journal of Basic Engineering, 82(1):35–45, 03 1960.
- Data Assimilation: A Mathematical Introduction. Texts in Applied Mathematics, 62, 2015.
- A low-rank nonlinear ensemble filter for vortex models of aerodynamic flows. In AIAA Scitech 2021 Forum, page 1937, 2021.
- A low-rank ensemble Kalman filter for elliptic observations. Proceedings of the Royal Society A, 478(2266):20220182, 2022.
- An adaptive ensemble filter for heavy-tailed distributions: tuning-free inflation and localization. arXiv preprint arXiv:2310.08741, 2023.
- R. J. LeVeque. Numerical methods for conservation laws, volume 214. Springer, 1992.
- E. Lorenz. Deterministic Nonperiodic Flow. Journal of Atmospheric Sciences, 20(2), 1963.
- Sampling via measure transport: An introduction. Handbook of Uncertainty Quantification, 1:2, 2016.
- Positivity-preserving adaptive Runge–Kutta methods. Communications in Applied Mathematics and Computational Science, 16(2):155–179, 2021.
- Computational optimal transport: With applications to data science. Foundations and Trends® in Machine Learning, 11(5-6):355–607, 2019.
- Constrained nonlinear state estimation using ensemble Kalman filters. Industrial & Engineering Chemistry Research, 49(5):2242–2253, 2010.
- C. Rackauckas and Q. Nie. Differentialequations.jl – A performant and Feature-rich Ecosystem for Solving Differential Equations in Julia. Journal of open research software, 5(1):15–15, 2017.
- Ensemble transport smoothing. Part I: Unified framework. Journal of Computational Physics: X, 17:100134, 2023.
- M. Rosenblatt. Remarks on a multivariate transformation. The Annals of Mathematical Statistics, 23(3):470–472, 1952.
- Inverse Problems and Data Assimilation. London Mathematical Society Student Texts. Cambridge University Press, 2023.
- D. Simon. Kalman filtering with state constraints: a survey of linear and nonlinear algorithms. IET Control Theory & Applications, 4(8):1303–1318, 2010.
- Obstacles to High-Dimensional Particle Filtering. Monthly Weather Review, 136(12):4629–4640, 2008.
- Coupling techniques for nonlinear ensemble filtering. SIAM Review, 64(4):921–953, 2022.
- N. G. Trillos and D. Sanz-Alonso. The bayesian update: variational formulations and gradient flows. arXiv preprint arXiv:1705.07382, 2018.
- C. Villani et al. Optimal transport: Old and New, volume 338. Springer, 2009.
- Adding constraints to Bayesian inverse problems. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 33, pages 1666–1673, 2019.
- Regularized ensemble Kalman methods for inverse problems. Journal of Computational Physics, 416:109517, 2020.