Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
167 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A Structurally Informed Data Assimilation Approach for Nonlinear Partial Differential Equations (2309.02585v2)

Published 5 Sep 2023 in math.NA and cs.NA

Abstract: Ensemble transform Kalman filtering (ETKF) data assimilation is often used to combine available observations with numerical simulations to obtain statistically accurate and reliable state representations in dynamical systems. However, it is well known that the commonly used Gaussian distribution assumption introduces biases for state variables that admit discontinuous profiles, which are prevalent in nonlinear partial differential equations. This investigation designs a new structurally informed non-Gaussian prior that exploits statistical information from the simulated state variables. In particular, we construct a new weighting matrix based on the second moment of the gradient information of the state variable to replace the prior covariance matrix used for model/data compromise in the ETKF data assimilation framework. We further adapt our weighting matrix to include information in discontinuity regions via a clustering technique. Our numerical experiments demonstrate that this new approach yields more accurate estimates than those obtained using ETKF on shallow water equations, even when ETKF is enhanced with inflation and localization techniques.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (38)
  1. Joint sparse recovery based on variances. SIAM Journal on Scientific Computing, 41(1):A246–A268, 2019.
  2. J. L. Anderson. An ensemble adjustment Kalman filter for data assimilation. Monthly Weather Review, 129(12):2884 – 2903, 2001.
  3. J. L. Anderson. An adaptive covariance inflation error correction algorithm for ensemble filters. Tellus A: Dynamic Meteorology and Oceanography, 59(2):210–224, 2007.
  4. Polynomial fitting for edge detection in irregularly sampled signals and images. SIAM Journal on Numerical Analysis, 43(1):259–279, 2005.
  5. Discontinuity detection in multivariate space for stochastic simulations. Journal of Computational Physics, 228(7):2676–2689, 2009.
  6. Data fusion and data assimilation of ice thickness observations using a regularisation framework. Tellus A: Dynamic Meteorology and Oceanography, 71(1):1564487, 2019.
  7. Data Assimilation. Society for Industrial and Applied Mathematics, Philadelphia, PA, 2016.
  8. Adaptive sampling with the ensemble transform Kalman filter. part I: Theoretical aspects. Monthly Weather Review, 129(3):420 – 436, 2001.
  9. E. Candes and T. Tao. Decoding by linear programming. IEEE Transactions on Information Theory, 51(12):4203–4215, 2005.
  10. S. E. Cohn. An introduction to estimation theory (gtSpecial Issuelt Data Assimilation in Meteology and Oceanography: Theory and Practice). Journal of the Meteorological Society of Japan. Ser. II, 75(1B):257–288, 1997.
  11. A. M. Ebtehaj and E. Foufoula-Georgiou. On variational downscaling, fusion, and assimilation of hydrometeorological states: A unified framework via regularization. Water Resources Research, 49(9):5944–5963, 2013.
  12. G. Evensen. Sequential data assimilation with a nonlinear quasi-geostrophic model using monte carlo methods to forecast error statistics. Journal of Geophysical Research: Oceans, 99(C5):10143–10162, 1994.
  13. G. Evensen. Data Assimilation: The Ensemble Kalman Filter. Springer-Verlag, Berlin, Heidelberg, 2006.
  14. Downscaling Satellite Precipitation with Emphasis on Extremes: A Variational ℓℓ\ellroman_ℓ11{}_{1}start_FLOATSUBSCRIPT 1 end_FLOATSUBSCRIPT-Norm Regularization in the Derivative Domain. Surveys in Geophysics, 35(3):765–783, May 2014.
  15. L1-regularisation for ill-posed problems in variational data assimilation. PAMM, 10(1):665–668, 2010.
  16. Resolution of sharp fronts in the presence of model error in variational data assimilation. Quarterly Journal of the Royal Meteorological Society, 139(672):742–757, 2013.
  17. R. Furrer and T. Bengtsson. Estimation of high-dimensional prior and posterior covariance matrices in Kalman filter variants. Journal of Multivariate Analysis, 98(2):227–255, 2007.
  18. G. Gaspari and S. E. Cohn. Construction of correlation functions in two and three dimensions. Quarterly Journal of the Royal Meteorological Society, 125(554):723–757, 1999.
  19. A. Gelb and T. Scarnati. Reducing effects of bad data using variance based joint sparsity recovery. J. Sci. Comput., 78(1):94–120, 2019.
  20. Novel approach to nonlinear/non-Gaussian bayesian state estimation. IEE Proceedings F (Radar and Signal Processing), 140:107–113(6), April 1993.
  21. W. W. Hager. Updating the inverse of a matrix. SIAM Review, 31(2):221–239, 1989.
  22. Very large inverse problems in atmosphere and ocean modelling. International Journal for Numerical Methods in Fluids, 47(8-9):759–771, 2005.
  23. A new method for the nonlinear transformation of means and covariances in filters and estimators. IEEE Transactions on Automatic Control, 45(3):477–482, 2000.
  24. R. E. Kalman. A New Approach to Linear Filtering and Prediction Problems. Journal of Basic Engineering, 82(1):35–45, 03 1960.
  25. E. Kalnay. Atmospheric Modeling, Data Assimilation and Predictability. Cambridge University Press, 2002.
  26. Data assimilation: A mathematical introduction, volume 62 of Texts in Applied Mathematics. Springer, Cham, 2015. A mathematical introduction.
  27. Evaluating data assimilation algorithms. Monthly Weather Review, 140(11):3757 – 3782, 2012.
  28. Physically-based data assimilation. Geoscientific Model Development, 3(2):669–677, 2010.
  29. Weighted essentially non-oscillatory schemes. Journal of Computational Physics, 115(1):200–212, 1994.
  30. On the convergence of the ensemble Kalman filter. Applications of Mathematics, 56(6):533–541, 2011.
  31. A. W. Max. Inverting modified matrices. In Memorandum Rept. 42, Statistical Research Group, page 4. Princeton Univ., 1950.
  32. A high order method for determining the edges in the gradient of a function. Communications in Computational Physics, 5:694–711, 2009.
  33. C.-W. Shu. Essentially non-oscillatory and weighted essentially non-oscillatory schemes. Acta Numerica, 29:701–762, 2020.
  34. Obstacles to high-dimensional particle filtering. Monthly Weather Review, 136(12):4629 – 4640, 2008.
  35. S. Srang and M. Yamakita. On the estimation of systems with discontinuities using continuous-discrete unscented Kalman filter. In 2014 American Control Conference, pages 457–463, 2014.
  36. J. Stoker. Water Waves: The Mathematical Theory With Applications. John Wiley & Sons, Ltd, 1992.
  37. Ensemble square root filters. Monthly Weather Review, 131(7):1485 – 1490, 2003.
  38. Empirical bayesian inference using a support informed prior. SIAM/ASA Journal on Uncertainty Quantification, 10(2):745–774, 2022.
Citations (1)

Summary

We haven't generated a summary for this paper yet.