2000 character limit reached
Variational Gaussian filtering via Wasserstein gradient flows (2303.06398v2)
Published 11 Mar 2023 in stat.CO, cs.CE, cs.SY, eess.SY, and stat.ML
Abstract: We present a novel approach to approximate Gaussian and mixture-of-Gaussians filtering. Our method relies on a variational approximation via a gradient-flow representation. The gradient flow is derived from a Kullback--Leibler discrepancy minimization on the space of probability distributions equipped with the Wasserstein metric. We outline the general method and show its competitiveness in posterior representation and parameter estimation on two state-space models for which Gaussian approximations typically fail: systems with multiplicative noise and multi-modal state distributions.
- R. E. Kalman, “A new approach to linear filtering and prediction problems,” Journal of Basic Engineering, 1960.
- S. L. Heston, “A closed-form solution for options with stochastic volatility with applications to bond and currency options,” The Review of Financial Studies, 1993.
- A. F. Garcìa-Fernàndez, L. Svensson, M. R. Morelande, and S. Särkkä, “Posterior linearization filter: Principles and implementation using sigma points,” IEEE Transactions on Signal Processing, 2015.
- F. Tronarp, Á. F. García-Fernández, and S. Särkkä, “Iterative filtering and smoothing in nonlinear and non-Gaussian systems using conditional moments,” IEEE Signal Processing Letters, 2018.
- M. Lambert, S. Chewi, F. Bach, S. Bonnabel, and P. Rigollet, “Variational inference via Wasserstein gradient flows,” arXiv preprint arXiv:2205.15902, 2022.
- J. M. Joyce, “Kullback–Leibler divergence,” in International Encyclopedia of Statistical Science. Springer, 2011.
- F. Santambrogio, “Euclidean, metric, and Wasserstein gradient flows: An overview,” Bulletin of Mathematical Sciences, 2017.
- S. Särkkä, “On unscented Kalman filtering for state estimation of continuous-time nonlinear systems,” IEEE Transactions on Automatic Control, 2007.
- B. Christianson, “Reverse accumulation and attractive fixed points,” Optimization Methods & Software, 1994.
- N. J. Gordon, D. J. Salmond, and A. F. Smith, “Novel approach to nonlinear/non-Gaussian Bayesian state estimation,” in IEEE Proceedings of Radar and Signal Processing, 1993.
- S. Malik and M. K. Pitt, “Particle filters for continuous likelihood evaluation and maximisation,” Journal of Econometrics, 2011.
- R. Jordan, D. Kinderlehrer, and F. Otto, “The variational formulation of the Fokker–Planck equation,” SIAM Journal on Mathematical Analysis, 1998.