Differentiable Particle Filtering using Optimal Placement Resampling (2402.16639v1)
Abstract: Particle filters are a frequent choice for inference tasks in nonlinear and non-Gaussian state-space models. They can either be used for state inference by approximating the filtering distribution or for parameter inference by approximating the marginal data (observation) likelihood. A good proposal distribution and a good resampling scheme are crucial to obtain low variance estimates. However, traditional methods like multinomial resampling introduce nondifferentiability in PF-based loss functions for parameter estimation, prohibiting gradient-based learning tasks. This work proposes a differentiable resampling scheme by deterministic sampling from an empirical cumulative distribution function. We evaluate our method on parameter inference tasks and proposal learning.
- N. Metropolis, A. W. Rosenbluth, M. N. Rosenbluth, A. H. Teller, and E. Teller, “Equation of State Calculations by Fast Computing Machines,” The Journal of Chemical Physics, vol. 21, no. 6, pp. 1087–1092, Jun. 1953.
- N. Gordon, D. Salmond, and A. Smith, “Novel approach to nonlinear/non-Gaussian Bayesian state estimation,” IEE Proceedings F Radar and Signal Processing, vol. 140, no. 2, p. 107, 1993.
- F. Daum and J. Huang, “Curse of dimensionality and particle filters,” in 2003 IEEE Aerospace Conference Proceedings (Cat. No.03TH8652), vol. 4, Mar. 2003, pp. 4_1979–4_1993, iSSN: 1095-323X.
- M. Arulampalam, S. Maskell, N. Gordon, and T. Clapp, “A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking,” IEEE Transactions on Signal Processing, vol. 50, no. 2, pp. 174–188, Feb. 2002.
- T. Li, M. Bolic, and P. M. Djuric, “Resampling Methods for Particle Filtering: Classification, implementation, and strategies,” IEEE Signal Processing Magazine, vol. 32, no. 3, pp. 70–86, May 2015.
- C. Naesseth, S. Linderman, R. Ranganath, and D. Blei, “Variational Sequential Monte Carlo,” in Proceedings of the Twenty-First International Conference on Artificial Intelligence and Statistics. PMLR, Mar. 2018, pp. 968–977, iSSN: 2640-3498.
- C. J. Maddison, J. Lawson, G. Tucker, N. Heess, M. Norouzi, A. Mnih, A. Doucet, and Y. Teh, “Filtering Variational Objectives,” in Advances in Neural Information Processing Systems, vol. 30. Curran Associates, Inc., 2017.
- D. P. Kingma and M. Welling, “Auto-Encoding Variational Bayes,” CoRR, Dec. 2013.
- T. Le, M. Igl, T. Rainforth, T. Jin, and F. Wood, “Auto-encoding sequential Monte Carlo,” International Conference on Learning Representations (ICLR), 2018.
- Y. Burda, R. Grosse, and R. Salakhutdinov, “Importance Weighted Autoencoders,” International Conference on Learning Representations, 2015.
- P. Karkus, D. Hsu, and W. S. Lee, “Particle Filter Networks with Application to Visual Localization,” in Proceedings of The 2nd Conference on Robot Learning. PMLR, Oct. 2018, pp. 169–178, iSSN: 2640-3498.
- R. Jonschkowski, D. Rastogi, and O. Brock, “Differentiable Particle Filters: End-to-End Learning with Algorithmic Priors,” in Robotics: Science and Systems XIV. Robotics: Science and Systems Foundation, Jun. 2018.
- A. Ścibior and F. Wood, “Differentiable Particle Filtering without Modifying the Forward Pass,” Oct. 2021, arXiv:2106.10314 [cs, stat].
- A. Younis and E. Sudderth, “Differentiable and Stable Long-Range Tracking of Multiple Posterior Modes,” Advances in Neural Information Processing Systems, vol. 36, Dec. 2023.
- A. Singh, O. Makhlouf, M. Igl, J. Messias, A. Doucet, and S. Whiteson, “Particle-Based Score Estimation for State Space Model Learning in Autonomous Driving,” in Proceedings of The 6th Conference on Robot Learning. PMLR, Mar. 2023, pp. 1168–1177, iSSN: 2640-3498.
- M. Zhu, K. Murphy, and R. Jonschkowski, “Towards Differentiable Resampling,” Apr. 2020, arXiv:2004.11938 [cs, stat].
- C. Rosato, L. Devlin, V. Beraud, P. Horridge, T. B. Schön, and S. Maskell, “Efficient Learning of the Parameters of Non-Linear Models Using Differentiable Resampling in Particle Filters,” IEEE Transactions on Signal Processing, vol. 70, pp. 3676–3692, 2022.
- A. Corenflos, J. Thornton, G. Deligiannidis, and A. Doucet, “Differentiable Particle Filtering via Entropy-Regularized Optimal Transport,” in Proceedings of the 38th International Conference on Machine Learning. PMLR, Jul. 2021, pp. 2100–2111, iSSN: 2640-3498.
- X. Chen and Y. Li, “An overview of differentiable particle filters for data-adaptive sequential Bayesian inference,” Foundations of Data Science, Dec. 2023.
- A. Kloss, G. Martius, and J. Bohg, “How to train your differentiable filter,” Autonomous Robots, vol. 45, no. 4, pp. 561–578, May 2021.
- S. Malik and M. K. Pitt, “Particle filters for continuous likelihood evaluation and maximisation,” Journal of Econometrics, vol. 165, no. 2, pp. 190–209, Dec. 2011.
- O. C. Schrempf, D. Brunn, and U. D. Hanebeck, “Density Approximation Based on Dirac Mixtures with Regard to Nonlinear Estimation and Filtering,” in Proceedings of the 45th IEEE Conference on Decision and Control. San Diego, CA, USA: IEEE, 2006, pp. 1709–1714.
- D. P. Kingma and J. Ba, “Adam: A Method for Stochastic Optimization,” Jan. 2017, arXiv:1412.6980 [cs].
- J. Hull and A. White, “The Pricing of Options on Assets with Stochastic Volatilities,” The Journal of Finance, vol. 42, no. 2, pp. 281–300, 1987.
- U. D. Hanebeck and V. Klumpp, “Localized Cumulative Distributions and a multivariate generalization of the Cramér-von Mises distance,” in 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, Aug. 2008, pp. 33–39.