Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
158 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Multilevel Importance Sampling for Rare Events Associated With the McKean--Vlasov Equation (2208.03225v4)

Published 5 Aug 2022 in math.NA, cs.NA, and stat.CO

Abstract: This work combines multilevel Monte Carlo (MLMC) with importance sampling to estimate rare-event quantities that can be expressed as the expectation of a Lipschitz observable of the solution to a broad class of McKean--Vlasov stochastic differential equations. We extend the double loop Monte Carlo (DLMC) estimator introduced in this context in (Ben Rached et al., 2023) to the multilevel setting. We formulate a novel multilevel DLMC estimator and perform a comprehensive cost-error analysis yielding new and improved complexity results. Crucially, we devise an antithetic sampler to estimate level differences guaranteeing reduced computational complexity for the multilevel DLMC estimator compared with the single-level DLMC estimator. To address rare events, we apply the importance sampling scheme, obtained via stochastic optimal control in (Ben Rached et al., 2023), over all levels of the multilevel DLMC estimator. Combining importance sampling and multilevel DLMC reduces computational complexity by one order and drastically reduces the associated constant compared to the single-level DLMC estimator without importance sampling. We illustrate the effectiveness of the proposed multilevel DLMC estimator on the Kuramoto model from statistical physics with Lipschitz observables, confirming the reduced complexity from $\mathcal{O}(\mathrm{TOL}{\mathrm{r}}{-4})$ for the single-level DLMC estimator to $\mathcal{O}(\mathrm{TOL}{\mathrm{r}}{-3})$ while providing a feasible estimate of rare-event quantities up to prescribed relative error tolerance $\mathrm{TOL}_{\mathrm{r}}$.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (53)
  1. The Kuramoto model: A simple paradigm for synchronization phenomena. Reviews of modern physics, 77(1):137, 2005.
  2. Probability and measure theory. Academic press, 2000.
  3. Zero-variance importance sampling estimators for Markov process expectations. Mathematics of Operations Research, 38(2):358–388, 2013.
  4. Adaptive importance sampling for multilevel Monte Carlo Euler method. Stochastics, 95(2):303–327, 2023.
  5. State-dependent importance sampling for estimating expectations of functionals of sums of independent random variables. Statistics and Computing, 33(2):40, 2023.
  6. Importance sampling for a robust and efficient multilevel Monte Carlo estimator for stochastic reaction networks. Statistics and Computing, 30:1665–1689, 2020.
  7. Learning-based importance sampling via stochastic optimal control for stochastic reaction networks. Statistics and Computing, 33(3):58, 2023.
  8. Double-loop importance sampling for McKean–Vlasov stochastic differential equation, 2023.
  9. Convergence rate for the approximation of the limit law of weakly interacting particles: application to the Burgers equation. The Annals of Applied Probability, 6(3):818–861, 1996.
  10. A stochastic particle method for the McKean-Vlasov and the Burgers equation. Mathematics of computation, 66(217):157–192, 1997.
  11. Mean-field stochastic differential equations and associated PDEs. 2017.
  12. Multilevel simulation of functionals of Bernoulli random variables with application to basket credit derivatives. Methodology and Computing in Applied Probability, 17:579–604, 2015.
  13. Stochastic evolution equations in portfolio credit modelling. SIAM Journal on Financial Mathematics, 2(1):627–664, 2011.
  14. A continuation multilevel Monte Carlo algorithm. BIT Numerical Mathematics, 55:399–432, 2015.
  15. Smoothing properties of McKean–Vlasov SDEs. Probability Theory and Related Fields, 171:97–148, 2018.
  16. Cubature on Wiener space for McKean–Vlasov SDEs with smooth scalar interaction. The Annals of Applied Probability, 29(1):130–177, 2019.
  17. Approximate McKean–Vlasov representations for a class of SPDEs. Stochastics An International Journal of Probability and Stochastics Processes, 82(1):53–68, 2010.
  18. David Cumin and CP Unsworth. Generalising the Kuramoto model for the study of neuronal synchronisation in the brain. Physica D: Nonlinear Phenomena, 226(2):181–196, 2007.
  19. Particle-based multiscale modeling of calcium puff dynamics. Multiscale Modeling & Simulation, 14(3):997–1016, 2016.
  20. Simulation of McKean–Vlasov SDEs with super-linear growth. IMA Journal of Numerical Analysis, 42(1):874–922, 2022.
  21. Importance sampling for McKean-Vlasov SDEs. Applied Mathematics and Computation, 453:128078, 2023.
  22. Importance sampling, large deviations, and differential games. Stochastics: An International Journal of Probability and Stochastic Processes, 76(6):481–508, 2004.
  23. From individual to collective behaviour of coupled velocity jump processes: a locust example. arXiv preprint arXiv:1104.2584, 2011.
  24. Multilevel Monte Carlo method for ergodic SDEs without contractivity. Journal of Mathematical Analysis and Applications, 476(1):149–176, 2019.
  25. Derek Michael Forrester. Arrays of coupled chemical oscillators. Scientific reports, 5(1):16994, 2015.
  26. Michael B Giles. Multilevel Monte Carlo path simulation. Operations research, 56(3):607–617, 2008.
  27. Michael B Giles. Multilevel Monte Carlo methods. Acta numerica, 24:259–328, 2015.
  28. Antithetic multilevel Monte Carlo estimation for multi-dimensional SDEs without Lévy area simulation. 2014.
  29. Abdul Lateef Haji Ali. Pedestrian flow in the mean field limit. 2012.
  30. Multilevel and multi-index Monte Carlo methods for the McKean–Vlasov equation. Statistics and Computing, 28:923–935, 2018.
  31. Multi-index Monte Carlo: when sparsity meets sampling. Numerische Mathematik, 132:767–806, 2016a.
  32. Optimization of mesh hierarchies in multilevel Monte Carlo samplers. Stochastics and Partial Differential Equations Analysis and Computations, 4(1):76–112, 2016b.
  33. Weak existence and uniqueness for McKean–Vlasov SDEs with common noise. 2021.
  34. Projection-based algorithms for optimal control and importance sampling of diffusions. 2015.
  35. Model reduction algorithms for optimal control and importance sampling of diffusions. Nonlinearity, 29(8):2298, 2016.
  36. Variational characterization of free energy: theory and algorithms. Entropy, 19(11):626, 2017.
  37. Importance sampling in path space for diffusion processes with slow-fast variables. Probability Theory and Related Fields, 170:177–228, 2018.
  38. Coupling importance sampling and multilevel Monte Carlo using sample average approximation. Methodology and Computing in Applied Probability, 20:611–641, 2018.
  39. Numerical Solution of Stochastic Differential Equations. Springer, Berlin, 1992. doi: https://doi.org/10.1007/978-3-662-12616-5.
  40. On mean field games with common noise and mckean-vlasov spdes. Stochastic Analysis and Applications, 37(4):522–549, 2019.
  41. Handbook of Monte Carlo methods. John Wiley & Sons, 2013.
  42. Multilevel Richardson–Romberg extrapolation. 2017.
  43. Strong convergence of Euler–Maruyama schemes for McKean–Vlasov stochastic differential equations under local Lipschitz conditions of state variables. IMA Journal of Numerical Analysis, 43(2):1001–1035, 2023.
  44. Henry P McKean Jr. A class of Markov processes associated with nonlinear parabolic equations. Proceedings of the National Academy of Sciences, 56(6):1907–1911, 1966.
  45. S. Méléard. Asymptotic behaviour of some interacting particle systems; McKean-Vlasov and Boltzmann models. In D. Talay and L. Tubaro, editors, Probabilistic Models for Nonlinear Partial Differential Equations, volume 1627, pages 42–95. Springer, 1996.
  46. Existence and uniqueness theorems for solutions of McKean–Vlasov stochastic equations. Theory of Probability and Mathematical Statistics, 103:59–101, 2020.
  47. Shigeyoshi Ogawa. Monte carlo simulation of nonlinear diffusion processes. Japan journal of industrial and applied mathematics, 9:25–33, 1992.
  48. Bernt Oksendal. Stochastic differential equations: an introduction with applications. Springer Science & Business Media, 2013.
  49. Journal of Computational Physics, 274:140–157, 2014.
  50. Alain-Sol Sznitman. Topics in propagation of chaos. Lecture notes in mathematics, pages 165–251, 1991.
  51. Antithetic multilevel particle system sampling method for McKean-Vlasov SDEs. arXiv preprint arXiv:1903.07063, 2019.
  52. Iterative multilevel particle approximation for McKean–Vlasov SDEs. The Annals of Applied Probability, 29(4):2230–2265, 2019.
  53. Applications of the cross-entropy method to importance sampling and optimal control of diffusions. SIAM Journal on Scientific Computing, 36(6):A2654–A2672, 2014.
Citations (3)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com