Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
184 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Multi-index Importance Sampling for McKean-Vlasov Stochastic Differential Equation (2307.05149v1)

Published 11 Jul 2023 in math.NA, cs.NA, and stat.CO

Abstract: This work introduces a novel approach that combines the multi-index Monte Carlo (MC) method with importance sampling (IS) to estimate rare event quantities expressed as an expectation of a smooth observable of solutions to a broad class of McKean-Vlasov stochastic differential equations. We extend the double loop Monte Carlo (DLMC) estimator, previously introduced in our works (Ben Rached et al., 2022a,b), to the multi-index setting. We formulate a new multi-index DLMC estimator and conduct a comprehensive cost-error analysis, leading to improved complexity results. To address rare events, an importance sampling scheme is applied using stochastic optimal control of the single level DLMC estimator. This combination of IS and multi-index DLMC not only reduces computational complexity by two orders but also significantly decreases the associated constant compared to vanilla MC. The effectiveness of the proposed multi-index DLMC estimator is demonstrated using the Kuramoto model from statistical physics. The results confirm a reduced complexity from $\mathcal{O}(\mathrm{TOL}{\mathrm{r}}{-4})$ for the single level DLMC estimator (Ben Rached et al., 2022a) to $\mathcal{O}(\mathrm{TOL}{\mathrm{r}}{-2} (\log \mathrm{TOL}{\mathrm{r}}{-1})2)$ for the considered example, while ensuring accurate estimation of rare event quantities within the prescribed relative error tolerance $\mathrm{TOL}\mathrm{r}$.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (39)
  1. The Kuramoto model: A simple paradigm for synchronization phenomena. Reviews of modern physics, 77(1):137, 2005.
  2. Zero-variance importance sampling estimators for Markov process expectations. Mathematics of Operations Research, 38(2):358–388, 2013.
  3. Adaptive importance sampling for multilevel Monte Carlo Euler method. Stochastics, 95(2):303–327, 2023.
  4. Importance sampling for a robust and efficient multilevel Monte Carlo estimator for stochastic reaction networks. Statistics and Computing, 30:1665–1689, 2020.
  5. Double loop importance sampling for McKean-Vlasov stochastic differential equation. arXiv preprint arXiv:2207.06926, 2022a.
  6. Multilevel importance sampling for McKean-Vlasov stochastic differential equation. arXiv preprint arXiv:2208.03225, 2022b.
  7. Convergence rate for the approximation of the limit law of weakly interacting particles: application to the Burgers equation. The Annals of Applied Probability, 6(3):818–861, 1996.
  8. A stochastic particle method for the McKean-Vlasov and the Burgers equation. Mathematics of computation, 66(217):157–192, 1997.
  9. Mean-field stochastic differential equations and associated PDEs. 2017.
  10. Stochastic evolution equations in portfolio credit modelling. SIAM Journal on Financial Mathematics, 2(1):627–664, 2011.
  11. A continuation multilevel Monte Carlo algorithm. BIT Numerical Mathematics, 55:399–432, 2015.
  12. Smoothing properties of McKean–Vlasov SDEs. Probability Theory and Related Fields, 171:97–148, 2018.
  13. Cubature on Wiener space for McKean–Vlasov SDEs with smooth scalar interaction. The Annals of Applied Probability, 29(1):130–177, 2019.
  14. Approximate McKean–Vlasov representations for a class of SPDEs. Stochastics An International Journal of Probability and Stochastics Processes, 82(1):53–68, 2010.
  15. David Cumin and CP Unsworth. Generalising the Kuramoto model for the study of neuronal synchronisation in the brain. Physica D: Nonlinear Phenomena, 226(2):181–196, 2007.
  16. Particle-based multiscale modeling of calcium puff dynamics. Multiscale Modeling & Simulation, 14(3):997–1016, 2016.
  17. Simulation of McKean–Vlasov SDEs with super-linear growth. IMA Journal of Numerical Analysis, 42(1):874–922, 2022.
  18. Importance sampling for McKean-Vlasov SDEs. Applied Mathematics and Computation, 453:128078, 2023.
  19. From individual to collective behaviour of coupled velocity jump processes: a locust example. arXiv preprint arXiv:1104.2584, 2011.
  20. Multilevel Monte Carlo method for ergodic SDEs without contractivity. Journal of Mathematical Analysis and Applications, 476(1):149–176, 2019.
  21. Derek Michael Forrester. Arrays of coupled chemical oscillators. Scientific reports, 5(1):16994, 2015.
  22. Abdul Lateef Haji Ali. Pedestrian flow in the mean field limit. 2012.
  23. Multilevel and multi-index Monte Carlo methods for the McKean–Vlasov equation. Statistics and Computing, 28:923–935, 2018.
  24. Multi-index Monte Carlo: when sparsity meets sampling. Numerische Mathematik, 132:767–806, 2016a.
  25. Optimization of mesh hierarchies in multilevel Monte Carlo samplers. Stochastics and Partial Differential Equations Analysis and Computations, 4(1):76–112, 2016b.
  26. A simple approach to proving the existence, uniqueness, and strong and weak convergence rates for a broad class of McKean–Vlasov equations. 2021.
  27. Weak existence and uniqueness for McKean–Vlasov SDEs with common noise. 2021.
  28. Variational characterization of free energy: theory and algorithms. Entropy, 19(11):626, 2017.
  29. PD Hinds and MV Tretyakov. Neural variance reduction for stochastic differential equations. arXiv preprint arXiv:2209.12885, 2022.
  30. Coupling importance sampling and multilevel Monte Carlo using sample average approximation. Methodology and Computing in Applied Probability, 20:611–641, 2018.
  31. Handbook of Monte Carlo methods. John Wiley & Sons, 2013.
  32. Strong convergence of Euler–Maruyama schemes for McKean–Vlasov stochastic differential equations under local Lipschitz conditions of state variables. IMA Journal of Numerical Analysis, 43(2):1001–1035, 2023.
  33. Henry P McKean Jr. A class of Markov processes associated with nonlinear parabolic equations. Proceedings of the National Academy of Sciences, 56(6):1907–1911, 1966.
  34. S. Méléard. Asymptotic behaviour of some interacting particle systems; McKean-Vlasov and Boltzmann models. In D. Talay and L. Tubaro, editors, Probabilistic Models for Nonlinear Partial Differential Equations, volume 1627, pages 42–95. Springer, 1996.
  35. Stochastic numerics for mathematical physics, volume 39. Springer, 2004.
  36. Existence and uniqueness theorems for solutions of McKean–Vlasov stochastic equations. Theory of Probability and Mathematical Statistics, 103:59–101, 2020.
  37. Nigel J Newton. Variance reduction for simulated diffusions. SIAM journal on applied mathematics, 54(6):1780–1805, 1994.
  38. Alain-Sol Sznitman. Topics in propagation of chaos. Lecture notes in mathematics, pages 165–251, 1991.
  39. Iterative multilevel particle approximation for McKean–Vlasov SDEs. The Annals of Applied Probability, 29(4):2230–2265, 2019.
Citations (3)

Summary

We haven't generated a summary for this paper yet.