Generalized convergence of the deep BSDE method: a step towards fully-coupled FBSDEs and applications in stochastic control (2403.18552v1)
Abstract: We are concerned with high-dimensional coupled FBSDE systems approximated by the deep BSDE method of Han et al. (2018). It was shown by Han and Long (2020) that the errors induced by the deep BSDE method admit a posteriori estimate depending on the loss function, whenever the backward equation only couples into the forward diffusion through the Y process. We generalize this result to fully-coupled drift coefficients, and give sufficient conditions for convergence under standard assumptions. The resulting conditions are directly verifiable for any equation. Consequently, unlike in earlier theory, our convergence analysis enables the treatment of FBSDEs stemming from stochastic optimal control problems. In particular, we provide a theoretical justification for the non-convergence of the deep BSDE method observed in recent literature, and present direct guidelines for when convergence can be guaranteed in practice. Our theoretical findings are supported by several numerical experiments in high-dimensional settings.
- Backward stochastic differential equations. Springer, 2017.
- Forward-Backward Stochastic Differential Equations and their Applications, volume 1702 of Lecture Notes in Mathematics. Springer Berlin Heidelberg, Berlin, Heidelberg, 2007.
- E. Pardoux and S. Peng. Backward stochastic differential equations and quasilinear parabolic partial differential equations. In Boris L. Rozovskii and Richard B. Sowers, editors, Stochastic Partial Differential Equations and Their Applications, pages 200–217, Berlin, Heidelberg, 1992. Springer Berlin Heidelberg.
- Fabio Antonelli. Backward-Forward Stochastic Differential Equations. The Annals of Applied Probability, 3(3):777–793, 1993. Publisher: Institute of Mathematical Statistics.
- Forward-backward stochastic differential equations and quasilinear parabolic pdes. Probability theory and related fields, 114:123–150, 1999.
- François Delarue. On the existence and uniqueness of solutions to FBSDEs in a non-degenerate case. Stochastic Processes and their Applications, 99(2):209–286, June 2002.
- F. Delarue and G. Guatteri. Weak existence and uniqueness for forward–backward SDEs. Stochastic Processes and their Applications, 116(12):1712–1742, December 2006.
- A regression-based Monte Carlo method to solve backward stochastic differential equations. The Annals of Applied Probability, 15(3):2172–2202, 2005. Publisher: The Institute of Mathematical Statistics.
- Discrete-time approximation and Monte-Carlo simulation of backward stochastic differential equations. Stochastic Processes and their Applications, 111(2):175–206, June 2004.
- A forward scheme for backward sdes. Stochastic processes and their applications, 117(12):1793–1812, 2007.
- Least-Squares Monte Carlo for Backward SDEs. In René A Carmona, Pierre Del Moral, Peng Hu, and Nadia Oudjane, editors, Numerical Methods in Finance, pages 257–289, Berlin, Heidelberg, 2012. Springer Berlin Heidelberg.
- A Fourier Cosine Method for an Efficient Computation of Solutions to BSDEs. SIAM Journal on Scientific Computing, 37(2):A859–A889, 2015.
- Solving forward-backward stochastic differential equations explicitly — a four step scheme. Probability Theory and Related Fields, 98(3):339–359, September 1994.
- Numerical Methods for Forward-Backward Stochastic Differential Equations. The Annals of Applied Probability, 6(3):940–968, 1996. Publisher: Institute of Mathematical Statistics.
- The Steepest Descent Method for Forward-Backward SDEs. Electronic Journal of Probability, 10(none):1468–1495, January 2005. Publisher: Institute of Mathematical Statistics and Bernoulli Society.
- A forward - Backward stochastic algorithm for quasi-linear PDES. The Annals of Applied Probability, 2006.
- Time discretization and Markovian iteration for coupled FBSDEs. The Annals of Applied Probability, 18(1):143–177, February 2008.
- Efficient numerical Fourier methods for coupled forward–backward SDEs. Journal of Computational and Applied Mathematics, 296:593–612, April 2016.
- Solving high-dimensional partial differential equations using deep learning. Proceedings of the National Academy of Sciences, 115(34):8505–8510, 2018.
- Deep Learning-Based Numerical Methods for High-Dimensional Parabolic Partial Differential Equations and Backward Stochastic Differential Equations. Communications in Mathematics and Statistics, 5(4):349–380, December 2017.
- Deep backward schemes for high-dimensional nonlinear PDEs. Mathematics of Computation, 89(324):1547–1579, 2020.
- Convergence of the Backward Deep BSDE Method with Applications to Optimal Stopping Problems. SIAM Journal on Financial Mathematics, 14(4):1290–1303, December 2023. Publisher: Society for Industrial and Applied Mathematics.
- The One Step Malliavin scheme: new discretization of BSDEs implemented with deep learning regressions. IMA Journal of Numerical Analysis, page drad092, February 2024.
- Convergence of the deep BSDE method for coupled FBSDEs. Probability, Uncertainty and Quantitative Risk, 5:1–33, 2020.
- Convergence of a robust deep FBSDE method for stochastic control. SIAM Journal on Scientific Computing, 45(1):A226–A255, 2023.
- Numerical methods for backward stochastic differential equations: A survey. Probability Surveys, 20:486–567, 2023.
- Convergence of the Deep BSDE method for FBSDEs with non-Lipschitz coefficients. Probability, Uncertainty and Quantitative Risk, 6(4):391–408, 2021. Publisher: Probability, Uncertainty and Quantitative Risk.
- Convergence of the deep BSDE method for stochastic control problems formulated through the stochastic maximum principle, January 2024. arXiv:2401.17472 [cs, math, q-fin].
- Huyên Pham. Continuous-time stochastic control and optimization with financial applications, volume 61. Springer Science & Business Media, 2009.
- Solving stochastic optimal control problem via stochastic maximum principle with deep learning method. Journal of Scientific Computing, 93(1):30, 2022.
- Kurt Hornik. Approximation capabilities of multilayer feedforward networks. Neural Networks, 4(2):251–257, January 1991.
- Stochastic controls: Hamiltonian systems and HJB equations, volume 43. Springer Science & Business Media, 1999.