2000 character limit reached
Asymptotic Nash Equilibria of Finite-State Ergodic Markovian Mean Field Games (2404.11695v2)
Published 17 Apr 2024 in math.OC and math.PR
Abstract: Mean field games (MFGs) model equilibria in games with a continuum of weakly interacting players as limiting systems of symmetric $n$-player games. We consider the finite-state, infinite-horizon problem with ergodic cost. Assuming Markovian strategies, we first prove that any solution to the MFG system gives rise to a $(C/\sqrt{n})$-Nash equilibrium in the $n$-player game. We follow this result by proving the same is true for the strategy profile derived from the master equation. We conclude the main theoretical portion of the paper by establishing a large deviation principle for empirical measures associated with the asymptotic Nash equilibria. Then, we contrast the asymptotic Nash equilibria using an example. We solve the MFG system directly and numerically solve the ergodic master equation by adapting the deep Galerkin method of Sirignano and Spiliopoulos. We use these results to derive the strategies of the asymptotic Nash equilibria and compare them. Finally, we derive an explicit form for the rate functions in dimension two.
- On solutions of mean field games with ergodic cost. Journal de Mathématiques Pures et Appliquées, 107(2):205–251, Feb. 2017.
- E. Bayraktar and A. Cohen. Analysis of a finite state many player game using its master equation. SIAM Journal on Control and Optimization, 56(5):3538–3568, 2018.
- The master equation in mean field theory. J. Math. Pures Appl. (9), 103(6):1441–1474, 2015.
- V. S. Borkar and R. Sundaresan. Asymptotics of the invariant measure in mean field models with jumps. Stoch. Syst., 2(2):322–380, 2012.
- The master equation and the convergence problem in mean field games, volume 201 of Annals of Mathematics Studies. Princeton University Press, Princeton, NJ, 2019.
- P. Cardaliaguet and A. Porretta. Long time behavior of the master equation in mean-field game theory. Analysis & PDE, 2017.
- P. Cardaliaguet and C. Rainer. An example of multiple mean field limits in ergodic differential games. NoDEA Nonlinear Differential Equations Appl., 27(3):Paper No. 25, 19, 2020.
- R. Carmona and M. Laurière. Convergence analysis of machine learning algorithms for the numerical solution of mean field control and games I: The ergodic case. SIAM J. Numer. Anal., 59(3):1455–1485, 2021.
- A. Cecchin and G. Pelino. Convergence, fluctuations and large deviations for finite state mean field games via the master equation. Stochastic Processes and their Applications, 129(11):4510 – 4555, 2019.
- T. Chan. Large deviations and quasi-stationarity for density-dependent birth-death processes. J. Austral. Math. Soc. Ser. B, 40(2):238–256, 1998.
- Deep Backward and Galerkin Methods for the Finite State Master Equation. arXiv e-prints, Mar. 2024.
- A. Cohen and E. Zell. Analysis of the Finite-State Ergodic Master Equation. Applied Mathematics and Optimization, 87, 2023.
- T. Daras. Hoeffding Type Inequalities and their Applications in Statistics and Operations Research. AIP Conference Proceedings, 936, Sep 2007.
- M. Fischer. On the connection between symmetric n𝑛nitalic_n-player games and mean field games. Ann. Appl. Probab., 127(2):757–810, 2017.
- Mean field games master equations with nonseparable Hamiltonians and displacement monotonicity. Ann. Probab., 50(6):2178–2217, 2022.
- Discrete time, finite state space mean field games. J. Math. Pures Appl. (9), 93(3):308–328, 2010.
- Continuous time finite state mean field games. Appl. Math. Optim., 68(1):99–143, 2013.
- F. Höfer and M. Soner. Synchronization games. arxiv preprint, 2024.
- The Nash certainty equivalence principle and Mckean-Vlasov systems: An invariance principle and entry adaptation. In Decision and Control, 2007 46th IEEE Conference on, pages 121–126. IEEE, 2007.
- Large population stochastic dynamic games: Closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle. Commun. Inf. Syst., 6(3):221–251, 2006.
- Probability, random processes, and statistical analysis. Cambridge University Press, Cambridge, 2012.
- D. Lacker. A general characterization of the mean field limit for stochastic differential games. Probab. Theory Related Fields, pages 1–68, 2015.
- D. Lacker. Limit theory for controlled mckean-vlasov dynamics. SIAM J. Control Optim., 55:1641–1672, 2017.
- D. Lacker. On the convergence of closed-loop nash equilibria to the mean field game limit. Ann. Appl. Probab., 30, 2020.
- D. Lacker and L. Le Flem. Closed-loop convergence for mean field games with common noise. Ann. Appl. Probab., 33(4):2681–2733, 2023.
- Jeux à champ moyen. I. Le cas stationnaire. C. R. Math. Acad. Sci. Paris, 343(9):619–625, 2006.
- Mean field games. Jpn. J. Math., 2(1):229–260, 2007.
- M. Laurière. Numerical methods for mean field games and mean field type control. In Mean field games, volume 78 of Proc. Sympos. Appl. Math., pages 221–282. Amer. Math. Soc., Providence, RI, 2021.
- C. Léonard. Large deviations for long range interacting particle systems with jumps. Ann. Inst. H. Poincaré Probab. Statist., 31(2):289–323, 1995.
- C. Mou and J. Zhang. Wellposedness of second order master equations for mean field games with nonsmooth data. arXiv e-prints, page arXiv:1903.09907, Mar. 2019.
- C. Mou and J. Zhang. Mean Field Game Master Equations with Anti-monotonicity Conditions. arXiv e-prints, page arXiv:2201.10762, Jan. 2022.
- B. A. Neumann. Stationary equilibria of mean field games with finite state and action space. Dynamic Games and Applications, 10(4):845–871, 2020.
- J. Sirignano and K. Spiliopoulos. DGM: a deep learning algorithm for solving partial differential equations. J. Comput. Phys., 375:1339–1364, 2018.
- L. Ying. On the approximation error of mean-field models. Stochastic Systems, 8(2):126–142, 2018.