Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
156 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

On Time-Inconsistency in Mean Field Games (2312.07770v2)

Published 12 Dec 2023 in math.OC, cs.GT, and math.PR

Abstract: We investigate an infinite-horizon time-inconsistent mean-field game (MFG) in a discrete time setting. We first present a classic equilibrium for the MFG and its associated existence result. This classic equilibrium aligns with the conventional equilibrium concept studied in MFG literature when the context is time-consistent. Then we demonstrate that while this equilibrium produces an approximate optimal strategy when applied to the related $N$-agent games, it does so solely in a precommitment sense. Therefore, it cannot function as a genuinely approximate equilibrium strategy from the perspective of a sophisticated agent within the $N$-agent game. To address this limitation, we propose a new consistent equilibrium concept in both the MFG and the $N$-agent game. We show that a consistent equilibrium in the MFG can indeed function as an approximate consistent equilibrium in the $N$-agent game. Additionally, we analyze the convergence of consistent equilibria for $N$-agent games toward a consistent MFG equilibrium as $N$ tends to infinity.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (31)
  1. Equilibria of dynamic games with many players: existence, approximation, and market structure. J. Econom. Theory, 156:269–316, 2015.
  2. Infinite dimensional analysis. Springer, Berlin, third edition, 2006. A hitchhiker’s guide.
  3. Q-learning in regularized mean-field games. Dynamic Games and Applications, 13(1):89–117, 2023.
  4. Mean field control and finite agent approximation for regime-switching jump diffusions. Applied Mathematics & Optimization, 88(2):36, 2023.
  5. Finite state mean field games with wright–fisher common noise as limits of n-player weighted games. Mathematics of Operations Research, 47(4):2840–2890, 2022.
  6. Analysis of a finite state many player game using its master equation. SIAM J. Control Optim., 56(5):3538–3568, 2018.
  7. Existence of markov equilibrium control in discrete time. arXiv preprint arXiv:2308.07227, 2023.
  8. Relaxed equilibria for time-inconsistent markov decision processes. arXiv preprint arXiv:2307.04227, 2023.
  9. Time-inconsistent control theory with finance applications. Springer Finance. Springer, Cham, [2021] ©2021.
  10. V. I. Bogachev. Measure theory. Vol. I, II. Springer-Verlag, Berlin, 2007.
  11. Long time results for a weakly interacting particle system in discrete time. Stoch. Anal. Appl., 33(3):429–463, 2015.
  12. The master equation and the convergence problem in mean field games, volume 201 of Annals of Mathematics Studies. Princeton University Press, Princeton, NJ, 2019.
  13. Probabilistic analysis of mean-field games. SIAM J. Control Optim., 51(4):2705–2734, 2013.
  14. Time-inconsistent mean-field optimal stopping: a limit approach. J. Math. Anal. Appl., 528(1):Paper No. 127582, 26, 2023.
  15. Weighted discounting—on group diversity, time-inconsistency, and consequences for investment. J. Econom. Theory, 189:105089, 40, 2020.
  16. Time-consistent portfolio management. SIAM J. Financial Math., 3(1):1–32, 2012.
  17. Markus Fischer. On the connection between symmetric N𝑁Nitalic_N-player games and mean field games. Ann. Appl. Probab., 27(2):757–810, 2017.
  18. Continuous time finite state mean field games. Appl. Math. Optim., 68(1):99–143, 2013.
  19. Learning mean-field games. Advances in neural information processing systems, 32, 2019.
  20. A general framework for learning mean-field games. Math. Oper. Res., 48(2):656–686, 2023.
  21. Strong and weak equilibria for time-inconsistent stochastic control in continuous time. Math. Oper. Res., 46(2):428–451, 2021.
  22. Daniel Lacker. A general characterization of the mean field limit for stochastic differential games. Probab. Theory Related Fields, 165(3-4):581–648, 2016.
  23. Daniel Lacker. Limit theory for controlled McKean-Vlasov dynamics. SIAM J. Control Optim., 55(3):1641–1672, 2017.
  24. Linear-quadratic time-inconsistent mean-field type Stackelberg differential games: time-consistent open-loop solutions. IEEE Trans. Automat. Control, 66(1):375–382, 2021.
  25. Time-inconsistent mean-field stochastic LQ problem: open-loop time-consistent control. IEEE Trans. Automat. Control, 63(9):2771–2786, 2018.
  26. Markov-Nash equilibria in mean-field games with discounted cost. SIAM J. Control Optim., 56(6):4256–4287, 2018.
  27. R. H. Strotz. Myopia and inconsistency in dynamic utility maximization. The Review of Economic Studies, 23(3):165–180, 1955.
  28. Time-inconsistent LQ games for large-population systems and applications. J. Optim. Theory Appl., 197(3):1249–1268, 2023.
  29. Policy mirror ascent for efficient and independent learning in mean field games. In International Conference on Machine Learning, pages 39722–39754. PMLR, 2023.
  30. Jiongmin Yong. Time-inconsistent optimal control problems and the equilibrium HJB equation. Math. Control Relat. Fields, 2(3):271–329, 2012.
  31. Time-inconsistent mean-field stopping problems: A regularized equilibrium approach. arXiv preprint arXiv:2311.00381, 2023.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now