Topological bifurcations in a mean-field game (2405.05473v1)
Abstract: Mean-field games (MFG) provide a statistical physics inspired modeling framework for decision making in large-populations of strategic, non-cooperative agents. Mathematically, these systems consist of a forward-backward in time system of two coupled nonlinear partial differential equations (PDEs), namely the Fokker-Plank and the Hamilton-Jacobi-BeLLMan equations, governing the agent state and control distribution, respectively. In this work, we study a finite-time MFG with a rich global bifurcation structure using a reduced-order model (ROM). The ROM is a 4D two-point boundary value problem obtained by restricting the controlled dynamics to first two moments of the agent state distribution, i.e., the mean and the variance. Phase space analysis of the ROM reveals that the invariant manifolds of periodic orbits around the so-called `ergodic MFG equilibrium' play a crucial role in determining the bifurcation diagram, and impart a topological signature to various solution branches. We show a qualitative agreement of these results with numerical solutions of the full-order MFG PDE system.
- Mean field games and mean field type control theory, volume 101. Springer, 2013.
- Peter E Caines. Mean field games. Encyclopedia of Systems and Control, pages 706–712, 2015.
- Nash, social and centralized solutions to consensus problems via mean field control theory. IEEE Transactions on Automatic Control, 58(3), 2013.
- V. S. Borkar. Controlled diffusion processes. Probability Surveys, 2:213–244, 2005.
- Stochastic controls: Hamiltonian systems and HJB equations, volume 43. Springer Science & Business Media, 2012.
- Probabilistic Theory of Mean Field Games with Applications I-II. Springer, 2018.
- On non-uniqueness and uniqueness of solutions in finite-horizon mean field games. ESAIM: Control, Optimisation and Calculus of Variations, 25:44, 2019.
- Pattern formation in flocking models: A hydrodynamic description. Physical Review E, 92(6):062111, 2015.
- Steven H Strogatz. From Kuramoto to Crawford: exploring the onset of synchronization in populations of coupled oscillators. Physica D: Nonlinear Phenomena, 143(1-4):1–20, 2000.
- Bifurcation analysis of a class of ‘car following’traffic models. Physica D: Nonlinear Phenomena, 197(3-4):222–241, 2004.
- Synchronization of coupled oscillators is a game. IEEE Transactions on Automatic Control, 57(4):920–935, 2012.
- Synchronization in a Kuramoto mean field game. Communications in Partial Differential Equations, 48(9):1214–1244, 2023.
- Stationary equilibria and their stability in a Kuramoto MFG with strong interaction. Communications in Partial Differential Equations, pages 1–27, 2024.
- A mean-field game model for homogeneous flocking. Chaos: An Interdisciplinary Journal of Nonlinear Science, 28(6):061103, 2018.
- Hansjörg Kielhöfer. Bifurcation theory: An introduction with applications to PDEs, volume 156. Springer Science & Business Media, 2006.
- Marco Cirant. On the existence of oscillating solutions in non-monotone mean-field games. Journal of Differential Equations, 266(12):8067–8093, 2019.
- The variational structure and time-periodic solutions for mean-field games systems. Minimax Theory and its applications, 3(2):227–260, 2018.
- Panrui Ni. Time periodic solutions of first order mean field games from the perspective of Mather theory. arXiv preprint arXiv:2401.07155, 2024.
- Max-Olivier Hongler. Mean-field games and swarms dynamics in Gaussian and non-Gaussianenvironments. Journal of Dynamics & Games, 7(1), 2020.
- Schrödinger approach to mean field games. Physical review letters, 116(12):128701, 2016.
- Quadratic mean field games. Physics Reports, 799:1–35, 2019.
- Stephen Wiggins. Introduction to applied nonlinear dynamical systems and chaos, volume 2. Springer, 2003.
- Richard Paul McGehee. Some homoclinic orbits for the restricted three-body problem. The University of Wisconsin-Madison, 1969.
- Heteroclinic connections between periodic orbits and resonance transitions in celestial mechanics. Chaos: An Interdisciplinary Journal of Nonlinear Science, 10(2):427–469, 2000.
- Cylindrical manifolds in phase space as mediators of chemical reaction dynamics and kinetics. i. theory. The Journal of chemical physics, 94(12):8310–8328, 1991.
- A tube dynamics perspective governing stability transitions: an example based on snap-through buckling. International Journal of Mechanical Sciences, 149:413–428, 2018.
- Long time average of mean field games with a nonlocal coupling. SIAM Journal on Control and Optimization, 51(5):3558–3591, 2013.
- Alexander Zaslavski. Turnpike properties in the calculus of variations and optimal control, volume 80. Springer Science & Business Media, 2005.
- Bose-Einstein condensation and superfluidity, volume 164. Oxford University Press, 2016.
- CC Conley. Low energy transit orbits in the restricted three-body problems. SIAM Journal on Applied Mathematics, 16(4):732–746, 1968.
- Dynamical systems, the three-body problem and space mission design. Marsden Books, 2022.
- Solving boundary value problems for ordinary differential equations in MATLAB with bvp4c. Tutorial notes, 2000:1–27, 2000.
- Recipes for continuation. SIAM, 2013.
- Alessio Porretta. On the planning problem for the mean field games system. Dynamic Games and Applications, 4:231–256, 2014.
- Steering the distribution of agents in mean-field games system. Journal of Optimization Theory and Applications, 179(1):332–357, 2018.
- Mean field games: numerical methods for the planning problem. SIAM Journal on Control and Optimization, 50(1):77–109, 2012.
- Mathieu Lauriere. Numerical methods for mean field games and mean field type control. Mean field games, 78:221, 2021.
- Universal behavior in non-stationary mean field games. Physics Letters A, 384(25):126608, 2020.
- Optimal transport in systems and control. Annual Review of Control, Robotics, and Autonomous Systems, 4:89–113, 2021.
- Optimal transport over nonlinear systems via infinitesimal generators on graphs. Journal of Computational Dynamics, 5(1&2):1–32, 2018.
- Mean-field optimal control. ESAIM: Control, Optimisation and Calculus of Variations, 20(4):1123–1152, 2014.
- Control of McKean–Vlasov dynamics versus mean field games. Mathematics and Financial Economics, 7:131–166, 2013.
- Brake orbits and heteroclinic connections for first order mean field games. Transactions of the American Mathematical Society, 374(7):5037–5070, 2021.