Finite-time convergence to an $ε$-efficient Nash equilibrium in potential games
Abstract: This paper investigates the convergence time of log-linear learning to an $\epsilon$-efficient Nash equilibrium (NE) in potential games. In such games, an efficient NE is defined as the maximizer of the potential function. Previous literature provides asymptotic convergence rates to efficient Nash equilibria, and existing finite-time rates are limited to potential games with further assumptions such as the interchangeability of players. In this paper, we prove the first finite-time convergence to an $\epsilon$-efficient NE in general potential games. Our bounds depend polynomially on $1/\epsilon$, an improvement over previous bounds that are exponential in $1/\epsilon$ and only hold for subclasses of potential games. We then strengthen our convergence result in two directions: first, we show that a variant of log-linear learning that requires a factor $A$ less feedback on the utility per round enjoys a similar convergence time; second, we demonstrate the robustness of our convergence guarantee if log-linear learning is subject to small perturbations such as alterations in the learning rule or noise-corrupted utilities.
- Autonomous vehicle-target assignment: A game-theoretical formulation. 2007.
- On the inefficiency ratio of stable equilibria in congestion games. In Internet and Network Economics: 5th International Workshop, WINE 2009, Rome, Italy, December 14-18, 2009. Proceedings 5. Springer, 2009.
- The nonstochastic multiarmed bandit problem. SIAM journal on computing, 2002.
- Fast convergence to nearly optimal solutions in potential games. In Proceedings of the 9th ACM conference on Electronic commerce, 2008.
- Lawrence E Blume. The statistical mechanics of strategic interaction. Games and economic behavior, 1993.
- On the robustness of learning in games with stochastically perturbed payoff observations . Games and Economic Behavior, 2017.
- Regret analysis of stochastic and nonstochastic multi-armed bandit problems. Foundations and Trends® in Machine Learning, 2012.
- Non-convex mixed-integer nonlinear programming: A survey. Surveys in Operations Research and Management Science, 2012.
- Convergence to approximate Nash equilibria in congestion games. Games and Economic Behavior, 2011.
- Logarithmic Sobolev inequalities for finite Markov chains. The Annals of Applied Probability, 1996.
- Learning with bandit feedback in potential games. Advances in Neural Information Processing Systems, 2017.
- Tracking the best expert. Machine learning, 1998.
- Online learning of nash equilibria in congestion games. SIAM Journal on Control and Optimization, 2015.
- Equilibrium selection in potential games with noisy rewards. In International Conference on NETwork Games, Control and Optimization (NetGCooP 2011), 2011.
- Markov chains and mixing times. American Mathematical Soc., 2017.
- Robustness of stochastic stability in game theoretic learning. In 2013 American Control Conference, 2013.
- Revisiting log-linear learning: Asynchrony, completeness and payoff-based implementation . Games and Economic Behavior, 2012.
- Game theory and distributed control. In Handbook of game theory with economic applications. Elsevier, 2015.
- Distributed welfare games. Operations Research, 2013.
- Connections between cooperative control and potential games illustrated on the consensus problem . In 2007 European Control Conference (ECC). IEEE, 2007.
- Laurent Miclo. Remarques sur l’hypercontractivité et l’évolution de l’entropie pour des chaines de Markov finies . Springer, 1997.
- Fictitious play property for games with identical interests. Journal of economic theory, 1996a.
- Potential games. Games and economic behavior, 1996b.
- Convergence to equilibrium in local interaction games and ising models. arXiv preprint arXiv:0812.0198, 2008.
- The spread of innovations in social networks. Proceedings of the National Academy of Sciences, 2010.
- Mathematical aspects of mixing times in Markov chains. Foundations and Trends® in Theoretical Computer Science, 2006.
- John Nash. Non-cooperative games. Annals of mathematics, 1951.
- John F Nash Jr. Equilibrium points in n-person games. Proceedings of the national academy of sciences, 1950.
- Utility and mechanism design in multi-agent systems: An overview. Annual Reviews in Control, 2022.
- Multiplicative weights update with constant step-size in congestion games: Convergence, limit cycles and chaos . Advances in Neural Information Processing Systems, 2017.
- Robert W Rosenthal. A class of games possessing pure-strategy Nash equilibria. International Journal of Game Theory, 1973.
- Dynamics in congestion games. ACM SIGMETRICS Performance Evaluation Review, 2010.
- H Peyton Young. The evolution of conventions. Econometrica: Journal of the Econometric Society, 1993.
- Global convergence of localized policy iteration in networked multi-agent reinforcement learning . Proceedings of the ACM on Measurement and Analysis of Computing Systems, 2023.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.