Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Deterministic Sub-exponential Algorithm for Discounted-sum Games with Unary Weights (2405.02479v2)

Published 3 May 2024 in cs.GT

Abstract: Turn-based discounted-sum games are two-player zero-sum games played on finite directed graphs. The vertices of the graph are partitioned between player 1 and player 2. Plays are infinite walks on the graph where the next vertex is decided by a player that owns the current vertex. Each edge is assigned an integer weight and the payoff of a play is the discounted-sum of the weights of the play. The goal of player 1 is to maximize the discounted-sum payoff against the adversarial player 2. These games lie in NP and coNP and are among the rare combinatorial problems that belong to this complexity class and the existence of a polynomial-time algorithm is a major open question. Since breaking the general exponential barrier has been a challenging problem, faster parameterized algorithms have been considered. If the discount factor is expressed in unary, then discounted-sum games can be solved in polynomial time. However, if the discount factor is arbitrary (or expressed in binary), but the weights are in unary, none of the existing approaches yield a sub-exponential bound. Our main result is a new analysis technique for a classical algorithm (namely, the strategy iteration algorithm) that present a new runtime bound which is $n{O ( W{1/4} \sqrt{n} )}$, for game graphs with $n$ vertices and maximum absolute weight of at most $W$. In particular, our result yields a deterministic sub-exponential bound for games with weights that are constant or represented in unary.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (35)
  1. Andersson, D. Improved Combinatorial Algorithms for Discounted Payoff Games. PhD thesis, Uppsala University, 2006.
  2. The complexity of solving stochastic games on graphs. In International Symposium on Algorithms and Computation (2009), Springer, pp. 112–121.
  3. Baez, J. The beauty of roots, 2023. https://math.ucr.edu/home/baez/roots/.
  4. On satisficing in quantitative games. Tools and Algorithms for the Construction and Analysis of Systems 12651, 20.
  5. Littlewood-type problems on [0, 1]. Proceedings of the London Mathematical Society 79, 1 (1999), 22–46.
  6. Faster algorithms for mean-payoff games. Formal Methods Syst. Des. 38, 2 (2011), 97–118.
  7. Deciding parity games in quasi-polynomial time. SIAM J. Comput. 51, 2 (2022), 17–152.
  8. Alternation. Journal of the ACM (JACM) 28, 1 (1981), 114–133.
  9. A reduction from parity games to simple stochastic games. In GandALF (2011), pp. 74–86.
  10. Logical reliability of interacting real-time tasks. In Proceedings of the conference on Design, automation and test in Europe (2008), pp. 909–914.
  11. Efficient and dynamic algorithms for alternating büchi games and maximal end-component decomposition. Journal of the ACM (JACM) 61, 3 (2014), 1–40.
  12. Quantitative interprocedural analysis. In Proceedings of the 42nd Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages (2015), pp. 539–551.
  13. Condon, A. On Algorithms for Simple Stochastic Games. Advances in computational complexity theory (1990).
  14. Condon, A. The complexity of stochastic games. Information and Computation 96, 2 (1992), 203–224.
  15. Discounting the future in systems theory. In International Colloquium on Automata, Languages, and Programming (2003), Springer, pp. 1022–1037.
  16. A faster deterministic exponential time algorithm for energy games and mean payoff games. In ICALP (2019).
  17. Positional strategies for mean payoff games. Int. Journal of Game Theory 8, 2 (1979), 109–113.
  18. Tree automata, mu-calculus and determinacy. In FOCS (1991).
  19. The complexity of the simplex method. In Proceedings of the forty-seventh annual ACM symposium on Theory of computing (2015), pp. 201–208.
  20. Competitive Markov Decision Processes. Springer-Verlag, 1997.
  21. Friedman, O. A super-polynomial lower bound for the parity game strategy improvement algorithm as we know it. Logic in Computer Science (LICS). IEEE, Los Alamitos (to appear, 2009) (2009).
  22. Subexponential lower bounds for randomized pivoting rules for the simplex algorithm. In Proceedings of the forty-third annual ACM symposium on Theory of computing (2011), pp. 283–292.
  23. Trees, automata, and games. In STOC’82 (1982), ACM Press, pp. 60–65.
  24. Cyclic games and an algorithm to find minimax cycle means in directed graphs. USSR Comput. Math. Math. Phys. 28, 5 (1990), 85–91.
  25. Strategy iteration is strongly polynomial for 2-player turn-based stochastic games with a constant discount factor. JACM 60, 1 (2013), 1–16.
  26. Jurdzinski, M. Deciding the winner in parity games is in UP ∩\cap∩ co-UP. Information Processing Letters 68, 3 (1998), 119–124.
  27. Jurdzinski, M. Small progress measures for solving parity games. In STACS (2000), pp. 290–301.
  28. A deterministic subexponential algorithm for solving parity games. SIAM J. Comput. 38, 4 (2008), 1519–1532.
  29. Kozachinskiy, A. Polyhedral value iteration for discounted games and energy games. In Proceedings of the 2021 ACM-SIAM Symposium on Discrete Algorithms (SODA) (2021), SIAM, pp. 600–616.
  30. Ludwig, W. A subexponential randomized algorithm for the simple stochastic game problem. Information and Computation 117 (1995), 151–155.
  31. Puterman, M. L. Markov Decision Processes. John Wiley and Sons, 1994.
  32. Schewe, S. Solving parity games in big steps. In FSTTCS 2007 (2007), pp. 449–460.
  33. Shapley, L. S. Stochastic Games. Proceedings of the National Academy of Sciences 39, 10 (1953), 1095–1100.
  34. Zielonka, W. Infinite games on finitely coloured graphs with applications to automata on infinite trees. In Theoretical Computer Science (1998), vol. 200(1-2), pp. 135–183.
  35. The complexity of mean payoff games on graphs. Theoretical Computer Science 158, 1-2 (1996), 343–359.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (4)
  1. Ali Asadi (10 papers)
  2. Krishnendu Chatterjee (214 papers)
  3. Raimundo Saona (13 papers)
  4. Jakub Svoboda (14 papers)

Summary

We haven't generated a summary for this paper yet.