Winning Without Observing Payoffs: Exploiting Behavioral Biases to Win Nearly Every Round (2404.00150v1)
Abstract: Gameplay under various forms of uncertainty has been widely studied. Feldman et al. (2010) studied a particularly low-information setting in which one observes the opponent's actions but no payoffs, not even one's own, and introduced an algorithm which guarantees one's payoff nonetheless approaches the minimax optimal value (i.e., zero) in a symmetric zero-sum game. Against an opponent playing a minimax-optimal strategy, approaching the value of the game is the best one can hope to guarantee. However, a wealth of research in behavioral economics shows that people often do not make perfectly rational, optimal decisions. Here we consider whether it is possible to actually win in this setting if the opponent is behaviorally biased. We model several deterministic, biased opponents and show that even without knowing the game matrix in advance or observing any payoffs, it is possible to take advantage of each bias in order to win nearly every round (so long as the game has the property that each action beats and is beaten by at least one other action). We also provide a partial characterization of the kinds of biased strategies that can be exploited to win nearly every round, and provide algorithms for beating some kinds of biased strategies even when we don't know which strategy the opponent uses.
- Tracking and handling behavioral biases in active learning frameworks. Information Sciences, 641:119117, 2023. URL: https://www.sciencedirect.com/science/article/pii/S0020025523007028, doi:10.1016/j.ins.2023.119117.
- The nonstochastic multiarmed bandit problem. SIAM Journal on Computing, 32(1):48–77, 2002. doi:10.1137/S0097539701398375.
- C.F. Camerer. Behavioral Game Theory: Experiments in Strategic Interaction. The Roundtable Series in Behavioral Economics. Princeton University Press, 2011. URL: https://books.google.com/books?id=cr_Xg7cRvdcC.
- Edward Cartwright. Behavioral economics. Routledge, 2018.
- Prediction, learning, and games. Cambridge University Press, 2006. doi:10.1017/CBO9780511546921.
- Nicolas Christin. Network security games: Combining game theory, behavioral economics, and network measurements. In John S. Baras, Jonathan Katz, and Eitan Altman, editors, Decision and Game Theory for Security, pages 4–6, Berlin, Heidelberg, 2011. Springer Berlin Heidelberg. doi:10.1007/978-3-642-25280-8_2.
- Playing the wrong game: An experimental analysis of relational complexity and strategic misrepresentation. Games and Economic Behavior, 62(2):364–382, 2008. URL: https://www.sciencedirect.com/science/article/pii/S0899825607001133, doi:10.1016/j.geb.2007.05.007.
- Playing games without observing payoffs. In Innovations in Computer Science - ICS 2010, Tsinghua University, Beijing, China, January 5-7, 2010. Proceedings, pages 106–110. Tsinghua University Press, 2010. URL: http://conference.iiis.tsinghua.edu.cn/ICS2010/content/papers/9.html.
- Algorithmic rationality: Game theory with costly computation. Journal of Economic Theory, 156:246–268, 2015. URL: https://doi.org/10.1016/j.jet.2014.04.007, doi:10.1016/J.JET.2014.04.007.
- Daniel Kahneman. Thinking, Fast and Slow. Farrar, Straus and Giroux, New York, 2011.
- Nick Littlestone. Learning quickly when irrelevant attributes abound: A new linear-threshold algorithm. Machine Learning, 2(4):285–318, 1988. doi:10.1007/BF00116827.
- Learning, exploitation and bias in games. PLOS ONE, 16(2):1–14, 02 2021. doi:10.1371/journal.pone.0246588.
- A strategy of win-stay, lose-shift that outperforms tit-for-tat in the prisoner’s dilemma game. Nature, 364(6432):56–58, July 1993. doi:10.1038/364056a0.
- A course in game theory. The MIT Press, Cambridge, USA, 1994. electronic edition. URL: https://arielrubinstein.tau.ac.il/books/GT.pdf.
- Herbert Robbins. Some aspects of the sequential design of experiments. Bulletin of the American Mathematical Society, 58(5):527 – 535, 1952. doi:10.1090/s0002-9904-1952-09620-8.
- Shai Shalev-Shwartz. Online learning and online convex optimization. Foundations and Trends in Machine Learning, 4(2):107–194, 2012. doi:10.1561/2200000018.
- Reinforcement learning: An introduction. MIT press, 2018.
- Santosh Vempala. Algorithmic convex geometry. https://faculty.cc.gatech.edu/~vempala/acg/notes.pdf, 2008. [Accessed 06-Sep-2023].
- Social cycling and conditional responses in the rock-paper-scissors game. Scientific Reports, 4(1), jul 2014. doi:10.1038/srep05830.