Reducing Optimism Bias in Incomplete Cooperative Games (2402.01930v4)
Abstract: Cooperative game theory has diverse applications in contemporary artificial intelligence, including domains like interpretable machine learning, resource allocation, and collaborative decision-making. However, specifying a cooperative game entails assigning values to exponentially many coalitions, and obtaining even a single value can be resource-intensive in practice. Yet simply leaving certain coalition values undisclosed introduces ambiguity regarding individual contributions to the collective grand coalition. This ambiguity often leads to players holding overly optimistic expectations, stemming from either inherent biases or strategic considerations, frequently resulting in collective claims exceeding the actual grand coalition value. In this paper, we present a framework aimed at optimizing the sequence for revealing coalition values, with the overarching goal of efficiently closing the gap between players' expectations and achievable outcomes in cooperative games. Our contributions are threefold: (i) we study the individual players' optimistic completions of games with missing coalition values along with the arising gap, and investigate its analytical characteristics that facilitate more efficient optimization; (ii) we develop methods to minimize this gap over classes of games with a known prior by disclosing values of additional coalitions in both offline and online fashion; and (iii) we empirically demonstrate the algorithms' performance in practical scenarios, together with an investigation into the typical order of revealing coalition values.
- Gleb Beliakov. 2022. On Random Generation of Supermodular Capacities. IEEE TRANSACTIONS ON FUZZY SYSTEMS 30, 1 (2022), 293–295.
- Jan Bok and Martin Černý. 2023. 1-convex extensions of incomplete cooperative games and the average value. Theory and Decisions (2023).
- Martin Černý. 2023. Bounds on solution concepts of incomplete cooperative games. arXiv:arXiv:2212.04748 [cs.GT]
- Martin Černý and Michel Grabisch. 2024. Incomplete cooperative games with player-centered information. Discrete Applied Mathematics 346 (2024), 62–79.
- Computational Aspects of Cooperative Game Theory (1 ed.). Springer Cham. XVI, 150 pages.
- Gustave Choquet. 1954. Theory of capacities. In Annales de l’institut Fourier, Vol. 5. 131–295.
- Michael Finus. 2008. Game theoretic research on the design of international environmental agreements: insights, critical remarks, and future challenges. International Review of environmental and resource economics 2, 1 (2008), 29–67.
- An analysis of approximations for maximizing submodular set functions I. Mathematical Programming 14 (1978), 265–294.
- Michel Grabisch. 2016. Set Functions, Games and Capacities in Decision Making. Number 978-3-319-30690-2 in Theory and Decision Library C. Springer.
- Samuel Ieong and Yoav Shoham. 2005. Marginal Contribution Nets: A Compact Representation Scheme for Coalitional Games.
- Francis W. Irwin. 1953. Stated expectations as functions of probability and desirability of outcomes. Journal of Personality (1953).
- Cooperative game theory approach to allocating benefits of horizontal cooperation. European Journal of Operational Research 229, 2 (2013), 444–452.
- Scott M. Lundberg and Su-In Lee. 2017. A Unified Approach to Interpreting Model Predictions. In Advances in Neural Information Processing Systems 30, I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.). Curran Associates, Inc., 4765–4774.
- Satoshi Masuya and Masahiro Inuiguchi. 2016. A fundamental study for partially defined cooperative games. Fuzzy Optimization Decision Making 15, 1 (2016), 281–306.
- Kevin R. Murphy and Jeanette N. Cleveland. 1995. Understanding performance appraisal: Social, organizational, and goal-based perspectives. Sage.
- Mahesh Nagarajan and Greys Sošić. 2008. Game-theoretic analysis of cooperation among supply chain agents: Review and extensions. European journal of operational research 187, 3 (2008), 719–745.
- Guillermo Owen. 2013. Game Theory (4th ed.). Emerald Group Publishing, Bingley, U.K.
- Bezalel Peleg and Peter Sudhölter. 2007. Introduction to the Theory of Cooperative Games. Springer.
- Manju Puri and David T Robinson. 2007. Optimism and economic choice. Journal of financial economics 86, 1 (2007), 71–99.
- Coalitional game theory for communication networks. Ieee signal processing magazine 26, 5 (2009), 77–97.
- Proximal Policy Optimization Algorithms. CoRR abs/1707.06347 (2017).
- Comandur Seshadhri and Jan Vondrák. 2014. Is Submodularity Testable? Algorithmica 69 (2014), 1–25.
- Burr Settles. 2009. Active Learning Literature Survey. University of Wisconsin-Madison Department of Computer Sciences (2009).
- Glenn Shafer. 1976. A Mathematical Theory of Evidence. Princeton University Press.
- Lloyd Shapley. 1953. A value for n-person game. Annals of Mathematical Studies 28 (1953), 307–317.
- Paul Slovic. 1987. Perception of Risk. Science 236, 4799 (1987), 280–285.
- Facts and fears: Understanding perceived risk. In The perception of risk. Routledge, 137–153.
- Richard S. Sutton and Andrew G. Barto. 2014. Reinforcement Learning: An Introduction.
- Neil D. Weinstein. 1980. Unrealistic optimism about future life events. Journal of personality and social psychology 39, 5 (1980), 806.
- Neil D. Weinstein. 1989. Optimistic biases about personal risks. Science 246, 4935 (1989), 1232–1233.
- Filip Úradník. 2024. Incomplete Cooperative. https://github.com/furadnik/IncompleteCooperative/releases/tag/AAMAS24. Accessed: February 10, 2024.