LSTM model predicting outcome of strategic thinking task exhibits representations of level-k thinking
Abstract: Which neural mechanisms underlie strategic thinking in the human brain? Neuroeconomic research has not yet bridged the gap between theoretical models of higher-order reasoning and the precise mechanisms implemented in neural networks in the human brain. In this paper, I demonstrate that a recurrent neural network model can learn to perform strongly in the simple strategic game Rock-Paper-Scissors. In doing so, it develops implicit representations of strategically important variables (the levels of reasoning) which economists have postulated in theoretical models. These representations can be extracted from the hidden activations of the neural network. These findings hint at a connection between the mechanisms implicit in recurrent neural networks and models of strategic thinking in economic theory. Future empirical brain research can investigate whether these mechanisms correspond to mechanisms implicit in biological neural networks.
- Colin Camerer, Teck Hua Ho and Juin Kuan Chong “A cognitive hierarchy model of games” In The Quarterly Journal of Economics 119.3 MIT Press, 2004, pp. 861–898
- Colin Camerer, Teck-Hua Ho and Juin Chong “A psychological approach to strategic thinking in games” In Current Opinion in Behavioral Sciences 3 Elsevier, 2015, pp. 157–162
- Colin F Camerer “Behavioural game theory” In Behavioural and Experimental economics Springer, 2010, pp. 42–50
- “Neural correlates of depth of strategic reasoning in medial prefrontal cortex” In Proceedings of the National Academy of Sciences 106.23 National Acad Sciences, 2009, pp. 9163–9168
- Miguel A Costa-Gomes and Georg Weizsäcker “Stated beliefs and play in normal-form games” In The Review of Economic Studies 75.3 Wiley-Blackwell, 2008, pp. 729–762
- Vincent P Crawford and Nagore Iriberri “Level-k auctions: Can a nonequilibrium model of strategic thinking explain the winner’s curse and overbidding in private-value auctions?” In Econometrica 75.6 Wiley Online Library, 2007, pp. 1721–1770
- Tayfun Gokmen, Malte J Rasch and Wilfried Haensch “Training LSTM networks with resistive cross-point devices” In Frontiers in neuroscience 12 Frontiers Media SA, 2018, pp. 745
- Tian Guo, Tao Lin and Nino Antulov-Fantulin “Exploring interpretable LSTM neural networks over multi-variable data” In Proceedings of the 36th International Conference on Machine Learning 97, Proceedings of Machine Learning Research PMLR, 2019, pp. 2494–2504 URL: https://proceedings.mlr.press/v97/guo19b.html
- Teck-Hua Ho, So-Eun Park and Xuanming Su “A bayesian level-k model in n-person games” In Management Science 67.3 INFORMS, 2021, pp. 1622–1638
- “Long short-term memory” In Neural computation 9.8 MIT press, 1997, pp. 1735–1780
- “Increasing the Interpretability of Recurrent Neural Networks Using Hidden Markov Models” arXiv, 2016 DOI: 10.48550/ARXIV.1606.05320
- “Neural basis of strategic decision making” In Trends in neurosciences 39.1 Elsevier, 2016, pp. 40–48
- Rosemarie Nagel “Unraveling in guessing games: An experimental study” In The American economic review 85.5 JSTOR, 1995, pp. 1313–1326
- John F Nash “Equilibrium points in n-person games” In Proceedings of the national academy of sciences 36.1 National Acad Sciences, 1950, pp. 48–49
- Martin J Osborne and Ariel Rubinstein “A course in game theory” MIT press, 1994
- “PyTorch: An Imperative Style, High-Performance Deep Learning Library” In Advances in Neural Information Processing Systems 32 Curran Associates, Inc., 2019, pp. 8024–8035 URL: http://papers.neurips.cc/paper/9015-pytorch-an-imperative-style-high-performance-deep-learning-library.pdf
- “PyTorch LSTM documentation” Accessed: 2023-03-11, https://pytorch.org/docs/stable/generated/torch.nn.LSTM.html, 2023
- “People thinking about thinking people: the role of the temporo-parietal junction in “theory of mind”” In Neuroimage 19.4 Elsevier, 2003, pp. 1835–1842
- Dale O Stahl and Paul W Wilson “On players’ models of other players: Theory and experimental evidence” In Games and Economic Behavior 10.1 Elsevier, 1995, pp. 218–254
- John Von Neumann and Oskar Morgenstern “Theory of games and economic behavior, 2nd rev” Princeton university press, 1944
Paper Prompts
Sign up for free to create and run prompts on this paper.