Decision making in stochastic extensive form I: Stochastic decision forests (2404.12332v2)
Abstract: A general theory of stochastic decision forests is developed to bridge two concepts of information flow: decision trees and refined partitions on the one side, filtrations from probability theory on the other. Instead of the traditional "nature" agent, this framework uses a single lottery draw to select a tree of a given decision forest. Each "personal" agent receives dynamic updates from an own oracle on the lottery outcome and makes partition-refining choices adapted to this information. This theory addresses a key limitation of existing approaches in extensive form theory, which struggle to model continuous-time stochastic processes, such as Brownian motion, as outcomes of "nature" decision making. Additionally, a class of stochastic decision forests based on time-indexed action paths is constructed, encompassing a wide range of models from the literature and laying the groundwork for an approximation theory for stochastic differential games in extensive form.
- Repeated games in continuous time as extensive form games. Journal of Mathematical Economics, 61:34–57, 2015.
- Comment on “Trees and extensive forms”. Journal of Economic Theory, 146(5):2165––2168, 2011.
- Trees and decisions. Economic Theory, 25:764–798, 2005.
- Trees and extensive form. Journal of Economic Theory, 143:216–250, 2008.
- The theory of extensive form games. Springer, 2016.
- Robert J. Aumann. Game theory. In Matias Vernengo, Esteban Perez Caldentey, and Barkley J Rosser Jr, editors, The New Palgrave dictionary of economics. Palgrave Macmillan UK: Imprint: Palgrave Macmillan, 2020.
- Long cheap talk. Econometrica, 71(6):1619–1660, 2003.
- Fundamentals of Stochastic Filtering. Stochastic Modelling and Applied Probability. Springer, New York, 2009.
- Rough Volatility. Society for Industrial and Applied Mathematics, Philadelphia, PA, 2023.
- Dimitri Bertsekas and Steven E. Shreve. Stochastic optimal control: the discrete-time case, volume 5. Athena Scientific, 1996.
- Vladimir I. Bogachev. Measure theory, volume 1. Springer, Berlin, Heidelberg, 2007.
- Béla Bollobás. Modern graph theory, volume 184 of Graduate Texts in Mathematics. Springer Science & Business Media, New York, 2013.
- Probabilistic theory of mean field games with applications I. Mean field FBSDEs, control, and games, volume 83 of Probability theory and stochastic modelling. Springer, Cham, 2018.
- Samuel N. Cohen and Robert J. Elliott. Stochastic calculus and applications, volume 2. Springer, 2015.
- Optimal adaptive control with separable drift uncertainty. arXiv2309.07091, 2023. Preprint.
- Introduction to lattices and order. Cambridge University Press, 2nd edition, 2002.
- The mathematics of arbitrage. Springer, 2006.
- Differential Games in Economics and Management Science. Cambridge University Press, 2000.
- Nicole El Karoui. Les aspects probabilistes du controle stochastique. In P. L. Hennequin, editor, Ecole d’Eté de Probabilités de Saint-Flour IX-1979, pages 73–238, Berlin, Heidelberg, 1981. Springer.
- Drew Fudenberg and David K. Levine. Open-loop and closed-loop equilibria in dynamic games with many players. Journal of Economic Theory, 44(1):1–18, 1988.
- Game Theory. MIT Press, Cambridge (Massachusetts), London, 1991.
- Stochastic Finance. De Gruyter, Berlin, Boston, 2016.
- Maxmin expected utility with non-unique prior. Journal of Mathematical Economics, 18(2):141–153, 1989.
- Steven R. Grenadier. The strategic exercise of options: development cascades and overbuilding in real estate markets. J. Finance, 51(5):1653–1679, 1996.
- Reinforcement learning for linear-convex models with jumps via stability analysis of feedback controls. SIAM Journal on Control and Optimization, 61(2):755–787, 2023.
- Large population stochastic dynamic games. Closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle. Communication in information and systems, 6(3):221–252, 2006.
- John C. Hull and Sankarshan Basu. Options, futures, and other derivatives. Pearson Education India, 10th edition, 2018.
- Olav Kallenberg. Foundations of Modern Probability, volume 99 of Probability Theory and Stochastic Modelling. Springer Cham, 2021. 3rd edition.
- Ioannis Karatzas and Steven E. Shreve. Methods of mathematical finance, volume 39. Springer, 1998.
- Harold W. Kuhn. Extensive games. Proceedings of the National Academy of Sciences, 36(10):570–576, 1950.
- Harold W. Kuhn. Extensive games and the problem of information. Contributions to the Theory of Games, 2(28):193–216, 1953.
- Mean field games. Japanese journal of mathematics, 2:227–260, 2007.
- Optimal stopping and free-boundary problems. Birkhäuser, Basel, 2006.
- Huyên Pham. Continuous-time stochastic control and optimization with financial applications, volume 61. Springer Science & Business Media, 2009.
- Subgame-perfect equilibria in stochastic timing games. Journal of Mathematical Economics, 72:36–50, 2017.
- Lior Rokach. Decision forest: Twenty years of research. Information Fusion, 27:111–125, 2016.
- Ariel Rubinstein. Perfect equilibrium in a bargaining model. Econometrica: Journal of the Econometric Society, pages 97–109, 1982.
- Leonard J. Savage. The foundations of statistics. Dover Publications, New York, 1972.
- Lloyd S. Shapley. Stochastic games. Proceedings of the national academy of sciences, 39(10):1095–1100, 1953.
- Albert N. Shiryaev. Optimal stopping rules, volume 8. Springer Science & Business Media, 2007.
- Leo K. Simon. Basic timing games. Working paper 8745, University of California, Berkeley, 1987.
- Leo K. Simon and Maxwell B. Stinchcombe. Extensive form games in continuous time: Pure strategies. Econometrica: Journal of the Econometric Society, pages 1171–1214, 1989.
- Jan-Henrik Steg. On preemption in discrete and continuous time. Dynamic games and applications, 8(4):918–938, 2018.
- Maxwell B. Stinchcombe. Maximal strategy sets for continuous-time game theory. Journal of Economic Theory, 56(2):235–265, 1992.
- John von Neumann and Oskar Morgenstern. Theory of Games and Economic Behavior. Princeton University Press, Princeton, 1944.