Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
41 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
41 tokens/sec
o3 Pro
7 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

ABIDES-Economist: Agent-Based Simulation of Economic Systems with Learning Agents (2402.09563v1)

Published 14 Feb 2024 in cs.MA, econ.GN, and q-fin.EC

Abstract: We introduce a multi-agent simulator for economic systems comprised of heterogeneous Households, heterogeneous Firms, Central Bank and Government agents, that could be subjected to exogenous, stochastic shocks. The interaction between agents defines the production and consumption of goods in the economy alongside the flow of money. Each agent can be designed to act according to fixed, rule-based strategies or learn their strategies using interactions with others in the simulator. We ground our simulator by choosing agent heterogeneity parameters based on economic literature, while designing their action spaces in accordance with real data in the United States. Our simulator facilitates the use of reinforcement learning strategies for the agents via an OpenAI Gym style environment definition for the economic system. We demonstrate the utility of our simulator by simulating and analyzing two hypothetical (yet interesting) economic scenarios. The first scenario investigates the impact of heterogeneous household skills on their learned preferences to work at different firms. The second scenario examines the impact of a positive production shock to one of two firms on its pricing strategy in comparison to the second firm. We aspire that our platform sets a stage for subsequent research at the intersection of artificial intelligence and economics.

PDF HTML Abstract
Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize File Document Download Save Streamline Icon: https://streamlinehq.com PDF File Document Download Save Streamline Icon: https://streamlinehq.com Markdown Bookmark Chat Bubble Oval Streamline Icon: https://streamlinehq.com Chat (Pro)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (65)
  1. Dynare: Reference Manual Version 5. Technical report, CEPREMAP, 2022.
  2. A multi-agent approach to cooperative traffic management and route guidance. Transportation Research Part B: Methodological, 39(4):297–318, 2005.
  3. Abides-gym: gym environments for multi-agent discrete event simulation and application to financial markets. In Proceedings of the Second ACM International Conference on AI in Finance, pages 1–9, 2021.
  4. Bayesian analysis of dsge models. Econometric reviews, 26(2-4):113–172, 2007.
  5. W Brian Arthur. Foundations of complexity economics. Nature Reviews Physics, 3(2):136–145, 2021.
  6. Deep equilibrium nets. International Economic Review, 63(4):1471–1525, 2022.
  7. An analysis of stochastic game theory for multiagent reinforcement learning. Citeseer, 2000.
  8. Language models are few-shot learners. Advances in neural information processing systems, 33:1877–1901, 2020.
  9. A comprehensive survey of multiagent reinforcement learning. IEEE Transactions on Systems, Man, and Cybernetics, 38(2):156–172, 2008.
  10. Abides: Towards high-fidelity market simulation for ai research. arXiv preprint arXiv:1904.12066, 2019.
  11. Global dsge models. Review of Economic Dynamics, 2023.
  12. Deep reinforcement learning in a monetary model. arXiv preprint arXiv:2104.09368, 2021.
  13. Nominal rigidities and the dynamic effects of a shock to monetary policy. Journal of political Economy, 113(1):1–45, 2005.
  14. A theory of production. American Economic Association, 1928.
  15. Analyzing micro-founded general equilibrium models with many agents using deep reinforcement learning. Technical report, 2022.
  16. Dsge model-based forecasting. In Handbook of economic forecasting, volume 2, pages 57–140. Elsevier, 2013.
  17. New york fed dsge model (version 1002). https://github.com/FRBNY-DSGE/DSGE.jl, 2015.
  18. Inflation in the great recession and new keynesian models. American Economic Journal: Macroeconomics, 7(1):168–96, 2015.
  19. Analyzing the impact of tax credits on households in simulated economic systems with learning agents. arXiv preprint arXiv:2311.17252, 2023.
  20. Multi-agent systems: A survey. Ieee Access, 6:28573–28593, 2018.
  21. Policy interaction, expectations and the liquidity trap. Review of Economic Dynamics, 8(2):303–323, 2005.
  22. The economy needs agent-based modelling. Nature, 460(7256):685–686, 2009.
  23. Federal Reserve Board. Selected interest rates (daily). https://www.federalreserve.gov/releases/h15/, 2023.
  24. The theory of learning in games, volume 2. MIT press, 1998.
  25. Large-scale multi-agent-based modeling and simulation of microblogging-based online social network. In Multi-Agent-Based Simulation XIV: International Workshop, pages 17–33, 2014.
  26. General equilibrium: problems and prospects. Routledge, 2003.
  27. Drawing on different disciplines: macroeconomic agent-based models. Journal of Evolutionary Economics, 29:39–66, 2019.
  28. Agent-based modelling in economics. John Wiley & Sons, 2015.
  29. Werner Hildenbrand. On the “law of demand”. Econometrica: Journal of the Econometric Society, pages 997–1019, 1983.
  30. Solving heterogeneous general equilibrium economic models with deep reinforcement learning. arXiv preprint arXiv:2103.16977, 2021.
  31. Optimal monetary policy using reinforcement learning. Technical report, Deutsche Bundesbank Discussion Paper, 2021.
  32. Multiagent reinforcement learning: Theoretical framework and an algorithm. In Proceedings of the Fifteenth International Conference on Machine Learning, pages 242–250, 1998.
  33. Internal Revenue Service. 2022 tax rate schedules. https://www.irs.gov/media/166986, 2022.
  34. Reinforcement learning: A survey. Journal of Artificial Intelligence Research, 4:237–285, 1996.
  35. Monetary policy according to hank. American Economic Review, 108(3):697–743, 2018.
  36. Estimating nonlinear heterogeneous agents models with neural networks. 2022.
  37. Per Krusell and Anthony A Smith, Jr. Income and wealth heterogeneity in the macroeconomy. Journal of political Economy, 106(5):867–896, 1998.
  38. Time to build and aggregate fluctuations. Econometrica: Journal of the Econometric Society, pages 1345–1370, 1982.
  39. Rllib: Abstractions for distributed reinforcement learning. In International Conference on Machine Learning, 2018.
  40. Michael L Littman. Markov games as a framework for multi-agent reinforcement learning. In Machine learning proceedings, pages 157–163. 1994.
  41. Biased or limited: Modeling sub-rational human investors in financial markets. arXiv preprint arXiv:2210.08569, 2022.
  42. Robert E Lucas Jr. Econometric policy evaluation: A critique. In Carnegie-Rochester conference series on public policy, volume 1, pages 19–46, 1976.
  43. A unified approach to interpreting model predictions. In I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett, editors, Advances in Neural Information Processing Systems 30, pages 4765–4774. Curran Associates, Inc., Long Beach, 2017.
  44. Tutorial on agent-based modeling and simulation. In Proceedings of the Winter Simulation Conference, 2005.
  45. Deep learning for solving dynamic economic models. Journal of Monetary Economics, 122:76–101, 2021.
  46. Policy rules and economic performance. Journal of Macroeconomics, 68:103291, 2021.
  47. Generative agents: Interactive simulacra of human behavior. arXiv preprint arXiv:2304.03442, 2023.
  48. Agent-based simulation of a financial market. Physica A: Statistical Mechanics and its Applications, 299(1-2):319–327, 2001.
  49. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347, 2017.
  50. Shocks and frictions in us business cycles: A bayesian dsge approach. American economic review, 97(3):586–606, 2007.
  51. An introduction to agent based modelling and simulation of social processes. Interdisciplinary Description of Complex Systems, 1(1-2):1–8, 2003.
  52. Statista. Per capita consumption of the bread and cereal products in the united states from 2017 to 2027. https://www.statista.com/forecasts/1374278/size-of-the-bread-and-cereal-product-market-in-the-united-states, 2023.
  53. Joseph E Stiglitz. Where modern macroeconomics went wrong. Oxford Review of Economic Policy, 34(1-2):70–106, 2018.
  54. Lars EO Svensson. Monetary policy strategies for the federal reserve. Technical report, National Bureau of Economic Research, 2020.
  55. Simple and robust rules for monetary policy. In Handbook of monetary economics, volume 3, pages 829–859. Elsevier, 2010.
  56. John B Taylor. Discretion versus policy rules in practice. In Carnegie-Rochester conference series on public policy, volume 39, pages 195–214, 1993.
  57. Handbook of computational economics: agent-based computational economics. Elsevier, 2006.
  58. Callum Rhys Tilbury. Reinforcement learning for economic policy: A new frontier? Technical report, 2023.
  59. Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971, 2023.
  60. U.S. Bureau of Labor Statistics. Average hourly and weekly earnings of all employees on private nonfarm payrolls by industry sector, seasonally adjusted. https://www.bls.gov/news.release/empsit.t19.htm, 2023.
  61. U.S. Bureau of Labor Statistics. Average price data (in u.s. dollars), selected items. https://www.bls.gov/charts/consumer-price-index/consumer-price-index-average-price-data.htm, 2023.
  62. U.S. Bureau of Labor Statistics. Employment situation. https://www.bls.gov/news.release/empsit.toc.htm, 2023.
  63. USA.gov. Minimum wage. https://www.usa.gov/minimum-wage, 2023.
  64. Multi-agent robotic systems in collaborative robotics. In Interactive Collaborative Robotics: Third International Conference, pages 270–279, 2018.
  65. Michael Woodford. Convergence in macroeconomics: elements of the new synthesis. American economic journal, 1(1):267–279, 2009.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (4)
  1. Kshama Dwarakanath (11 papers)
  2. Svitlana Vyetrenko (39 papers)
  3. Peyman Tavallali (12 papers)
  4. Tucker Balch (61 papers)
Citations (4)
View on Semantic Scholar
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets