A Network Simulation of OTC Markets with Multiple Agents (2405.02480v1)
Abstract: We present a novel agent-based approach to simulating an over-the-counter (OTC) financial market in which trades are intermediated solely by market makers and agent visibility is constrained to a network topology. Dynamics, such as changes in price, result from agent-level interactions that ubiquitously occur via market maker agents acting as liquidity providers. Two additional agents are considered: trend investors use a deep convolutional neural network paired with a deep Q-learning framework to inform trading decisions by analysing price history; and value investors use a static price-target to determine their trade directions and sizes. We demonstrate that our novel inclusion of a network topology with market makers facilitates explorations into various market structures. First, we present the model and an overview of its mechanics. Second, we validate our findings via comparison to the real-world: we demonstrate a fat-tailed distribution of price changes, auto-correlated volatility, a skew negatively correlated to market maker positioning, predictable price-history patterns and more. Finally, we demonstrate that our network-based model can lend insights into the effect of market-structure on price-action. For example, we show that markets with sparsely connected intermediaries can have a critical point of fragmentation, beyond which the market forms distinct clusters and arbitrage becomes rapidly possible between the prices of different market makers. A discussion is provided on future work that would be beneficial.
- Multi-agent modeling and simulation of a stock market. Investment Management and Financial Innovations, 15(4):123–134, 2018.
- An actor-critic algorithm for sequence prediction. arXiv preprint arXiv:1607.07086, 2016.
- Bruce Bartlett. Hedging under sabr model. Wilmott magazine, 4:2–4, 2006.
- An agent-based model for crisis liquidity dynamics. Office of Financial Research Working Paper, 15(18), 2015.
- Multi-agent reinforcement learning: A review of challenges and applications. Applied Sciences, 11(11):4948, 2021.
- Ralph Grothmann. Multi-agent modelling based on artificial neural networks. PhD thesis, Faculty of Economics, University of Bremen, Germany, 2002.
- Arbitrage-free sabr. Wilmott, 2014(69):60–75, 2014.
- Managing smile risk. Wilmott Magazine, 2002.
- Managing smile risk. The Best of Wilmott, 1:249–296, 2002.
- A survey of multi-agent system approach in risk assessment. In 2018 International Symposium on Agent, Multi-Agent Systems and Robotics (ISAMSR), pages 1–6. IEEE, 2018.
- Takao Terano Hiroshi Takahashi. Agent-based approach to investors’ behavior and asset price fluctuation in financial markets. In Journal of Artificial Societies and Social Simulation. JASSS, 2003.
- From market games to real-world markets. The European Physical Journal B, 20(4):493–501, 2001.
- Application of multi-agent games to the prediction of financial time series. Physica A: Statistical Mechanics and its Applications, 299(1-2):222–227, 2001.
- Investment rules, margin, and market volatility. The Journal of Portfolio Management, 16(1):45–52, 1989.
- Power law distributions for stock prices in financial markets, 2004.
- Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
- The flash crash: High-frequency trading in an electronic market. The Journal of Finance, 72(3):967–998, 2017.
- Equilibrium multi-agent model with heterogeneous views on fundamental risks. SSRN Electronic Journal, 2021.
- A multiagent approach to q𝑞qitalic_q-learning for daily stock trading. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, 37(6):864–877, 2007.
- Moshe Levy. Stock market crashes as social phase transitions. Journal of Economic Dynamics and Control, 32(1):137–155, 2008.
- A multifractal model of asset returns. Cowles Foundation discussion paper, 1997.
- Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602, 2013.
- Human-level control through deep reinforcement learning. Nature, 518(7540):529–533, February 2015.
- Effects of limit order book information level on market stability metrics. Journal of Economic Interaction and Coordination, 12(2):221–247, 2017.
- An agent based model of the e-mini s&p 500 applied to flash crash analysis. In 2012 IEEE Conference on Computational Intelligence for Financial Engineering & Economics (CIFEr), pages 1–8. IEEE, 2012.
- Artificial economic life: a simple model of a stockmarket. Physica D: Nonlinear Phenomena, 75(1-3):264–274, 1994.
- Multi-agent-based order book model of financial markets. Europhysics Letters (EPL), 75(3):510–516, 2006.
- Agent-based models of financial markets. Reports on Progress in Physics, 70(3):409–450, 2007.
- Safe, multi-agent, reinforcement learning for autonomous driving. arXiv preprint arXiv:1610.03295, 2016.
- Mastering the game of go with deep neural networks and tree search. nature, 529(7587):484–489, 2016.
- Mastering the game of go without human knowledge. nature, 550(7676):354–359, 2017.
- Pettingzoo: Gym for multi-agent reinforcement learning. Advances in Neural Information Processing Systems, 34:15032–15043, 2021.
- Leverage causes fat tails and clustered volatility. SSRN Electronic Journal, 2010.
- Applications of multi-agent reinforcement learning in future internet: A comprehensive survey. IEEE Communications Surveys and Tutorials, 2022.
- The value of information in a multi-agent market model. The European Physical Journal B, 55(1):115–120, 2007.
- An agent-based approach to artificial stock market modeling. Procedia Computer Science, 168:161–169, 2020.
- Grandmaster level in starcraft ii using multi-agent reinforcement learning. Nature, 575(7782):350–354, 2019.
- Missaka Warusawitharana. Time-varying volatility and the power law distribution of stock returns, 2016.
- Marco A Wiering et al. Multi-agent reinforcement learning for traffic light control. In Machine Learning: Proceedings of the Seventeenth International Conference (ICML’2000), pages 1151–1158, 2000.
- Uri Wilensky. Netlogo wolf sheep predation model. https://ccl.northwestern.edu/netlogo/models/WolfSheepPredation, 1997. Center for Connected Learning and Computer-Based Modeling, Northwestern University, Evanston, IL.
- Uri Wilensky. Netlogo flocking model. Center for Connected Learning and Computer-Based Modeling, Northwestern University, Evanston, IL, 1998.
- Uri Wilensky. Netlogo. https://ccl.northwestern.edu/netlogo/, 1999. Center for Connected Learning and Computer-Based Modeling, Northwestern University, Evanston, IL.
- Multi-agent reinforcement learning: A selective overview of theories and algorithms. Handbook of Reinforcement Learning and Control, pages 321–384, 2021.
- G. K. Zipf. Human behaviour and the principle of least effort. Addison-Wesley Press, 1949.
- James T. Wilkinson (1 paper)
- Jacob Kelter (1 paper)
- John Chen (19 papers)
- Uri Wilensky (7 papers)