Integrating Tick-level Data and Periodical Signal for High-frequency Market Making (2306.17179v1)
Abstract: We focus on the problem of market making in high-frequency trading. Market making is a critical function in financial markets that involves providing liquidity by buying and selling assets. However, the increasing complexity of financial markets and the high volume of data generated by tick-level trading makes it challenging to develop effective market making strategies. To address this challenge, we propose a deep reinforcement learning approach that fuses tick-level data with periodic prediction signals to develop a more accurate and robust market making strategy. Our results of market making strategies based on different deep reinforcement learning algorithms under the simulation scenarios and real data experiments in the cryptocurrency markets show that the proposed framework outperforms existing methods in terms of profitability and risk management.
- The diversity of high-frequency traders. Journal of Financial Markets, 16(4):741–770, 2013.
- High-frequency trading in a limit order book. Quantitative Finance, 8(3):217–224, 2008.
- Dealing with the inventory risk: a solution to the market making problem. Mathematics and financial economics, 7:477–507, 2013.
- High-frequency market-making with inventory constraints and directional bets. arXiv preprint arXiv:1206.4810, 2012.
- Optimal high-frequency trading with limit and market orders. Quantitative Finance, 13(1):79–94, 2013.
- Algorithmic trading, stochastic control, and mutually exciting processes. SIAM review, 60(3):673–703, 2018.
- Algorithmic trading with model uncertainty. SIAM Journal on Financial Mathematics, 8(1):635–671, 2017.
- An electronic market-maker. 2001.
- Modeling stock order flows and learning market-making from data. 2002.
- Reinforcement learning for high-frequency market making. In ESANN 2018-Proceedings, European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, pages 521–526. Esann, 2018.
- Market making via reinforcement learning. arXiv e-prints, pages arXiv–1804, 2018.
- Effect of market spread over reinforcement learning based market maker. In Machine Learning, Optimization, and Data Science: 5th International Conference, LOD 2019, Siena, Italy, September 10–13, 2019, Proceedings 5, pages 143–153. Springer, 2019.
- Data-driven market-making via model-free learning. In IJCAI, pages 4461–4468, 2020.
- Jonathan Sadighian. Deep reinforcement learning in cryptocurrency market making. arXiv preprint arXiv:1911.08647, 2019.
- Deep reinforcement learning for market making in corporate bonds: beating the curse of dimensionality. Applied Mathematical Finance, 26(5):387–452, 2019.
- Yagna Patel. Optimizing market making using multi-agent reinforcement learning. arXiv preprint arXiv:1812.10252, 2018.
- Market making with signals through deep reinforcement learning. IEEE Access, 9:61611–61622, 2021.
- How and when are high-frequency stock returns predictable? Technical report, National Bureau of Economic Research, 2022.
- Optimal market making in the presence of latency. Quantitative Finance, 20(9):1495–1512, 2020.
- Statistical properties of stock order books: empirical results and models. Quantitative finance, 2(4):251, 2002.
- The information content of an open limit-order book. Journal of Futures Markets: Futures, Options, and Other Derivative Products, 29(1):16–41, 2009.
- The price impact of order book events. Journal of financial econometrics, 12(1):47–88, 2014.
- Christopher John Cornish Hellaby Watkins. Learning from delayed rewards. 1989.
- Human-level control through deep reinforcement learning. nature, 518(7540):529–533, 2015.
- Deep reinforcement learning with double q-learning. In Proceedings of the AAAI conference on artificial intelligence, volume 30, 2016.
- Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347, 2017.
- Trust region policy optimization. In International conference on machine learning, pages 1889–1897. PMLR, 2015.
- Optimal execution strategies in limit order books with general shape functions. Quantitative finance, 10(2):143–157, 2010.
- Price impact of order flow imbalance: Multi-level, cross-sectional and forecasting. arXiv preprint arXiv:2112.13213, 2021.