Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
153 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Applying Reinforcement Learning to Option Pricing and Hedging (2310.04336v1)

Published 6 Oct 2023 in q-fin.CP, cs.CE, and cs.LG

Abstract: This thesis provides an overview of the recent advances in reinforcement learning in pricing and hedging financial instruments, with a primary focus on a detailed explanation of the Q-Learning Black Scholes approach, introduced by Halperin (2017). This reinforcement learning approach bridges the traditional Black and Scholes (1973) model with novel artificial intelligence algorithms, enabling option pricing and hedging in a completely model-free and data-driven way. This paper also explores the algorithm's performance under different state variables and scenarios for a European put option. The results reveal that the model is an accurate estimator under different levels of volatility and hedging frequency. Moreover, this method exhibits robust performance across various levels of option's moneyness. Lastly, the algorithm incorporates proportional transaction costs, indicating diverse impacts on profit and loss, affected by different statistical properties of the state variables.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (54)
  1. Dynamic programming. Princeton University Press, Princeton, USA.
  2. Eye of the hurricane: An autobiography. World Scientific, Singapore.
  3. BIS, 2022a. BIS Quarterly review. https://www.bis.org/publ/qtrpdf/r_qt2212.pdf/. Online; accessed 12-December-2022.
  4. BIS, 2022b. OTC derivatives statistics at end-June 2022. https://www.bis.org/publ/otc_hy2211.pdf/. Online; accessed 12-December-2022.
  5. Arbitrage theory in continuous time. Oxford University Press, Oxford, UK.
  6. The pricing of options and corporate liabilities. Journal of Political Economy 81, 637–654.
  7. Statistical control by monitoring and adjustment. John Wiley & Sons, Hoboken, USA.
  8. Deep hedging. Quantitative Finance 19, 1271–1291.
  9. Deep hedging: Hedging derivatives under generic market frictions using reinforcement learning. Swiss Finance Institute Research Paper 19-80.
  10. Gamma and vega hedging using deep distributional reinforcement learning. arXiv preprint:2205.05614 .
  11. Deep hedging of derivatives using reinforcement learning. The Journal of Financial Data Science 3, 10–27.
  12. Open source cross-sectional asset pricing. Critical Finance Review 11, 207–264.
  13. Asset pricing: Revised edition. Princeton University Press, Princeton, USA.
  14. Option pricing: A simplified approach. Journal of Financial Economics 7, 229–263.
  15. DDV, 2022. Börsenumsätze in derivativen Wertpapieren. https://www.derivateverband.de/DEU/Statistiken/Boersenumsaetze/. Online; accessed 14-December-2022.
  16. Machine learning in finance. Springer, Cham, Switzerland.
  17. Deep reinforcement learning for option replication and hedging. The Journal of Financial Data Science 2, 44–57.
  18. Tree-based batch mode reinforcement learning. Journal of Machine Learning Research 6, 503–556.
  19. Artificial intelligence and machine learning in finance: Identifying foundations, themes, and research clusters from bibliometric analysis. Journal of Behavioral and Experimental Finance 32, 100577.
  20. Mainstream science on intelligence: An editorial with 52 signatories, history, and bibliography. Intelligence 24, 13–23.
  21. Applications of least-squares regressions to pricing and hedging of financial derivatives. Ph.D. thesis. Technische Universität München.
  22. Man versus machine: On artificial intelligence and hedge funds performance. Applied Economics 54, 4632–4646.
  23. QLBS: Q-Learner in the Black-Scholes (-Merton) worlds. arXiv preprint:1712.04609 .
  24. The QLBS Q-Learner goes NuQLear: Fitted Q iteration, inverse RL, and option portfolios. Quantitative Finance 19, 1543–1553.
  25. Double Q-learning. Advances in Neural Information Processing Systems 23, 2613–2621.
  26. A closed-form solution for options with stochastic volatility with applications to bond and currency options. The Review of Financial Studies 6, 327–343.
  27. Replicating anomalies. The Review of Financial Studies 33, 2019–2133.
  28. The pricing of options on assets with stochastic volatilities. The Journal of Finance 42, 281–300.
  29. Optimal delta hedging for options. Journal of Banking & Finance 82, 180–190.
  30. Options, futures, and other derivatives. Prentice Hall, Englewood Cliffs, USA.
  31. Dynamic replication and hedging: A reinforcement learning approach. The Journal of Financial Data Science 1, 159–171.
  32. Batch reinforcement learning, in: Reinforcement learning. Springer, pp. 45–73.
  33. Deep Reinforcement Learning. Das umfassende Praxis-Handbuch: Moderne Algorithmen für Chatbots, Robotik, diskrete Optimierung und Web-Automatisierung inkl. Multiagenten-Methoden. MITP-Verlags GmbH & Co. KG, Frechen, Germany.
  34. Option pricing and replication with transactions costs. The Journal of Finance 40, 1283–1301.
  35. Offline reinforcement learning: Tutorial, review, and perspectives on open problems. arXiv preprint: 2005.01643 .
  36. Valuing american options by simulation: A simple least-squares approach. The Review of Financial Studies 14, 113–147.
  37. What is artificial intelligence. url: http://jmc.stanford.edu/articles/whatisai/whatisai.pdf.
  38. Theory of rational option pricing. The Bell Journal of Economics and Management Science 4, 141–183.
  39. Playing atari with deep reinforcement learning. arXiv preprint:1312.5602 .
  40. A generalization error for Q-learning. Journal of Machine Learning Research 6, 1073–1097.
  41. Deep hedging: Continuous reinforcement learning for hedging of general portfolios across multiple risk aversions, in: 3rd ACM International Conference on AI in Finance, pp. 361–368.
  42. Neural fitted Q iteration – first experiences with a data efficient neural reinforcement learning method, in: European Conference on Machine Learning, Springer. pp. 317–328.
  43. Artificial Intelligence: A Modern Approach. Prentice Hall, Upper Saddle River, USA.
  44. Lectures on reinforcement learning. url: https://www.davidsilver.uk/teaching/.
  45. Mastering the game of go with deep neural networks and tree search. Nature 529, 484–489.
  46. Mastering the game of go without human knowledge. Nature 550, 354–359.
  47. Reward is enough. Artificial Intelligence 299, 103535.
  48. Learning to predict by the methods of temporal differences. Machine Learning 3, 9–44.
  49. Reinforcement learning: An introduction. MIT press, Cambridge, USA; London, UK.
  50. On average versus discounted reward temporal-difference learning. Machine Learning 49, 179–191.
  51. Computing machinery and intelligence. Mind 59, 433–460.
  52. Learning from delayed rewards. Ph.D. thesis. King’s College.
  53. Q-learning. Machine Learning 8, 279–292.
  54. Catecholamine theories of reward: A critical review. Brain Research 152, 215–247.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now