Expert Aggregation for Financial Forecasting (2111.15365v4)
Abstract: Machine learning algorithms dedicated to financial time series forecasting have gained a lot of interest. But choosing between several algorithms can be challenging, as their estimation accuracy may be unstable over time. Online aggregation of experts combine the forecasts of a finite set of models in a single approach without making any assumption about the models. In this paper, a Bernstein Online Aggregation (BOA) procedure is applied to the construction of long-short strategies built from individual stock return forecasts coming from different machine learning models. The online mixture of experts leads to attractive portfolio performances even in environments characterised by non-stationarity. The aggregation outperforms individual algorithms, offering a higher portfolio Sharpe Ratio, lower shortfall, with a similar turnover. Extensions to expert and aggregation specialisations are also proposed to improve the overall mixture on a family of portfolio evaluation metrics.
- TensorFlow: Large-scale machine learning on heterogeneous systems, 2015. URL https://www.tensorflow.org/. Software available from tensorflow.org.
- Making the whole greater than the sum of its parts: A literature review of ensemble methods for financial time series forecasting. Journal of Forecasting, 41(8):1701–1724, 2022. doi: https://doi.org/10.1002/for.2894.
- Fundamentals and exchange rate forecastability with simple machine learning methods. Journal of International Money and Finance, 88:1–24, 2018.
- A. F. Atiya. Why does forecast combination work so well? International Journal of Forecasting, 36(1):197–200, 2020.
- Sequential aggregation of heterogeneous experts for pm10 forecasting. Atmospheric Pollution Research, 7(6):1101–1109, 2016.
- Relative loss bounds for on-line density estimation with the exponential family of distributions. Machine Learning, 43(3):211–246, 2001.
- Forecasting financial time series with ensemble learning. 2010 International Symposium on Intelligent Signal Processing and Communication Systems, pages 1–4, 2010. doi: 10.1109/ISPACS.2010.5704751.
- The combination of forecasts. Journal of the Operational Research Society, 20(4):451–468, 1969.
- D. Blackwell. An analog of the minimax theorem for vector payoffs. Pacific Journal of Mathematics, 6(1):1 – 8, 1956.
- L. Breiman. Bagging predictors. Machine Learning, 24:123–140, 1996.
- L. Breiman. Random forests. Machine Learning, 45:5–32, 2001.
- Diversity creation methods: a survey and categorisation. Information Fusion, 6(1):5–20, 2005a.
- Managing diversity in regression ensembles. Journal of Machine Learning Research, 6(9), 2005b.
- Risk and risk management in the credit card industry. Journal of Banking & Finance, 72:218–239, 2016.
- N. Cesa-Bianchi and G. Lugosi. Potential-based algorithms in on-line prediction and game theory. Machine Learning, 51:239–261, 2003.
- N. Cesa-Bianchi and G. Lugosi. Prediction, Learning, and Games. Cambridge University Press, 2006.
- E. Debry and V. Mallet. Ensemble forecasting with machine learning algorithms for ozone, nitrogen dioxide and pm10 on the prev’air platform. Atmospheric Environment, 91:71–84, 2014.
- Forecasting electricity consumption by aggregating specialized experts. Machine Learning, 90(2):231–260, 2013.
- Experiments with a new boosting algorithm. In ICML, volume 96, pages 148–156. Citeseer, 1996.
- Using and combining predictors that specialize. In Proceedings of The Twenty-ninth Annual ACM Symposium on Theory of Computing, pages 334–343, 1997.
- Dissecting characteristics nonparametrically. The Review of Financial Studies, 33(5):2326–2377, 2020.
- P. Gaillard and Y. Goude. Forecasting electricity consumption by aggregating experts; how to design a good set of experts. Lecture Notes in Statistics: Modeling and Stochastic Learning for Forecasting in High Dimension, 06 2014. doi: 10.1007/978-3-319-18732-7_6.
- A second-order bound with excess losses. In M. F. Balcan, V. Feldman, and C. Szepesvári, editors, Proceedings of The 27th Conference on Learning Theory, volume 35 of Proceedings of Machine Learning Research, pages 176–196, Barcelona, Spain, 13–15 Jun 2014. PMLR.
- Package OPERA, 2016.
- Empirical asset pricing via machine learning. The Review of Financial Studies, 33(5):2223–2273, 2020.
- J. Hannan. Approximation to bayes risk in repeated play. Contributions to the Theory of Games, 3:97–139, 1957.
- Deep learning for finance: deep portfolios. Applied Stochastic Models in Business and Industry, 33(1):3–12, 2017.
- M. Herbster and M. K. Warmuth. Tracking the best expert. Machine Learning, 32(2):151–178, 1998.
- A nonparametric approach to pricing and hedging derivative securities via learning networks. The Journal of Finance, 49(3):851–889, 1994.
- Consumer credit-risk models via machine-learning algorithms. Journal of Banking & Finance, 34(11):2767–2787, 2010.
- Shrinking the cross-section. Journal of Financial Economics, 135(2):271–292, 2020.
- J. Lewellen. The cross section of expected stock returns. Critical Finance Review, 4(1):1–44, 2014.
- Learning multiple stock trading patterns with temporal routing adaptor and optimal transport. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, pages 1017–1026, 2021.
- N. Littlestone and M. K. Warmuth. The weighted majority algorithm. Information and Computation, 108(2):212–261, 1994.
- B. Moritz and T. Zimmermann. Tree-based conditional portfolio sorts: The relation between past and future stock returns. Available at SSRN 2740751, 2016.
- J. Mourtada and O.-A. Maillard. Efficient tracking of a growing number of experts. In International Conference on Algorithmic Learning Theory, pages 517–539. PMLR, 2017.
- J. Nowotarski and R. Weron. Recent advances in electricity price forecasting: A review of probabilistic forecasting. Renewable and Sustainable Energy Reviews, 81:1548–1568, 2018.
- A comprehensive evaluation of ensemble learning for stock-market prediction. Journal of Big Data, 7(1):1–40, 2020.
- Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12:2825–2830, 2011.
- Forecasting: theory and practice. International Journal of Forecasting, 2022.
- International stock return predictability: what is the role of the united states? The Journal of Finance, 68(4):1633–1662, 2013.
- Machine learning for stock selection. Financial Analysts Journal, 75(3):70–88, 2019.
- Deep learning for mortgage risk. Journal of Financial Econometrics, 19(2):313–368, 2021.
- R. E. Schapire. The strength of weak learnability. Machine Learning, 5:197–227, 1990.
- G. Stoltz. Incomplete Information and Internal Regret in Prediction of Individual Sequences. PhD thesis, Université Paris Sud - Paris XI, 2005. URL https://tel.archives-ouvertes.fr/tel-00009759.
- Adaboost-lstm ensemble learning for financial time series forecasting. In Computational Science–ICCS 2018: 18th International Conference, Wuxi, China, June 11–13, 2018 Proceedings, Part III 18, pages 590–597. Springer, 2018.
- Calibrated ensemble forecasts using quantile regression forests and ensemble model output statistics. Monthly Weather Review, 144(6):2375–2393, 2016.
- Online learning with the continuous ranked probability score for ensemble forecasting. Quarterly Journal of the Royal Meteorological Society, 143(702):521–529, 2017.
- V. Vovk. Competitive on-line linear regression. Advances in Neural Information Processing Systems, 10, 1997.
- V. Vovk. A game of prediction with expert advice. Journal of Computer and System Sciences, 56(2):153–173, 1998. ISSN 0022-0000. doi: https://doi.org/10.1006/jcss.1997.1556.
- V. Vovk. On-line regression competitive with reproducing kernel hilbert spaces. In International Conference on Theory and Applications of Models of Computation, pages 452–463. Springer, 2006.
- V. G. Vovk. Aggregating strategies. Proc. of Computational Learning Theory, 1990, page 371–386, 1990.
- Predicting short-term stock prices using ensemble methods and online data sources. Expert Systems with Applications, 112:258–273, 2018.
- O. Wintenberger. Optimal learning with bernstein online aggregation. Machine Learning, 106(1):119–141, 2017.
- WRDS. Wharton research data services. URL https://wrds-web.wharton.upenn.edu/wrds/.
- Deep reinforcement learning for automated stock trading: An ensemble strategy. In Proceedings of the first ACM International Conference on AI in Finance, pages 1–8, 2020.
- Option price forecasting using neural networks. Omega, 28(4):455–466, 2000.