Multi-output Ensembles for Multi-step Forecasting (2306.14563v1)
Abstract: This paper studies the application of ensembles composed of multi-output models for multi-step ahead forecasting problems. Dynamic ensembles have been commonly used for forecasting. However, these are typically designed for one-step-ahead tasks. On the other hand, the literature regarding the application of dynamic ensembles for multi-step ahead forecasting is scarce. Moreover, it is not clear how the combination rule is applied across the forecasting horizon. We carried out extensive experiments to analyze the application of dynamic ensembles for multi-step forecasting. We resorted to a case study with 3568 time series and an ensemble of 30 multi-output models. We discovered that dynamic ensembles based on arbitrating and windowing present the best performance according to average rank. Moreover, as the horizon increases, most approaches struggle to outperform a static ensemble that assigns equal weights to all models. The experiments are publicly available in a repository.
- Journal of Econometrics 135(1), 31–53 (2006)
- Journal of the Operational Research Society 20(4), 451–468 (1969)
- The Journal of Machine Learning Research 17(1), 152–161 (2016)
- arXiv preprint arXiv:2202.08485 (2022)
- Information Fusion 6(1), 5–20 (2005)
- Journal of machine learning research 6(Sep), 1621–1650 (2005)
- Machine Learning 109(11), 1997–2028 (2020)
- In: 2017 IEEE International Conference on Data Science and Advanced Analytics (DSAA), pp. 242–251 (2017). DOI 10.1109/DSAA.2017.26
- In: 2017 IEEE International Conference on Data Science and Advanced Analytics (DSAA), pp. 242–251. IEEE (2017)
- Machine Learning 108(6), 913–944 (2019)
- Cambridge University Press, New York, NY, USA (2006)
- Journal of Business & Economic Statistics 4(1), 39–46 (1986)
- International Journal of Data Science and Analytics 7(4), 311–329 (2019)
- International journal of forecasting 21(1), 15–24 (2005)
- International Journal of Forecasting 24(1), 163–169 (2008)
- Kuncheva, L.I.: Classifier ensembles for changing environments. In: International Workshop on Multiple Classifier Systems, pp. 1–15. Springer (2004)
- In: The 41st international ACM SIGIR conference on research & development in information retrieval, pp. 95–104 (2018)
- International Journal of Forecasting 36(1), 54–74 (2020)
- Acm computing surveys (csur) 45(1), 1–40 (2012)
- Journal of the Royal Statistical Society. Series A (General) pp. 131–165 (1974)
- arXiv preprint arXiv:1905.10437 (2019)
- the Journal of machine Learning research 12, 2825–2830 (2011)
- Journal of the American Statistical Association 79(387), 575–583 (1984)
- Journal of Artificial Intelligence Research 70, 683–718 (2021)
- In: Data Mining (ICDM), 2015 IEEE International Conference on, pp. 1003–1008 (2015). DOI 10.1109/ICDM.2015.55
- Sánchez, I.: Adaptive combination of forecasts with application to wind energy. International Journal of Forecasting 24(4), 679–693 (2008)
- In: 2011 IEEE 11th International Conference on Data Mining, pp. 695–704. IEEE (2011)
- Expert systems with applications 39(8), 7067–7083 (2012)
- Springer Berlin Heidelberg, Berlin, Heidelberg (1981)
- In: International Symposium on Experimental Robotics, pp. 703–713. Springer (2016)
- In: Twenty-Ninth AAAI Conference on Artificial Intelligence (2015)
- Wolpert, D.H.: Stacked generalization. Neural networks 5(2), 241–259 (1992)
- Wolpert, D.H.: The lack of a priori distinctions between learning algorithms. Neural computation 8(7), 1341–1390 (1996)
- Wolpert, D.H.: The supervised learning no-free-lunch theorems. Soft computing and industry pp. 25–42 (2002)
- arXiv preprint arXiv:1509.08333 (2015)