Postprocessing of point predictions for probabilistic forecasting of day-ahead electricity prices: The benefits of using isotonic distributional regression (2404.02270v2)
Abstract: Operational decisions relying on predictive distributions of electricity prices can result in significantly higher profits compared to those based solely on point forecasts. However, the majority of models developed in both academic and industrial settings provide only point predictions. To address this, we examine three postprocessing methods for converting point forecasts of day-ahead electricity prices into probabilistic ones: Quantile Regression Averaging, Conformal Prediction, and the recently introduced Isotonic Distributional Regression. We find that while the latter demonstrates the most varied behavior, it contributes the most to the ensemble of the three predictive distributions, as measured by Shapley values. Remarkably, the performance of the combination is superior to that of state-of-the-art Distributional Deep Neural Networks over two 4.5-year test periods from the German and Spanish power markets, spanning the COVID pandemic and the war in Ukraine.
- B. Uniejewski and R. Weron, “Regularized quantile regression averaging for probabilistic electricity price forecasting,” Energy Econ., vol. 95, p. 105121, 2021.
- G. Marcjasz, M. Narajewski, R. Weron, and F. Ziel, “Distributional neural networks for electricity price forecasting,” Energy Econ., vol. 125, p. 106843, 2023.
- J. Nowotarski and R. Weron, “Recent advances in electricity price forecasting: A review of probabilistic forecasting,” Renew. Sustain. Energy Rev., vol. 81, pp. 1548–1568, 2018.
- S. Vannitsem et al., “Statistical postprocessing for weather forecasts: Review, challenges, and avenues in a big data world,” Bull. Am. Meteorol. Soc., vol. 102, no. 3, pp. E681–E699, 2021.
- B. Liu, J. Nowotarski, T. Hong, and R. Weron, “Probabilistic load forecasting via Quantile Regression Averaging on sister forecasts,” IEEE Trans. Smart Grid, vol. 8, pp. 730–737, 2017.
- Y. Wang, N. Zhang, Y. Tan, T. Hong, D. Kirschen, and C. Kang, “Combining probabilistic load forecasts,” IEEE Trans. Smart Grid, vol. 10, no. 4, pp. 3664–3674, 2019.
- C. Kath and F. Ziel, “Conformal prediction interval estimation and applications to day-ahead and intraday power markets,” Int. J. Forecasting, vol. 37, no. 2, pp. 777–799, 2021.
- W. Nitka and R. Weron, “Combining predictive distributions of electricity prices. does minimizing the CRPS lead to optimal decisions in day-ahead bidding?” Oper. Res. Decis., vol. 33, pp. 103–116, 2023.
- D. Yang, G. Yang, and B. Liu, “Combining quantiles of calibrated solar forecasts from ensemble numerical weather prediction,” Renew. Energy, vol. 215, p. 118993, 2023.
- G. Shafer and V. Vovk, “A tutorial on conformal prediction,” J. Mach. Learn. Res., vol. 9, p. 371–421, 2008.
- A. Henzi, J. F. Ziegel, and T. Gneiting, “Isotonic distributional regression,” J. R. Stat. Soc. B, vol. 83, no. 5, p. 963–993, 2021.
- T. Gneiting, S. Lerch, and B. Schulz, “Probabilistic solar forecasting: Benchmarks, post-processing, verification,” Solar Energy, vol. 252, pp. 72–80, 2023.
- J. Lago, G. Marcjasz, B. De Schutter, and R. Weron, “Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark,” Appl. Energy, vol. 293, p. 116983, 2021.
- G. Marcjasz, B. Uniejewski, and R. Weron, “Probabilistic electricity price forecasting with NARX networks: Combine point or probabilistic forecasts?” Int. J. Forecasting, vol. 36, no. 2, pp. 466–479, 2020.
- J. Nowotarski and R. Weron, “Computing electricity spot price prediction intervals using quantile regression and forecast averaging,” Comput. Stat., vol. 30, no. 3, pp. 791–803, 2015.
- M. Zaffran, O. Féron, Y. Goude, J. Josse, and A. Dieuleveut, “Adaptive conformal predictions for time series,” Proc. Mach. Learn. Res., vol. 162, pp. 25 834–25 866, 2022.
- A. Henzi, A. Mösching, and L. Dümbgen, “Accelerating the pool-adjacent-violators algorithm for isotonic distributional regression,” Methodol. Comput. Appl. Probab., vol. 24, no. 4, pp. 2633–2645, 2022.
- S. Rasp and S. Lerch, “Neural networks for postprocessing ensemble weather forecasts,” Mon. Weather Rev., vol. 146, pp. 3885–3900, 2018.
- R. Giacomini and H. White, “Tests of conditional predictive ability,” Econometrica, vol. 74, no. 6, pp. 1545–1578, 2006.