Conformal Prediction for Stochastic Decision-Making of PV Power in Electricity Markets
Abstract: This paper studies the use of conformal prediction (CP), an emerging probabilistic forecasting method, for day-ahead photovoltaic power predictions to enhance participation in electricity markets. First, machine learning models are used to construct point predictions. Thereafter, several variants of CP are implemented to quantify the uncertainty of those predictions by creating CP intervals and cumulative distribution functions. Optimal quantity bids for the electricity market are estimated using several bidding strategies under uncertainty, namely: trust-the-forecast, worst-case, Newsvendor and expected utility maximization (EUM). Results show that CP in combination with k-nearest neighbors and/or Mondrian binning outperforms its corresponding linear quantile regressors. Using CP in combination with certain bidding strategies can yield high profit with minimal energy imbalance. In concrete, using conformal predictive systems with k-nearest neighbors and Mondrian binning after random forest regression yields the best profit and imbalance regardless of the decision-making strategy. Combining this uncertainty quantification method with the EUM strategy with conditional value at risk (CVaR) can yield up to 93\% of the potential profit with minimal energy imbalance.
- EPEX SPOT, “The European Power Exchange,” 2023. [Online]. Available: https://www.epexspot.com/en
- M. N. Akhter, S. Mekhilef, H. Mokhlis, and N. Mohamed Shah, “Review on forecasting of photovoltaic power generation based on machine learning and metaheuristic techniques,” IET Renewable Power Generation, vol. 13, no. 7, pp. 1009–1023, 3 2019.
- D. Yang, J. Kleissl, C. A. Gueymard, H. T. Pedro, and C. F. Coimbra, “History and trends in solar irradiance and pv power forecasting: A preliminary assessment and review using text mining,” Solar Energy, vol. 168, pp. 60–101, 2018.
- D. W. Van der Meer, J. Widén, and J. Munkhammar, “Review on probabilistic forecasting of photovoltaic power production and electricity consumption,” Renewable and Sustainable Energy Reviews, vol. 81, pp. 1484–1512, 2018.
- A. N. Angelopoulos and S. Bates, “A gentle introduction to conformal prediction and distribution-free uncertainty quantification,” 2021. [Online]. Available: https://arxiv.org/abs/2107.07511
- C. Johnstone and B. Cox, “Conformal uncertainty sets for robust optimization,” in Conformal and Probabilistic Prediction and Applications. PMLR, 2021, pp. 72–90.
- M. Mendil, L. Mossina, M. Nabhan, and K. Pasini, “Robust gas demand forecasting with conformal prediction,” in Proceedings of the Eleventh Symposium on Conformal and Probabilistic Prediction with Applications, ser. Proceedings of Machine Learning Research, U. Johansson, H. Boström, K. An Nguyen, Z. Luo, and L. Carlsson, Eds., vol. 179. PMLR, 24–26 Aug 2022, pp. 169–187. [Online]. Available: https://proceedings.mlr.press/v179/mendil22a.html
- Y. Grushka-Cockayne and V. R. R. Jose, “Combining prediction intervals in the m4 competition,” International Journal of Forecasting, vol. 36, no. 1, pp. 178–185, 2020.
- M. Jain, T. AlSkaif, and S. Dev, “Are deep learning models more effective against traditional models for load demand forecasting?” in 2022 International Conference on Smart Energy Systems and Technologies (SEST), 2022, pp. 1–6.
- L. Visser, T. AlSkaif, and W. van Sark, “Operational day-ahead solar power forecasting for aggregated pv systems with a varying spatial distribution,” Renewable Energy, vol. 183, pp. 267–282, 2022.
- L. Grinsztajn, E. Oyallon, and G. Varoquaux, “Why do tree-based models still outperform deep learning on typical tabular data?” Advances in neural information processing systems, vol. 35, pp. 507–520, 2022.
- U. Johansson, H. Boström, T. Löfström, and H. Linusson, “Regression conformal prediction with random forests,” Machine learning, vol. 97, pp. 155–176, 2014.
- H. Boström, U. Johansson, and T. Löfström, “Mondrian conformal predictive distributions,” in Conformal and Probabilistic Prediction and Applications. PMLR, 2021, pp. 24–38.
- H. Boström, “Conformal Regressors and Predictive Systems – a Gentle Introduction,” 2022. [Online]. Available: https://shorturl.at/mwHQ7
- K. J. Arrow, T. Harris, and J. Marschak, “Optimal inventory policy,” Econometrica: Journal of the Econometric Society, pp. 250–272, 1951.
- M. Zugno, T. Jónsson, and P. Pinson, “Trading wind energy on the basis of probabilistic forecasts both of wind generation and of market quantities,” Wind Energy, vol. 16, no. 6, pp. 909–926, 2013.
- R. T. Rockafellar and S. Uryasev, “Optimization of conditional value-at-risk,” The Journal of Risk, vol. 2, no. 3, pp. 21–41, 2000.
- L. R. Visser, B. Elsinga, T. A. AlSkaif, and W. G. J. H. M. van Sark, “Open-source quality control routine and multi-year power generation data of 175 pv systems,” Journal of Renewable and Sustainable Energy, vol. 14, no. 4, p. 043501, 2022.
- T. AlSkaif, S. Dev, L. Visser, M. Hossari, and W. van Sark, “A systematic analysis of meteorological variables for pv output power estimation,” Renewable Energy, vol. 153, pp. 12–22, 2020.
- W. F. Holmgren, C. W. Hansen, and M. A. Mikofski, “pvlib python: A python package for modeling solar energy systems,” Journal of Open Source Software, vol. 3, no. 29, p. 884, 2018.
- ECMWF, “European centre for medium-range weather forecasts, ecmwf,” 2020.
- ENTSO-E, “Prices of Activated Balancing Energy Legacy,” 2023. [Online]. Available: https://shorturl.at/iopD3
- TenneT, “Export data,” 2023. [Online]. Available: https://shorturl.at/bcvQS
- H. Boström, “crepes: a python package for generating conformal regressors and predictive systems,” Conformal and Probabilistic Prediction and Applications, vol. 179, pp. 1–19, 2022.
- J. Bracher, E. Ray, T. Gneiting, and N. Reich, “Evaluating epidemic forecasts in an interval format,” PLOS Computational Biology, vol. 17, p. e1008618, 02 2021.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.