Papers
Topics
Authors
Recent
Search
2000 character limit reached

Conformal Prediction for Stochastic Decision-Making of PV Power in Electricity Markets

Published 29 Mar 2024 in cs.LG, cs.SY, eess.SY, and stat.ML | (2403.20149v1)

Abstract: This paper studies the use of conformal prediction (CP), an emerging probabilistic forecasting method, for day-ahead photovoltaic power predictions to enhance participation in electricity markets. First, machine learning models are used to construct point predictions. Thereafter, several variants of CP are implemented to quantify the uncertainty of those predictions by creating CP intervals and cumulative distribution functions. Optimal quantity bids for the electricity market are estimated using several bidding strategies under uncertainty, namely: trust-the-forecast, worst-case, Newsvendor and expected utility maximization (EUM). Results show that CP in combination with k-nearest neighbors and/or Mondrian binning outperforms its corresponding linear quantile regressors. Using CP in combination with certain bidding strategies can yield high profit with minimal energy imbalance. In concrete, using conformal predictive systems with k-nearest neighbors and Mondrian binning after random forest regression yields the best profit and imbalance regardless of the decision-making strategy. Combining this uncertainty quantification method with the EUM strategy with conditional value at risk (CVaR) can yield up to 93\% of the potential profit with minimal energy imbalance.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (25)
  1. EPEX SPOT, “The European Power Exchange,” 2023. [Online]. Available: https://www.epexspot.com/en
  2. M. N. Akhter, S. Mekhilef, H. Mokhlis, and N. Mohamed Shah, “Review on forecasting of photovoltaic power generation based on machine learning and metaheuristic techniques,” IET Renewable Power Generation, vol. 13, no. 7, pp. 1009–1023, 3 2019.
  3. D. Yang, J. Kleissl, C. A. Gueymard, H. T. Pedro, and C. F. Coimbra, “History and trends in solar irradiance and pv power forecasting: A preliminary assessment and review using text mining,” Solar Energy, vol. 168, pp. 60–101, 2018.
  4. D. W. Van der Meer, J. Widén, and J. Munkhammar, “Review on probabilistic forecasting of photovoltaic power production and electricity consumption,” Renewable and Sustainable Energy Reviews, vol. 81, pp. 1484–1512, 2018.
  5. A. N. Angelopoulos and S. Bates, “A gentle introduction to conformal prediction and distribution-free uncertainty quantification,” 2021. [Online]. Available: https://arxiv.org/abs/2107.07511
  6. C. Johnstone and B. Cox, “Conformal uncertainty sets for robust optimization,” in Conformal and Probabilistic Prediction and Applications.   PMLR, 2021, pp. 72–90.
  7. M. Mendil, L. Mossina, M. Nabhan, and K. Pasini, “Robust gas demand forecasting with conformal prediction,” in Proceedings of the Eleventh Symposium on Conformal and Probabilistic Prediction with Applications, ser. Proceedings of Machine Learning Research, U. Johansson, H. Boström, K. An Nguyen, Z. Luo, and L. Carlsson, Eds., vol. 179.   PMLR, 24–26 Aug 2022, pp. 169–187. [Online]. Available: https://proceedings.mlr.press/v179/mendil22a.html
  8. Y. Grushka-Cockayne and V. R. R. Jose, “Combining prediction intervals in the m4 competition,” International Journal of Forecasting, vol. 36, no. 1, pp. 178–185, 2020.
  9. M. Jain, T. AlSkaif, and S. Dev, “Are deep learning models more effective against traditional models for load demand forecasting?” in 2022 International Conference on Smart Energy Systems and Technologies (SEST), 2022, pp. 1–6.
  10. L. Visser, T. AlSkaif, and W. van Sark, “Operational day-ahead solar power forecasting for aggregated pv systems with a varying spatial distribution,” Renewable Energy, vol. 183, pp. 267–282, 2022.
  11. L. Grinsztajn, E. Oyallon, and G. Varoquaux, “Why do tree-based models still outperform deep learning on typical tabular data?” Advances in neural information processing systems, vol. 35, pp. 507–520, 2022.
  12. U. Johansson, H. Boström, T. Löfström, and H. Linusson, “Regression conformal prediction with random forests,” Machine learning, vol. 97, pp. 155–176, 2014.
  13. H. Boström, U. Johansson, and T. Löfström, “Mondrian conformal predictive distributions,” in Conformal and Probabilistic Prediction and Applications.   PMLR, 2021, pp. 24–38.
  14. H. Boström, “Conformal Regressors and Predictive Systems – a Gentle Introduction,” 2022. [Online]. Available: https://shorturl.at/mwHQ7
  15. K. J. Arrow, T. Harris, and J. Marschak, “Optimal inventory policy,” Econometrica: Journal of the Econometric Society, pp. 250–272, 1951.
  16. M. Zugno, T. Jónsson, and P. Pinson, “Trading wind energy on the basis of probabilistic forecasts both of wind generation and of market quantities,” Wind Energy, vol. 16, no. 6, pp. 909–926, 2013.
  17. R. T. Rockafellar and S. Uryasev, “Optimization of conditional value-at-risk,” The Journal of Risk, vol. 2, no. 3, pp. 21–41, 2000.
  18. L. R. Visser, B. Elsinga, T. A. AlSkaif, and W. G. J. H. M. van Sark, “Open-source quality control routine and multi-year power generation data of 175 pv systems,” Journal of Renewable and Sustainable Energy, vol. 14, no. 4, p. 043501, 2022.
  19. T. AlSkaif, S. Dev, L. Visser, M. Hossari, and W. van Sark, “A systematic analysis of meteorological variables for pv output power estimation,” Renewable Energy, vol. 153, pp. 12–22, 2020.
  20. W. F. Holmgren, C. W. Hansen, and M. A. Mikofski, “pvlib python: A python package for modeling solar energy systems,” Journal of Open Source Software, vol. 3, no. 29, p. 884, 2018.
  21. ECMWF, “European centre for medium-range weather forecasts, ecmwf,” 2020.
  22. ENTSO-E, “Prices of Activated Balancing Energy Legacy,” 2023. [Online]. Available: https://shorturl.at/iopD3
  23. TenneT, “Export data,” 2023. [Online]. Available: https://shorturl.at/bcvQS
  24. H. Boström, “crepes: a python package for generating conformal regressors and predictive systems,” Conformal and Probabilistic Prediction and Applications, vol. 179, pp. 1–19, 2022.
  25. J. Bracher, E. Ray, T. Gneiting, and N. Reich, “Evaluating epidemic forecasts in an interval format,” PLOS Computational Biology, vol. 17, p. e1008618, 02 2021.

Summary

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 2 tweets with 29 likes about this paper.