Electrical Load Forecasting Model Using Hybrid LSTM Neural Networks with Online Correction (2403.03898v1)
Abstract: Accurate electrical load forecasting is of great importance for the efficient operation and control of modern power systems. In this work, a hybrid long short-term memory (LSTM)-based model with online correction is developed for day-ahead electrical load forecasting. Firstly, four types of features are extracted from the original electrical load dataset, including the historical time series, time index features, historical statistical features, and similarity features. Then, a hybrid LSTM-based electrical load forecasting model is designed, where an LSTM neural network block and a fully-connected neural network block are integrated that can model both temporal features (historical time series) and non-temporal features (the rest features). A gradient regularization-based offline training algorithm and an output layer parameter fine-tuning-based online model correction method are developed to enhance the model's capabilities to defend against disturbance and adapt to the latest load data distribution, thus improving the forecasting accuracy. At last, extensive experiments are carried out to validate the effectiveness of the proposed electrical load forecasting strategy with superior accuracy compared with commonly used forecasting models.
- B. F. Hobbs, S. Jitprapaikulsarn, S. Konda, V. Chankong, K. A. Loparo, and D. J. Maratukulam, “Analysis of the value for unit commitment of improved load forecasts,” IEEE Trans. Power Syst., vol. 14, no. 4, pp. 1342–1348, 1999.
- C. Kuster, Y. Rezgui, and M. Mourshed, “Electrical load forecasting models: A critical systematic review,” Sust. Cities Soc., vol. 35, pp. 257–270, 2017.
- N. Amjady, “Short-term hourly load forecasting using time-series modeling with peak load estimation capability,” IEEE Trans. Power Syst., vol. 16, no. 3, pp. 498–505, 2001.
- B. Liu, J. Nowotarski, T. Hong, and R. Weron, “Probabilistic load forecasting via quantile regression averaging on sister forecasts,” IEEE Trans. Smart Grid, vol. 8, no. 2, pp. 730–737, 2017.
- Y. Wang, J. Chen, X. Chen, X. Zeng, Y. Kong, S. Sun, Y. Guo, and Y. Liu, “Short-term load forecasting for industrial customers based on TCN-lightGBM,” IEEE Trans. Power Syst., vol. 36, no. 3, pp. 1984–1997, 2020.
- P.-H. Kuo and C.-J. Huang, “A high precision artificial neural networks model for short-term energy load forecasting,” Energies, vol. 11, no. 1, 2018.
- H. Jiang, Y. Zhang, E. Muljadi, J. J. Zhang, and D. W. Gao, “A short-term and high-resolution distribution system load forecasting approach using support vector regression with hybrid parameters optimization,” IEEE Trans. Smart Grid, vol. 9, no. 4, pp. 3341–3350, 2018.
- T. Senjyu, H. Takara, K. Uezato, and T. Funabashi, “One-hour-ahead load forecasting using neural network,” IEEE Trans. Power Syst., vol. 17, no. 1, pp. 113–118, 2002.
- S. Jurado, Àngela Nebot, F. Mugica, and N. Avellana, “Hybrid methodologies for electricity load forecasting: Entropy-based feature selection with machine learning and soft computing techniques,” Energy, vol. 86, pp. 276–291, 2015.
- W. Kong, Z. Y. Dong, Y. Jia, D. J. Hill, Y. Xu, and Y. Zhang, “Short-term residential load forecasting based on LSTM recurrent neural network,” IEEE Trans. Smart Grid, vol. 10, no. 1, pp. 841–851, 2019.
- T. Bashir, C. Haoyong, M. F. Tahir, and Z. Liqiang, “Short term electricity load forecasting using hybrid prophet-LSTM model optimized by BPNN,” Energy Rep., vol. 8, pp. 1678–1686, 2022.
- Elia. Total load on the belgian grid. [Online]. Available: https://opendata.elia.be/explore/dataset/ods001/information
- Energinet. Production and consumption - settlement. [Online]. Available: https://www.energidataservice.dk/tso-electricity/ProductionConsumptionSettlement
- Statnett. Data from the power system. [Online]. Available: https://www.statnett.no/en/for-stakeholders-in-the-power-industry/data-from-the-power-system
- Z. Lv, H. Ding, L. Wang, and Q. Zou, “A convolutional neural network using dinucleotide one-hot encoder for identifying dna n6-methyladenine sites in the rice genome,” Neurocomputing, vol. 422, pp. 214–221, 2021.
- G. Dudek, “Pattern similarity-based methods for short-term load forecasting – part 1: Principles,” Appl. Soft. Comput., vol. 37, pp. 277–287, 2015.
- X. Huang, Q. Li, Y. Tai, Z. Chen, J. Zhang, J. Shi, B. Gao, and W. Liu, “Hybrid deep neural model for hourly solar irradiance forecasting,” Renew. Energy, vol. 171, pp. 1041–1060, 2021.
- T.-Y. Ma and S. Faye, “Multistep electric vehicle charging station occupancy prediction using hybrid LSTM neural networks,” Energy, vol. 244, p. 123217, 2022.
- S. Hochreiter and J. Schmidhuber, “Long Short-Term Memory,” Neural Comput., vol. 9, no. 8, pp. 1735–1780, 11 1997.
- D.-H. Pham and A.-C. Le, “Exploiting multiple word embeddings and one-hot character vectors for aspect-based sentiment analysis,” Int. J. Approx. Reasoning, vol. 103, pp. 1–10, 2018.
- A. G. Schwing and R. Urtasun, “Fully connected deep structured networks,” arXiv preprint arXiv:1503.02351, 2015.
- A. Ross and F. Doshi-Velez, “Improving the adversarial robustness and interpretability of deep neural networks by regularizing their input gradients,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32, no. 1, 2018.
- T. Miyato, A. M. Dai, and I. Goodfellow, “Adversarial training methods for semi-supervised text classification,” arXiv preprint arXiv:1605.07725, 2016.
- D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014.
- Z. Li and D. Hoiem, “Learning without forgetting,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 40, no. 12, pp. 2935–2947, 2018.
- T.-Y. Kim and S.-B. Cho, “Predicting residential energy consumption using CNN-LSTM neural networks,” Energy, vol. 182, pp. 72–81, 2019.
- H. Zang, R. Xu, L. Cheng, T. Ding, L. Liu, Z. Wei, and G. Sun, “Residential load forecasting based on LSTM fusing self-attention mechanism with pooling,” Energy, vol. 229, p. 120682, 2021.
- L. Han, Y. Peng, Y. Li, B. Yong, Q. Zhou, and L. Shu, “Enhanced deep networks for short-term and medium-term load forecasting,” IEEE Access, vol. 7, pp. 4045–4055, 2018.
- R. Zhu, W. Liao, and Y. Wang, “Short-term prediction for wind power based on temporal convolutional network,” Energy Rep., vol. 6, pp. 424–429, 2020.
- A. Ahmad, N. Javaid, M. Guizani, N. Alrajeh, and Z. A. Khan, “An accurate and fast converging short-term load forecasting model for industrial applications in a smart grid,” IEEE Trans. Ind. Informat., vol. 13, no. 5, pp. 2587–2596, 2017.