Windformer:Bi-Directional Long-Distance Spatio-Temporal Network For Wind Speed Prediction (2311.14316v1)
Abstract: Wind speed prediction is critical to the management of wind power generation. Due to the large range of wind speed fluctuations and wake effect, there may also be strong correlations between long-distance wind turbines. This difficult-to-extract feature has become a bottleneck for improving accuracy. History and future time information includes the trend of airflow changes, whether this dynamic information can be utilized will also affect the prediction effect. In response to the above problems, this paper proposes Windformer. First, Windformer divides the wind turbine cluster into multiple non-overlapping windows and calculates correlations inside the windows, then shifts the windows partially to provide connectivity between windows, and finally fuses multi-channel features based on detailed and global information. To dynamically model the change process of wind speed, this paper extracts time series in both history and future directions simultaneously. Compared with other current-advanced methods, the Mean Square Error (MSE) of Windformer is reduced by 0.5\% to 15\% on two datasets from NERL.
- “Wind power forecasting using attention-based gated recurrent unit network,” Energy, vol. 196, pp. 117081, 2020.
- “A hybrid attention-based deep learning approach for wind power prediction,” Applied Energy, vol. 323, pp. 119608, 2022.
- “Application of hybrid model based on empirical mode decomposition, novel recurrent neural networks and the arima to wind speed prediction,” Energy Conversion and Management, vol. 233, pp. 113917, 2021.
- “Scene learning: Deep convolutional networks for wind power prediction by embedding turbines into grid space,” Applied energy, vol. 238, pp. 249–257, 2019.
- “U-convolutional model for spatio-temporal wind speed forecasting,” International Journal of Forecasting, vol. 37, no. 2, pp. 949–970, 2021.
- “Deep learning approach for wind speed forecasts at turbine locations in a wind farm,” IET renewable power generation, vol. 14, no. 13, pp. 2416–2428, 2020.
- “Probabilistic spatiotemporal wind speed forecasting based on a variational bayesian deep learning model,” Applied Energy, vol. 260, pp. 114259, 2020.
- “Attention is all you need,” Advances in neural information processing systems, vol. 30, 2017.
- “An image is worth 16x16 words: Transformers for image recognition at scale,” ICLR, 2021.
- “Pvtv2: Improved baselines with pyramid vision transformer,” Computational Visual Media, vol. 8, no. 3, pp. 1–10, 2022.
- “Conformer: Local features coupling global representations for visual recognition,” in Proceedings of the IEEE/CVF international conference on computer vision, 2021, pp. 367–376.
- “Swin transformer: Hierarchical vision transformer using shifted windows,” in Proceedings of the IEEE/CVF international conference on computer vision, 2021, pp. 10012–10022.
- “Delving deeper into convolutional networks for learning video representations,” arXiv preprint arXiv:1511.06432, 2015.
- “Attentional feature fusion,” in Proceedings of the IEEE/CVF winter conference on applications of computer vision, 2021, pp. 3560–3569.
- “Squeeze-and-excitation networks,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 7132–7141.
- “Completion of wind turbine data sets for wind integration studies applying random forests and k-nearest neighbors,” Applied energy, vol. 208, pp. 252–262, 2017.
- “Short-term wind speed prediction using an unscented kalman filter based state-space support vector regression approach,” Applied energy, vol. 113, pp. 690–705, 2014.
- “Regression tree ensembles for wind energy and solar radiation prediction,” Neurocomputing, vol. 326, pp. 151–160, 2019.
- “Mau: A motion-aware unit for video prediction and beyond,” Advances in Neural Information Processing Systems, vol. 34, pp. 26950–26962, 2021.
- “Predrnn: A recurrent neural network for spatiotemporal predictive learning,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 2, pp. 2208–2225, 2022.
- “Simvp: Simpler yet better video prediction,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 3170–3180.