ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecast (2402.01295v4)
Abstract: Data-driven weather forecast based on ML has experienced rapid development and demonstrated superior performance in the global medium-range forecast compared to traditional physics-based dynamical models. However, most of these ML models struggle with accurately predicting extreme weather, which is related to training loss and the uncertainty of weather systems. Through mathematical analysis, we prove that the use of symmetric losses, such as the Mean Squared Error (MSE), leads to biased predictions and underestimation of extreme values. To address this issue, we introduce Exloss, a novel loss function that performs asymmetric optimization and highlights extreme values to obtain accurate extreme weather forecast. Beyond the evolution in training loss, we introduce a training-free extreme value enhancement module named ExBooster, which captures the uncertainty in prediction outcomes by employing multiple random samples, thereby increasing the hit rate of low-probability extreme events. Combined with an advanced global weather forecast model, extensive experiments show that our solution can achieve state-of-the-art performance in extreme weather prediction, while maintaining the overall forecast accuracy comparable to the top medium-range forecast models.
- Algorithmic hallucinations of near-surface winds: Statistical downscaling with generative adversarial networks to convection-permitting scales. Artificial Intelligence for the Earth Systems, 2(4):e230015, 2023.
- Attribution of extreme weather and climate events overestimated by unreliable climate simulations. Geophysical Research Letters, 43(5):2158–2164, 2016.
- The rise of data-driven weather forecasting. arXiv preprint arXiv:2307.10128, 2023.
- A closer look at the optimization landscapes of generative adversarial networks. arXiv preprint arXiv:1906.04848, 2019.
- Accurate medium-range global weather forecasting with 3d neural networks. Nature, 619(7970):533–538, 2023.
- Minimum sample size determination for generalized extreme value distribution. Communications in Statistics—Simulation and Computation®, 40(1):87–98, 2010.
- Fengwu: Pushing the skillful global medium-range weather forecast beyond 10 days lead. arXiv preprint arXiv:2304.02948, 2023a.
- Fuxi: A cascade machine learning forecasting system for 15-day global weather forecast. arXiv preprint arXiv:2306.12873, 2023b.
- Generative adversarial networks: An overview. IEEE signal processing magazine, 35(1):53–65, 2018.
- Machine learning for numerical weather and climate modelling: a review. Geoscientific Model Development, 16(22):6433–6477, 2023.
- Ensemble methods for meteorological predictions. noaa, 2018.
- Survey on the application of deep learning in extreme weather prediction. Atmosphere, 12(6):661, 2021.
- Farge, M. Wavelet transforms and their applications to turbulence. Annual review of fluid mechanics, 24(1):395–458, 1992.
- Big data analytics in weather forecasting: A systematic review. Archives of Computational Methods in Engineering, 29(2):1247–1275, 2022.
- Extremal dependence indices: Improved verification measures for deterministic forecasts of rare binary events. Weather and Forecasting, 26(5):699–713, 2011.
- Evidence linking arctic amplification to extreme weather in mid-latitudes. Geophysical research letters, 39(6), 2012.
- Probabilistic forecasting. Annual Review of Statistics and Its Application, 1:125–151, 2014.
- Weather forecasting with ensemble methods. Science, 310(5746):248–249, 2005.
- Gray, W. M. Tropical cyclone genesis in the western north pacific. Journal of the Meteorological Society of Japan. Ser. II, 55(5):465–482, 1977.
- Adaptive fourier neural operators: Efficient token mixers for transformers. arXiv preprint arXiv:2111.13587, 2021.
- Hamill, T. M. Interpretation of rank histograms for verifying ensemble forecasts. Monthly Weather Review, 129(3):550–560, 2001.
- A unified view of performance metrics: Translating threshold choice into expected classification loss. Journal of Machine Learning Research, 13:2813–2869, 2012.
- The era5 global reanalysis. Quarterly Journal of the Royal Meteorological Society, 146(730):1999–2049, 2020.
- Denoising diffusion probabilistic models. Advances in neural information processing systems, 33:6840–6851, 2020.
- Extreme heatwave over eastern china in summer 2022: the role of three oceans and local soil moisture feedback. Environmental Research Letters, 18(4):044025, 2023.
- General maximum likelihood empirical bayes estimation of normal means. projecteuclid, 2009.
- Multi-task learning using uncertainty to weigh losses for scene geometry and semantics. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 7482–7491, 2018.
- Extreme value distributions: theory and applications. world scientific, 2000.
- Fourcastnet: Accelerating global high-resolution weather forecasting using adaptive fourier neural operators. In Proceedings of the Platform for Advanced Scientific Computing Conference, pp. 1–11, 2023.
- Learning skillful medium-range global weather forecasting. Science, pp. eadi2336, 2023.
- Swin transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF international conference on computer vision, pp. 10012–10022, 2021.
- Global extreme heat forecasting using neural weather models. Artificial Intelligence for the Earth Systems, 2(1):e220035, 2023.
- Weather forecasting for renewable energy system: A review. Archives of Computational Methods in Engineering, 29(5):2875–2891, 2022.
- MODEL, E. W. Ifs documentation. ecmwf, 2003.
- Cmip x-mos: Improving climate models with extreme model output statistics. arXiv preprint arXiv:2311.03370, 2023.
- Ni, Z. Kunyu: A high-performing global weather model beyond regression losses. arXiv preprint arXiv:2312.08264, 2023.
- U-net transformer: Self and cross attention for medical image segmentation. In Machine Learning in Medical Imaging: 12th International Workshop, MLMI 2021, Held in Conjunction with MICCAI 2021, Strasbourg, France, September 27, 2021, Proceedings 12, pp. 267–276. Springer, 2021.
- Machine learning approaches to extreme weather events forecast in urban areas: Challenges and initial results. Supercomputing Frontiers and Innovations, 9(1):49–73, 2022.
- Neural networks for postprocessing ensemble weather forecasts. Monthly Weather Review, 146(11):3885–3900, 2018.
- Weatherbench: a benchmark data set for data-driven weather forecasting. Journal of Advances in Modeling Earth Systems, 12(11):e2020MS002203, 2020.
- Temperature changes in the mid-and high-latitudes of the southern hemisphere. International Journal of Climatology, 33(8):1948–1963, 2013.
- Ensemble methods for neural network-based weather forecasts. Journal of Advances in Modeling Earth Systems, 13(2), 2021.
- Attention is all you need. Advances in neural information processing systems, 30, 2017.
- Evaluation and prediction of transportation resilience under extreme weather events: A diffusion graph convolutional approach. Transportation research part C: emerging technologies, 115:102619, 2020a.
- Wang, P. denoising-diffusion-pytorch. url, 2020. Accessed: 2020-09-06.
- A comprehensive survey of loss functions in machine learning. Annals of Data Science, pp. 1–26, 2020b.
- Better and faster: Exponential loss for image patch matching. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 4812–4821, 2019.
- Regional forecasting of wind speeds during typhoon landfall in taiwan: A case study of westward-moving typhoons. Atmosphere, 9(4):141, 2018.
- The maximum value distribution in a reverberation chamber. In 2001 IEEE EMC International Symposium. Symposium Record. International Symposium on Electromagnetic Compatibility (Cat. No. 01CH37161), volume 2, pp. 751–756. IEEE, 2001.
- Interaction of cloud dynamics and microphysics during the rapid intensification of super-typhoon nanmadol (2022) based on multi-satellite observations. Geophysical Research Letters, 50(15):e2023GL104541, 2023.
- Diffusion models: A comprehensive survey of methods and applications. ACM Computing Surveys, 56(4):1–39, 2023.
- Using numerical weather model outputs to forecast wind gusts during typhoons. Journal of Wind Engineering and Industrial Aerodynamics, 188:247–259, 2019.
- Detecting region outliers in meteorological data. In Proceedings of the 11th ACM international symposium on Advances in geographic information systems, pp. 49–55, 2003.
- Fuxi-extreme: Improving extreme rainfall and wind forecasts with diffusion model. arXiv preprint arXiv:2310.19822, 2023.