Weather Prediction with Diffusion Guided by Realistic Forecast Processes (2402.06666v1)
Abstract: Weather forecasting remains a crucial yet challenging domain, where recently developed models based on deep learning (DL) have approached the performance of traditional numerical weather prediction (NWP) models. However, these DL models, often complex and resource-intensive, face limitations in flexibility post-training and in incorporating NWP predictions, leading to reliability concerns due to potential unphysical predictions. In response, we introduce a novel method that applies diffusion models (DM) for weather forecasting. In particular, our method can achieve both direct and iterative forecasting with the same modeling framework. Our model is not only capable of generating forecasts independently but also uniquely allows for the integration of NWP predictions, even with varying lead times, during its sampling process. The flexibility and controllability of our model empowers a more trustworthy DL system for the general weather community. Additionally, incorporating persistence and climatology data further enhances our model's long-term forecasting stability. Our empirical findings demonstrate the feasibility and generalizability of this approach, suggesting a promising direction for future, more sophisticated diffusion models without the need for retraining.
- Precipitation nowcasting with generative diffusion models. arXiv preprint arXiv:2308.06733, 2023.
- The quiet revolution of numerical weather prediction. Nature, 525(7567):47–55, 2015.
- Accurate medium-range global weather forecasting with 3d neural networks. Nature, 619(7970):533–538, 2023.
- Bouwer, L. M. Observed and projected impacts from extreme weather events: implications for loss and damage. Loss and damage from climate change: Concepts, methods and policy options, pp. 63–82, 2019.
- Dyffusion: A dynamics-informed diffusion model for spatiotemporal forecasting. arXiv preprint arXiv:2306.01984, 2023.
- Long-term instabilities of deep learning-based digital twins of the climate system: The cause and a solution. arXiv preprint arXiv:2304.07029, 2023.
- Fengwu: Pushing the skillful global medium-range weather forecast beyond 10 days lead. arXiv preprint arXiv:2304.02948, 2023a.
- Fuxi: A cascade machine learning forecasting system for 15-day global weather forecast. arXiv preprint arXiv:2306.12873, 2023b.
- Diffusion posterior sampling for general noisy inverse problems. In The Eleventh International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=OnD9zGAGT0k.
- Cheyenne: HPE/SGI ICE XA System (University Community Computing), 2019.
- Prediff: Precipitation nowcasting with latent diffusion models. arXiv preprint arXiv:2307.10422, 2023.
- Manifold preserving guided diffusion, 2023.
- The era5 global reanalysis. Quarterly Journal of the Royal Meteorological Society, 146(730):1999–2049, 2020.
- Classifier-free diffusion guidance. arXiv preprint arXiv:2207.12598, 2022.
- Denoising diffusion probabilistic models. Advances in neural information processing systems, 33:6840–6851, 2020.
- Keisler, R. Forecasting global weather with graph neural networks. arXiv preprint arXiv:2202.07575, 2022.
- Turbulent flow simulation using autoregressive conditional diffusion models. arXiv preprint arXiv:2309.01745, 2023.
- Learning skillful medium-range global weather forecasting. Science, pp. eadi2336, 2023.
- The essence of chaos. Pure and Applied Geophysics, 147(3):598–599, 1996.
- Dpm-solver++: Fast solver for guided sampling of diffusion probabilistic models. arXiv preprint arXiv:2211.01095, 2022.
- Developing trustworthy ai for weather and climate. Physics Today, 77(1):26–31, 2024.
- Sdedit: Guided image synthesis and editing with stochastic differential equations. arXiv preprint arXiv:2108.01073, 2021.
- Scaling transformer neural networks for skillful and reliable medium-range weather forecasting. arXiv preprint arXiv:2312.03876, 2023.
- Palmer, T. The ecmwf ensemble prediction system: Looking back (more than) 25 years and projecting forward 25 years. Quarterly Journal of the Royal Meteorological Society, 145:12–24, 2019.
- Fourcastnet: A global data-driven high-resolution weather model using adaptive fourier neural operators. arXiv preprint arXiv:2202.11214, 2022.
- Gencast: Diffusion-based ensemble forecasting for medium-range weather. arXiv preprint arXiv:2312.15796, 2023.
- Zero-shot text-to-image generation, 2021.
- Weatherbench: a benchmark data set for data-driven weather forecasting. Journal of Advances in Modeling Earth Systems, 12(11):e2020MS002203, 2020.
- Weatherbench 2: A benchmark for the next generation of data-driven global weather models. arXiv preprint arXiv:2308.15560, 2023.
- Can artificial intelligence-based weather prediction models simulate the butterfly effect? Geophysical Research Letters, 50(20):e2023GL105747, 2023.
- Denoising diffusion implicit models. arXiv:2010.02502, October 2020. URL https://arxiv.org/abs/2010.02502.
- Attention is all you need. In Guyon, I., Luxburg, U. V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., and Garnett, R. (eds.), Advances in Neural Information Processing Systems, volume 30. Curran Associates, Inc., 2017. URL https://proceedings.neurips.cc/paper_files/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf.
- FreeDoM: Training-free energy-guided conditional diffusion model. arXiv:2303.09833, 2023.
- Zhanxiang Hua (3 papers)
- Yutong He (43 papers)
- Chengqian Ma (11 papers)
- Alexandra Anderson-Frey (3 papers)