DiffObs: Generative Diffusion for Global Forecasting of Satellite Observations (2404.06517v1)
Abstract: This work presents an autoregressive generative diffusion model (DiffObs) to predict the global evolution of daily precipitation, trained on a satellite observational product, and assessed with domain-specific diagnostics. The model is trained to probabilistically forecast day-ahead precipitation. Nonetheless, it is stable for multi-month rollouts, which reveal a qualitatively realistic superposition of convectively coupled wave modes in the tropics. Cross-spectral analysis confirms successful generation of low frequency variations associated with the Madden--Julian oscillation, which regulates most subseasonal to seasonal predictability in the observed atmosphere, and convectively coupled moist Kelvin waves with approximately correct dispersion relationships. Despite secondary issues and biases, the results affirm the potential for a next generation of global diffusion models trained on increasingly sparse, and increasingly direct and differentiated observations of the world, for practical applications in subseasonal and climate prediction.
- Brian DO Anderson. Reverse-time diffusion equation models. Stochastic Processes and their Applications, 12(3):313–326, 1982.
- Rainnet v1. 0: a convolutional neural network for radar-based precipitation nowcasting. Geoscientific Model Development, 13(6):2631–2644, 2020.
- Pangu-weather: A 3d high-resolution model for fast and accurate global weather forecast. arXiv preprint arXiv:2211.02556, 2022.
- Fengwu: Pushing the skillful global medium-range weather forecast beyond 10 days lead. arXiv preprint arXiv:2304.02948, 2023.
- Predicting the cloud patterns of the Madden-Julian oscillation through a low-order nonlinear stochastic model. Geophys. Res. Lett., August 2014. ISSN 0094-8276, 1944-8007. doi: 10.1002/2014GL060876.
- Prediff: Precipitation nowcasting with latent diffusion models. arXiv preprint arXiv:2307.10422, 2023.
- The era5 global reanalysis. Quarterly Journal of the Royal Meteorological Society, 146(730):1999–2049, 2020.
- The global precipitation measurement mission. Bulletin of the American meteorological Society, 95(5):701–722, 2014.
- Ernest Hovmöller. The trough-and-ridge diagram. Tellus, 1(2):62–66, 1949.
- Nasa global precipitation measurement (gpm) integrated multi-satellite retrievals for gpm (imerg). Algorithm theoretical basis document (ATBD) version, 4(26):30, 2015.
- Gpm imerg final precipitation l3 half hourly 0.1 degree x 0.1 degree v06. Greenbelt, MD, Goddard Earth Sciences Data and Information Services Center (GES DISC), Accessed: March 19, 2022., 2019. 10.5067/GPM/IMERG/3B-HH/06.
- Estimation of non-normalized statistical models by score matching. Journal of Machine Learning Research, 6(4), 2005.
- Elucidating the design space of diffusion-based generative models. Advances in Neural Information Processing Systems, 35:26565–26577, 2022.
- Zonal and vertical structure of the madden–julian oscillation. Journal of the atmospheric sciences, 62(8):2790–2809, 2005.
- The tropical rainfall measuring mission (trmm) sensor package. Journal of atmospheric and oceanic technology, 15(3):809–817, 1998.
- Graphcast: Learning skillful medium-range global weather forecasting. arXiv preprint arXiv:2212.12794, 2022.
- Predictability and forecasting. Springer, 2005.
- Latent diffusion models for generative precipitation nowcasting with accurate uncertainty quantification. arXiv preprint arXiv:2304.12891, 2023.
- Seeds: Emulation of weather forecast ensembles with diffusion models. arXiv preprint arXiv:2306.14066, 2023.
- Observations of the 40–50-day tropical oscillation—a review. Monthly weather review, 122(5):814–837, 1994.
- Michael Maier-Gerber. A python package for the construction of the wheeler–kiladis space-time spectra. https://github.com/mmaiergerber/wk_spectra, 2018.
- Residual diffusion modeling for km-scale atmospheric downscaling. arXiv preprint arXiv:2309.15214, 2024.
- Forecasting tropical cyclones with cascaded diffusion models. arXiv preprint arXiv:2310.01690, 2023.
- Fourcastnet: A global data-driven high-resolution weather model using adaptive fourier neural operators. arXiv preprint arXiv:2202.11214, 2022.
- Gencast: Diffusion-based ensemble forecasting for medium-range weather. arXiv preprint arXiv:2312.15796, 2023.
- David A Randall. Beyond deadlock. Geophysical Research Letters, 40(22):5970–5976, 2013.
- Skilful precipitation nowcasting using deep generative models of radar. Nature, 597(7878):672–677, 2021.
- Nigel Roberts. Assessing the spatial and temporal variation in the skill of precipitation forecasts from an nwp model. Meteorological Applications: A journal of forecasting, practical applications, training techniques and modelling, 15(1):163–169, 2008.
- Scale-selective verification of rainfall accumulations from high-resolution forecasts of convective events. Monthly Weather Review, 136(1):78–97, 2008.
- Score-based generative modeling through stochastic differential equations. arXiv preprint arXiv:2011.13456, 2020.
- Observations of a convectively coupled kelvin wave in the eastern pacific itcz. Journal of the Atmospheric Sciences, 59(1):30–53, 2002.
- Ace: A fast, skillful learned global atmospheric model for climate prediction. arXiv preprint arXiv:2310.02074, 2023.
- Can machines learn to predict weather? using deep learning to predict gridded 500-hpa geopotential height from historical weather data. Journal of Advances in Modeling Earth Systems, 11(8):2680–2693, 2019.
- Convectively coupled equatorial waves: Analysis of clouds and temperature in the wavenumber–frequency domain. Journal of the Atmospheric Sciences, 56(3):374–399, 1999.
- Stratospheric wave disturbances propagating over the equatorial pacific. Journal of the Meteorological Society of Japan. Ser. II, 44(5):291–294, 1966.
- Four theories of the madden-julian oscillation. Reviews of Geophysics, 58(3):e2019RG000685, 2020. doi: https://doi.org/10.1029/2019RG000685. URL https://agupubs.onlinelibrary.wiley.com/doi/abs/10.1029/2019RG000685. e2019RG000685 2019RG000685.
- The east pacific wavetrain: Its variability and impact on the atmospheric circulation in the boreal winter. Advances in Atmospheric Sciences, 29:471–483, 2012.