Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
110 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Conditional diffusion models for downscaling & bias correction of Earth system model precipitation (2404.14416v1)

Published 5 Apr 2024 in physics.geo-ph, cs.AI, cs.LG, and physics.ao-ph

Abstract: Climate change exacerbates extreme weather events like heavy rainfall and flooding. As these events cause severe losses of property and lives, accurate high-resolution simulation of precipitation is imperative. However, existing Earth System Models (ESMs) struggle with resolving small-scale dynamics and suffer from biases, especially for extreme events. Traditional statistical bias correction and downscaling methods fall short in improving spatial structure, while recent deep learning methods lack controllability over the output and suffer from unstable training. Here, we propose a novel machine learning framework for simultaneous bias correction and downscaling. We train a generative diffusion model in a supervised way purely on observational data. We map observational and ESM data to a shared embedding space, where both are unbiased towards each other and train a conditional diffusion model to reverse the mapping. Our method can be used to correct any ESM field, as the training is independent of the ESM. Our approach ensures statistical fidelity, preserves large-scale spatial patterns and outperforms existing methods especially regarding extreme events and small-scale spatial features that are crucial for impact assessments.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (29)
  1. Bias correction of gcm precipitation by quantile mapping: how well do methods preserve changes in quantiles and extremes? Journal of Climate, 28(17):6938–6959.
  2. Cuturi, M. (2013). Sinkhorn distances: Lightspeed computation of optimal transport. Advances in neural information processing systems, 26.
  3. The GFDL Earth System Model Version 4.1 (GFDL-ESM 4.1): Overall Coupled Model Description and Simulation Characteristics. Journal of Advances in Modeling Earth Systems, 12(11):e2019MS002015. _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1029/2019MS002015.
  4. Adjusting spatial dependence of climate model outputs with cycle-consistent adversarial networks. Climate dynamics, 57:3323–3353.
  5. Generative adversarial networks. Communications of the ACM, 63(11):139–144.
  6. Downscaling rcm precipitation to the station scale using statistical transformations–a comparison of methods. Hydrology and Earth System Sciences, 16(9):3383–3390.
  7. An intercomparison of statistical downscaling methods used for water resource assessments in the u nited s tates. Water Resources Research, 50(9):7167–7186.
  8. Efficient diffusion training via min-snr weighting strategy. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 7441–7451.
  9. The ERA5 global reanalysis. Quarterly Journal of the Royal Meteorological Society, 146(730):1999–2049. _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/qj.3803.
  10. Physically constrained generative adversarial networks for improving precipitation fields from earth system models. Nature Machine Intelligence, 4(10):828–839.
  11. Deep learning for bias-correcting cmip6-class earth system models. Earth’s Future, 11(10):e2023EF004002.
  12. Denoising diffusion probabilistic models. Advances in neural information processing systems, 33:6840–6851.
  13. Cascaded diffusion models for high fidelity image generation. Journal of Machine Learning Research, 23(47):1–33.
  14. Using machine learning to cut the cost of dynamical downscaling. Earth’s Future, 11(3):e2022EF003291.
  15. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980.
  16. Ipcc, 2023: Climate change 2023: Synthesis report, summary for policymakers. contribution of working groups i, ii and iii to the sixth assessment report of the intergovernmental panel on climate change [core writing team, h. lee and j. romero (eds.)]. ipcc, geneva, switzerland. Technical Report 10.59327/IPCC/AR6-9789291691647.001, Intergovernmental Panel on Climate Change (IPCC), Geneva, Switzerland. Please access report for extended list of writing team, editors, scientific steering committee and other contributing authors.
  17. Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed. arXiv:2101.02388 [cs].
  18. Learning to correct climate projection biases. Journal of Advances in Modeling Earth Systems, 13(10):e2021MS002509.
  19. High-resolution downscaling with interpretable deep learning: Rainfall extremes over new zealand. Weather and Climate Extremes, 38:100525.
  20. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10684–10695.
  21. Palette: Image-to-image diffusion models. In ACM SIGGRAPH 2022 Conference Proceedings, pages 1–10.
  22. Photorealistic text-to-image diffusion models with deep language understanding. Advances in neural information processing systems, 35:36479–36494.
  23. Image super-resolution via iterative refinement. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(4):4713–4726.
  24. Bias correction of temperature and precipitation over china for rcm simulations using the qm and qdm methods. Climate Dynamics, 57:1425–1443.
  25. Deepsd: Generating high resolution climate change projections through single image super-resolution. In Proceedings of the 23rd acm sigkdd international conference on knowledge discovery and data mining, pages 1663–1672.
  26. Debias coarsely, sample conditionally: Statistical downscaling through optimal transport and probabilistic diffusion models. Advances in Neural Information Processing Systems, 36.
  27. Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing, 13(4):600–612.
  28. Causes of higher climate sensitivity in cmip6 models. Geophysical Research Letters, 47(1):e2019GL085782.
  29. Unpaired image-to-image translation using cycle-consistent adversarial networks. In Proceedings of the IEEE International Conference on Computer Vision (ICCV).
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (6)
  1. Michael Aich (4 papers)
  2. Philipp Hess (7 papers)
  3. Baoxiang Pan (11 papers)
  4. Sebastian Bathiany (12 papers)
  5. Yu Huang (176 papers)
  6. Niklas Boers (40 papers)
Citations (2)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com