Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
110 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Fast, Scale-Adaptive, and Uncertainty-Aware Downscaling of Earth System Model Fields with Generative Foundation Models (2403.02774v1)

Published 5 Mar 2024 in physics.ao-ph, cs.CV, cs.LG, and physics.geo-ph

Abstract: Accurate and high-resolution Earth system model (ESM) simulations are essential to assess the ecological and socio-economic impacts of anthropogenic climate change, but are computationally too expensive. Recent machine learning approaches have shown promising results in downscaling ESM simulations, outperforming state-of-the-art statistical approaches. However, existing methods require computationally costly retraining for each ESM and extrapolate poorly to climates unseen during training. We address these shortcomings by learning a consistency model (CM) that efficiently and accurately downscales arbitrary ESM simulations without retraining in a zero-shot manner. Our foundation model approach yields probabilistic downscaled fields at resolution only limited by the observational reference data. We show that the CM outperforms state-of-the-art diffusion models at a fraction of computational cost while maintaining high controllability on the downscaling task. Further, our method generalizes to climate states unseen during training without explicitly formulated physical constraints.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (40)
  1. Towards Principled Methods for Training Generative Adversarial Networks. arXiv:1701.04862 [cs, stat].
  2. Enforcing Analytic Constraints in Neural Networks Emulating Physical Systems. Physical Review Letters, 126(9):98302. arXiv: 1909.00912 Publisher: American Physical Society.
  3. Unpaired Downscaling of Fluid Flows with Diffusion Bridges. arXiv:2305.01822 [physics].
  4. Bias Correction of GCM Precipitation by Quantile Mapping: How Well Do Methods Preserve Changes in Quantiles and Extremes? Journal of Climate, 28(17):6938–6959. Publisher: American Meteorological Society Section: Journal of Climate.
  5. Diffusion Models Beat GANs on Image Synthesis. arXiv:2105.05233 [cs, stat].
  6. NICE: Non-linear Independent Components Estimation. arXiv:1410.8516 [cs].
  7. CM2Mc-LPJmL v1.0: biophysical coupling of a process-based dynamic vegetation model with managed land to a general circulation model. Geoscientific Model Development, 14(6):4117–4141. Publisher: Copernicus GmbH.
  8. Adjusting spatial dependence of climate model outputs with cycle-consistent adversarial networks. Springer Berlin Heidelberg. Publication Title: Climate Dynamics Issue: 0123456789 ISSN: 14320894.
  9. Generative Adversarial Nets. In Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N., and Weinberger, K. Q., editors, Advances in Neural Information Processing Systems, volume 27. Curran Associates, Inc.
  10. ClimAlign: Unsupervised statistical downscaling of climate variables via normalizing flows. arXiv:2008.04679 [cs, stat].
  11. Generating physically-consistent high-resolution climate data with hard-constrained neural networks. arXiv: 2208.05424.
  12. A Generative Deep Learning Approach to Stochastic Downscaling of Precipitation Forecasts. Journal of Advances in Modeling Earth Systems, 14(10). arXiv:2204.02028 [physics, stat].
  13. The ERA5 global reanalysis. Quarterly Journal of the Royal Meteorological Society, 146(730):1999–2049. _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/qj.3803.
  14. Physically constrained generative adversarial networks for improving precipitation fields from Earth system models. Nature Machine Intelligence, 4(10):828–839. Number: 10 Publisher: Nature Publishing Group.
  15. Deep Learning for Bias-Correcting CMIP6-Class Earth System Models. Earth’s Future, 11(10):e2023EF004002. _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1029/2023EF004002.
  16. Denoising Diffusion Probabilistic Models. arXiv:2006.11239 [cs, stat].
  17. Elucidating the Design Space of Diffusion-Based Generative Models. arXiv:2206.00364 [cs, stat].
  18. Adam: A method for stochastic optimization. 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings, pages 1–15. arXiv: 1412.6980.
  19. The effect of rainfall changes on economic production. Nature, 601(7892):223–227. Number: 7892 Publisher: Nature Publishing Group.
  20. On the Variance of the Adaptive Learning Rate and Beyond. arXiv:1908.03265 [cs, stat].
  21. Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed. arXiv:2101.02388 [cs].
  22. SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations. arXiv:2108.01073 [cs].
  23. Learning to Correct Climate Projection Biases. Journal of Advances in Modeling Earth Systems, 13(10):e2021MS002509. _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1029/2021MS002509.
  24. Normalizing flows for probabilistic modeling and inference. The Journal of Machine Learning Research, 22(1):57:2617–57:2680.
  25. PyTorch: An Imperative Style, High-Performance Deep Learning Library. In Advances in Neural Information Processing Systems, volume 32. Curran Associates, Inc.
  26. Skilful precipitation nowcasting using deep generative models of radar. Nature, 597(7878):672–677. arXiv: 2104.00954 Publisher: Springer US.
  27. Generative Modelling With Inverse Heat Dissipation. arXiv:2206.13397 [cs, stat].
  28. U-net: Convolutional networks for biomedical image segmentation. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), volume 9351, pages 234–241. Springer Verlag. arXiv: 1505.04597 ISSN: 16113349.
  29. Climate goals and computing the future of clouds. Nature Climate Change, 7(1):3–5. Number: 1 Publisher: Nature Publishing Group.
  30. Green AI. arXiv:1907.10597 [cs, stat].
  31. Denoising Diffusion Implicit Models. arXiv:2010.02502 [cs].
  32. Consistency Models. arXiv:2303.01469 [cs, stat].
  33. Generative Modeling by Estimating Gradients of the Data Distribution. In Advances in Neural Information Processing Systems, volume 32. Curran Associates, Inc.
  34. Score-Based Generative Modeling through Stochastic Differential Equations. arXiv:2011.13456 [cs, stat].
  35. The Double-ITCZ Bias in CMIP3, CMIP5, and CMIP6 Models Based on Annual Mean Precipitation. Geophysical Research Letters, 47(8):1–11.
  36. The role of cyclonic activity in tropical temperature-rainfall scaling. Nature Communications, 12(1):6732. Number: 1 Publisher: Nature Publishing Group.
  37. Debias Coarsely, Sample Conditionally: Statistical Downscaling through Optimal Transport and Probabilistic Diffusion Models. arXiv:2305.15618 [physics].
  38. The Unreasonable Effectiveness of Deep Features as a Perceptual Metric. arXiv:1801.03924 [cs].
  39. Fast Sampling of Diffusion Models via Operator Learning. In Proceedings of the 40th International Conference on Machine Learning, pages 42390–42402. PMLR. ISSN: 2640-3498.
  40. Unpaired Image-To-Image Translation Using Cycle-Consistent Adversarial Networks. In Proceedings of the IEEE International Conference on Computer Vision, pages 2223–2232.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (4)
  1. Philipp Hess (7 papers)
  2. Michael Aich (4 papers)
  3. Baoxiang Pan (11 papers)
  4. Niklas Boers (40 papers)

Summary

We haven't generated a summary for this paper yet.