Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Hard-Constrained Deep Learning for Climate Downscaling (2208.05424v9)

Published 8 Aug 2022 in physics.ao-ph and cs.LG

Abstract: The availability of reliable, high-resolution climate and weather data is important to inform long-term decisions on climate adaptation and mitigation and to guide rapid responses to extreme events. Forecasting models are limited by computational costs and, therefore, often generate coarse-resolution predictions. Statistical downscaling, including super-resolution methods from deep learning, can provide an efficient method of upsampling low-resolution data. However, despite achieving visually compelling results in some cases, such models frequently violate conservation laws when predicting physical variables. In order to conserve physical quantities, here we introduce methods that guarantee statistical constraints are satisfied by a deep learning downscaling model, while also improving their performance according to traditional metrics. We compare different constraining approaches and demonstrate their applicability across different neural architectures as well as a variety of climate and weather data sets. Besides enabling faster and more accurate climate predictions through downscaling, we also show that our novel methodologies can improve super-resolution for satellite data and natural images data sets.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (41)
  1. The influence of weather forecast resolution on the circulation of lake george, ny. Water Resources Research, 57(10):e2020WR029552, 2021. doi: https://doi.org/10.1029/2020WR029552. URL https://agupubs.onlinelibrary.wiley.com/doi/abs/10.1029/2020WR029552. e2020WR029552 2020WR029552.
  2. Configuration and intercomparison of deep learning neural models for statistical downscaling. Geoscientific Model Development, 13(4):2109–2124, 2020. doi: 10.5194/gmd-13-2109-2020. URL https://gmd.copernicus.org/articles/13/2109/2020/.
  3. Achieving conservation of energy in neural network emulators for climate modeling, 2019. URL https://arxiv.org/abs/1906.06622.
  4. Enforcing analytic constraints in neural networks emulating physical systems. Phys. Rev. Lett., 126:098302, Mar 2021. doi: 10.1103/PhysRevLett.126.098302. URL https://link.aps.org/doi/10.1103/PhysRevLett.126.098302.
  5. C. Chaudhuri and C. Robertson. Cligan: A structurally sensitive convolutional neural network model for statistical downscaling of precipitation from multi-model ensembles. Water, 2020.
  6. Single image super-resolution with uncertainty estimation for lunar satellite images. NeruIPS Workshop ML for Physical Sciences, 2021.
  7. Image super-resolution using deep convolutional networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 38(2):295–307, 2016. doi: 10.1109/TPAMI.2015.2439281.
  8. Dc3: A learning method for optimization with hard constraints. In International Conference on Learning Representations, 2021.
  9. A. Geiss and J. C. Hardin. Strictly enforcing invertibility and conservation in cnn-based super resolution for scientific datasets. Artificial Intelligence for the Earth Systems, 2(1):e210012, 2023. doi: https://doi.org/10.1175/AIES-D-21-0012.1. URL https://journals.ametsoc.org/view/journals/aies/2/1/AIES-D-21-0012.1.xml.
  10. Downscaling atmospheric chemistry simulations with physically consistent deep learning. Geoscientific Model Development Discussions, 2022:1–26, 2022. doi: 10.5194/gmd-2022-76. URL https://gmd.copernicus.org/preprints/gmd-2022-76/.
  11. Climalign: Unsupervised statistical downscaling of climate variables via normalizing flows. In Proceedings of the 10th International Conference on Climate Informatics, CI2020, page 60–66, New York, NY, USA, 2020. Association for Computing Machinery. ISBN 9781450388481. doi: 10.1145/3429309.3429318. URL https://doi.org/10.1145/3429309.3429318.
  12. The ongoing need for high-resolution regional climate models: Process understanding and stakeholder information. Bulletin of the American Meteorological Society, 101(5):E664 – E683, 2020. doi: 10.1175/BAMS-D-19-0113.1. URL https://journals.ametsoc.org/view/journals/bams/101/5/bams-d-19-0113.1.xml.
  13. Physics-informed learning of aerosol microphysics. arXiv preprint arXiv:2109.10593, 2021.
  14. Physics-informed learning of aerosol microphysics, 2022. URL https://arxiv.org/abs/2207.11786.
  15. Augmented convolutional lstms for generation of high-resolution climate change projections. IEEE Access, 9:25208–25218, 2021. doi: 10.1109/ACCESS.2021.3057500.
  16. The era5 global reanalysis. Quarterly Journal of the Royal Meteorological Society, 146(730):1999–2049, 2020. doi: https://doi.org/10.1002/qj.3803. URL https://rmets.onlinelibrary.wiley.com/doi/abs/10.1002/qj.3803.
  17. Physically constrained generative adversarial networks for improving precipitation fields from earth system models. Nature Machine Intelligence, 4, 2022.
  18. Meshfreeflownet: A physics-constrained deep continuous space-time super-resolution framework. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, SC ’20. IEEE Press, 2020. ISBN 9781728199986.
  19. Wisosuper: Benchmarking super-resolution methods on wind and solar data, 2021. URL https://arxiv.org/abs/2109.08770.
  20. Photo-realistic single image super-resolution using a generative adversarial network, 2016. URL https://arxiv.org/abs/1609.04802.
  21. Photo-realistic single image super-resolution using a generative adversarial network. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 4681–4690, 2017.
  22. Stochastic super-resolution for downscaling time-evolving atmospheric fields with a generative adversarial network. IEEE Transactions on Geoscience and Remote Sensing, 59(9):7211–7223, 2021. doi: 10.1109/TGRS.2020.3032790.
  23. Enhanced deep residual networks for single image super-resolution. In 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pages 1132–1140, 2017. doi: 10.1109/CVPRW.2017.151.
  24. Video frame synthesis using deep voxel flow. In 2017 IEEE International Conference on Computer Vision (ICCV), pages 4473–4481, 2017. doi: 10.1109/ICCV.2017.478.
  25. Srflow: Learning the super-resolution space with normalizing flow. In ECCV, 2020.
  26. D. Maraun and M. Widmann. Statistical Downscaling and Bias Correction for Climate Research. Cambridge University Press, 2018. doi: 10.1017/9781107588783.
  27. M. Mirza and S. Osindero. Conditional generative adversarial nets, 2014. URL https://arxiv.org/abs/1411.1784.
  28. A fortran-keras deep learning bridge for scientific computing. arXiv preprint arXiv:2004.10652, 2020.
  29. Online dynamical downscaling of temperature and precipitation within the iloveclim model (version 1.1). Geoscientific Model Development, 11(1):453–466, 2018. doi: 10.5194/gmd-11-453-2018. URL https://gmd.copernicus.org/articles/11/453/2018/.
  30. Deep learning and process understanding for data-driven earth system science. Nature, 2(1), 2019. doi: https://doi.org/10.1038/s41586-019-0912-1.
  31. Overview of the norwegian earth system model (noresm2) and key climate response of cmip6 deck, historical, and scenario simulations. Geoscientific Model Development, 13(12):6165–6200, 2020. doi: 10.5194/gmd-13-6165-2020. URL https://gmd.copernicus.org/articles/13/6165/2020/.
  32. Spatio-temporal downscaling of climate data using convolutional and error-predicting neural networks. Frontiers in Climate, 3, 2021. ISSN 2624-9553. doi: 10.3389/fclim.2021.656479. URL https://www.frontiersin.org/articles/10.3389/fclim.2021.656479.
  33. Adversarial super-resolution of climatological wind and solar data. Proceedings of the National Academy of Sciences, 117(29):16805–16815, 2020. doi: 10.1073/pnas.1918964117. URL https://www.pnas.org/doi/abs/10.1073/pnas.1918964117.
  34. Deepsd: Generating high resolution climate change projections through single image super-resolution. KDD ’17, page 1663–1672, New York, NY, USA, 2017. Association for Computing Machinery. ISBN 9781450348874. doi: 10.1145/3097983.3098004. URL https://doi.org/10.1145/3097983.3098004.
  35. Fast and accurate learned multiresolution dynamical downscaling for precipitation. Geoscientific Model Development, 14(10):6355–6372, 2021. doi: 10.5194/gmd-14-6355-2021. URL https://gmd.copernicus.org/articles/14/6355/2021/.
  36. Esrgan: Enhanced super-resolution generative adversarial networks, 2018a. URL https://arxiv.org/abs/1809.00219.
  37. Esrgan: Enhanced super-resolution generative adversarial networks. In The European Conference on Computer Vision Workshops (ECCVW), September 2018b.
  38. Investigating two super-resolution methods for downscaling precipitation: ESRGAN and CAR, 2020. URL https://arxiv.org/abs/2012.01233.
  39. Learning texture transformer network for image super-resolution. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 5790–5799, 2020. doi: 10.1109/CVPR42600.2020.00583.
  40. L. Zanna and T. Bolton. Data-driven equation discovery of ocean mesoscale closures. Geophysical Research Letters, 47(17):e2020GL088376, 2020. doi: https://doi.org/10.1029/2020GL088376. URL https://agupubs.onlinelibrary.wiley.com/doi/abs/10.1029/2020GL088376. e2020GL088376 10.1029/2020GL088376.
  41. L. Zanna and T. Bolton. Deep Learning of Unresolved Turbulent Ocean Processes in Climate Models, chapter 20, pages 298–306. John Wiley & Sons, Ltd, 2021. ISBN 9781119646181. doi: https://doi.org/10.1002/9781119646181.ch20. URL https://onlinelibrary.wiley.com/doi/abs/10.1002/9781119646181.ch20.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (8)
  1. Paula Harder (14 papers)
  2. Alex Hernandez-Garcia (24 papers)
  3. Venkatesh Ramesh (5 papers)
  4. Qidong Yang (5 papers)
  5. Prasanna Sattigeri (70 papers)
  6. Daniela Szwarcman (14 papers)
  7. Campbell Watson (12 papers)
  8. David Rolnick (68 papers)
Citations (10)

Summary

We haven't generated a summary for this paper yet.