Interpretable Machine Learning for Weather and Climate Prediction: A Survey (2403.18864v1)
Abstract: Advanced machine learning models have recently achieved high predictive accuracy for weather and climate prediction. However, these complex models often lack inherent transparency and interpretability, acting as "black boxes" that impede user trust and hinder further model improvements. As such, interpretable machine learning techniques have become crucial in enhancing the credibility and utility of weather and climate modeling. In this survey, we review current interpretable machine learning approaches applied to meteorological predictions. We categorize methods into two major paradigms: 1) Post-hoc interpretability techniques that explain pre-trained models, such as perturbation-based, game theory based, and gradient-based attribution methods. 2) Designing inherently interpretable models from scratch using architectures like tree ensembles and explainable neural networks. We summarize how each technique provides insights into the predictions, uncovering novel meteorological relationships captured by machine learning. Lastly, we discuss research challenges around achieving deeper mechanistic interpretations aligned with physical principles, developing standardized evaluation benchmarks, integrating interpretability into iterative model development workflows, and providing explainability for large foundation models.
- Deep multi-stations weather forecasting: explainable recurrent convolutional neural networks. arXiv preprint arXiv:2009.11239, 2020.
- Machine learning for precipitation nowcasting from radar images. arXiv preprint arXiv:1912.12132, 2019.
- The data assimilation research testbed: A community facility. Bulletin of the American Meteorological Society, 90(9):1283–1296, 2009.
- A machine learning-based global atmospheric forecast model. Geophysical Research Letters, 47(9):e2020GL087776, 2020.
- Deep data assimilation: integrating deep learning with data assimilation. Applied Sciences, 11(3):1114, 2021.
- Explainable artificial intelligence (xai): Concepts, taxonomies, opportunities and challenges toward responsible ai. Information fusion, 58:82–115, 2020.
- Rainnet v1. 0: a convolutional neural network for radar-based precipitation nowcasting. Geoscientific Model Development, 13(6):2631–2644, 2020.
- On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PloS one, 10(7):e0130140, 2015.
- Indicator patterns of forced change learned by an artificial neural network. Journal of Advances in Modeling Earth Systems, 12(9):e2020MS002195, 2020.
- The quiet revolution of numerical weather prediction. Nature, 525(7567):47–55, 2015.
- Accurate medium-range global weather forecasting with 3d neural networks. Nature, 619(7970):533–538, 2023a.
- Oceangpt: A large language model for ocean science tasks. arXiv preprint arXiv:2310.02031, 2023b.
- Machine learning in weather prediction and climate analyses—applications and perspectives. Atmosphere, 13(2):180, 2022.
- Can machine learning improve the model representation of turbulent kinetic energy dissipation rate in the boundary layer for complex terrain? Geoscientific Model Development, 13(9):4271–4285, 2020.
- Finding the right xai method–a guide for the evaluation and ranking of explainable ai methods in climate science. arXiv preprint arXiv:2303.00652, 2023.
- Leo Breiman. Random forests. Machine learning, 45:5–32, 2001.
- Fengwu: Pushing the skillful global medium-range weather forecast beyond 10 days lead. arXiv preprint arXiv:2304.02948, 2023a.
- Fuxi: A cascade machine learning forecasting system for 15-day global weather forecast. arXiv preprint arXiv:2306.12873, 2023b.
- Foundation models for weather and climate data understanding: A comprehensive survey. arXiv preprint arXiv:2312.03014, 2023c.
- Nowcasting extreme rain and extreme wind speed with machine learning techniques applied to different input datasets. Atmospheric Research, 282:106548, 2023.
- Data assimilation by artificial neural networks for an atmospheric general circulation model. Advanced applications for artificial neural networks, 265, 2018.
- Towards automated circuit discovery for mechanistic interpretability. arXiv preprint arXiv:2304.14997, 2023.
- Christopher Daly. Guidelines for assessing the suitability of spatial climate data sets. International Journal of Climatology: A Journal of the Royal Meteorological Society, 26(6):707–721, 2006.
- A unified taylor framework for revisiting attribution methods. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pp. 11462–11469, 2021.
- Unifying fourteen post-hoc attribution methods with taylor interactions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024.
- Techniques for interpretable machine learning. Communications of the ACM, 63(1):68–77, 2019.
- Advances of four machine learning methods for spatial data handling: A review. Journal of Geovisualization and Spatial Analysis, 4:1–25, 2020.
- Interpretation of black box for short-term predictions of pre-monsoon cumulonimbus cloud events over kolkata. Journal of Data, Information and Management, 4(2):167–183, 2022.
- Evaluation, tuning and interpretation of neural networks for working with images in meteorological applications. Bulletin of the American Meteorological Society, pp. 1–47, 2020.
- Deep learning for twelve hour precipitation forecasts. Nature communications, 13(1):1–10, 2022.
- Using a 10-year radar archive for nowcasting precipitation growth and decay: A probabilistic machine learning approach. Weather and Forecasting, 34(5):1547–1569, 2019.
- Differentiated explanation of deep neural networks with skewed distributions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(6):2909–2922, 2021.
- Interpretable deep learning for spatial analysis of severe hailstorms. Monthly Weather Review, 147(8):2827–2845, 2019.
- Machine learning classification of significant tornadoes and hail in the united states using era5 proximity soundings. Weather and Forecasting, 36(6):2143–2160, 2021.
- Stratiform and convective rain classification using machine learning models and micro rain radar. Remote Sensing, 14(18):4563, 2022.
- Training machine learning models on climate model output yields skillful interpretable seasonal precipitation forecasts. Communications Earth & Environment, 2(1):159, 2021.
- Approaches to the simulation of regional climate change: a review. Reviews of geophysics, 29(2):191–216, 1991.
- Using explainability to inform statistical downscaling based on deep learning beyond standard validation approaches. Journal of Advances in Modeling Earth Systems, 15(11):e2023MS003641, 2023.
- Predicting rapid intensification in north atlantic and eastern north pacific tropical cyclones using a convolutional neural network. Weather and Forecasting, 37(8):1333–1355, 2022.
- Learning dynamics and heterogeneity of spatial-temporal graph data for traffic forecasting. IEEE Transactions on Knowledge and Data Engineering, 34(11):5415–5428, 2021.
- Survey of data assimilation methods for convective-scale numerical weather prediction at operational centres. Quarterly Journal of the Royal Meteorological Society, 144(713):1218–1256, 2018.
- A deep learning method for bias correction of ecmwf 24–240 h forecasts. Advances in Atmospheric Sciences, 38(9):1444–1459, 2021.
- Data assimilation procedure by recurrent neural network. Engineering Applications of Computational Fluid Mechanics, 6(2), 2012.
- Improving predictions of land-atmosphere interactions based on a hybrid data assimilation and machine learning method. Hydrology and Earth System Sciences Discussions, 2022:1–33, 2022.
- “dendrology” in numerical weather prediction: What random forests and logistic regression tell us about forecasting extreme precipitation. Monthly Weather Review, 146(6):1785–1812, 2018.
- The era5 global reanalysis. Quarterly Journal of the Royal Meteorological Society, 146(730):1999–2049, 2020.
- Domain knowledge integration into deep learning for typhoon intensity classification. Scientific reports, 11(1):12972, 2021.
- Development and interpretation of a neural-network-based synthetic radar reflectivity estimator using goes-r satellite observations. Journal of Applied Meteorology and Climatology, 60(1):3–21, 2020.
- Deep learning forecast uncertainty for precipitation over the western united states. Monthly Weather Review, 151(6):1367–1385, 2023.
- A survey on explainability of graph neural networks. arXiv preprint arXiv:2306.01958, 2023.
- The ncep/ncar 40-year reanalysis project. In Renewable energy, pp. Vol1_146–Vol1_194. Routledge, 2018.
- Physics-informed machine learning: case studies for weather and climate modelling. Philosophical Transactions of the Royal Society A, 379(2194):20200093, 2021.
- Neural general circulation models. arXiv preprint arXiv:2311.07222, 2023.
- Changes in united states summer temperatures revealed by explainable neural networks. Authorea Preprints, 2023.
- Which polarimetric variables are important for weather/no-weather discrimination? Journal of Atmospheric and Oceanic Technology, 32(6):1209–1223, 2015.
- Graphcast: Learning skillful medium-range global weather forecasting. arXiv preprint arXiv:2212.12794, 2022.
- Learning skillful medium-range global weather forecasting. Science, 382(6677):1416–1421, 2023.
- A machine learning model for predicting silica concentrations through time series analysis of mining data. Journal of Korean Society for Quality Management, 48(3):511–520, 2020.
- Combining data assimilation and machine learning to estimate parameters of a convective-scale model. Quarterly Journal of the Royal Meteorological Society, 148(743):860–874, 2022.
- Stochastic super-resolution for downscaling time-evolving atmospheric fields with a generative adversarial network. IEEE Transactions on Geoscience and Remote Sensing, 59(9):7211–7223, 2020.
- Thunderstorm nowcasting with deep learning: A multi-hazard data fusion model. Geophysical Research Letters, 50(8):e2022GL101626, 2023.
- A wind speed forecasting model based on multi-objective algorithm and interpretability learning. Energy, 269:126778, 2023a.
- M4: A unified xai benchmark for faithfulness evaluation of feature attribution methods across metrics, modalities and models. In Thirty-seventh Conference on Neural Information Processing Systems Datasets and Benchmarks Track, 2023b.
- Probabilistic convective initiation nowcasting using himawari-8 ahi with explainable deep learning models. Monthly Weather Review, 2023c.
- Deep-learning post-processing of short-term station precipitation based on nwp forecasts. Atmospheric Research, 295:107032, 2023.
- Comparing and interpreting differently designed random forests for next-day severe weather hazard prediction. Weather and Forecasting, 37(6):871–899, 2022.
- Regional forecast of heavy precipitation and interpretability based on td-vae. In 2021 40th Chinese Control Conference (CCC), pp. 7260–7265. IEEE, 2021.
- A unified approach to interpreting model predictions. Advances in neural information processing systems, 30, 2017.
- Statistical post-processing of multiple meteorological elements using the multimodel integration embedded method. Atmospheric Research, 301:107269, 2024.
- Investigating the fidelity of explainable artificial intelligence methods for applications of convolutional neural networks in geoscience. Artificial Intelligence for the Earth Systems, 1(4):e220012, 2022.
- Making the black box more transparent: Understanding the physical implications of machine learning. Bulletin of the American Meteorological Society, 100(11):2175–2199, 2019.
- Probabilistic 0–1-h convective initiation nowcasts that combine geostationary satellite observations and numerical weather prediction model data. Journal of Applied Meteorology and Climatology, 54(5):1039–1059, 2015.
- A benchmark to test generalization capabilities of deep learning methods to classify severe convective storms in a changing climate. Earth and Space Science, 8(9):e2020EA001490, 2021.
- The ecmwf ensemble prediction system: Methodology and validation. Quarterly journal of the royal meteorological society, 122(529):73–119, 1996.
- Explaining nonlinear classification decisions with deep taylor decomposition. Pattern recognition, 65:211–222, 2017.
- Interpretable machine learning: definitions, methods, and applications. arXiv preprint arXiv:1901.04592, 2019.
- Climax: A foundation model for weather and climate. arXiv preprint arXiv:2301.10343, 2023.
- Zoom in: An introduction to circuits. Distill, 5(3):e00024–001, 2020.
- Improving precipitation estimation using convolutional neural network. Water Resources Research, 55(3):2301–2321, 2019.
- Fourcastnet: A global data-driven high-resolution weather model using adaptive fourier neural operators. arXiv preprint arXiv:2202.11214, 2022.
- Gencast: Diffusion-based ensemble forecasting for medium-range weather. arXiv preprint arXiv:2312.15796, 2023.
- Seasonal forecast of winter precipitation over china using machine learning models. Atmospheric Research, 294:106961, 2023.
- Hybrid explainable srnn-lstm architecture for irradiance, temperature and wind speed forecasting. 2023.
- High-resolution downscaling with interpretable deep learning: Rainfall extremes over new zealand. Weather and Climate Extremes, 38:100525, 2022.
- Neural networks for postprocessing ensemble weather forecasts. Monthly Weather Review, 146(11):3885–3900, 2018.
- Deep learning to represent subgrid processes in climate models. Proceedings of the National Academy of Sciences, 115(39):9684–9689, 2018.
- Deep learning-based weather prediction: a survey. Big Data Research, 23:100178, 2021.
- Sar-unet: Small attention residual unet for explainable nowcasting tasks. arXiv preprint arXiv:2303.06663, 2023.
- Identifying relations between deep convection and the large-scale atmosphere using explainable artificial intelligence. Journal of Geophysical Research: Atmospheres, 127(3):e2021JD035388, 2022.
- Ga-smaat-gnet: Generative adversarial small attention gnet for extreme precipitation nowcasting. arXiv preprint arXiv:2401.09881, 2024.
- Model-agnostic interpretability of machine learning. arXiv preprint arXiv:1606.05386, 2016a.
- " why should i trust you?" explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp. 1135–1144, 2016b.
- Lewis F Richardson. Weather prediction by numerical process. University Press, 1922.
- Statistical downscaling of precipitation using machine learning techniques. Atmospheric research, 212:240–258, 2018.
- Predicting weather forecast uncertainty with machine learning. Quarterly Journal of the Royal Meteorological Society, 144(717):2830–2841, 2018.
- Potential and limitations of machine learning for modeling warm-rain cloud microphysical processes. Journal of Advances in Modeling Earth Systems, 12(12):e2020MS002301, 2020.
- Grad-cam: Visual explanations from deep networks via gradient-based localization. In Proceedings of the IEEE international conference on computer vision, pp. 618–626, 2017.
- Convolutional lstm network: A machine learning approach for precipitation nowcasting. Advances in neural information processing systems, 28, 2015.
- Diagnosing supercell environments: A machine learning approach. Weather and Forecasting, 37(5):771–785, 2022.
- Using an explainable machine learning approach to characterize earth system model errors: Application of shap analysis to modeling lightning flash occurrence. Journal of Advances in Modeling Earth Systems, 14(4):e2021MS002881, 2022.
- Revealing the impact of global heating on north atlantic circulation using transparent machine learning. Journal of Advances in Modeling Earth Systems, 13(8):e2021MS002496, 2021.
- Short-term weather forecasting using spatial feature attention based lstm model. IEEE Access, 10:82456–82468, 2022.
- Axiomatic attribution for deep networks. In International conference on machine learning, pp. 3319–3328. PMLR, 2017.
- Spatio-temporal weather forecasting and attention mechanism on convolutional lstms. arXiv preprint arXiv:2102.00696, 4, 2021.
- Interpretable machine learning for meteorological data. In 2021 The 5th International Conference on Machine Learning and Soft Computing, pp. 11–17, 2021.
- Physically interpretable neural networks for the geosciences: Applications to earth system variability. Journal of Advances in Modeling Earth Systems, 12(9):e2019MS002002, 2020.
- Assessing decadal predictability in an earth-system model using explainable neural networks. Geophysical Research Letters, 48(12):e2021GL093842, 2021a.
- Testing the reliability of interpretable neural networks in geoscience using the madden–julian oscillation. Geoscientific Model Development, 14(7):4495–4508, 2021b.
- A machine learning-explainable ai approach to tropospheric dynamics analysis using water vapor meteosat images. In 2021 IEEE Symposium Series on Computational Intelligence (SSCI), pp. 1–8. IEEE, 2021.
- A deep learning model for estimating tropical cyclone wind radius from geostationary satellite infrared imagery. Monthly Weather Review, 151(2):403–417, 2023.
- Score-cam: Score-weighted visual explanations for convolutional neural networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020.
- Yaqiang Wang. Meteoinfo: Gis software for meteorological data visualization and analysis. Meteorological Applications, 21(2):360–368, 2014.
- YaQiang Wang. An open source software suite for multi-dimensional meteorological data computation and visualisation. J. Open Res. Softw, 7(1):21, 2019.
- Deep learning augmented data assimilation: Reconstructing missing information with convolutional autoencoders. Monthly Weather Review, 150(8):1977–1991, 2022.
- Peter AG Watson. Applying machine learning to improve simulations of a chaotic dynamical system using empirical error correction. Journal of Advances in Modeling Earth Systems, 11(5):1402–1417, 2019.
- Can machines learn to predict weather? using deep learning to predict gridded 500-hpa geopotential height from historical weather data. Journal of Advances in Modeling Earth Systems, 11(8):2680–2693, 2019.
- Improving data-driven global weather prediction using deep convolutional neural networks on a cubed sphere. Journal of Advances in Modeling Earth Systems, 12(9):e2020MS002109, 2020.
- Fast data assimilation (fda): Data assimilation by machine learning for faster optimize model state. Journal of Computational Science, 51:101323, 2021.
- Towards explainable artificial intelligence (xai): A data mining perspective. arXiv preprint arXiv:2401.04374, 2024.
- Hourly rolling correction of precipitation forecast via convolutional and long short-term memory networks. Atmospheric Science Letters, 23(10):e1100, 2022.
- Temporal dynamic network with learnable coupled adjacent matrix for wind forecasting. IEEE Geoscience and Remote Sensing Letters, 2023.
- Atmconvgru for weather forecasting. IEEE Geoscience and Remote Sensing Letters, 19:1–5, 2021.
- Terrain-guided flatten memory network for deep spatial wind downscaling. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 15:9468–9481, 2022.
- Correction model for rainfall forecasts using the lstm with multiple meteorological factors. Meteorological Applications, 27(1):e1852, 2020.
- Prediction of tropical cyclone genesis from mesoscale convective systems using machine learning. Weather and Forecasting, 34(4):1035–1049, 2019.
- Skilful nowcasting of extreme precipitation with nowcastnet. Nature, 619(7970):526–532, 2023.
- Opening the black box of large language models: Two views on holistic interpretability. arXiv preprint arXiv:2402.10688, 2024.
- A deep learning network for cloud-to-ground lightning nowcasting with multisource data. Journal of Atmospheric and Oceanic Technology, 37(5):927–942, 2020.
- Physics-augmented deep learning to improve tropical cyclone intensity and size estimation from satellite imagery. Monthly Weather Review, 149(7):2097–2113, 2021.
- Ruyi Yang (1 paper)
- Jingyu Hu (19 papers)
- Zihao Li (161 papers)
- Jianli Mu (1 paper)
- Tingzhao Yu (1 paper)
- Jiangjiang Xia (3 papers)
- Xuhong Li (39 papers)
- Aritra Dasgupta (14 papers)
- Haoyi Xiong (98 papers)