---
title: Data-Driven Weather Forecast Models
url: https://www.emergentmind.com/topics/data-driven-weather-forecast-models
type: topic
---

# Data-Driven Weather Forecast Models

Data-driven weather forecast models are statistical–machine learning systems that learn the mapping from previous atmospheric states (or observations) to future forecasts, typically from large global reanalysis datasets rather than explicit numerical integration of physical dynamical equations. In the past five years, these models—often based on vision transformers, graph neural networks, U-Nets, or spectral operators—have achieved skill that is comparable to, and on selected metrics surpasses, traditional numerical weather prediction (NWP) at global, regional, and local scales. Their performance depends on the quality of initial conditions, model architecture, and loss function, especially with respect to extremes and uncertainty quantification. This article provides a comprehensive summary including mathematical formulations, operational design, integration with data assimilation, methods for capturing extremes, benchmarking, computational considerations, and current limitations.

## 1. Mathematical Basis and Model Architecture

Data-driven weather models learn the transition operator
$$
\hat{X}^{t+\Delta t} = f_{\theta}(X^t)
$$
where $X^t \in \mathbb{R}^{C \times L \times H \times W}$ is the multivariate atmospheric state on a grid (channels $C$, vertical levels $L$, latitude $H$, longitude $W$), and $f_{\theta}$ is a deep neural network parameterized by $\theta$. Common architectures include 3D Earth-Specific Transformers (e.g., Pangu-Weather [2211.02556], [2308.04460]), Swin-Transformer U-Nets [2503.19354], fully-spectral operators (AFNO) [2402.08185], and graph neural networks with global–regional mesh refinement [2409.02891].

Key architectural choices:
- **Patch embedding** along vertical and horizontal axes, maintaining cubic or multi-scale spatial representations.
- **Hierarchical down/up-sampling** and positional encodings (e.g., Earth-Specific positional bias) to capture spatial inhomogeneity and anisotropy.
- **Self-attention or local–global mixing windows** for long-range dependencies.
- **Autoregressive multi-step mapping** for medium-range and sub-seasonal forecasting.

For kilometer-scale forecasting, novel cross-resolution transfer learning and regional adaptation modules can extend the trained system from coarse (0.25°) to fine (0.09°) grids without retraining the entire backbone [2402.00059].

## 2. Data Assimilation and Initialization

Forecast quality is bounded by the fidelity of initial states. While most systems are trained on reanalyses such as ERA5, operational deployment can use initial conditions from current analyses (ECMWF IFS, NOAA GFS, CMA GRAPES, or regional DA systems) [2308.04460], [2503.12956]. Compatibility experiments confirm that pretrained models generalize across analysis sources when input fields are properly mapped to their native grid/resolution.

End-to-end data-driven systems now integrate neural data assimilation, directly ingesting raw observations (satellite radiances, GNSS-RO, surface/radiosonde data), and producing analysis fields via deep networks with attention–fusion bottlenecks [2408.05472], [2508.18486], or full observation-space embedding [2407.15586]. Models such as Huracan [2508.18486] and Aardvark Weather [2404.00411] jointly optimize ensemble data assimilation and forecast modules, in some cases matching or exceeding the probabilistic skill of operational NWP ensembles.

The mathematical formulation for 4DVar assimilation with a neural forecast operator replaces classical adjoint gradients with auto-differentiation, streamlining both the analysis update and the forecast cycle [2312.12455]:
$$
J(x_0) = \frac{1}{2}(x_0 - x^b)^T B^{-1}(x_0 - x^b) + \frac{1}{2}\sum_{\tau=0}^{T-1} [H(x_\tau) - y_\tau]^T (R_\tau + Q_\tau)^{-1} [H(x_\tau) - y_\tau]
$$
where $H$ is the observation operator and $x_\tau$ generated by the neural model.

## 3. Loss Functions, Extremes, and Uncertainty Quantification

Deterministic models have traditionally minimized the mean squared error (MSE) across all locations and variables, weighted by latitude for area (e.g., $w(\phi)=\cos(\phi)$). However, symmetric losses such as MSE produce biased underestimation of rare/extreme events, due to the asymmetry in the Generalized Extreme Value (GEV) or Gumbel distribution of maxima.

To address this, ExtremeCast [2402.01295] introduces Exloss:
$$
\text{Exloss}(x, y) = |S(x, y) \cdot (x - y)|^2
$$
with $S(x,y)=s_< <1$ if $y$ in the tail (above $y_{90}$ or below $y_{10}$) and $x$ under-predicts, otherwise $S=1$. This reweights gradients so that tail predictions receive stronger correction, balancing the expected loss across under/over prediction.

Post-hoc ensemble schemes (ExEnsemble, ExBooster) introduce controlled noise to deterministic forecasts, rank-sorting perturbed outputs, and selecting the rank-preserved member. This broadens the dispersion of predicted extremes without retraining.

Probabilistic models use continuous ranked probability score (CRPS) for training and evaluation:
$$
\mathrm{CRPS}(F, y) = \int_{-\infty}^{\infty} [F(x) - 1(x \ge y)]^2 dx
$$
where $F(x)$ is the empirical forecast CDF. Ensembles of networks or diffusion models [2503.19354], [2508.18486] provide physically plausible uncertainty quantification and better calibration at long leads.

## 4. Training Protocols, Computational Resources, and Efficiency

The largest global models are pretrained on 40+ years of hourly reanalysis (ERA5, IMDAA), with additional fine-tuning on high-resolution or regional analyses [2211.02556], [2503.12956]. Training costs span hundreds of GPU-days on multi-node A100/TPU clusters; regional models or meta-models can be trained on CPUs with reduced complexity via dimension reduction, local attention, or split-domain methods [2012.00678], [2406.19615].

Inference is orders of magnitude faster than NWP. For example, Pangu-Weather produces a 240 h global forecast in ~4 s on a 24 GB GPU [2308.04460], while Aardvark Weather completes 10-day global rollouts in minutes on a handful of GPUs [2404.00411]. Stretched-grid GNN models efficiently target high-resolution domains (2.5 km) within global context [2409.02891]. Distributed variable aggregation and crop-based training sharply reduce parameter and memory costs, with only minor loss in skill [2406.19615].

Hierarchical autoregressive mapping allows dynamic selection of forecast interval per lead, reducing cumulative error and runtime, especially for regional systems [2503.12956].

## 5. Benchmarking, Verification, and Skill Metrics

Verification is framed in terms of latitude-weighted RMSE, anomaly correlation coefficient (ACC), bias, CRPS (for ensembles), spread–skill ratio, and event-based indices (SEEPS, SEDI, ETS). ERA5 acts as “ground truth” for most global models, with validation against operational analyses and station observations for practical relevance [2308.04460], [2211.02556], [2408.05472], [2503.19354]. 

WeatherBench 2 [2308.15560] and the rise of data-driven models [2307.10128] document head-to-head performance against IFS HRES and ensemble baselines:

| Model           | RMSE (Z500, 5d lead) | Relative to IFS HRES |
|-----------------|----------------------|----------------------|
| IFS HRES        | 3.93×10³ m²/s²       | 0%                   |
| GraphCast       | 3.96×10³ m²/s²       | +0.8%                |
| Pangu-Weather   | 4.02×10³ m²/s²       | +2.3%                |
| ERA5 hindcast   | 4.01×10³ m²/s²       | +2.1%                |

Extremes and skill at high quantiles remain a principal differentiator. With Exloss and ExEnsemble (ExtremeCast [2402.01295]), global underestimation of tail events (RQE near zero) and SEDI for 99.5th percentile events (t2m: 0.71 vs GraphCast: 0.56, ECMWF-IFS: 0.61) are state-of-the-art.

Regional models such as the stretched-grid GNN [2409.02891] yield RMSE and equitable threat scores exceeding regional NWP at short leads, though deterministic loss functions still under-represent extremes.

## 6. Limitations, Challenges, and Prospective Advances

Current limitations include:
- *Dependence on analysis quality*: Users in data-sparse regions still require careful mapping or local enhancements for initial states [2308.04460], [2408.05472].
- *Extreme event underestimation*: Remedies include Exloss, quantile regression, ensemble augmentation, and tailored post-processing [2402.01295], [2409.02891].
- *Physical constraints*: Most models do not explicitly enforce conservation laws (mass, energy), risking dynamic inconsistency.
- *Uncertainty quantification*: Probabilistic ensemble approaches are still in early adoption outside the very largest systems [2508.18486], [2403.15598].
- *Station-level and diagnostic prediction scaling*: Modular two-stage approaches allow scalable addition of new diagnostic variables without backbone retraining [2312.00290].
- *Scalability and compute*: Regional split training and distributed variable representation cut resource demand, but optimal choices of split and aggregation remain an open research topic [2406.19615].

Future directions emphasize hybrid physics–ML architectures, integrated end-to-end DA, uncertainty-aware probabilistic forecasting, downscaling, and physically-constrained learning. Direct observation-space modeling circumvents traditional DA, enabling more flexible, rapid, and inclusive Earth system prediction [2407.15586].

## 7. Impact and Context in Operational Forecasting

Data-driven weather forecast models now rival NWP for global and medium-range skill, have fundamentally shifted the operational paradigm toward inference-based rapid updates, and enable:
- Near-real-time, regionally customized forecasts at reduced computational cost.
- Flexible deployment in resource-limited environments, with full support for bespoke diagnostic prediction and local adaptation [2404.00411].
- Robust, scalable integration with satellite and in situ observations, with direct forecast initialization bypassing traditional DA bottlenecks [2408.05472], [2508.18486].

Hybrid systems employing large-scale spectral nudging merge physics-based and ML-generated weather fields, leveraging strengths of both classes [2407.06100]. ExtremeCast [2402.01295] and similar systems demonstrate quantitative correction of tail biases inherent to symmetric loss convention, setting benchmarks for risk-sensitive applications.

A plausible implication is that large-scale, modular, and observation-driven data-driven models will increasingly underpin operational forecasting, with machine learning augmenting or even supplanting classic NWP infrastructure for certain predictands and regions. Operational centers are advised to incorporate loss design, ensemble augmentation, and rigorous benchmarking against multi-source analysis in future implementations to ensure reliability at extremes and in rapidly evolving meteorological conditions.

Source: https://www.emergentmind.com/topics/data-driven-weather-forecast-models