---
title: 'RainShift: Precipitation Downscaling Benchmark'
url: https://www.emergentmind.com/topics/rainshift
type: topic
---

# RainShift: Precipitation Downscaling Benchmark

Searching arXiv for RainShift benchmark and closely related precipitation-shift work.
RainShift is a dataset and benchmark for evaluating precipitation downscaling under geographic distribution shifts. It is framed around the problem that Earth System Models are the main tool for projecting climate-change impacts, yet cannot feasibly be run at resolutions sufficient for local-scale risk assessments, while deep learning-based super-resolution models typically require retraining for each geographical area because climatic processes vary regionally and high-resolution observational data are unevenly available across the globe [2507.04930]. RainShift therefore targets cross-geography generalization: models are trained on data-rich regions in the Global North and evaluated zero-shot on data-sparse regions in the Global South, with the aim of quantifying how downscaling performance degrades under out-of-distribution geographic shift and which modeling or alignment strategies partially mitigate that degradation [2507.04930].

## 1. Definition and scope

RainShift is explicitly introduced as “a benchmark for precipitation downscaling across geographies” [2507.04930]. Its central task is probabilistic downscaling: given low-resolution meteorological inputs and invariant geographic covariates, a model is required to approximate the conditional distribution of higher-resolution precipitation fields,
\[
G(x)\sim p_G(\cdot\mid x), \qquad p_G(\cdot\mid x)\approx p(\,\cdot\mid x),
\]
where \(y\in\mathbb{R}^{200\times200}\), \(x_\ell\in\mathbb{R}^{9\times80\times80}\), \(x_h\in\mathbb{R}^{2\times200\times200}\), and the upsampling factor is \(N=200/80=2.5\) [2507.04930].

The benchmark is motivated by a particular failure mode of learned downscaling systems: they can perform competitively in-distribution yet degrade when transferred to climatically distinct regions. RainShift formalizes this issue through train/test splits in which the training and evaluation regions are disjoint and geographically differentiated, specifically contrasting dense observational coverage in the Global North with data-sparse areas in the Global South [2507.04930]. The benchmark therefore addresses not only super-resolution fidelity, but also the broader question of equitable access to high-resolution climate information across unevenly observed regions [2507.04930].

A broader usage of the term “RainShift” also appears in adjacent literature as shorthand for rain-related distribution shift problems in other domains, including rainy street-scene perception and precipitation nowcasting under non-stationary meteorological distributions [2104.04606; 2601.01605; 2601.20342]. In RainShift proper, however, the task is specifically geographic generalization in climate-scale precipitation downscaling [2507.04930].

## 2. Dataset construction and geographical design

RainShift combines low-resolution atmospheric inputs, high-resolution precipitation targets, and static geographic fields over a common spatial footprint. The low-resolution inputs \(x_{\ell}\) are ERA5 reanalysis from ECMWF on a regular \(0.25^\circ\times0.25^\circ\) grid, approximately \(25\) km per pixel in mid-latitudes, sampled hourly over 2001–2022. These inputs are organized as \(c=9\) channels on \(80\times80\) patches spanning \(20^\circ\times20^\circ\) [2507.04930]. The high-resolution targets \(y\) are NASA GPM IMERG Final Run V07 precipitation at \(0.1^\circ\times0.1^\circ\), approximately \(10\) km per pixel, originally half-hourly and aggregated to hourly over the same 2001–2022 period. These targets are single-channel \(200\times200\) patches over the same \(20^\circ\times20^\circ\) area [2507.04930]. The invariant geographic features \(x_h\) are land-sea mask and orography on the \(200\times200\) target grid [2507.04930].

The geographical split is intrinsic to the benchmark design. Training regions \(\{T_i\}_{i=1..12}\) consist of twelve \(20^\circ\times20^\circ\) patches in the Global North selected for dense observational coverage, whereas evaluation regions \(\{E_j\}_{j=1..6}\) are six \(20^\circ\times20^\circ\) patches in data-sparse areas of the Global South: Cape Horn, Amazon Basin, West Africa, Horn of Africa, Tibetan Plateau, and Melanesia [2507.04930]. Four nested training scenarios \(A_1\subset A_2\subset A_3\subset A_4\) are defined by unions of the \(T_i\), allowing systematic study of how expansion of the source training domain affects zero-shot transfer [2507.04930].

RainShift also introduces explicit distributional notation. If \((x_A,y_A)\sim p_A\) denotes samples from region \(A\), then the aggregated train and test input distributions are written as
\[
p_{\text{train}}(x)\;=\;\frac1{|T|}\sum_{i=1}^{12}p_{T_i}(x), \qquad
p_{\text{test}}(x)\;=\;\frac1{6}\sum_{j=1}^{6}p_{E_j}(x),
\]
and region-wise mean precipitation is summarized by
\[
\mu_{A} \;=\; \mathbb{E}_{(x,y)\sim p_A}\bigl[y\bigr].
\]
These definitions make the benchmark’s shift setting mathematically explicit: training and evaluation differ through geographically indexed underlying distributions rather than only through random holdout sampling [2507.04930].

## 3. Preprocessing and evaluation protocol

RainShift applies a four-stage preprocessing pipeline. First, ERA5 precipitation is clipped to \([\min(\mathrm{IMERG}),\,\max(\mathrm{IMERG})]\) to mitigate spurious light rain and extreme outliers; values below IMERG’s minimum are set to zero and values above its maximum are clipped [2507.04930]. Second, each variable is standardized via a global Z-score,
\[
\tilde x = \frac{x - \bar\mu}{\tilde\sigma},\quad
\tilde\sigma^2 \;=\;\frac1n\sum_{i=1}^n\bigl(\sigma_i^2+\mu_i^2\bigr)\;-\,\Bigl(\tfrac1n\sum_{i=1}^n\mu_i\Bigr)^2,
\]
where \(\mu_i,\sigma_i^2\) are region-wise mean and variance and \(n=|T|\) [2507.04930]. Third, a log-transform is applied to non-negative variables \((\mathrm{tp},\mathrm{cp},\text{orography})\),
\[
\hat x = \log\bigl(x\cdot10^3 + 10^5\bigr).
\]
Fourth, the resulting arrays are stored in Zarr format with 200-timestep chunks, approximately \(10\) MB for ERA5 and \(30\) MB for IMERG [2507.04930].

The benchmark uses both temporal and geographical separation. Temporally, models are trained on 2001–2020 and evaluated on 2021–2022, in a zero-shot setting with no target labels in evaluation [2507.04930]. Geographically, the sub-tasks are \(A_i\to E_j\) with \(A_i\cap E_j=\varnothing\), ensuring that generalization is genuinely cross-region rather than interpolative within a shared climate regime [2507.04930].

Performance is assessed with deterministic and probabilistic metrics. The Continuous Ranked Probability Score is defined as
\[
\mathrm{CRPS}(F,y)\;=\;\int_{-\infty}^\infty\bigl[F(z)-\mathbf1(z\ge y)\bigr]^2\,dz,
\]
and reduces to mean absolute error for deterministic outputs [2507.04930]. Peak Signal-to-Noise Ratio is defined by
\[
\mathrm{PSNR}(X,\widehat X) =10\log_{10}\!\Bigl(\frac{\max(X)^2}{\mathrm{MSE}(X,\widehat X)}\Bigr), \quad
\mathrm{MSE}(X,\widehat X) =\frac1{hw}\sum_{i,j}\bigl(X_{ij}-\widehat X_{ij}\bigr)^2.
\]
Structural Similarity Index is
\[
\mathrm{SSIM}(X,\widehat X) =\frac{(2\mu_X\mu_{\widehat X}+c_1)(2\sigma_{X\widehat X}+c_2)}
{(\mu_X^2+\mu_{\widehat X}^2+c_1)(\sigma_X^2+\sigma_{\widehat X}^2+c_2)},
\]
and Fractional Skill Score is
\[
\mathrm{FSS}=1-\frac{\sum_i(P_f(i)-P_o(i))^2}
{\sum_i\bigl(P_f(i)^2+P_o(i)^2\bigr)},
\]
with FSS ranging from \(0\) to \(1\) [2507.04930]. The metric suite reflects both pointwise fidelity and spatial organization, which is particularly relevant for precipitation fields.

## 4. Baseline models and domain-alignment strategy

RainShift evaluates several baseline families spanning deterministic, adversarial, and diffusion-based formulations. The simplest baseline is bilinear interpolation of ERA5 precipitation to the \(200\times200\) grid,
\[
\widehat y_{\mathrm{interp}}=\mathrm{Bilinear}(x_\ell^{\mathrm{tp}}),
\]
used as a lower bound [2507.04930]. The deterministic neural baseline is a fully convolutional residual network \(G_\theta\) trained by minimizing \(\ell_1\) loss,
\[
\min_\theta\;\mathbb{E}_{(x,y)\sim p_A}\bigl[\|G_\theta(x)-y\|_1\bigr].
\]
Adversarial modeling is represented by Wasserstein GAN with gradient penalty, with critic and generator losses
\[
\mathcal L_D =
\mathbb{E}_{y\sim p}\bigl[D(y)\bigr]
-\mathbb{E}_{x\sim p}\bigl[D\bigl(G(x)\bigr)\bigr]
+\lambda\, \mathbb{E}_{\hat y}\bigl[\bigl(\|\nabla_{\hat y}D(\hat y)\|_2-1\bigr)^2\bigr],
\]
\[
\mathcal L_G = -\mathbb{E}_{x\sim p}\bigl[D\bigl(G(x)\bigr)\bigr].
\]
The diffusion baseline uses a score network \(s_\theta(x_t,t)\) trained by denoising score matching,
\[
\min_\theta\; \mathbb{E}_{t,x_0,\epsilon}\Bigl[\bigl\|s_\theta(x_t,t) -\nabla_{x_t}\log p_{t|0}(x_t\mid x_0)\bigr\|_2^2\Bigr],
\]
with a forward SDE \(dx = f(x,t)\,dt + g(t)\,d w\) and a learned reverse SDE for sampling [2507.04930].

A central methodological component is domain alignment through quantile mapping applied to the low-resolution precipitation channel. To mitigate shifts where \(p_{\mathrm{train}}\neq p_{\mathrm{target}}\), RainShift uses
\[
\hat x_{\mathrm{target}} = F^{-1}_{\mathrm{train},h} \bigl(F_{\mathrm{target},h}(x_{\mathrm{target}})\bigr),
\]
where \(F_{*,h}\) are historical CDFs and \(h\) indexes the historical period; the multiplicative variant is used for non-negative variables [2507.04930]. This is not presented as a complete solution to geographic shift, but as a concrete mechanism for pre-aligning marginal input distributions across regions.

The benchmark’s methodological framing yields two immediate comparisons. First, it distinguishes deterministic super-resolution from probabilistic downscaling, with the latter better matched to uncertainty in precipitation fields [2507.04930]. Second, it separates raw model capacity from cross-domain alignment, showing that performance under shift depends not only on the generative architecture but also on how source and target distributions are brought into correspondence [2507.04930].

## 5. Empirical findings under geographic distribution shift

RainShift reports substantial out-of-distribution degradation across geographies. In absolute terms, ERA5 interpolation yields CRPS values ranging from \(0.120\) mm/h in Cape Horn to \(0.434\) mm/h in Melanesia [2507.04930]. Under the smallest training scenario \(A_1\), GAN achieves CRPS approximately \(0.075\)–\(0.326\), diffusion model approximately \(0.091\)–\(0.295\), while ResNet is unstable, including a case where CRPS tends to \(1.8\times 10^4\) in the Tibetan Plateau [2507.04930]. Under the largest training scenario \(A_4\), GAN and diffusion model reach CRPS approximately \(0.070\)–\(0.284\), substantially outperforming ResNet, which is around \(0.083\)–\(0.298\) [2507.04930].

Relative to interpolation, RainShift defines
\[
\Delta_{\mathrm{rel}}=
\frac{\mathrm{CRPS}_{\mathrm{interp}}-\mathrm{CRPS}_{\mathrm{model}}}
{\mathrm{CRPS}_{\mathrm{interp}}}\times100\%.
\]
Under this measure, GAN and diffusion model provide consistent gains of \(30\)–\(50\%\) across regions, except in two outlier cases, whereas ResNet provides only modest improvements and exhibits instabilities under strong shifts [2507.04930]. To quantify transfer loss against in-region training, the benchmark defines
\[
\Delta_{\mathrm{drop}}=
\frac{\mathrm{CRPS}_{A_i}-\mathrm{CRPS}_{E_j}}
{\mathrm{CRPS}_{E_j}} \times100\%,
\]
where \(\mathrm{CRPS}_{E_j}\) is the score when training directly on \(E_j\). For \(A_1\), this out-of-distribution drop reaches up to \(30\%\); even with the broadest source domain \(A_4\), residual drops up to \(17\%\) remain, with model- and region-dependent variation [2507.04930].

The effect of enlarging the source domain is heterogeneous. Expanding \(A_1\to A_4\) generally reduces CRPS, especially for GANs in high-rainfall regions such as the Amazon and Melanesia [2507.04930]. However, some regions, specifically the Horn of Africa and the Tibetan Plateau, show diminishing or no gains from adding more North-American and East-Asian data [2507.04930]. This suggests that source-domain diversity is beneficial but not sufficient when climatic regimes remain mismatched.

Quantile mapping improves CRPS in five of six regions for all models under the \(A_1\to E_j\) setting [2507.04930]. One reported example is the diffusion model in the Tibetan Plateau, improving from \(0.028\) to \(0.024\) mm/h, a \(14\%\) relative reduction [2507.04930]. The benchmark therefore supports a nuanced conclusion: geographic shift is persistent, but some part of it is addressable through relatively simple input-space alignment.

## 6. Relation to adjacent “RainShift” problems

The RainShift benchmark belongs to a wider family of distribution-shift problems involving rain, precipitation, and transfer across environments, but its formulation is distinct. In autonomous driving, RaidaR addresses rainy street-scene perception by providing a real-rain annotated dataset containing \(58{,}542\) rainy images, \(5{,}000\) rainy semantic annotations, and \(3{,}658\) rainy instance annotations, together with unpaired rain–sun translation methods such as Masked CycleGAN and Masked GANHopper [2104.04606]. That work states that incorporating RaidaR and masked translation-based synthetic images improves semantic and instance segmentation under rainy conditions and explicitly describes this as addressing the RainShift challenge [2104.04606]. Here, “RainShift” refers to weather-induced visual domain shift in perception.

In precipitation nowcasting, REE-TTT studies cross-regional extreme precipitation scenarios and uses an adaptive Test-Time Training mechanism to handle non-stationary meteorological distributions [2601.01605]. Its ST-TTT block combines a motion-enhanced query projection, a linear training view, and temporal attention in a self-supervised inner loop, with reported gains in Beijing single-region testing and Hangzhou zero-shot generalization [2601.01605]. The same details text explicitly frames this as handling distribution shifts in precipitation, again referring to such tasks as “RainShift” [2601.01605].

StormDiT extends the shift discussion to the “2–6 hour gray zone” in precipitation nowcasting, where extrapolation errors compound and numerical weather prediction remains too slow for storm-scale operational deployment [2601.20342]. Its report links this limitation directly to RainShift as an effort to extend high-resolution precipitation forecasts beyond the traditional nowcasting horizon and into the \(2\)–\(12\) h regime [2601.20342]. It further proposes several transferable ideas for RainShift, including unified latent-space generative modeling, causal spatiotemporal compression, rectified flow ODEs, global self-attention, probabilistic calibration via spread-skill analysis, and multi-modal extension [2601.20342].

These adjacent usages indicate that “RainShift” functions as a broader organizing concept for rain- or precipitation-related distribution shifts across multiple ML subfields. A plausible implication is that the benchmark definition in geographic downscaling [2507.04930] and the broader rain-shift usage in perception and nowcasting [2104.04606; 2601.01605; 2601.20342] are converging on a common concern: whether models trained under one meteorological or geographical regime remain reliable under another.

## 7. Significance, limitations, and methodological implications

RainShift is described as the first large-scale benchmark explicitly designed to measure how well deep downscaling models generalize across geographic distribution shifts, particularly from data-rich Global North regions to data-sparse Global South regions [2507.04930]. Its reported findings emphasize that geographic and climatic variability is the principal bottleneck to global generalization, more so than pure model architecture or data volume, and that probabilistic models such as GANs and diffusion models systematically outperform deterministic CNNs and interpolation in out-of-distribution settings [2507.04930].

The benchmark also motivates a set of best practices. It recommends probabilistic generative frameworks to capture precipitation uncertainty; domain-alignment methods such as quantile mapping or optimal-transport-based distribution matching; region-aware or meta-learning strategies such as location embeddings and task-informed meta-learning; physical constraints or hybrid physics-ML approaches; and selective augmentation of training data using climates analogous to the target region rather than uniform expansion from unrelated areas [2507.04930]. Because only quantile mapping is quantitatively evaluated in the reported experiments, the remaining items are best read as methodological recommendations rather than validated benchmark conclusions.

A common misconception in geographically transferred downscaling is that simply enlarging the training corpus will eliminate domain shift. RainShift directly contradicts this: expanding \(A_1\) to \(A_4\) generally helps, but residual performance drops remain and some target regions exhibit little benefit from added source data [2507.04930]. Another misconception is that deterministic super-resolution alone is sufficient if the network is large enough; the benchmark instead reports that deterministic ResNet can be unstable under strong shifts, whereas GAN and diffusion baselines remain more reliable [2507.04930].

Within the broader research landscape, RainShift can be interpreted as a benchmark that formalizes an increasingly central question in climate ML: not whether a model can downscale precipitation accurately somewhere, but whether it can do so where high-resolution information is most needed and least observed. The reported evidence suggests that geographic transfer is not a peripheral evaluation setting but the core criterion for real-world applicability in global precipitation downscaling [2507.04930].

Source: https://www.emergentmind.com/topics/rainshift