Reverse Martingale RNN Overview

• Reverse Martingale RNN is a recurrent network regularized by a learned backward projector that enforces approximate hidden-state reconstructibility.
• It couples probabilistic forecasting with a reverse-martingale penalty to improve early warnings for droughts and flash floods while reducing false alarms.
• Empirical studies show that RMRNN preserves forecast accuracy while stabilizing latent dynamics, leading to improved anomaly detection and timely warnings.

Searching arXiv for the specified RMRNN papers and closely related work to ground the article. Reverse Martingale RNN (RMRNN) denotes a class of recurrent neural networks trained with an auxiliary backward-coherence regularizer that encourages the hidden-state trajectory to be approximately reconstructible from future hidden states. In the precipitation-forecasting formulations introduced in 2026, the method couples a conventional probabilistic forecasting head with a learned backward projector $g_\phi$, so that the same latent trajectory used for prediction also yields a residual process for online drought or flood warning (Hui-Mean et al., 26 May 2026). A broader theoretical treatment casts the induced hidden-state dynamics as a quasi-reverse-martingale under contraction and summable backward drift, providing convergence, stopping-time, and confidence-sequence results under stated assumptions (Chang, 8 Jun 2026). The approach is therefore both a regularization strategy for latent-state stability and a mechanism for sequential change detection.

1. Definition and formal structure

RMRNN is built on the hidden-state sequence $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$ of a recurrent network. In the precipitation studies, the relevant filtration is the decreasing “future” filtration

$\mathcal{G}_t = \sigma(h_s : s \ge t),$

or equivalently the backward filtration

$F_t^{\rm bwd} = \sigma(h_t, h_{t+1}, \dots),$

and the core idea is to make $h_t$ approximately recoverable from $h_{t+1}$ through a learned one-step backward projector $g_\phi$ (Hui-Mean et al., 26 May 2026, Chang, 8 Jun 2026).

The regularized model introduces the penalty

$$L_{\rm RM}(\theta,\phi) = \frac{1}{T-1}\sum_{t=1}^{T-1} \|h_t - g_\phi(h_{t+1})\|^2,$$

which penalizes hidden-state incoherence when traversed backward in time (Hui-Mean et al., 26 May 2026). In the forecasting papers, this is described as encouraging the trajectory to be “back-coherent,” or approximately a reverse martingale, via the approximation

$$E[h_t \mid \mathcal{G}_{t+1}] \approx g_\phi(h_{t+1}) \, .$$

The theoretical paper uses analogous notation, defining the one-step backward-prediction residual

$\delta_t = h_t - g_\phi(h_{t+1}),$

and treats backward coherence as the practical condition that $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$0 (Chang, 8 Jun 2026).

Formally, the exact reverse-martingale definition given in the theory paper is that a sequence $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$1 satisfies

$\{h_t\}_{t=1}^T \subset \mathbb{R}^d$2

with each $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$3 measurable with respect to the decreasing filtration $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$4 (Chang, 8 Jun 2026). The precipitation papers do not claim exact satisfaction of this condition; rather, they regularize hidden states so that backward reconstruction defects become small and informative (Hui-Mean et al., 26 May 2026, Foo et al., 1 Jul 2026).

2. Architecture and training objective

In its precipitation-forecasting instantiations, RMRNN augments a standard recurrent backbone with a small backward projector. One formulation uses a GRU with hidden dimension $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$5, typically $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$6–$\{h_t\}_{t=1}^T \subset \mathbb{R}^d$7, and in the principal experiments sets $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$8 (Hui-Mean et al., 26 May 2026). Another formulation presents the method more generally for Elman, GRU, or LSTM cells, and reports a main implementation based on a single-layer Elman RNN with hidden dimension $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$9 (Foo et al., 1 Jul 2026). This variation indicates that the reverse-martingale penalty is not tied to a single recurrent cell family.

The backward projector $\mathcal{G}_t = \sigma(h_s : s \ge t),$0 is a small MLP. In the GRU-based precipitation system it is specified as a two-layer residual form,

$\mathcal{G}_t = \sigma(h_s : s \ge t),$1

and in the reported implementation it is a two-layer MLP with hidden width 64 and ReLU activation (Hui-Mean et al., 26 May 2026). Training proceeds by backpropagation through time, with gradients from both the forecast-generation path and the reverse-martingale penalty accumulated jointly (Hui-Mean et al., 26 May 2026).

The combined objective in the precipitation forecasting paper is

$\mathcal{G}_t = \sigma(h_s : s \ge t),$2

where $\mathcal{G}_t = \sigma(h_s : s \ge t),$3 is the negative log-score or CRPS of a two-part precipitation distribution consisting of dry probability $\mathcal{G}_t = \sigma(h_s : s \ge t),$4 and a $\mathcal{G}_t = \sigma(h_s : s \ge t),$5 component for $\mathcal{G}_t = \sigma(h_s : s \ge t),$6 (Hui-Mean et al., 26 May 2026). The penalty schedule is staged: $\mathcal{G}_t = \sigma(h_s : s \ge t),$7 for the first $\mathcal{G}_t = \sigma(h_s : s \ge t),$8 warm-up epochs, followed by

$\mathcal{G}_t = \sigma(h_s : s \ge t),$9

with $F_t^{\rm bwd} = \sigma(h_t, h_{t+1}, \dots),$0 and $F_t^{\rm bwd} = \sigma(h_t, h_{t+1}, \dots),$1, yielding $F_t^{\rm bwd} = \sigma(h_t, h_{t+1}, \dots),$2 at the final epoch (Hui-Mean et al., 26 May 2026). A related presentation reports the same warm-up-and-decay pattern with total epochs $F_t^{\rm bwd} = \sigma(h_t, h_{t+1}, \dots),$3 (Foo et al., 1 Jul 2026).

The practical training setup reported for the GRU-based model includes Adam with learning rate $F_t^{\rm bwd} = \sigma(h_t, h_{t+1}, \dots),$4, batch size 32, sequence length 168 under sliding-window BPTT, no dropout, forecast lead times of 1–72 h for hourly data and 1–7 days for daily data, and spatial neighbourhood radius $F_t^{\rm bwd} = \sigma(h_t, h_{t+1}, \dots),$5 equal to 10 km for Taiwan CWA, 50 km for CHIRPS, and 100 km for GHCN Texas (Hui-Mean et al., 26 May 2026). The more general precipitation study uses Adam with learning rate $F_t^{\rm bwd} = \sigma(h_t, h_{t+1}, \dots),$6, 200 epochs, past 30 days of standardized $F_t^{\rm bwd} = \sigma(h_t, h_{t+1}, \dots),$7 for daily stations, and past 1–6 h for hourly CWA/ERA5-Land data (Foo et al., 1 Jul 2026).

3. Residual process and sequential warning

A distinctive feature of RMRNN is that the same latent defect used in regularization becomes the basis of online warning. In the GRU precipitation model, the one-step backward-coherence residual is defined as

$F_t^{\rm bwd} = \sigma(h_t, h_{t+1}, \dots),$8

then reduced to a scalar anomaly score, for example by Euclidean norm or projection, and standardized under pre-event climatology mean and standard deviation $F_t^{\rm bwd} = \sigma(h_t, h_{t+1}, \dots),$9 via

$h_t$0

A calibrated pseudo-likelihood ratio

$h_t$1

drives a Shiryaev–Roberts (SR) recursion

$h_t$2

with stopping time

$h_t$3

and default $h_t$4 (Hui-Mean et al., 26 May 2026).

The algorithmic workflow reported for this system is explicit: after training, residuals on held-out climatology are used to estimate $h_t$5; the SR threshold $h_t$6 is calibrated by Monte Carlo to achieve a target $h_t$7; online, each new $h_t$8 yields $h_t$9, then $h_{t+1}$0, $h_{t+1}$1, $h_{t+1}$2, and $h_{t+1}$3, with an alarm when $h_{t+1}$4 (Hui-Mean et al., 26 May 2026). Reported calibrations are $h_{t+1}$5 days for drought and $h_{t+1}$6 hours for flash-flood (Hui-Mean et al., 26 May 2026).

A parallel precipitation paper uses the same backward defect concept but pairs it with one-sided CUSUM rather than Shiryaev–Roberts. There,

$h_{t+1}$7

is standardized using held-out climatology to produce $h_{t+1}$8, after which the detector updates

$h_{t+1}$9

with $g_\phi$0, shift direction $g_\phi$1 for drought and $g_\phi$2 for heavy rain, and threshold $g_\phi$3 calibrated by Monte Carlo to meet a target no-change average run length $g_\phi$4 such as 365 days (Foo et al., 1 Jul 2026).

This methodological divergence is important. RMRNN refers to the regularized recurrent architecture and its latent defect, not to a single fixed sequential detector. The common principle is that backward reconstruction defect acts as a regime-sensitive online statistic. A plausible implication is that the architecture and the change-point test are modular components: the forecasting papers instantiate this with SR in one case and CUSUM in another (Hui-Mean et al., 26 May 2026, Foo et al., 1 Jul 2026).

4. Empirical performance in precipitation forecasting and early warning

The first dedicated precipitation study evaluates RMRNN on the Taiwan CWA dense rain-gauge network, CHIRPS v2 daily gridded precipitation over Taiwan and the Horn of Africa, and NOAA GHCN-Daily stations over the Texas Hill Country (Hui-Mean et al., 26 May 2026). Across 1,000 replications, the model is reported to match or slightly improve the GRU baseline in RMSE, MAE, and CRPS at 1 h–72 h lead while substantially improving alarm characteristics (Hui-Mean et al., 26 May 2026).

The paper reports representative forecast-skill values as mean $g_\phi$5 SD over 1,000 replications:

Benchmark	GRU	RMRNN
Taiwan (Tamsui basin, 1 h lead), CRPS	$g_\phi$6	$g_\phi$7
CHIRPS Horn of Africa (1 d lead), CRPS	$g_\phi$8	$g_\phi$9
ERA5-Land (1 h lead), CRPS	$$L_{\rm RM}(\theta,\phi) = \frac{1}{T-1}\sum_{t=1}^{T-1} \|h_t - g_\phi(h_{t+1})\|^2,$$0	$$L_{\rm RM}(\theta,\phi) = \frac{1}{T-1}\sum_{t=1}^{T-1} \|h_t - g_\phi(h_{t+1})\|^2,$$1

The same study reports stronger gains for early warning. For drought detection on CHIRPS Taiwan at $$L_{\rm RM}(\theta,\phi) = \frac{1}{T-1}\sum_{t=1}^{T-1} \|h_t - g_\phi(h_{t+1})\|^2,$$2 days, CUSUM on SPI-3 achieves detection $$L_{\rm RM}(\theta,\phi) = \frac{1}{T-1}\sum_{t=1}^{T-1} \|h_t - g_\phi(h_{t+1})\|^2,$$3, FAR $$L_{\rm RM}(\theta,\phi) = \frac{1}{T-1}\sum_{t=1}^{T-1} \|h_t - g_\phi(h_{t+1})\|^2,$$4, lead $$L_{\rm RM}(\theta,\phi) = \frac{1}{T-1}\sum_{t=1}^{T-1} \|h_t - g_\phi(h_{t+1})\|^2,$$5 d, whereas SR on RMRNN achieves detection $$L_{\rm RM}(\theta,\phi) = \frac{1}{T-1}\sum_{t=1}^{T-1} \|h_t - g_\phi(h_{t+1})\|^2,$$6, FAR $$L_{\rm RM}(\theta,\phi) = \frac{1}{T-1}\sum_{t=1}^{T-1} \|h_t - g_\phi(h_{t+1})\|^2,$$7, lead $$L_{\rm RM}(\theta,\phi) = \frac{1}{T-1}\sum_{t=1}^{T-1} \|h_t - g_\phi(h_{t+1})\|^2,$$8 d (Hui-Mean et al., 26 May 2026). For flash-flood detection in Tamsui at $$L_{\rm RM}(\theta,\phi) = \frac{1}{T-1}\sum_{t=1}^{T-1} \|h_t - g_\phi(h_{t+1})\|^2,$$9 h, an operational threshold achieves detection $$E[h_t \mid \mathcal{G}_{t+1}] \approx g_\phi(h_{t+1}) \, .$$0, FAR $$E[h_t \mid \mathcal{G}_{t+1}] \approx g_\phi(h_{t+1}) \, .$$1, lead $$E[h_t \mid \mathcal{G}_{t+1}] \approx g_\phi(h_{t+1}) \, .$$2 h, whereas SR on RMRNN achieves detection $$E[h_t \mid \mathcal{G}_{t+1}] \approx g_\phi(h_{t+1}) \, .$$3, FAR $$E[h_t \mid \mathcal{G}_{t+1}] \approx g_\phi(h_{t+1}) \, .$$4, lead $$E[h_t \mid \mathcal{G}_{t+1}] \approx g_\phi(h_{t+1}) \, .$$5 h (Hui-Mean et al., 26 May 2026). The summary statement is that the SR detector reduces false-alarm ratios by a factor of three to five at matched detection power, and case studies include the 2020–2021 Taiwan drought being flagged 8–12 days earlier than SPI-3 thresholding and the 2023 Typhoon Haikui flood being signalled 4 h before the CWA operational alert (Hui-Mean et al., 26 May 2026).

A second precipitation paper broadens the climatic scope to monsoonal Taiwan, semi-arid Texas, temperate Germany, and Mediterranean Anatolia (Turkey), using CWA historical archive and GHCN-Daily station networks (Foo et al., 1 Jul 2026). Across all four networks—Texas $$E[h_t \mid \mathcal{G}_{t+1}] \approx g_\phi(h_{t+1}) \, .$$6, Germany $$E[h_t \mid \mathcal{G}_{t+1}] \approx g_\phi(h_{t+1}) \, .$$7, Turkey $$E[h_t \mid \mathcal{G}_{t+1}] \approx g_\phi(h_{t+1}) \, .$$8, Taiwan $$E[h_t \mid \mathcal{G}_{t+1}] \approx g_\phi(h_{t+1}) \, .$$9—RMRNN versus GRU and unregularized variants shows test MSE difference within $\delta_t = h_t - g_\phi(h_{t+1}),$0, with test MAE and CRPS indistinguishable, while hidden-state instability

$\delta_t = h_t - g_\phi(h_{t+1}),$1

is reduced by 43–55% compared to unregularized and by $\delta_t = h_t - g_\phi(h_{t+1}),$2 compared to GRU (Foo et al., 1 Jul 2026). Heavy-rain AUC(P95) and CSI are reported as preserved (Foo et al., 1 Jul 2026).

For drought-warning lead against SPI-3 at matched $\delta_t = h_t - g_\phi(h_{t+1}),$3 year, the same paper reports the following real-drought results:

Region/event	Lead over SPI-3	Additional reported outcome
Texas (2010–2015 flash drought)	median $\delta_t = h_t - g_\phi(h_{t+1}),$4 days	RM earlier in 92% of runs; detection 96% vs 92%
Germany (2018 drought)	$\delta_t = h_t - g_\phi(h_{t+1}),$5 days	RM earlier in 74% of runs; detection 89% vs 94%
Turkey (2013–2014 drought)	$\delta_t = h_t - g_\phi(h_{t+1}),$6 days	RM earlier in 54% of runs; detection 95% vs 92%
Taiwan (2020–2021 drought)	island-wide median $\delta_t = h_t - g_\phi(h_{t+1}),$7 days	positive lead on five headwater stations, negative on windward/coastal stations

These results show that gains are not uniform. The authors explicitly propose an interpretation: the reverse-martingale defect leads when drought onset is a multivariate regime shift that precedes rainfall deficit, but shows no lead where rainfall deficit itself is the onset signal (Foo et al., 1 Jul 2026). A controlled synthetic study supports this heterogeneity: for injected drought onsets with known times, CUSUM on RM defect detects 92% of events versus 83% for SPI-3, with median lead $\delta_t = h_t - g_\phi(h_{t+1}),$8 days at matched $\delta_t = h_t - g_\phi(h_{t+1}),$9; for injected heavy-rain onsets, precipitation CUSUM detects 95% in 3 timesteps, while RM-defect CUSUM detects only 14%, indicating no anomaly advantage for sharp wet onset (Foo et al., 1 Jul 2026).

5. Theoretical foundations: quasi-reverse-martingale perspective

The 2026 theory paper places RMRNN in a probabilistic framework centered on contraction, backward approximation, and quasi-martingale structure (Chang, 8 Jun 2026). It assumes an RNN state update $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$00, a backward projector $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$01, and two main conditions. Assumption A is contraction: $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$02 for some $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$03. Assumption B is summable backward approximation error, where

$\{h_t\}_{t=1}^T \subset \mathbb{R}^d$04

satisfies $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$05 (Chang, 8 Jun 2026). Under these and additional finite-moment and backward-sufficiency conditions, the hidden-state sequence is described as a quasi-reverse-martingale.

The central convergence theorem states that if

$\{h_t\}_{t=1}^T \subset \mathbb{R}^d$06

then $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$07 converges almost surely to a limit $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$08; with uniform integrability, convergence also holds in $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$09 (Chang, 8 Jun 2026). Under exponentially $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$10-mixing inputs and geometrically decaying defect, the paper gives the rate

$\{h_t\}_{t=1}^T \subset \mathbb{R}^d$11

for $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$12 (Chang, 8 Jun 2026).

The same framework yields pathwise stopping and uncertainty constructions. Defining the increment sum

$\{h_t\}_{t=1}^T \subset \mathbb{R}^d$13

the stopping time

$\{h_t\}_{t=1}^T \subset \mathbb{R}^d$14

is almost surely finite, and the tubes

$\{h_t\}_{t=1}^T \subset \mathbb{R}^d$15

contain $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$16 for all $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$17 (Chang, 8 Jun 2026). If an observable upper bound $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$18 satisfies simultaneous coverage, then

$\{h_t\}_{t=1}^T \subset \mathbb{R}^d$19

forms a time-uniform confidence sequence (Chang, 8 Jun 2026).

The paper also shows that under a Gaussian backward model

$\{h_t\}_{t=1}^T \subset \mathbb{R}^d$20

minimizing the empirical backward-coherence loss is equivalent to minimizing a Kullback–Leibler divergence to the true conditional backward model, which links the method to variational inference (Chang, 8 Jun 2026). This suggests that RMRNN regularization can be read not only as a stability penalty but also as a quasi-likelihood objective on hidden-state transitions.

6. Related formulations, extensions, and limitations

RMRNN emerged from precipitation forecasting and early warning, but the theoretical paper and later application study treat backward coherence as a more general recurrent-state regularizer (Hui-Mean et al., 26 May 2026, Chang, 8 Jun 2026, Foo et al., 1 Jul 2026). The general algorithmic form is

$\{h_t\}_{t=1}^T \subset \mathbb{R}^d$21

with

$\{h_t\}_{t=1}^T \subset \mathbb{R}^d$22

and the task loss instantiated as cross-entropy, MSE, NLL, or CRPS depending on the domain (Chang, 8 Jun 2026).

Empirical studies outside hydroclimate are reported in the theoretical paper. On PhysioNet 2012 ICU mortality prediction, RMRNN matches RNN AUC while reducing stability time $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$23 from 34.7 h to 21.6 h, i.e., 13 h earlier stability (Chang, 8 Jun 2026). On FRED-MD one-month-ahead industrial production, MSE decreases from 0.0419 for RNN to 0.0111 for RMRNN, while a BVAR(4) yields 0.0001 (Chang, 8 Jun 2026). On UCI Human Activity Recognition, accuracy is approximately 0.82 for all RNNs and 0.53 for HMM, and RMRNN exhibits lower post-transition tracking error with empirical geometric decay rate $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$24 (Chang, 8 Jun 2026). These results support the claim that backward coherence can improve latent stability without degrading task performance, although the same paper explicitly states that the guarantees apply under the stated assumptions and that universality is not claimed (Chang, 8 Jun 2026).

Several extensions are proposed in the literature. The precipitation study suggests spatial coupling via graph RNNs, attention-based or Transformer sequence models with a backward-coherence head, streaming calibration of the RM loss for online training, terrain-aware neighbourhood definitions in complex orography, and hybrid embeddings of large-scale climate indices such as ENSO in the hidden state (Foo et al., 1 Jul 2026). The theory paper similarly notes that extension to LSTM or GRU requires verifying contraction $\{h_t\}_{t=1}^T \subset \mathbb{R}^d$25 or using Zoneout or spectral-norm gating, and identifies Transformer analogues based on backward filtrations as an open problem (Chang, 8 Jun 2026).

A recurring limitation is event dependence. The hydroclimate studies do not claim universal lead-time improvement. One precipitation paper states that the benefit is large in one region, partial in two others, and near-absent in the fourth, with hydroclimatic character of drought onset offered as a plausible explanation to be tested in future work (Foo et al., 1 Jul 2026). The same work finds that the anomaly advantage largely disappears for abrupt heavy-rain onset in synthetic experiments (Foo et al., 1 Jul 2026). Accordingly, a common misconception—that backward-coherence residuals should uniformly outperform direct thresholding for all hazards—is not supported by the reported evidence.

RMRNN is therefore best understood as a conservative recurrent design in which forecast skill is preserved while hidden-state dynamics are regularized into a more stable, diagnostically useful form. In the published precipitation applications, this design supports calibrated early-warning signals for drought and, in some settings, flash-flood risk, while the theoretical work frames those empirical gains within a quasi-reverse-martingale analysis of hidden-state convergence and stability (Hui-Mean et al., 26 May 2026, Chang, 8 Jun 2026).