Online Rolling Controlled SMC

• ORCSMC is a method that extends controlled SMC for real-time filtering and smoothing in hidden Markov models using a rolling window mechanism.
• It employs dual particle systems and twisting functions to adaptively balance bias and variance while managing bounded computational resources.
• Empirical results reveal significant variance reduction and improved stability compared to standard bootstrap particle filtering in high-dimensional settings.

Online Rolling Controlled Sequential Monte Carlo (ORCSMC) is an advanced methodology for real-time inference in general-state-space hidden Markov models. By leveraging controlled sequential Monte Carlo techniques with a rolling window mechanism, ORCSMC delivers adaptive filtering and smoothing with bounded computational resources while significantly reducing variance compared to standard particle filtering approaches (Xue et al., 1 Aug 2025).

1. Formulation and Model Setting

ORCSMC operates within the standard hidden Markov (state-space) model framework on $\mathbb{R}^d$, with observations in $\mathbb{R}^{d'}$. The model comprises latent states $X_t$ evolving via Markov transitions

$$X_1 \sim \mu(x_1), \quad X_t \mid X_{t-1} = x_{t-1} \sim f_t(x_t \mid x_{t-1}),$$

and conditionally independent observations

$Y_t \mid X_t = x_t \sim g_t(y_t \mid x_t).$

The primary inferential objectives are: (i) online filtering ($p(x_t \mid y_{1:t})$), (ii) offline smoothing ($p(x_{1:T}\mid y_{1:T})$), and (iii) the marginal data likelihood ($p(y_{1:t})$).

2. Controlled SMC and Twisting Functions

The central mechanism underlying controlled SMC is the introduction of a time-indexed sequence of strictly positive twisting (or guiding) functions

$$\psi_t: \mathbb{R}^d \rightarrow (0,\infty), \quad t \geq 1,$$

used to reweight and transform the standard HMM measure. The resulting twisted model employs modified initial and transition densities,

$$\mu^\psi(x_1) = \frac{\mu(x_1)\psi_1(x_1)}{\mu(\psi_1)}, \quad f_t^\psi(x_t \mid x_{t-1}) = \frac{f_t(x_t\mid x_{t-1})\psi_t(x_t)}{Q_t^\psi(x_{t-1})},$$

and corresponding potential functions,

$\mathbb{R}^{d'}$0

The choice of $\mathbb{R}^{d'}$1 directly regulates importance-weight variance. An infeasible optimal regime, $\mathbb{R}^{d'}$2, makes incremental weights constant, resulting in zero-variance estimation, but is unavailable in closed form.

Offline CSMC estimates such twisting functions by alternating forward particle propagation (twisted auxiliary particle filtering, $\mathbb{R}^{d'}$3-APF) and backward least-squares updates on $\mathbb{R}^{d'}$4 using particle clouds over the trajectory.

3. Algorithmic Structure: Dual Particle Systems and Rolling Window

To meet real-time and bounded-resource requirements, ORCSMC utilizes two coupled particle systems, both employing the $\mathbb{R}^{d'}$5-APF within a rolling window of fixed lag $\mathbb{R}^{d'}$6:

A. Learning (Control) Particle Filter:

On each rolling window $\mathbb{R}^{d'}$7 with $\mathbb{R}^{d'}$8:

• Particles $\mathbb{R}^{d'}$9 are initialized with current twisting functions $X_t$0.
• For each of $X_t$1 twist-learning iterations:
  1. Forward pass (propagation and weighting via $X_t$2-APF) across the window, yielding weighted particle sets at each $X_t$3.
  2. Backward pass (for $X_t$4), updating $X_t$5 by least-squares regression over $X_t$6, typically in a parametric function class (e.g., exponentiated quadratics).

B. Estimation Particle Filter:

After $X_t$7 updates to $X_t$8, a single forward $X_t$9-APF is performed on $$X_1 \sim \mu(x_1), \quad X_t \mid X_{t-1} = x_{t-1} \sim f_t(x_t \mid x_{t-1}),$$0 to produce the filtering estimate and unbiased likelihood estimate $$X_1 \sim \mu(x_1), \quad X_t \mid X_{t-1} = x_{t-1} \sim f_t(x_t \mid x_{t-1}),$$1.

A key advantage is the $$X_1 \sim \mu(x_1), \quad X_t \mid X_{t-1} = x_{t-1} \sim f_t(x_t \mid x_{t-1}),$$2 per-step cost and $$X_1 \sim \mu(x_1), \quad X_t \mid X_{t-1} = x_{t-1} \sim f_t(x_t \mid x_{t-1}),$$3 memory usage, independent of $$X_1 \sim \mu(x_1), \quad X_t \mid X_{t-1} = x_{t-1} \sim f_t(x_t \mid x_{t-1}),$$4. This fixed resource profile enables true online operation.

4. Theoretical Properties and Statistical Guarantees

For any fixed twisting sequence $$X_1 \sim \mu(x_1), \quad X_t \mid X_{t-1} = x_{t-1} \sim f_t(x_t \mid x_{t-1}),$$5, the marginal likelihood estimator $$X_1 \sim \mu(x_1), \quad X_t \mid X_{t-1} = x_{t-1} \sim f_t(x_t \mid x_{t-1}),$$6 delivered by the $$X_1 \sim \mu(x_1), \quad X_t \mid X_{t-1} = x_{t-1} \sim f_t(x_t \mid x_{t-1}),$$7-APF shows unbiasedness: $$X_1 \sim \mu(x_1), \quad X_t \mid X_{t-1} = x_{t-1} \sim f_t(x_t \mid x_{t-1}),$$8 There exists an optimal, typically infeasible, twist policy $$X_1 \sim \mu(x_1), \quad X_t \mid X_{t-1} = x_{t-1} \sim f_t(x_t \mid x_{t-1}),$$9 that achieves zero-variance weights.

Under strong mixing and boundedness assumptions for the HMM and measurement density, both the twisted particle filter and the entire CSMC/ORCSMC stack admit a Central Limit Theorem for estimators of marginal means.

The rolling window design induces a bias-variance tradeoff: truncating twist function learning to the $Y_t \mid X_t = x_t \sim g_t(y_t \mid x_t).$0 most recent steps introduces bias relative to offline CSMC but yiels strong variance reduction compared to the standard bootstrap particle filter.

5. Algorithmic Details and Pseudocode

The ORCSMC method at each time $Y_t \mid X_t = x_t \sim g_t(y_t \mid x_t).$1 executes as follows (notation as above):

1. Set rolling window start $Y_t \mid X_t = x_t \sim g_t(y_t \mid x_t).$2.

2. Initialize learning particle system $Y_t \mid X_t = x_t \sim g_t(y_t \mid x_t).$3.
3. For $Y_t \mid X_t = x_t \sim g_t(y_t \mid x_t).$4: a. Forward propagate and weight learning particles via $Y_t \mid X_t = x_t \sim g_t(y_t \mid x_t).$5-APF over $Y_t \mid X_t = x_t \sim g_t(y_t \mid x_t).$6. b. Backward recursion: update $Y_t \mid X_t = x_t \sim g_t(y_t \mid x_t).$7 for $Y_t \mid X_t = x_t \sim g_t(y_t \mid x_t).$8 using weighted particles.
4. Forward $Y_t \mid X_t = x_t \sim g_t(y_t \mid x_t).$9-APF with final $p(x_t \mid y_{1:t})$0 for filtering and likelihood estimation.

Within both particle systems, resampling is triggered if the effective sample size falls below a threshold fraction $p(x_t \mid y_{1:t})$1. Proposals are drawn from the twisted kernel $p(x_t \mid y_{1:t})$2, and second-stage weights utilize $p(x_t \mid y_{1:t})$3.

6. Empirical Performance and Practical Considerations

Numerical experiments on linear-Gaussian models, stochastic volatility models, and neuroscience-inspired binomial models demonstrate that ORCSMC consistently attains substantial variance reduction, stability, and accuracy advantages versus both the bootstrap particle filter and offline CSMC (Xue et al., 1 Aug 2025).

• In high-dimensional Gaussian models, ORCSMC achieves stable $p(x_t \mid y_{1:t})$4-errors and RMSE of $p(x_t \mid y_{1:t})$5 across dimensions $p(x_t \mid y_{1:t})$6, greatly outperforming BPF (e.g., BPF with $p(x_t \mid y_{1:t})$7 vs. ORCSMC with $p(x_t \mid y_{1:t})$8).
• For univariate stochastic volatility ($p(x_t \mid y_{1:t})$9), increasing lag $p(x_{1:T}\mid y_{1:T})$0 sharply reduces $p(x_{1:T}\mid y_{1:T})$1-likelihood variance; the method preserves performance in non-Gaussian, heteroskedastic regimes.
• In multichannel binomial models, moderate window sizes maintain effective sample size and stable marginal-likelihood variance even as dimension increases.

The fixed lag $p(x_{1:T}\mid y_{1:T})$2 and iterations $p(x_{1:T}\mid y_{1:T})$3 permit tuning the bias-variance balance for target applications; larger $p(x_{1:T}\mid y_{1:T})$4 trades increased computation for offline CSMC-level accuracy, while small $p(x_{1:T}\mid y_{1:T})$5 offers rapid response with bounded effort.

7. Connections, Impact, and Significance

ORCSMC extends the foundational work on controlled SMC and twisted particle filtering to an online, receding-horizon context. The design systematically overcomes the computational scaling and memory limits of full-trajectory CSMC, while preserving its crucial statistical efficiency benefits, particularly variance control, in real-time applications (Xue et al., 1 Aug 2025).

This makes ORCSMC attractive for sequential latent-state inference in complex, high-dimensional, and non-Gaussian state-space models where standard methods such as the bootstrap filter are either unstable or computationally impractical. The use of dual particle systems to learn and exploit twisting functions in real time, combined with rigorous statistical guarantees and demonstrated empirical superiority, establishes ORCSMC as a robust and practically deployable technique for modern sequential inference problems.