---
title: 'Prob-nnGParareal: Local nnGP in Parareal Solvers'
url: https://www.emergentmind.com/topics/prob-nngparareal
type: topic
---

# Prob-nnGParareal: Local nnGP in Parareal Solvers

Prob-nnGParareal is a variant of Prob-GParareal in which the Gaussian-process correction model used within Parareal is replaced by a nearest-neighbors Gaussian process, or nnGP. In the formulation introduced in "Prob-GParareal: A Probabilistic Numerical Parallel-in-Time Solver for Differential Equations" [2509.03945], the method is a probabilistic Parallel-in-Time solver for ODEs and PDEs that retains uncertainty quantification for the Parareal correction while reducing the prohibitive scaling of standard GP regression. Its defining feature is the use of local GP fits based on the $m \ll Nk$ nearest training points to a query state, rather than a GP trained on all accumulated correction data.

## 1. Position within the Parareal, GParareal, and Prob-GParareal lineage

Parareal solves an initial value problem over a time domain partitioned into $N$ subintervals by alternating a cheap coarse solver and a fine solver in a predictor–corrector iteration. In the classical formulation, the update is
\[
U_i^{(k+1)}=\mathcal G(U_{i-1}^{(k+1)})+\bigl[\mathcal F(U_{i-1}^{(k)})-\mathcal G(U_{i-1}^{(k)})\bigr],
\]
with convergence in $K_{\mathrm{Para}}<N$ iterations giving a speed-up approximately $N/K_{\mathrm{Para}}$ [2405.12182].

GParareal replaces the raw discrepancy $\delta(u)=\mathcal F(u)-\mathcal G(u)$ by a GP surrogate trained on all previous discrepancy evaluations. This reduces the number of Parareal iterations in many settings, but its covariance inversion grows as $O((kN)^3)$ per iteration because the training set accumulates across iterations [2405.12182]. Prob-GParareal extends that construction by sampling from the full GP posterior rather than using only a posterior mean, thereby quantifying uncertainty in the Parareal correction and propagating numerical uncertainty across time [2509.03945].

Prob-nnGParareal is the nearest-neighbors counterpart of Prob-GParareal. It inherits the probabilistic formulation of Prob-GParareal while replacing the full GP with local nnGP fits, reducing the cubic dependence on $Nk$ to a cubic dependence on the neighbor count $m$ [2509.03945]. This places it simultaneously in two lineages: the probabilistic extension of GParareal and the scalability-oriented nnGParareal construction of "Nearest Neighbors GParareal: Improving Scalability of Gaussian Processes for Parallel-in-Time Solvers" [2405.12182].

## 2. Local probabilistic correction model

The correction function is defined coordinatewise by
\[
f_c^{(s)}(u)\equiv(F-G)^{(s)}(u),
\]
with GP prior
\[
f_c^{(s)}(\cdot)\sim GP(0,K(\cdot,\cdot)).
\]
The kernel may be, for example, the squared-exponential kernel
\[
K(u,u')=\sigma_o^2\exp(-\|u-u'\|^2/\sigma_i^2),
\]
or a Matérn kernel $K_{\nu,\ell,\sigma_o}(\cdot,\cdot)$ [2509.03945].

The probabilistic Parareal update is expressed in terms of random states $U_{i,k}$:
\[
U_{i,k}=G(U_{i-1,k})+Z_{i,k},
\]
with
\[
Z_{i,k}\mid U_{i-1,k}=u \sim N_d\bigl(\mu_{D_k}(u),\Sigma_{D_k}(u)\bigr),
\]
where $\mu_{D_k}(u)$ and $\Sigma_{D_k}(u)$ are the posterior mean and covariance of the local nnGP approximation to $f_c(u)=F(u)-G(u)$ [2509.03945].

The essential algorithmic modification is local data selection. Rather than train on all
\[
D_k=\{(u_{i-1,j},f_c(u_{i-1,j}))\},
\]
the method trains at a test location $u'$ only on the $m$ nearest neighbor inputs $X_m=(x_1,\ldots,x_m)\subseteq D_k$, selected by Euclidean distance, together with outputs
\[
y_m=(f_c(x_j))_{j=1}^m.
\]
The resulting nnGP posterior for each coordinate is
\[
\mu_{nn}^{(s)}(u')=K(X_m,u')^T[K(X_m,X_m)+\sigma_{\mathrm{reg}}^2I]^{-1}y_m,
\]
\[
\sigma_{nn}^{(s)}(u')^2=K(u',u')-K(X_m,u')^T[K(X_m,X_m)+\sigma_{\mathrm{reg}}^2I]^{-1}K(X_m,u').
\]
This replaces a global GP inversion by repeated local inversions of size $m\times m$ [2509.03945].

A plausible implication is that the method trades a globally coherent covariance model for locality-adapted correction estimates. The construction is explicitly local in state space rather than global in iteration history.

## 3. Iterative workflow and distributional convergence

The high-level pseudocode in [2509.03945] treats the state on each interval as an empirical distribution rather than a single iterate. The inputs are an initial measure $P_{U0}$, a sample count $n$, coarse and fine solvers $G$ and $F$, a tolerance $\epsilon$, and neighbor count $m$.

Initialization proceeds by drawing $\{u_{0,0}^{(j)}\}_{j=1}^n\sim P_{U0}$ and propagating them through the coarse solver:
\[
u_{i,0}^{(j)} \leftarrow G(u_{i-1,0}^{(j)}),\qquad i=1,\ldots,N.
\]
At each subsequent iteration, the method first gathers summaries by computing
\[
\bar u_{i,k-1}\leftarrow \frac{1}{n}\sum_j u_{i,k-1}^{(j)}
\]
for each interval, and then evaluates $F(\bar u_{i,k-1})$ and $G(\bar u_{i,k-1})$ [2509.03945].

The training data are augmented via
\[
D_k \leftarrow D_{k-1}\cup \{(\bar u_{i,k-1},F(\bar u_{i,k-1})-G(\bar u_{i,k-1})) : i=0,\ldots,N-1\}.
\]
A kd-tree is then built over the inputs of $D_k$, and no global GP inversion is performed. For each sample trajectory and interval, the algorithm finds the $m$ nearest neighbors of $u_{i-1,k}^{(j)}$, computes $\mu_{nn}(u_{i-1,k}^{(j)})$ and $\sigma_{nn}(u_{i-1,k}^{(j)})^2$, draws
\[
z_{i,k}^{(j)}\sim N_d(\mu_{nn},\operatorname{diag}(\sigma_{nn}^2)),
\]
and sets
\[
u_{i,k}^{(j)}=G(u_{i-1,k}^{(j)})+z_{i,k}^{(j)}.
\]
Convergence is checked in distribution, for example by a Wasserstein distance on empirical measures, with termination when
\[
\mathrm{distance}\bigl(\mathrm{Emp}(U_{\cdot,k}),\mathrm{Emp}(U_{\cdot,k-1})\bigr)<\epsilon
\]
[2509.03945].

This workflow distinguishes Prob-nnGParareal from deterministic nnGParareal. In nnGParareal, the local GP posterior mean supplies a deterministic correction. In Prob-nnGParareal, the posterior also drives sampling, so the output is a time-indexed family of empirical distributions rather than a single corrected state sequence.

## 4. Complexity reduction and error-control structure

For the full-GP version Prob-GParareal, the correction cost at iteration $k$ is
\[
T_f^{GP}(k)=O(d(Nk)^2+(Nk)^3)\quad\text{[training]}
\]
plus
\[
O(N\cdot d\cdot n\cdot (Nk+(Nk)^2))\quad\text{[sampling]}.
\]
For Prob-nnGParareal, the corresponding correction cost is
\[
T_f^{nnGP}(k)=O(N\cdot d\cdot (m^2+m^3))\quad\text{[one local training per interval]}
\]
plus
\[
O(N\cdot d\cdot n\cdot (m+m^2+\log(Nk)))\quad\text{[sampling + neighbor search]}.
\]
Because $m\ll Nk$, this is described as a drastic reduction, typically $O(Nm^3+Nnm)$ [2509.03945].

The deterministic precursor nnGParareal is analyzed similarly in terms of local GP inversions and kd-tree neighbor search. There, the total model cost per iteration is
\[
T_{\mathrm{model}}(k)=O(d\,m^3+d\,N\log(kN)),
\]
and the complexity reduction is summarized as a shift from $O((kN)^3)$ to $O(d\,m^3+d\,N\log(kN))$ [2405.12182]. This suggests that Prob-nnGParareal inherits the same geometric advantage of locality, but with an added sampling layer.

The error-control statement in [2509.03945] is phrased in terms of variance propagation and Wasserstein distance. Under standard Lipschitz and GP-RKHS assumptions, if
\[
a:=2d(L_G^2+3L_c^2)<1,
\]
then for interval $i$ and iteration $k$,
\[
\max_s \mathrm{Var}[U_{i,k}^{(s)}]\le \sum_{j=0}^{i-1}a^{i-1-j}b_{j,k},
\]
and
\[
W_2^2(\delta_{u(t_i)},P_{U_{i,k}})\le \sum_{j=1}^i a^{i-j}b_{j,k},
\]
where
\[
b_{j,k}=O(h_{\rho,D_k}^{\alpha})
\]
involves the local fill distance $h_{\rho,D_k}$ of the training set around $U_{j-1,k}$ [2509.03945].

For the nnGP variant, the same type of bound holds with the fill distance computed over the $m$-neighbor subset, assuming the neighbor set adequately covers the local region. This makes the dependence on local data density explicit: the uncertainty and transport-error bounds are tied to how well the selected neighbors cover the relevant part of the state space.

## 5. Benchmark behavior on viscous Burgers’ equation

The principal PDE example in [2509.03945] is viscous Burgers’ equation,
\[
u_t=\nu u_{xx}-u\,u_x,
\]
on $x\in[-1,1]$ with $\nu=0.01$ and periodic boundary conditions, spatially discretized to $d=128$ ODEs. The time domain is partitioned into $N=128$ intervals over $[t_0,t_N]=[0,5]$. The coarse solver is $G=\mathrm{RK}(1)$ with $512$ steps, and the fine solver is $F=\mathrm{RK}(8)$ with $5.12\times 10^6$ steps [2509.03945].

The reported convergence and timing figures are as follows.

| Method | Convergence / model build | Total runtime |
|---|---:|---:|
| Parareal | $K_{\mathrm{conv}}=10$ | $\approx 1\mathrm{h}4\mathrm{m}$ |
| GParareal | $K_{\mathrm{conv}}=6$, model build $1\mathrm{h}2\mathrm{m}$ | $1\mathrm{h}39\mathrm{m}$ |
| nnGParareal | $K_{\mathrm{conv}}=9$, model $7$ min | $1\mathrm{h}3\mathrm{m}$ |
| Prob-nnGParareal $(m=15,n=5000)$ | $K_{\mathrm{conv}}=5$, model $3$ min | $\approx 33$ min |

For Prob-nnGParareal, the additional reported metrics relative to the fine solver are bias $\approx 3.2\times 10^{-7}$ and MSE $\approx 1.3\times 10^{-12}$. Proper scoring rules for the probabilistic forecast are MAD $\approx 3.5\times 10^{-13}$, VS $\approx 5.2\times 10^{-10}$, and ES $\approx 3.7\times 10^{-7}$ [2509.03945].

The same experiment is used to illustrate scalability relative to deterministic nearest-neighbor GP Parareal. In that setting, the method is reported as giving approximately a $2\times$ speed-up over nnGParareal on this PDE example [2509.03945]. This suggests that, at least for the reported Burgers configuration, the probabilistic local-GP formulation is not merely a UQ layer but also a computationally competitive solver configuration.

## 6. Integration, limitations, hyperparameters, and nomenclature

Prob-nnGParareal is designed as a minimally invasive modification of an existing Parareal implementation: it replaces only the GP training and prediction module, while leaving the coarse/fine solver calls and the domain decomposition untouched [2509.03945]. This is one reason it sits naturally beside earlier GP-based Parareal variants rather than requiring a new PinT framework.

The limitations recorded in [2509.03945] are local-data limitations rather than conceptual ones. If $m$ is too small, or if the training set is not locally dense, the nearest-neighbor approximation degrades; dynamic adaptation of $m$ may therefore be required. kd-tree search incurs $O(\log(Nk))$ per query, which can remain challenging in extreme high dimension. The uncertainty-quantification bounds rely on fill-distance assumptions, so if the sample states $U_{i,k}$ drift away from the training-data manifold, the error may grow.

The hyperparameter guidelines are likewise local. The number of neighbors should start with $m\approx 10$–$20$ and be increased until local GP posterior variance decays appropriately. Kernel lengthscales $\sigma_i,\sigma_o$ and regularization $\sigma_{\mathrm{reg}}$ may be tuned by marginal likelihood locally on each neighbor set, or fixed by “rulers” based on typical distances in $D_k$. The number of samples $n$ should be chosen so that empirical measures converge; $n=1000$–$5000$ is stated as often sufficient. The convergence tolerance $\epsilon$ is defined on the Wasserstein distance between successive empirical distributions, with values $10^{-7}$–$10^{-9}$ described as typically yielding good accuracy without excessive iterations. Early stopping can be based on forecast variance when it stops decreasing significantly [2509.03945].

A recurrent source of confusion is nomenclature. In the usage tied to [2509.03945], Prob-nnGParareal denotes the nearest-neighbors-GP variant of Prob-GParareal. By contrast, a separate summary associated with "Parallel-in-Time Solutions with Random Projection Neural Networks" [2408.09756] uses the same label for a Parareal method whose coarse propagator is a Random Projection Neural Network. The two constructions are technically distinct: one localizes GP corrections within a probabilistic Parareal framework, whereas the other replaces the coarse propagator by an RPNN. The nearest-neighbors-GP meaning is the one explicitly introduced as a variant of Prob-GParareal [2509.03945].

Source: https://www.emergentmind.com/topics/prob-nngparareal