Papers
Topics
Authors
Recent
Search
2000 character limit reached

Next Gaussian Prediction (NGP)

Updated 13 May 2026
  • NGP is a unified algorithmic framework that performs one-step ahead prediction in Gaussian process models using generalized moment-based covariance structures.
  • It extends classical methods like the Szegő–Verblunsky and Durbin–Levinson recurrences by leveraging orthogonal rational functions for efficient computation.
  • The framework accommodates stationary, nonstationary, and ARMA-type processes, providing explicit formulas for optimal predictors and error variances.

Next Gaussian Prediction (NGP) is a unified algorithmic framework for one-step ahead prediction in Gaussian process models with generalized covariance structures, built on the Kreĭn–Nudel’man theory of generalized moments. NGP encompasses stationary Gaussian processes, ARMA models, and a broad class of nonstationary, varying ("generalized stationary") Gaussian processes by expressing their covariances in terms of orthogonal rational functions (ORFs) on the unit circle. The prediction scheme generalizes the classical Szegő–Verblunsky and Durbin–Levinson recursions, providing explicit computation of best linear predictors, error variances, and orthonormal bases via the Schur-type multipoint algorithm (Baratchart et al., 2010).

1. Generalized Moment Gaussian Processes

NGP begins by fixing a system of continuous functions W={w0,w1,}C(T)W = \{w_0, w_1, \ldots \} \subset C(\mathbb{T}), where T={eit:t[0,2π)}\mathbb{T} = \{ e^{it} : t \in [0,2\pi) \} denotes the unit circle. This system is required to satisfy the Kreĭn–Nudel’man positivity condition: for every nn, there exist constants {ak}\{a_k\} such that

k=0n(akwk(z)+akwk(z))>0zT.\sum_{k=0}^{n} (a_k w_k(z) + \overline{a_k} \overline{w_k(z)}) > 0 \quad \forall z \in \mathbb{T}.

A sequence {ck}k=0\{c_k\}_{k=0}^\infty is a positive generalized-moment sequence with respect to WW if

[k=0n(akwk+akwk)0 on T]    [k=0n(akck+akck)0],\left[ \sum_{k=0}^{n} (a_k w_k + \overline{a_k} \overline{w_k}) \geq 0 \text{ on } \mathbb{T} \right] \implies \left[ \sum_{k=0}^{n} (a_k c_k + \overline{a_k} \overline{c_k}) \geq 0 \right],

for all finite sequences {ak}\{a_k\}. The Kreĭn–Nudel’man theorem ensures the existence of a unique positive Borel measure σ\sigma on T={eit:t[0,2π)}\mathbb{T} = \{ e^{it} : t \in [0,2\pi) \}0 such that

T={eit:t[0,2π)}\mathbb{T} = \{ e^{it} : t \in [0,2\pi) \}1

A zero-mean Gaussian process T={eit:t[0,2π)}\mathbb{T} = \{ e^{it} : t \in [0,2\pi) \}2 is called a T={eit:t[0,2π)}\mathbb{T} = \{ e^{it} : t \in [0,2\pi) \}3-varying Gaussian process (W-VGP) if its covariance admits the generalized-Toeplitz form

T={eit:t[0,2π)}\mathbb{T} = \{ e^{it} : t \in [0,2\pi) \}4

This framework extends the class of stationary Gaussian processes (recovered by T={eit:t[0,2π)}\mathbb{T} = \{ e^{it} : t \in [0,2\pi) \}5) and accommodates a variety of nonstationary and rational spectral structures.

2. Spectral Representation and Covariance Structure

For any W-VGP, the generalized Herglotz and Kolmogorov–Wiener–Masani theories guarantee the existence of a unique orthogonal-increment Gaussian measure T={eit:t[0,2π)}\mathbb{T} = \{ e^{it} : t \in [0,2\pi) \}6, supported on T={eit:t[0,2π)}\mathbb{T} = \{ e^{it} : t \in [0,2\pi) \}7, satisfying

T={eit:t[0,2π)}\mathbb{T} = \{ e^{it} : t \in [0,2\pi) \}8

for Borel sets T={eit:t[0,2π)}\mathbb{T} = \{ e^{it} : t \in [0,2\pi) \}9. Each process variable admits the spectral integral representation

nn0

with covariance structure immediately following:

nn1

3. One-Step Prediction via Orthogonal Rational Functions

The optimal one-step prediction in NGP is obtained in nn2 by first applying the Gram–Schmidt process to the system nn3, yielding a family of orthonormal functions nn4 satisfying

nn5

By the isometry nn6, the closed span of nn7 in nn8 is mapped to nn9 in {ak}\{a_k\}0. The next-step linear predictor is the {ak}\{a_k\}1 projection:

{ak}\{a_k\}2

which pulls back to

{ak}\{a_k\}3

with {ak}\{a_k\}4. The mean-square prediction error is

{ak}\{a_k\}5

4. Orthonormal Rational Systems and Schur-Type Recurrences

In the notable case where {ak}\{a_k\}6 is the sequence of simple Blaschke products at prescribed poles {ak}\{a_k\}7,

{ak}\{a_k\}8

the orthonormal family {ak}\{a_k\}9 becomes the system of classical orthogonal rational functions (ORFs) on the unit circle. These satisfy a two-term Schur-type recurrence:

k=0n(akwk(z)+akwk(z))>0zT.\sum_{k=0}^{n} (a_k w_k(z) + \overline{a_k} \overline{w_k(z)}) > 0 \quad \forall z \in \mathbb{T}.0

where k=0n(akwk(z)+akwk(z))>0zT.\sum_{k=0}^{n} (a_k w_k(z) + \overline{a_k} \overline{w_k(z)}) > 0 \quad \forall z \in \mathbb{T}.1 is the k=0n(akwk(z)+akwk(z))>0zT.\sum_{k=0}^{n} (a_k w_k(z) + \overline{a_k} \overline{w_k(z)}) > 0 \quad \forall z \in \mathbb{T}.2th Schur parameter, k=0n(akwk(z)+akwk(z))>0zT.\sum_{k=0}^{n} (a_k w_k(z) + \overline{a_k} \overline{w_k(z)}) > 0 \quad \forall z \in \mathbb{T}.3, k=0n(akwk(z)+akwk(z))>0zT.\sum_{k=0}^{n} (a_k w_k(z) + \overline{a_k} \overline{w_k(z)}) > 0 \quad \forall z \in \mathbb{T}.4, and k=0n(akwk(z)+akwk(z))>0zT.\sum_{k=0}^{n} (a_k w_k(z) + \overline{a_k} \overline{w_k(z)}) > 0 \quad \forall z \in \mathbb{T}.5 normalizes k=0n(akwk(z)+akwk(z))>0zT.\sum_{k=0}^{n} (a_k w_k(z) + \overline{a_k} \overline{w_k(z)}) > 0 \quad \forall z \in \mathbb{T}.6. This recurrence, along with the orthogonality relation

k=0n(akwk(z)+akwk(z))>0zT.\sum_{k=0}^{n} (a_k w_k(z) + \overline{a_k} \overline{w_k(z)}) > 0 \quad \forall z \in \mathbb{T}.7

enables efficient computation of all inner products for the predictor via forward recursion—the multipoint Schur algorithm. The error-power satisfies

k=0n(akwk(z)+akwk(z))>0zT.\sum_{k=0}^{n} (a_k w_k(z) + \overline{a_k} \overline{w_k(z)}) > 0 \quad \forall z \in \mathbb{T}.8

5. Classical ARMA and Levinson–Durbin Algorithms as Special Cases

When k=0n(akwk(z)+akwk(z))>0zT.\sum_{k=0}^{n} (a_k w_k(z) + \overline{a_k} \overline{w_k(z)}) > 0 \quad \forall z \in \mathbb{T}.9, the construction reduces to the case of stationary Gaussian processes. Here, the orthonormal system becomes the classical trigonometric polynomials of Szegő–Verblunsky theory, and the recurrences reduce to the well-known Durbin–Levinson recursions. The prediction error matches the Levinson–Durbin determinant ratio. For processes with ARMA-type rational spectral densities ({ck}k=0\{c_k\}_{k=0}^\infty0), the predictor system can be realized with finite-dimensional rational functions, yielding the classical ARMA next-step predictor.

Basis Choice Type of Process Corresponding Prediction Algorithm
{ck}k=0\{c_k\}_{k=0}^\infty1 Stationary Szegő–Verblunsky, Durbin–Levinson
Blaschke products Rational poles Multipoint Schur (ORF) predictor
General {ck}k=0\{c_k\}_{k=0}^\infty2 Generalized VGP Gram–Schmidt, generalized NGP

6. Algorithmic Procedure and Computational Aspects

The NGP workflow comprises the following steps:

  1. Select a basis {ck}k=0\{c_k\}_{k=0}^\infty3 tailored to the problem class (e.g., monomials for stationary cases, Blaschke products for rational/pole structure, arbitrary bases as required).
  2. Compute generalized moments {ck}k=0\{c_k\}_{k=0}^\infty4 or {ck}k=0\{c_k\}_{k=0}^\infty5 and verify the positivity (generalized Toeplitz).
  3. Apply Gram–Schmidt in {ck}k=0\{c_k\}_{k=0}^\infty6 to {ck}k=0\{c_k\}_{k=0}^\infty7 to obtain {ck}k=0\{c_k\}_{k=0}^\infty8 and the next {ck}k=0\{c_k\}_{k=0}^\infty9.
  4. Calculate inner products WW0 for WW1.
  5. Form the one-step predictor:

WW2

with error variance WW3.

If the Schur parameters WW4 are known, the full Gram–Schmidt process can be bypassed and WW5 updated recursively, resulting in WW6 computational complexity for predictor and error-power evaluation.

7. Context, Applications, and Extensions

NGP generalizes classical one-step prediction in Gaussian processes by providing a versatile framework that accommodates both stationary and wide classes of nonstationary and rational spectral models. This construction enables explicit spectral representation, efficient prediction, and error quantification for Gaussian processes whose covariance is expressible via generalized-moment structures, including those not amenable to standard Toeplitz or ARMA-based approaches. The strong connection of NGP with the multipoint Schur algorithm and orthogonal rational functions highlights its applicability in scenarios requiring robust, efficient prediction in nonstationary and nontrivial spectral environments (Baratchart et al., 2010).

Definition Search Book Streamline Icon: https://streamlinehq.com
References (1)

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Next Gaussian Prediction (NGP).