Next Gaussian Prediction (NGP)
- NGP is a unified algorithmic framework that performs one-step ahead prediction in Gaussian process models using generalized moment-based covariance structures.
- It extends classical methods like the Szegő–Verblunsky and Durbin–Levinson recurrences by leveraging orthogonal rational functions for efficient computation.
- The framework accommodates stationary, nonstationary, and ARMA-type processes, providing explicit formulas for optimal predictors and error variances.
Next Gaussian Prediction (NGP) is a unified algorithmic framework for one-step ahead prediction in Gaussian process models with generalized covariance structures, built on the Kreĭn–Nudel’man theory of generalized moments. NGP encompasses stationary Gaussian processes, ARMA models, and a broad class of nonstationary, varying ("generalized stationary") Gaussian processes by expressing their covariances in terms of orthogonal rational functions (ORFs) on the unit circle. The prediction scheme generalizes the classical Szegő–Verblunsky and Durbin–Levinson recursions, providing explicit computation of best linear predictors, error variances, and orthonormal bases via the Schur-type multipoint algorithm (Baratchart et al., 2010).
1. Generalized Moment Gaussian Processes
NGP begins by fixing a system of continuous functions , where denotes the unit circle. This system is required to satisfy the Kreĭn–Nudel’man positivity condition: for every , there exist constants such that
A sequence is a positive generalized-moment sequence with respect to if
for all finite sequences . The Kreĭn–Nudel’man theorem ensures the existence of a unique positive Borel measure on 0 such that
1
A zero-mean Gaussian process 2 is called a 3-varying Gaussian process (W-VGP) if its covariance admits the generalized-Toeplitz form
4
This framework extends the class of stationary Gaussian processes (recovered by 5) and accommodates a variety of nonstationary and rational spectral structures.
2. Spectral Representation and Covariance Structure
For any W-VGP, the generalized Herglotz and Kolmogorov–Wiener–Masani theories guarantee the existence of a unique orthogonal-increment Gaussian measure 6, supported on 7, satisfying
8
for Borel sets 9. Each process variable admits the spectral integral representation
0
with covariance structure immediately following:
1
3. One-Step Prediction via Orthogonal Rational Functions
The optimal one-step prediction in NGP is obtained in 2 by first applying the Gram–Schmidt process to the system 3, yielding a family of orthonormal functions 4 satisfying
5
By the isometry 6, the closed span of 7 in 8 is mapped to 9 in 0. The next-step linear predictor is the 1 projection:
2
which pulls back to
3
with 4. The mean-square prediction error is
5
4. Orthonormal Rational Systems and Schur-Type Recurrences
In the notable case where 6 is the sequence of simple Blaschke products at prescribed poles 7,
8
the orthonormal family 9 becomes the system of classical orthogonal rational functions (ORFs) on the unit circle. These satisfy a two-term Schur-type recurrence:
0
where 1 is the 2th Schur parameter, 3, 4, and 5 normalizes 6. This recurrence, along with the orthogonality relation
7
enables efficient computation of all inner products for the predictor via forward recursion—the multipoint Schur algorithm. The error-power satisfies
8
5. Classical ARMA and Levinson–Durbin Algorithms as Special Cases
When 9, the construction reduces to the case of stationary Gaussian processes. Here, the orthonormal system becomes the classical trigonometric polynomials of Szegő–Verblunsky theory, and the recurrences reduce to the well-known Durbin–Levinson recursions. The prediction error matches the Levinson–Durbin determinant ratio. For processes with ARMA-type rational spectral densities (0), the predictor system can be realized with finite-dimensional rational functions, yielding the classical ARMA next-step predictor.
| Basis Choice | Type of Process | Corresponding Prediction Algorithm |
|---|---|---|
| 1 | Stationary | Szegő–Verblunsky, Durbin–Levinson |
| Blaschke products | Rational poles | Multipoint Schur (ORF) predictor |
| General 2 | Generalized VGP | Gram–Schmidt, generalized NGP |
6. Algorithmic Procedure and Computational Aspects
The NGP workflow comprises the following steps:
- Select a basis 3 tailored to the problem class (e.g., monomials for stationary cases, Blaschke products for rational/pole structure, arbitrary bases as required).
- Compute generalized moments 4 or 5 and verify the positivity (generalized Toeplitz).
- Apply Gram–Schmidt in 6 to 7 to obtain 8 and the next 9.
- Calculate inner products 0 for 1.
- Form the one-step predictor:
2
with error variance 3.
If the Schur parameters 4 are known, the full Gram–Schmidt process can be bypassed and 5 updated recursively, resulting in 6 computational complexity for predictor and error-power evaluation.
7. Context, Applications, and Extensions
NGP generalizes classical one-step prediction in Gaussian processes by providing a versatile framework that accommodates both stationary and wide classes of nonstationary and rational spectral models. This construction enables explicit spectral representation, efficient prediction, and error quantification for Gaussian processes whose covariance is expressible via generalized-moment structures, including those not amenable to standard Toeplitz or ARMA-based approaches. The strong connection of NGP with the multipoint Schur algorithm and orthogonal rational functions highlights its applicability in scenarios requiring robust, efficient prediction in nonstationary and nontrivial spectral environments (Baratchart et al., 2010).