---
title: Filtered Spectral Projection Algorithm (FSPA)
url: https://www.emergentmind.com/topics/filtered-spectral-projection-algorithm-fspa
type: topic
---

# Filtered Spectral Projection Algorithm (FSPA)

Filtered Spectral Projection Algorithm (FSPA) denotes a class of procedures in which a spectral filter or spectral projector is used to isolate a targeted invariant subspace and then transfer that subspace information to a downstream task. In the available literature, this includes a contour-integral spectral projection preconditioner for ill-conditioned linear systems, a spectrally-filtered discrete-in-time downscaling data assimilation scheme for the two-dimensional Navier–Stokes equations, and a projection-first framework for quantum principal component analysis [1609.06839] [1809.08654] [2603.13441]. The operators differ—resolvents \((zI-A)^{-1}\), Fourier projections \(P_\lambda\), and powers of a density operator \(\rho\)—but all three formulations use filtering to preserve a chosen spectral region and suppress complementary components.

## 1. Conceptual structure

In the linear-systems setting, the central object is the classical spectral projector
\[
P_\Gamma=\frac{1}{2\pi \sqrt{-1}}\oint_\Gamma (zI-A)^{-1}\,dz,
\]
where \(\Gamma\) encloses a selected subset of eigenvalues of \(A\). This projector is applied to a random matrix \(Y\) to form \(Z=P_\Gamma Y\), and \(Z\) is then used to build a deflation preconditioner [1609.06839]. In the data-assimilation setting, the key filtered projector is
\[
J=P_\lambda P_\sigma I_h,\qquad E=I-J,
\]
where \(I_h\) is a low-resolution interpolant observable, \(P_\sigma\) is the Leray projector, and \(P_\lambda\) is the orthogonal projection onto low Fourier modes; the algorithm repeatedly replaces the observed low-mode content by \(J U(t_n)\) at observation times [1809.08654]. In the qPCA setting, the filter is the power map \(f_k(\rho)=\rho^k\), and the normalized iterate
\[
|\phi_k\rangle=\frac{\rho^k|\phi_0\rangle}{\|\rho^k|\phi_0\rangle\|}
\]
amplifies overlap with the dominant eigenspace of \(\rho\) without explicit eigenvalue estimation [2603.13441].

These formulations suggest a common abstraction: first specify a spectral region of interest, then realize a filter that isolates or amplifies that region, and finally use the filtered subspace in a solver, an assimilation update, or a dimensionality-reduction primitive. A plausible implication is that FSPA is better understood as a design pattern centered on spectral isolation than as a single fixed algorithm.

## 2. Contour-integral FSPA for ill-conditioned linear systems

For linear systems
\[
Ax=b,\qquad A\in\mathbb{C}^{N\times N},
\]
the 2016 formulation targets ill-conditioned problems, especially those whose condition number is large because some eigenvalues are very close to the origin. The projector \(P_\Gamma\) is chosen so that \(\Gamma\) encloses those troublesome eigenvalues, typically a small circle around \(0\). Applying \(P_\Gamma\) to a random matrix \(Y\in\mathbb{C}^{N\times m}\) produces
\[
Z=P_\Gamma Y=\frac{1}{2\pi \sqrt{-1}}\oint_\Gamma (zI-A)^{-1}Y\,dz,
\]
whose columns almost surely span the targeted spectral subspace when \(m\) is suitably chosen. Because the contour integral cannot be evaluated exactly, it is approximated on a circle \(\Gamma=D(c,r)\) by Legendre–Gauss quadrature,
\[
Z\approx \frac{r}{2}\sum_{k=1}^q \omega_k e^{\pi \theta_k i}\Big((c+r e^{\pi \theta_k i})I-A\Big)^{-1}Y,
\]
so the projector is realized as a rational filter built from shifted resolvents [1609.06839].

The filtered subspace \(Z\) defines the deflation matrices
\[
M=Z^H A Z,\qquad
P=I-AZM^{-1}Z^H,\qquad
\widetilde P=I-ZM^{-1}Z^H A.
\]
The preconditioned problem is the singular but consistent deflated system
\[
PAx=Pb.
\]
When \(Z\) consists of eigenvectors \(v_1,\dots,v_m\), the spectrum of \(PA\) becomes
\[
\sigma(PA)=\{0,\dots,0,\lambda_{m+1},\dots,\lambda_N\},
\]
so the deflated eigenvalues are replaced by zeros and no longer affect the nonsingular part on which GMRES effectively iterates. The associated solution decomposition is
\[
x_1=ZM^{-1}Z^H b,\qquad
PAx=Pb\to x^\#,\qquad
x_2=\widetilde P x^\#,\qquad
x=x_1+x_2.
\]

The convergence analysis explains the gain. Without deflation, for diagonalizable \(A=V\Lambda V^{-1}\), the GMRES residual satisfies a standard ellipse-based bound involving \(\kappa_2(V)\). With exact-eigenvector deflation, the analogous bound replaces \(\kappa_2(V)\) by \(\kappa_2(R_{22})\), where \(R_{22}\) comes from a QR factorization of the eigenvector matrix. The remaining ellipse needs to contain only the undeflated eigenvalues, which can substantially improve the convergence factor [1609.06839].

The numerical experiments illustrate the mechanism. For a convection–diffusion problem with \(N=99^2\), \(Re=8000\), and a contour centered at \(0\) with radius \(0.5\), plain GMRES required \(3295\) iterations with \(\text{relres2}\approx 9.9\times10^{-8}\) and \(\text{relerr}\approx 3.3\times10^{-7}\). Deflated GMRES using \(Z\) from spectral projection with \(q=2^4\) and \(m=50\) required \(1340\) iterations, with \(\text{relres2}\approx 9.9\times10^{-8}\) and \(\text{relerr}\approx 1.8\times10^{-6}\). For the sparse benchmark matrix bcsstm27, unpreconditioned MBiCG did not converge within \(10^3N\) iterations and after \(1{,}224{,}000\) iterations still had \(\text{relerr}=0.57\), whereas a spectral-projection-based deflated run with improved \(Z\) required \(563\) iterations and achieved \(\text{relerr}\approx 3.4\times10^{-2}\) [1609.06839].

A distinctive feature of this formulation is that the method is problem-independent in the sense stated in the paper: it uses only the matrix \(A\) and the contour \(\Gamma\), not problem-specific eigenvector guesses or subdomain structures. The dominant practical cost is computing \(Z\), which requires solving \(mq\) shifted systems and motivates parallelization, multigrid acceleration, and numerical rank refinement through CGE-based column selection when \(Z\) is rank-deficient or nearly rank-deficient.

## 3. Spectrally filtered projection in discrete-in-time data assimilation

In the 2D incompressible Navier–Stokes setting on the periodic box \(\Omega=[0,L]^2\), the reference solution \(U\) solves
\[
\frac{dU}{dt}+\nu A U+B(U,U)=f,
\]
with \(A=-P_\sigma\Delta\) the Stokes operator and \(B(u,v)=P_\sigma(u\cdot\nabla v)\). Observations are available only at discrete times
\[
t_n=t_0+n\delta,
\]
through a low-resolution interpolant observable \(I_h(U(t_n))\). The filtered observation operator is defined by
\[
J=P_\lambda P_\sigma I_h,\qquad E=I-J,
\]
where \(P_\lambda\) is the orthogonal projection onto Fourier modes with \(|k|^2<\lambda\). The algorithm initializes with
\[
u_0=J U(t_0),
\]
updates by
\[
u_{n+1}=E\,S(t_{n+1},t_n;u_n)+J\,U(t_{n+1}),
\]
and evolves continuously between updates via
\[
u(t)=S(t,t_n;u_n),\qquad t\in[t_n,t_{n+1}).
\]
The paper describes this as inserting new observational data directly into the dynamical model as it is being evolved over time, rather than nudging [1809.08654].

The filtering role of \(J\) is mathematically explicit. Because \(\mathrm{Range}(J)\subset\mathrm{Range}(P_\lambda)\subset D(A)\), the operator replaces only low Fourier modes, and the complementary operator \(E\) retains the part not directly overwritten by observations. The paper proves norm estimates for \(E\) using the approximation-of-the-identity properties of the interpolant. For type-I interpolants,
\[
\|U-I_hU\|^2\le c_1 h^2\|U\|_V^2,\qquad U\in V,
\]
and for type-II interpolants,
\[
\|U-I_hU\|^2\le c_1 h^2\big(\|U\|_V^2+h^2\|AU\|^2\big),\qquad U\in D(A).
\]
These bounds allow the filtered interpolant \(J\) to behave like a near-identity on the relevant low-mode content [1809.08654].

The main analytical result is global synchronization: for every fixed \(\delta>0\), there exist \(h>0\) and \(\lambda>0\), depending only on the interpolant constant \(c_1\), on \(\|f\|\), on \(\nu\), and on the domain, such that
\[
\|u(t)-U(t)\|\to 0
\quad\text{exponentially in time as }t\to\infty.
\]
For type-I interpolants, the contraction is established in the \(H\)-norm through a discrete inequality of the form
\[
\|\tilde v_{n+1}\|^2\le \gamma \|\tilde v_n\|^2,\qquad \gamma\in(0,1),
\]
and then converted into exponential continuous-time decay. For type-II interpolants, the argument is carried out in vorticity form and yields exponential convergence of vorticity, which implies exponential convergence of velocities in \(H^1\) on the periodic domain [1809.08654].

This formulation extends earlier orthogonal-projection-based discrete-in-time schemes because \(I_h\) need not itself be an orthogonal projection. The spectral filter \(P_\lambda\) transforms rough or non-orthogonal observables—such as local averages or nodal measurements—into a smooth low-mode correction that is compatible with the dissipative structure of the PDE. A plausible implication is that, in this setting, FSPA functions as a regularizing interface between irregular measurement operators and the continuous Navier–Stokes dynamics.

## 4. Projection-first FSPA for quantum principal component analysis

In the 2026 qPCA formulation, the objective is not explicit eigenvalue recovery but projection onto the dominant spectral subspace of a covariance-encoded density operator. The starting point is a Hermitian positive semidefinite operator
\[
\rho=\sum_{j=1}^d \lambda_j|\psi_j\rangle\langle\psi_j|,\qquad
\lambda_1\ge \lambda_2\ge\cdots\ge \lambda_d\ge 0.
\]
For amplitude-encoded centered classical data, the paper states that the ensemble density matrix
\[
\rho=\sum_i p_i|\psi_i\rangle\langle\psi_i|
\]
coincides with the covariance matrix. For uncentered data, \(\rho\) corresponds to PCA without centering, and the paper derives eigenvalue interlacing bounds quantifying the deviation from standard centered PCA. It also states that ensembles of quantum states admit an equivalent centered covariance interpretation [2603.13441].

The algorithm is an adaptive normalized power iteration. Given an initial state
\[
|\phi_0\rangle=\sum_{j=1}^d a_j|\psi_j\rangle,
\]
FSPA repeatedly applies \(\rho\) and normalizes after each application. In the version described in the paper, the input is a Hermitian operator \(\rho\) with \(\|\rho\|\le 1\), an initial warm-start state \(|\phi_0\rangle\), and a number of rounds \(T\). One first normalizes \(|\phi_0\rangle\), sets an amplification parameter \(\beta=1\), and for each round applies \(\rho\) exactly \(\beta\) times, normalizing after every application, then doubles \(\beta\). Conceptually, the effective iterate is
\[
|\phi_k\rangle=\frac{\rho^k|\phi_0\rangle}{\|\rho^k|\phi_0\rangle\|}.
\]
The filter is therefore the spectral map \(f_k(\lambda)=\lambda^k\), which amplifies components corresponding to larger eigenvalues relative to the rest [2603.13441].

A central structural property is eigenvalue magnitude invariance: replacing \(\rho\) by \(c\rho\) with \(c>0\) does not change the normalized iterates. This removes the magnitude sensitivity associated with estimation-first qPCA pipelines based on phase estimation. The paper highlights two claimed drawbacks of the estimation-first approach: precision overhead or magnitude sensitivity, and overkill for projection tasks. FSPA is introduced specifically as a projection-first framework that bypasses explicit eigenvalue estimation while preserving the essential spectral structure [2603.13441].

Warm-start overlap is essential. In the nondegenerate case \(\lambda_1>\lambda_2\), if \(a_1\neq 0\), the fidelity with the top eigenvector after \(k\) effective power applications is
\[
F_k=
\frac{|a_1|^2}{|a_1|^2+\sum_{j\ge 2}|a_j|^2 r_j^{2k}}
\ge
\frac{|a_1|^2}{|a_1|^2+(1-|a_1|^2)r^{2k}},
\qquad
r=\frac{\lambda_2}{\lambda_1}.
\]
If the dominant eigenvalue is degenerate, \(\lambda_1=\cdots=\lambda_R>\lambda_{R+1}\), the algorithm does not force a basis choice inside the dominant eigenspace; instead it converges to the normalized projection of the initial state onto
\[
\mathcal S_R=\mathrm{span}\{|\psi_1\rangle,\dots,|\psi_R\rangle\}.
\]
This subspace-focused behavior is one of the paper’s explicit design goals in near-degenerate regimes [2603.13441].

The implementation viewpoint is compatible with block-encoding and QSVT-style polynomial transformations. Because normalization is non-unitary, the paper interprets it through post-selection or amplitude amplification rather than as a standalone unitary step.

## 5. Convergence, stability, and empirical behavior

The three formulations use different convergence mechanisms. In contour-integral deflation for linear systems, the improvement is spectral and geometric: once the targeted eigenvalues are deflated, GMRES effectively sees a smaller nonsingular problem whose residual bound depends on \(\kappa_2(R_{22})\) rather than \(\kappa_2(V)\), and the enclosing ellipse need only contain the remaining eigenvalues [1609.06839]. In the Navier–Stokes assimilation scheme, convergence is a synchronization result: suitable choices of \(\delta\), \(\lambda\), and \(h\) produce a discrete contraction that yields exponential decay of the state error in time [1809.08654]. In qPCA, the guarantee is overlap amplification: to obtain
\[
|\langle\psi_1|\phi_k\rangle|^2\ge 1-\epsilon,
\]
the required number of applications of \(\rho\) is
\[
\mathcal O\!\left(
\frac{\log(1/\epsilon)+\log(1/|a_1|^2)}
{\log(\lambda_1/\lambda_2)}
\right),
\]
so complexity depends on spectral ratios and initial overlap rather than on absolute eigenvalue scale [2603.13441].

The empirical behavior also differs by domain. In ill-conditioned linear systems, the filtered spectral projection preconditioner reduces iteration counts substantially and can improve accuracy in the norm of the distance to the exact solution. The convection–diffusion example and the sparse benchmark matrices bcsstm27 and mahindas show that spectral-projection-based deflation can turn essentially stagnant Krylov behavior into practical convergence, although the quality of \(Z\), the conditioning of \(M=Z^HAZ\), and column compression of \(Z\) materially affect performance [1609.06839]. In qPCA, the reported numerical demonstrations show three features: eigenvector-level instability can coexist with stable dominant subspaces; Lloyd-style qPCA collapses below a resolution threshold under global spectral downscaling whereas FSPA remains stable; and FSPA degrades smoothly rather than abruptly as the spectral gap shrinks. On benchmark datasets including Breast Cancer Wisconsin and handwritten Digits, downstream performance remains stable whenever projection quality is preserved [2603.13441].

Taken together, these results suggest that FSPA methods are usually justified less by a uniform asymptotic advantage than by a task-appropriate spectral representation. In each domain, the filter is tailored to the spectral object that actually controls computational difficulty: small eigenvalues near the origin in linear solvers, unresolved high Fourier content in data assimilation, and dominant principal subspaces in qPCA.

## 6. Relations to neighboring methods and interpretive issues

FSPA sits near several established research lines. The linear-systems formulation is rooted in deflation methods and projectors for Krylov solvers, and its contour-integral construction is closely related to quadrature-based spectral filtering and eigenspace extraction methods such as Sakurai–Sugiura and FEAST; the paper explicitly characterizes it as FEAST-style contour filtering applied not to eigenvalue problems per se, but to preconditioning linear systems via deflated Krylov methods [1609.06839]. The data-assimilation formulation extends earlier discrete-in-time schemes in which the observation operator itself was an orthogonal projection onto low Fourier modes; the key generalization is that the observable need only satisfy an approximation-of-the-identity property, while the added spectral projector \(P_\lambda\) restores the low-mode structure needed for analysis [1809.08654]. The qPCA formulation is presented against Lloyd-style, phase-estimation-based qPCA and argues that for many applications spectral projection is the essential primitive, while explicit eigenvalue estimation is often unnecessary [2603.13441].

A recurring interpretive issue is that “spectral projection” does not mean the same implementation in every setting. In the linear-systems paper, it is a contour-integral projector approximated by rational quadrature. In the Navier–Stokes assimilation paper, it is a low-mode Fourier projection composed with an interpolant observable. In the qPCA paper, it is a normalized power filter that approaches the dominant invariant subspace without numerically estimating eigenvalues. The literature therefore suggests that FSPA is not a single canonical routine but a family of filter-plus-projection constructions adapted to distinct operator classes and computational objectives.

Another common misunderstanding is that FSPA must return individual eigenvectors. The available formulations do not support that as a universal requirement. The linear-systems version needs a deflation subspace rather than explicit eigenpairs; the data-assimilation version inserts filtered low-mode observations rather than computing eigenvectors at all; and the qPCA version is explicitly subspace-oriented, with convergence to the dominant invariant subspace in degenerate cases and no artificial symmetry breaking in the absence of bias. This suggests that the defining feature of FSPA is not eigenvalue estimation, but controlled isolation of a spectral subspace and its direct use in the target algorithm.

Source: https://www.emergentmind.com/topics/filtered-spectral-projection-algorithm-fspa