---
title: 'Nyström Methods: Foundations & Applications'
url: https://www.emergentmind.com/topics/nystrom-methods
type: topic
---

# Nyström Methods: Foundations & Applications

The Nyström method is a foundational set of techniques for low-rank approximation and efficient computation with large matrices, particularly in kernel methods, integral equation solvers, and numerical ODE integration. Its core principle is to approximate a large matrix or operator by projecting onto the span of a judiciously chosen subset of its columns (or rows), thereby inducing a small, computationally manageable subproblem whose solution is then extended to the full matrix. This methodology yields scalable, explicit approximations with theoretically quantifiable error properties, and impacts broad domains in scientific computing, machine learning, and statistics.

## 1. Core Principle and Standard Formulation

The classical Nyström method targets the approximation of a symmetric positive semidefinite (SPSD) matrix \( K \in \mathbb R^{n \times n} \) (such as a kernel or Gram matrix) by sampling a subset \( S \subset \{1, \dots, n\} \) of \( m \ll n \) indices. Defining
\[
C = K_{:,S} \in \mathbb R^{n \times m}, \quad W = K_{S,S} \in \mathbb R^{m \times m},
\]
the Nyström approximation is
\[
K \approx \widetilde K := C W^+ C^T,
\]
where \( W^+ \) denotes the Moore–Penrose pseudoinverse [2002.09073][1605.07583][2511.15583]. This approximation projects \( K \) onto the column space of \( C \) and preserves the action of \( K \) on the sampled subspace exactly when \( W \) is invertible.

When approximating general matrices, one symmetrizes as necessary to recover self-adjoint structure [1305.0203]. For integral operators (e.g., in boundary integral equations), Nyström's approach discretizes the operator using quadrature at a set of collocation sites, leading to tractable, high-accuracy numerical methods [1510.06682].

## 2. Theoretical Guarantees and Sampling Schemes

Error bounds for the Nyström method generally relate the approximation quality to the spectrum of the target matrix and the sampling strategy. When columns are selected using uniform random sampling or with more sophisticated leverage-score or volume-based schemes, the expected approximation error can be quantified in spectral, Frobenius, or trace norms.

**Worst-case guarantee**: For a matrix \( A \) (or kernel \(

Source: https://www.emergentmind.com/topics/nystrom-methods