---
title: Continuous Nonlinear Widths in Approximation
url: https://www.emergentmind.com/topics/continuous-nonlinear-widths
type: topic
---

# Continuous Nonlinear Widths in Approximation

Continuous nonlinear widths are a class of quantitative invariants designed to measure the optimal performance of nonlinear approximation and encoding schemes under regularity constraints, generalizing classical linear widths. They play a pivotal role in geometric analysis, approximation theory, and the theory of parametric representations in functional spaces, enabling rigorous quantification of the compressibility and geometric complexity of sets in metric, Banach, and function spaces.

## 1. Foundational Definitions and Key Notions

Several related, but distinct, definitions for continuous nonlinear widths exist, each appropriate for a different analytic or geometric context.

**General Metric Setting.** For a compact metric space $(X,d)$ and integer $k \ge 0$, the (continuous) nonlinear $k$-width is
\[
w_k(X) = \inf_{\substack{K^k \subset X \\ \dim K^k \le k}} \enspace
\inf_{\phi:X \rightarrow K^k} \sup_{x \in X} d(x, \phi(x)),
\]
where the infimum is over compact $k$-dimensional polyhedra and all continuous maps, capturing how finely $X$ can be contracted to a $k$-complex via continuous collapse [2402.07810].

**Manifold Widths.** For a compact $K$ in a Banach space $X$, the *manifold $n$-width* is
\[
\delta_n(K)_X = \inf_{\substack{a_n:K \to \R^n \\ M_n:\R^n \to X}} \sup_{f \in K} \| f - M_n(a_n(f)) \|_X,
\]
where $a_n$ and $M_n$ are both continuous, encoding and decoding the elements of $K$ via $n$-parameters [2402.04407].

**Lipschitz Widths.** For a bounded $K \subset X$ and $L \ge 0$, the $m$th Lipschitz width is
\[
d^L_m(K)_X = \inf_{\varphi:L\text{-Lipschitz}} \sup_{f \in K} \inf_{y \in B_{Y_m}} \|f - \varphi(y)\|_X,
\]
where $B_{Y_m}$ is the unit ball in $\R^m$ under a suitable norm and $\varphi$ is $L$-Lipschitz [2111.01341, 2203.00605]. These invariants quantify approximation under controlled parameter dependence.

**$p$-Widths in Geometric Analysis.** In the min-max theory, for a compact domain $K \subset \mathbb{R}^2$,
\[
\omega_p(K) = \inf_{\Phi \,:\, p\text{-sweepout}} \sup_{x \in X} M(\Phi(x)),
\]
where $\Phi:X \to \mathcal{Z}_1(K,\partial K)$ is a $p$-sweepout, $M$ is the mass norm, and the sweepout has nontrivial cohomology [2505.03047]. These form a nonlinear analogue of Laplacian eigenvalues.

## 2. Contrasts with Classical Linear Widths

Classic Kolmogorov $n$-widths $d_n(K)_X$ use *linear* $n$-dimensional subspaces for approximating $K$,
\[
d_n(K)_X = \inf_{\substack{V \subset X\\ \dim V \le n}} \sup_{f \in K} \inf_{g \in V} \|f - g\|_X,
\]
measuring optimal performance for linear encoders/decoders. Nonlinear widths allow *nonlinear parameterizations*, markedly improving compressibility for classes of functions and sets where nonlinear structures are natural.

The *Urysohn width* $U_k(X)$ is closely related, capturing the minimal fiber diameter over continuous maps into $k$-complexes. Both Kolmogorov and Urysohn widths are generally larger than their continuous nonlinear analogues, since the latter admit non-linear collapsing schemes [2402.07810].

## 3. Invariant Properties, Continuity, and Scaling Laws

Continuous nonlinear widths exhibit key stability and monotonicity properties:
- **Monotonicity:** They decrease with increasing parameter dimension and increased regularity of the parameterization (e.g., larger Lipschitz constant).
- **Continuity:** Nonlinear widths vary continuously under domain deformations (e.g., $C^0$/Hausdorff topology for domains in $\mathbb{R}^n$), an essential feature for geometric invariants [2505.03047].
- **Asymptotics:** In the Gromov–Guth $p$-width theory,
  \[
  \lim_{p \to \infty} p^{-1/2} \omega_p(K) = \sqrt{\pi \cdot \mathrm{Area}(K)}
  \]
  for planar domains, interpolating between geometric width and spectral invariants [2505.03047].

For $\ell^\infty$-widths of $n$-manifolds in $\mathbb{R}^N$,
\[
W^{\ell^\infty}_{n-1}(M^n) \lesssim \sqrt{n}\ \mathrm{vol}(M^n)^{1/n},
\]
with an explicit bound of $\sqrt{3}$ in codimension one, reflecting dimension-independent compressibility [2402.07810].

## 4. Computational Examples and Explicit Bounds

Low-parameter continuous nonlinear widths have been computed explicitly in model domains:
- For the equilateral triangle of side $\sqrt{3}$,
  - $\omega_1 = \omega_2 = \frac{3}{2}$
  - $\omega_3 = \frac{3\sqrt{3}}{2}$
  - $\omega_4 = 3$
- For the square of side $\sqrt{2}$,
  - $\omega_1 = \sqrt{2}$
  - $\omega_2 = 2$
  - $\omega_3 = 2\sqrt{2}$
[2505.03047]

For Sobolev and Besov balls with unit radius in $L_p$-norm, sharp lower and upper bounds for manifold widths are
\[
\delta_n \asymp n^{-s/d}
\]
where $s$ is the smoothness and $d$ is the spatial dimension, provided $1/q - 1/p < s/d$. Notably, the decay of manifold widths can strictly exceed that of corresponding Bernstein widths, showing that the restriction to *continuous* parameterizations fundamentally alters approximation rates [2402.04407].

## 5. Geometric and Analytical Applications

Continuous nonlinear widths provide tight control over performance in nonlinear parametric methods and have been employed in distinctive analytical and geometric contexts:
- **Geometric Min-Max Theory:** The realization of $p$-widths as sums of billiard trajectory lengths in polygons provides a direct connection between geometric optimization and nonlinear width theory [2505.03047].
- **Systolic Geometry:** Dimension-independent upper bounds for $\ell^\infty$-widths yield universal estimates for systolic volume and the existence of noncontractible curves lying in small cubes [2402.07810].
- **Control Theory:** Quantitative upper bounds for the reachable set of nonlinear distributed-parameter systems (e.g., Euler–Bernoulli beams, controlled Schrödinger systems) are given using affine and nonlinear estimates of the widths of image sets under nonlinear mappings [2403.06029].

## 6. Links to Entropy Numbers and Approximation Theory

There exist explicit quantitative relationships between continuous nonlinear widths and entropy numbers:
- For compact $K \subset X$,
  \[
  d^L_m(K)_X \leq \varepsilon_n(K)_X \quad\text{(for suitable $L$, $m$)}
  \]
  where $\varepsilon_n(K)_X$ is the $n$-th entropy number. Conversely, lower bounds on entropy numbers furnish limits for Lipschitz widths [2111.01341, 2203.00605].

These invariants also control the performance ceiling for deep neural networks and $m$-term approximation schemes. For example, the Lipschitz widths yield fundamental lower bounds for the approximation error achievable by ReLU networks with fixed architecture and uniform parameter bounds [2111.01341].

## 7. Techniques for Bounding and Constructing Nonlinear Widths

Key techniques for deriving bounds include:
- **Nonlinear Federer–Fleming Push-Out:** Replacing linear projections onto grid skeletons with collapse onto low-volume separators (e.g., optimal foams) [2402.07810].
- **Sphere-Embedding Arguments:** Proving lower bounds for manifold widths via topological constructions using Borsuk–Ulam-type theorems [2402.04407].
- **Kinematic Averaging and Group Actions:** Using averaging over isometries (e.g., signed permutations for $\ell^\infty$) to optimize separators and control mass intersections [2402.07810].
- **Explicit Lipschitz Constructions:** Employing parameterizations with controlled Lipschitz constants mapped into target function or geometric spaces [2111.01341].

These analytical and combinatorial tools allow stronger, often dimension-independent, and sometimes matching upper and lower bounds in both geometric and analytic settings.

---

Continuous nonlinear widths provide the modern framework for understanding the intrinsic complexity and optimal parameterization of compact sets under continuous or Lipschitz maps, unifying themes in geometry, PDE, nonlinear approximation, learning theory, and control [2505.03047, 2402.07810, 2402.04407, 2403.06029, 2111.01341, 2203.00605].

Source: https://www.emergentmind.com/topics/continuous-nonlinear-widths