Approximate Hadamard Matrices Overview
- Approximate Hadamard matrices are n×n ±1 matrices whose singular values lie within [c√n, C√n], generalizing classical Hadamard matrices.
- They are constructed via prime-size block methods, arithmetic decompositions, and randomized perturbations to ensure well-conditioned spectral properties.
- These matrices have practical uses in numerical linear algebra, signal processing, and coding, providing robust preconditioning and near-orthogonal designs.
An approximate Hadamard matrix is an matrix with entries in whose singular values all lie in a window for some absolute constants independent of . These matrices substantially generalize classical Hadamard matrices, which correspond to the exact case . The concept arises naturally both from longstanding questions in combinatorial design theory and from practical requirements in signal processing and random matrix theory when exact orthogonality is unattainable.
1. Formal Definitions and the Hadamard Problem
Let and denote its singular values by . The condition number is . A classical (exact) Hadamard matrix satisfies , so all singular values are and . The Hadamard conjecture posits the existence of such matrices for all divisible by 4.
In dimensions where exact Hadamard matrices provably do not exist or their existence is open, the approximate Hadamard matrix relaxes the requirement, asking that
for constants independent of . This is equivalent to the operator norm inequality
and to a uniformly bounded condition number across all (Steinerberger, 20 Feb 2024, Dong et al., 2022, Alexeev et al., 18 Nov 2025).
2. Existence Theorems and Construction Strategies
The main existence theorem, due to Dong and Rudelson, asserts that for every , there exists a matrix with all singular values in a fixed window, for absolute (Steinerberger, 20 Feb 2024). The construction can be summarized as follows:
- Prime-size blocks: For each odd prime , a matrix whose entries are determined by the Legendre symbol , exploits classical Gauss sum bounds to guarantee flatness of the Fourier spectrum and singular values in .
- Gluing via arithmetic decompositions: By Vinogradov's three-primes theorem, any large can be written as a sum of a bounded number of primes, allowing assembly of blocks while controlling spectral deviations.
- Approximate Hadamard blocks: A "gluing" procedure pads and signs the blocks to form an matrix, preserving the spectral window (Steinerberger, 20 Feb 2024, Dong et al., 2022).
- Random noise augmentation: In (Dong et al., 2022), a small random Rademacher perturbation can be incorporated to fill out the full dimension and further concentrate the spectrum.
An alternative, nonconstructive proof uses "flat" orthogonal matrices—orthogonals with entries as close as possible to —and a subsequent randomized rounding to , with matrix Bernstein concentration controlling the eigenvalue spread. For all large , this yields
for some , implying the minimal achievable condition number among all -matrices converges to $1$ as (Alexeev et al., 18 Nov 2025).
3. Explicit Infinite Families of Approximations
Several explicit families achieve or :
| Construction | Parameter Regime | Condition Number |
|---|---|---|
| Symmetric conference | ||
| Barba matrices | ||
| SDS block construction | ||
| Flat Littlewood Circulants | All | , non-optimal |
For each construction, the design ensures that is close to in the spectral sense, but not exactly, so exact orthogonality is replaced by approximate spectral flatness:
- Symmetric conference matrices with , , yield with (Alexeev et al., 18 Nov 2025).
- Barba matrices satisfy , producing (Alexeev et al., 18 Nov 2025).
- Supplementary-difference-set (SDS) constructions combine two circulant blocks obeying to build block matrices with controlled singular spectrum (Alexeev et al., 18 Nov 2025).
- Circulant flat matrices: Via existence of flat Littlewood polynomials (i.e., -polynomials such that for all ), one constructs circulant with singular values bounded in (Steinerberger, 20 Feb 2024).
4. Circulant Approximate Hadamard Matrices and Flat Littlewood Polynomials
A circulant matrix has eigenvalues given by evaluation of the generating polynomial at th roots of unity. If is "flat" on the unit circle, meaning for all , then is a circulant approximate Hadamard matrix with the desired spectral window.
Balister, Bollobás, Morris, Sahasrabudhe, and Tiba have established the unconditional existence of such flat Littlewood polynomials for every (Steinerberger, 20 Feb 2024). Thus, circulant -matrices matching the Dong–Rudelson criteria exist in all dimensions. This provides the first universal construction of well-conditioned circulant -matrices with operator norm and minimal singular value both proportional to .
This result does not contradict Ryser's conjecture, which asserts the non-existence of exact circulant Hadamard matrices for , because these approximate versions only require the singular values to be well-separated but not equal (Steinerberger, 20 Feb 2024). Moreover, quantitative conjectures predict a polynomial spectral gap away from the optimal value in the non-Hadamard orders.
5. Relationship to Schur Norms, Almost Hadamard Matrices, and Design Theory
The theory of approximate Hadamard matrices intersects with other relaxations in the literature:
- Schur norm maximization: The maximal Schur (Hadamard) norm of an -matrix is if and only if it is a true Hadamard. For non-Hadamard orders, maximizing the Schur norm yields "almost Hadamard matrices," which closely approximate the ideal but always fall short (Holbrook et al., 2022). The best-known examples (e.g., for ) achieve .
- Almost Hadamard matrices (AHM): Defined as orthogonal matrices whose entries are as close to as possible, and which are local maxima of the $1$-norm on (Banica et al., 2012, Banica et al., 2012, Banica et al., 2017). These are highly structured, admit explicit classification results for certain patterns and circulant cases, but generally do not achieve the spectral flatness required of approximate Hadamard matrices in the Dong–Rudelson or Alexeev–Jasper–Mixon sense.
- Pseudo-Hadamard and block-design constructions: Families derived from removing rows/columns or "thinning" classical Hadamard matrices yield matrices with almost-orthogonal rows, relevant for systematic construction in missing dimensions (Sharipov, 2021).
The design perspective (incidence matrices from block designs, conference matrices, Barba matrices) provides infinite families of explicit near-optimal examples, which are especially valuable in cases where general probabilistic or number-theoretic constructions are available only nonconstructively (Alexeev et al., 18 Nov 2025).
6. Applications and Open Questions
Approximate Hadamard matrices enable robust and nearly orthogonal sign-preconditioned matrix ensembles for applications where only entries are permissible:
- Numerical linear algebra: They can be deployed as well-conditioned preconditioners, random projections, and for sketching algorithms needing bounded isometry constants (Alexeev et al., 18 Nov 2025).
- Signal processing and coding: Near-orthogonal matrices preserve signal energy and minimize cross-correlation in communication protocols, generalizing the Hadamard–Walsh approaches.
- Frame theory and combinatorics: They contribute to the design of new frame families and measuring ensembles where exact orthogonality is too restrictive (Dong et al., 2022).
Open questions include optimizing the exponent in condition number convergence to its tightest possible value, extending explicit families to new congruence classes, finding odd-order constructions with condition number below , and establishing more refined quantitative versions of the Ryser conjecture in the approximate regime (Steinerberger, 20 Feb 2024, Alexeev et al., 18 Nov 2025).
7. Comparison with Exact Hadamard and Limiting Behavior
Approximate Hadamard matrices do not close the Hadamard conjecture but fill an important gap by providing well-conditioned matrices in all dimensions, with condition numbers arbitrarily close to $1$ for large —matching exact Hadamard matrices asymptotically (Alexeev et al., 18 Nov 2025). This universality is achieved at the cost of perfect orthogonality, which remains exclusive to exact Hadamard matrices; the quantitative gap is well-characterized and diminishing as matrix size grows. The structure theory unifies probabilistic, algebraic, and analytic tools, promising further progress in both construction and characterization.