Papers
Topics
Authors
Recent
Search
2000 character limit reached

Variance Profile Matrix in Random Matrix Theory

Updated 8 July 2026
  • Variance profile matrices are deterministic constructs defining entrywise variances that govern the spectral distribution in random matrix models.
  • They appear in both Hermitian and non-Hermitian ensembles, influencing spectral edges and operator norms through Dyson and master equations.
  • Variance profiles play a critical role in statistical and algorithmic applications by modulating risk assessments and performance in high-dimensional inference.

Searching arXiv for recent and foundational papers on variance-profile random matrices. A variance profile matrix is a deterministic object that specifies entrywise second moments of a random matrix. In different conventions it appears either as the matrix of variances itself, such as ΣijN:=Var(XijN)(1+1i=j)1\Sigma_{ij}^N := \operatorname{Var}(X_{ij}^N)(1+\mathbf{1}_{i=j})^{-1} in Wigner-type models, or as a standard deviation profile An=(σij)A_n=(\sigma_{ij}) whose Hadamard square AnAnA_n\odot A_n is the variance profile (Ducatez et al., 2024, Cook et al., 2016, Adhikari et al., 2019). The notion generalizes homogeneous-variance ensembles by allowing heterogeneous variances across entries, and the resulting profile governs the limiting spectral distribution, spectral edge, operator norm, pseudospectral support, fluctuation theory, large deviations, and several high-dimensional inference procedures (Husson, 2020, Cheliotis et al., 2024, Alt et al., 2024, Bigot et al., 2024, Dabo et al., 3 Apr 2025, Xiao et al., 3 Jun 2026).

1. Definitions and conventions

The common feature across the literature is entrywise heteroscedasticity. In the Hermitian Wigner-type setting of large deviations, one considers real symmetric matrices

HijN=1NXijN,H_{ij}^N=\frac{1}{\sqrt N}X_{ij}^N,

with independent centered entries for 1ijN1\le i\le j\le N, and defines the variance profile by

ΣijN=Var(XijN)(1+1i=j)1.\Sigma_{ij}^N=\operatorname{Var}(X_{ij}^N)(1+\mathbf{1}_{i=j})^{-1}.

For off-diagonal entries, Var(XijN)=ΣijN\operatorname{Var}(X_{ij}^N)=\Sigma_{ij}^N, while for diagonal entries, Var(XiiN)=2ΣiiN\operatorname{Var}(X_{ii}^N)=2\Sigma_{ii}^N (Ducatez et al., 2024).

In non-Hermitian models, a standard convention is the rescaled entrywise product

Yn=1n(AnXn),Y_n=\frac{1}{\sqrt n}(A_n\odot X_n),

where An=(σij)A_n=(\sigma_{ij}) is deterministic with nonnegative entries and An=(σij)A_n=(\sigma_{ij})0 has i.i.d. centered unit-variance entries. The associated normalized variance profile is

An=(σij)A_n=(\sigma_{ij})1

so that An=(σij)A_n=(\sigma_{ij})2 (Cook et al., 2016, Cook et al., 2020).

In statistical models, the same idea appears as a deterministic modulation of an i.i.d. design. For ridge regression with non-identically distributed predictors,

An=(σij)A_n=(\sigma_{ij})3

and An=(σij)A_n=(\sigma_{ij})4 is called the variance profile because An=(σij)A_n=(\sigma_{ij})5 (Bigot et al., 2024). An analogous formulation is used for random features, where the variance profile may enter both the data matrix and, in a more general Gaussian-equivalence model, the random-feature matrix (Dabo et al., 3 Apr 2025).

Setting Profile object Meaning
Hermitian Wigner-type An=(σij)A_n=(\sigma_{ij})6 or An=(σij)A_n=(\sigma_{ij})7 Position-dependent entry variances
Non-Hermitian entrywise product An=(σij)A_n=(\sigma_{ij})8 or An=(σij)A_n=(\sigma_{ij})9 Standard deviation profile squared
High-dimensional regression AnAnA_n\odot A_n0 Entrywise predictor variances

A central structural assumption is convergence of the discrete profile to a continuum kernel. In the Hermitian setting, one assumes that there exist points AnAnA_n\odot A_n1 in AnAnA_n\odot A_n2 and a symmetric function AnAnA_n\odot A_n3 such that

AnAnA_n\odot A_n4

and that the empirical distribution of the AnAnA_n\odot A_n5 converges weakly to the uniform law on AnAnA_n\odot A_n6 (Ducatez et al., 2024). In sampled non-Hermitian profiles one similarly writes AnAnA_n\odot A_n7 or AnAnA_n\odot A_n8 (Cook et al., 2020, Hachem et al., 7 Jan 2025).

A recurrent terminological distinction is that some papers call AnAnA_n\odot A_n9 the “standard deviation profile” and HijN=1NXijN,H_{ij}^N=\frac{1}{\sqrt N}X_{ij}^N,0 the “variance profile,” while others directly call the matrix of second moments the variance profile (Adhikari et al., 2019, Cook et al., 2016). This is a difference of convention rather than substance.

2. Hermitian models, Dyson equations, and the spectral edge

For Hermitian variance-profile ensembles, the limiting spectral measure is described by self-consistent resolvent equations. In the discrete formulation of the Wigner-type model, with

HijN=1NXijN,H_{ij}^N=\frac{1}{\sqrt N}X_{ij}^N,1

the vector Dyson equation reads

HijN=1NXijN,H_{ij}^N=\frac{1}{\sqrt N}X_{ij}^N,2

In the continuum limit one seeks measurable HijN=1NXijN,H_{ij}^N=\frac{1}{\sqrt N}X_{ij}^N,3 with

HijN=1NXijN,H_{ij}^N=\frac{1}{\sqrt N}X_{ij}^N,4

and the limiting spectral measure is HijN=1NXijN,H_{ij}^N=\frac{1}{\sqrt N}X_{ij}^N,5 (Ducatez et al., 2024).

An equivalent formulation in the earlier variance-profile LDP literature is the quadratic vector equation

HijN=1NXijN,H_{ij}^N=\frac{1}{\sqrt N}X_{ij}^N,6

with HijN=1NXijN,H_{ij}^N=\frac{1}{\sqrt N}X_{ij}^N,7 the Stieltjes transform of the limiting measure HijN=1NXijN,H_{ij}^N=\frac{1}{\sqrt N}X_{ij}^N,8 (Husson, 2020). In both formulations, the rightmost point of the support of the limiting measure is denoted HijN=1NXijN,H_{ij}^N=\frac{1}{\sqrt N}X_{ij}^N,9, and 1ijN1\le i\le j\le N0 in probability or almost surely under the stated assumptions (Ducatez et al., 2024, Husson, 2020).

For piecewise constant profiles, the continuum equation reduces to a finite-dimensional system. If 1ijN1\le i\le j\le N1 is partitioned into blocks 1ijN1\le i\le j\le N2 and 1ijN1\le i\le j\le N3 is constant on each 1ijN1\le i\le j\le N4, then one obtains component measures 1ijN1\le i\le j\le N5, and the limiting measure is their mixture (Ducatez et al., 2024). This finite-dimensional reduction is the basis for explicit edge characterizations and for block-structured examples.

The spectral edge is also the asymptotic operator norm. For symmetric random matrices with variance profile 1ijN1\le i\le j\le N6, the operator norm of 1ijN1\le i\le j\le N7 converges to the largest element of the support of the limiting empirical spectral distribution. The paper on operator norms states that finite fourth moments are sufficient for convergence in probability and finite 1ijN1\le i\le j\le N8 moments are sufficient for almost sure convergence (Cheliotis et al., 2024). This places the spectral-edge description of variance-profile ensembles on the same footing as the Bai–Yin theorem in the homogeneous case.

A common simplification is the constant profile. When 1ijN1\le i\le j\le N9, the model reduces to classical Wigner matrices, the Dyson equation gives the semicircle law, and the spectral edge is ΣijN=Var(XijN)(1+1i=j)1.\Sigma_{ij}^N=\operatorname{Var}(X_{ij}^N)(1+\mathbf{1}_{i=j})^{-1}.0 after standardization (Husson, 2020). The broader role of the variance profile is therefore not merely to rescale the spectrum, but to change the self-consistent equation that determines the entire limiting measure.

3. Non-Hermitian deterministic equivalents and support geometry

For non-Hermitian matrices with independent entries and a variance profile, the central objects are deterministic equivalents defined through Master Equations. In the model

ΣijN=Var(XijN)(1+1i=j)1.\Sigma_{ij}^N=\operatorname{Var}(X_{ij}^N)(1+\mathbf{1}_{i=j})^{-1}.1

the empirical spectral distribution ΣijN=Var(XijN)(1+1i=j)1.\Sigma_{ij}^N=\operatorname{Var}(X_{ij}^N)(1+\mathbf{1}_{i=j})^{-1}.2 is approximated by a deterministic, rotationally invariant probability measure ΣijN=Var(XijN)(1+1i=j)1.\Sigma_{ij}^N=\operatorname{Var}(X_{ij}^N)(1+\mathbf{1}_{i=j})^{-1}.3 (Cook et al., 2016). Its radial cumulative distribution function is obtained from the zero-regularization limit of the Regularized Master Equations: ΣijN=Var(XijN)(1+1i=j)1.\Sigma_{ij}^N=\operatorname{Var}(X_{ij}^N)(1+\mathbf{1}_{i=j})^{-1}.4 followed by the limit ΣijN=Var(XijN)(1+1i=j)1.\Sigma_{ij}^N=\operatorname{Var}(X_{ij}^N)(1+\mathbf{1}_{i=j})^{-1}.5 (Cook et al., 2016, Cook et al., 2020).

The support radius is controlled by the spectral radius of the normalized variance profile. Specifically, the support of ΣijN=Var(XijN)(1+1i=j)1.\Sigma_{ij}^N=\operatorname{Var}(X_{ij}^N)(1+\mathbf{1}_{i=j})^{-1}.6 is contained in the disk

ΣijN=Var(XijN)(1+1i=j)1.\Sigma_{ij}^N=\operatorname{Var}(X_{ij}^N)(1+\mathbf{1}_{i=j})^{-1}.7

and, except maybe at zero, ΣijN=Var(XijN)(1+1i=j)1.\Sigma_{ij}^N=\operatorname{Var}(X_{ij}^N)(1+\mathbf{1}_{i=j})^{-1}.8 admits a positive density on the centered disk of radius ΣijN=Var(XijN)(1+1i=j)1.\Sigma_{ij}^N=\operatorname{Var}(X_{ij}^N)(1+\mathbf{1}_{i=j})^{-1}.9 (Cook et al., 2020). In the constant-profile case, this yields the circular law; in the doubly stochastic case, the circular law is recovered as well (Cook et al., 2016). The paper on properties and examples further identifies the profiles that yield the circular law: up to diagonal conjugation, these are the doubly stochastic normalized variance profiles (Cook et al., 2020).

The behavior at zero is profile-dependent. The density may be bounded, may blow up, or may vanish while an atom appears (Cook et al., 2020). Separable profiles reduce the Master Equations to a scalar fixed-point equation, and sampled continuous profiles lead to an integral version of the same structure (Cook et al., 2020). These examples show that the variance profile shapes not only the outer boundary but also fine structure in the bulk.

A further extension combines a variance profile with an additive deterministic diagonal deformation. For matrices Var(XijN)=ΣijN\operatorname{Var}(X_{ij}^N)=\Sigma_{ij}^N0 with

Var(XijN)=ΣijN\operatorname{Var}(X_{ij}^N)=\Sigma_{ij}^N1

the limiting spectral measure is identified as the Brown measure of a deformed operator-valued circular element, and its support exactly coincides with the Var(XijN)=ΣijN\operatorname{Var}(X_{ij}^N)=\Sigma_{ij}^N2-pseudospectrum in the consecutive limits Var(XijN)=ΣijN\operatorname{Var}(X_{ij}^N)=\Sigma_{ij}^N3 and Var(XijN)=ΣijN\operatorname{Var}(X_{ij}^N)=\Sigma_{ij}^N4 (Alt et al., 2024). In that framework the variance profile enters through integral operators

Var(XijN)=ΣijN\operatorname{Var}(X_{ij}^N)=\Sigma_{ij}^N5

and through a matrix Dyson equation for the hermitized resolvent (Alt et al., 2024). This identifies the support as a singular-value instability boundary determined by the profile.

4. Extremes, fluctuations, and large deviations

Variance profiles affect both global fluctuations and extreme-value probabilities. For the largest eigenvalue of Hermitian Wigner-type matrices, a large deviation principle holds at speed Var(XijN)=ΣijN\operatorname{Var}(X_{ij}^N)=\Sigma_{ij}^N6 under convergence of Var(XijN)=ΣijN\operatorname{Var}(X_{ij}^N)=\Sigma_{ij}^N7 to Var(XijN)=ΣijN\operatorname{Var}(X_{ij}^N)=\Sigma_{ij}^N8 and sharp sub-Gaussian tails. The rate function is expressed in terms of the solution of a Dyson equation involving Var(XijN)=ΣijN\operatorname{Var}(X_{ij}^N)=\Sigma_{ij}^N9, and the result is new even in the Gaussian case with non-constant variance profiles (Ducatez et al., 2024). An earlier formulation gives

Var(XiiN)=2ΣiiN\operatorname{Var}(X_{ii}^N)=2\Sigma_{ii}^N0

with Var(XiiN)=2ΣiiN\operatorname{Var}(X_{ii}^N)=2\Sigma_{ii}^N1 an annealed spherical-integral variational functional over probability measures on Var(XiiN)=2ΣiiN\operatorname{Var}(X_{ii}^N)=2\Sigma_{ii}^N2 (Husson, 2020). The later work removes several restrictive assumptions by using a more flexible rate function and a refined proof (Ducatez et al., 2024).

For non-Hermitian matrices, an upper bound on the spectral radius is controlled directly by the variance profile matrix. Under minimal moment assumptions and sparse profiles, the spectral radius does not exceed the square root of the spectral radius of the variance profile matrix with large probability: Var(XiiN)=2ΣiiN\operatorname{Var}(X_{ii}^N)=2\Sigma_{ii}^N3 The proof uses the reverse characteristic polynomial and a random analytic function built from traces of powers of Var(XiiN)=2ΣiiN\operatorname{Var}(X_{ii}^N)=2\Sigma_{ii}^N4 (Hachem et al., 7 Jan 2025).

At the level of linear eigenvalue statistics, the variance profile enters through explicit variance bounds and Fourier or cycle-sum functionals. For Hermitian matrices Var(XiiN)=2ΣiiN\operatorname{Var}(X_{ii}^N)=2\Sigma_{ii}^N5 with variance profile Var(XiiN)=2ΣiiN\operatorname{Var}(X_{ii}^N)=2\Sigma_{ii}^N6, the paper on second-order Poincaré inequalities proves an upper bound on the total variation distance between the standardized linear eigenvalue statistic and the standard Gaussian random variable, and uses it to establish CLTs for several classes of variance profiles (Adhikari et al., 2019). For non-Hermitian random band matrices with variance profile

Var(XiiN)=2ΣiiN\operatorname{Var}(X_{ii}^N)=2\Sigma_{ii}^N7

the fluctuations of linear eigenvalue statistics converge to a Gaussian law with an explicit variance formula depending on the Fourier transform of the profile (Jana, 2019).

These results make clear that a variance profile is not a peripheral perturbation. It modifies the limiting edge, the operator norm, the support of the limiting density, and the asymptotic cost of rare spectral events.

5. Statistical, algorithmic, and applied roles

In high-dimensional regression, the variance profile matrix encodes non-identically distributed predictors and determines deterministic equivalents for predictive risk and degrees of freedom. For the model

Var(XiiN)=2ΣiiN\operatorname{Var}(X_{ii}^N)=2\Sigma_{ii}^N8

the ridge estimator admits deterministic equivalents expressed through diagonal resolvent limits Var(XiiN)=2ΣiiN\operatorname{Var}(X_{ii}^N)=2\Sigma_{ii}^N9 and Yn=1n(AnXn),Y_n=\frac{1}{\sqrt n}(A_n\odot X_n),0 satisfying a variance-profile Dyson equation (Bigot et al., 2024). In the quasi doubly stochastic case these equivalents collapse to the classical Marchenko–Pastur fixed point and reproduce the standard double-descent profile, while other profiles produce different shapes, including “triple descent” in simulations (Bigot et al., 2024).

The same phenomenon persists in random features. For non-iid feature vectors with variance profile, operator-valued free probability and a block linearization yield deterministic equivalents for training and prediction risks associated with ridge regression in the random-features model (Dabo et al., 3 Apr 2025). Under a row-stochastic assumption on the variance profile, explicit Marchenko–Pastur formulas appear in the chaos-only case; more general cases require solving an operator-valued fixed-point equation whose self-energy operator is built from the profile (Dabo et al., 3 Apr 2025).

The variance profile also modifies iterative inference algorithms. For diagonal expectation propagation under variance-profile Gaussian sensing matrices,

Yn=1n(AnXn),Y_n=\frac{1}{\sqrt n}(A_n\odot X_n),1

the effective observation seen by the nonlinear module is generally not a fresh scalar Gaussian channel. Instead, the residuals form a coordinate-dependent Gaussian process whose covariance is shaped by the variance profile and by the finite linear history of the algorithm (Xiao et al., 3 Jun 2026). The paper characterizes this process through a conditioned matrix-Dyson-equation deterministic equivalent and a Gaussian-regression decomposition that separates predictable memory from orthogonal innovation (Xiao et al., 3 Jun 2026).

In spin-glass theory, the variance profile matrix appears as a deterministic, symmetric matrix Yn=1n(AnXn),Y_n=\frac{1}{\sqrt n}(A_n\odot X_n),2 with nonnegative entries controlling the covariance of Gaussian couplings: Yn=1n(AnXn),Y_n=\frac{1}{\sqrt n}(A_n\odot X_n),3 At sufficiently high temperature, the free energy is approximated by a deterministic functional of the fixed point

Yn=1n(AnXn),Y_n=\frac{1}{\sqrt n}(A_n\odot X_n),4

and the TAP/AMP Onsager correction becomes profile-dependent through Yn=1n(AnXn),Y_n=\frac{1}{\sqrt n}(A_n\odot X_n),5 (Hachem, 28 Apr 2026).

Applied settings use the same object in lower-dimensional or structured models. In low-rank denoising with heteroscedastic noise, a GUE or rectangular Gaussian matrix with variance profile leads to operator-valued resolvent equations and profile-aware determinant equations for outliers (Bigot et al., 2019). In a Yn=1n(AnXn),Y_n=\frac{1}{\sqrt n}(A_n\odot X_n),6 complex central Gaussian channel with arbitrary variances Yn=1n(AnXn),Y_n=\frac{1}{\sqrt n}(A_n\odot X_n),7, the variance profile matrix Yn=1n(AnXn),Y_n=\frac{1}{\sqrt n}(A_n\odot X_n),8 fundamentally departs from classical Wishart models and yields exact formulas for the distribution of the Gram matrix and of its eigenvalues (Auguin et al., 2017).

6. Structured profiles, computation, and recurring distinctions

Several structured classes recur across the literature. Constant profiles recover semicircle or circular laws (Husson, 2020, Cook et al., 2016). Block-constant profiles reduce continuum fixed-point equations to finite-dimensional systems and are used for community structure, deformed models, and explicit edge characterizations (Ducatez et al., 2024, Bigot et al., 2019). Band or spatially decaying profiles induce stronger coupling for nearby indices and modify the limiting spectral distribution away from the homogeneous case (Ducatez et al., 2024, Jana, 2019). Separable profiles

Yn=1n(AnXn),Y_n=\frac{1}{\sqrt n}(A_n\odot X_n),9

collapse the non-Hermitian Master Equations to a scalar equation and produce explicit radial densities, including Girko’s Sombrero distribution (Cook et al., 2020). Sampled continuous profiles discretize kernels An=(σij)A_n=(\sigma_{ij})0 or An=(σij)A_n=(\sigma_{ij})1 on An=(σij)A_n=(\sigma_{ij})2 and connect finite matrices to compact integral operators (Hachem et al., 7 Jan 2025, Cook et al., 2020).

A standard computational route is profile discretization followed by solution of a self-consistent system. For the Hermitian LDP, one discretizes An=(σij)A_n=(\sigma_{ij})3, approximates An=(σij)A_n=(\sigma_{ij})4 by a matrix, solves the discrete Dyson equation, and then evaluates the functionals entering the rate function (Ducatez et al., 2024). For non-Hermitian deterministic equivalents, one solves the Regularized Master Equations for decreasing regularization, obtains the radial CDF

An=(σij)A_n=(\sigma_{ij})5

and differentiates numerically to recover the density (Cook et al., 2016). For high-dimensional regression with variance profile, one solves the vector Dyson equation for An=(σij)A_n=(\sigma_{ij})6 and uses it in the explicit risk formula (Bigot et al., 2024).

Two distinctions recur and often remove apparent contradictions. First, a variance profile matrix is not the same object as a single population covariance matrix. In the regression papers, the profile is entrywise and may vary with both row and column; it is therefore more general than a fixed covariance An=(σij)A_n=(\sigma_{ij})7 shared across observations (Bigot et al., 2024, Dabo et al., 3 Apr 2025). Second, zero entries are compatible with much of the non-Hermitian theory, provided one imposes quantitative irreducibility or related admissibility assumptions (Cook et al., 2016, Cook et al., 2020). By contrast, some earlier Hermitian large-deviation arguments required continuity of a variational maximizer or positivity assumptions in the lower bound, and this dependence on auxiliary assumptions is explicitly discussed in the later generalization (Husson, 2020, Ducatez et al., 2024).

A plausible implication is that “variance profile matrix” functions less as a single definition than as a unifying schema for inhomogeneous random matrix models. Across Hermitian, non-Hermitian, rectangular, algorithmic, and statistical settings, the profile is the deterministic object that carries heterogeneity into the limiting equations, and those equations in turn determine spectral support, edges, fluctuations, rare events, and inference performance (Ducatez et al., 2024, Cook et al., 2020, Bigot et al., 2024, Xiao et al., 3 Jun 2026).

Definition Search Book Streamline Icon: https://streamlinehq.com
References (15)

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Variance Profile Matrix.