Variance Profile Matrix in Random Matrix Theory
- Variance profile matrices are deterministic constructs defining entrywise variances that govern the spectral distribution in random matrix models.
- They appear in both Hermitian and non-Hermitian ensembles, influencing spectral edges and operator norms through Dyson and master equations.
- Variance profiles play a critical role in statistical and algorithmic applications by modulating risk assessments and performance in high-dimensional inference.
Searching arXiv for recent and foundational papers on variance-profile random matrices. A variance profile matrix is a deterministic object that specifies entrywise second moments of a random matrix. In different conventions it appears either as the matrix of variances itself, such as in Wigner-type models, or as a standard deviation profile whose Hadamard square is the variance profile (Ducatez et al., 2024, Cook et al., 2016, Adhikari et al., 2019). The notion generalizes homogeneous-variance ensembles by allowing heterogeneous variances across entries, and the resulting profile governs the limiting spectral distribution, spectral edge, operator norm, pseudospectral support, fluctuation theory, large deviations, and several high-dimensional inference procedures (Husson, 2020, Cheliotis et al., 2024, Alt et al., 2024, Bigot et al., 2024, Dabo et al., 3 Apr 2025, Xiao et al., 3 Jun 2026).
1. Definitions and conventions
The common feature across the literature is entrywise heteroscedasticity. In the Hermitian Wigner-type setting of large deviations, one considers real symmetric matrices
with independent centered entries for , and defines the variance profile by
For off-diagonal entries, , while for diagonal entries, (Ducatez et al., 2024).
In non-Hermitian models, a standard convention is the rescaled entrywise product
where is deterministic with nonnegative entries and 0 has i.i.d. centered unit-variance entries. The associated normalized variance profile is
1
so that 2 (Cook et al., 2016, Cook et al., 2020).
In statistical models, the same idea appears as a deterministic modulation of an i.i.d. design. For ridge regression with non-identically distributed predictors,
3
and 4 is called the variance profile because 5 (Bigot et al., 2024). An analogous formulation is used for random features, where the variance profile may enter both the data matrix and, in a more general Gaussian-equivalence model, the random-feature matrix (Dabo et al., 3 Apr 2025).
| Setting | Profile object | Meaning |
|---|---|---|
| Hermitian Wigner-type | 6 or 7 | Position-dependent entry variances |
| Non-Hermitian entrywise product | 8 or 9 | Standard deviation profile squared |
| High-dimensional regression | 0 | Entrywise predictor variances |
A central structural assumption is convergence of the discrete profile to a continuum kernel. In the Hermitian setting, one assumes that there exist points 1 in 2 and a symmetric function 3 such that
4
and that the empirical distribution of the 5 converges weakly to the uniform law on 6 (Ducatez et al., 2024). In sampled non-Hermitian profiles one similarly writes 7 or 8 (Cook et al., 2020, Hachem et al., 7 Jan 2025).
A recurrent terminological distinction is that some papers call 9 the “standard deviation profile” and 0 the “variance profile,” while others directly call the matrix of second moments the variance profile (Adhikari et al., 2019, Cook et al., 2016). This is a difference of convention rather than substance.
2. Hermitian models, Dyson equations, and the spectral edge
For Hermitian variance-profile ensembles, the limiting spectral measure is described by self-consistent resolvent equations. In the discrete formulation of the Wigner-type model, with
1
the vector Dyson equation reads
2
In the continuum limit one seeks measurable 3 with
4
and the limiting spectral measure is 5 (Ducatez et al., 2024).
An equivalent formulation in the earlier variance-profile LDP literature is the quadratic vector equation
6
with 7 the Stieltjes transform of the limiting measure 8 (Husson, 2020). In both formulations, the rightmost point of the support of the limiting measure is denoted 9, and 0 in probability or almost surely under the stated assumptions (Ducatez et al., 2024, Husson, 2020).
For piecewise constant profiles, the continuum equation reduces to a finite-dimensional system. If 1 is partitioned into blocks 2 and 3 is constant on each 4, then one obtains component measures 5, and the limiting measure is their mixture (Ducatez et al., 2024). This finite-dimensional reduction is the basis for explicit edge characterizations and for block-structured examples.
The spectral edge is also the asymptotic operator norm. For symmetric random matrices with variance profile 6, the operator norm of 7 converges to the largest element of the support of the limiting empirical spectral distribution. The paper on operator norms states that finite fourth moments are sufficient for convergence in probability and finite 8 moments are sufficient for almost sure convergence (Cheliotis et al., 2024). This places the spectral-edge description of variance-profile ensembles on the same footing as the Bai–Yin theorem in the homogeneous case.
A common simplification is the constant profile. When 9, the model reduces to classical Wigner matrices, the Dyson equation gives the semicircle law, and the spectral edge is 0 after standardization (Husson, 2020). The broader role of the variance profile is therefore not merely to rescale the spectrum, but to change the self-consistent equation that determines the entire limiting measure.
3. Non-Hermitian deterministic equivalents and support geometry
For non-Hermitian matrices with independent entries and a variance profile, the central objects are deterministic equivalents defined through Master Equations. In the model
1
the empirical spectral distribution 2 is approximated by a deterministic, rotationally invariant probability measure 3 (Cook et al., 2016). Its radial cumulative distribution function is obtained from the zero-regularization limit of the Regularized Master Equations: 4 followed by the limit 5 (Cook et al., 2016, Cook et al., 2020).
The support radius is controlled by the spectral radius of the normalized variance profile. Specifically, the support of 6 is contained in the disk
7
and, except maybe at zero, 8 admits a positive density on the centered disk of radius 9 (Cook et al., 2020). In the constant-profile case, this yields the circular law; in the doubly stochastic case, the circular law is recovered as well (Cook et al., 2016). The paper on properties and examples further identifies the profiles that yield the circular law: up to diagonal conjugation, these are the doubly stochastic normalized variance profiles (Cook et al., 2020).
The behavior at zero is profile-dependent. The density may be bounded, may blow up, or may vanish while an atom appears (Cook et al., 2020). Separable profiles reduce the Master Equations to a scalar fixed-point equation, and sampled continuous profiles lead to an integral version of the same structure (Cook et al., 2020). These examples show that the variance profile shapes not only the outer boundary but also fine structure in the bulk.
A further extension combines a variance profile with an additive deterministic diagonal deformation. For matrices 0 with
1
the limiting spectral measure is identified as the Brown measure of a deformed operator-valued circular element, and its support exactly coincides with the 2-pseudospectrum in the consecutive limits 3 and 4 (Alt et al., 2024). In that framework the variance profile enters through integral operators
5
and through a matrix Dyson equation for the hermitized resolvent (Alt et al., 2024). This identifies the support as a singular-value instability boundary determined by the profile.
4. Extremes, fluctuations, and large deviations
Variance profiles affect both global fluctuations and extreme-value probabilities. For the largest eigenvalue of Hermitian Wigner-type matrices, a large deviation principle holds at speed 6 under convergence of 7 to 8 and sharp sub-Gaussian tails. The rate function is expressed in terms of the solution of a Dyson equation involving 9, and the result is new even in the Gaussian case with non-constant variance profiles (Ducatez et al., 2024). An earlier formulation gives
0
with 1 an annealed spherical-integral variational functional over probability measures on 2 (Husson, 2020). The later work removes several restrictive assumptions by using a more flexible rate function and a refined proof (Ducatez et al., 2024).
For non-Hermitian matrices, an upper bound on the spectral radius is controlled directly by the variance profile matrix. Under minimal moment assumptions and sparse profiles, the spectral radius does not exceed the square root of the spectral radius of the variance profile matrix with large probability: 3 The proof uses the reverse characteristic polynomial and a random analytic function built from traces of powers of 4 (Hachem et al., 7 Jan 2025).
At the level of linear eigenvalue statistics, the variance profile enters through explicit variance bounds and Fourier or cycle-sum functionals. For Hermitian matrices 5 with variance profile 6, the paper on second-order Poincaré inequalities proves an upper bound on the total variation distance between the standardized linear eigenvalue statistic and the standard Gaussian random variable, and uses it to establish CLTs for several classes of variance profiles (Adhikari et al., 2019). For non-Hermitian random band matrices with variance profile
7
the fluctuations of linear eigenvalue statistics converge to a Gaussian law with an explicit variance formula depending on the Fourier transform of the profile (Jana, 2019).
These results make clear that a variance profile is not a peripheral perturbation. It modifies the limiting edge, the operator norm, the support of the limiting density, and the asymptotic cost of rare spectral events.
5. Statistical, algorithmic, and applied roles
In high-dimensional regression, the variance profile matrix encodes non-identically distributed predictors and determines deterministic equivalents for predictive risk and degrees of freedom. For the model
8
the ridge estimator admits deterministic equivalents expressed through diagonal resolvent limits 9 and 0 satisfying a variance-profile Dyson equation (Bigot et al., 2024). In the quasi doubly stochastic case these equivalents collapse to the classical Marchenko–Pastur fixed point and reproduce the standard double-descent profile, while other profiles produce different shapes, including “triple descent” in simulations (Bigot et al., 2024).
The same phenomenon persists in random features. For non-iid feature vectors with variance profile, operator-valued free probability and a block linearization yield deterministic equivalents for training and prediction risks associated with ridge regression in the random-features model (Dabo et al., 3 Apr 2025). Under a row-stochastic assumption on the variance profile, explicit Marchenko–Pastur formulas appear in the chaos-only case; more general cases require solving an operator-valued fixed-point equation whose self-energy operator is built from the profile (Dabo et al., 3 Apr 2025).
The variance profile also modifies iterative inference algorithms. For diagonal expectation propagation under variance-profile Gaussian sensing matrices,
1
the effective observation seen by the nonlinear module is generally not a fresh scalar Gaussian channel. Instead, the residuals form a coordinate-dependent Gaussian process whose covariance is shaped by the variance profile and by the finite linear history of the algorithm (Xiao et al., 3 Jun 2026). The paper characterizes this process through a conditioned matrix-Dyson-equation deterministic equivalent and a Gaussian-regression decomposition that separates predictable memory from orthogonal innovation (Xiao et al., 3 Jun 2026).
In spin-glass theory, the variance profile matrix appears as a deterministic, symmetric matrix 2 with nonnegative entries controlling the covariance of Gaussian couplings: 3 At sufficiently high temperature, the free energy is approximated by a deterministic functional of the fixed point
4
and the TAP/AMP Onsager correction becomes profile-dependent through 5 (Hachem, 28 Apr 2026).
Applied settings use the same object in lower-dimensional or structured models. In low-rank denoising with heteroscedastic noise, a GUE or rectangular Gaussian matrix with variance profile leads to operator-valued resolvent equations and profile-aware determinant equations for outliers (Bigot et al., 2019). In a 6 complex central Gaussian channel with arbitrary variances 7, the variance profile matrix 8 fundamentally departs from classical Wishart models and yields exact formulas for the distribution of the Gram matrix and of its eigenvalues (Auguin et al., 2017).
6. Structured profiles, computation, and recurring distinctions
Several structured classes recur across the literature. Constant profiles recover semicircle or circular laws (Husson, 2020, Cook et al., 2016). Block-constant profiles reduce continuum fixed-point equations to finite-dimensional systems and are used for community structure, deformed models, and explicit edge characterizations (Ducatez et al., 2024, Bigot et al., 2019). Band or spatially decaying profiles induce stronger coupling for nearby indices and modify the limiting spectral distribution away from the homogeneous case (Ducatez et al., 2024, Jana, 2019). Separable profiles
9
collapse the non-Hermitian Master Equations to a scalar equation and produce explicit radial densities, including Girko’s Sombrero distribution (Cook et al., 2020). Sampled continuous profiles discretize kernels 0 or 1 on 2 and connect finite matrices to compact integral operators (Hachem et al., 7 Jan 2025, Cook et al., 2020).
A standard computational route is profile discretization followed by solution of a self-consistent system. For the Hermitian LDP, one discretizes 3, approximates 4 by a matrix, solves the discrete Dyson equation, and then evaluates the functionals entering the rate function (Ducatez et al., 2024). For non-Hermitian deterministic equivalents, one solves the Regularized Master Equations for decreasing regularization, obtains the radial CDF
5
and differentiates numerically to recover the density (Cook et al., 2016). For high-dimensional regression with variance profile, one solves the vector Dyson equation for 6 and uses it in the explicit risk formula (Bigot et al., 2024).
Two distinctions recur and often remove apparent contradictions. First, a variance profile matrix is not the same object as a single population covariance matrix. In the regression papers, the profile is entrywise and may vary with both row and column; it is therefore more general than a fixed covariance 7 shared across observations (Bigot et al., 2024, Dabo et al., 3 Apr 2025). Second, zero entries are compatible with much of the non-Hermitian theory, provided one imposes quantitative irreducibility or related admissibility assumptions (Cook et al., 2016, Cook et al., 2020). By contrast, some earlier Hermitian large-deviation arguments required continuity of a variational maximizer or positivity assumptions in the lower bound, and this dependence on auxiliary assumptions is explicitly discussed in the later generalization (Husson, 2020, Ducatez et al., 2024).
A plausible implication is that “variance profile matrix” functions less as a single definition than as a unifying schema for inhomogeneous random matrix models. Across Hermitian, non-Hermitian, rectangular, algorithmic, and statistical settings, the profile is the deterministic object that carries heterogeneity into the limiting equations, and those equations in turn determine spectral support, edges, fluctuations, rare events, and inference performance (Ducatez et al., 2024, Cook et al., 2020, Bigot et al., 2024, Xiao et al., 3 Jun 2026).