MeanSE is a technical term with three distinct definitions: a limiting MSE in regression, an error metric in DP training, and a generative speech model in enhancement.
In high-dimensional regression, it is derived via AMP, CGMT, and LOO, yielding method-independent asymptotic risk under Gaussian design assumptions.
In DP training and speech enhancement, MeanSE captures averaged error metrics through workload query evaluation and time-averaged velocity, emphasizing task-specific surrogate quality.
MeanSE is an overloaded technical term with distinct meanings across recent arXiv literatures. In high-dimensional regression, it denotes the limiting mean squared error predicted by scalar state equations for estimators such as approximate message passing (AMP) and convex estimators analyzed through the Convex Gaussian Min-Max Theorem (CGMT). In differentially private optimization, it denotes the root mean square error averaged over a workload’s queries, typically after correlated Gaussian noise is propagated through a schedule-dependent workload matrix. In speech enhancement, MeanSE is the name of a generative model that replaces an instantaneous flow field with a mean, time-averaged velocity field to obtain strong single-step enhancement. These usages share an emphasis on low-dimensional error characterizations, but they refer to different mathematical objects and should not be conflated (Luo et al., 2022, Kalinin et al., 22 Nov 2025, Wang et al., 25 Sep 2025).
1. Terminological scope
In current usage, “MeanSE” appears in at least three technically distinct roles. First, it is an asymptotic risk quantity in high-dimensional statistics. Second, it is an error metric in matrix-factorized differentially private training. Third, it is a proper model name in generative speech enhancement. This suggests that the term is best interpreted contextually rather than as a single standardized notion.
DP-SGD with correlated noise and learning-rate schedules
MeanSE as model name
Efficient generative speech enhancement with mean flows
Single-channel speech enhancement in the STFT domain
A recurring misconception is to treat these as interchangeable. They are not. The first is a limiting MSE under asymptotic Gaussian design, the second is an averaged RMSE over workload outputs, and the third is an architecture/training framework whose name happens to contain the same string.
2. MeanSE in high-dimensional regression
In high-dimensional regression, MeanSE refers to the limiting mean squared error predicted by state equations. The canonical AMP setup considers
The central result is that apparently different scalar characterizations derived by AMP, CGMT, and leave-one-out (LOO) arguments are equivalent after explicit parameter transformations. For robust M-estimation, the mappings
MeanSE(W,Σ)=(1/m)tr(WΣW⊤)0
and
MeanSE(W,Σ)=(1/m)tr(WΣW⊤)1
make the different state-equation systems identical. For LASSO, the mapping
MeanSE(W,Σ)=(1/m)tr(WΣW⊤)2
aligns the CGMT scalar system with the AMP state evolution. For logistic regression, the mapping
MeanSE(W,Σ)=(1/m)tr(WΣW⊤)3
plays the same role. Under these transformations, the predicted MeanSE is method-independent in the high-dimensional Gaussian-design limit, provided the regularity assumptions hold: MeanSE(W,Σ)=(1/m)tr(WΣW⊤)4 with MeanSE(W,Σ)=(1/m)tr(WΣW⊤)5, Gaussian design, separable prior or denoiser, and uniqueness or stability of the state-evolution fixed point (Luo et al., 2022).
3. MeanSE as an error metric in private training
In differentially private training with learning-rate schedules and correlated noise, MeanSE is defined for a workload MeanSE(W,Σ)=(1/m)tr(WΣW⊤)6 and noise covariance MeanSE(W,Σ)=(1/m)tr(WΣW⊤)7 by
MeanSE(W,Σ)=(1/m)tr(WΣW⊤)8
The corresponding worst-case metric is
MeanSE(W,Σ)=(1/m)tr(WΣW⊤)9
Here the workload is induced by scheduled SGD updates. With y=Ax0+w,Aij∼i.i.d.N(0,m1),w∼N(0,σw2Im),δ=nm.0 iterations, base learning rate y=Ax0+w,Aij∼i.i.d.N(0,m1),w∼N(0,σw2Im),δ=nm.1, schedule y=Ax0+w,Aij∼i.i.d.N(0,m1),w∼N(0,σw2Im),δ=nm.2, and actual step size y=Ax0+w,Aij∼i.i.d.N(0,m1),w∼N(0,σw2Im),δ=nm.3, the cumulative dependence on clipped gradients is represented by
where y=Ax0+w,Aij∼i.i.d.N(0,m1),w∼N(0,σw2Im),δ=nm.5 is the lower-triangular matrix of ones and y=Ax0+w,Aij∼i.i.d.N(0,m1),w∼N(0,σw2Im),δ=nm.6. Constant, exponential, polynomial, linear, cosine, step, and warmup-plus-decay schedules all fit this formulation.
Matrix-factorization mechanisms realize correlated noise through y=Ax0+w,Aij∼i.i.d.N(0,m1),w∼N(0,σw2Im),δ=nm.7 with y=Ax0+w,Aij∼i.i.d.N(0,m1),w∼N(0,σw2Im),δ=nm.8, so that y=Ax0+w,Aij∼i.i.d.N(0,m1),w∼N(0,σw2Im),δ=nm.9. Then
The paper factors the workload as xt+1=η(xt+A⊤zt;θt),zt=y−Axt+δzt−1⟨η′(xt−1+A⊤zt−1;θt−1)⟩,1, adds Gaussian noise to xt+1=η(xt+A⊤zt;θt),zt=y−Axt+δzt−1⟨η′(xt−1+A⊤zt−1;θt−1)⟩,2, and returns xt+1=η(xt+A⊤zt;θt),zt=y−Axt+δzt−1⟨η′(xt−1+A⊤zt−1;θt−1)⟩,3; this yields
The schedule-aware contribution is a Toeplitz square-root construction. For exponential decay xt+1=η(xt+A⊤zt;θt),zt=y−Axt+δzt−1⟨η′(xt−1+A⊤zt−1;θt−1)⟩,5, one sets
The schedule-aware factorization improves over prefix-sum factorizations under both MaxSE and MeanSE, with the strongest theoretical and empirical gains under stronger decay schedules (Kalinin et al., 22 Nov 2025).
4. MeanSE as a generative speech enhancement model
As a model name, MeanSE denotes an efficient generative speech enhancement system based on mean flows. The task is single-channel speech enhancement in the STFT domain, with clean speech τt2=σw2+δ1E[(η(X0+τt−1Z;θt−1)−X0)2],1, noisy speech τt2=σw2+δ1E[(η(X0+τt−1Z;θt−1)−X0)2],2, flow state τt2=σw2+δ1E[(η(X0+τt−1Z;θt−1)−X0)2],3, and conditional velocity field τt2=σw2+δ1E[(η(X0+τt−1Z;θt−1)−X0)2],4. Standard conditional flow matching learns the instantaneous field in
MeanSE replaces the instantaneous target with the average velocity over an interval τt2=σw2+δ1E[(η(X0+τt−1Z;θt−1)−X0)2],9: MSEt=E[(η(X0+τt−1Z;θt−1)−X0)2].0
It is trained by regressing this analytic mean-flow target: MSEt=E[(η(X0+τt−1Z;θt−1)−X0)2].1
For MSEt=E[(η(X0+τt−1Z;θt−1)−X0)2].2 intervals, inference updates
MSEt=E[(η(X0+τt−1Z;θt−1)−X0)2].3
and the single-step specialization is
MSEt=E[(η(X0+τt−1Z;θt−1)−X0)2].4
The architecture uses NCSN++ with complex STFT input, MSEt=E[(η(X0+τt−1Z;θt−1)−X0)2].5, hop length MSEt=E[(η(X0+τt−1Z;θt−1)−X0)2].6, and spectral image size MSEt=E[(η(X0+τt−1Z;θt−1)−X0)2].7. Time conditioning uses separate Gaussian Fourier feature embeddings for MSEt=E[(η(X0+τt−1Z;θt−1)−X0)2].8 and MSEt=E[(η(X0+τt−1Z;θt−1)−X0)2].9, fused into a single embedding. Two stabilization strategies are central: flow field mix-up, in which τt→τ⋆0 is used with a specified “flow ratio,” and time interval curriculum learning with maximum interval lengths τt→τ⋆1. Training uses VoiceBank-DEMAND at τt→τ⋆2 kHz, with learning rate τt→τ⋆3 from scratch and τt→τ⋆4 for fine-tuning, weight decayτt→τ⋆5, τt→τ⋆6, batch size τt→τ⋆7, and approximately τt→τ⋆8 epochs.
On VoiceBank-DEMAND, the 1-NFE comparison against FlowSE reports: FlowSE, NFEτt→τ⋆9, SIGθt→θ⋆0, BAK θt→θ⋆1, OVRL θt→θ⋆2, UTMOSθt→θ⋆3, WVMOS θt→θ⋆4, NISQAθt→θ⋆5, PESQθt→θ⋆6, ESTOI θt→θ⋆7; MeanSE, NFEθt→θ⋆8, SIG θt→θ⋆9, BAK τ⋆2=σw2+δ1E[(η(X0+τ⋆Z;θ⋆)−X0)2],0, OVRL τ⋆2=σw2+δ1E[(η(X0+τ⋆Z;θ⋆)−X0)2],1, UTMOSτ⋆2=σw2+δ1E[(η(X0+τ⋆Z;θ⋆)−X0)2],2, WVMOS τ⋆2=σw2+δ1E[(η(X0+τ⋆Z;θ⋆)−X0)2],3, NISQA τ⋆2=σw2+δ1E[(η(X0+τ⋆Z;θ⋆)−X0)2],4, PESQ τ⋆2=σw2+δ1E[(η(X0+τ⋆Z;θ⋆)−X0)2],5, ESTOI τ⋆2=σw2+δ1E[(η(X0+τ⋆Z;θ⋆)−X0)2],6. On out-of-domain WHAMR!, the 1-NFE comparison gives FlowSE: DNSMOS τ⋆2=σw2+δ1E[(η(X0+τ⋆Z;θ⋆)−X0)2],7, UTMOS τ⋆2=σw2+δ1E[(η(X0+τ⋆Z;θ⋆)−X0)2],8, WVMOS τ⋆2=σw2+δ1E[(η(X0+τ⋆Z;θ⋆)−X0)2],9, NISQA MeanSE=E[(η(X0+τ⋆Z;θ⋆)−X0)2].0; MeanSE: DNSMOS MeanSE=E[(η(X0+τ⋆Z;θ⋆)−X0)2].1, UTMOS MeanSE=E[(η(X0+τ⋆Z;θ⋆)−X0)2].2, WVMOS MeanSE=E[(η(X0+τ⋆Z;θ⋆)−X0)2].3, NISQA MeanSE=E[(η(X0+τ⋆Z;θ⋆)−X0)2].4. The ablation on flow field mix-up further shows that ratio MeanSE=E[(η(X0+τ⋆Z;θ⋆)−X0)2].5 is unstable and that larger ratios improve both in-domain and out-of-domain behavior, with MeanSE=E[(η(X0+τ⋆Z;θ⋆)−X0)2].6 used in the main results (Wang et al., 25 Sep 2025).
5. Relation to MSE and adjacent error criteria
Although the term “MeanSE” contains “MSE,” its interpretation depends on context, and raw MSE relationships do not automatically transfer to other evaluation criteria. For ordinary prediction, the population MSE between predictions MeanSE=E[(η(X0+τ⋆Z;θ⋆)−X0)2].7 and reference MeanSE=E[(η(X0+τ⋆Z;θ⋆)−X0)2].8 is
Because MeanSE(W,Σ)=(1/m)tr(WΣW⊤)03 can vary for fixed MSE, the mapping is many-to-many: the same MSE can correspond to different values of MeanSE(W,Σ)=(1/m)tr(WΣW⊤)04, and a lower MSE does not imply a higher concordance correlation. This is directly relevant to MeanSE terminology. In the high-dimensional-regression sense, MeanSE is an asymptotic risk target. In the DP-workload sense, it is already a transformed RMSE over multiple linear queries. In speech enhancement, it is not itself the evaluation metric, since reported performance also uses PESQ, ESTOI, DNSMOS P.835, WVMOS, UTMOS, and NISQA. A plausible implication is that “MeanSE” should be read as a task-specific surrogate or summary quantity rather than as a universal proxy for perceptual or agreement-oriented quality (Pandit et al., 2019).
6. Assumptions, limitations, and interpretive issues
Each usage of MeanSE is coupled to a specific asymptotic or algorithmic regime. In high-dimensional regression, the equivalence of AMP-, CGMT-, and LOO-derived state equations relies on high-dimensional asymptotics, Gaussian design, separable priors or denoisers, and regularity conditions such as convexity, differentiability, and fixed-point uniqueness. In private training, the schedule-aware MeanSE theory depends on workload factorization, DP calibration through MeanSE(W,Σ)=(1/m)tr(WΣW⊤)05 or MeanSE(W,Σ)=(1/m)tr(WΣW⊤)06, and regularity conditions on adjacent schedule differences; the multi-epoch theory further requires MeanSE(W,Σ)=(1/m)tr(WΣW⊤)07-min separation and banded inverse constructions. In speech enhancement, the reported MeanSE model depends on the Gaussian conditional path, analytic average-velocity targets, FlowSE initialization, flow field mix-up, and curriculum learning, and purely average-velocity training with ratio MeanSE(W,Σ)=(1/m)tr(WΣW⊤)08 is reported as unstable. These constraints imply that cross-domain translation of the term is usually semantic rather than mathematical: the shared label identifies an averaging principle over error or velocity, but not a single invariant object (Luo et al., 2022, Kalinin et al., 22 Nov 2025, Wang et al., 25 Sep 2025).
A second interpretive issue concerns notation. In the regression literature, MeanSE is literally a limiting mean squared error. In the privacy literature, MeanSE includes a square root and is therefore an averaged RMSE. In the speech-enhancement literature, MeanSE is a model name rather than an error formula. The technical literature therefore uses the same string for a risk limit, an evaluation metric, and a generative architecture. Careful reading of definitions is essential whenever the term appears without qualification.
“Emergent Mind helps me see which AI papers have caught fire online.”
Philip
Creator, AI Explained on YouTube
Sign up for free to explore the frontiers of research
Discover trending papers, chat with arXiv, and track the latest research shaping the future of science and technology.Discover trending papers, chat with arXiv, and more.