---
title: 'MeanFlowSE: One-Step Generative SE'
url: https://www.emergentmind.com/topics/meanflowse
type: topic
---

# MeanFlowSE: One-Step Generative SE

Searching arXiv for MeanFlowSE and closely related mean-flow speech enhancement papers.
arXiv search results considered:
- "MeanFlowSE: one-step generative speech enhancement via conditional mean flow" [2509.14858]
- "MeanFlowSE: One-Step Generative Speech Enhancement via MeanFlow" [2509.23299]
- "MeanSE: Efficient Generative Speech Enhancement with Mean Flows" [2509.21214]
- "Compose Yourself: Average-Velocity Flow Matching for One-Step Speech Enhancement" [2509.15952]
- Foundational context: "Mean Flows for One-step Generative Modeling" [2505.13447]

MeanFlowSE denotes a set of one-step generative speech enhancement formulations that adapt the MeanFlow idea of learning an average-velocity field over finite time intervals rather than only an instantaneous velocity field. In speech enhancement, the motivation is explicit: multistep diffusion and flow-matching systems learn local dynamics and therefore depend on iterative ODE or reverse-time solvers, whereas MeanFlowSE aims to predict a finite-interval displacement that can be applied in a single update. On arXiv, the term is presently ambiguous rather than singular, because it appears in both “MeanFlowSE: one-step generative speech enhancement via conditional mean flow” [2509.14858] and “MeanFlowSE: One-Step Generative Speech Enhancement via MeanFlow” [2509.23299], two related but architecturally distinct systems.

## 1. MeanFlow basis and the speech-enhancement rationale

The conceptual basis of MeanFlowSE is the MeanFlow formulation introduced for one-step generative modeling, where the learned object is the average velocity
\[
u(z_t,r,t) \triangleq \frac{1}{t-r}\int_r^t v(z_\tau,\tau)\,d\tau
\]
rather than the instantaneous velocity \(v(z_t,t)\). This changes inference from numerical integration of a local field to a finite jump,
\[
z_r = z_t - (t-r)\,u(z_t,r,t),
\]
and, in the one-step case, to
\[
x = z_0 = \epsilon - u_\theta(\epsilon,0,1).
\]
The original MeanFlow paper frames this as learning a finite-interval transport quantity that is better aligned with one-step generation than an infinitesimal tangent field [2505.13447].

Speech enhancement is an especially natural target for this reformulation because recent generative SE systems are constrained less by unconditional synthesis difficulty than by inference latency. Both MeanFlowSE papers state this bottleneck directly: diffusion- and flow-matching-based SE methods typically rely on multistep inference, and the need to numerically integrate or iteratively denoise is the main obstacle to real-time deployment. MeanFlowSE therefore reinterprets enhancement as a one-step conditional transport problem, with noisy speech providing the conditioning signal and the learned average-velocity field providing the entire denoising displacement in a single evaluation [2509.14858, 2509.23299].

## 2. Conditional mean flow in the complex STFT domain

The formulation in “MeanFlowSE: one-step generative speech enhancement via conditional mean flow” is built directly in the complex STFT domain and is explicitly conditional on the noisy observation \(y\). It defines a dual linear–Gaussian conditional path
\[
\mu_t = (1-t)\,x_1 + t\,y,\qquad
\sigma_t = (1-t)\,\sigma_{\min} + t\,\sigma_{\max},
\]
with
\[
x_t = \mu_t + \sigma_t z,\qquad z\sim\mathcal N(0,I).
\]
Here \(x_1\) is clean speech and \(y\) is noisy speech. Differentiating the path yields the on-path conditional instantaneous target
\[
v_t(x_t\mid x_1,y) = \mu_t' + \sigma_t' z
= \frac{\sigma_t'}{\sigma_t}(x_t-\mu_t)+\mu_t'.
\]
The mean-flow object is then defined as
\[
u(x_t,r,t\mid y) = \frac{1}{t-r}\int_r^t v(x_\tau,\tau\mid y)\,d\tau,
\]
with diagonal consistency
\[
u(x_t,t,t\mid y)=v(x_t,t\mid y).
\]

A central identity follows by differentiating \((t-r)u\):
\[
u(x_t,r,t\mid y) = v(x_t,t\mid y) - (t-r)\frac{d}{dt}u(x_t,r,t\mid y),
\]
where the total derivative along the trajectory is
\[
\frac{d}{dt}u(x_t,r,t\mid y) = v(x_t,t\mid y)\!\cdot\!\nabla_x u + \partial_t u.
\]
This converts an interval integral into a local training rule. The network \(u_\theta(x,r,t,y)\) is trained by a JVP-based first-order target,
\[
u_{\mathrm{tgt}} = v_t - c\,(t-r)\left[ v_t\!\cdot\!\nabla_x u_\theta + \partial_t u_\theta \right],
\]
with \(c=0.5\) in the reported experiments, and the loss
\[
\mathcal{L}_{\mathrm{MFSE}}
= \mathbb{E}\!\left[\left\|u_\theta(x_t,r,t,y)-\mathrm{sg}(u_{\mathrm{tgt}})\right\|_2^2\right].
\]
At \(r=t\), the correction vanishes and the objective reduces to conditional flow matching.

Inference is displacement-based rather than solver-based. The general reverse-time update is
\[
x_{t_{k+1}} = x_{t_k} - \Delta_k\,u_\theta\!\left(x_{t_k},\,r=t_{k+1},\,t=t_k\mid y\right),
\]
and the single-step form is
\[
\hat{x}_{t_\varepsilon}
= x_{T_{\mathrm{rev}}}
- (T_{\mathrm{rev}}-t_\varepsilon)\,
u_\theta\!\left(x_{T_{\mathrm{rev}}},r=t_\varepsilon,t=T_{\mathrm{rev}}\mid y\right).
\]

The implementation uses an NCSN++ U-Net with self-attention. Inputs are \((x_t,y)\) concatenated along channels; conditioning uses Gaussian Fourier embeddings of the primary time \(t\) and span \(\Delta=t-r\). The paper also reports several stabilizers: automatic differentiation for derivatives, a centered finite-difference fallback, stop-gradient on the target, per-sample \(\ell_2\) clipping for the Jacobian term, warmup of the mean-branch weight to \(0.25\), annealing the span-sampling exponent from \(8\) to \(1\), and injection of \(r=t\) in \(10\%\) of batches [2509.14858].

## 3. SSL-conditioned latent MeanFlowSE

The second MeanFlowSE paper relocates enhancement from the STFT domain to a pretrained latent space and makes SSL conditioning central. Clean speech is encoded by the WaveVAE from KALL-E into 256-dimensional latents at 25 Hz, while noisy speech is represented by WavLM-Large features. All 24 WavLM-Large transformer layers are fused through a trainable weighted sum with softmax normalization. The generative core is a DiT with \(N=8\) transformer layers, 8 attention heads, hidden size 512, and feed-forward dimension 2048 [2509.23299].

Its MeanFlow equations are the standard average-velocity relations:
\[
u(z_t,r,t) = \frac{1}{t-r}\int_r^t v(z_\tau,\tau)\,d\tau,
\]
with direct one-step transport written first as
\[
z_0 = z_1 - u(z_1,0,1),
\]
and operationally, at inference, as
\[
z_0 = \epsilon - \hat{u}.
\]
The enhanced waveform is then reconstructed by the VAE decoder,
\[
\hat{x}=\mathrm{Dec}(z_0).
\]

Training predicts \(\hat u(z_t,r,t)\) from interpolated latent \(z_t\), noisy SSL conditioning \(z_y\), positional encodings, and time embeddings \(\mathrm{TE}(r)\) and \(\mathrm{TE}(t)\). The reported objective is an adaptive weighted squared error,
\[
\mathcal{L} = \mathbb{E}\!\left[w \cdot \| \hat{u}(z_t,r,t)-u \|_2^2 \right],
\]
where
\[
w = (\delta^2 + c )^{-(1-\gamma)}, \qquad \delta^2 = \| \hat{u} - u \|_2^2.
\]
The paper states that the target average velocity is derived analytically from \(z_x\) and \(\epsilon\), and that MeanFlow is implemented with an autograd-based JVP formulation.

A defining architectural claim is that SSL conditioning is superior to conditioning on noisy VAE latents. The ablation named MeanFlowSE\(_{\text{VAE input}}\) keeps the same one-step backbone and runtime but degrades both perceptual and semantic metrics, including a simulated-set WER increase from \(8.5\) to \(18.4\). This assigns a specific role to the WavLM representation: it is not an auxiliary loss target, but the principal noisy-speech guidance signal for the latent transport model [2509.23299].

## 4. Position within the broader mean-flow speech-enhancement literature

MeanFlowSE belongs to a broader 2025 line of SE work that replaces instantaneous-flow modeling with interval-level transport quantities. The immediate baseline is FlowSE, which remains a conditional flow-matching method with an instantaneous velocity field \(v_\theta(x_t,y,t)\) and forward ODE integration from \(x_0\sim\mathcal N(y,\sigma^2 I)\). Its conditional path is centered on the noisy speech through
\[
\mu_t(x_1,y)=t x_1+(1-t)y,\qquad \sigma_t=(1-t)\sigma,
\]
but inference still requires Euler integration with \(N\in\{1,2,3,4,5\}\) steps [2508.06840].

MeanSE moves closer to the first MeanFlowSE formulation. It defines
\[
u(x_t,r,t\mid y)=\frac{1}{t-r}\int_r^t v_\tau(x_\tau\mid y)\,d\tau
\]
and uses the one-step rule
\[
x_0 = x_1 - u_\theta(x_1,0,1,y).
\]
Its reported training recipe requires flow field mix-up, initialization from a trained FlowSE checkpoint, and interval curriculum learning, which the paper presents as necessary because directly regressing mean flows from scratch is unstable [2509.21214].

COSE occupies a different point in the design space. It keeps the average-velocity target for one-step SE but replaces MeanFlow’s JVP-based differential identity with a velocity composition identity derived from ODE semigroup structure:
\[
u(\boldsymbol{x}_{t_1}, t_1, t_2, \boldsymbol{y})
= (1-\alpha)\, u(\boldsymbol{x}_m, m, t_2, \boldsymbol{y})
+ \alpha\, u(\boldsymbol{x}_{t_1}, t_1, m, \boldsymbol{y}).
\]
The paper’s core claim is that this eliminates JVPs while preserving theoretical consistency and reduces training cost by \(40\%\) and sampling cost by up to \(5\times\) without compromising enhancement quality [2509.15952].

Taken together, these papers show that “mean flow” in SE is not a single implementation but a methodological direction: interval-average velocity, one-step displacement, and the replacement of ODE integration by direct transport.

## 5. Reported empirical performance

The two MeanFlowSE papers report on different benchmarks and use different representations, so their metrics are not directly interchangeable. This suggests that MeanFlowSE is better understood as a design family than as a single benchmarked system [2509.14858, 2509.23299].

| Variant | Benchmark | Reported result |
|---|---|---|
| MeanFlowSE [2509.14858] | VoiceBank-DEMAND | \(1\) NFE, ESTOI \(0.881\), SI-SDR \(19.975\), BAK \(4.073\), RTF \(0.11\) |
| MeanFlowSE [2509.23299] | Simulated DNS test | WER \(8.5\), RTF \(0.013\), \(40.7\)M parameters |
| MeanFlowSE [2509.23299] | DNS blind test, with reverb | SIG \(3.615\), BAK \(4.177\), OVRL \(3.368\) |

On VoiceBank-DEMAND, the conditional-mean-flow variant reports the strongest ESTOI, SI-SDR, BAK, and SpkSim in its comparison table, together with the lowest RTF. Its OVRL score \(3.207\) is slightly below the Schrödinger Bridge value \(3.216\), but it reaches that regime with \(1\) NFE rather than \(30\) [2509.14858].

On the DNS blind and simulated tests, the latent SSL-conditioned variant reports SOTA-level perceptual quality and competitive intelligibility. On the simulated test set it has the best WER, lowest RTF, and smallest parameter count among the listed generative baselines. Against its own flow-matching ablations, MeanFlowSE trades a small residual quality gap to FM(100) for a substantially lower RTF: \(0.013\) versus \(0.086\) [2509.23299].

## 6. Misconceptions, ambiguity, and open questions

A common misconception is that MeanFlowSE names one canonical architecture. Current arXiv usage does not support that reading: one MeanFlowSE is an STFT-domain conditional mean-flow model with JVP-based first-order correction, and another is an SSL-conditioned latent DiT with a WaveVAE decoder. A second misconception is that MeanFlowSE is simply FlowSE run with fewer steps. FlowSE still learns an instantaneous vector field and integrates an ODE, whereas MeanFlowSE variants explicitly learn average-velocity fields for one-step displacement or latent refinement. A third misconception is that one-step transport removes technical complexity. The reported systems still rely on derivative handling, span sampling, clipping, pretrained SSL or VAE components, and carefully chosen conditioning schemes. Related work such as COSE further indicates that JVP overhead remains an active optimization target. These points are all visible across the MeanFlowSE, FlowSE, MeanSE, and COSE papers [2508.06840, 2509.14858, 2509.23299, 2509.21214, 2509.15952].

The open issues are similarly concrete. The conditional-mean-flow paper explicitly lists its use of a linear–Gaussian path and first-order derivative estimation as a limitation and points to more flexible or data-driven paths, higher-order corrections, and evaluation under real-world conditions. The latent SSL-conditioned paper identifies further improvement of speech quality, adaptation to low-latency streaming, and extension to full-band scenarios as future directions. MeanSE adds a practical warning: directly learning mean flows from scratch can be unstable without flow field mix-up and interval curriculum. A plausible implication is that MeanFlowSE should presently be read less as a finished canonical recipe than as a rapidly consolidating research program for one-step generative speech enhancement.

Source: https://www.emergentmind.com/topics/meanflowse