---
title: Conditional Diffusion Model (CDiff) Overview
url: https://www.emergentmind.com/topics/conditional-diffusion-model-cdiff
type: topic
---

# Conditional Diffusion Model (CDiff) Overview

Searching arXiv for the provided paper and closely related conditional diffusion work to ground the article.
Conditional Diffusion Model (CDiff) denotes a class of diffusion-based generative models in which sampling or denoising is explicitly conditioned on auxiliary information. In the literature represented here, the term is used in several related but domain-specific senses: as a generalized diffusion probabilistic model for speech enhancement that incorporates the observed noisy speech signal into both the diffusion and reverse processes [2202.05256]; as a conditional generative model that reconstructs fine-grained environment-and-channel fingerprints maps from coarse observations [2505.07894]; as a receiver-side conditional decoder for wireless semantic communications [2509.22282]; and as a broader design pattern in applications such as longitudinal MRI generation [2411.05860], cortical thickness trajectory prediction [2403.06940], target speech extraction [2308.03987], electrical impedance tomography [2501.05769], graph synthesis [2311.01729], and planning in offline meta-reinforcement learning [2305.19923]. Across these uses, CDiff replaces unconditional generation with generation under side information, either by modifying the forward diffusion process, the reverse denoising process, or both.

## 1. Conceptual scope and defining characteristics

In standard diffusion probabilistic modeling, a forward process gradually corrupts data and a reverse process learns to denoise it. The conditional variant augments this construction with side information such as noisy observations, class labels, speaker clues, spatial context, temporal encodings, or task embeddings. The resulting model learns a conditional distribution rather than an unconditional one. For speech enhancement, this is formalized as a “conditional diffusion probabilistic model” that incorporates the observed noisy speech signal \( y \) into both the diffusion and reverse processes, with the stated goal of adapting to non-Gaussian real noises in the estimated speech signal [2202.05256].

A recurring distinction in the literature is where conditioning enters the model. In some formulations, conditioning appears only in the reverse process, as in the high-resolution EnvCF reconstruction model that learns \( p(\boldsymbol{\mathsf{F}} \mid \boldsymbol{\dot{\mathsf{F}}}) \) using a conditional denoising network [2505.07894]. In others, conditioning appears in both the forward and reverse processes, as in the speech-enhancement CDiff and the semantic communications decoder, where the noising trajectory itself is altered by the condition [2202.05256, 2509.22282]. A further variation is sparse or indirect conditioning: conditional sampling can be performed using an unconditional diffusion model and limited explicit guidance, with model predictive control used to approximate unavailable guidance at unguided steps [2210.12192].

This diversity suggests that “CDiff” is best understood as a family of conditional generative diffusion constructions rather than a single canonical architecture. A plausible implication is that the most informative taxonomy separates methods by conditioning locus: forward-conditioned, reverse-conditioned, and guidance-conditioned variants.

## 2. Mathematical formulations

For speech enhancement, CDiff is introduced as a generalized formulation of the diffusion probabilistic model. The conditional forward process is

\[
q_{\text{cdiff}}(x_t|x_0, y) = \mathcal{N}\big(x_t; (1-m_t)\sqrt{\bar{\alpha}_t} x_0 + m_t\sqrt{\bar{\alpha}_t} y, \delta_t I \big) \tag{8}
\]

with

\[
\delta_t = (1-\bar{\alpha}_t) - m_t^2 \bar{\alpha}_t \tag{9}
\]

where \( m_t \) smoothly transitions from \( 0 \) to \( 1 \), so that early steps are more influenced by \( x_0 \) and later steps by \( y \) [2202.05256]. The corresponding conditional reverse process is

\[
p_{\text{cdiff}}(x_{t-1} | x_t, y) = \mathcal{N}(x_{t-1}; \mu_\theta(x_t, y, t), \tilde{\delta}_t I) \tag{12}
\]

with

\[
\mu_\theta(x_t, y, t) = c_{xt} x_t + c_{yt} y - c_{\epsilon t} \epsilon_\theta(x_t, y, t) \tag{13}
\]

where the network \( \epsilon_\theta \) predicts the noise, including non-Gaussian components [2202.05256].

The associated conditional ELBO is given as

\[
\begin{align*}
\mathrm{ELBO} = & -\mathbb{E}_q \Bigg[ D_{\mathrm{KL}}(q_{\text{cdiff}}(x_T|x_0, y) \| p_{\text{latent}}(x_T|y)) \\
& + \sum_{t=2}^T D_{\mathrm{KL}}(q_{\text{cdiff}}(x_{t-1}|x_t, x_0, y) \| p_\theta(x_{t-1}|x_t, y)) \\
& - \log p_\theta(x_0|x_1, y) \Bigg] \tag{16}
\end{align*}
\]

which leads to a conditional noise-prediction loss,

\[
\mathcal{L}_{\text{CDiff}} = \mathbb{E}_{x_0, \epsilon, y, t} \left\| \frac{m_t \sqrt{\bar{\alpha}_t}}{\sqrt{1-\bar{\alpha}_t}} (y - x_0) + \frac{\sqrt{\delta_t}}{\sqrt{1-\bar{\alpha}_t}} \epsilon  - \epsilon_\theta(x_t, y, t) \right\|_2^2 \tag{26}
\]

so the target contains both standard Gaussian noise and the actual noise in \( y - x_0 \) [2202.05256].

Other CDiff instances retain the DDPM objective but condition only the reverse model. In EnvCDiff, the forward process is Gaussian,

\[
q(\boldsymbol{\mathsf{F}_{1:T}} | \boldsymbol{\mathsf{F}_0}) = \prod_{t=1}^T q(\boldsymbol{\mathsf{F}_t} | \boldsymbol{\mathsf{F}_{t-1}})
\]

with

\[
\boldsymbol{\mathsf{F}_t} = \sqrt{\bar{\alpha}_t}\, \boldsymbol{\mathsf{F}_0} + \sqrt{1-\bar{\alpha}_t}\, \boldsymbol{\varepsilon}_t,
\qquad
\bar{\alpha}_t = \prod_{i=1}^t (1-\beta_i),
\]

while the conditional reverse process is

\[
p(\boldsymbol{\mathsf{F}_{0:T}} | \boldsymbol{\dot{\mathsf{F}}}) = p(\boldsymbol{\mathsf{F}_T}) \prod_{t=1}^T p_\theta(\boldsymbol{\mathsf{F}_{t-1}} | \boldsymbol{\mathsf{F}_t}, \boldsymbol{\dot{\mathsf{F}}})
\]

and training minimizes

\[
\mathcal{L}(\theta) = \sum_{t=1}^T \mathbb{E}_{\boldsymbol{\mathsf{F}_0}, \boldsymbol{\varepsilon}_t}\Big[\, \|\, \boldsymbol{\varepsilon}_t - \boldsymbol{\varepsilon}_\theta\big(\boldsymbol{\dot{\mathsf{F}}},\, \boldsymbol{\mathsf{F}_t}, t\big)\, \|_2^2\, \Big]
\]

[2505.07894].

In wireless semantic communications, the conditional diffusion decoder uses a forward process conditioned on semantic information,

\[
q(\boldsymbol{x}_t | \boldsymbol{x}_0, \tilde{\boldsymbol{y}}_{\mathrm{sem}})
\sim \mathcal{N} \left( (1-w_t)\sqrt{\bar{\alpha}_t} \boldsymbol{x}_0 + w_t\sqrt{\bar{\alpha}_t} \tilde{\boldsymbol{y}}_{\mathrm{sem}}, \delta_t \mathbf{I} \right),
\]

with the reverse update

\[
\boldsymbol{x}_{t-1} = \psi_x \boldsymbol{x}_t + \psi_{y} y - \psi_{\epsilon} \bm{\epsilon}_\theta(\boldsymbol{x}_t, y, t) + \sqrt{\delta_t} \boldsymbol{z}
\]

and

\[
\bm{\epsilon}_\theta(\boldsymbol{x}_t, y, t) := \frac{ \boldsymbol{x}_t - \sqrt{ \bar{\alpha}_t} \hat{\boldsymbol{x}}_\theta(\boldsymbol{x}_t, y; t) }{ \sqrt{1 - \bar{\alpha}_t} }
\]

[2509.22282].

These formulations show two common mathematical motifs. First, conditioning may shift the mean of the forward kernel. Second, the denoiser or score estimator typically takes the noisy state, the condition, and the timestep as inputs, with training reduced to a noise-prediction or denoised-sample regression objective.

## 3. Conditioning mechanisms and architectural patterns

The conditioning variable can be an observed corrupted signal, a coarse-resolution field, a clue identifying a target source, a baseline scan, a temporal interval, or a task representation. In the speech-enhancement CDiff, \( y \) is the observed noisy speech signal, and the model is designed so that the latent variable trajectory traverses between clean and observed noisy data [2202.05256]. In EnvCDiff, the condition is the low-resolution EnvCF map \( \boldsymbol{\dot{\mathsf{F}}} \), provided at every denoising step as side information to ensure that hallucinated fine details are consistent with known coarse structure [2505.07894]. In the semantic communications decoder, the condition is the noisy semantic latent received through the channel, incorporated to “steer” the decoding process toward the intended semantics [2509.22282].

Architecturally, several patterns recur. A U-Net backbone is used in precipitation downscaling, with the concatenated low-resolution input, topographic information, and noise-corrupted high-resolution precipitation image fed into the network at each timestep [2412.14539]. An attention-based 3D UNet is used for longitudinal MRI generation, where the noisy image, conditioning MRI, and time-visit encoding are combined through latent summation,

\[
\mathcal{E}_\theta(x_t, t, S, \Delta) = D\left(E\left(F(x_t) + H(S) + P(\Delta), t \right), t\right)
\]

[2411.05860]. In cortical thickness trajectory prediction, baseline CTh, demographics, diagnosis, and time difference are concatenated along the channel dimension of a 1D Attention U-Net input tensor [2403.06940]. In tabular building-energy imputation, a single MLP takes noisy target features, condition features, masks, and timestep embedding, with condition features kept fixed and visible at all timesteps [2511.02930]. In wireless channel identification, a transformer conditions its attention and MLP mechanisms on scenario label \( c \) and timestep \( t \) to capture hidden channel features in multiple latent noise spaces [2506.12419].

A notable alternative to explicit conditional training is training-free energy guidance. FreeDoM uses off-the-shelf pre-trained networks to construct time-independent energy functions, estimates a clean image from the current noisy state, and applies an energy gradient step during sampling,

\[
\mathbf{x}_{t-1} = \mathbf{m}_t - \rho_t \nabla_{\mathbf{x}_t}\mathcal{E}(\mathbf{c}, \mathbf{x}_t)
\]

which turns an unconditional diffusion model into a conditional one without extra training [2303.09833]. Relatedly, “Conditional Diffusion with Less Explicit Guidance via Model Predictive Control” studies conditional sampling using an unconditional diffusion model with limited explicit guidance, approximating missing guidance by differentiable forward simulation and backpropagation [2210.12192].

## 4. Training, sampling, and inference workflows

The generic training pattern in CDiff methods is to sample a clean datum and condition, choose a timestep, corrupt the datum according to the forward process, and optimize a denoising objective. In speech enhancement, training samples \( (x_0, y) \), \( \epsilon \), and \( t \), generates \( x_t \) using the interpolated conditional forward process, predicts combined noise with \( \epsilon_\theta(x_t, y, t) \), and minimizes \( \mathcal{L}_{\text{CDiff}} \) [2202.05256]. In speech-enhancement inference, sampling begins with

\[
x_T \sim \mathcal{N}(\sqrt{\bar{\alpha}_T} y, \delta_T I)
\]

and iteratively computes

\[
x_{t-1} = c_{xt} x_t + c_{yt} y - c_{\epsilon t} \epsilon_\theta(x_t, y, t) + \text{noise}
\]

until producing the clean estimate \( x_0 \) [2202.05256].

In conditional tabular imputation, the sample is partitioned into observed variables \( x^{\text{cond}} \) and unobserved variables \( x^{\text{target}} \). Diffusion is applied only to \( x^{\text{target}} \), while \( x^{\text{cond}} \) remains fixed and conditions each reverse step. Dynamic masking randomizes the observed/target split during training, and inference begins from random noise on masked features before iterative denoising conditioned on the fixed observed part [2511.02930].

In target speech extraction, the forward SDE corrupts clean target speech \( x_0 \) toward the mixture \( y \),

\[
\mathrm{d}x_t = \gamma (y - x_t)\,\mathrm{d}t + g(t)\,\mathrm{d}w,
\]

and the reverse SDE samples target speech conditioned on mixture \( y \) and clue \( c \),

\[
\mathrm{d}x_t = [-f(x_t, y) + g(t)^2 \nabla_{x_t} \log p_t(x_t|y, c)]\,\mathrm{d}t + g(t)\, \mathrm{d}\bar{w}
\]

[2308.03987]. That work also introduces ensemble inference, which repeats sampling multiple times with different random seeds and averages the outputs to reduce extraction errors caused by the diffusion process [2308.03987].

In the EIT reconstruction framework CDMVC, the condition is an initial pre-imaged conductivity reconstruction \( I \), concatenated channel-wise with the noisy conductivity sample at each step. Sampling includes an additional optimization stage every several steps to enforce voltage consistency using a forward voltage constraint network,

\[
\widehat{\sigma}_0' = \arg \min_{\widehat{\sigma}_0} \frac{1}{2} \| v - F_{\hat{\theta}}(\widehat{\sigma}_0)\|_2^2
\]

[2501.05769]. This illustrates a broader pattern in CDiff applications: conditional generation is often combined with domain-specific constraints during sampling rather than relying on denoising alone.

## 5. Empirical behavior across domains

The empirical claims in the literature emphasize improvements in fidelity, robustness, and generalization under the relevant task-specific metrics.

For speech enhancement on VoiceBank + DEMAND, the implemented CDiff variant, CDiffuSE, outperforms its unconditional Diffusion baseline DiffuSE by a clear margin in an ablation study, with PESQ improving from \( 2.44 \rightarrow 2.52 \) for the Large model, and perceptual metrics such as CSIG and COVL also improving [2202.05256]. The same study reports that compared with SEGAN, DSEGAN, and SE-Flow, CDiffuSE performs better, especially in PESQ, and that under unseen noise, trained on VoiceBank-DEMAND and tested on CHiME-4, CDiffuSE degrades less and achieves best scores on all metrics among the compared methods [2202.05256].

For sparse-guidance conditional sampling, model predictive control approximations to guidance have high cosine similarity to real guides, above \( 0.99 \) even when \( \delta = 500 \) steps out of \( T=1000 \), and above \( 0.80 \) even for \( \delta = 900 \). Baselines using image-level guidance gradients such as CLIP are near \( 0.01 \), almost orthogonal to the true conditional guide [2210.12192]. In Stable Diffusion experiments with only 5 explicit guidance steps, adding 3 MPC-approximated guidance steps reduces FID to Reference from \( 400.0 \) to \( 282.4 \), and FID to Gold Standard from \( 443.3 \) to \( 312.8 \) [2210.12192].

For precipitation downscaling, the bias-informed conditional diffusion model achieves highly accurate results in an 8 times downscaling setting, outperforming previous deterministic methods [2412.14539]. The reported table gives RMSE \( 2.972 \), Corr \( 0.945 \), and Bias \( -0.0389 \) for the full model, compared with RMSE \( 5.921 \), Corr \( 0.828 \), and Bias \( 0.0660 \) for SRCNN [2412.14539].

For longitudinal MRI generation, the conditional diffusion model reaches FID \( 33.75 \) and SSIM \( 0.2774 \), compared with FID \( 39.28 \) and SSIM \( 0.2314 \) for Med-DDPM and FID \( 201.32 \) and SSIM \( 0.2662 \) for VAE [2411.05860]. For cortical thickness trajectory prediction, CDiff yields MAE \( 0.092 \pm 0.032 \) over all subjects, compared with \( 0.117 \pm 0.026 \) for GRUD, \( 0.120 \pm 0.024 \) for LSTM-T, and \( 0.150 \pm 0.108 \) for cFSGL, while Bland-Altman analysis shows near-zero bias with narrow 95% confidential interval compared to ground truth in 6–36 months [2403.06940].

For target speech extraction on Libri2mix, Diff-TSE-MT+Ens. reports PESQ \( 3.08 \), ESTOI \( 0.80 \), and SI-SDR \( 11.28 \), improving over the discriminative TSE baseline at PESQ \( 2.58 \), ESTOI \( 0.75 \), and SI-SDR \( 10.01 \) [2308.03987]. For EIT reconstruction, CDMVC attains RE \( 0.0634 \), SSIM \( 0.9819 \), PSNR \( 38.44 \,\mathrm{dB} \), and DR \( 1.0059 \) in simulation data, with an ablation showing RE decreasing from \( 0.0931 \) to \( 0.0634 \) and SSIM increasing from \( 0.9548 \) to \( 0.9819 \) after adding voltage consistency during sampling [2501.05769].

For dual-conditional graph synthesis, CDGraph reports validity \( 1.0 \) on Facebook and BlogCatalog in the summary table, with edge error \( 0.186 \) and clustering MMD \( 0.022 \), outperforming SPECTRE, GSM, EDGE, and DiGress on the reported metrics [2311.01729]. For offline meta-reinforcement learning, MetaDiffuser reports \( 936.2 \pm 17.9 \) on Cheetah-Dir versus \( 931.7 \pm 21.3 \) for Prompt-DT and \( 823.5 \pm 37.0 \) for CORRO [2305.19923]. These results suggest that conditional diffusion is not confined to perceptual synthesis; it also functions as a structured conditional generator for trajectories, graphs, and inverse problems.

## 6. Relation to adjacent conditional diffusion paradigms

Several papers clarify what CDiff is not, or what alternatives exist. ShiftDDPMs argues that most existing conditional DDPMs relate conditions only to the reverse process and fit it to the reversal of an unconditional forward process, which limits condition modeling and generation to a small time window [2302.02373]. Its proposal is to introduce conditions into the forward process by allocating an exclusive diffusion trajectory for each condition using shifting rules, thereby dispersing condition modeling across all timesteps [2302.02373]. This provides a useful conceptual contrast with reverse-only conditioning.

FreeDoM occupies another adjacent position. It is not a trained conditional diffusion model in the usual sense but a training-free conditional diffusion model that leverages time-independent energy functions constructed from off-the-shelf pre-trained networks [2303.09833]. This framework shows that conditional behavior can be induced without retraining the generative model, although the paper notes limitations in inference cost, fine-structure control, and conflicting multi-condition guidance [2303.09833].

“Conditional Diffusion with Less Explicit Guidance via Model Predictive Control” addresses a separate misconception: that high-quality conditional diffusion necessarily requires explicit guidance at every step. The reported results indicate that conditional sampling can be achieved with minimal explicit guidance by simulating forward with unconditional diffusion and backpropagating explicit guidance at reachable timesteps [2210.12192]. This suggests that the operational notion of a conditional diffusion model includes not only models trained directly with conditions but also systems that recover conditionality through guidance approximations.

A further extension appears in score-based continuous-time discrete diffusion, where diffusion is generalized to categorical data via a stochastic jump process and continuous-time Markov chain, with learning based on matching conditional marginal distributions [2211.16750]. Although this paper is not framed around “CDiff” as a named model, it reinforces the broader point that conditional diffusion ideas are portable across continuous, discrete, and mixed-feature data regimes.

## 7. Applications, limitations, and interpretive issues

The applications represented here are heterogeneous: speech enhancement [2202.05256], target speech extraction [2308.03987], precipitation downscaling [2412.14539], longitudinal medical image generation [2411.05860], cortical thickness trajectory prediction [2403.06940], electrical impedance tomography [2501.05769], environment-aware channel map super-resolution [2505.07894], wireless semantic communications [2509.22282], building-energy data imputation [2511.02930], channel scenario identification [2506.12419], social graph synthesis [2311.01729], and offline meta-RL planning [2305.19923]. The unifying property is conditional generation under structured side information.

Several limitations are explicit. In the MPC-guidance framework, backpropagation through unconditional diffusion steps requires memory linear in the number of denoising steps [2210.12192]. In FreeDoM, inference cost is somewhat higher than fully trained models, energy guidance may be coarse on large domains, and simple weighted sums of multiple conditions may yield imperfect results when conditions conflict [2303.09833]. In graph synthesis, the method is specialized to dual-conditional social graphs and uses a classifier-guided denoising setup shaped by homophily and contagion assumptions [2311.01729]. In portfolio optimization, transaction costs can erode the advantage of diffusion-generated return estimates unless explicitly modeled in the optimization problem [2509.22088].

One common misconception is to treat CDiff as a single standardized algorithm. The surveyed work does not support that reading. Instead, “Conditional Diffusion Model” is a recurring designation for a modeling principle whose concrete realization depends on domain structure and conditioning semantics. Another misconception is that conditioning always enters through labels or prompts. In the speech-enhancement CDiff, the condition is the noisy observation itself [2202.05256]; in EIT it is an initial reconstruction and voltage consistency constraint [2501.05769]; in meta-RL it is a learned task context [2305.19923]. This broader view is important for interpreting claims across papers that share the “CDiff” label but not a common architecture.

A plausible implication is that the main scientific contribution of CDiff-style models lies less in the diffusion backbone itself than in the way conditional information is aligned with the forward corruption law, reverse denoiser, and sampling-time constraints. In that sense, CDiff is best understood as a conditional generative interface between diffusion modeling and domain structure.

Source: https://www.emergentmind.com/topics/conditional-diffusion-model-cdiff