---
title: 'FoundDiff: Unified LDCT Denoising'
url: https://www.emergentmind.com/topics/founddiff
type: topic
---

# FoundDiff: Unified LDCT Denoising

FoundDiff is a two-stage, unified low-dose computed tomography (LDCT) denoising framework designed to work across multiple dose levels and multiple anatomical regions without retraining or manually supplying explicit condition labels at test time. It couples dose-anatomy perception through a dose- and anatomy-aware contrastive language image pre-training model (DA-CLIP) with adaptive denoising through a dose- and anatomy-aware diffusion model (DA-Diff), and is presented as a foundational diffusion model for unified and generalizable LDCT denoising across various dose levels and anatomical regions [2508.17299].

## 1. Clinical problem and scope

FoundDiff is motivated by the central tension of LDCT imaging: reduced radiation exposure is desirable under the ALARA principle, but lower radiation increases noise and artifacts and can compromise diagnostic image quality. The restoration objective is therefore to recover an NDCT-quality image from an LDCT input. The paper treats this not as a single-condition denoising problem, but as a setting in which noise severity varies continuously with dose and image statistics vary substantially across anatomical regions such as abdomen, chest, and head [2508.17299].

The paper argues that most prior DL-based LDCT denoisers are trained narrowly, usually on one dose level or one anatomy, and therefore learn dose- and anatomy-specific mappings. It identifies several concrete limitations: single-condition training, discrete explicit dose conditioning, neglect of anatomy semantics, lack of adaptive perception, and the scalability cost of specialized models. In this formulation, generalization failure is expected whenever scanning conditions shift across dose protocols or anatomical regions, because the model has not explicitly learned to perceive those variations [2508.17299].

A central conceptual point is the paper’s use of the term “foundational diffusion model.” Here the phrase denotes a unified, broadly applicable LDCT denoiser trained across multiple dose levels and multiple anatomical regions so that it can serve as a general-purpose denoiser with strong transfer, especially to unseen dose levels, without extra fine-tuning. It does not denote a web-scale multimodal foundation model; rather, it denotes a single denoising framework intended to subsume condition-specific LDCT models [2508.17299].

## 2. Two-stage architecture

FoundDiff is organized as a sequential two-stage strategy. Stage 1 is dose-anatomy perception through DA-CLIP. Stage 2 is adaptive denoising through DA-Diff. The interaction is direct: DA-CLIP takes a CT image and produces a dose embedding \(e_\mathrm{d}\) and an anatomical embedding \(e_\mathrm{a}\); DA-Diff then uses those learned embeddings to condition a diffusion denoiser that restores the LDCT image [2508.17299].

At inference time, the input is an LDCT image only. The image is first passed through DA-CLIP, which outputs dose-aware and anatomy-aware embeddings. These embeddings condition DA-Diff, which denoises the LDCT and produces the restored image. The paper explicitly emphasizes that this avoids manually supplying explicit condition labels at test time. At training time, the two stages are optimized sequentially: DA-CLIP is trained first on images with dose labels and anatomy labels, and DA-Diff is then trained on LDCT/NDCT pairs while using the learned DA-CLIP representations as conditioning [2508.17299].

This decomposition assigns distinct roles to the two stages. DA-CLIP performs perception of scanning-condition semantics, with dose treated as a continuous ordinal variable and anatomy as a region-level semantic variable. DA-Diff performs restoration in residual space, using those condition embeddings to modulate denoising behavior. The framework therefore combines explicit condition perception with conditional diffusion, rather than relying on a single monolithic denoiser to infer all condition structure implicitly [2508.17299].

## 3. DA-CLIP: dose and anatomy perception

DA-CLIP is built on a pretrained CLIP-based image quality assessment model, specifically CLIPIQA, and fine-tunes the image encoder while adding two task-specific heads: a two-layer MLP dose head producing \(e_\mathrm{d}\), and a two-layer MLP anatomical head producing \(e_\mathrm{a}\) [2508.17299].

For dose perception, the model also uses two text embeddings, \(e_\text{clean}\) and \(e_\text{noisy}\), obtained from the prompts “clean” and “noisy.” The predicted dose score is
\[
\hat{y}_\mathrm{d}= \frac{\exp(e_\text{d}\cdot e_\text{clean})}
{\exp(e_\text{d}\cdot e_\text{clean})+\exp(e_\text{d}\cdot e_\text{noisy})}.
\]
This scalar is supervised by
\[
\mathcal{L}_\text{dose}=\|\hat{y}-y_\mathrm{d}\|_2^2,
\]
where \(y_\mathrm{d}\) is the ground-truth dose label. The paper argues that MSE alone produces fragmented, dispersed representations and therefore introduces a ranking contrastive loss \(\mathcal{L}_\mathrm{rank}\), constructed with \(d(\cdot,\cdot)\) as the \(L1\) distance between dose labels and a contrastive set \(\mathcal{S}_{i,j}\) defined by relative dose distance. The resulting dose objective is
\[
\mathcal{L}_\mathrm{d}=\mathcal{L}_\mathrm{dose}+\mathcal{L}_\mathrm{rank}.
\]
Its stated purpose is to encode the continuous and ordinal nature of dose variation, which is especially important because the dose levels are concentrated in a narrow low-dose range from \(10\%\) to \(50\%\) of normal dose [2508.17299].

For anatomy perception, the model uses a supervised contrastive loss over the anatomical embedding:
\[
\mathcal{L}_\mathrm{a} = \sum_{i=1}^{N} \frac{-1}{|P(i)|} \sum_{p\in P(i)} \log \frac{ \exp\left(\frac{e_\mathrm{a}^{i}\cdot e_\mathrm{a}^{p}}{\tau}\right) }{ \sum_{j=1}^{N} \exp\left(\frac{e_\mathrm{a}^{i}\cdot e_\mathrm{a}^{j}}{\tau}\right) }.
\]
Here \(P(i)\) is the set of positives from the same anatomical region. The total DA-CLIP objective is
\[
\mathcal{L}_\mathrm{DA\text{-}CLIP}=\mathcal{L}_\mathrm{d}+\mathcal{L}_\mathrm{a}.
\]
The anatomical classes used are abdomen, chest, and head [2508.17299].

The empirical evidence reported for DA-CLIP is strong. For dose prediction, CLIPIQA gives PLCC/SROCC of \(0.2691/0.2539\), CLIPIQA+ gives \(0.8617/0.8792\), DA-CLIP without \(\mathcal{L}_\mathrm{rank}\) gives \(0.9337/0.8929\), DA-CLIP without \(\mathcal{L}_\mathrm{a}\) gives \(0.9426/0.9447\), and full DA-CLIP gives \(0.9907/0.9831\). The paper also reports t-SNE behavior consistent with the intended geometry: dose embeddings are arranged continuously according to relative dose level, whereas anatomy embeddings form clear clusters for abdomen, chest, and head [2508.17299].

## 4. DA-Diff and DACB-conditioned residual diffusion

DA-Diff is built on RDDM and uses the residual diffusion branch. Instead of predicting a clean image directly, it operates in residual space, defining
\[
I_\mathrm{res}=I_\mathrm{ld}-I_\mathrm{nd},
\]
where \(I_\mathrm{ld}\) is the LDCT image and \(I_\mathrm{nd}\) is the NDCT image. The forward residual diffusion process is
\[
q(I_t \mid I_{t-1}, I_\mathrm{res})= \mathcal{N}(I_t; I_{t-1}+\alpha_t I_\mathrm{res}, \beta_t^2 \mathbf{I}),
\]
and the training objective is
\[
\mathcal{L}_\mathrm{DA\text{-}Diff}(\theta) = \mathbb{E} \left[ \left\| I_\mathrm{res} - I_\mathrm{res}^{\theta}(I_t,t,I_\mathrm{ld}) \right\|^2 \right].
\]
The network itself is U-Net-like, with four levels and channel widths \(64,128,256,512\). Each level contains an RLEB for local contextual information and a DACB for condition-aware modulation [2508.17299].

DACB is the distinctive conditioning mechanism. The paper assigns different roles to the two conditions. Dose is treated as a global condition, analogous to diffusion timestep, and is fused with timestep through adaLN-Zero. Anatomy is treated as spatial-semantic context and is integrated through a conditional state-space model derived from Mamba, denoted CSSM. Dose-timestep modulation is parameterized as
\[
\gamma_1,\beta_1,\alpha_1,\gamma_2,\beta_2,\alpha_2 = \operatorname{MLP}(\operatorname{MLP}(t)+e_\mathrm{d}),
\]
and the two DACB sub-blocks are written as
\[
\mathbf{F}_l^1 = \gamma_1\, \mathrm{LayerNorm}(\mathbf{F}_l)+\beta_1 \mathbf{F}_l,
\]
\[
\mathbf{F}_{l}^{\prime} = \mathrm{CSSM}(\mathbf{F}_l^1,e_\mathrm{a})+\alpha_1 \mathbf{F}_l^1+\mathbf{F}_l,
\]
followed by
\[
\mathbf{F}_l^2 = \gamma_2\, \mathrm{LayerNorm}(\mathbf{F}_l^{\prime})+\beta_2 \mathbf{F}_l^{\prime},
\]
\[
\mathbf{F}_{l+1} = \operatorname{TransposedAttention}(\mathbf{F}_{l}^{\prime})+\alpha_2 \mathbf{F}_l^2+\mathbf{F}_l^{\prime}.
\]
The paper states that the anatomical embedding is linearly projected and then added to the SSM output matrix \(C\) inside the conditional 2D selective scan, while transposed attention is used to mitigate the channel-independence limitation of standard SSM processing [2508.17299].

The DA-Diff ablation starting from RDDM shows a monotonic improvement as the proposed conditioning components are added. Reported PSNR/SSIM values are \(41.29/0.9038\) for RDDM, \(41.44/0.9074\) after adding dose condition, \(41.50/0.9077\) after adding anatomical condition through CSSM, \(41.56/0.9082\) after adding transposed attention, and \(41.75/0.9108\) for the full FoundDiff configuration. This supports the paper’s claim that dose and anatomy should be fused differently and jointly [2508.17299].

## 5. Data regime, optimization, and empirical performance

The main training and evaluation corpus is a large simulated dataset derived from Mayo-2020. It uses 50 patients per anatomical region for abdomen, chest, and head, and extends the original low-dose availability by simulating additional dose levels with the ASTRA Toolbox. The resulting eight dose levels are \(1/2,\ 1/3,\ 1/4,\ 1/5,\ 1/6,\ 1/8,\ 1/10,\ 1/20\). The patient split is \(80\%\) for training and \(20\%\) for testing. Across all doses, the training set contains 85,480 slices and the testing set contains 21,424 slices; per dose, the totals are 10,685 training slices and 2,678 testing slices [2508.17299].

| Dataset | Role | Key facts |
|---|---|---|
| Mayo-2020 derived set | Main training/testing | 8 dose levels, 3 anatomical regions, 50 patients per region |
| Mayo-2016 | Cross-dataset generalization | Abdomen only, 10 patients, 2 patients for testing, 1,136 images |

DA-CLIP is trained on all data. DA-Diff is trained only on four seen dose levels, \(1/2,\ 1/4,\ 1/6,\ 1/10\), and is then tested on both those seen doses and the unseen doses \(1/3,\ 1/5,\ 1/8,\ 1/20\). This is the paper’s operational definition of unseen-dose generalization [2508.17299].

The optimization settings are explicit. DA-CLIP is trained for 100 epochs with batch size 192 using SGD, momentum \(0.9\), weight decay \(1.0\times 10^{-9}\), and a cosine-annealed learning rate from \(1.0\times 10^{-2}\) to \(1.0\times 10^{-5}\). DA-Diff is trained for 400K iterations with batch size 2 using Adam with \(\beta_1=0.9\), \(\beta_2=0.99\), weight decay \(1.0\times 10^{-9}\), and learning rate \(2.0\times 10^{-4}\). DA-CLIP uses \(256\times 256\) patches; DA-Diff uses full \(512\times 512\) images. Window level is \([-1000, 2000]\) HU, and augmentation consists of random horizontal flip and rotations \(90^\circ, 180^\circ, 270^\circ\). Diffusion uses \(T=10^3\) total steps and DDIM sampling with only 2 sampling steps [2508.17299].

On seen dose levels, the paper reports that FoundDiff consistently outperforms all competing methods on PSNR and SSIM. On unseen dose levels \(1/3,\ 1/5,\ 1/8,\ 1/20\), it also outperforms competing methods, with especially clear gains at \(1/20\). The qualitative description is consistent across abdomen, chest, and head: FoundDiff better preserves vessels and fine structures, suppresses noise without artificial textures, avoids over-smoothing, and better matches NDCT reference [2508.17299].

The most concrete quantitative comparison is cross-dataset testing on Mayo-2016. FoundDiff attains \(44.22 \pm 1.26\) PSNR and \(0.9731 \pm 0.0124\) SSIM, compared with \(44.07 \pm 1.26\) and \(0.9705 \pm 0.0107\) for RDDM, \(43.99 \pm 1.11\) and \(0.9699 \pm 0.0094\) for Restormer, \(43.64 \pm 0.92\) and \(0.9687 \pm 0.0070\) for CoreDiff, \(43.58 \pm 0.84\) and \(0.9682 \pm 0.0104\) for RED-CNN, and \(43.11 \pm 0.96\) and \(0.9624 \pm 0.0118\) for PDF [2508.17299].

A second notable result is comparison against specialized single-condition models at \(1/10\) dose. FoundDiff still slightly exceeds those specialized variants: on abdomen it reaches \(45.94/0.9849\) versus RDDM \(45.61/0.9836\); on chest it reaches \(34.39/0.8229\) versus Restormer \(34.27/0.8212\); and on head it reaches \(52.93/0.9961\) versus RDDM \(52.57/0.9954\). This is important because it shows that unification across dose and anatomy does not require sacrificing specialized-condition performance [2508.17299].

## 6. Interpretation, limitations, and relation to other “FoundDiff” usages

The most important technical interpretation of FoundDiff is that it models dose as an ordinal continuous condition and anatomy as a semantic structural condition, then fuses them with different mechanisms: adaptive normalization for dose/timestep and conditional state-space modeling for anatomy. This is the core reason the paper gives for its unseen-dose behavior. The DA-CLIP ablations support the conditioning hypothesis directly: removing \(\mathcal{L}_\mathrm{rank}\) reduces dose prediction to PLCC/SROCC \(0.9337/0.8929\), and removing \(\mathcal{L}_\mathrm{a}\) yields \(0.9426/0.9447\), whereas full DA-CLIP reaches \(0.9907/0.9831\) [2508.17299].

The paper is also explicit about limits. It notes a simulation-to-real gap, because the simulated dataset still differs from heterogeneous real clinical LDCT data. It also notes computational cost: even with efficient SSMs and 2-step DDIM sampling, full-image diffusion denoising remains more expensive than traditional models. Additional constraints are visible from the setup itself: DA-CLIP requires dose labels and anatomy labels during training, and the anatomical coverage in the reported experiments is limited to abdomen, chest, and head [2508.17299].

A common source of confusion is the name. In the supplied literature, similarly named or conceptually adjacent systems address different tasks. Diff-XYZ studies code-diff understanding through apply, anti-apply, and diff generation over \(\langle \textit{old code}, \textit{new code}, \textit{diff} \rangle\) triples [2510.12487]. DiffRegCD uses frozen denoising diffusion features for integrated registration and change detection, estimating both a dense displacement field and a change mask [2511.07935]. DifFoundMAD applies foundation-model embeddings to differential morphing attack detection by comparing a suspected morph and a trusted live capture [2604.17961]. FoundDiff, by contrast, is specifically a unified LDCT denoising framework. A plausible implication is that the shared “FoundDiff” vocabulary in these works reflects a broader pattern—foundation representations or diffusion-based priors being coupled to differential or cross-condition reasoning—but the concrete object of inference in FoundDiff is image restoration rather than correspondence, biometric discrepancy, or code-edit reasoning [2508.17299].

In that sense, FoundDiff’s contribution is best understood narrowly and technically: it is a two-stage LDCT denoising system in which condition perception and conditional residual diffusion are explicitly separated, and in which generalization across eight dose levels and three anatomical regions is treated as the primary design objective rather than as a secondary transfer property [2508.17299].

Source: https://www.emergentmind.com/topics/founddiff