---
title: Cross-Distribution Diffusion CT Reconstruction
url: https://www.emergentmind.com/topics/cross-distribution-diffusion-priors-driven-iterative-reconstruction-cdpir
type: topic
---

# Cross-Distribution Diffusion CT Reconstruction

Cross-Distribution Diffusion Priors-Driven Iterative Reconstruction (CDPIR) is a sparse-view CT reconstruction framework designed specifically for out-of-distribution robustness. It combines a transformer-based diffusion prior learned across multiple datasets with model-based iterative reconstruction, and alternates between a generative sampling update and an explicit CT data-consistency update. In the formulation introduced in "Cross-Distribution Diffusion Priors-Driven Iterative Reconstruction for Sparse-View CT" [2509.13576], the method targets scanner, protocol, geometry, and anatomy shifts that degrade single-distribution priors, and uses a Scalable Interpolant Transformer (SiT) with classifier-free guidance to couple domain-specific and domain-invariant image statistics.

## 1. Inverse-problem setting and motivation

CDPIR is formulated for sparse-view CT, where projection measurements are strongly undersampled and the reconstruction problem is ill-posed. The acquisition model is written as
\[
\mathbf{y} = \mathbf{A}\mathbf{x} + \epsilon,
\]
where \(\mathbf{x} \in \mathbb{R}^n\) is the vectorized CT image, \(\mathbf{y} \in \mathbb{R}^m\) is the vectorized sinogram, \(\mathbf{A} \in \mathbb{R}^{m \times n}\) is the CT system matrix, and \(\epsilon\) is additive noise. In sparse-view settings, typically \(m<n\), so the forward operator alone does not determine a unique anatomically plausible solution [2509.13576].

The framework is motivated not only by sparse-view ill-posedness but also by domain shift. The paper identifies scanner vendor and hardware, acquisition protocol, geometry, anatomy, and noise or reconstruction statistics as major sources of out-of-distribution degradation. It explicitly contrasts datasets such as AAPM and COCA to illustrate scanner, protocol, and anatomy shifts. Its central claim is that single-distribution generative priors are not robust enough for sparse-view CT under realistic domain shifts, and that reconstruction should therefore combine cross-distribution prior learning with explicit physics-based iterative correction [2509.13576].

This positioning makes CDPIR a reconstruction framework rather than a pure generator. The diffusion model is not used as a standalone image synthesizer; it serves as a learned prior inside an alternating model-based solver. A plausible implication is that the method is aimed at regimes in which measurement incompleteness and prior mismatch are equally important failure modes.

## 2. Variational formulation and split reconstruction objective

The paper first states a constrained optimization problem,
\[
\min_{\mathbf{x}} J(\mathbf{x}) + \lambda_1 \|\nabla \mathbf{x}\|_1,
\qquad
\text{s.t.}
\qquad
\|\mathbf{A}\mathbf{x} - \mathbf{y}\|_2^2 \le \delta_n,
\]
where \(J(\mathbf{x})\) denotes the objective of the reverse diffusion process, \(\|\nabla \mathbf{x}\|_1\) is total variation regularization, \(\lambda_1\) controls the TV term, and \(\delta_n\) is a noise tolerance. It then rewrites reconstruction as
\[
\min_{\mathbf{x}}
\|\mathbf{A}\mathbf{x} - \mathbf{y}\|_2^2
+
\lambda_1 \|\nabla \mathbf{x}\|_1
+
\lambda_2 J(\mathbf{x}),
\]
which directly couples data fidelity, TV regularization, and the diffusion prior term [2509.13576].

To make alternating optimization possible, the method introduces an auxiliary variable \(\mathbf{r}\) and imposes \(\mathbf{r}=\mathbf{x}\):
\[
\min_{\mathbf{x},\mathbf{r}}
\|\mathbf{A}\mathbf{x} - \mathbf{y}\|_2^2
+
\lambda_1 \|\nabla \mathbf{x}\|_1
+
\lambda_2 J(\mathbf{r}),
\qquad
\text{s.t.}
\qquad
\mathbf{r}=\mathbf{x}.
\]
This yields two subproblems. The generative step is
\[
\mathbf{r}_{i+1}
=
\arg\min_{\mathbf{r}}
\|\mathbf{r}-\mathbf{x}_i\|_2^2 + \lambda_2 J(\mathbf{r}),
\]
which pulls the current iterate toward the learned image prior. The data-consistency step is
\[
\mathbf{x}_{i+1}
=
\arg\min_{\mathbf{x}}
\|\mathbf{A}\mathbf{x} - \mathbf{y}\|_2^2
+
\lambda_1 \|\nabla \mathbf{x}\|_1
+
\lambda_3 \|\mathbf{x} - \mathbf{r}_{i+1}\|_2^2,
\]
which enforces projection consistency while anchoring the reconstruction to the generative update [2509.13576].

This split is central to the method’s identity. It is neither a pure posterior sampler nor a purely deterministic regularized inverse solver. Instead, it alternates a stochastic prior-imposing subproblem with a model-based image update.

## 3. Cross-distribution diffusion prior

The learned prior is built with a Scalable Interpolant Transformer. The paper places SiT inside a unified stochastic interpolant framework and uses a reverse-time process of the form
\[
d\mathbf{x}
=
\mathbf{v}(\mathbf{x}, t)\,dt
+
\frac{1}{2}\omega_t \mathbf{s}(\mathbf{x}, t)\,dt
+
\sqrt{\omega_t}\,d\bar{\mathbf{w}},
\]
where \(\mathbf{v}(\mathbf{x}, t)\) is the velocity field and \(\mathbf{s}(\mathbf{x}, t)\) is the score function. The velocity is defined as
\[
\mathbf{v}(\mathbf{x}, t) = \frac{d\mathbf{x}}{dt},
\]
and the score is recovered from the velocity by
\[
\mathbf{s}(\mathbf{x}, t)
=
\sigma_t^{-1}
\frac{\alpha_t \mathbf{v}(\mathbf{x}, t) - \dot{\alpha}_t \mathbf{x}}
{\dot{\alpha}_t \sigma_t - \alpha_t \dot{\sigma}_t}.
\]
The paper presents this velocity-to-score mapping as the signature of its stochastic interpolant prior [2509.13576].

The “cross-distribution” aspect is realized by multi-dataset training with classifier-free guidance. Each dataset is assigned a condition token \(c\), and during training that token is randomly dropped and replaced by a null token \(\varnothing\). At sampling time the guided velocity is
\[
\mathbf{v}^{(\mu)}_{\theta}(\mathbf{x}, t; c)
=
\mathbf{v}_{\theta}(\mathbf{x}, t; \varnothing)
+
\mu \Big[
\mathbf{v}_{\theta}(\mathbf{x}, t; c)
-
\mathbf{v}_{\theta}(\mathbf{x}, t; \varnothing)
\Big].
\]
The paper then defines
\[
\mathbf{v}_{\mathrm{inv}}(\mathbf{x}, t)
=
\mathbf{v}_{\theta}(\mathbf{x}, t; \varnothing),
\qquad
\mathbf{v}_{\mathrm{spec}}(\mathbf{x}, t; c)
=
\mathbf{v}_{\theta}(\mathbf{x}, t; c)
-
\mathbf{v}_{\theta}(\mathbf{x}, t; \varnothing),
\]
so that
\[
\mathbf{v}^{(\mu)}_{\theta}(\mathbf{x}, t; c)
=
\mathbf{v}_{\mathrm{inv}}(\mathbf{x}, t)
+
\mu\,\mathbf{v}_{\mathrm{spec}}(\mathbf{x}, t; c).
\]
The null-conditioned branch is interpreted as domain-invariant and the residual as domain-specific; the paper does not present this as a hard disentanglement guarantee. In all reported experiments, \(\mu=1\), so the practical effect of CFG is concentrated in the prior-learning structure rather than aggressive test-time amplification [2509.13576].

Architecturally, the implementation uses SiT in the Big configuration, with patch size \(2\), and removes the original autoencoder so that training and inference occur directly in the image domain. Table II reports CDPIR-B-2 with depth \(12\), hidden size \(768\), attention heads \(12\), and \(142.8\)M parameters, and CDPIR-S-2 with depth \(12\), hidden size \(384\), attention heads \(6\), and \(39.1\)M parameters [2509.13576].

## 4. Alternating reconstruction pipeline

Reconstruction begins with an ASD-POCS initialization obtained from the sparse-view data. The generative subproblem is then solved by a Stochastic Euler-Maruyama sampler based on the conditional VP-SDE diffusion transformer model. The data-consistency subproblem is handled by ASD-POCS with improved TV and Ordered-Subset SART, so the solver alternates between prior-imposing stochastic sampling and explicit projection-domain correction [2509.13576].

The ASD-POCS update is written as a fusion of a SART step and a TV step:
\[
\mathbf{x}^{p+1}(\lambda_{TV})
=
(1-\lambda_{TV}) X_{\text{SART}}^{p+1}
+
\lambda_{TV} X_{\text{TV}}^{p+1,Q},
\]
where \(\lambda_{TV}\in(0,1]\) is chosen adaptively so that
\[
\|A\mathbf{x}^{p+1}(\lambda_{TV}) - \mathbf{y}\|_2^2
=
(1-w)\epsilon_{\text{SART}}^{p+1}
+
w\epsilon^p,
\qquad
w=0.8.
\]
This adaptive residual condition is intended to stabilize the data-consistency step by balancing projection fidelity against TV regularization [2509.13576].

The guided score used in the SiT sampler is obtained from the guided velocity:
\[
\mathbf{s}^{(\mu)}_{\theta}(\mathbf{x}, t; c)
=
\frac{1}{\sigma_t}
\frac{
\alpha_t\,\mathbf{v}^{(\mu)}_{\theta}(\mathbf{x}, t; c)
-
\dot{\alpha}_t\,\mathbf{x}
}{
\dot{\alpha}_t\,\sigma_t - \alpha_t\,\dot{\sigma}_t
},
\]
and the reverse process is
\[
d\mathbf{x}
=
\mathbf{v}^{(\mu)}_{\theta}(\mathbf{x}, t; c)\,dt
+
\frac{1}{2}\omega_t\,\mathbf{s}^{(\mu)}_{\theta}(\mathbf{x}, t; c)\,dt
+
\sqrt{\omega_t}\,d\bar{\mathbf{w}}.
\]
The paper states that \(\omega_t = \sigma_t\). It also states that inference uses \(1000\) diffusion steps, with ASD-POCS outer iterations \(P=10\), TV inner iterations \(Q=1\), subsets \(K=5\), and initialization-stage iterations \(30\) [2509.13576].

Operationally, one alternating cycle can be summarized as follows. First, the current image estimate is updated by reverse-SDE sampling under the cross-distribution SiT prior. Second, the resulting image is corrected by ASD-POCS/iTV so that it better matches the measured sinogram. This alternating structure is the defining mechanics of CDPIR.

## 5. Empirical behavior under in-distribution and OOD conditions

The paper evaluates CDPIR on AAPM, COCA, XCAT, a real GE clinical cardiac dataset, and a MARS photon-counting CT extremity dataset, using PSNR and SSIM as the reported metrics. For simulation experiments on AAPM, COCA, and XCAT, full-view projections are numerically generated using GE clinical cardiac geometry through LEAP and then uniformly subsampled from \(984\) views to \(55\) views. For the GE clinical zero-shot evaluation, models trained on AAPM are tested on real GE clinical sparse-view sinograms with \(123\) views subsampled from \(984\). For MARS PCCT, each slice contains \(373\) views and is subsampled to \(74\) views [2509.13576].

Quantitatively, CDPIR is reported as best or near-best across both in-distribution and OOD settings. In the strong OOD transfer from AAPM to COCA, it achieves \(39.22\) PSNR and \(0.951\) SSIM, compared with \(36.01\) and \(0.937\) for DDS. In the transfer from AAPM to XCAT, it achieves \(38.36\) and \(0.952\). When trained on COCA and tested on XCAT, it reaches \(40.06\) and \(0.971\). It also leads in-distribution, with \(36.63\) and \(0.942\) on AAPM trained and tested on AAPM, and \(39.67\) and \(0.958\) on COCA trained and tested on COCA [2509.13576].

The ablations are aligned with the paper’s OOD thesis. Training on AAPM+COCA instead of AAPM alone improves OOD performance on XCAT from
\[
37.59 \pm 1.97 \text{ dB},\ 0.946 \pm 0.0000
\]
to
\[
38.36 \pm 0.56 \text{ dB},\ 0.952 \pm 0.0000.
\]
Model scale also matters: on AAPM\(\to\)COCA, CDPIR-S-2 gives \(35.54/0.9218\), whereas CDPIR-B-2 gives \(39.22/0.9510\). The sampling-step study indicates that CDPIR reaches high-quality reconstructions with as few as \(200\) steps, whereas DDS needs close to \(1000\) steps for comparable quality in the shown experiment [2509.13576].

On real data, the paper reports that all baselines retain severe sparse-view artifacts on zero-shot GE clinical cardiac CT, while CDPIR suppresses them most effectively; the SSIM map suggests about \(+0.07\) over DDS. On far-OOD MARS PCCT wrist data, it is reported to improve over ASD-POCS by about \(+3.5\) dB PSNR and \(+0.05\) SSIM. These results are used to support the claim that CDPIR is robust not only to simulated domain shifts but also to real scanner and anatomy shifts [2509.13576].

## 6. Position in diffusion-prior reconstruction literature and principal limitations

CDPIR belongs to a broader family of iterative inverse solvers that combine learned diffusion priors with explicit measurement operators. Earlier examples include "Diffusion Prior Regularized Iterative Reconstruction for Low-dose CT" [2310.06949], which alternates OS-SART with a DDPM prior; "DPER: Diffusion Prior Driven Neural Representation for Limited Angle and Sparse View CT Reconstruction" [2404.17890], which uses HQS to couple an INR data solver with a score-based prior and reports improved OOD behavior; "From Sparse X-rays to 3D CT: Training-Free Reconstruction with Diffusion Priors" [2606.20763], which reuses a frozen voxel-space 3D Diffusion Transformer prior across X-ray-to-CT and several other medical inverse problems; "PET Image Reconstruction Using Deep Diffusion Image Prior" [2507.15078], which adapts a diffusion prior across tracer and scanner shifts using Poisson-likelihood-guided fine-tuning; and "Steerable Conditional Diffusion for Domain Adaptation in PET Image Reconstruction" [2510.13441], which uses per-step LoRA adaptation to suppress hallucinated OOD artifacts. Relative to those methods, CDPIR’s distinctive move is to train the prior itself across multiple datasets and to interpret classifier-free guidance as a mechanism for coupling domain-invariant and domain-specific image statistics inside an alternating sparse-view CT solver [2509.13576].

A more formal Bayesian precursor is "Score-Based Diffusion Models as Principled Priors for Inverse Imaging" [2304.11751], which turns score models into explicit densities through the probability flow ODE. CDPIR, by contrast, is an alternating model-based reconstruction method that uses a learned stochastic interpolant prior and ASD-POCS rather than explicit posterior optimization under an ODE-computed prior density. This suggests that CDPIR occupies a middle ground between explicit probabilistic prior modeling and engineering-oriented iterative reconstruction.

The paper also leaves several limitations explicit or implied. Inference is computationally heavy because it uses a large transformer and up to \(1000\) diffusion steps together with iterative ASD-POCS updates. The approach assumes access to multiple heterogeneous training datasets and meaningful domain labels. It introduces several balancing parameters and solver settings, including \(\lambda_1,\lambda_2,\lambda_3\), CFG scale, diffusion-step count, and ASD-POCS iteration structure, without a full sensitivity characterization. Finally, the exact SiT training loss and some sampling discretization details are not specified in the paper text provided, which makes full reproduction less direct [2509.13576].

Taken together, CDPIR is best understood as a multi-domain generative-prior and physics-constrained reconstruction framework for sparse-view CT under domain shift. Its defining idea is that OOD robustness should not be assigned solely to stronger data consistency or solely to a broader diffusion model. Instead, it arises from the interaction of multi-distribution prior learning, null-conditioned and conditional guidance structure, transformer-based global modeling, and explicit iterative correction against the measured projections.

Source: https://www.emergentmind.com/topics/cross-distribution-diffusion-priors-driven-iterative-reconstruction-cdpir