---
title: 3D Latent Rectified Flow (T1C-RFlow)
url: https://www.emergentmind.com/topics/3d-latent-rectified-flow-t1c-rflow
type: topic
---

# 3D Latent Rectified Flow (T1C-RFlow)

Searching arXiv for the target paper and closely related rectified-flow/latent 3D medical synthesis references.
3D Latent Rectified Flow (T1C-RFlow) is a **3D latent-space conditional rectified flow model** for synthesizing post-contrast T1 MRI from **pre-contrast T1w and T2-FLAIR**. Its defining strategy is to compress full 3D MRI volumes into a compact latent space using a **pretrained 3D VAE**, learn a **deterministic velocity field** that transports Gaussian noise to the target T1C latent conditioned on the encoded inputs, and decode the resulting latent back into a full-resolution synthetic T1C volume [2509.24194]. The method was developed for brain tumor imaging using the BraTS 2024 glioma, meningioma, and metastases cohorts, and is positioned as a computationally efficient route toward contrast-agent-free MRI synthesis rather than a validated unrestricted replacement for acquired post-contrast imaging [2509.24194].

## 1. Clinical task and problem formulation

T1C-RFlow addresses **contrast-agent-free synthesis of T1-contrast-enhanced MRI (T1C)** for brain tumor imaging. In the formulation reported for the method, the inputs are exactly **pre-contrast T1-weighted (T1w)** and **T2-FLAIR**, and the output target is **T1-contrast enhanced MRI (T1C)** [2509.24194]. This is an intramodal conditional synthesis problem in which paired, co-registered volumetric MRI is available during training, and T1w, T2-FLAIR, and T1C are assumed to be spatially aligned and preprocessed into a common space [2509.24194].

The clinical motivation is tied to the role of gadolinium-based contrast agents in neuro-oncologic imaging. T1C is described as especially important because the **enhancing tumor** is defined by abnormal uptake visible on post-contrast T1-weighted imaging, while GBCAs carry safety concerns including **risk of nephrogenic systemic fibrosis** and concerns related to **gadolinium retention** [2509.24194]. Additional motivations include scan complexity, variability due to contrast administration, and access constraints in resource-limited settings [2509.24194].

Within the broader literature, T1C-RFlow belongs to a class of 3D medical synthesis systems that replace slow latent DDPM sampling with ODE-based transport in latent space. A closely related methodological precedent is MAISI-v2, which likewise reuses a pretrained 3D VAE and replaces a DDPM-based latent diffusion model with a rectified flow model for high-resolution 3D medical image synthesis [2508.05772]. T1C-RFlow differs in task specification by targeting paired MRI-to-MRI synthesis for brain tumors rather than unconditional or mask-conditioned CT generation [2509.24194][2508.05772].

## 2. Latent representation and preprocessing pipeline

The method uses **MAISI’s pretrained 3D VAE** as a fixed latent compressor and decoder [2509.24194]. Each MRI sequence is represented as a full 3D volume of shape

\[
1 \times 256 \times 256 \times 192
\]

and is compressed into a latent tensor of shape

\[
4 \times 64 \times 64 \times 48.
\]

The encoder outputs \(\mu(x)\) and \(\sigma(x)\) in that latent space, and the VAE latent is sampled as

\[
z = \mu(x) + \sigma(x)\epsilon, \quad \epsilon \sim \mathcal{N}(0,1). \tag{1}
\]

This corresponds to **1/4 spatial resolution per axis** and **64x fewer voxels** than the original image grid [2509.24194].

The preprocessing pipeline used for the reported experiments consists of DICOM to NIfTI conversion, skull stripping using **HD-BET**, affine coregistration of T1, T1C, T2, and T2-FLAIR to the **Linear Symmetrical MNI Atlas**, resampling to **1 mm isotropic**, standardization to

\[
256 \times 256 \times 192,
\]

and intensity normalization to

\[
[-1,1].
\]

These preprocessing steps define the volumetric input space in which the pretrained VAE is applied [2509.24194].

The paper motivates latent-space modeling primarily by efficiency. The VAE makes **whole-volume 3D synthesis** feasible, avoids patch-wise training and sliding-window inference for the generative model itself, and reduces memory demand while maintaining high reconstruction quality [2509.24194]. The reported VAE reconstruction metrics are:

- **T1w:** NMSE \(0.63 \times 10^{-2}\), PSNR \(35.3 \pm 2.0\) dB, SSIM \(0.979 \pm 0.006\)
- **T2-FLAIR:** NMSE \(1.11 \times 10^{-2}\), PSNR \(34.8 \pm 1.9\) dB, SSIM \(0.972 \pm 0.008\)
- **T1C:** NMSE \(1.63 \times 10^{-2}\), PSNR \(35.2 \pm 1.5\) dB, SSIM \(0.973 \pm 0.008\)

This suggests that the latent bottleneck preserves most of the information needed for downstream conditional synthesis [2509.24194].

## 3. Conditioning design and rectified-flow formulation

Conditioning is performed entirely in latent space. If \(z_{\mathrm{T1w}}\) and \(z_{\mathrm{FLAIR}}\) denote the latent encodings of T1w and T2-FLAIR, the conditioning tensor is formed by channel-wise concatenation:

\[
c = [z_{\mathrm{T1w}} \, \| \, z_{\mathrm{FLAIR}}].
\]

Since each latent has shape \(4 \times 64 \times 64 \times 48\), the condition tensor has shape

\[
8 \times 64 \times 64 \times 48.
\]

At training and inference, the rectified flow network receives the concatenation

\[
[z_t \, \| \, z_{\mathrm{T1w}} \, \| \, z_{\mathrm{FLAIR}}],
\]

which the paper explicitly states has shape

\[
12 \times 64 \times 64 \times 48.
\]

This is an early-fusion conditioning mechanism by channel concatenation rather than cross-attention or classifier-free guidance [2509.24194].

The latent rectified-flow path is defined using a clean target latent \(z_0\), Gaussian noise \(z_1 \sim \mathcal{N}(0, I)\), and a monotone schedule \(a(t)\) with \(a(0)=0\), \(a(1)=1\):

\[
z_t = (1-a(t))z_0 + a(t)z_1. \tag{2}
\]

Differentiating this path yields the analytical target velocity field

\[
v^*(z_t, t) = \frac{d z_t}{dt} = a'(t)(z_1 - z_0). \tag{3}
\]

The network learns a conditional velocity field \(v_{\theta}(z_t, t, c)\) under the loss

\[
L_{\mathrm{RFlow}}(\theta) = \mathbb{E}_{z_0, z_t}\left[\left\| v_{\theta}(z_t,t,c)-v^*(z_t,t)\right\|_1\right]. \tag{4}
\]

The paper writes the expectation in abbreviated form, but the surrounding description makes clear that training samples a target latent, a noise latent, and a timestep, then minimizes the \(L_1\) distance between predicted and analytical velocity [2509.24194].

Generation is performed by integrating the learned ODE

\[
\frac{dz}{dt} = v_{\theta}(z,t,c), \qquad z(1) \sim \mathcal{N}(0,I), \qquad t: 1 \rightarrow 0 \tag{5}
\]

with the fixed-step deterministic update

\[
z_{k-1} = z_k - \Delta t \, v_{\theta}(z_k, t_k, c), \qquad k=K,\ldots,1. \tag{6}
\]

The default reported sampling length is \(K=200\) [2509.24194].

This places T1C-RFlow squarely in the ODE-based latent transport family. A plausible implication is that its practical speed advantage arises from combining latent compression with a direct velocity-field regression objective, rather than from architectural simplification alone. That reading is consistent with MAISI-v2, which also attributes accelerated 3D synthesis to replacing latent DDPM denoising with rectified-flow transport [2508.05772].

## 4. Network architecture and training configuration

The generative backbone is reported as a **3D diffusion U-Net** trained under the rectified flow objective [2509.24194]. The stated architectural details are concise but explicit: the network has a **symmetrical encoder and decoder**, channel sizes

\[
[128, 128, 256],
\]

and **2 residual blocks per layer** [2509.24194]. Figure-level descriptions in the paper indicate a denoising U-Net with residual blocks, skip connections, and timestep embedding input [2509.24194].

Several implementation details are not specified in the paper. It does **not** explicitly report the residual block design, normalization type, activation function, attention placement, exact timestep embedding formulation, downsampling and upsampling operators, or whether sinusoidal or learned time embeddings are used [2509.24194]. This incompleteness is relevant for reproduction because the method’s performance advantage is established empirically, but some architectural degrees of freedom remain undocumented.

Training uses **AdamW** with learning rate \(1 \times 10^{-5}\), \(\beta_1 = 0.9\), \(\beta_2 = 0.999\), weight decay \(1 \times 10^{-4}\), batch size 4, and 100 epochs on a single NVIDIA **A6000 ADA (48 GB)** [2509.24194]. The rectified-flow training setup uses **1000 training timesteps** and a **logit-normal sampling distribution** based on latent size \((64 \times 64 \times 48)\) with 3 spatial dimensions [2509.24194]. The paper does not provide the explicit logit-normal formula for this scheduler [2509.24194].

The benchmark suite is deliberately controlled. All compared methods are trained in the **same latent space**, and all latent outputs are decoded by the **same VAE decoder** [2509.24194]. The baselines are:

- **pix2pix**
- **latent DDPM**
- **DiT-3D**

The DDPM baseline uses a standard diffusion formulation with **1000 denoising steps**, while DiT-3D is adapted from a 3D shape-generation implementation to work on medical images and to use a **rectified flow scheduler** [2509.24194]. This means the comparison against DiT-3D is not purely a scheduler comparison; it also reflects the inductive bias difference between a dense volumetric U-Net and a tokenized transformer backbone [2509.24194].

## 5. Empirical performance and efficiency

The study uses the **BraTS 2024 challenge** data across three tumor cohorts:

- **Glioma (GLI):** 1480 patients
- **Meningioma (MEN):** 1141 patients
- **Metastases (MET):** 1475 patients

for a total of 4096 cases, split into **Training: 2860**, **Validation: 612**, and **Test: 614**, while maintaining cohort proportions [2509.24194]. The test set contains **GLI: 239**, **MEN: 162**, and **MET: 213** [2509.24194].

Whole-brain evaluation is reported using **NMSE**, **PSNR**, **NCC**, and **SSIM** on decoded image-space volumes normalized in \([-1,1]\), with SSIM constants

\[
C_1=(0.01L)^2,\quad C_2=(0.03L)^2,\quad L=2.
\]

On the overall test set, T1C-RFlow achieved:

- **NMSE:** \(0.063 \pm 0.067\)
- **PSNR:** \(29.7 \pm 3.0\) dB
- **NCC:** \(0.957 \pm 0.018\)
- **SSIM:** \(0.925 \pm 0.054\)

compared with:

| Method | NMSE | PSNR | NCC | SSIM |
|---|---:|---:|---:|---:|
| T1C-RFlow | \(0.063 \pm 0.067\) | \(29.7 \pm 3.0\) | \(0.957 \pm 0.018\) | \(0.925 \pm 0.054\) |
| DDPM | \(0.084 \pm 0.078\) | \(28.3 \pm 3.0\) | \(0.951 \pm 0.021\) | \(0.903 \pm 0.059\) |
| pix2pix | \(0.091 \pm 0.250\) | \(28.4 \pm 2.9\) | \(0.933 \pm 0.030\) | \(0.923 \pm 0.051\) |
| DiT-3D | \(0.118 \pm 0.074\) | \(26.5 \pm 3.0\) | \(0.922 \pm 0.030\) | \(0.874 \pm 0.077\) |

The paper states that average NMSE improved by **25%** over the next-best method, DDPM, and that most improvements were statistically significant, with the noted exception of SSIM versus pix2pix in whole-brain results [2509.24194].

By cohort, T1C-RFlow achieved the following headline values:

- **GLI:** NMSE \(0.044 \pm 0.047\), SSIM \(0.935 \pm 0.025\)
- **MEN:** NMSE \(0.046 \pm 0.029\), SSIM \(0.937 \pm 0.021\)
- **MET:** NMSE \(0.098 \pm 0.088\), SSIM \(0.905 \pm 0.082\)

with the metastases cohort described as consistently harder for all methods, which the authors suggest may be due to lower quality T1C images in that dataset [2509.24194].

For tumor-region evaluation, a subset of **545 patients** with segmentation maps was used, defining the tumor region by a bounding box around the segmentation map with **5 voxels of padding** [2509.24194]. In that region, T1C-RFlow also performed best overall, with:

- **NMSE:** \(0.074 \pm 0.054\)
- **PSNR:** \(21.7 \pm 5.8\)
- **NCC:** \(0.486 \pm 0.290\)
- **SSIM:** \(0.570 \pm 0.170\)

The paper specifically emphasizes stronger reconstruction of the **contrast-enhancing tumor region** and better preservation of fine anatomical detail relative to the baselines [2509.24194].

Efficiency is one of the method’s most concrete advantages. On the A6000 ADA GPU, the reported times are:

- **VAE encode:** 1.2 s
- **T1C-RFlow denoising:** 6.9 s
- **VAE decode:** 1.6 s
- **Total:** 9.7 s/volume

This is compared with:

- **DDPM (latent, 1000 steps):** 37.7 s
- **DDPM (patch-based image space):** 4.3 hr
- **DiT-3D:** 11.9 s
- **pix2pix latent prediction:** 74.0 ms

The key interpretation in the paper is that T1C-RFlow is much faster than latent DDPM and dramatically faster than patch-based image-space DDPM, while producing higher image quality than the one-step pix2pix baseline [2509.24194]. This mirrors the broader acceleration pattern reported for rectified-flow-based medical synthesis in MAISI-v2, where replacing latent DDPM with rectified flow yielded substantially better speed-quality tradeoffs [2508.05772].

## 6. Interpretive context, ablations, and limitations

The main ablation studies the contribution of the two conditioning modalities. Using both T1w and T2-FLAIR produced the best performance:

- **T1w + T2-FLAIR:** NMSE \(0.063 \pm 0.067\), SSIM \(0.925 \pm 0.054\)
- **T1w only:** NMSE \(0.074 \pm 0.071\), SSIM \(0.916 \pm 0.054\)
- **T2-FLAIR only:** NMSE \(0.117 \pm 0.079\), SSIM \(0.881 \pm 0.060\)

with reported significance \(p < .01\) for the multimodal improvement [2509.24194]. This supports the paper’s interpretation that T1w provides stronger direct structural and intensity correspondence to T1C, while FLAIR contributes complementary lesion information [2509.24194].

The paper also offers an implicit architectural argument through benchmark comparison. Because all methods share the same latent space and decoder, the superiority of T1C-RFlow over latent DDPM suggests that the rectified-flow transport objective is advantageous in this setup, while the superiority over DiT-3D suggests that a volumetric U-Net may better preserve dense spatial structure than a flattened transformer tokenization scheme for this task [2509.24194]. This suggests that in medical volumetric synthesis, scheduler choice and architectural inductive bias interact rather than contributing independently.

Several limitations are explicitly acknowledged. The training data are limited to **brain tumor cohorts from BraTS 2024**, so performance on other neurologic diseases, institutions, scanners, and acquisition protocols remains unvalidated [2509.24194]. The model does **not** use segmentation masks or tumor priors during training, which the authors note may limit performance in large or highly heterogeneous tumors [2509.24194]. The method is also dependent on the latent space inherited from MAISI’s pretrained VAE, which was not designed specifically for T1C synthesis or tumor-aware conditioning [2509.24194].

The qualitative discussion notes several observed reconstruction limitations: slight visual differences in contrast-enhancing regions, possible mismatches in overall brightness between T1C and synthetic T1C, more difficulty in low-quality ground-truth T1C cases, and lower performance on metastases and complex gliomas [2509.24194]. The paper also cautions that synthetic contrast images may look plausible while not perfectly reflecting actual pathology or enhancement, so the method is framed as a promising research direction rather than a clinically unrestricted substitute [2509.24194].

A common misconception is that T1C-RFlow is simply a faster DDPM. The paper’s formulation is more specific: it trains a deterministic conditional velocity field in latent space and samples by fixed-step ODE integration, rather than by reverse diffusion denoising [2509.24194]. Another possible misconception is to view it as a generic 3D latent rectified-flow framework. More precisely, it is a task-specific **whole-volume 3D synthetic contrast MRI** system whose conditioning, preprocessing, and evaluation are tightly aligned to paired brain tumor MRI [2509.24194].

In the wider rectified-flow literature, T1C-RFlow can be situated alongside other latent 3D transport models, but its domain-specificity matters. MAISI-v2 is a direct methodological reference for 3D latent rectified flow in medical imaging [2508.05772], while CTFlow shows a related latent flow-matching strategy for whole-volume text-conditioned CT synthesis using a video-inspired autoregressive design [2508.12900]. By contrast, T1C-RFlow remains a paired multimodal MRI synthesis model rather than a text-conditioned or mask-conditioned foundation model [2509.24194][2508.05772][2508.12900].

T1C-RFlow is therefore best understood as a specialized 3D latent rectified-flow system for synthetic post-contrast MRI generation: it compresses T1w, T2-FLAIR, and T1C into a compact volumetric latent space; conditions a 3D U-Net on T1w and FLAIR latents; learns a deterministic velocity field from Gaussian noise to T1C latent; and reconstructs a full synthetic T1C volume with practical whole-volume runtime [2509.24194]. Its significance lies in showing that high-quality whole-volume 3D synthetic contrast MRI can be made computationally feasible while outperforming matched latent-space DDPM, pix2pix, and DiT-3D baselines on BraTS 2024 brain tumor cohorts [2509.24194].

Source: https://www.emergentmind.com/topics/3d-latent-rectified-flow-t1c-rflow