SANA-Sprint: Fast T2I Diffusion Framework

• SANA-Sprint is an efficient diffusion model framework designed for ultra-fast text-to-image generation in 1–4 inference steps.
• It employs a hybrid distillation approach combining self-consistency matching (sCM) and latent adversarial distillation (LADD) to balance speed and fidelity.
• Its step-adaptive design with dense time embeddings and ControlNet integration enables real-time, high-resolution image synthesis and interactive conditional editing.

SANA-Sprint is an efficient diffusion model framework designed for ultra-fast text-to-image (T2I) generation, achieving state-of-the-art performance with as few as 1–4 inference steps. It leverages a pre-trained flow-matching foundation model, introducing hybrid distillation and a step-adaptive architecture to significantly reduce inference latency while maintaining high output fidelity. SANA-Sprint enables real-time, high-resolution generation and supports user-interactive conditional generation through integration with ControlNet (Chen et al., 12 Mar 2025).

1. Motivation and Overview

Contemporary diffusion models for T2I tasks deliver high perceptual quality but typically require 50–100 iterative denoising steps, resulting in considerable inference latency—on the order of seconds per 1024×1024 image. SANA-Sprint circumvents this speed-quality bottleneck by distilling a pre-trained flow-matching model into a compact, step-adaptive student capable of generating images in 1–4 steps. Key contributions include:

• A training-free transformation from a pre-trained flow-matching model to a TrigFlow teacher, enabling efficient continuous-time self-consistency distillation (sCM).
• A hybrid distillation paradigm, combining sCM for teacher alignment and diversity retention with latent adversarial distillation (LADD) for enhancing single-step fidelity.
• A unified architecture supporting dynamic adaptation to 1–4 inference steps with a single student model, and seamless integration with ControlNet for fast, interactive image editing and conditional generation (Chen et al., 12 Mar 2025).

2. Consistency Distillation and Teacher Transformation

SANA-Sprint’s core is continuous-time consistency distillation. The teacher model consists of a pre-trained flow-matching network $v_\theta(x_{t,\mathrm{FM}}, t)$, transformed into a TrigFlow teacher $\widehat F_\theta(x_{t,\mathrm{Trig}}, t)$ using a lossless (differentiable) mapping (as detailed in Proposition 3.1 and Eqs. (5)–(7)), eliminating the need for costly retraining. The generative process is governed by the probability flow ODE:

$$\frac{\mathrm{d}x_t}{\mathrm{d}t} = v_\theta(x_t, t)$$

The student network $f_\phi(x_t, t)$ is trained to match the teacher’s ODE solution at all continuous time points using the self-consistency loss:

$$\mathcal{L}_{\mathrm{sCM}} = \mathbb{E}_{t, x_t} \| f_\phi(x_t, t) - f_{\mathrm{teacher}}(x_t, t) \|_2^2$$

This mechanism enforces local dynamical alignment with the teacher, mitigating discretization artifacts inherent to discrete-time distillation approaches (Chen et al., 12 Mar 2025).

3. Hybrid Distillation: sCM and LADD

The hybrid distillation objective leverages two complementary forms of knowledge transfer:

• Self-Consistency Matching (sCM): Ensures the student reproduces the teacher’s local velocity fields, providing trajectory-level diversity and ODE consistency.
• Latent Adversarial Distillation (LADD): Employs a GAN-like framework in latent space, where a discriminator $D_\psi$ operating on frozen teacher feature maps distinguishes between real noisy samples and student outputs. The generator and discriminator losses are:

$$\mathcal{L}_{\mathrm{LADD}}^G = \mathbb{E} \left[-\sum_k D_{\psi, k}(\widehat F_\theta^{\mathrm{pre}, k}(\hat x_s))\right]$$

$$\mathcal{L}_{\mathrm{LADD}}^D = \mathbb{E} \left[\sum_k \mathrm{ReLU}(1 - D_{\psi, k}(\widehat F_\theta^{\mathrm{pre}, k}(x_s)))\right] + \mathbb{E} \left[\sum_k \mathrm{ReLU}(1 + D_{\psi, k}(\widehat F_\theta^{\mathrm{pre}, k}(\hat x_s)))\right]$$

The hybrid loss is:

$$\mathcal{L}_{\mathrm{hybrid}} = \alpha\, \mathcal{L}_{\mathrm{sCM}} + \beta\, \mathcal{L}_{\mathrm{LADD}}^G$$

with default $\alpha=1.0$ and $\widehat F_\theta(x_{t,\mathrm{Trig}}, t)$0. This approach facilitates rapid convergence, stabilizes training, and preserves detail and fidelity in single-step outputs (Chen et al., 12 Mar 2025).

4. Step-Adaptive Model Design

Unlike prior approaches requiring step-specific retraining, SANA-Sprint utilizes a continuous, dense time embedding (rescaling $\widehat F_\theta(x_{t,\mathrm{Trig}}, t)$1 to $\widehat F_\theta(x_{t,\mathrm{Trig}}, t)$2) within a single network, supporting any step schedule in the 1–4 range. Notable architectural features include:

• Dense Time Embeddings: Improve stabilization of $\widehat F_\theta(x_{t,\mathrm{Trig}}, t)$3 terms in the ODE.
• QK-Normalization: RMS normalization of query and key vectors in self- and cross-attention layers is employed to prevent gradient explosion during distillation from large teacher models.

At inference, the model accepts an arbitrary number (1–4) of ODE steps, dictated by the selected schedule, for flexible speed-quality customization (Chen et al., 12 Mar 2025).

5. ControlNet Integration and Conditional Generation

SANA-Sprint incorporates ControlNet to facilitate real-time, interactive conditional generation and image editing. The transformer backbone is extended with ControlNet branches, each ingesting external conditioning—such as HED edge maps or user scribbles. For each transformer layer, small convolutional encoders process the conditioning input, injecting feature maps as additional keys and values into both self- and cross-attention mechanisms. The hybrid distillation strategy is maintained during ControlNet augmentation, ensuring retention of structural controllability at 1024×1024 resolution in as few as 2 steps and 0.25s latency on H100 (Chen et al., 12 Mar 2025).

6. Experimental Results and Comparative Analysis

Empirical evaluation is carried out on the MJHQ-30K dataset (30,000 high-quality text–image pairs, 1024×1024 resolution), using metrics such as FID, GenEval, CLIP-Score, and wall-clock latency. Key comparative results are summarized below.

Model/Setting	Steps	FID	GenEval	Throughput (img/s)	Latency (s/image)
SANA-Sprint (0.6B)	1	7.04	0.72	7.22	0.21
FLUX-schnell (12B)	1	7.26	0.69	1.47	0.68
SANA-Sprint (0.6B)	4	6.48	0.76	5.34	0.32
FLUX-schnell (12B)	4	7.94	0.71	0.50	2.10

SANA-Sprint establishes a new Pareto frontier for speed-fidelity trade-offs—substantially reducing generations times (e.g., 0.1s for T2I, 0.25s for ControlNet on H100)—while preserving or outperforming baseline model quality. Qualitative analysis shows that even single-step generations maintain detailed textures, coherent textual outputs, and precise semantic correspondence. Interactive ControlNet demonstrations enable photo-realistic synthesis from hand-drawn inputs in real time (Chen et al., 12 Mar 2025).

7. Limitations, Extensions, and Research Directions

SANA-Sprint’s primary limitations include slight fidelity degradation for extremely complex prompts when operating below two steps, and its dependence on a strong flow-matching teacher for optimal results. Ongoing and future research directions include:

• Extending step adaptivity to continuous-time schedules, supporting arbitrary step counts.
• Generalizing the hybrid distillation approach to alternative teacher model families (e.g., standard diffusion, rectified flow).
• Exploring broader multi-modal conditioning mechanisms (e.g., depth, semantic maps).

Code and pre-trained models will be open-sourced, supporting further advancement in ultra-fast diffusion inference and AI-powered creative applications (Chen et al., 12 Mar 2025).