---
title: Scaled Spatial Guidance (SSG) in VAR
url: https://www.emergentmind.com/topics/scaled-spatial-guidance-ssg
type: topic
---

# Scaled Spatial Guidance (SSG) in VAR

Searching arXiv for the cited SSG papers and closely related work to ground the article.
arxiv_search query: 2602.05534 OR "Scaled Spatial Guidance" OR "SSG: Scaled Spatial Guidance for Multi-Scale Visual Autoregressive Generation" OR 2604.26503 OR 2404.05384 OR 2601.04572 OR 2604.08048 OR 2508.17062
Scaled Spatial Guidance (SSG) most specifically denotes a training-free, inference-time guidance method for multi-scale visual autoregressive (VAR) image generation that modifies per-scale residual logits so that each generation step contributes high-frequency content not already explained by coarser scales [2602.05534]. In adjacent literatures, the phrase is also used more broadly for guidance schemes that replace a single global guidance strength with spatially varying or scale-aware control, including per-pixel, per-region, and cluster-level diffusion guidance [2604.26503], [2404.05384], [2601.04572]. The acronym is not stable across the literature: in some works, SSG instead expands to “Self-Swap Guidance” or “Spatial Signal Guided” [2604.08048], [2508.17062].

## 1. Terminological scope and acronym usage

The clearest formalization of SSG as a named method appears in “SSG: Scaled Spatial Guidance for Multi-Scale Visual Autoregressive Generation,” where SSG is defined for next-scale VAR models and paired with a frequency-domain prior construction called Discrete Spatial Enhancement (DSE) [2602.05534]. Other papers use the same phrase descriptively rather than as a fixed algorithmic name, or use the acronym for different expansions entirely.

| Paper | Expansion or usage of “SSG” | Role |
|---|---|---|
| [2602.05534] | Scaled Spatial Guidance | Specific VAR inference method |
| [2604.26503] | SSG as spatially varying guidance; SAMG realization | Per-pixel diffusion guidance |
| [2404.05384] | Not named SSG, but presented as an operationalization of it | Region-wise CFG rescaling |
| [2601.04572] | SSG lens applied to FENCE | Cluster-level spatio-temporal guidance |
| [2604.08048] | Self-Swap Guidance | Acronym collision; token-swap guidance |
| [2508.17062] | Spatial Signal Guided | Acronym collision in video DiT |

This terminological dispersion matters because “Scaled Spatial Guidance” can refer either to the specific VAR method of [2602.05534] or, more loosely, to a broader design pattern in which guidance becomes spatially heterogeneous rather than globally uniform. A common misconception is that SSG names a single diffusion-time variant of classifier-free guidance; the literature instead shows at least three distinct usages: a logit-space VAR mechanism, a family resemblance among spatially adaptive guidance methods, and unrelated acronym expansions.

## 2. Information-theoretic formulation in multi-scale VAR

In the VAR setting of [2602.05534], image generation is factorized across coarse-to-fine scales. With token maps $r_k \in \{1,\dots,V\}^{h_k \times w_k}$, the joint distribution is

$$
p(r_1,\dots,r_K) = p(r_1)\prod_{k=2}^K p(r_k \mid r_{<k}).
$$

A sampled token map is de-quantized to an embedding $z_k$, and the accumulated feature state evolves as

$$
\hat f_k = \hat f_{k-1} + U(z_k), \qquad \hat f_0 = 0.
$$

The motivating problem is a train–inference discrepancy in next-scale VAR. Under teacher forcing, later scales learn to add progressively higher-frequency details. At inference, limited capacity and accumulated error can cause later scales to drift, re-predicting or distorting low-frequency structure instead of contributing scale-appropriate, novel detail. The paper reformulates this problem through an Information Bottleneck (IB) lens [2602.05534].

The classical IB objective is

$$
\mathcal{L}_{\text{IB}} = \min_{\tilde X} I(X;\tilde X) - \beta I(\tilde X;Y).
$$

For VAR step $k$, the paper sets $X=\hat f_{k-1}$, $\tilde X=z_k$, and $Y=\hat f_K$, then reverses the usual compression perspective to maximize novel utility while penalizing redundancy:

$$
\mathcal{L}_{\text{VAR-IB}} = \max_{z_k} \beta I(z_k;\hat f_K \mid \hat f_{k-1}) - I(\hat f_{k-1}; z_k).
$$

Using the chain rule and the coarse-state approximation $\hat f_{k-1} \approx L(\hat f_K)$, this becomes

$$
\mathcal{L}_{\text{VAR-IB}} \approx \max_{z_k} \beta I(z_k;\hat f_K) - (\beta+1) I(z_k;\hat f_{k-1}),
$$

and, in the frequency-domain interpretation with ideal low/high-pass filters $L(\cdot)$ and $H(\cdot)$ and $L+H=\mathrm{Id}$,

$$
\mathcal{L}_{\text{VAR-IB}} \approx \max_{z_k} \beta I(z_k;H(\hat f_K)) - I(z_k;L(\hat f_K)).
$$

The interpretation given in the paper is precise: the step-$k$ residual should be informative about new high-frequency content while remaining uninformative about low-frequency content already established. This is the conceptual core of SSG in its original form.

At the operational level, SSG acts in logit space. If $\ell_k \in \mathbb{R}^{h_k \times w_k \times V}$ are the pre-softmax residual logits at scale $k$, then the scale-$k$ semantic residual is defined as

$$
\Delta_k = \ell_k - \ell_{\text{prior}},
$$

where $\ell_{\text{prior}}$ is a frequency-aware prior derived from the previous scale.

## 3. Discrete Spatial Enhancement and the SSG logit update

The prior construction in [2602.05534] is Discrete Spatial Enhancement (DSE), whose stated purpose is to transport only the coarse structure from the previous scale to the current resolution while avoiding over-smoothing from linear interpolation or blockiness from nearest-neighbor upsampling. DSE applies a 2D DCT-II with orthonormal normalization over the spatial dimensions of the logits for each vocabulary channel, combines spectra by hard low-frequency replacement, and returns to spatial logits with the inverse DCT-III.

Let $\ell_{k-1}$ be previous-step logits and $\ell_{\text{interp}}=\mathrm{Interpolate}(\ell_{k-1}\rightarrow h_k,w_k)$ the current-resolution interpolant. After taking DCTs of both tensors, DSE replaces the top-left low-frequency block of the interpolated spectrum by the exact low-frequency coefficients of the coarse spectrum:

$$
\tilde L[p,q,c]
=
M_{\text{low}}[p,q] \, L_{\text{prev}}[p,q,c]
+
\bigl(1-M_{\text{low}}[p,q]\bigr)\, L_{\text{interp}}[p,q,c],
$$

where $M_{\text{low}}[p,q]=1$ for $p<h_{k-1}$ and $q<w_{k-1}$, and $0$ otherwise. The prior is then

$$
\ell_{\text{prior}} = \mathrm{IDCT}(\tilde L).
$$

The paper emphasizes two consequences of this construction: DSE preserves coarse structure exactly through hard low-frequency replacement, and it carries a plausible high-frequency extrapolation from the interpolant rather than injecting artificial blockiness [2602.05534]. A zero-padding variant that removes extrapolated detail is denoted DSE†.

SSG then converts the information-theoretic objective into a closed-form logit-space update. Given the semantic residual $\Delta_k$, the paper defines a concave MAP-style surrogate

$$
\mathcal{L}(\ell') = \beta (\ell')^\top \Delta_k - \tfrac{1}{2}\|\ell' - \ell_k\|_2^2,
$$

whose unique maximizer is

$$
\ell_k^{\text{SSG}} = \ell_k + \beta \Delta_k = \ell_k + \beta(\ell_k - \ell_{\text{prior}}).
$$

A per-scale schedule is recommended:

$$
\beta_k = \beta \left(1-\frac{k-1}{K}\right).
$$

The paper states that this linear decay is effective and stable in practice, whereas a fixed $\beta$ can overemphasize late high-frequency updates and degrade FID even if IS rises. After the update, sampling proceeds as usual:

$$
r_k \sim \mathrm{Cat}\bigl(\mathrm{softmax}(\ell_k^{\text{SSG}}/T)\bigr),
$$

optionally with top-$k$ or nucleus sampling if those are already present in the base system. No additional normalization or clipping is required beyond the base temperature $T$ [2602.05534].

Algorithmically, SSG is minimal. At each scale $k>1$, the model computes base logits $\ell_k$, constructs $\ell_{\text{prior}}$ from cached raw logits $\ell_{k-1}$ by DSE, forms $\Delta_k$, applies the affine update, samples tokens, de-quantizes them to $z_k$, accumulates $\hat f_k$, and caches raw logits for the next step. Its extra cost per scale is an interpolation plus DCT/IDCT on an $(h_k \times w_k \times V)$ tensor, with GPU-batched transform complexity $O(h_k w_k \log(h_k w_k))$ per channel [2602.05534].

## 4. Empirical profile, ablations, and operating characteristics

The empirical profile reported in [2602.05534] is consistent across class-conditional ImageNet, higher-resolution ImageNet, and text-to-image benchmarks. On ImageNet $256\times256$ with 10-step class-conditional generation, SSG improves FID, sFID, and IS across all reported VAR scales; the strongest reported configuration is VAR-d30, where FID improves from 2.02 to 1.68 and IS from 302.9 to 313.2.

| Setting | Baseline $\rightarrow$ SSG | Latency |
|---|---|---|
| ImageNet $256\times256$, VAR-d16 | FID 3.42 $\rightarrow$ 3.27; sFID 8.70 $\rightarrow$ 8.39; IS 275.6 $\rightarrow$ 285.3 | Time unchanged |
| ImageNet $256\times256$, VAR-d30 | FID 2.02 $\rightarrow$ 1.68; sFID 8.52 $\rightarrow$ 8.50; IS 302.9 $\rightarrow$ 313.2 | 10 steps |
| ImageNet $512\times512$, VAR-d36 | FID 2.70 $\rightarrow$ 2.39; IS 290.6 $\rightarrow$ 320.6 | Time unchanged |
| MJHQ-30K, HART-0.7B | FID 8.46 $\rightarrow$ 7.28; CLIPScore 0.2819 $\rightarrow$ 0.2834 | Time $\approx$ constant |
| MJHQ-30K, Infinity-2B | FID 10.01 $\rightarrow$ 9.68; CLIPScore 0.2754 $\rightarrow$ 0.2767 | Time $\approx$ constant |

The same paper reports that SSG+VAR-d30, with FID 1.68 at 10 steps, is competitive with or surpasses diffusion and masked autoregressive baselines such as DiffiT at FID 1.73 with 250 steps and MAR-H at FID 1.78 with 64 steps [2602.05534]. The result is important less as a cross-family ranking than as evidence that guidance on the inherited coarse-to-fine hierarchy can unlock substantial gains without retraining or additional denoising iterations.

The ablations isolate the two core design choices. First, purely spatial priors degrade performance: nearest-neighbor prior gives FID 4.02 and linear interpolation prior gives FID 3.79 against a baseline FID of 3.42. Frequency-domain priors instead improve it: DSE† yields FID 3.34 and full DSE yields FID 3.27, with IS gains and unchanged latency. Second, the $\beta_k$ schedule matters: fixed $\beta$ overguides, producing FID 3.63 and IS 287.8, whereas linear decay gives FID 3.27 and IS 285.3 [2602.05534].

The paper also reports a spectral analysis: SSG suppresses spectral energy below the previous Nyquist frequency and boosts it above that frequency, aligning the generation step with the intended high-frequency novelty. Pixel-level spectra align better to the reference dataset while avoiding excessive high-frequency noise. Across temperature sweeps, the FID–IS Pareto frontier improves: for similar IS, SSG gives lower FID, and for similar FID, it gives higher IS. Mean wall-clock time changes by at most 1–2%, which the paper describes as effectively negligible [2602.05534].

## 5. Diffusion-era generalizations of scaled spatial guidance

Outside VAR, several papers instantiate the same broad principle—spatially heterogeneous guidance—through different mechanisms. This suggests a broader, concept-level reading of “scaled spatial guidance”: not a single update rule, but a family of methods that localize guidance strength according to structure, semantics, or uncertainty.

“Delta Score Matters! Spatial Adaptive Multi Guidance in Diffusion Models” derives a per-pixel guidance energy from the conditional–unconditional difference,
$$
\Delta\epsilon_t = \epsilon_\theta(x_t,c)-\epsilon_\theta(x_t,\emptyset), \qquad
E_t(p)=\frac{1}{C}\|\Delta\epsilon_t(p)\|_2^2,
$$
normalizes it, and maps it affinely to a local guidance scale between $\omega_{\min}$ and $\omega_{\max}$. The final guided prediction is
$$
\tilde{\epsilon}_{\text{SAMG}}(p)=\epsilon_\theta(x_t,\emptyset;p)+\Omega_{\text{map}}(p)\,\Delta\epsilon_t(p).
$$
The paper interprets standard CFG as tangential linear extrapolation on a curved data manifold and uses the resulting deviation analysis to motivate conservative scaling at high-energy boundaries and aggressive scaling in low-energy regions. Reported gains include SDXL COCO FID 27.98 to 25.41 with CLIPScore 19.51 to 20.14, and SD3.5-M GenEval All score 0.63 to 0.66; in video, ModelScope-1.7B improves CHScore Flow 70.47 to 72.10, Frame LPIPS 8.12 to 7.35, Frame SSIM 79.13 to 80.50, and MTScore CLIP 10.56 to 10.78 [2604.26503].

“Rethinking the Spatial Inconsistency in Classifier-Free Diffusion Guidance” formulates a region-wise version of CFG. It constructs semantic masks from cross-attention and self-attention, then composes guidance as
$$
\hat{\epsilon}_{\theta}(x_t,c,t)
=
\epsilon_{\theta}(x_t,t)
+
\sum_{i=1}^{M}
\gamma_{t,i}\,\bigl(m_{t,i}\odot(\epsilon_{\theta}(x_t,c,t)-\epsilon_{\theta}(x_t,t))\bigr).
$$
The per-region scales are chosen to uniformize aggregate guidance magnitude across regions relative to a benchmark mask. On SD-v1.5 with DPMSolver++ and $\gamma=7.5$, the paper reports FID 12.466 to 12.059 and CLIP 0.3223 to 0.3226; on IF with DPMSolver++ and $\gamma=10.0$, it reports FID 15.31 to 13.99 at unchanged CLIP 0.3280 [2404.05384].

“Spatial-Temporal Feedback Diffusion Guidance for Controlled Traffic Imputation” extends the same logic to spatio-temporal data. FENCE uses a dynamic posterior-based guidance scale,
$$
\lambda(\boldsymbol{x}_k,k)
\approx
\frac{p_{\theta,k}(\boldsymbol{c}\mid \boldsymbol{x}_k)}
{p_{\theta,k}(\boldsymbol{c}\mid \boldsymbol{x}_k)-(1-\pi)},
$$
and computes it at cluster level after grouping nodes by attention-derived spatial correlation features. The resulting guided prediction is
$$
\tilde{\epsilon}_{\theta}
=
\epsilon_{\theta}^{\mathrm{uncond}}
+
\boldsymbol{\lambda}_k \odot
\bigl(\epsilon_{\theta}(\boldsymbol{x}_k,k,\boldsymbol{c})-\epsilon_{\theta}^{\mathrm{uncond}}(\boldsymbol{x}_k,k)\bigr).
$$
Across PEMS04/07/08 with SR-TC and SC-TC missingness at $\alpha=80\%$, FENCE is reported to beat the second-best method by an average 6.26% in MAPE, with cluster-level scaling outperforming a uniform global scale in ablations [2601.04572].

These methods are mechanistically different. SAMG is energy-driven and per-pixel, S-CFG is mask-driven and per-region, and FENCE is posterior-driven and cluster-level. The shared principle is spatial heterogeneity in guidance strength.

## 6. Related acronym collisions, limitations, and interpretive boundaries

The acronym SSG is not unique to Scaled Spatial Guidance. In “Guiding a Diffusion Model by Swapping Its Tokens,” SSG means “Self-Swap Guidance.” The method creates a perturbed branch by swapping semantically dissimilar spatial or channel tokens, defines
$$
\Delta_t = \epsilon_{\text{ori}}(x_t)-\epsilon_{\text{pert}}(x_t),
$$
and guides with
$$
\epsilon_{\text{guided}}(x_t)=\epsilon_{\text{ori}}(x_t)+w_t\,\Delta_t.
$$
The paper explicitly states that this is not Scaled Spatial Guidance by name, although it is a scaled spatial guidance mechanism “in the practical sense” because it uses spatially targeted perturbations and a tunable guidance strength. Reported conditional SDXL results on COCO 2014 include FID 21.73, CLIP 0.313, IS 34.63, AES 5.902, PickScore 22.17, and ImageReward 0.276; unconditional COCO 2014 results include FID 70.91 and IS 16.44 [2604.08048].

In “SSG-DiT: A Spatial Signal Guided Framework for Controllable Video Generation,” SSG expands to “Spatial Signal Guided,” not Scaled Spatial Guidance. The method uses CLIP-derived $24\times24$ attention and MLP masks to build a spatially prompted image and injects the resulting visual condition into a frozen video DiT through a dual-branch attention adapter:
$$
O_{\text{attn}} = X_{\text{in}} + O_{\text{self}} + O_{\text{cross}}.
$$
The paper explicitly states that it does not introduce an explicit scalar guidance coefficient in its reported experiments; any multiplier on $O_{\text{cross}}$ would be a practical extension rather than part of the reported setup. On VBench, the full model reports Subject Consistency 97.40, Spatial Relationship 78.17, and Overall Consistency 26.31, while the ablation without SSG drops Overall Consistency to 18.91 [2508.17062].

For the original VAR SSG, the limitations are specific and concrete. The method is sensitive to the quality of the previous step’s logits: if they are distorted, the prior can misalign the semantic residual and suppress useful detail. It cannot fully correct severe initial mistakes or tokenizer bottlenecks, does not force separation for ambiguous prompts or classes that blend with the background, and can overguide when $\beta$ is large and non-decayed, raising IS while harming FID. Methods that do not expose logits at sampling, such as continuous-time diffusion without categorical stages, require adaptation for direct application [2602.05534].

Across the broader literature, limitations recur at the level of spatial decomposition. SAMG notes dense semantic overlaps as a failure mode; S-CFG notes mis-segmentation, token ambiguity, and instability for extremely small regions; FENCE notes noisy attention and mis-clustering under extreme sparsity [2604.26503], [2404.05384], [2601.04572]. A plausible implication is that “scaled spatial guidance” is most reliable when the mechanism used to localize guidance—frequency separation, attention-derived masks, energy maps, or clusters—faithfully captures the structure that the model should preserve.

In that sense, Scaled Spatial Guidance is best understood not merely as one named method, but as a general principle of replacing uniform guidance with structure-aware, location-sensitive guidance. Its most formal and compact realization remains the VAR logit update of [2602.05534], where the principle is expressed as a frequency-aware prior, a semantic residual, and a single closed-form affine update.

Source: https://www.emergentmind.com/topics/scaled-spatial-guidance-ssg