---
title: 'MSPG-SEN: Multi-Scale Progressive GAN'
url: https://www.emergentmind.com/topics/multi-scale-progressive-generative-adversarial-network-mspg-sen
type: topic
---

# MSPG-SEN: Multi-Scale Progressive GAN

Searching arXiv for the named model and closely related formulations to ground the article in current records.
Multi-Scale Progressive Generative Adversarial Network, abbreviated MSPG-SEN, denotes a non-uniform but increasingly useful label for adversarial architectures that combine multi-scale representation, progressive refinement or staged growth, and an additional enhancement component operating on channels, statistics, or scale conditioning. In the surveyed arXiv literature, the term is explicit in "Two-flow Feedback Multi-scale Progressive Generative Adversarial Network" [2508.16089], but closely related formulations appear earlier under other names: FIGAN for frame interpolation [1711.06045], a multi-scale recursive super-resolution system with a statistics-capturing discriminator [1809.10711], BSD-GAN with scale-disentangled latent branches and a later SE-based mapping [1803.08467], PC-GANs for pan-sharpening [2207.14451], and a StyleGAN3-based scale-space generator recast as an MSPG-SEN-style system [2406.08924]. Across these works, MSPG-SEN is best understood as a design pattern rather than a single canonical network.

## 1. Terminological scope and lineage

The label is not used consistently across papers. In "Frame Interpolation with Multi-Scale Deep Loss Functions and Generative Adversarial Networks" [1711.06045], the paper introduces FIGAN rather than MSPG-SEN, and its discriminator-generator design is mapped to a "Multi-Scale Progressive GAN" because the generator estimates motion and synthesis features in a coarse-to-fine manner. In "Multi-Scale Recursive and Perception-Distortion Controllable Image Super-Resolution" [1809.10711], the system is explicitly interpreted as an MSPG-SEN because the discriminator contains a specialized statistics-capturing layer, namely Variance Normalization and Shift Correlator (VN+SC). In "PC-GANs: Progressive Compensation Generative Adversarial Networks for Pan-sharpening" [2207.14451], the core system corresponds to MSPG without SEN, while SE integration is described as an extension. In "Learning Images Across Scales Using Adversarial Training" [2406.08924], the acronym does not appear in the paper, but the method is recast as MSPG-SEN because scale-aware conditioning, procedural Fourier injection, and cross-scale consistency act as a scale-enhancement component. The 2025 paper uses MSPG-SEN directly, but its concrete definition of SEN centers on APFL, GCTDRN, DEMA, and an auxiliary feature discriminator rather than on classical SE blocks [2508.16089].

| Source | Multi-scale/progressive mechanism | SEN interpretation |
|---|---|---|
| [1711.06045] | Coarse-to-fine residual flow and synthesis refinement | Proposed extension via SE blocks |
| [1809.10711] | Recursive multigrid SR over \(2\times,4\times,8\times\) | Statistics Extraction Network via VN+SC |
| [1803.08467] | Progressive growing with latent branch de-freezing | Mapped extension via SE gating |
| [2207.14451] | Triple-GAN progressive compensation | Suggested SE add-on, not original |
| [2406.08924] | Progressive scale-bin training and Fourier injection | Scale-enhancement component |
| [2508.16089] | Two-flow progressive GAN with feedback | DEMA/APFL-centered enhancement |

A second source of ambiguity is the meaning of "SEN." In the super-resolution formulation, SEN is not a squeeze-and-excitation block; it is a Statistics Extraction Network formed by VN+SC. In the BSD-GAN mapping and the FIGAN extension, SEN refers instead to channel recalibration through standard SE modules. This suggests that MSPG-SEN functions as an umbrella term whose suffix identifies an enhancement mechanism, but not a unique one [1803.08467].

## 2. Core architectural pattern

The common architectural core is multi-scale generation coupled to a progressive procedure that either refines predictions from coarse to fine or grows the model through resolution stages. In FIGAN, two consecutive frames \(I_0\) and \(I_1\) are processed through a 3-level pyramid with downsampling factors \(\times 8\), \(\times 4\), and \(\times 2\), then upsampled to full resolution. At each scale \(s\), the network predicts synthesis features \(\Gamma^{(s)}=\{\Delta^{(s)},W^{(s)}\}\), where \(\Delta^{(s)}\in\mathbb{R}^{H_s\times W_s\times 2}\) is a learned bidirectional motion field and \(W^{(s)}\in\mathbb{R}^{H_s\times W_s\times 1}\) is a spatial blending weight. The coarsest estimate is produced by \(f_{\text{flow\_coarse}}\), while finer scales use \(f_{\text{flow\_res}}\) to predict residual corrections after warping the inputs with the upsampled coarser flow [1711.06045].

In the controllable super-resolution system, the generator is G-MGBP, a generative version of Multi-Grid Back-Projection. It operates recursively across scales \(2\times\), \(4\times\), and \(8\times\), and uses learned Analysis, Synthesis, Upscale, and Downscale modules with latent iterative back-projection. A single external amplitude parameter \(W\) scales Gaussian noise channels injected into the Upscale module, allowing inference-time traversal of the perception-distortion trade-off. All scales are produced in a single forward pass, and parameters are shared across scales [1809.10711].

BSD-GAN realizes progression differently. Its generator is DCGAN-like, but the latent vector is partitioned into scale-specific sub-vectors \(z=[z^{(0)},z^{(1)},\dots,z^{(K-1)}]\). Training proceeds by progressively increasing resolution and de-freezing one latent branch at a time. Stage I at each scale trains only the newly added generator block, whereas Stage II unfreezes all generator layers and gradually activates the new branch by feeding \(z^{(t)}\sim U(-\alpha,\alpha)\) with \(\alpha\) increasing from \(0\) to \(1\). The paper attributes scale separation to branch suppression, whereby previously trained branches retain coarse structure and newly activated branches are pushed toward finer features [1803.08467].

PC-GANs implement progression as compensation across spatial scales and directions. A Deep Multiscale Guidance module first produces a pre-fused image \(F_d\), then a Spatial-Spectral Residual Compensation module refines it with two reverse-architecture GANs: one coarse-to-fine and one fine-to-coarse. The coarse-to-fine update is
$$
D_h^{(s)} = G_s([I_h^{(s-1)}, F_d^{(s-1)}]_{\text{dim}}), \qquad
I_h^{(s)} = \frac{u_2(I_h^{(s-1)}) + D_h^{(s)}}{2},
$$
with an analogous fine-to-coarse recursion used during training to close the cycle [2207.14451].

The continuous scale-space model generalizes multi-scale progression from discrete pyramids to a continuous scale parameter
$$
s=\log_2\left(\frac{\omega}{\omega_{\min}}\right),
$$
with typical \(s_{\max}=8\), corresponding to zoom factors up to \(256\times\). Its generator is an alias-free StyleGAN3-R conditioned on continuous position and scale through
$$
g(\mathbf{x}_i;\mathbf{x}_p,s_p)=2^{-s_p}(\mathbf{x}_i-\mathbf{x}_p),
$$
and supplied with binned Fourier features whose blending weights vary with scale. Progression is enforced by curriculum sampling over scale bins and by an explicit scale-consistency loss across \(s\) and \(s-\Delta s\) [2406.08924].

## 3. Generator, discriminator, and SEN mechanisms

The generator side of MSPG-SEN systems is uniformly multi-scale, but the discriminator side varies from a lightweight image-level classifier to recursive multi-scale discriminators and auxiliary feature critics. FIGAN uses a lightweight image discriminator with 32 initial filters and 8 Conv-BatchNorm-LeakyReLU blocks, alternating strides 2 and 1, and doubling channels at each stride-2 block. It is unconditional in the original paper and distinguishes real \(I_{0.5}\) from generated \(f_{\theta_G}(I_0,I_1)\). The mapped MSPG extension notes that conditioning \(D\) on \((I_0,I_1)\) is straightforward [1711.06045].

The super-resolution formulation provides the clearest example of SEN as a statistics extractor rather than channel attention. Its multi-scale recursive discriminator \(D^L\) consumes generator outputs at all scales and begins with a VN+SC layer. Variance normalization is defined as
$$
\hat{I}_{i,j}=\frac{I_{i,j}-\mu_{i,j}(I)}{\sigma_{i,j}(I)+1},
$$
and the shift correlator constructs 49 channels through
$$
V^{7(p+3)+q+3}_{i,j}(I)=\hat{I}_{i,j}\cdot\hat{I}_{i+p,j+q}, \qquad p,q\in\{-3,\dots,3\}.
$$
These channels encode local correlation statistics that are described as close to Gaussian for natural images and sensitive to distortions. The VN+SC output is then passed through a 4-layer dense block, and the discriminator recurses across scales with shared parameters [1809.10711].

In the SE-based interpretation of MSPG-SEN, the relevant operation is the standard squeeze-and-excitation block for a feature tensor \(X\in\mathbb{R}^{H\times W\times C}\):
- squeeze: \(z_c=(1/(HW))\sum_{i,j}X_{i,j,c}\),
- excitation: \(s=\sigma(W_2\delta(W_1 z))\),
- scale: \(Y_{i,j,c}=s_c\cdot X_{i,j,c}\).

The mapped FIGAN extension proposes inserting SE after each convolution layer in \(f_{\text{flow\_coarse}}\), \(f_{\text{flow\_res}}\), and \(f_{\text{syn\_refine}}\), and after each discriminator block. The BSD-GAN-to-MSPG-SEN mapping proposes SE after each progressive upsampling or downsampling block, optionally conditioning the gate on the scale-specific latent branch \(z^{(k)}\) [1803.08467].

PC-GANs do not include attention or SE in the original design. Their feature fusion is performed by concatenation inside generator blocks, and discriminators \(D_C\) and \(D_F\) are ordinary convolutional critics over coarse and fine domains. The paper explicitly treats SE as a possible extension and suggests placing channel-SE in the Deep Multiscale Guidance module, inside SSRC residual blocks, and optionally in the discriminators, with the warning that over-aggressive reweighting can induce spectral bias [2207.14451].

The 2024 continuous scale-space model again diverges from classical SE. Its enhancement mechanism is the injection of procedural Fourier features in scale bins, assigned to layers according to per-layer Nyquist limits, combined with a cross-scale coherence loss. The 2025 explicit MSPG-SEN paper departs further: it defines a globally connected two-flow dynamic residual network, a Dynamic Embedded Attention Mechanism, and an auxiliary discriminator on intermediate generator features. Its fusion rule is
$$
F_{\text{final}}(X)=\alpha\cdot\bigl(\text{Branch}_{3\times 3}(X)+\text{Branch}_{5\times 5}(X)+\text{Branch}_{7\times 7}(X)\bigr)+\beta\cdot\text{Attention}(X)+\text{Shortcut}(X),
$$
with \(\alpha,\beta\) produced dynamically, and with \(D_{\text{main}}\) and \(D_{\text{aux}}\) providing joint adversarial feedback [2406.08924][2508.16089].

## 4. Objectives, supervision, and optimization

A defining property of MSPG-SEN systems is that adversarial training is rarely used in isolation; it is coupled to scale-aware reconstruction, perceptual, cycle, or consistency losses. FIGAN uses a multi-scale synthesis loss
$$
\mathcal{L}_{\text{multi-syn}}=\sum_{s=1}^{3}\lambda_{\text{syn},s}\,\tau\big(\hat{I}_{0.5}^{(s)},D^s I_{0.5}\big),
$$
with \(\lambda_{\text{syn},1}=1\) and \(\lambda_{\text{syn},2}=\lambda_{\text{syn},3}=0.5\), plus a refinement loss on \(\hat{I}_{0.5}^{\text{refine}}\). The distance
$$
\tau(a,b)=\|a-b\|_1+\lambda_{\text{VGG}}\|\gamma(a)-\gamma(b)\|_2^2,\qquad \lambda_{\text{VGG}}=10^{-3},
$$
combines \(L_1\) with VGG \((5\_4)\) features, and the overall objective adds an image-level GAN term weighted by \(\lambda_{\text{GAN}}=10^{-4}\). The paper states that multi-level supervision constrains the solution space, prevents degenerate decompositions, accelerates convergence, and stabilizes the GAN term by anchoring low-frequency structure early [1711.06045].

The controllable super-resolution system uses deliberate loss routing by the control parameter \(W\). Reconstruction and one branch of cycle loss are evaluated with \(W=0\), while adversarial and contextual losses are evaluated with \(W=1\). Its total objective is
$$
\mathcal{L}_{\text{total}}=\sum_{L=1}^3\left\{
0.001\,\mathcal{L}^{\text{GAN-G}}_L(Y_{W=1})
+0.1\,\mathcal{L}^{\text{perc}}_L(Y_{W=1},X)
+10\,\mathcal{L}^{\text{rec}}_L(Y_{W=0},X)
+10\,\mathcal{L}^{\text{cycle}}_L(Y_{W=0},Y_{W=1},X)
\right\}.
$$
The training schedule pre-trains \(G\) with \(W=0\) and only \(L_1\), then activates the full objective. Optimization uses Adam with initial learning rate \(10^{-3}\), square-root decay, batch size 16, and \(128\times128\) patches [1809.10711].

BSD-GAN uses the non-saturating GAN objective and a two-stage schedule at every resolution. During Stage I, only the newest generator block is trainable; during Stage II, all generator layers are unfrozen and the new latent branch is gradually activated. This progressive de-freezing is the central training mechanism, rather than an auxiliary regularizer [1803.08467].

PC-GANs use a joint compensation loss
$$
\mathcal{L}^{JC}=\mathcal{L}^{Adv}+\lambda_1\mathcal{L}^{Cyc}+\lambda_2\mathcal{L}^{R},
$$
with \(\lambda_1=10\) and \(\lambda_2=5\), combined with LSGAN adversarial terms for DMG, C2F, and F2C. The DMG module is first supervised by \(\mathcal{L}_{DMG}=\|R-F_d\|_2^2\), then the triple-GAN system is trained cyclically with Adam for generators, mini-batch gradient descent for discriminators, learning rate \(0.0002\), and 300 epochs [2207.14451].

The continuous scale-space model uses StyleGAN3 non-saturating logistic loss with R1 and ADA, augmented by the exact scale-consistency term
$$
\mathcal{L}_{\text{scale}}=\mathbb{E}_{\mathbf{z},\mathbf{x}_p,s_p,\Delta s}\!\left[
d\!\left(R_{\Delta s}\!\left(G(\mathbf{z},\mathbf{x}_p,s_p)\right),\,G\!\left(\mathbf{z},\mathbf{x}_p,s_p-\Delta s\right)\right)
\right],
$$
where \(d\) is implemented as a linear combination of \(\ell_1\) and LPIPS. The offset \(\Delta s\) is drawn from a Beta distribution conditioned on \(s\), and gradients are backpropagated through only one branch of the scale-consistency pair per iteration for stability [2406.08924].

The explicit 2025 MSPG-SEN paper introduces APFL, which adapts learning rates and loss weights according to generator-quality and discriminator-accuracy signals. Its generator objective is written as
$$
\mathcal{L}_G^{\text{total}}(t)=
\lambda_{\mathrm{adv}}(t)\mathcal{L}_{\mathrm{adv}}^G+
\lambda_{\mathrm{FM}}(t)\mathcal{L}_{\mathrm{FM}}+
\lambda_{\mathrm{aux}}(t)\mathcal{L}_{\mathrm{aux}}^G+
\lambda_{\mathrm{con}}(t)\mathcal{L}_{\mathrm{LGCL}},
$$
with AdamW, EMA decay \(0.9999\), batch size 16, dropout \(10\%\), and a StepLR-like update scheme. This suggests an MSPG-SEN variant in which progression is controlled not only by resolution staging but also by adaptive feedback between generator and discriminator [2508.16089].

## 5. Empirical behavior across application domains

In frame interpolation, FIGAN emphasizes the efficiency-accuracy trade-off. At \(360\times640\), the paper reports a baseline CNN at \(33.93\) dB with \(123\)k parameters and \(57\) G FLOPs; the multi-scale model with refinement reaches \(36.97\) dB at \(25\) G FLOPs and \(0.015\) s/frame; FIGAN itself, defined as MS+VGG+GAN, reaches \(36.68\) dB at \(25\) G FLOPs and \(0.015\) s; SepConv \(L1\) reaches \(37.04\) dB but at \(81\) G FLOPs and \(0.7\) s/frame. The paper states that FIGAN provides subjective visual quality comparable to the best performing interpolation method at \(\times 47\) faster runtime, while the best numeric PSNR reported in the paper is \(37.23\) dB for MS trained on 200k, without GAN [1711.06045].

In super-resolution, the G-MGBP-based MSPG-SEN is explicitly controllable. It achieved 2nd best perceptual quality in PIRM Region 3 \((12.5<\text{RMSE}\le 16)\), 5th in Region 2 \((\text{RMSE}\le 12.5)\), and 7th in Region 1 \((\text{RMSE}\le 11.5)\). The full model uses approximately \(281\)k parameters, runs in approximately \(0.2\) s per image, and can traverse the perception-distortion plane by varying \(W\) at inference. The transition is reported as sharp near \(W\approx 0.01\)–\(0.02\), where contextual similarity improves initially while RMSE remains modest [1809.10711].

For unconditional image synthesis, BSD-GAN contributes scale-disentangled latent control rather than distortion metrics. Its evidence includes variance-by-scale distributions, latent mixing across scales, and the smallest average minimum modified iGAN objective values across tested datasets relative to DCGAN, PGGAN, InfoGAN, and StyleGAN. Qualitative control is described as coarse branches affecting global color and layout while finer branches modify facial details, hair, lighting, or analogous high-frequency attributes in other classes [1803.08467].

In pan-sharpening, PC-GANs report best reduced-resolution metrics on both QuickBird and WorldView-4 among the compared methods. On QB, the paper reports \(Q4=0.9773\), \(SAM=2.8485\), and \(ERGAS=2.5370\); on WV-4, \(Q4=0.9361\), \(SAM=5.4779\), and \(ERGAS=4.8823\). In full-resolution evaluation, the paper reports on QB \(D_\lambda=0.0137\), \(D_s=0.0186\), \(QNR=0.9680\), and on WV-4 \(D_\lambda=0.0148\), \(D_s=0.0236\), \(QNR=0.9619\). The SSRC module also improves other pan-sharpeners when used as a post-processor [2207.14451].

The continuous scale-space model extends the empirical scope of MSPG-SEN-like systems beyond fixed discrete resolution conversion. It demonstrates zoom-in factors up to \(256\times\) and interactive navigation at approximately \(20\) fps. Reported FID values for reconstruction from unstructured patches include Himalayas \(19.1\), Spain \(8.4\), Milkyway \(8.6\), Moon \(9.0\), and Rembrandt \(14.6\); for generative multiscale modeling, the paper reports, for example, MoonGen FID \(6.3\) versus AnyresGAN \(18.4\), together with stronger scale-consistency statistics [2406.08924].

The 2025 explicit MSPG-SEN paper claims state-of-the-art generation results on datasets named INKK \((89.7\%)\), AWUN \((78.3\%)\), IONJ \((85.5\%)\), POKL \((88.7\%)\), and OPIN \((96.4\%)\), and attributes gains to APFL, GCTDRN, DEMA, and AFE. However, the text does not define what these percentages measure and does not provide standard metrics such as FID, IS, or LPIPS. That omission is itself a substantive empirical characteristic of the paper [2508.16089].

## 6. Limitations, misconceptions, and open directions

A common misconception is that MSPG-SEN denotes a single settled architecture. The literature instead shows at least three distinct families of "SEN" mechanisms: a Statistics Extraction Network via VN+SC in super-resolution, Squeeze-and-Excitation-style channel gating in mapped variants of frame interpolation and scale-disentangled GANs, and more general scale-enhancement or attention-feedback machinery in continuous scale-space modeling and the 2025 explicit MSPG-SEN formulation [1809.10711][1711.06045][2406.08924].

Another misconception is that multi-scale progression alone resolves instability or realism-fidelity trade-offs. The surveyed papers repeatedly report residual failure modes. In frame interpolation, fast or large motion, layered scenes, occlusions and disocclusions, and texture flicker remain problematic; blending weights help but do not eliminate ghosting or holes, and single-step GAN or perceptual losses do not enforce multi-frame consistency [1711.06045]. In super-resolution, high \(W\) can over-hallucinate textures, the contextual loss can eventually behave like a distortion metric, and the adversarial-plus-VN+SC setup can overfit non-reference metrics [1809.10711]. In BSD-GAN, disentanglement is scale-aware rather than semantic-aware, added layers can still alter earlier weights, and too many branches or overly fast de-freezing can cause leakage across scales [1803.08467]. In pan-sharpening, SE integration is not free: the paper warns that over-aggressive channel reweighting can induce spectral bias, which is especially critical because spectral fidelity is the overriding requirement [2207.14451]. In the continuous scale-space model, occasional faint parallel-line overlays or saturated blobs appear at finest scales, and the method still benefits from coarse scale labels even though it is robust to noisy ones [2406.08924]. In the explicit 2025 MSPG-SEN paper, ambiguous metrics, missing standardized comparisons, and absent reproducibility details constrain interpretation of the reported gains [2508.16089].

The open directions proposed across the literature are relatively coherent. Suggested extensions include conditional or multi-scale discriminators, explicit forward-backward consistency losses for motion fields, explicit occlusion-aware masks, temporal adversarial or cycle-consistency losses for video, spatial attention such as CBAM in conjunction with SE, deformable convolutions in synthesis refinement, curriculum schemes over motion magnitude, and standardized FID/IS/precision-recall reporting when evaluating scale-disentangled GANs [1711.06045][1803.08467]. This suggests that the most stable future definition of MSPG-SEN may be methodological rather than taxonomic: a multi-scale adversarial system in which progression is coupled to an explicit enhancement operator that constrains what each scale should represent.

Source: https://www.emergentmind.com/topics/multi-scale-progressive-generative-adversarial-network-mspg-sen