---
title: 'ModFus-DM: Diffusion-Based Modulation Fusion'
url: https://www.emergentmind.com/topics/modfus-dm
type: topic
---

# ModFus-DM: Diffusion-Based Modulation Fusion

Searching arXiv for the exact topic and closely related papers to ground the article.
ModFus-DM denotes “modulation-driven feature fusion via diffusion model,” an unsupervised automatic modulation classification framework built around a diffusion generative model for I/Q signals. It is designed for automatic modulation classification under limited labels, variable signal lengths, distribution shifts, and fading channels, and it couples a modulated signal diffusion generation model with a diffusion-aware feature fusion module to obtain robust modulation representations [2508.01719]. In the provided literature, the exact title refers to wireless signal classification, while closely related “ModFus-DM style” descriptions also appear in robust dynamic multi-modal state estimation and multimodal image fusion [2105.06018], [2506.15218], [2408.15641].

## 1. Definition, scope, and problem setting

ModFus-DM addresses automatic modulation classification, which aims to identify the modulation format of a received radio signal \(s[n]\) without prior knowledge of the transmitter’s parameters. The baseband model is

\[
s[n] = \alpha \cdot r[n-\tau] \cdot e^{j(2\pi \Delta f n T_s + \phi)} + w[n]
\]

where \(r[n] = \mathcal{M}(x[n])\) is the modulated baseband signal from information sequence \(x[n]\) and modulation map \(\mathcal{M}(\cdot)\), \(\alpha\) is channel fading, \(\tau\) timing offset, \(\Delta f\) carrier frequency offset, \(T_s\) sampling interval, \(\phi\) phase offset, and \(w[n]\) is additive Gaussian noise [2508.01719].

The framework is motivated by four stated limitations of existing deep-learning AMC methods: dependence on large labeled datasets, fixed-length input assumption, vulnerability to distribution shifts, and poor limited-label performance. The provided account also notes that self-supervised and contrastive AMC methods rely on task-specific proxy tasks and augmentations, and that mismatched augmentations can yield suboptimal features. ModFus-DM therefore positions diffusion models as representation learners rather than only as data generators: iterative denoising captures multi-scale temporal structure, the training objective is label-free, robustness is induced by reconstruction from highly corrupted conditions, and the convolutional U-Net structure can naturally handle different sequence lengths [2508.01719].

A common misunderstanding is to treat ModFus-DM as a conventional fully supervised classifier. Its defining property is instead a two-stage procedure: an unlabeled generative pretraining stage followed by a small-label discriminative stage. This separation is central to its reported behavior under limited-label and shifted-distribution conditions [2508.01719].

## 2. Two-stage architecture and learning pipeline

ModFus-DM is a two-stage, generative-then-discriminative framework. Stage 1 performs unsupervised modulation representation learning with the modulated signal diffusion generation model. Stage 2 freezes that backbone and trains a diffusion-aware feature fusion module plus classifier using only a small number \(N\) of labeled signals per modulation and SNR [2508.01719].

The end-to-end pipeline is specified as follows. Complex I/Q sequences \(s[n]\) are formatted as \(2 \times L\) real-valued arrays. During Stage 1, a forward diffusion process progressively perturbs the signal to obtain \(s_t\). A 1D U-Net then takes \((s_t,t)\) and predicts the noise or equivalently reconstructs \(s_0\), and the network is trained with a diffusion noise prediction loss. After training, a small forward step such as \(t=1\) is selected, a slightly noised input \(s_1\) is generated, and intermediate features are collected from U-Net blocks \(b_1,\dots,b_8\). These features are pooled and fused by the diffusion-aware feature fusion module to produce a compact feature vector \(\mathcal{F}_s^D\), which is sent to a linear classifier with softmax [2508.01719].

The training protocol is sequential rather than joint. Stage 1 minimizes the unsupervised diffusion loss on all training samples treated as unlabeled. Stage 2 keeps the diffusion model frozen and minimizes only the classification loss for the fusion module and classifier. The provided description states that there is no joint generative-discriminative loss and that this design avoids overfitting the generative backbone to the small labeled set [2508.01719].

This suggests that the central inductive bias of ModFus-DM lies in preserving a representation space shaped by denoising, rather than adapting the entire model to the supervised objective. A plausible implication is that the method is meant to retain modulation structure learned from unlabeled data even when the labeled subset is extremely small.

## 3. Modulated signal diffusion generation model

The modulated signal diffusion generation model is a diffusion generative model specialized for 1D complex baseband signals. Its forward process is a Markov chain that progressively adds Gaussian noise:

\[
q(s_t \mid s_{t-1}) = \mathcal{N}(\nu_t s_{t-1},\,(1-\nu_t^2) I)
\]

with \(s_0\) the original I/Q signal and \(\nu_t \propto 1/t\) the diffusion coefficient at step \(t\). By composition,

\[
q(s_t \mid s_0) = \mathcal{N}(\mu_t s_0,\, \sigma_t^2 I),
\]

where

\[
\mu_t = \prod_{s=1}^{t} \nu_s,\qquad \sigma_t^2 = 1 - \prod_{s=1}^{t} \nu_s^2,
\]

so that

\[
s_t = \mu_t s_0 + \sigma_t \varepsilon,\quad \varepsilon \sim \mathcal{N}(0, I).
\]

For large \(T\), \(s_T\) approaches isotropic Gaussian noise [2508.01719].

The reverse model is learned through noise prediction. With a network \(\delta_{\theta}(s_t, t)\) that predicts \(\varepsilon\), the clean signal estimate is reconstructed as

\[
\hat{s}_0 = \frac{1}{\prod_{s=1}^{t} \nu_s} \left( s_t - \sqrt{1 - \prod_{s=1}^t \nu_s^2} \, \delta_{\theta}(s_t, t) \right).
\]

The training objective is the standard diffusion noise prediction loss,

\[
\mathcal{L}_M = \mathbb{E}_{s_0, \varepsilon, t} \left[ \left\| \varepsilon - \delta_{\theta}(s_t, t) \right\|^2 \right].
\]

The stated training details are \(T=100\), AdamW, learning rate \(0.0002\), and 2000 epochs [2508.01719].

Architecturally, the backbone is a 1D U-Net with encoder blocks \(b_1,b_2,b_3,b_4\), decoder blocks \(b_5,b_6,b_7,b_8\), skip connections, and time conditioning. Signals are represented as \(2 \times L\) inputs, and the convolutional structure is presented as compatible with variable lengths [2508.01719]. The representation claim made in the source is that denoising forces the model to encode constellation structure, symbol sequences and temporal transitions, and channel distortions and how to invert them. The description further states that early decoder blocks, especially \(b_6\) and \(b_7\), contain the richest discriminative representations [2508.01719].

## 4. Diffusion-aware feature fusion and classification

The diffusion-aware feature fusion module, DAFFus, is the mechanism that converts generative diffusion features into classification features. After the diffusion model is trained and frozen, a small forward step is selected; ablation shows \(t=1\) is best, with accuracy stable for \(t \in [1,7]\) and then dropping as noise dominates [2508.01719].

For each block \(b_i\), the pooled feature is defined as

\[
f_s^{b_i} = \mathcal{AP}\Big(\mathcal{U}_{\theta^*}^{b_i}(s_1)\Big), \quad i=1,\dots,L,
\]

where \(\mathcal{AP}\) pools along the time dimension to length 1. The collection of block features is

\[
\mathcal{F}_s = \{ f_s^{b_i} \mid i=1,\dots,L \}.
\]

DAFFus focuses on decoder blocks \(b_{L/2+1}\dots b_L\), which for \(L=8\) means \(b_5\)–\(b_8\). These are concatenated channel-wise:

\[
\mathcal{F}_s^c = \mathcal{C}\big[ f_s^{b_{L/2+1}}, \dots, f_s^{b_L} \big],
\]

and then compressed through a linear layer with activation:

\[
\mathcal{F}_s^D = \sigma(W \mathcal{F}_s^c + b),
\]

with embedding dimension \(d=128\) [2508.01719].

The classifier is a single-layer softmax model:

\[
p(y=c \mid s) = \frac{\exp\big(W_{\text{cls}}^{c} \mathcal{F}_s^D + b_{\text{cls}}^{c}\big)}{ \sum_{c'=1}^{C} \exp\big(W_{\text{cls}}^{c'} \mathcal{F}_s^D + b_{\text{cls}}^{c'}\big) }.
\]

Stage 2 uses standard cross-entropy,

\[
\mathcal{L}_{\text{cls}} = - y_t \log p(y=y_t \mid s).
\]

The stated optimization details are Adam, cosine annealing from \(0.01\) down to \(0\), 50 epochs, and labeled data counts \(N \in \{2,5,10,20\}\) per class per SNR [2508.01719].

The empirical rationale for DAFFus is explicit. Encoder-only fusion, denoted “Fusion down,” performs poorly due to coarse features. Fusion of all blocks is worse than carefully selected fusion because low-quality features degrade the representation. DAFFus outperforms any single block and the naive fusion schemes; on RML2016.10A with \(t=1\), it beats the best single block \(b_7\) by \(2.4\%\) and “Fusion down” by \(13.36\%\) [2508.01719].

## 5. Datasets, evaluation protocol, and reported performance

The reported experiments use four datasets. RML2016.10A contains \(2 \times 128\) signals, SNR from \(-20\) to \(18\) dB, training 800 samples per SNR per type, test 200 per SNR per type, and 11 modulations. RML2016.10B contains \(2 \times 128\) signals, SNR from \(-20\) to \(18\) dB, training 4800 per SNR per type, test 1200 per SNR per type, and 10 modulations. RML2018.01A contains \(2 \times 1024\) signals, SNR from \(-20\) to \(30\) dB, training 3276 per SNR per type, test 819 per SNR per type, and 24 modulations. RML2022 contains \(2 \times 128\) signals, SNR from \(-20\) to \(20\) dB, training 1600 per SNR per type, test 400 per SNR per type, and 11 modulations [2508.01719].

The evaluation protocol includes supervised baselines MCLDNN, CTDNN, PETCGDNN, GE2E, CCNN, and OSMRNet, and self-/semi-supervised baselines TcssAMR, SemiAMC, SSRCNN, and CPC. Limited-label settings use \(N = 2,5,10,20\) labeled signals per class per SNR, with 10 Monte Carlo splits averaged for each \(N\) [2508.01719].

The headline result is that on the 24-modulation RML2018.01A dataset, with only 10 labeled signals per type at SNR \(\ge 12\) dB, ModFus-DM achieves \(88.27\%\) accuracy. The provided comparison at 12 dB further reports the following. On RML2016.10A, CTDNN trained with all labels reaches \(92.09\%\), ModFus-DM with \(N=10\) reaches \(89.34\%\), ModFus-DM with \(N=20\) reaches \(91.08\%\), and ModFus-DM with all labels reaches \(96.05\%\). On RML2016.10B, PETCGDNN trained with all labels reaches \(91.68\%\), CTDNN reaches \(93.44\%\), ModFus-DM with \(N=20\) reaches \(87.44\%\) while using only \(0.42\%\) labels, and ModFus-DM with all labels reaches \(93.75\%\). On RML2018.01A, ModFus-DM with \(N=10\) reaches \(88.27\%\), with \(N=20\) reaches \(92.07\%\), and with all labels reaches \(95.84\%\). On RML2022, CTDNN trained with all labels reaches \(96.64\%\), ModFus-DM with \(N=20\) reaches \(97.09\%\), and ModFus-DM with all labels reaches \(99.00\%\) [2508.01719].

Against self-/semi-supervised baselines, the stated gains are large in very low-label settings. At \(N=2\), 8 dB, ModFus-DM beats second-best SSRCNN by \(33.16\%\) on RML2016.10A, \(49.60\%\) on RML2016.10B, and \(38.93\%\) on RML2022. At \(N=10\) and SNR \(\ge 8\) dB, accuracy is at least \(88.14\%\) on RML2016.10A, at least \(84.48\%\) on RML2016.10B, and at least \(90.57\%\) on RML2022 [2508.01719].

These figures support the narrower claim made in the source: with very small labeled subsets, ModFus-DM is competitive with or superior to fully supervised networks trained on all labels, and with full labels it outperforms the listed baselines [2508.01719].

## 6. Robustness to distribution shift, variable length, and channel fading

Distribution-shift evaluation includes cross-dataset transfer between RML2016.10A and RML2016.10B. For SNR \(> 0\) dB and \(N=10\), the reported average accuracy is \(>84.67\%\) for A2B and \(>86.81\%\) for B2A, whereas the competing self-/semi-supervised methods TcssAMR, SemiAMC, SSRCNN, and CPC remain below approximately \(55\%\) in the same settings [2508.01719]. The provided interpretation is that diffusion-based denoising encourages modeling intrinsic signal structure rather than dataset-specific artifacts or augmentations.

Variable-length recognition is examined in two ways. In the same-dataset experiment on RML2018.01A, the diffusion model is trained on length 1024 and tested on cropped signals of lengths 64–1024 at SNR \(=24\) dB. With \(N=10\), the reported accuracies are \(45.83\%\) for 64 samples, \(83.90\%\) for 256, \(90.10\%\) for 512, \(91.09\%\) for 768, and \(90.69\%\) for 1024 [2508.01719]. In cross-length and cross-dataset settings, long-to-short transfer at \(N=10\), 10 dB, yields \(71.49\%\) and \(69.51\%\), and short-to-long transfer reaches about \(60\)–\(61\%\) at 24 dB when training on short signals and testing on long RML2018.01A sequences [2508.01719].

Fading robustness is evaluated on RML2022. Under Rayleigh fading with variance \(\sigma^2 \in [0.6,1.2]\), and 10 labeled examples per class, accuracy is within \(1\)–\(2\%\) of the ideal no-fading case at \(\sigma^2=0.6\), and remains above \(73\%\) even at \(\sigma^2=1.2\). Under Rician fading with \(K \in [2,18]\), and \(N=5\), accuracy is above \(81.58\%\) across all \(K\) [2508.01719].

The source also reports that a moderate diffusion horizon gives the best trade-off between representation richness and computational cost. In the ablation on total diffusion steps \(T\), mean accuracy on RML2016.10A with \(N=10\) rises from \(80.04\%\) at \(T=10\) to \(83.57\%\) at \(T=50\), \(87.37\%\) at \(T=70\), and \(89.29\%\) at \(T=100\), then saturates or slightly fluctuates at \(T \ge 150\) [2508.01719].

## 7. Limitations, nomenclature, and related “ModFus-DM style” uses

The stated limitations of ModFus-DM are fivefold. First, it only uses raw complex baseband signals; other informative views such as spectrograms, wavelet scalograms, or constellation diagrams are not exploited. Second, diffusion-model training is computationally expensive because it uses a U-Net, \(T=100\), and 2000 epochs. Third, performance at deep negative SNRs remains challenging. Fourth, the experimental channel models are AWGN, Rayleigh, and Rician fading, while more complex real-world channels may require extended modeling. Fifth, the method focuses on modulation types rather than protocol recognition, symbol-level demodulation, or joint channel estimation and decoding [2508.01719].

The name itself also requires careful handling. In the provided material, the exact title “ModFus-DM” refers to the AMC framework above [2508.01719]. However, related descriptions in other domains frame different methods as “ModFus-DM style” systems. In robust dynamic multi-modal state estimation, a DMA-based particle filter for unexpected modality failures introduces binary modality “usefulness,” enumerates \(2^n\) model hypotheses, and performs Bayesian model averaging over sensor-availability configurations [2105.06018]. In multimodal medical image fusion, DM-FNet is described as a diffusion-model-based unified framework that uses a diffusion-trained UNet encoder–decoder, multi-timestep noisy inputs, attention-guided multimodal feature fusion, multiscale feature fusion, and a hybrid loss for MRI–CT, MRI–PET, and MRI–SPECT fusion [2506.15218]. In lightweight multi-modality image fusion, MMDRFuse is presented as a distilled mini-model with dynamic refresh, featuring a two-convolution student with 113 trainable parameters, digestible distillation, a comprehensive loss, and a history-based refresh strategy [2408.15641].

A plausible implication is that “ModFus-DM” has become a suggestive label for methods that combine modulation or modality-aware fusion with diffusion or dynamic mechanisms, but the exact arXiv title designates the unsupervised AMC system introduced for modulation representation learning [2508.01719].

Source: https://www.emergentmind.com/topics/modfus-dm