---
title: Variational Soft Symbol Detection (VSSD)
url: https://www.emergentmind.com/topics/variational-soft-symbol-detection-vssd
type: topic
---

# Variational Soft Symbol Detection (VSSD)

Variational Soft Symbol Detection (VSSD) denotes a class of variational-inference-based soft detectors for linear Gaussian communication channels in which exact a posteriori probability (APP) detection is replaced by optimization over a tractable approximate posterior. In the foundational variational framework for soft-in-soft-out detection in interference channels, the method is developed for multiple-access interference (MAI), inter-symbol interference (ISI), and multiple-input multiple-output (MIMO) channels, with a concrete emphasis on turbo multiuser detection [0809.0032]. Later work uses the same variational logic under the explicit VSSD label for affine frequency division multiplexing (AFDM) and for delay-scale-spread underwater acoustic channels, where it produces soft symbol probabilities and bit-level log-likelihood ratios (LLRs) with low-complexity iterative updates [2507.03858] [2508.21373].

## 1. Channel models and detection objective

The canonical VSSD setting is a linear observation model in which an observed vector is generated by a channel matrix, a symbol vector, and additive Gaussian noise. In the 2008 formulation, the received real vector satisfies
$$
r = S A b + n,
$$
where $S$ is an $N\times K$ known channel or spreading matrix, $A=\mathrm{diag}(A_1,\dots,A_K)$ is a diagonal amplitude matrix, $b\in\mathcal X^K$ is the transmitted symbol vector, and $n\sim \mathcal N(0,\sigma_n^2 I)$ [0809.0032]. After matched filtering or Cholesky-whitening, the same model is written in compact form as
$$
y = H b + w,\qquad w\sim \mathcal N(0,\sigma_n^2 I).
$$
The stated channel interpretations include chip-space signatures in CDMA, convolutional/ISI mixing, and MIMO mixing matrices [0809.0032].

In coded systems, the symbol prior $p(b)$ is supplied by decoder-side information, typically factorized across bit levels via LLRs. The detector’s target is the set of soft marginals $p(b_k\mid r)$, but exact APP evaluation is exponentially complex in the number of users or symbols $K$ [0809.0032]. VSSD addresses precisely this complexity bottleneck: it preserves soft-input/soft-output operation while avoiding exhaustive marginalization.

Later VSSD formulations retain the same structural objective in complex-valued models. For AFDM, the effective demodulated model is
$$
y = \bar H x + n,\qquad n\sim \mathcal{CN}(0,N_0 I),
$$
with $x$ drawn from a $K$-ary QAM alphabet under a factorized uniform prior [2507.03858]. In delay-scale-spread channels, the receiver operates on
$$
y = Hx + w,\qquad w\sim \mathcal{CN}(0,\sigma^2 I_N),
$$
with $x\in\mathcal Q^N$ and i.i.d. discrete-uniform symbol priors [2508.21373]. Across these settings, the common problem is approximate marginal inference for discrete symbols in a dense linear Gaussian observation model.

## 2. Variational free energy, KL minimization, and ELBO formulations

The foundational variational construction introduces a tractable approximate posterior $Q(b)$ and selects it by minimizing the Kullback–Leibler divergence to the true posterior,
$$
D[Q(b)\,\|\,p(b\mid r)] = \int Q(b)\log\frac{Q(b)}{p(b\mid r)}\,db.
$$
Equivalently, one minimizes the variational free energy
$$
F[Q] = \int Q(b)\log Q(b)\,db - \int Q(b)\log p(b,r)\,db,
$$
or, using $p(b\mid r)\propto p(r\mid b)p(b)$,
$$
F[Q] = E_Q[\log Q(b)] - E_Q[\log p(r\mid b)p(b)].
$$
Up to an additive constant, this free energy is the KL divergence to the exact posterior, so restricting $Q$ to a simpler family converts APP detection into a tractable optimization problem [0809.0032].

The later AFDM and delay-scale-spread formulations write the same idea in evidence-lower-bound language. In AFDM, the detector minimizes $KL[q\|p]$ or, equivalently, maximizes
$$
\mathcal L(q)=E_q[\log p(y\mid x)] + E_q[\log p(x)] - E_q[\log q(x)],
$$
under a mean-field factorization $q(x)=\prod_{n=1}^N q_n(x_n)$ [2507.03858]. The DS-spread formulation likewise adopts a fully factorized approximate posterior
$$
q(x)=\prod_{i=1}^N q_i(x_i)
$$
and maximizes
$$
L(q)=E_q[\ln p(y,x)]-\sum_i E_{q_i}[\ln q_i(x_i)].
$$
Because the symbol prior is uniform in that setting, only the likelihood term affects the per-symbol coordinate update [2508.21373].

This common variational structure is central to the identity of VSSD. Exact Bayesian detection is replaced not by an ad hoc linearization alone, but by optimization of a surrogate objective—variational free energy or ELBO—whose stationary points define approximate soft posteriors. The 2008 framework explicitly states that this viewpoint provides unified and rigorous justifications for detectors proposed on radically different grounds and facilitates convenient joint detection and decoding when error-control codes are incorporated [0809.0032].

## 3. Principal detector families and update mechanisms

Within the original framework, two principal approximating families are emphasized: Gaussian VSSD and discrete mean-field VSSD. A DDF-aided discrete variant modifies initialization in the first iteration. Their essential structure is summarized below [0809.0032].

| Variant | Approximate posterior | Stated per-iteration cost |
|---|---|---|
| Gaussian VSSD | $Q(b)=\mathcal N(b;\mu,\Sigma)$ | One $K\times K$ solve, $O(K^3)$, or iterative $O(K^2)$ with structure |
| Discrete VSSD | $Q(b)=\prod_{k=1}^K Q_k(b_k)$ with binary means $m_k$ | $O(K^2)$ per flooding sweep |
| DDF-aided discrete VSSD | First iteration uses triangularized channel filter $F_k$ | DDF initialization adds $O(K^2)$ |

For Gaussian VSSD, the prior and likelihood are approximated as Gaussian:
$$
p(b)=\mathcal N(b;0,W),\qquad p(r\mid b)=\mathcal N(r;SAb,\sigma_n^2 I),\qquad Q(b)=\mathcal N(b;\mu,\Sigma).
$$
Minimizing the free energy yields closed-form updates
$$
\mu = (A S^T S A + \sigma_n^2 W^{-1})^{-1}(A S^T r + \sigma_n^2 W^{-1} b_{\text{prior}})
$$
and
$$
\Sigma = (A S^T S A/\sigma_n^2 + W^{-1}/\sigma_n^2)^{-1}.
$$
Here $b_{\text{prior}}$ is the prior mean vector and $W=\mathrm{diag}(\mathrm{var}[b_k])$ comes from the decoder. The detector then forms an output LLR from the Gaussian marginal $Q(b_k)=\mathcal N(\mu_k,[\Sigma]_{kk})$ via
$$
LLR_{\text{out}}(k)=\tfrac12\log\frac{Q(b_k=+1)}{Q(b_k=-1)}.
$$
The framework states that this implementation requires one $K\times K$ linear solve per iteration, for example via Cholesky [0809.0032].

For discrete VSSD, the approximate posterior is factorized into independent binary marginals
$$
Q(b)=\prod_{k=1}^K Q_k(b_k),\qquad Q_k(b_k=+1)=\tfrac12(1+m_k),\qquad m_k\in[-1,+1].
$$
Substituting this family into the free energy and minimizing by coordinate descent yields mean-field updates. The stated recursion updates the posterior mean through
$$
m_k \leftarrow \tanh\!\left[\tfrac12\,LLR_{\text{pos}}(k)\right],
$$
with $LLR_{\text{pos}}(k)$ formed from the prior LLR and interference-cancellation terms involving the channel column $n_k$ and the off-diagonal correlation matrix $R=S^T S-\mathrm{diag}(S^T S)$ [0809.0032]. Under a flooding schedule, all $K$ users are updated in parallel from the previous sweep; under sequential scheduling, the updates are applied one at a time in an SIC-style manner with immediate interference cancellation.

The DDF-aided discrete variant modifies only the first pass: it replaces $R$ by a triangularized channel filter $F_k$ to mimic DDF cancellation and obtain a better initialization, after which ordinary flooding or sequential discrete VSSD resumes [0809.0032]. The same source states that this variational framework unifies known SISO detectors—including decorrelator, MMSE, SIC, Wang–Poor, and DDF—as special cases of variational free-energy minimization.

## 4. Turbo processing, parameter estimation, and extension beyond BPSK

VSSD is explicitly formulated as a soft-in/soft-out block and is therefore naturally embedded in a turbo loop. In the multiuser setting, each outer iteration consists of a detection step and a decoding step. The detector uses current prior means and variances from the decoder to run one or more VSSD sweeps and outputs extrinsic LLRs $LLR_{\mathrm{mud}}(b_k)$. These are passed to APP decoders such as BCJR, turbo, or LDPC decoders, which return updated extrinsic LLRs $LLR_{\mathrm{dec}}(b_k)$. The next VSSD pass then uses
$$
LLR_{\text{prior}}(b_k)=LLR_{\mathrm{dec}}(b_k),
$$
with prior means updated, for example, by $b_{\text{prior}}=\tanh(LLR_{\mathrm{dec}}/2)$ [0809.0032].

The framework identifies three scheduling regimes for turbo VSSD. In flooding, all users are detected in parallel and then decoded in parallel. In sequential scheduling, users are detected and decoded one by one in SIC fashion. In a hybrid schedule, the detector runs sequentially across users while storing extrinsics, and the decoders then operate in parallel [0809.0032]. These are not separate inference principles; they are operational arrangements for exchanging soft information between variational detection and channel decoding.

A second extension concerns uncertain channel parameters. When amplitudes $A$ or noise variance $\sigma_n^2$ are not accurately known, the detector wraps a parameter update around variational data detection through variational EM. The joint objective is
$$
F[Q,\theta]=E_Q[\log Q(b)]-E_Q[\log p(r,b\mid \theta)]-\log p(\theta),
$$
with $\theta=\{A,\sigma_n^2\}$. The E-step fixes $\theta^{(j-1)}$ and minimizes the free energy with respect to $Q(b)$ by running VSSD. The M-step fixes $Q^{(j)}$ and minimizes with respect to the parameters, including the stated update
$$
\sigma_n^{2\,(j)} = \frac{1}{NT}E_{Q^{(j)}}[\|r-SA^{(j)}b\|^2].
$$
The source further notes that closed-form updates exist when $p(b,r\mid\theta)$ is Gaussian and $p(\theta)$ is conjugate Gaussian/Gamma [0809.0032].

The same paper also extends BPSK-based SISO detection schemes to arbitrary square QAM constellations. Each symbol $b_k$ is represented in $m$ bits with Gray mapping; the variational approximation is then factorized across bit levels,
$$
Q(b_{1,1},\dots,b_{K,m})=\prod_{k,\ell} Q_{k,\ell}(b_{k,\ell}).
$$
By writing the QAM symbol as a weighted sum of its bit indicators and re-deriving mean-field updates on bit LLRs, the method yields “bit-level equalization and soft detection” (BLESD), with stated complexity $O(K^2 m)$ per iteration [0809.0032]. This directly addresses a common misconception that the original variational framework is restricted to BPSK or real-valued detection; the source explicitly states a rigorous extension to arbitrary square QAM.

## 5. Complexity, convergence properties, and performance characterizations

The complexity statements attached to VSSD are variant-specific rather than uniform. In the original framework, Gaussian VSSD requires one $K\times K$ matrix solve per iteration, giving $O(K^3)$ complexity, or $O(K^2)$ with conjugate-gradient and structured $S^T S$. Discrete VSSD requires $O(K^2)$ per full flooding sweep, since each user update is $O(K)$. DDF initialization adds $O(K^2)$ for triangular-filter multiplications, and the EM extension adds $O(K^2)$ per outer iteration for parameter updates [0809.0032].

Convergence guarantees are likewise differentiated. The 2008 formulation states that the free energy is non-increasing under each coordinate or variational update. For Gaussian VSSD, the free energy is convex in $(\mu,\Sigma)$, so there is a unique global minimizer. For discrete mean-field VSSD, the free energy $F(m)$ is nonconvex; the source therefore describes convergence to a good local minimum as the typical outcome, and notes that SIC-style scheduling or DDF-aided initialization plus multiple sweeps usually improves the result. It further states that linear convergence can be shown under mild conditions [0809.0032]. This is an important clarification: VSSD is a controlled approximation to APP detection, not an exact replacement.

The original performance examples emphasize turbo multiuser detection. In a 4-user CDMA system with cross-correlation $0.7$, turbo VSSD with Gaussian flooding is reported to reach the near-single-user bound in 4–5 iterations and to outperform hybrid Wang–Poor and decorrelator-based SISO methods. Discrete VSSD with DDF-aided initialization is reported to match Gaussian VSSD up to moderate loads while using lower complexity. Under imperfect knowledge of channel amplitude or noise variance, the EM-extended versions are stated to recover most of the lost SNR within 3–6 EM iterations [0809.0032].

The later AFDM formulation expresses analogous convergence in ELBO language: its closed-form coordinate updates guarantee monotonic increase of the ELBO and convergence to a local optimum. In the stated QPSK, $N=256$ experiments under $P=3$ and $P=5$ multipaths, five VB iterations produce a waterfall at lower SNR and achieve more than $1\,\mathrm{dB}$ gain over MPA, while the residual
$$
\mathrm{res}_{(t)}=\max_{n,k}\left|\pi_n^{k\,(t)}-\pi_n^{k\,(t-1)}\right|
$$
typically falls below $10^{-3}$ within 3–4 iterations even for $P=5$ [2507.03858]. These results reinforce the original point that variational optimization trades exact posterior computation for a monotone surrogate objective with practical iteration counts.

## 6. Later VSSD formulations and related variational detection lines

The 2025 AFDM detector presents VSSD in a fully discrete complex form. Under the mean-field law
$$
q(x)=\prod_{n=1}^N q_n(x_n),
$$
each factor is a categorical distribution over the QAM alphabet with probabilities $\pi_n=[\pi_n^1,\dots,\pi_n^K]$, posterior mean $\hat x_n=\sum_k \pi_n^k a_k$, and variance $\hat v_n=\sum_k \pi_n^k|a_k-\hat x_n|^2$ [2507.03858]. The coordinate ascent updates define, for each symbol, a residual
$$
\mu_n = y - \sum_{j\neq n}\bar H(:,j)\hat x_j,
$$
an effective variance
$$
v_n = N_0 + \sum_{j\neq n}\|\bar H(:,j)\|^2 \hat v_j,
$$
and a scalar equivalent model
$$
z_n = \frac{\bar H(:,n)^H\mu_n}{\|\bar H(:,n)\|^2},\qquad
\sigma_n^2 = \frac{v_n}{\|\bar H(:,n)\|^2},
$$
followed by the soft-max update
$$
\pi_n^k \propto \exp\!\left[-\frac{|z_n-a_k|^2}{\sigma_n^2}\right].
$$
Bit-wise LLRs are then formed by summing posterior symbol probabilities over the subsets of constellation points whose labeled bit equals 1 or 0. The stated complexity is $O(T\cdot Q\cdot N\cdot P)$, contrasted in the paper with $O(T\cdot Q\cdot N\cdot P^2)$ for MPA [2507.03858]. In the reported experiments, VSSD outperforms ZF, LMMSE, and MPA across all SNRs, converges faster than MPA, and degrades only mildly as the number of multipath components increases.

The delay-scale-spread channel work of the same year places VSSD inside a broader receiver chain that also includes variational off-grid channel estimation and iterative channel-estimation/data-detection (ICED). Its detector uses the sufficient statistics
$$
A=H^H H,\qquad b=H^H y,
$$
forms for each symbol the interference-canceled residual
$$
r_i^{(j)} = b_i - \sum_{k\neq i} A_{ik} m_k^{(j)},
$$
and updates the factor $q_i$ over each constellation point $z\in\mathcal Q$ through
$$
g_i^{(j+1)}(z) = -\frac{1}{\sigma^2}\left[A_{ii}|z|^2 - 2\,\mathrm{Re}\{r_i^{(j)} z^*\}\right],
$$
followed by soft-max normalization [2508.21373]. The per-iteration cost is stated as approximately $O(N^2+NQ)$ after precomputing $A$ and $b$, in contrast with an $O(N^3)$ MMSE matrix inversion. Performance statements are waveform-dependent: replacing a 1-tap equalizer with VSSD yields a 4–5 dB gain at BER $=10^{-2}$ for all waveforms, collapses the performance gap between OTFS, OCDM, and ODSS, and leaves all three outperforming OFDM by approximately 11 dB at BER $=10^{-3}$. With coded transmission under estimated CSI, VSSD LLRs provide a further approximately 5.4 dB gain at BER $=10^{-2}$, after which all four waveforms become essentially indistinguishable in BER; ICED adds an approximately 3 dB improvement in channel NMSE and an approximately 3 dB BER gain relative to pilot-only estimation [2508.21373]. A plausible implication is that, in this regime, receiver inference quality can dominate nominal waveform differences.

A related but distinct line of work in MIMO detection develops an inverse-free variational Bayesian framework and unfolds it into a deep architecture called VBINet. That model approximates the posterior by $q(x)q(\epsilon)$, maximizes a relaxed ELBO based on a quadratic bound with diagonal $T\succeq H^T H$, and alternates closed-form updates for the symbol distribution and the noise precision before unrolling the iteration into trainable layers [2109.12275]. The resulting network outputs posterior means and variances that can be converted into bit-level LLRs, and it is reported to remain robust under noise-variance uncertainty because the $\epsilon$ update is built into the model [2109.12275]. This suggests a methodological extension of the VSSD viewpoint: variational soft detection need not terminate at hand-designed iterative receivers, but can also serve as the template for model-driven unrolled networks.

Across these strands, VSSD is best understood not as a single detector formula but as a variational design paradigm for soft symbol inference in linear channels. The defining elements are the replacement of exact APP detection by KL/ELBO optimization, the use of tractable factorized or Gaussian approximate posteriors, monotone coordinate or variational updates, and the production of soft outputs suitable for iterative decoding [0809.0032] [2507.03858] [2508.21373].

Source: https://www.emergentmind.com/topics/variational-soft-symbol-detection-vssd