---
title: 'HANA-JSCC: Robust MIMO Semantic Transmission'
url: https://www.emergentmind.com/topics/hana-jscc
type: topic
---

# HANA-JSCC: Robust MIMO Semantic Transmission

Searching arXiv for the HANA-JSCC paper and closely related semantic communication context.
HANA-JSCC is a semantic image transmission system with channel matrix and channel noise adaptation for multiple-input-multiple-output semantic communication under imperfect channel state information (CSI). It was introduced to address the impracticality of assuming perfect channel matrix estimation in channel-adaptive joint source-channel coding, particularly under hardware and pilot overhead constraints. The method combines a Swin-Transformer-based semantic encoder and decoder, a split channel codec, a Transformer-based channel matrix adaptor, and a two-stage training procedure with knowledge distillation. In the reported evaluations, it improves average image reconstruction quality over state-of-the-art benchmarks across multiple noise and estimation-error settings, with gains of approximately \(0.40\sim0.54\) dB in average PSNR depending on dataset and condition [2509.04005].

## 1. Problem setting and formal model

HANA-JSCC is situated in semantic communication for image transmission over MIMO channels. The motivating problem is that existing MIMO semantic communication systems assume perfect channel matrix estimation for channel-adaptive joint source-channel coding, whereas the target deployment regime involves imperfect CSI at both transmitter and receiver. The system therefore treats channel estimation error as a first-class design variable rather than as a negligible perturbation [2509.04005].

The channel model is a flat Rayleigh fading MIMO channel with imperfect CSI. The true channel matrix is
$$
H_p \in \mathbb{C}^{n_{rx}\times n_{tx}},
$$
and the estimated channel available at both ends is
$$
H_{est} = H_p + H_e,\quad H_e\sim\mathcal{CN}(0,\sigma_e^2).
$$
After precoding, the transmitted symbols satisfy
$$
y = H_p\,V_{est}\,z_C + N \in\mathbb{C}^{n_{rx}\times d},
$$
with
$$
N\sim\mathcal{CN}(0,\sigma_n^2 I).
$$
Receiver-side post-processing with the estimated left singular vectors yields
$$
\tilde z_C = U_{est}^H\,y
= U_{est}^H H_p V_{est} z_C + U_{est}^H N.
$$

This formulation makes the mismatch between \(H_{est}\) and \(H_p\) central to the decoding problem. A plausible implication is that any end-to-end architecture designed only for perfect CSI will be structurally vulnerable to misalignment introduced by estimation noise, even if its source and channel representations are otherwise strong.

## 2. End-to-end architecture

The architecture is organized as a transmitter, a MIMO channel, and a receiver, with explicit CSI-conditioned processing inserted into the latent channel-coding path [2509.04005].

At the transmitter, an input image \(x\) is first mapped by a semantic encoder \(E_S(\cdot\mid\phi_S)\), described as a Swin-Transformer-based network, into a lower-dimensional semantic feature map
$$
z_S \in \mathbb{R}^{c'\times h'\times w'}.
$$
The encoder also takes the scalar channel SNR \(r\) as side input through a small MLP denoted Channel-ModNet. The channel codec is split into two MLP sub-codecs:

- \(E_{C,1}(z_S\mid \phi_{C,1}): \mathbb{R}^{c'\times h'\times w'} \to \mathbb{R}^{n_{tx}\times d'}\)
- \(E_{C,2}(z_{C,2}\mid \phi_{C,2}): \mathbb{R}^{n_{tx}\times d'} \to \mathbb{C}^{n_{tx}\times d}\)

A non-trainable power-normalization layer follows \(E_{C,2}\). Between these two sub-codecs sits the channel matrix adaptor \(E_{CMA}\), which refines the latent representation using \(H_{est}\). The resulting complex symbols are then precoded by \(V_{est}\), obtained from the singular value decomposition of the estimated channel matrix.

The receiver mirrors this logic. Post-processing with \(U_{est}^H\) produces \(\hat z_C\), which is passed through a three-part channel decoder:
- \(D_{C,1}(\hat z_C\mid\theta_{C,1}): \mathbb{C}^{n_{rx}\times d} \to \mathbb{R}^{n_{rx}\times d'}\)
- \(D_{CMA}(\hat z_{C,1},H_{est}\mid\theta_{CMA}): \mathbb{R}^{n_{rx}\times d'} \to \mathbb{R}^{n_{rx}\times d'}\)
- \(D_{C,2}(\hat z_{C,2}\mid\theta_{C,2}): \mathbb{R}^{n_{rx}\times d'} \to \mathbb{R}^{c'\times h'\times w'}\)

A semantic decoder \(D_S(\cdot\mid\theta_S)\), also with SNR attention, reconstructs the image \(\hat x\).

The corresponding end-to-end equations are
$$
z_S = E_S(x,r\mid\phi_S),\qquad
z_{C,1} = E_{C,1}(z_S\mid\phi_{C,1}),
$$
$$
z_{C,2} = E_{CMA}(z_{C,1},H_{est}\mid\phi_{CMA}),\qquad
z_C = E_{C,2}(z_{C,2}\mid\phi_{C,2}),
$$
$$
z = V_{est} z_C,
$$
and, at the receiver,
$$
\hat z_C = U_{est}^H y,\qquad
\hat z_{C,1}=D_{C,1}(\hat z_C\mid\theta_{C,1}),
$$
$$
\hat z_{C,2}=D_{CMA}(\hat z_{C,1},H_{est}\mid\theta_{CMA}),\qquad
\hat z_S=D_{C,2}(\hat z_{C,2}\mid\theta_{C,2}),
$$
$$
\hat x = D_S(\hat z_S,r\mid\theta_S).
$$

## 3. Channel matrix adaptor

The distinguishing architectural element is the channel matrix adaptor, inserted symmetrically in the transmitter and receiver latent pipelines. Its role is to collaborate with the channel codec to adapt to misaligned channel state information, thereby mitigating the impact of estimation errors [2509.04005].

The adaptor takes two inputs: a latent token sequence
$$
Z=(z_{C,1}^1,\ldots,z_{C,1}^{n_{tx}})\in\mathbb{R}^{n_{tx}\times d'}
$$
and the estimated channel matrix
$$
H_{est}\in\mathbb{C}^{n_{rx}\times n_{tx}}.
$$
The estimated CSI is projected by a small fully connected layer into a real CSI token
$$
c\in\mathbb{R}^{1\times d'}.
$$
This token is concatenated with the latent sequence,
$$
T=[c;Z]\in\mathbb{R}^{(n_{tx}+1)\times d'},
$$
and processed by \(N\) Transformer blocks, with \(N=6\) in the reported configuration. Each block contains multi-head self-attention with \(h\) heads of size \(d'/h\), followed by an MLP with hidden size \(4d'\), GeLU activation, residual connections, and layer normalization. The first token is discarded at the output, leaving \(n_{tx}\) refined tokens \(Z'\in\mathbb{R}^{n_{tx}\times d'}\), identified as \(z_{C,2}\).

The adaptor transformations are written as
$$
z_{C,2}=E_{CMA}(z_{C,1},H_{est}\mid \phi_{CMA})
\equiv f_{adaptor}(z_{C,1},H_{est}),
$$
and
$$
\hat z_{C,2}=D_{CMA}(\hat z_{C,1},H_{est}\mid \theta_{CMA})
\equiv g_{adaptor}(\hat z_{C,1},H_{est}).
$$

The paper attributes the need for this design to an ill-posed one-to-many relation between estimated and true channel matrices. By explicitly embedding the estimated CSI into a learnable token and using self-attention over CSI and semantic tokens, the adaptor is described as learning a many-to-one mapping that aligns the latent representation with the actual channel realization. It does not attempt to recover a unique true channel from \(H_{est}\); rather, it adjusts feature tokens conditioned on the observed estimate. This directly addresses a common misconception that robustness to imperfect CSI must come from explicit channel reconstruction alone.

## 4. Two-stage training and knowledge distillation

HANA-JSCC uses a two-stage training strategy designed to overcome convergence difficulties caused by the ill-posed problem. The first stage performs imperfect-CSI fine-tuning, and the second stage introduces knowledge distillation from a perfect-CSI teacher to an imperfect-CSI student [2509.04005].

In Stage I, the entire network is initialized from a SwinJSCC model pretrained under imperfect CSI. The semantic encoder and decoder parameters \(\{\phi_S,\theta_S\}\) are frozen, while the channel codec and adaptor parameters
\(\{\phi_{C,1},\phi_{CMA},\phi_{C,2},\theta_{C,1},\theta_{CMA},\theta_{C,2}\}\)
are trained. The loss is the image-domain \(L_1\) objective
$$
\mathcal{L}_{S_1} = \lVert \hat x - x\rVert_1,
$$
with \(\sigma_e^2\) sampled uniformly from \([\sigma_{e,\min}^2,\sigma_{e,\max}^2]\) in each batch.

In Stage II, the teacher is a copy of the same architecture trained under perfect-CSI conditions in Stage I, with all weights frozen. The student is the Stage-I imperfect-CSI model, now fully unfrozen. Distillation is applied through KL-divergence at two internal levels: the post-adaptor channel token \(z_{C,2}\) and the recovered semantic feature \(\hat z_S\). The Stage-II loss is
$$
\mathcal{L}_{S_2}
=
\lVert \hat x_{St} - x\rVert_1
+
\beta\Big[
D_{\mathrm{KL}}(z_{C,2}^{Tc}\|z_{C,2}^{St})
+
D_{\mathrm{KL}}(\hat z_S^{Tc}\|\hat z_S^{St})
\Big],
\quad \beta>0.
$$
The reported training setup typically sets \(\beta=1\), doubles the batch size, and uses Adam with learning rate \(10^{-3}\) and cosine decay.

This training strategy is technically notable because distillation is imposed on intermediate latent variables as well as the final reconstruction objective. This suggests that the method treats imperfect-CSI robustness as a representation-alignment problem, not solely as an output-level denoising problem.

## 5. Experimental configuration and reported results

The reported evaluation uses two datasets and a fixed large-array MIMO configuration. CIFAR-10 is used with \(50\)k training images and \(10\)k test images of size \(3\times 32\times 32\), at compression ratio \(1/12\). Kodak24 is evaluated on \(24\) high-resolution images of size \(3\times 512\times 768\) or \(3\times 768\times 512\), at compression ratio \(1/48\), with training on \(48\)k ImageNet crops. The MIMO setting is \(n_{tx}=n_{rx}=16\). Channel noise SNR is sampled from \(\{-6,-3,0,3,\ldots,18\}\) dB, and the estimation error variance is uniformly distributed in \([0.01,0.1]\) [2509.04005].

The benchmarks are DeepJSCC, DeepJSCC-V, DeepJSCC-MIMO, SwinJSCC, and SwinJSCC-w/o-SA. All are pretrained with perfect CSI and then fine-tuned on \(H_{est}\).

| Dataset / metric | Method | Reported result |
|---|---|---|
| CIFAR-10 average over all SNR and \(\sigma_e\) | DeepJSCC-MIMO | 28.14 dB |
| CIFAR-10 average over all SNR and \(\sigma_e\) | SwinJSCC | 28.09 dB |
| CIFAR-10 average over all SNR and \(\sigma_e\) | HANA-JSCC | 28.54 dB |
| Kodak24 average | SwinJSCC | 30.20 dB |
| Kodak24 average | HANA-JSCC w/o KD | 30.62 dB |
| Kodak24 average | HANA-JSCC w/ KD | 30.74 dB |

On CIFAR-10, the gain is reported as approximately \(+0.40\) to \(+0.45\) dB over the best listed baselines. On Kodak24, the adaptor contributes \(+0.42\) dB relative to SwinJSCC, and knowledge distillation contributes a further \(+0.12\) dB. The broader summary given for the method is that HANA-JSCC achieves \(0.40\sim0.54\) dB higher average performance across various noise and estimation error levels in various datasets.

The reported discussion further states that, across the full SNR range and \(\sigma_e\) span, HANA-JSCC consistently outperforms all baselines by approximately \(0.4\)–\(0.5\) dB PSNR on CIFAR-10 and approximately \(0.5\) dB on Kodak24. It also states that the Transformer-based adaptor absorbs channel estimation errors and restores the channel decomposition into approximately parallel sub-channels even under misaligned CSI.

## 6. Interpretation, scope, and relation to neighboring approaches

Within the reported design space, HANA-JSCC combines three elements: a two-step channel codec with an in-the-loop CSI adaptor, a lightweight Transformer design for feature refinement, and two-stage training with KL-based knowledge distillation [2509.04005]. The system therefore differs from benchmarked approaches not by replacing semantic image coding altogether, but by inserting an explicit CSI-conditioned latent adaptation mechanism and pairing it with a teacher-student training scheme.

Its scope is specifically semantic image transmission over large MIMO arrays with imperfect CSI. The paper does not claim generality beyond the reported flat Rayleigh fading MIMO setting, the specified dataset configurations, and the \(n_{tx}=n_{rx}=16\) experiments. A plausible implication is that the method should be understood as a robustification of MIMO semantic communication under channel-estimation mismatch, rather than as a universal solution for arbitrary channel models or modalities.

An important conceptual point is that the method does not remove the use of SVD-based precoding and post-processing. Instead, it augments that pipeline so that latent variables can adapt when the estimated decomposition is misaligned with the true channel. Likewise, the knowledge distillation stage does not substitute for imperfect-CSI training; it is added after Stage-I fine-tuning and is reported to be especially beneficial in high-SNR and low-error regimes.

In summary, HANA-JSCC is a MIMO semantic image transmission framework that operationalizes robustness to imperfect CSI through CSI-tokenized latent refinement and dual-level knowledge distillation. In the reported experiments, this combination yields consistently higher PSNR than the listed state-of-the-art baselines while preserving an end-to-end differentiable semantic communication architecture.

Source: https://www.emergentmind.com/topics/hana-jscc