---
title: 'WiFo-CF: Wireless Foundation CSI Feedback'
url: https://www.emergentmind.com/topics/wifo-cf
type: topic
---

# WiFo-CF: Wireless Foundation CSI Feedback

WiFo-CF is a wireless foundation model for channel state information (CSI) feedback that is designed to replace fixed-configuration deep learning pipelines with a single pretrained model accommodating heterogeneous channel dimensions, feedback rates, and data distributions. Its defining elements are a multi-user, multi-rate self-supervised pre-training strategy, a Mixture of Shared and Routed Expert (S-R MoE) architecture, and large-scale pretraining on the heterogeneous LH-CDF dataset. In the reported evaluations, WiFo-CF achieves the best average in-distribution normalized mean-squared error (NMSE), strong zero-shot out-of-distribution performance across simulated and real-world scenarios, and transferable representations for downstream CSI-based indoor localization [2508.04068].

## 1. Problem formulation and signal model

WiFo-CF addresses three recurrent limitations of earlier deep learning CSI feedback systems: fixed input shape, limited generalization, and rigid feedback rate. Earlier encoder–decoder designs are described as being tied to a particular CSI tensor size, typically trained for a single antenna geometry, one OFDM grid, one compression ratio, and one data distribution. WiFo-CF is explicitly formulated to handle heterogeneity along channel dimensions, feedback rates, and data distributions within one framework [2508.04068].

The system model is an FDD MU-MISO OFDM link in which a base station with $N_t$ antennas serves $K$ single-antenna users over $N_c$ subcarriers with spacing $\Delta f$. On subcarrier $n$, the transmit signal is
$$
x_n = V_n s_n,
$$
and the received signal for user $k$ is
$$
y_{k,n} = h_{k,n}^H v_{k,n} s_{k,n} + \sum_{i\neq k} h_{k,n}^H v_{i,n} s_{i,n} + n_{k,n},
$$
with $n_{k,n} \sim \mathcal{CN}(0,\sigma^2)$. For illustration, the paper gives zero-forcing precoding
$$
V_n = \gamma H_n^H (H_n H_n^H)^{-1},
$$
while emphasizing that precoder details are orthogonal to the CSI feedback problem itself [2508.04068].

Each user estimates a complex CSI matrix $H_k \in \mathbb{C}^{N_t \times N_c}$, which WiFo-CF converts into a real-valued two-channel tensor $\bar{H}_k \in \mathbb{R}^{2 \times N_t \times N_c}$ containing real and imaginary parts. The encoder compresses CSI into a latent vector
$$
z_k = f_\theta(H_k) \in \mathbb{R}^{D_L},
$$
followed by non-uniform $\mu$-law quantization,
$$
F(x) = \mathrm{sgn}(x)\cdot \frac{\ln(1+\mu|x|)}{\ln(1+\mu)},
$$
and $b_k$-bit uniform quantization over $[-1,1]$, giving a bit budget
$$
B_k = b_k D_L.
$$
The decoder reconstructs multi-user CSI jointly from the dequantized latents:
$$
\hat{H}_1,\ldots,\hat{H}_K = g_\phi(\{D(s_k)\}).
$$

Two rate-related quantities are central. The compression ratio is
$$
CR = \frac{D_L}{2N_tN_c},
$$
and the effective spectral efficiency is defined as
$$
ESE = R_k \times \eta,\qquad \eta = 1 - \frac{B_k}{R_uWT_c},
$$
thereby incorporating feedback latency through uplink rate $R_u$, bandwidth $W$, and coherence time $T_c$. Reconstruction quality is measured by
$$
NMSE = \mathbb{E}\!\left[\frac{\|H-\hat{H}\|_2^2}{\|H\|_2^2}\right],
$$
reported in dB as $10\log_{10}(NMSE)$ [2508.04068].

## 2. Architecture and representation learning mechanism

WiFo-CF uses a multi-user scalable autoencoder (MUAE). The user equipment side employs identical encoders, while the base station hosts a single high-capacity decoder that jointly reconstructs multi-user CSI and exploits inter-user correlations. This asymmetric allocation matches the deployment assumption that user equipment is resource-constrained and the base station is compute-rich [2508.04068].

CSI embedding begins with a non-overlapping 2D convolution on $\bar{H}_k$:
$$
H_{\mathrm{conv}} = \mathrm{Conv2d}(\bar{H}_k),
$$
with patch size $(p_n,p_f)$ along antennas and frequency. The resulting tensor is flattened into $L=(N_t/p_n)(N_c/p_f)$ tokens. Absolute sinusoidal positional encoding is then added:
$$
H_{\mathrm{enc}}^0 = H_{\mathrm{emb}} + P_{\mathrm{absolute}},
$$
with
$$
P_{\mathrm{absolute}}(2i,j)=\sin\!\left(j/10000^{2i/d_{\mathrm{enc}}}\right),\qquad
P_{\mathrm{absolute}}(2i+1,j)=\cos\!\left(j/10000^{2i/d_{\mathrm{enc}}}\right).
$$

The encoder stacks Transformer blocks with RMSNorm and sparse MoE feedforward layers:
$$
U_{\mathrm{enc}}^l = \mathrm{RMSNorm}(\mathrm{MHA}(H_{\mathrm{enc}}^{l-1}) + H_{\mathrm{enc}}^{l-1}),
$$
$$
H_{\mathrm{enc}}^l = \mathrm{RMSNorm}(\mathrm{MoE}(U_{\mathrm{enc}}^l) + U_{\mathrm{enc}}^l).
$$
The MoE layer is defined by
$$
\mathrm{MoE}(x)=\sum_{i\in T_k(x)} G(x)[i]\cdot E_i(x),
$$
where $G(x)$ is the gating network, $T_k(x)$ selects the top-$k$ experts, and $E_i$ denotes expert $i$ [2508.04068].

The decoder first upsamples each user code into a full token sequence, then adds both absolute positional embeddings and a user-identity embedding:
$$
H_{\mathrm{dec},k}^0 = H_{\mathrm{dec},k} + P_{\mathrm{absolute}} + U_k.
$$
All user sequences are concatenated and jointly decoded, which is a structural device for modeling inter-user CSI correlation. Dynamic-rate feedback is supported because the bit width $b_k$ is configurable per user, and joint decoding allows higher-precision users to assist lower-precision users through shared latent structure [2508.04068].

The defining architectural component is the S-R MoE:
$$
\mathrm{S\text{-}R\ MoE}(x)=\sum_{j=1}^{N_s} S\text{-}E_j(x)+\sum_{i\in T_k(x)} G(x)[i]\cdot R\text{-}E_i(x).
$$
Shared experts are always active and model global CSI priors; routed experts are sparsely activated and model user- or domain-specific factors. The paper attributes natural support for variable $K$ to this design, without padding or retraining. To prevent routing collapse, WiFo-CF adds a Switch-Transformer-style load-balancing term
$$
L_{lb}=N\sum_{i=1}^N f_iP_i,
$$
and pretraining uses
$$
L=L_{rec}+\beta_1 L_{lb},
$$
with $\beta_1 \approx 0.01$ [2508.04068].

The reported model variants are as follows.

| Variant | Architecture | Parameters |
|---|---|---|
| Small | encoder depth 2 / width 64 / heads 8; decoder depth 2 / width 64 / heads 8; experts 1 shared − 1 activated − 31 routed | $\approx 0.10$ M inference / $1.73$ M training |
| Base | $2\times128/8$ encoder; $4\times128/8$ decoder; experts 1−3−31 | $\approx 1.60$ M / $8.38$ M |
| Large | $4\times128/8$ encoder; $4\times128/8$ decoder; experts 1−7−31 | $\approx 3.89$ M / $14.18$ M |

## 3. Heterogeneous pretraining on LH-CDF

WiFo-CF is pretrained on LH-CDF, described as the first large-scale heterogeneous channel feedback dataset. LH-CDF combines three generation paradigms: statistical channels from QuaDRiGa, ray-tracing channels from DeepMIMO and SynthSoM, and real-world measurements from Argos and Dichasus. The dataset spans frequencies from $1$ to $28$ GHz in QuaDRiGa, $3.4$–$3.5$ and $28$–$60$ GHz in DeepMIMO, $28$ GHz in SynthSoM, $2.4$ GHz in Argos, and $1.27$–$3.44$ GHz in Dichasus, with base-station antenna counts from $16$ to $256$, user antenna counts from $1$ to $4$, subcarrier counts from $16$ to $64$, and mobility ranges from $0$ to $300$ km/h [2508.04068].

The total scale is reported as over $1$ million samples. The pretraining set contains QuaDRiGa Q1–Q8 ($\approx 480$k), DeepMIMO D1–D2 ($\approx 120$k), and Argos A1–A6 ($\approx 90$k). Zero-shot evaluation uses QuaDRiGa Q9–Q16 ($\approx 480$k), DeepMIMO D3–D4 ($\approx 120$k), SynthSoM S1–S2 ($\approx 10$k), Argos A7–A8 ($\approx 30$k), and Dichasus H1–H2 ($\approx 30$k) [2508.04068].

Pretraining is self-supervised, multi-user, and multi-rate. For each batch, the number of users is randomly sampled as $K_m\in[2,6]$, and the bit width is randomly sampled as $b\in[3,7]$ per user. The model then performs encoding, $\mu$-law quantization, dequantization, and joint decoding for all users. The reported hyperparameters are batch size $64$, $100$ pretraining epochs, learning rate in $[10^{-6},10^{-5}]$, patch size $(p_n,p_f)=(4,4)$, and fixed $CR=1/32$, optimized with Adam and cosine annealing [2508.04068].

This pretraining protocol is intended to expose the model simultaneously to variation in user count, quantization precision, antenna dimension, subcarrier dimension, propagation model, and domain shift. A plausible implication is that WiFo-CF’s generalization is driven not only by scale, but by deliberate co-training over multiple operational axes rather than simple dataset aggregation.

## 4. Empirical performance, generalization, and ablation results

On in-distribution evaluation over Q1–Q8 and D1–D2, WiFo-CF reports the best average NMSE at $-4.913$ dB, compared with LAM at $-2.685$ dB, CRNet at $-2.538$ dB, CsiNet at $-1.683$ dB, and TVAL3 at $0.091$ dB. Representative dataset-level results include Q1 at $-7.759$ dB versus $-3.375$ for LAM and $-2.939$ for CRNet, and D1 at $-6.271$ dB versus $-3.280$ for LAM and $-2.028$ for CRNet. The paper emphasizes that a single WiFo-CF model handles all heterogeneous configurations, whereas baselines require many models, with CsiNet cited as requiring approximately $40$ per scenario family [2508.04068].

The multi-rate setting is evaluated through both spectral efficiency and effective spectral efficiency. The reported trend is that WiFo-CF improves spectral efficiency as $b$ increases from $3$ to $7$ bits, but larger $b$ reduces the effective communication ratio $\eta$ because the uplink payload $B_k$ increases. In fast time-varying or mmWave channels with small $T_c$, smaller $b$ can outperform larger $b$ in ESE, which is the principal systems argument for multi-rate capability [2508.04068].

Zero-shot out-of-distribution performance is a central result. On Q9–Q16, D3–D4, and S1, WiFo-CF achieves an average NMSE of $-4.628$ dB, while the best full-shot baseline, LAM, achieves $-3.567$ dB. The average gain is reported as approximately $1.061$ dB despite evaluation on unseen configurations. Dataset highlights include S1 at $-9.518$ dB for WiFo-CF zero-shot, versus $-7.218$ for LAM full-shot and $-6.816$ for CRNet, and D4 at $-6.948$ dB versus $-5.727$ for LAM and $-5.180$ for CRNet [2508.04068].

Ablation results are structured around the S-R MoE and the pretraining recipe. On Q1–Q8, the base model achieves $-4.131$ dB. Removing routed experts yields $-2.896$ dB, removing shared experts yields $-3.414$ dB, removing multi-user joint decoding yields $-2.861$ dB, and removing multi-rate training yields $-2.844$ dB. On Q9–Q16, the same removals degrade performance from $-3.243$ dB to $-2.204$, $-2.541$, $-2.374$, and $-1.736$ dB, respectively. The paper interprets these results as confirming the importance of S-R MoE, joint multi-user decoding, and multi-rate pretraining [2508.04068].

The scaling study states that larger models and larger, more diverse datasets consistently improve both in-distribution and out-of-distribution performance. Patch size is also treated as a design variable, with $(4,4)$ described as a robust choice that yields Q1 NMSE of $-7.624$ dB at moderate FLOPs [2508.04068].

## 5. Transfer learning, efficiency, deployment, and limitations

WiFo-CF is also evaluated as a transferable representation model. In few-shot transfer on real-world data, the reported comparison includes zero-shot inference, full fine-tuning, frozen-backbone transfer, and training from scratch. Zero-shot WiFo-CF is stated to outperform baselines even when those baselines are trained with $1$k labeled samples, with an average NMSE advantage of approximately $3.0$ dB. The frozen backbone often surpasses full fine-tuning, which the paper attributes to highly generalizable pretrained features and reduced overfitting from fewer trainable parameters [2508.04068].

For CSI-based indoor localization, WiFo-CF’s encoder representations are used as features for coordinate regression. Encoded features yield more than $10\%$ lower localization error than raw CSI, and the compressed and quantized features also provide substantial gains at much lower dimension. This situates WiFo-CF not only as a feedback model, but also as a reusable channel representation learner [2508.04068].

Compute and latency are reported in both sparse and dense terms. WiFo-CF-Small attains NMSE of $-3.667$ dB at $80.3$ MFLOPs, $7.526$ ms inference, and $0.10$ M inference parameters. The sparse design reduces FLOPs by more than $90\%$ relative to its dense counterpart while maintaining accuracy; the dense small model is listed at $837$ MFLOPs and $7.672$ ms. Baseline figures are LAM at $147$ MFLOPs and $-1.934$ dB, CRNet at $29$ MFLOPs and $-2.538$ dB, and CsiNet at $29$ MFLOPs and $-1.683$ dB. The training platform is reported as $4\times$ NVIDIA RTX 4090 GPUs, $4\times$ Intel Xeon Platinum 8358P CPUs, and $188$ GB RAM [2508.04068].

The deployment model is asymmetric. The encoders are described as identical and lightweight for user equipment deployment, while the heavier decoder runs at the base station. Per-user bit widths $b_k$ are signaled to the base station, and size-agnostic down/up-sampling allows a single pretrained model to serve multiple cells and devices. The practical guidance given is to normalize magnitude to $[-1,1]$ before $\mu$-law quantization, use Conv2d patch embedding with $(4,4)$ as a strong default, and begin domain adaptation with frozen-backbone fine-tuning of the output head before escalating to full fine-tuning if necessary [2508.04068].

The paper also enumerates several limitations. Foundation pretraining depends on large, diverse datasets such as LH-CDF, and collecting real CSI raises privacy and logistics concerns. Routing stability depends on well-tuned gating and load balancing, and extreme domain shifts may challenge the S-R MoE router. The decoder is compute-heavier than the encoder, so further efficiency work such as quantization-aware inference and expert pruning is identified as beneficial. Future directions include online or federated updates, per-cell personalization, explicit rate–distortion objectives, mutual-information regularization, and more explicit physics-informed priors [2508.04068].

## 6. Relation to the broader WiFo literature and nomenclature

WiFo-CF belongs to a broader family of wireless foundation models. The paper explicitly states that the wireless foundation model concept, “as in WiFo and LWM,” is extended to CSI feedback by pretraining on large, heterogeneous channel corpora to learn universal channel compression and reconstruction priors [2508.04068]. The immediate precursor is WiFo, introduced as the first space-time-frequency wireless foundation model for time-frequency channel prediction, where time extrapolation and cross-frequency prediction are unified as masked reconstruction on heterogeneous CSI tensors [2412.08908].

The term itself is not entirely uniform across later WiFo literature. In WiFo-2, “WiFo-CF” refers to a downstream CSI feedback capability in which WiFo-2 is used on the receiver side to denoise or refine CSI reconstructed by a standard compression network under a fixed $25\%$ compression ratio, rather than to an end-to-end variable-rate feedback model [2511.22222]. In WiFo-M$^2$, by contrast, the summary states that the paper does not explicitly define a module named “WiFo-CF,” and instead interprets the phrase as “WiFo Channel Feature forecasting” in the context of multimodal sensing and CSI-aligned latent prediction [2601.09179].

This terminological variation has two consequences. First, “WiFo-CF” in the strict bibliographic sense denotes the model introduced in “WiFo-CF: Wireless Foundation Model for CSI Feedback” [2508.04068]. Second, later usage sometimes broadens the label to mean CSI-feedback capability or channel-feature forecasting inside other WiFo-derived systems. The most precise usage therefore depends on context, but within the CSI feedback literature the canonical referent is the variable-rate, heterogeneous-configuration feedback model built around multi-user self-supervision and S-R MoE [2508.04068].

Source: https://www.emergentmind.com/topics/wifo-cf