Channel Foundation Models (CFMs)
- Channel Foundation Models (CFMs) are domain-specific models that learn universal, transferable representations of channel state information from heterogeneous, unlabeled data.
- CFMs leverage self-supervised learning paradigms—generative, discriminative, hybrid, and predictive—to overcome data scarcity and improve robustness across various wireless tasks.
- CFMs show practical improvements in NMSE, pilot overhead reduction, and zero-shot adaptability, benefiting applications like channel estimation, beamforming, and positioning.
Searching arXiv for recent and foundational papers on Channel Foundation Models to ground the article. Channel Foundation Models (CFMs) are domain-specific foundation models that learn universal, reusable representations of channel state information from large-scale, heterogeneous, and often unlabeled channel data, then transfer those representations across downstream tasks such as channel estimation, prediction, beamforming, positioning, CSI compression and feedback, and sensing. In the wireless literature, CFMs are described as pretrained, universal channel feature extractors and as large, transferable models trained on diverse CSI to learn a “universal channel representation,” with adaptation performed by full fine-tuning, lightweight fine-tuning, or zero-/few-shot transfer (Jiang et al., 18 Jul 2025, Zhou et al., 17 Dec 2025).
1. Conceptual foundations
The CFM literature frames wireless channels as a pretraining domain in their own right rather than as a sequence of isolated supervised tasks. A survey introducing the concept “for the first time” presents CFMs as a unified framework built around self-supervised learning on large unlabeled channel datasets, motivated by heavy dependence on labeled data, poor generalization under domain shift, and task silos across channel estimation, feedback, beam selection, localization, and sensing (Jiang et al., 18 Jul 2025). Related work sharpens that definition in several directions: predictive CFMs are trained on cross-domain CSI to produce transferable priors for current-slot estimation (Zhou et al., 17 Dec 2025); representation CFMs learn compact, task-agnostic embeddings from realistic multi-antenna channels (Guler et al., 14 May 2025); generalized wireless foundation models aim to work without scenario-specific finetuning across reconstruction and prediction tasks (Zhang et al., 26 Jan 2026).
A recurrent theme is that the wireless channel exhibits structured variability across space, time, frequency, propagation environment, numerology, antenna configuration, mobility, and SNR. The rationale for large-scale pretraining is therefore not merely data volume, but exposure to heterogeneous propagation statistics. In the predictive CFM setting, training across many TDL profiles, speeds, subcarrier spacings, pilot patterns, and SNRs is used to induce “environment-agnostic features” and strong cross-scenario transferability (Zhou et al., 17 Dec 2025). HeterCSI formulates the same issue as “dual heterogeneity”: scale heterogeneity in , , and , and scenario diversity across indoor, urban, rural, LoS/NLoS, carrier frequency, and hardware (Zhang et al., 26 Jan 2026).
The contrast with classical pipelines is explicit. Traditional supervised estimators learn direct mappings for a fixed task and often degrade under distribution shifts, whereas CFMs separate representation learning from downstream adaptation. In one formulation, they bring a “pretrain once, adapt everywhere” paradigm to the physical layer by learning channel-intrinsic features from large unlabeled corpora (Jiang et al., 17 Feb 2025).
2. Self-supervised learning paradigms
The survey literature organizes CFM training into generative, discriminative, and hybrid paradigms, with predictive modeling now functioning as a closely related fourth pattern in task-oriented channel modeling (Jiang et al., 18 Jul 2025, Zhou et al., 17 Dec 2025).
| Paradigm | Core mechanism | Representative instances |
|---|---|---|
| Generative SSL | Masked reconstruction of CSI or related channel tensors | WiFo (Liu et al., 2024), WiMAE (Guler et al., 14 May 2025), CSI-MAE (Jiang et al., 7 Jan 2026) |
| Discriminative SSL | Contrastive alignment of positive channel views or modalities | CSI-CLIP (Jiang et al., 17 Feb 2025), CSI-CLIP++ (Jiang et al., 24 Jun 2026) |
| Hybrid SSL | Joint reconstruction and contrastive learning | ContraWiMAE (Guler et al., 14 May 2025) |
| Predictive priors | Forecast future CSI from channel history, then refine with current evidence | Predictive CFM for channel estimation (Zhou et al., 17 Dec 2025) |
Generative SSL is most commonly instantiated as masked channel modeling. The survey writes the masked objective as
and treats masked reconstruction as the dominant pretraining template for CFM-like systems (Jiang et al., 18 Jul 2025). WiFo unifies time-domain and frequency-domain channel prediction as reconstruction from partial observations,
with pretraining driven by random, time-masked, and frequency-masked reconstruction tasks over a space-time-frequency tensor (Liu et al., 2024). CSI-MAE uses masked MSE over masked patches only, with a high mask ratio of , while WiMAE reports that is optimal for forcing the encoder to learn global structure rather than local memorization (Jiang et al., 7 Jan 2026, Guler et al., 14 May 2025).
Discriminative SSL enters the CFM literature mainly through physically paired views. CSI-CLIP treats CIR and CSI as naturally aligned multimodal data and uses CLIP-style contrastive learning to align them in a shared embedding space (Jiang et al., 17 Feb 2025). CSI-CLIP++ keeps the same physical idea but emphasizes scalability and stronger transfer across PHY, RAN, and ISAC tasks by aligning frequency-domain CSI and delay-domain CIR (Jiang et al., 24 Jun 2026). In both cases, the physical equivalence of the two domains provides positive pairs without requiring synthetic augmentations.
Hybrid SSL combines structural reconstruction and discriminative separation. ContraWiMAE augments masked reconstruction with InfoNCE on AWGN-generated positive pairs, using
with in the reported experiments (Guler et al., 14 May 2025). The intended effect is to improve linear separability and data efficiency beyond what reconstruction alone can achieve.
Predictive CFMs depart from static masked recovery by learning priors over channel evolution. In the predictive channel-estimation framework, a decoder-only time-series transformer forecasts the current slot from the previous slot,
and sparse pilots then calibrate the prediction rather than define the estimate from scratch (Zhou et al., 17 Dec 2025).
3. Architectural patterns and channel representations
CFM architectures closely follow the chosen pretraining objective, but several structural motifs recur: patchified CSI tokens, transformer backbones, modality-specific encoders for paired channel views, and explicit handling of complex-valued data.
Masked-autoencoder CFMs typically convert complex CSI into two real-valued channels and preserve antenna–subcarrier or space–time–frequency topology through positional encoding. WiFo represents MISO-OFDM CSI as a space–time–frequency tensor 0, converts it to a real tensor with separate real and imaginary channels, and applies non-overlapping 1D patching with patch size 2 before transformer encoding (Liu et al., 2024). CSI-MAE instead aggregates the MIMO dimension into an antenna-domain axis, builds a two-channel real tensor
3
then uses 2D sine–cosine positional embeddings over the antenna–subcarrier grid (Jiang et al., 7 Jan 2026). WiMAE similarly splits each complex patch into real and imaginary parts and explores patch shapes 4 and 5, reporting better downstream generalization for 6 and higher reconstruction SNR for 7 (Guler et al., 14 May 2025).
Contrastive multimodal CFMs use dual encoders instead of encoder–decoder reconstruction. CSI-CLIP and CSI-CLIP++ build one branch for CSI and one for CIR, relying on the Fourier correspondence between the two domains rather than explicit analytical regularization. CSI-CLIP++ states the discrete OFDM relation as
8
and uses paired CSI–CIR realizations to learn a shared embedding space (Jiang et al., 24 Jun 2026). CSI-CLIP uses ResNet50 encoders adapted to two-channel real/imaginary inputs, while CSI-CLIP++ reports ViT-B/16 and ViT-L/16 backbones, with downstream adaptation through a lightweight two-layer MLP head on the pretrained CSI encoder (Jiang et al., 17 Feb 2025, Jiang et al., 24 Jun 2026).
Task-oriented CFMs incorporate stronger inductive bias into the downstream pipeline. The predictive estimator in “Reducing Pilots in Channel Estimation With Predictive Foundation Models” combines three modules: a decoder-only time-series transformer adapted from TimesFM, a pilot processing network based on a Vision Transformer, and a learned residual fusion block. The predictive backbone performs univariate decomposition over real–imaginary channel sequences, patching with 9, causal attention, and decoder-only forecasting; the pilot encoder uses 0 layers, enhanced FFN blocks with 1 depth-wise convolutions, and Adaptive LayerNorm conditioned on 2 (Zhou et al., 17 Dec 2025). The final estimate is produced by hidden-state fusion,
3
which empirically outperforms weighting and attention fusion in that study (Zhou et al., 17 Dec 2025).
Generalized pretraining under variable input size requires architectural or systems mechanisms beyond standard ViTs. HeterCSI keeps a ViT-style encoder–decoder but adds scale-aware adaptive batching and double masking so that variable 4, 5, and 6 do not collapse training through zero-padding and gradient conflict (Zhang et al., 26 Jan 2026). At a broader multimodal scale, WiCo—introduced in the MMICM framework—uses modality-specific encoders for RGB, depth, LiDAR, maps, and RF metadata, a unified transformer backbone with hierarchical tokenization and sparse attention, physics-informed decoders, and parameterized adapters conditioned on band, scenario, and scale (Bai et al., 11 Mar 2026).
4. Data regimes, pretraining corpora, and transfer
The CFM literature is unusually explicit about pretraining diversity because cross-scenario transfer is treated as a primary capability rather than a side effect. Wireless CFMs are trained on simulated or ray-traced corpora that vary carrier frequency, channel model, antenna layout, OFDM configuration, mobility, and environment.
Several large pretraining sets are repeatedly used. WiMAE and ContraWiMAE pretrain on 1.14M DeepMIMO samples at 7 GHz across 8 scenarios and evaluate on 9 samples from 0 unseen scenarios (Guler et al., 14 May 2025). CSI-CLIP pretrains on more than 1 CSI samples from 2 heterogeneous DeepMIMO scenarios, then evaluates transfer to new tasks and to a Sionna RT urban cellular scenario at 3 GHz (Jiang et al., 17 Feb 2025). CSI-CLIP++ also uses more than 4M DeepMIMO samples across 5 scenarios and evaluates on seven unseen DeepMIMO scenarios plus cross-simulator transfer to Sionna RT (Jiang et al., 24 Jun 2026). WiFo pretrains on a heterogeneous QuaDRiGa corpus of 6K CSI samples from 7 datasets spanning carrier frequencies from 8 to 9 GHz, variable 0, 1, and UPA sizes, and user speed ranges from 2–3 to 4–5 km/h (Liu et al., 2024). CSI-MAE uses approximately 6 million Sionna-generated CSI samples under 3GPP TR 38.901, spanning UMi, UMa, and RMa; carrier frequencies 7, 8, 9, 0, and 1 GHz; subcarrier spacings 2, 3, and 4 kHz; and UE velocities uniformly sampled in 5 m/s (Jiang et al., 7 Jan 2026). The predictive channel-estimation CFM is trained on 6 trajectories times 7 slots, i.e., 8 samples, covering TDL-A/B/C, speeds 9–0 km/h, subcarrier spacings 1 kHz, SNRs 2–3 dB, and “2P”/“4P” pilot patterns, with TDL-D LoS reserved for zero-shot tests (Zhou et al., 17 Dec 2025).
HeterCSI makes the data-handling problem itself part of the method. It pretrains on 4 QuaDRiGa-generated MISO-OFDM datasets, each with 5 samples split 6, and evaluates on 7 distinct zero-shot datasets spanning indoor, RMa, UMa, and UMi conditions across frequencies including 8, 9, 0, 1, 2, 3, 4, 5, 6, and 7 GHz (Zhang et al., 26 Jan 2026). Its central empirical insight is that mixed-scale training induces destructive gradient interference, while scenario diversity is constructive once scales are aligned. The reported gradient cosine statistics are 8 negative pairs for mixed-scale batches, dropping to 9 and 0 for same-scale and similar-scale batches across diverse scenarios (Zhang et al., 26 Jan 2026).
Transfer protocols vary. Some CFMs are explicitly zero-shot: WiFo is designed for instant use on new channel-prediction configurations without fine-tuning (Liu et al., 2024), and HeterCSI emphasizes operation without scenario-specific finetuning (Zhang et al., 26 Jan 2026). Others mix frozen-backbone and full-finetuning regimes. CSI-MAE reports a lightweight decoder finetuning strategy that freezes the pretrained encoder for extrapolation and feedback, and full-parameter finetuning for positioning (Jiang et al., 7 Jan 2026). WiMAE and ContraWiMAE emphasize linear probing and small downstream models, while CSI-CLIP and CSI-CLIP++ use lightweight two-layer MLP heads on a pretrained CSI encoder (Guler et al., 14 May 2025, Jiang et al., 17 Feb 2025, Jiang et al., 24 Jun 2026).
5. Downstream tasks and reported empirical behavior
CFMs are evaluated across a broader task spectrum than most earlier wireless self-supervised models: CSI reconstruction, time-domain prediction, frequency-domain prediction, channel estimation, channel identification, beam prediction, feedback, extrapolation, positioning, and system-level BER.
| System | Main tasks | Representative reported outcome |
|---|---|---|
| Predictive CFM estimator (Zhou et al., 17 Dec 2025) | Channel estimation and BER | NMSE improves by 1–2 dB; “2P” matches LMMSE “4P,” implying up to 3 pilot reduction |
| HeterCSI (Zhang et al., 26 Jan 2026) | Reconstruction, time prediction, frequency prediction | Versus WiFo, NMSE improves by 4 dB, 5 dB, and 6 dB; training latency reduced by about 7 |
| CSI-CLIP (Jiang et al., 17 Feb 2025) | Positioning, beam management, channel identification | Positioning mean error distance reduced by 8 on average across 9 scenarios |
| CSI-CLIP++ (Jiang et al., 24 Jun 2026) | Channel identification, beam prediction, positioning | Beam Top-1 accuracy improves by up to 0 percentage points |
| CSI-MAE (Jiang et al., 7 Jan 2026) | Extrapolation, feedback, positioning | Finetuned positioning reaches RMSE 1 m, with 2 errors within 3 m |
| WCFM with NPI suppression (Wang et al., 19 Sep 2025) | Channel prediction from degraded CSI | Best NMSE across SINR, predicted subcarrier count 4, and downstream training ratio 5 |
Predictive channel estimation is one of the clearest demonstrations of a task-oriented CFM. The predictive estimator reports that PFM-aided channel estimation improves NMSE by 6–7 dB over LMMSE, CNN, and ViT baselines, that at 8–9 km/h “2P” pilots achieve NMSE comparable to LMMSE with “4P,” and that end-to-end BER with LDPC and 00-QAM is reduced by at least 01 dB in the high-SNR regime at 02 km/h (Zhou et al., 17 Dec 2025). Zero-shot tests are central to the argument: the same system reports more than 03 dB gain for an unseen speed of 04 km/h, more than 05 dB gain for an unseen 06 setting at SNR 07 dB, and competitive performance on unseen TDL-D LoS despite the distribution shift (Zhou et al., 17 Dec 2025).
Prediction-oriented CFMs show a similar pattern. WiFo reports average NMSE 08 for time-domain prediction and 09 for frequency-domain prediction on its multi-dataset evaluation, outperforming Transformer, LSTM, 3D ResNet, PAD, and LLM4CP variants while remaining zero-shot on unseen configurations (Liu et al., 2024). HeterCSI then uses WiFo as the state-of-the-art zero-shot benchmark and reports average NMSE(dB) gains of 10 dB for CSI reconstruction, 11 dB for time-domain prediction, and 12 dB for frequency-domain prediction, while also surpassing best full-shot competitors on average by 13 dB, 14 dB, and 15 dB on the same three tasks (Zhang et al., 26 Jan 2026).
Representation CFMs are strongest on discriminative downstream tasks. CSI-CLIP reports an average 16 reduction in positioning error distance over supervised baselines across 17 scenarios, about 18 average improvement in beam-management accuracy, and gains or parity in channel identification (Jiang et al., 17 Feb 2025). CSI-CLIP++ strengthens the beam-prediction result substantially, with Top-1 gains up to 19 percentage points in O1_60 and consistent improvements across seven unseen scenarios, while also improving cross-simulator positioning in Sionna RT by 20, 21, and 22 in the three reported sectors (Jiang et al., 24 Jun 2026). In ablations, CSI-CLIP++ reports that contrastive CSI–CIR alignment is stronger than masked reconstruction for PHY and RAN discrimination, while masked reconstruction remains competitive for fine-grained regression in ISAC positioning (Jiang et al., 24 Jun 2026).
MAE-style CFMs report strong reconstruction-oriented and transfer-oriented behavior. CSI-MAE states that its frozen decoder strategy meets or exceeds supervised baselines on channel extrapolation and channel feedback across all five evaluation scenarios, while full finetuning yields the best reported results, including feedback NMSE values such as 23 dB for RMa-24 and 25 dB for UMi-26 (Jiang et al., 7 Jan 2026). For positioning on its 3GPP dataset, finetuning achieves RMSE 27 m and places 28 of errors within 29 m, compared with RMSE 30 m and 31 within 32 m for the supervised baseline (Jiang et al., 7 Jan 2026). WiMAE and ContraWiMAE emphasize linear separability and data efficiency: for cross-frequency beam selection at codebook size 33, top-1 linear-probe accuracy with 34 labels reaches 35 for ContraWiMAE versus 36 for WiMAE, 37 for LWM, and 38 for RAW input (Guler et al., 14 May 2025).
Practical deployment results are also beginning to appear. The predictive estimator reports per-slot inference latency of 39 ms and 40M parameters on an RTX 4090 plus i9-14900K, with the claim that latency below 41 ms is consistent with 3GPP timing budgets (Zhou et al., 17 Dec 2025). The NPI-suppression WCFM explicitly addresses the mismatch between perfect-CSI pretraining and degraded-CSI deployment by projecting received pilot signals into channel and orthogonal subspaces, estimating noise-plus-interference, subtracting it, and then completing CSI before foundation-model feature extraction. Its reported advantage is not only better NMSE across SINR and prediction span, but also lower downstream sample complexity: with 42, it outperforms the other solutions even at 43 on the channel-prediction task (Wang et al., 19 Sep 2025).
6. Limitations, open questions, and broader usage of the term
The strongest limitations recur across papers. Many wireless CFMs still rely on simulated or ray-traced data rather than measured data, making hardware impairments, calibration errors, phase noise, IQ imbalance, non-stationary interference, and severe domain shifts only partially represented (Guler et al., 14 May 2025, Zhou et al., 17 Dec 2025, Jiang et al., 7 Jan 2026). Fixed or weakly variable input geometry also remains a constraint: CSI-CLIP explicitly notes poor generalization to unseen 44 configurations because input reshaping changes spatial and temporal axes (Jiang et al., 17 Feb 2025). HeterCSI identifies scale heterogeneity itself as a barrier to generalized pretraining, requiring batch construction and masking strategies that ordinary mixed-scale training does not provide (Zhang et al., 26 Jan 2026).
Several open questions are now well defined. The predictive-estimation work points to error propagation from previous-slot estimates, pilot-design co-optimization, lightweight variants via pruning or distillation, and the absence of formal bounds relating NMSE to pilot density under learned priors (Zhou et al., 17 Dec 2025). The CFM survey emphasizes physics-informed priors, robust tokenization for next-token prediction, low-complexity attention, realistic open datasets, federated and continual learning, explainability, privacy, security, and benchmarking standards as unresolved requirements for scalable deployment (Jiang et al., 18 Jul 2025). WiCo extends that list to multimodal alignment, physics-grounded regularization, and parameterized adapters across air–space–ground–sea environments, but also notes the cost of collecting spatially and temporally aligned multimodal corpora and the lack of paradigm-fair evaluation suites (Bai et al., 11 Mar 2026).
The term “Channel Foundation Model” is also not confined to wireless channel state information. In scientific computing, D-CHAG uses the phrase for channel-aware foundation models on multi-channel imagery such as hyperspectral data and weather fields, where the main systems challenge is scalable cross-channel tokenization and aggregation under large channel counts (Tsaris et al., 26 Jun 2025). In multivariate time series, CHARM is presented as a channel-aware foundation embedding model that incorporates channel-level textual descriptions and is permutation-equivariant with respect to channel order, and Partial Channel Dependence introduces dataset-specific channel masks for channel-adaptive time-series foundation models (Dutta et al., 20 May 2025, Lee et al., 2024). This suggests that the phrase “CFM” is becoming polysemous: in wireless communications it denotes foundation models for propagation channels, while in adjacent fields it can denote foundation models that treat channels as a primary modeling axis.
Taken together, the cited literature establishes CFMs as a rapidly diversifying research program rather than a single architecture family. What unifies the field is the attempt to replace scenario-specific, label-intensive wireless intelligence with pretrained channel representations or priors that survive changes in environment, scale, modality, and task. Where the papers differ is in what they regard as the most faithful self-supervised signal: masked recovery of structure, contrastive alignment of physically equivalent views, predictive modeling of channel evolution, or multimodal grounding in environment observations (Jiang et al., 18 Jul 2025, Jiang et al., 24 Jun 2026).