---
title: 'DC-Mamber: Dual-Channel Forecasting Model'
url: https://www.emergentmind.com/topics/dc-mamber
type: topic
---

# DC-Mamber: Dual-Channel Forecasting Model

Searching arXiv for the exact paper and closely related naming variants to ground the article.
DC-Mamber is a dual-channel prediction model for multivariate time series forecasting that combines a Mamba-based branch with a linear Transformer branch in order to couple channel-independent and channel-mixing views of the same sequence. In the formulation used by the model, the historical input is $\mathbf{X}=\{\mathbf{x}_1,\ldots,\mathbf{x}_L\}\in\mathbb{R}^{L\times V}$ and the objective is to forecast $\mathbf{Y}=\{\mathbf{x}_{L+1},\ldots,\mathbf{x}_{L+W}\}\in\mathbb{R}^{W\times V}$. The Mamba-based channel is assigned to extract intra-variable features, while the Transformer-based channel models cross-timestep global dependencies; a learned fusion layer then integrates both streams for prediction [2507.04381].

## 1. Concept and problem setting

DC-Mamber is situated in multivariate time series forecasting (MTSF), where the central modeling problem is to preserve three kinds of structure simultaneously: global temporal dependencies, local intra-variable dynamics, and cross-variable correlations. The model is explicitly motivated by the observation that prevailing architectures usually privilege only one of these views. Channel-mixing strategies treat the multivariate vector at each time step as a token and therefore emphasize inter-variable relationships and global temporal modeling, whereas channel-independent strategies treat each variable history as a token and therefore emphasize per-variable temporal dynamics [2507.04381].

This bifurcation is also architectural. Transformer-based models are described as strong in global dependency modeling through self-attention, but constrained by quadratic complexity and limited sensitivity to local temporal patterns. Mamba, built on state space models (SSMs), is described as achieving linear complexity and efficient long-range modeling, while being less effective at aggregating global contextual information in parallel. DC-Mamber is designed as a direct response to this complementarity: one channel exploits Mamba where local, intra-variable temporal structure is central, and the other exploits linear attention where global temporal interactions across time steps are central [2507.04381].

The model therefore defines two tokenizations of the same normalized input $\mathbf{X}_{norm}\in\mathbb{R}^{B\times L\times V}$. The time-token view is
\[
\mathbf{X}_{t\text{-token}}\in\mathbb{R}^{L\times V},
\]
where the token at time $i$ is $\boldsymbol{x}_{1:V}^{(i)}=(x_1^{(i)},\ldots,x_V^{(i)})$. The variable-token view is
\[
\mathbf{X}_{v\text{-token}}\in\mathbb{R}^{V\times L},
\]
where the token for variable $j$ is $\boldsymbol{x}_{1:L}^{(j)}=(x_1^{(j)},\ldots,x_L^{(j)})$. The architectural claim of DC-Mamber is that both views are necessary, and that assigning each view to the branch most compatible with it improves forecasting accuracy [2507.04381].

## 2. Architectural organization

DC-Mamber has four principal components: a dual-channel token embedding layer, dual-channel encoders stacked $N$ times, a feature-fusion module, and a prediction head. The processing flow is: normalize the input, construct two feature representations through separate embedding layers, process them in parallel through a temporal encoder and a variable encoder, align the resulting features to a common variable dimension, fuse them with an MLP and LayerNorm, and project to the forecast horizon [2507.04381].

| Component | Representation | Function |
|---|---|---|
| T-Embedding + T-Encoder | $\mathbb{R}^{B\times L\times D}$ | Global temporal dependencies under channel-mixing |
| V-Embedding + V-Encoder | $\mathbb{R}^{B\times V\times D}$ | Local intra-variable dependencies under channel-independent processing |
| Fusion + Projector | $\mathbb{R}^{B\times V\times D}$ to $\mathbb{R}^{B\times W\times V}$ | Integrate both channels and predict future values |

The temporal branch begins with T-Embedding. Positional encoding is added to the normalized input, after which a two-layer feed-forward projection maps the variable dimension $V$ to the hidden dimension $D$:
\[
\text{T-Embedding}(x)=\text{ReLU}(\mathbf{W}_1 x+\mathbf{b}_1)\mathbf{W}_2+\mathbf{b}_2,
\]
producing $\mathbf{X}_{tem}\in\mathbb{R}^{B\times L\times D}$. This representation preserves the multivariate state at each time step and prepares it for linear attention [2507.04381].

The variable branch begins with V-Embedding. The normalized input is permuted to $\mathbb{R}^{B\times V\times L}$ and then projected from $L$ to $D$ by a two-layer feed-forward mapping written in the paper as
\[
\begin{split}
\text{V-Embedding}(x) &= \text{ReLU}(\mathbf{W}_{1} \cdot \text{permute}(x))\mathbf{W}_2 \\
&\quad + \text{ReLU}(\mathbf{b}_1)\mathbf{W}_2 + \mathbf{b}_2.
\end{split}
\]
The output is $\mathbf{X}_{var}\in\mathbb{R}^{B\times V\times D}$, where each variable obtains a dedicated latent representation of its temporal evolution [2507.04381].

## 3. Variable encoder: Bi-Mamba and channel-independent modeling

The variable encoder is the Mamba-based branch. It operates on $\mathbf{X}_{var}\in\mathbb{R}^{B\times V\times D}$ and is intended to capture local, intra-variable temporal structure through a channel-independent strategy. Its theoretical basis is the selective SSM formulation of Mamba. The continuous-time dynamics are written as
\[
\begin{split}
h'(t) &= \mathbf{A} h(t) + \mathbf{B} x(t), \\
y(t) &= \mathbf{C} h(t),
\end{split}
\]
and after zero-order hold discretization with step $\Delta$,
\[
\begin{split}
\overline{\mathbf{A}} &= \exp(\Delta \mathbf{A}),\\
\overline{\mathbf{B}} &= (\Delta \mathbf{A})^{-1}(\exp(\Delta \mathbf{A})-\mathbf{I})\cdot \Delta \mathbf{B},
\end{split}
\]
which yields
\[
\begin{split}
h_t &= \overline{\mathbf{A}} h_{t-1} + \overline{\mathbf{B}} x_t, \\
y_t &= \mathbf{C} h_t.
\end{split}
\]
These equations provide the state-space substrate from which the Mamba block is constructed [2507.04381].

DC-Mamber uses a bidirectional variant, Bi-Mamba, to mitigate the unidirectional character of standard Mamba. The forward and backward passes are denoted
\[
\begin{split}
\overrightarrow{\mathbf{Y}} &= \overrightarrow{\text{Mamba}}(\mathbf{X}_{var}),\\
\overleftarrow{\mathbf{Y}} &= \overleftarrow{\text{Mamba}}(\mathbf{X}_{var}),\\
Y_{\text{Bi-Mamba}} &= \overrightarrow{\mathbf{Y}} + \overleftarrow{\mathbf{Y}}.
\end{split}
\]
This design gives each variable access to information from both directions within its representation, which the paper positions as advantageous for temporal dependency capture [2507.04381].

The Mamba block itself is described procedurally. A linear projection first expands the input into $\mathbf{x},\mathbf{z}\in\mathbb{R}^{B\times V\times ED}$. A Conv1D followed by SiLU produces $\mathbf{x}'$. The model then learns a structured state matrix $\mathbf{A}\in\mathbb{R}^{D\times N}$ and computes input-dependent $\mathbf{B},\mathbf{C}\in\mathbb{R}^{B\times V\times N}$ from $\mathbf{x}'$. The dynamic step $\Delta$ is computed with a softplus transformation, after which the parameters are discretized to $\overline{\mathbf{A}},\overline{\mathbf{B}}\in\mathbb{R}^{B\times V\times D\times N}$. A selective SSM computation produces $\mathbf{y}\in\mathbb{R}^{B\times V\times ED}$, which is gated with $\text{SiLU}(\mathbf{z})$ and projected back to $\mathbf{Y}\in\mathbb{R}^{B\times V\times D}$ [2507.04381].

At the encoder level, the branch follows a Transformer-like residual layout:
\[
\begin{split}
X_0' &= X_{var} + \text{Dropout}(\text{Bi-Mamba}(X_{var})),\\
X_1' &= \text{Layer-norm}(X_0'),\\
Y_{\text{V-Encoder}} &= \text{Layer-norm}\left(X_1' + \text{MLP-block}(X_1')\right).
\end{split}
\]
The MLP-block is Conv1D-based. Stacking $N$ such layers yields $M_{var}\in\mathbb{R}^{B\times V\times D}$, the variable-centric representation passed to fusion [2507.04381].

## 4. Temporal encoder: linear Transformer and channel-mixing modeling

The temporal encoder operates on $\mathbf{X}_{tem}\in\mathbb{R}^{B\times L\times D}$ and uses a channel-mixing strategy in which each time step is a token containing all variables. Its purpose is to model global temporal dependencies across the sequence while preserving computational efficiency. Rather than full self-attention, DC-Mamber adopts a Linformer-style linear attention, which reduces the dependence on sequence length from quadratic to linear in $L$ when the projection dimension is fixed [2507.04381].

Given $Q,K,V\in\mathbb{R}^{L\times d}$ and projection matrices $E,F\in\mathbb{R}^{k\times L}$ with $k\ll L$, the branch defines
\[
K_{\text{proj}} = EK,\qquad V_{\text{proj}} = FV,
\]
and then computes
\[
\text{Linear-attention}(Q,K_{\text{proj}},V_{\text{proj}})
=
\text{softmax}\left(\frac{QK_{\text{proj}}^T}{\sqrt{d}}\right)V_{\text{proj}}.
\]
The use of projected keys and values is the mechanism by which the temporal branch preserves efficiency on long contexts [2507.04381].

The T-Encoder layer is written as
\[
\begin{split}
X_0 &= X_{tem} + \text{Dropout}(\text{Linear-attention}(X_{tem})),\\
X_1 &= \text{Layer-norm}(X_0),\\
Y_{\text{T-Encoder}} &= \text{Layer-norm}\bigl(X_1 + \text{MLP-block}(X_1)\bigr).
\end{split}
\]
As in the variable encoder, the feed-forward stage is Conv1D-based. Stacking $N$ layers yields $M_{tem}\in\mathbb{R}^{B\times L\times D}$ [2507.04381].

The conceptual asymmetry between the two branches is deliberate rather than incidental. Ablation results reported in the paper indicate that the best configuration is precisely the one adopted in DC-Mamber: the V-Encoder should be channel-independent and the T-Encoder should be channel-mixing. The swapped assignment, and the alternatives where both encoders use the same tokenization strategy, are reported as inferior. This suggests that the model’s gains do not derive simply from adding two branches, but from matching each architectural primitive to the data view for which it is best suited [2507.04381].

## 5. Fusion, prediction, and optimization

After the parallel encoder stacks, the two feature maps have incompatible token axes: $M_{tem}\in\mathbb{R}^{B\times L\times D}$ and $M_{var}\in\mathbb{R}^{B\times V\times D}$. DC-Mamber therefore aligns the temporal features to the variable dimension. The temporal tensor is permuted to $\mathbb{R}^{B\times D\times L}$, projected along $L$ to $V$, and permuted back to obtain $M'_{tem}\in\mathbb{R}^{B\times V\times D}$. It is then concatenated with $M_{var}$ along the feature dimension to produce $x\in\mathbb{R}^{B\times V\times 2D}$ [2507.04381].

Fusion is implemented by an MLP with LayerNorm:
\[
\begin{split}
\text{Feature-fusion}(M'_{\text{tem}},M_{\text{var}})
=
\text{Layer-Norm}\Bigl(
\mathbf{W}_2\bigl(\text{ReLU}(\mathbf{W}_1 x+\mathbf{b}_1)\bigr)+\mathbf{b}_2
\Bigr),
\end{split}
\]
where $\mathbf{W}_1\in\mathbb{R}^{2D\times D}$ and $\mathbf{W}_2\in\mathbb{R}^{D\times D}$. The result is a fused representation $Y\in\mathbb{R}^{B\times V\times D}$. A linear projector then maps $D$ to the forecast horizon $W$, yielding $\mathbb{R}^{B\times V\times W}$, which is permuted to the final prediction tensor $\hat{\mathbf{Y}}\in\mathbb{R}^{B\times W\times V}$ [2507.04381].

Training uses mean squared error,
\[
\text{MSE}=\frac{1}{n}\sum_{i=1}^{n}(y_i-\hat{y}_i)^2,
\]
while evaluation also reports mean absolute error,
\[
\text{MAE}=\frac{1}{n}\sum_{i=1}^{n}|y_i-\hat{y}_i|.
\]
Optimization is performed with Adam on MSE. LayerNorm is used in both encoder branches and in the fusion layer, and dropout with rate $0.1$ is applied in attention, MLP-blocks, and Mamba modules. The implementation is in PyTorch and the experiments are run on an NVIDIA RTX 3090 with CUDA 11.4. The standard look-back window is $L=96$, training lasts 10 epochs with early stopping, and the forecast horizons are dataset-specific: for ECL, Solar-Energy, Weather, and ETTm1, $W\in\{96,192,336,720\}$; for PEMS03, PEMS04, PEMS07, and PEMS08, $W\in\{12,24,48,96\}$ [2507.04381].

The computational argument of the model is equally central. Standard Transformer attention under channel-mixing has complexity $O(L^2D)$, and under channel-independent tokenization has complexity $O(V^2D)$. By contrast, the T-Encoder uses Linformer-style linear attention with complexity approximately $O(LkD)$, while the V-Encoder inherits Mamba’s linear dependence on the scanned dimension. This places both channels in a linear-time regime with respect to their primary sequence axes, which the paper identifies as essential for long-sequence forecasting [2507.04381].

## 6. Empirical results, ablations, and relation to similarly named models

DC-Mamber is evaluated on eight public datasets spanning traffic, electricity, energy, weather, and transformer temperature forecasting: PEMS03, PEMS04, PEMS07, PEMS08, ECL, Solar-Energy, Weather, and ETTm1. The baseline set includes S-Mamba, iTransformer, PatchTST, Crossformer, FEDformer, Stationary Transformer, TimesNet, RLinear, DLinear, TiDE, and SCINet. The paper reports that DC-Mamber achieves the best average performance in MSE and MAE on almost all datasets and horizons, with an average reduction of $4.2\%$ in MSE and $4.9\%$ in MAE compared to state-of-the-art baselines. It also records 30 first places in MSE and 30 in MAE across all dataset-horizon combinations [2507.04381].

The gains are especially visible relative to the nearest Mamba-family baseline, S-Mamba. In average MSE across horizons, the reported reductions are: PEMS03, $0.136\rightarrow0.106$; PEMS04, $0.096\rightarrow0.083$; PEMS07, $0.088\rightarrow0.081$; PEMS08, $0.156\rightarrow0.147$; Electricity, $0.171\rightarrow0.169$; Solar-Energy, $0.244\rightarrow0.233$; Weather, $0.252\rightarrow0.250$. In average MAE, the reported reductions include PEMS03, $0.241\rightarrow0.214$; PEMS04, $0.204\rightarrow0.186$; PEMS07, $0.188\rightarrow0.177$; PEMS08, $0.243\rightarrow0.209$; Electricity, $0.267\rightarrow0.265$; Solar-Energy, $0.275\rightarrow0.259$ [2507.04381].

Ablation studies are structurally important. Removing the V-Encoder degrades performance, and removing the T-Encoder degrades it more severely; on PEMS08 averaged over horizons, the full model reports MSE $0.147$ and MAE $0.209$, compared with MSE $0.160$ and MAE $0.232$ without the V-Encoder, and MSE $0.218$ and MAE $0.273$ without the T-Encoder. Further ablations show that the adopted tokenization-to-encoder assignment is the best one: on PEMS04 average performance, the reported values are MSE $0.083$, MAE $0.186$ for the proposed design; MSE $0.089$, MAE $0.197$ for the swapped design; MSE $0.093$, MAE $0.199$ when both encoders are channel-independent; and MSE $0.152$, MAE $0.260$ when both are channel-mixing [2507.04381].

Parameter-sensitivity experiments indicate that the learning rate depends on the dataset, that $d_{\text{state}}$ has a relatively minor effect, and that moderate increases in $d_{\text{model}}$ tend to help while overly small or overly large values can hurt. The paper also includes prediction-curve comparisons against S-Mamba and states that DC-Mamber’s predicted trajectories are closer to ground truth, with smaller deviations in amplitude and phase, especially on difficult horizons and high-dimensional traffic datasets [2507.04381].

The name “DC-Mamber” belongs specifically to the multivariate forecasting model described above. It should be distinguished from several similarly named Mamba-family systems in other domains, including “DCAMamba,” a framework for rapid DC arc fault detection [2503.01264], “DC-Mamba,” an “align-then-enhance” remote sensing change detection framework [2509.15563], and “DCMamba,” a semi-supervised medical image segmentation framework [2508.13712]. This suggests that the “DC” prefix is not semantically fixed across the literature; in the case of DC-Mamber, it denotes a dual-channel architecture in which Mamba and linear Transformer are combined within a single forecasting model [2507.04381].

Source: https://www.emergentmind.com/topics/dc-mamber