---
title: 'CD-MAMP: Cross-Domain Memory Approx. Message Passing'
url: https://www.emergentmind.com/topics/cross-domain-memory-approximate-message-passing-cd-mamp
type: topic
---

# CD-MAMP: Cross-Domain Memory Approx. Message Passing

Searching arXiv for the cited papers and related CD-MAMP work.
arxiv_search(query="Cross-Domain Memory Approximate Message Passing OR CD-MAMP", max_results=10)
arxiv_search(query="Memory Approximate Message Passing 2106.02237", max_results=5)
arxiv_search(query="Interleaved Block-Sparse Transform 2407.13255", max_results=5)
arxiv_search(query="Interleave Frequency Division Multiplexing 2405.02604", max_results=5)
arxiv_search(query="WHTDM Walsh-Hadamard Transform Division Multiplexing 2605.14482", max_results=5)
arxiv_search(query="Achievable Rate and Coding Principle for MIMO Multicarrier Systems With Cross-Domain MAMP Receiver Over Doubly Selective Channels 2601.04433", max_results=5)
Cross-Domain Memory Approximate Message Passing (CD-MAMP) denotes a family of iterative Bayesian inference architectures that extend Memory Approximate Message Passing (MAMP) by separating the linear and nonlinear stages across different domains while retaining long-memory correction, orthogonality, and state-evolution-based design. In the underlying MAMP framework, the estimation problem is posed on the high-dimensional linear model $y = A x_0 + w$, where $x_0$ has an IID prior, $w$ is Gaussian noise, and $A$ is typically right-unitarily invariant (RUI) rather than IID. MAMP was introduced to bridge the gap between low-complexity AMP, which can diverge on non-IID or ill-conditioned matrices, and Bayes-optimal OAMP/VAMP, whose LMMSE linear estimator is computationally expensive. Later CD-MAMP constructions place the memory linear estimator in one domain—such as a time, transform, or WHT domain—and the nonlinear MMSE estimator in another—such as a source or symbol domain—thereby adapting MAMP’s orthogonality principle to compressed sensing, multicarrier equalization, and coded MIMO receivers [2012.10861].

## 1. Conceptual origin in MAMP

MAMP originates from the observation that canonical AMP is low-complexity but depends on IID sub-Gaussian sensing matrices, whereas OAMP/VAMP extends to RUI matrices at the cost of a high-complexity LMMSE step. In the MAMP formulation of Liu, Huang, and Kurkoski, the linear estimator and nonlinear estimator are both allowed to use memory of past iterates. The memory linear estimator and nonlinear estimator are written as
\[
\text{LE:}\quad r_t = Q_t y + \sum_{i=1}^t P_{t,i} x_i,
\qquad
\text{NLE:}\quad x_{t+1} = \Phi_t(r_1,\ldots,r_t),
\]
with $Q_t$ and $P_{t,i}$ polynomial in $A^H A$ and $\Phi_t$ separable-and-Lipschitz [2106.02237].

The central design idea is that long memory can replace the explicit matrix inversion in BO-OAMP/VAMP. In Bayes-optimal MAMP (BO-MAMP), the LMMSE inverse is approximated by a long-memory matched filter driven by
\[
B = I_M - A A^H,\qquad
f_t = \theta_t B f_{t-1} + \gamma_t (y - A x_t),
\]
with the linear output formed from polynomial combinations of $A^H B^i$. This preserves a per-iteration cost of $O(MN)$, comparable to AMP, rather than the $O(M^3+M^2N)$ cost associated with BO-OAMP/VAMP [2012.10861].

The theoretical result that gives MAMP its importance is fixed-point equivalence: for all RUI matrices, the state evolution of optimized BO-MAMP converges to the same fixed point as high-complexity BO-OAMP/VAMP, and when that state evolution has a unique fixed point, the algorithm achieves the Bayes-optimal MSE predicted by the replica method [2012.10861]. A plausible implication is that later CD-MAMP constructions are best understood as domain-specific realizations of this MAMP principle rather than as a separate inference theory.

## 2. Cross-domain architecture

In later literature, “cross-domain” refers to performing the memory linear estimator in one representation of the signal while performing the nonlinear MMSE estimation in another. The cross-domain split is explicit in several systems: IBS-CD-MAMP uses a memory linear estimator in the IBS transform domain and a nonlinear estimator in the source domain; IFDM CD-MAMP uses a memory matched filter in the time domain and a nonlinear detector in the interleave-frequency domain; WHTDM uses a WHT-domain linear model and symbol-domain denoising; and MS-CD-MAMP couples time-domain sparse detection with symbol-domain constellation and coding constraints [2407.13255].

| Construction | Linear stage domain | Nonlinear stage domain |
|---|---|---|
| IBS-CD-MAMP | IBS transform domain | Source domain |
| IFDM CD-MAMP | Time domain | Interleave-frequency domain |
| WHTDM CD-MAMP | WHT domain | Symbol domain |
| MS-CD-MAMP | Time domain across slots | Symbol domain with coding |

A representative cross-domain loop appears in IFDM. The transmitted signal is
\[
x = U s = \Pi F_N^H s,
\]
the time-domain received model is
\[
y = H x + w,
\]
and the inverse IF transform gives
\[
\hat{y} = U^{-1} y = F_N \Pi^{-1} H \Pi F_N^H s + \tilde{w}
= H_{\mathrm{eff}} s + \tilde{w}.
\]
The detector then alternates between a time-domain memory matched filter
\[
r_t = \gamma_t(X_t)
= \tfrac{1}{\varepsilon_t^\gamma}\bigl(\hat{\gamma}_t(X_t) - X_t p_t\bigr),
\]
and an interleave-frequency-domain nonlinear detector
\[
s_{t+1} = \phi_t(\tilde{r}_t)
= \tfrac{1}{\varepsilon_t^\phi}\bigl(\hat{\phi}_t(\tilde{r}_t) - p_t^\phi \tilde{r}_t\bigr),
\]
with the two domains connected by $U$ and $U^{-1}$ [2405.02604].

In IBS-CD-MAMP, the same architectural pattern is expressed through an IBS transform. The measurement model is
\[
y = A \Xi s + n,
\]
with transform-domain variable $x := \Xi s$. The memory linear estimator operates on $x$, IBS-IFT maps residuals back to the source domain,
\[
\tilde{r}_t = \Bigl(\bigcup_{l=1}^L T_l \Pi_l^{-1}\Bigr)\hat{\Pi}^{-1} r_t,
\]
and IBS-FT returns the source-domain estimate to the transform domain for the next memory update [2407.13255].

## 3. Orthogonality principle and state evolution

The defining theoretical mechanism of MAMP and CD-MAMP is full orthogonality across memory. If $f_i = x_i - x_0$ and $g_i = r_i - x_0$, then the strengthened orthogonality conditions are, for all $1 \le t' \le t$,
\[
\lim_{N\to\infty}\frac{1}{N}x_0^H g_t = 0,\qquad
\lim_{N\to\infty}\frac{1}{N}f_{t'}^H g_t = 0,\qquad
\lim_{N\to\infty}\frac{1}{N}g_{t'}^H f_{t+1} = 0.
\]
This ensures that the current output error is orthogonal to all preceding input errors, not merely to the current one, and it is this stronger condition that enables asymptotically IID Gaussian errors under long-memory recursion [2012.10861].

To enforce these constraints, MAMP introduces explicit orthogonalization procedures for both modules. In the linear estimator, trace constraints such as
\[
\mathrm{tr}\{Q_t A\} = 1,\qquad \mathrm{tr}\{P_{t,i}\}=0
\]
are imposed by subtracting trace terms from an unconstrained memory estimator. In the nonlinear estimator, an arbitrary separable Lipschitz map $\Phi_t(r_1,\ldots,r_t)$ is orthogonalized by subtracting a projection onto prior error directions, with Stein’s lemma then yielding the required decorrelation [2012.10861].

Because memory induces correlated inputs across iterations, BO-MAMP is characterized by covariance-matrix state evolution rather than a purely scalar recursion. With
\[
v_t^{\mathrm{NL}} = N^{-1}E[\|f_t\|^2],\qquad
v_t^{\mathrm{LE}} = N^{-1}E[\|g_t\|^2],
\]
and covariance matrix $V_t = [v_{i,j}]_{i,j=1}^t$, the nonlinear-stage update with $L$-length damping takes the form
\[
v_{t+1,t+1} = s_{t+1}^T V_{t+1} s_{t+1},
\qquad
s_{t+1} = \frac{[V_{t+1}]^{-1}1}{1^T[V_{t+1}]^{-1}1},
\]
when $V_{t+1}$ is invertible. This damping rule minimizes the next-iterate MSE and guarantees monotonic MSE decrease in the BO-MAMP state evolution [2012.10861].

The practical parameterization is likewise SE-driven. The relaxation parameter is chosen as
\[
\theta_t = \frac{1}{\bar{a} + p_t},\qquad p_t = \frac{\sigma^2}{v_t^{\mathrm{NL}}},
\]
to minimize $\rho(\theta_t B)$ and ensure $\rho(\theta_t B)<1$, while $\gamma_t$ is chosen in closed form to minimize $v_{t,t}^{\mathrm{LE}}$. In applications where only eigenvalue bounds are available, the literature uses surrogate bounds without significant performance loss [2012.10861].

## 4. Domain-specific constructions

The compressed-sensing version of CD-MAMP is represented by IBS-CD-MAMP. Its purpose is not only algorithmic but architectural: a single large RUI transform is replaced by an interleaved block-sparse transform
\[
\Xi_{\mathrm{IBS}}
=
\hat{\Pi}\cdot
\mathrm{blkdiag}(S_1\Pi_1T_1,\ldots,S_L\Pi_LT_L),
\]
where block-wise interleaving $\Pi_l$, row selection $S_l$, and whole-matrix interleaving $\hat{\Pi}$ collectively approximate the randomness of a large transform at lower hardware scale. The reported rationale is that both block-wise and whole interleaving are needed; weaker variants such as BS-FT, W-IBS-FT, and B-IBS-FT show worse MSE or BER [2407.13255].

The IFDM construction emphasizes a different structural point. Rather than seeking sparsity in the effective symbol-domain channel, IFDM deliberately creates a fully dense and right-unitarily invariant equivalent matrix
\[
H_{\mathrm{eff}} = F_N \Pi^{-1} H \Pi F_N^H,
\]
while exploiting the super-sparse time-domain channel $H$ inside the memory matched filter. The paper states that the IF transform enables the equivalent channel matrices to satisfy the right-unitarily invariant assumption commonly used for OAMP and MAMP, thereby supporting replica MAP-optimal detection with proper coding [2405.02604].

WHTDM adapts the same cross-domain logic to a real-valued Walsh–Hadamard modulation. After cyclic-prefix removal and WHT demodulation, the observation is
\[
z_{\mathrm{WHT}} = W^T H_c W x + \tilde{n} = Gx + \tilde{n}.
\]
Because $G$ is generally non-diagonal, the equalizer uses a banded approximation $G_B$ and alternates a banded linear step with scalar denoising. The memory mechanism is explicit:
\[
\gamma^{(t)} = \gamma^{(t-1)} - \theta_m G_B G_B^T \gamma^{(t-1)} + \theta_m r^{(t)},
\qquad
p^{(t)} = x^{(t)} + \theta G_B^T \gamma^{(t)},
\]
which the paper describes as accelerating convergence by reusing residual information from the WHT domain [2605.14482].

The most elaborate extension is the multi-slot CD-MAMP receiver for coded MIMO multicarrier systems. There, the time-domain linear stage is maintained per slot $t$,
\[
\tilde{\gamma}_{t,\ell}(X_\ell^t)
=
\theta_\ell^t B_t \tilde{\gamma}_{t,\ell-1}(X_{\ell-1}^t)
+
\xi_\ell^t (y_t - H_t x_\ell^t),
\]
the symbol-domain stage computes APP-based denoising and decoder feedback, and the analysis is reduced from high-dimensional matrix SE to a simplified SISO variational state evolution in terms of $\rho_\ell^\gamma$ and $v_\ell^{\hat{\phi}}$ [2601.04433].

## 5. Complexity and reported performance

The original appeal of MAMP is that it preserves the matched-filter complexity class. In BO-MAMP, each iteration uses matrix-vector multiplications $\{A x_t, A^H f_t, A A^H f_t\}$, giving $O(MN)$ per iteration, while covariance bookkeeping and short-memory damping contribute only negligible $O(L^3)$ overhead [2012.10861].

IBS-CD-MAMP reduces transform cost by replacing one $N$-point transform with $L$ parallel $N_s$-point transforms. The IBS transform stage therefore costs $O(N\log N_s)$ rather than $O(N\log N)$, and the total per-iteration complexity is
\[
O(PN + N + 2N\log N_s).
\]
The reported relative complexity reductions for IFDM-style settings are approximately $69.69\%$ overall at $N_s=128$, $57.57\%$ at $N_s=32$, $45.45\%$ at $N_s=8$, and $39.39\%$ at $N_s=4$, all relative to IFDM with $N_s=4096$ [2407.13255].

For IFDM, CD-MAMP combines sparse time-domain filtering with FFT/interleaving operations. The paper gives overall complexity $O(PN\mathcal{T}+2N\mathcal{T}\log N)$ and reports several performance comparisons: at BER $\approx 10^{-5}$, IFDM + CD-MAMP achieves approximately $3\,\mathrm{dB}$ gain over OTFS/AFDM with CD/DD-OAMP and approximately $9\,\mathrm{dB}$ over DD-MAMP; in $4\times4$ MIMO it outperforms OFDM, OTFS, and AFDM by more than $5\,\mathrm{dB}$; and its running time is approximately $100\times$ faster than OTFS + CD-OAMP, approximately $10\times$ faster than OTFS + DD-MAMP, and approximately $2\times$ faster than AFDM + CD-MAMP [2405.02604].

In WHTDM, the equalizer-side cost is $O(NB)$ per iteration because the algorithm operates on the banded matrix $G_B$. The transmitter-side counts for a $1024$-symbol block are $0$ real multiplications and $12{,}288$ real additions for WHTDM, versus $12{,}288$ real multiplications and $18{,}432$ real additions for OFDM. Under the 3GPP TDL-C model at $28\,\mathrm{GHz}$, WHTDM with CD-MAMP achieves over an order of magnitude lower BER than OFDM 1-tap MMSE at $120\,\mathrm{km/h}$, maintains BER below $3\times 10^{-2}$ across $0$–$500\,\mathrm{km/h}$ at $\mathrm{SNR}=20\,\mathrm{dB}$ for delay spreads $30$–$300\,\mathrm{ns}$, and among the compared CD-MAMP-equalized new waveforms yields the best BER [2605.14482].

For coded MIMO multicarrier reception, MS-CD-MAMP is positioned against MS-CD-OAMP/VAMP. The reported complexity is
\[
O(\mathbb{I}N J L T + 2NJL\log N + ML),
\]
and the runtime at BER $\approx 10^{-5}$ is approximately $28\%$ of MS-CD-OAMP/VAMP. On the information-theoretic side, the paper reports that coded MIMO-OFDM, OTFS, and AFDM with MS-CD-MAMP achieve the same maximum achievable rate in doubly selective channels, and that optimized finite-length LDPC codes operate only $0.5\sim1.8\,\mathrm{dB}$ from the associated theoretical limit while gaining $0.8\sim4.4\,\mathrm{dB}$ over well-designed point-to-point LDPC codes [2601.04433].

## 6. Scope, misconceptions, and open questions

A recurrent misconception is to treat CD-MAMP as a generic claim of Bayes-optimality in any multi-domain system. The literature is more specific. Exact fixed-point equivalence and Bayes-optimal MSE are established for optimized MAMP under RUI matrices and unique state-evolution fixed points; in IBS-CD-MAMP, by contrast, the transform only approximates RUI, and the paper explicitly states that the optimality claim is empirical rather than formally proven [2012.10861].

Another misconception is that cross-domain processing is inherently superior to domain-matched diagonalization. The WHTDM study provides a counterexample: in static channels, OFDM with 1-tap MMSE achieves the best BER, while WHTDM and other transform-domain waveforms exhibit error floors because their equivalent channel matrices remain non-diagonal and CD-MAMP convergence is then limited by residual coupling [2605.14482]. Similarly, IFDM’s benefits derive from deliberate dense right-unitarily invariant mixing, not from preserving sparsity in the effective symbol-domain channel [2405.02604].

Several practical caveats recur across the literature. Convergence without damping is not guaranteed in MAMP; $L=1$ may fail, while $L=2$ or $3$ is usually sufficient [2106.02237]. In IBS-CD-MAMP, uneven block extraction harms performance, and both local and global interleaving are required [2407.13255]. In WHTDM, the choice of band width $B$, step sizes $\theta$ and $\theta_m$, and damping $\alpha$ becomes more delicate as delay and Doppler spreads grow [2605.14482]. In MS-CD-MAMP, perfect CSI is assumed, and the coding analysis depends on uniformly Lipschitz decoding modules [2601.04433].

The stated research directions are correspondingly concrete. The IBS work identifies formal state evolution for rectangular, interleaved, block-sparse transforms as open, and suggests adaptive IBS, learned denoisers, hybrid FFT/FWHT blocks, and joint design of memory filters and interleavers [2407.13255]. The WHTDM paper points to pilot-aided WHT-domain channel estimation and adaptive bandwidth tracking [2605.14482]. A plausible synthesis of these directions is that future CD-MAMP research will center

Source: https://www.emergentmind.com/topics/cross-domain-memory-approximate-message-passing-cd-mamp