---
title: 'RegistrationMamba: Mamba-Based Image Registration'
url: https://www.emergentmind.com/topics/registrationmamba
type: topic
---

# RegistrationMamba: Mamba-Based Image Registration

Searching arXiv for recent papers on RegistrationMamba and related Mamba-based registration methods.
RegistrationMamba is a Mamba-based registration framework for cross-modal remote sensing image registration, proposed to align images from different sensors or modalities, most notably optical–SAR pairs, under pronounced nonlinear radiometric variation and limited texture [2507.04397]. The method replaces a conventional CNN- or Transformer-dominated encoder with a visual state space encoder and combines three elements: global context feature extraction using a Mamba-based visual state space backbone, multi-level feature aggregation for local-detail recovery, and multi-expert feature learning for feature enrichment under texture-limited conditions [2507.04397]. In the broader literature, the name also sits within an emerging class of “RegistrationMamba”-style systems in which state space models serve as the registration backbone for dense medical registration, multi-modal deformable alignment, or point cloud registration, typically to obtain long-range dependency modeling with linear complexity rather than quadratic self-attention [2401.13934] [2404.05105] [2411.01399] [2506.13183].

## 1. Definition and problem setting

RegistrationMamba is designed for cross-modal remote sensing image registration, a task in which images from distinct sensing modalities must be aligned despite modality-dependent appearance differences and limited discriminative texture [2507.04397]. The paper emphasizes two central difficulties. The first is nonlinear radiometric variation, described as a modality gap arising because optical and SAR images are generated by fundamentally different imaging physics. The second is limited texture and repetitive local patterns, which makes discriminative correspondence extraction difficult, especially in homogeneous or high-resolution regions [2507.04397].

The framework is positioned against two dominant design families. CNN-based registration methods are described as being limited by the local receptive field and therefore weak in long-range contextual modeling. Transformer-based methods improve global modeling but incur quadratic self-attention cost, which restricts their applicability to high-resolution cross-modal remote sensing imagery [2507.04397]. RegistrationMamba is presented as a middle-ground design in which global modeling is achieved through state space sequence processing with linear complexity, while local discriminability is strengthened by dedicated aggregation and expert-fusion modules [2507.04397].

A broader reading of the literature suggests that RegistrationMamba is both a specific method and an instance of a wider research direction: using Mamba or related state space models as the global registration backbone in settings where registration depends on long-range correspondence but cannot tolerate the cost of full attention [2401.13934] [2404.05105] [2506.13183]. This suggests that the term can denote not only the specific optical–SAR architecture, but also a broader architectural motif in registration research.

## 2. Architectural composition

The framework has three major parts: a Mamba-based visual state space encoder for global context feature extraction, a multi-level feature aggregation module for local texture refinement, and a multi-expert feature learning strategy for richer representations under texture-limited conditions [2507.04397]. The encoder uses a 2D selective scanning module over image features, while the aggregation and expert-learning components address the local-detail and representation-enrichment deficiencies that would remain if one relied on global sequence modeling alone [2507.04397].

The encoder is hierarchical. Input images are first processed by a \(7\times7\) convolutional block, then patchified and passed through multiple visual state space blocks, with downsampling between stages [2507.04397]. The paper specifies three feature scales, with two cascaded VSS blocks per scale and output channels \(96\), \(192\), and \(384\) [2507.04397]. This design couples large receptive-field propagation with a multi-scale feature hierarchy.

The multi-expert feature learning component is explicitly motivated by texture scarcity. An image transformation pool generates augmented image variants through flipping, random rotation, and homography transformation, producing transformed inputs \(X_S^n=T_n(X_S)\) [2507.04397]. Each transformed image is passed through RegistrationMamba to obtain features \(F_S^n\), which are then processed by expert-specific modules \(E_n\) and fused by a learnable soft router [2507.04397]. Unlike sparse mixture-of-experts designs that select only a subset of experts, the paper states that MEFL fuses information from all experts for richer feature representation [2507.04397].

The multi-level feature aggregation module integrates global contextual features with local texture details. It consists of MSAA, used at most encoder levels, and CA, used only for the deepest feature level \(F'_3\) [2507.04397]. MSAA uses multi-scale depthwise convolutions and adaptive gating, with channel split ratios
\[
\delta_1=\frac{3}{8},\quad \delta_2=\frac{1}{2},\quad \delta_3=\frac{1}{8},
\]
while CA performs lightweight channel reallocation at the most semantically abstract level [2507.04397]. After MFA, multi-level features are upsampled, concatenated, and adaptively fused to produce final template and reference representations [2507.04397].

## 3. State space formulation and cross-scanning mechanism

RegistrationMamba adopts the standard continuous-time state space formulation
\[
\left\{\begin{array}{l}
h^{\prime}(t)=\mathbf{A} h(t)+\mathbf{B} x(t), \\
y(t)=\mathbf{C} h(t)+\mathbf{D} x(t),
\end{array}\right.
\]
followed by a Mamba-style discretization using zero-order hold [2507.04397]. The discrete form is given as
\[
\left\{\begin{array}{l}
\mathbf{\bar{A}=\exp(\bigtriangleup \mathbf{A}),} \\
\mathbf{\bar{B}=(\bigtriangleup \mathbf{A})^{-1}\left(\exp(\bigtriangleup \mathbf{A})-I\right)\cdot \bigtriangleup \mathbf{B},
\end{array}\right.
\]
with the state update
\[
\left\{\begin{array}{l}
h'_{t}=\mathbf{\bar A} h_{t-1}+\mathbf{\bar B} x_{t}, \\
y_{t}=\mathbf{C} h_{t}.
\end{array}\right.
\]
The sequence can also be written as a convolution with an effective kernel \(\mathbf{\bar K}\) [2507.04397].

The critical Mamba-specific distinction is selective scanning, in which parameters become input-dependent:
\[
\left\{\begin{array}{l}
\bar{\mathbf{B}=s_{B}(x),} \\
\bar{\mathbf{C}=s_{C}(x),} \\
\bigtriangleup =\tau_{\bigtriangleup}(\Theta+s_{\bigtriangleup}(x)).
\end{array}\right.
\]
The paper describes this as converting the model into a linear time-varying system so that state updates adapt to the input content [2507.04397].

For 2D imagery, RegistrationMamba uses a 2D selective scanning module, SS2D. Given input feature \(f\), the formulation is
\[
\left\{ \begin{array}{l}
f_{j}=Expand(f,j), \\
\bar f_{j}=S6(f_{j}), \\
f'=Merge(\bar f_{1}, \bar f_{2}, \bar f_{3}, \bar f_{4}),
\end{array} \right.
\]
where \(Expand(\cdot)\) forms sequences from the 2D feature map in four scanning directions, \(S6\) denotes the selective cross-scanning state sequential model, and \(Merge(\cdot)\) recombines the outputs into a 2D feature map [2507.04397]. This multi-directional cross-scanning is the mechanism by which the framework captures image-wide contextual relationships with linear complexity.

This design places RegistrationMamba within a larger class of visual state space adaptations. VMambaMorph extends a visual state space cross-scan block to 3D volumetric registration, aiming to propagate information across axial, sagittal, and coronal dependencies in brain MR–CT registration [2404.05105]. MT-PCR uses Z-order serialization to convert unordered 3D point clouds into sequences that Mamba can process for coarse matching before Transformer refinement [2506.13183]. These related systems indicate that the central challenge is not only replacing attention, but adapting state space processing to the geometry of the registration domain.

## 4. Feature enrichment and matching objective

MEFL is one of the distinctive components of RegistrationMamba. For each transformed template image \(X_S^n\), the framework extracts features \(F_S^n = RegistrationMamba(X_S^n)\), then passes them through expert modules:
\[
\bar{F}_{S}^{n} = E_{n}(F_{S}^{n}).
\]
The expert outputs are fused through a learnable soft router, with router parameters \(\alpha_i\) mapped to weights
\[
w_i = softmax(\alpha_i) = \frac{e^{\alpha_i}}{\sum_{j=0}^{n-1} e^{\alpha_j}},
\]
and final aggregated feature
\[
F_{S} = \sum_{i=0}^{n-1} w_i \cdot \bar{F}_{S}^{i}.
\]
The paper states that soft fusion outperforms both sparse top-2 expert selection and equal weighting, and that increasing the number of experts from \(2\) to \(4\) improves performance, with \(4\) experts chosen as the best trade-off [2507.04397].

For similarity computation, the template feature map is treated as a convolution kernel and slid over the reference feature map:
\[
F[i,j] = \sum_{c=1}^{C}\sum_{k=1}^{H_S}\sum_{l=1}^{W_S} F_S[c,k,l]\cdot F_O[c,i+k,j+l].
\]
The normalized similarity is then
\[
Sim[i,j] = \frac{F[i,j]}{\|F_S\|_2 \cdot \|F_O\|_2}.
\]
The paper states that this convolutional correlation is GPU-friendly and faster than pixel-wise matching [2507.04397].

The training objective follows F3Net and consists of three losses. The matching loss uses a \(7\times7\) positive region around the ground-truth location and the top-\(k\) hardest negatives with \(k=49\):
\[
L_m = (S_{neg}+1)^2 + (1-S_{pos})^2.
\]
The fine similarity loss uses a Gaussian target and top-\(k'\) supervision with \(k'=9\):
\[
\left\{ \begin{array}{l}
G_{gt}=Gaussian(gt), \\
L_{fine}=(topk'(G_{gt})-S_{pos}^{topk'})^2,
\end{array} \right.
\]
and the similarity peak loss is
\[
L_{peak}=2-(max(S)-mean(S)).
\]
The final objective is
\[
L_{final}=L_m+\gamma_1 L_{fine}+\gamma_2 L_{peak},
\]
with \(\gamma_1=1\) and \(\gamma_2=1\) [2507.04397].

A plausible implication is that RegistrationMamba does not treat long-range modeling, local detail, and matching supervision as interchangeable. Instead, global context is handled by the VSS encoder, local texture by MFA, and ambiguity reduction by MEFL and a correlation-based similarity objective.

## 5. Datasets, implementation, and empirical results

The method is evaluated on two optical–SAR datasets with different resolutions [2507.04397]. SEN1-2 contains \(282{,}384\) co-registered optical/SAR patch pairs from Sentinel-1 and Sentinel-2 at \(10\,m\) resolution and image size \(256\times256\). Following prior work, \(6{,}450\) pairs per season are sampled, yielding \(25{,}800\) total pairs, which are split \(7{:}3\) into \(18{,}060\) training and \(7{,}740\) testing samples. The SAR template crop size is \(192\times192\) [2507.04397]. The OS dataset includes GF-3 SAR and Google Earth optical imagery at \(1\,m\) resolution, with OS-512 containing \(2{,}673\) pairs of size \(512\times512\) and OS-256 containing \(10{,}692\) pairs of size \(256\times256\); OS-512 is split into \(2{,}249\) train and \(424\) test samples with template crop \(384\times384\), and OS-256 into \(8{,}996\) train and \(1{,}696\) test samples with template crop \(192\times192\) [2507.04397].

Evaluation uses the \(L_2\) distance between predicted and ground-truth matching locations,
\[
L_2=\sqrt{(x_p-x_g)^2+(y_p-y_g)^2},
\]
and Correct Matching Rate,
\[
CMR(T)=\frac{N_{match}}{N_{total}},
\]
where a match is correct if \(L_2 \le T\) [2507.04397]. Implementation uses PyTorch on an NVIDIA RTX 4090 with AdamW, batch size \(4\), initial learning rate \(0.0005\), \(10\) training epochs, \(4\) experts in MEFL, three scales, two VSS blocks per scale, output channels \(96/192/384\), and loss weights \(\gamma_1=\gamma_2=1\) [2507.04397].

The principal reported results are summarized below.

| Benchmark | Key results | Additional notes |
|---|---|---|
| SEN1-2 | \(L_2=2.93\), CMR(1) \(=62.14\%\), CMR(2) \(=82.25\%\), CMR(3) \(=89.19\%\), CMR(5) \(=93.04\%\) | Best \(L_2\) among compared methods [2507.04397] |
| OS-512 | \(L_2=2.39\), CMR(1) \(=34.67\%\), CMR(2) \(=61.32\%\), CMR(3) \(=80.42\%\), CMR(5) \(=94.58\%\) | Outperforms F3Net and DC-InfoNCE, especially at stricter thresholds [2507.04397] |
| OS-256 | \(L_2=3.39\), CMR(1) \(=24.94\%\), CMR(2) \(=48.11\%\), CMR(3) \(=67.92\%\), CMR(4) \(=78.60\%\), CMR(5) \(=85.50\%\) | \(22.14\)M parameters, \(170.24\) GFLOPs, \(123\) ms average time per pair [2507.04397] |

On SEN1-2, the paper reports improvement in CMR(3) from \(82.00\%\) for MARU-Net to \(89.19\%\), from \(87.24\%\) for F3Net to \(89.19\%\), and a \(15.19\)-point CMR(3) improvement over FFT U-Net [2507.04397]. On OS-256, a framework comparison states that UNet is lighter but weaker, while TransUNet and U-Transformer benefit from global modeling but are far more expensive; RegistrationMamba is reported to achieve better accuracy than these baselines while being much more efficient than Transformer-based alternatives [2507.04397].

The paper also reports average registration time on SEN1-2: NCC \(57\) ms, MI \(5450\) ms, DDFN \(239\) ms, Siamese CNN \(629\) ms, FFT U-Net \(437\) ms, MARU-Net \(396\) ms, and RegistrationMamba \(123\) ms [2507.04397]. Under Gaussian noise added to OS optical images, the method is reported to remain stable from \(2\%\) to \(20\%\) variance and to degrade only slightly beyond \(22\%\) variance [2507.04397]. It is additionally reported to be less sensitive to template-size reduction than F3Net [2507.04397].

## 6. Ablation evidence and relation to the wider Mamba registration literature

The ablation study on OS-256 isolates the effect of the main modules [2507.04397]. Starting from a base CNN U-Net with \(L_2=4.39\) and CMR(3) \(=56.43\%\), adding Mamba yields \(L_2=3.93\) and CMR(3) \(=62.85\%\), adding MEFL yields \(L_2=3.69\) and CMR(3) \(=65.04\%\), and the full model reaches \(L_2=3.39\) and CMR(3) \(=67.92\%\) [2507.04397]. MFA ablations show that removing MSAA gives \(L_2=3.65\) and CMR(3) \(=65.57\%\), removing CA gives \(L_2=3.46\) and CMR(3) \(=66.63\%\), removing both gives \(L_2=3.49\) and CMR(3) \(=65.15\%\), and full MFA restores the best \(L_2=3.39\) and CMR(3) \(=67.92\%\) [2507.04397]. Expert-number ablations show \(0\) experts at \(L_2=3.93\), CMR(3) \(=62.85\%\); \(2\) experts at \(L_2=3.70\), CMR(3) \(=65.04\%\); \(3\) experts at \(L_2=3.53\), CMR(3) \(=66.16\%\); and \(4\) experts as the best setting with \(L_2=3.39\), CMR(3) \(=67.92\%\), after which performance saturates [2507.04397].

These results support the paper’s claim that the framework succeeds through the joint action of linear-time global context modeling, local texture enhancement, and multi-view expert feature enrichment [2507.04397]. They also clarify a recurring theme in Mamba-based registration research: Mamba alone is typically not the whole method. In MambaMorph, a simple fine-grained U-Net extractor is paired with a Mamba-based registration module, and the combination is reported to improve SR-Reg Dice from \(78.98\%\) for \(\text{MambaMorph}_{reg}\) to \(82.71\%\) for the full model [2401.13934]. In VMambaMorph, a hybrid VMamba-CNN backbone plus recursive refinement yields Dice \(82.94\pm2.01\) and HD\(_{95}\) \(1.35\pm0.18\) on SR-Reg, surpassing the reported MambaMorph baseline on that benchmark [2404.05105]. In MambaReg, disentanglement of modality-dependent and modality-invariant features is combined with Bi-Mamba and ROI-aware training, producing Dice \(83.44\), MSE \(51.00\times10^{-4}\), NCC \(91.01\), and SSIM \(83.88\) on the reconstructed MSU-PID RGB-IR dataset [2411.01399]. In MT-PCR, Z-order serialization and an optimized Mamba encoder are used for scalable coarse matching, with Transformer refinement retained for sparse and dense point cloud registration [2506.13183].

A common misconception would be that “RegistrationMamba” simply means substituting a Transformer with Mamba. The literature summarized here indicates a more specific pattern. In each case, the state space component is adapted to the geometry of the registration domain and paired with modules that address domain-specific deficiencies: feature extraction for multi-modal medical volumes [2401.13934], cross-scan redesign and recursion for 3D volumetric alignment [2404.05105], disentangled sparse coding and ROI emphasis for RGB–IR plant images [2411.01399], or spatial serialization plus Transformer refinement for point clouds [2506.13183]. RegistrationMamba follows the same pattern through SS2D scanning, MFA, and MEFL [2507.04397].

## 7. Significance, limitations, and research context

RegistrationMamba is significant within cross-modal remote sensing because it addresses both of the paper’s stated failure modes—modality gap and texture scarcity—within a single linear-complexity framework [2507.04397]. The visual state space encoder supplies global dependency modeling, MFA recovers local discriminability, and MEFL enriches features by aggregating transformed image variants through multiple experts [2507.04397]. This architecture is explicitly intended to preserve the computational advantages of Mamba over self-attention while avoiding the locality limitations of pure CNN designs [2507.04397].

The paper’s stated limitation is that performance still requires improvement in extremely sparse-texture and highly repetitive-texture scenes [2507.04397]. This is important because those cases are structurally aligned with the motivating difficulties of CRSI registration itself. A plausible implication is that, although global sequence modeling reduces ambiguity, it does not entirely eliminate the need for stronger inductive bias or richer supervision when local evidence is intrinsically weak or repetitive.

Within the wider literature, RegistrationMamba exemplifies an ongoing shift from attention-centric registration backbones toward state space alternatives that aim to retain global reasoning while improving scaling behavior. MambaMorph frames this in terms of deformable MR–CT registration and efficient long-range spatial correspondence modeling in 3D volumes [2401.13934]. VMambaMorph extends the idea to visual state space cross-scan modules and recursive refinement [2404.05105]. MambaReg emphasizes interpretability through disentanglement of modality-independent and modality-dependent features [2411.01399]. MT-PCR shows that when the underlying data are unordered, a registration-capable Mamba architecture may require explicit geometric serialization before selective scanning becomes effective [2506.13183]. RegistrationMamba contributes the remote-sensing counterpart of this trajectory: a cross-modal, optical–SAR registration system centered on multi-directional selective scanning, multi-level local aggregation, and multi-expert augmentation-aware feature fusion [2507.04397].

Source: https://www.emergentmind.com/topics/registrationmamba