LGANet++: Unsupervised 3D Image Registration

• The paper presents LGANet++, which integrates local-global attention and image decomposition within a coarse-to-fine 3D CNN to enhance registration accuracy.
• The method outperforms state-of-the-art techniques, showing up to 6.12% DSC improvement and reduced errors in cross-patient, cross-time, and cross-modal scenarios.
• It ensures topology preservation and robustness through a diffeomorphic refinement layer and multi-scale fusion, making it promising for diverse clinical applications.

Searching arXiv for the specified paper and closely related registration work. arxiv_search.query({"^^^^^^^^2search_query2 OR ti:\2^^^^^^^^"Unsupervised Deformable Image Registration with Local-Global Attention and Image Decomposition\"","start":^^^^2search_query2^^^^,"max_results":5}) I found the target paper on arXiv and will use it as the primary source. I’ll also retrieve a small set of related registration papers for contextual comparison. arxiv_search.query({"^^^^^^^^2search_query2 deformable registration OR ti:PIViT deformable image registration","start":^^^^2search_query2^^^^,"max_results":^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2search_query2^^^^}) LGANet++ is an unsupervised deformable image registration framework for medical image analysis that combines local-global attention with image decomposition in a coarse-to-fine architecture to improve registration accuracy, robustness, and generalizability across cross-patient, cross-time, and cross-modal CT–MR scenarios (&&&^^^^2search_query2^^^^&&&). It is formulated as a 3D CNN-based registration network with a dual-stream encoder, multi-scale fusion, a local-global attention mechanism, feature interaction and fusion with decomposition, and a diffeomorphic layer intended to produce smooth, topology-preserving deformation fields. In the reported evaluation on five publicly available datasets, the method consistently outperformed several state-of-the-art registration methods, with gains of ^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^.39% in cross-patient registration, ^^^^2search_query2^^^^.7^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^% in cross-time registration, and 6.^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\22^^^^% in cross-modal CT–MR registration; the source code is available at the authors’ public repository (&&&^^^^2search_query2^^^^&&&).

^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^. Role in deformable image registration

Deformable image registration is described as a critical technology in medical image analysis with applications including disease diagnosis, multi-modal fusion, and surgical navigation. The motivating problem is that traditional methods often rely on iterative optimization, which is computationally intensive and lacks generalizability, while recent deep learning methods with attention-based mechanisms still face difficulty in accurately registering regions with high anatomical variability (&&&^^^^2search_query2^^^^&&&).

Within that setting, LGANet++ is positioned as an unsupervised, coarse-to-fine deformable registration network. Its defining premise is that registration quality can be improved by jointly modeling long-range contextual dependencies, local correspondences, and structural consistency under intensity variation. This is operationalized through the combination of local-global attention, multi-scale fusion, image decomposition, and diffeomorphic refinement. A plausible implication is that the method is intended not merely as a replacement for a single attention block, but as an integrated design for handling both geometric complexity and modality-dependent appearance change.

2. Architectural organization

LGANet++ begins with two identical 3D CNN encoders with shared weights that extract four levels of feature pyramids PRESERVED_PLACEHOLDER_^^^^2search_query2^^^^ and PRESERVED_PLACEHOLDER_^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^ for $i=1\ldots4$ from the fixed image $I_f$ and moving image $I_m$, respectively (&&&^^^^2search_query2^^^^&&&). These pyramid features are fused across scales by the Multi-Scale Fusion Module (MSFM), which projects each feature map to a low dimensionality $c$ with $c=8$, resizes all feature maps to a common spatial size $s_t$ by pooling or interpolation, and multiplies and reconvolves them to produce a fused map $C_i$:

$$F'_{k,i} = \begin{cases} \mathrm{Interp}(\mathrm{Conv}(F_i)), & s_i < s_t,\ \mathrm{Conv}(F_i), & s_i = s_t,\ \mathrm{Pool}(\mathrm{Conv}(F_i)), & s_i > s_t, \end{cases}$$

PRESERVED_PLACEHOLDER_^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2search_query2^^^^

At the coarsest scale, PRESERVED_PLACEHOLDER_^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^, the Local-Global Attention Module (LGAM) takes PRESERVED_PLACEHOLDER_^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\22^^^^, PRESERVED_PLACEHOLDER_^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^3, and PRESERVED_PLACEHOLDER_^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^4 and estimates an initial deformation PRESERVED_PLACEHOLDER_^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^5. At the finer scales PRESERVED_PLACEHOLDER_^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^6, the Feature Interaction and Fusion Module (FIFM) iteratively refines the deformation. The overall hierarchy is explicitly coarse-to-fine:

PRESERVED_PLACEHOLDER_^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^7

This progression propagates context from coarse resolutions and then refines finer details at higher resolutions. In structural terms, the network separates global initialization from progressive local correction, which is consistent with the broader design objective of combining robustness to large deformation with sensitivity to fine anatomical detail.

3. Attention, fusion, and decomposition mechanisms

Within LGAM, a 3D correlation layer is first applied between PRESERVED_PLACEHOLDER_^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^8 and PRESERVED_PLACEHOLDER_^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^9, and the resulting representation is concatenated with $i=1\ldots4$^^^^2search_query2^^^^. The combined feature

$i=1\ldots4$^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^

is then processed by a Position Attention Module (PAM):

$i=1\ldots4$2

$i=1\ldots4$3

The resulting representation is split into two branches: Global Attention (GA), which applies self-attention across the entire volume, and Local Attention (LA), which applies self-attention within non-overlapping sub-volumes (&&&^^^^2search_query2^^^^&&&). Both branches follow the standard transformer attention formulation

$i=1\ldots4$4

$i=1\ldots4$5

with $i=1\ldots4$6 reshaped as either $i=1\ldots4$7 for global attention or $i=1\ldots4$8 for local attention. Residual connections preserve learned context, and the outputs are fused through an MLP to form $i=1\ldots4$9.

The finer-scale refinement is centered on FIFM and the Image Decomposition Module (IDM). After upsampling $I_f$^^^^2search_query2^^^^, the model warps the original features to obtain $I_f$^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^. IDM is then applied both to $I_f$2 and to $I_f$3:

$I_f$4

For $I_f$5 and $I_f$6, this yields $I_f$7 and $I_f$8. The method then computes cross-warp consistency through

$I_f$9

and concatenates $I_m$^^^^2search_query2^^^^, $I_m$^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^, and $I_m$2 weighted by the Channel-Wise Attention Module (CWAM). Finally, the resulting field $I_m$3 is summed with STN-warps of $I_m$4 and $I_m$5 to produce $I_m$6.

The stated purpose of IDM is to decouple anatomical structure from intensity variations, thereby improving consistency between the warped and fixed images. This suggests that LGANet++ treats appearance inconsistency not as noise alone but as a factor that should be explicitly separated from structural correspondence, especially in cross-modal settings.

4. Diffeomorphic refinement and loss formulation

Once $I_m$7 is estimated, LGANet++ applies a differentiable exponential layer intended to ensure invertibility and smoothness of the deformation (&&&^^^^2search_query2^^^^&&&). The update is given as

$I_m$8

This layer is the mechanism by which the network enforces diffeomorphic behavior at the field-construction stage.

Training is unsupervised. The similarity term is based on local normalized cross-correlation (NCC) over a window $I_m$9:

$c$^^^^2search_query2^^^^

The optimization objective is

$c$^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^

$c$2

$c$3

A common misconception is that unsupervised registration dispenses with explicit constraints. In LGANet++, unsupervised learning is paired with a specified similarity measure, a deformation smoothness regularizer, hierarchical refinement, and a diffeomorphic layer. The absence of manual annotations does not imply unconstrained field estimation; rather, the supervision is implicit in the image similarity and regularity terms.

5. Data, preprocessing, and optimization protocol

The reported experiments use five publicly available datasets spanning three registration scenarios: LPBA for cross-patient brain MRI, IXI for brain MRI atlas-to-patient registration, OASIS as an external test set, Lung CT for exhalation-to-inhalation cross-time registration, and Abdomen CT–MR for cross-modal liver registration (&&&^^^^2search_query2^^^^&&&). Images were skull-stripped or clipped, resampled or cropped to volumes of size up to $c$4, and normalized to $c$5.

Implementation was in PyTorch on an NVIDIA RTX 4^^^^2search_query2^^^^9^^^^2search_query2^^^^ GPU with single-precision 3D convolutions. The batch size was ^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^, except batch 4 for IXI. Optimization used Adam with initial learning rate $c$6, $c$7, $c$8, linear decay to $c$9 after epoch 2^^^^2search_query2search_query2^^^^, and total training for 3^^^^2search_query2search_query2^^^^ epochs. The loss settings were $c=8$^^^^2search_query2^^^^ and NCC window $c=8$^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^.

Scenario	Datasets	Preprocessing / protocol
Cross-patient	LPBA, IXI, OASIS	Skull-stripped, resampled/cropped, normalized
Cross-time	Lung CT	Clipped, resampled/cropped, normalized
Cross-modal	Abdomen CT–MR	Clipped, resampled/cropped, normalized

The protocol indicates that the method was not evaluated on a single homogeneous benchmark. Instead, the experiments were organized to test generalization across within-modality, longitudinal, and cross-modality conditions, including an external test on OASIS after training on IXI.

6. Quantitative performance, interpretation, and limitations

LGANet++ was compared against nine state-of-the-art methods, including VoxelMorph, PIViT, GroupMorph, and RDP, using DSC, HD95, TRE, recall, precision, and Negative Jacobian Determinant (NJD) (&&&^^^^2search_query2^^^^&&&). The reported results are as follows:

Task	Main result	Additional metrics
LPBA cross-patient	DSC 73.52%	HD95 5.^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2search_query2^^^^ mm, NJD ^^^^2search_query2^^^^.^^^^2search_query2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^%
IXI cross-patient	DSC 83.6^^^^2search_query2^^^^%	HD95 2.^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\22^^^^ mm
OASIS external test	DSC 76.7^^^^2search_query2^^^^%	HD95 2.7^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^ mm
Abdomen CT–MR	DSC 8^^^^2search_query2^^^^.28%	HD95 6.43 mm, recall 84.72%, precision 74.62%
Lung CT cross-time	DSC 97.6^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^%	TRE 2.^^^^2search_query22^^^^ mm, NJD ^^^^2search_query2^^^^.^^^^2search_query2search_query22

The gains over the previous best were reported as ^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^.39% on LPBA, ^^^^2search_query2^^^^.76% on IXI, ^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^.39% on the IXI-to-OASIS external test, 6.^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\22^^^^% on Abdomen CT–MR, and ^^^^2search_query2^^^^.7^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^% on Lung CT; TRE on Lung CT decreased by ^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\22^^^^.9%. All improvements were statistically significant by Wilcoxon $c=8$2 except where marginal HD95 differences were noted.

The paper attributes the strong performance to four factors: local-global attention in LGAM for voxel-level correspondences and long-range context; multi-scale fusion in MSFM for semantic integration across resolutions; IDM and CWAM in FIFM for structural consistency and adaptive feature weighting; and coarse-to-fine diffeomorphic refinement for robustness with topology preservation. The reported limitations are also specific. The method can exhibit occasional non-diffeomorphic local folds in very challenging cross-modal cases, reflected in higher NJD than some competing methods, and it has increased model complexity and GPU memory footprint due to repeated FIFM and attention layers. Future work is described as the incorporation of biomechanical or adversarial constraints for stricter diffeomorphism and model pruning or distillation for deployment on resource-limited hardware.

The clinical implications identified in the paper follow directly from the evaluated scenarios and the unsupervised design. LGANet++ is presented as suitable for atlas-based segmentation, longitudinal disease monitoring such as tumor growth or atrophy, intraoperative guidance such as MRI–CT fusion, and multi-modal diagnostic fusion such as PET–MRI. Its reported inference time of less than ^^^^2id:(Huang et al., 20 Jan 2026) OR ti:\2^^^^ second per volume further suggests utility in time-sensitive workflows without requiring manual annotations (&&&^^^^2search_query2^^^^&&&).