---
title: 'Hy‑CycleAlign: Hyperbolic Registration Fusion'
url: https://www.emergentmind.com/topics/hyperbolic-cycle-alignment-network-hy-cyclealign
type: topic
---

# Hy‑CycleAlign: Hyperbolic Registration Fusion

Hyperbolic Cycle Alignment Network (Hy‑CycleAlign) is a registration–fusion framework for infrared–visible image fusion under misalignment. It formulates cross-modal image registration in hyperbolic space through a dual-path cyclic architecture: a forward registration network aligns infrared to visible, a backward registration network reconstructs the original image, and a Hyperbolic Hierarchy Contrastive Alignment module imposes pixel-level and edge-level constraints in the Poincaré ball. The method is presented as the first image registration method based on hyperbolic space, and its stated objective is to improve both alignment quality and downstream fusion quality under nonlinear cross-modal discrepancies [2507.23508].

## 1. Problem setting and formal task

Hy‑CycleAlign addresses infrared–visible image fusion when the two input modalities are spatially misaligned. The motivating setting is that infrared and visible images often exhibit sensor-pose differences, viewpoint changes, and modality gaps induced by distinct imaging physics, while most existing fusion methods assume pre-aligned inputs. Registration methods that do exist are described as typically working in Euclidean space and relying on image translation modules, which can accumulate error and introduce artifacts [2507.23508].

The framework uses infrared images \(T\) and visible images \(V\) as inputs. Two registration networks are defined: \(R_{t2v}: T \to V\) for infrared-to-visible alignment and \(R_{v2t}: V \to T\) for visible-to-infrared alignment. The forward path predicts a deformation field \(\phi_{t2v} = R_{t2v}(T,V)\) and warps the infrared image as
$$
T_v = T \circ \phi_{t2v}.
$$
The backward path predicts \(\phi_{v2t} = R_{v2t}(T,V)\) and produces
$$
V_t = V \circ \phi_{v2t}.
$$
These transformations are then composed to reconstruct the original modalities:
$$
T_{vt} = T_v \circ \phi_{v2t}, \qquad V_{tv} = V_t \circ \phi_{t2v}.
$$
This establishes the closed-loop registration structure that gives the method its “cycle alignment” designation [2507.23508].

Hy‑CycleAlign also includes a fusion stage. After registration, the aligned infrared image \(T_v\) and the visible image \(V\) are passed to a simple encoder–decoder fusion network:
$$
F = \text{Decoder}(\text{Encoder}(V) + \text{Encoder}(T_v)).
$$
This design makes registration quality a direct determinant of fusion quality rather than a preprocessing step external to fusion [2507.23508].

## 2. Hyperbolic geometric rationale

The method is motivated by the claim that Euclidean geometry handles linear discrepancies well but is limited in representing complex nonlinear relationships between infrared and visible imagery. The paper attributes this to the linear nature of Euclidean distances and the difficulty of capturing hierarchical, nonlinear, and modality-specific correspondences with standard translation-based alignment [2507.23508].

Hy‑CycleAlign instead uses the Poincaré ball model of hyperbolic space,
$$
\mathbb{D}^n = \{x \in \mathbb{R}^n : \|x\| < 1\},
$$
and compares Euclidean and hyperbolic sensitivities to misalignment. The Euclidean distance is written as
$$
d_E(u,v)=\|u-v\|_2.
$$
The Poincaré distance is given as
$$
d_P(u,v)=\cosh^{-1}\left(1+2\frac{\|u-v\|^2}{(1-\|u\|^2)(1-\|v\|^2)}\right).
$$
Under the approximation \(v \to u\), with \(\delta = v-u\), the paper derives
$$
d_P(u,v)\approx \frac{2}{1-\|u\|^2}\|u-v\|.
$$
This yields the gradient amplification relation
$$
\frac{\|\nabla_u d_P\|}{\|\nabla_u d_E\|}=\frac{2}{1-\|u\|^2}>1.
$$
As \(\|u\| \to 1\), the paper states that \(\|\nabla_u d_P\| \to \infty\), implying that small misalignments generate stronger gradients in hyperbolic space, especially near the boundary of the ball [2507.23508].

The geometric interpretation is that hyperbolic space is more sensitive to misalignment than Euclidean space and that this sensitivity increases as points approach the boundary. In the method’s argument, this sensitivity makes hyperbolic constraints particularly suitable for cross-modal registration, where subtle structural discrepancies between thermal and visible cues are often decisive [2507.23508].

## 3. Dual-path cross-modal cyclic registration

The registration backbone is organized as a dual-path cycle. The forward registration network aligns infrared to visible, while the backward registration network aligns visible to infrared. Their outputs are not treated as independent deformations; instead, they are composed to form closed registration loops, producing \(T_{vt}\) and \(V_{tv}\), which are compared against the original \(T\) and \(V\). This establishes geometric consistency through inverse-like behavior without requiring explicit inverse parameterization [2507.23508].

The cycle consistency term is
$$
\mathcal{L}_{cc}=\|T_{vt}-T\|_1+\|V_{tv}-V\|_1.
$$
A smoothness regularizer is applied to the set of deformation fields \(\Phi\):
$$
\mathcal{L}_{sm}=\sum_{\phi\in\Phi}\|\nabla f(\phi)\|^2.
$$
The smoothness term encourages plausible spatial transformations, while the cycle term penalizes inconsistent forward–backward warps [2507.23508].

Structural realism is further enforced through adversarial supervision on Sobel edge maps. For infrared-to-visible alignment, the adversarial objective is written as
$$
\mathcal{L}_{adv}
=
\mathbb{E}_{v}[\log D_v(\nabla V)]
+
\mathbb{E}_{t}[\log(1-D_v(\nabla R_{t2v}(T,V)))].
$$
A symmetric term is used for visible-to-infrared registration with a second discriminator \(D_t\). The discriminators therefore judge whether edges from the registered image resemble edges from the target modality, which ties registration to cross-modal structural plausibility rather than only pixelwise similarity [2507.23508].

This cyclic design also differentiates Hy‑CycleAlign from alignment-free fusion frameworks. Its architecture couples registration, structural consistency, and fusion, rather than assuming that fusion can compensate for input misalignment on its own [2507.23508].

## 4. Hyperbolic Hierarchy Contrastive Alignment

The Hyperbolic Hierarchy Contrastive Alignment module, abbreviated H\(^{2}\)CA, is the method’s central hyperbolic component. It operates at two levels: H\(^{2}\)CA‑p for pixel or deep feature alignment and H\(^{2}\)CA‑e for edge-level alignment. The “hierarchy” in the module refers to this multi-level combination of global feature alignment and local structural alignment [2507.23508].

Euclidean features are mapped into the Poincaré ball using
$$
\text{Proj}(i)=\frac{i}{\sqrt{c}\|i\|}\tanh(\sqrt{c}\|i\|),
$$
and, in the appendix formulation, the map is accompanied by a boundary projection
$$
\text{Proj}(x,c)=
\begin{cases}
x & \text{if } \|x\|<\frac{1}{\sqrt{c}}-\varepsilon,\\
\frac{1-\varepsilon}{\sqrt{c}}\frac{x}{\|x\|} & \text{otherwise},
\end{cases}
$$
with \(\varepsilon = 10^{-6}\). The paper uses curvature \(c=0.01\) in the reported model configuration [2507.23508].

Within the ball, Hy‑CycleAlign uses Möbius addition
$$
m\oplus n
=
\frac{(1+2c\langle m,n\rangle + c\|n\|^2)m + (1-c\|m\|^2)n}
{1+2c\langle m,n\rangle + c^2\|m\|^2\|n\|^2},
$$
and the hyperbolic distance
$$
d_P(m,n)=\frac{2}{\sqrt{c}}\cosh^{-1}(\sqrt{c}\| -m\oplus n\|).
$$
These operations replace Euclidean addition and Euclidean distances in the alignment loss [2507.23508].

At the edge level, H\(^{2}\)CA‑e uses Sobel operator outputs and minimizes
$$
\mathcal{L}_{h2c-e}=-\log \sigma\big(-d_P(\nabla T_v,\nabla V)\big).
$$
At the pixel or deep-feature level, H\(^{2}\)CA‑p uses VGG‑16 features and minimizes
$$
\mathcal{L}_{h2c-p}=-\log \sigma\big(-d_P(T_v,V)\big).
$$
The full hyperbolic contrastive term is
$$
\mathcal{L}_{h2c}=\mathcal{L}_{h2c-e}+\mathcal{L}_{h2c-p}.
$$
In this construction, H\(^{2}\)CA‑e targets local structural correspondence, while H\(^{2}\)CA‑p targets higher-level and more global feature correspondence, both under hyperbolic geometry [2507.23508].

A common misconception is that the hyperbolic component alone performs registration. The reported formulation does not support that reading: H\(^{2}\)CA is one component inside a broader cycle-consistent registration system that also uses adversarial edge supervision, smooth deformation regularization, and a fusion loss [2507.23508].

## 5. Objective function and training protocol

The overall objective combines adversarial, cycle, hyperbolic, smoothness, and fusion terms:
$$
\mathcal{L}
=
\mathcal{L}_{adv}
+
\mathcal{L}_{cc}
+
\mathcal{L}_{h2c}
+
\mathcal{L}_{sm}
+
\mathcal{L}_{f}.
$$
The fusion term is
$$
\mathcal{L}_{f}
=
\frac{1}{HW}\|F-\max(T_v,V)\|_1
+
\frac{1}{HW}
\big\|
|\nabla F|-\max(|\nabla T_v|,|\nabla V|)
\big\|_1.
$$
Its first term encourages preservation of salient intensities, while its second term encourages preservation of the strongest gradients from either modality [2507.23508].

Training is performed jointly over the two registration networks, the two discriminators, the hyperbolic alignment module, and the fusion network. The reported optimizer is AdamW with initial learning rate \(10^{-4}\), and training runs for 120 epochs. The curvature parameter is selected through ablation, with \(c=0.01\) chosen in the final setting [2507.23508].

The experimental protocol also includes synthetic misalignment generation for originally aligned datasets. LLVIP is made misaligned by random nonlinear transformations applied to infrared images, MFNet by random nonlinear transformations applied to visible images, and RoadScene by random horizontal shifts of infrared images by 0.5–1.5% of image width. DroneVehicle is used as a real misaligned infrared–visible benchmark. Sobel edges are used throughout the adversarial and edge-level hyperbolic objectives [2507.23508].

The method is therefore trained not merely as a fusion system, but as a coupled optimization in which alignment and fusion are co-determined. This design is explicit in the training algorithm, where deformation estimation, hyperbolic alignment, adversarial edge discrimination, and fusion are executed in one loop [2507.23508].

## 6. Evaluation and empirical behavior

Hy‑CycleAlign is evaluated on DroneVehicle, LLVIP, MFNet, RoadScene, and TNO using registration metrics including HD, HD95, ASSD, DSC, and MEE, together with fusion metrics including SF and EN. The reported comparisons include alignment-free fusion methods such as DIDFuse, CDDFuse, and EMMA, and alignment-based methods such as SuperFusion, ReCoNet, MURF, UMF‑CMGR, and IMF [2507.23508].

The ablation study on MFNet is especially diagnostic. A Euclidean baseline with cycle alignment but without H\(^{2}\)CA reports HD \(=153.51\), HD95 \(=86.68\), ASSD \(=22.99\), DSC \(=0.72\), and EN \(=6.43\). The full Hy‑CycleAlign model reports HD \(=67.38\), HD95 \(=22.43\), ASSD \(=4.43\), DSC \(=0.93\), and EN \(=6.50\). Intermediate ablations show that H\(^{2}\)CA‑p alone and H\(^{2}\)CA‑e alone both improve performance, while their combination yields the strongest overall result [2507.23508].

On DroneVehicle, the method reports HD \(=70.36\), HD95 \(=25.76\), ASSD \(=6.38\), DSC \(=0.75\), and MEE \(=28.28\), together with competitive SF and EN. On LLVIP it reports DSC \(=0.85\) and ASSD \(=15.50\). On MFNet it reports HD \(=67.38\), HD95 \(=22.43\), ASSD \(=4.43\), DSC \(=0.93\), and MEE \(=7.39\). These values are presented as either best or competitive relative to the listed baselines, depending on the dataset and metric [2507.23508].

The curvature ablation compares \(c \in \{1,10^{-1},10^{-2},10^{-3},10^{-4}\}\). The configuration \(c=10^{-2}\) yields HD95 \(=34.71\), ASSD \(=7.88\), DSC \(=0.92\), and EN \(=6.44\), and is adopted as the preferred trade-off. The complexity comparison reports 16.66 G FLOPs and 18.26 M parameters for Hy‑CycleAlign, versus 16.36 G FLOPs and 1.96 M parameters for SuperFusion, and much larger FLOP counts for MURF, UMF, and IMF [2507.23508].

A downstream object-detection experiment on DroneVehicle uses YOLOv11‑m over fused images. Hy‑CycleAlign reports recall \(=81.5\), precision \(=12.3\), and mAP@0.5 \(=13.7\), with precision and mAP@0.5 listed as best in that comparison. This result is consistent with the method’s central claim that registration quality directly affects fusion utility in downstream tasks [2507.23508].

## 7. Relation to broader hyperbolic alignment research and open directions

Hy‑CycleAlign belongs to a wider class of methods that use hyperbolic geometry for cross-modal or structured alignment, but its task is notably different from most of that literature. Related work applies hyperbolic alignment to text–3D retrieval through hierarchical ordering and contribution-aware aggregation [2511.11045], open-vocabulary semantic segmentation through decoupled radial and angular alignment [2605.08874], multi-modal entity alignment in knowledge graphs [2106.03619], vision–language dataset distillation through rank-aware hyperbolic alignment [2606.29464], few-shot adaptation through path-decoupled hyperbolic flow matching [2602.20479], brain–vision alignment through hyperbolic feature interpolation [2603.22721], manifold-preserving hyperbolic graph convolution [2104.06942], joint user–community network alignment [2209.02908], optimal-transport-based alignment of Poincaré embeddings [2012.01089], and modality alignment across heterogeneous hyperbolic manifolds with distinct curvatures [2510.27391]. Within this landscape, Hy‑CycleAlign is distinguished by operating at the level of dense infrared–visible image registration and fusion rather than retrieval, segmentation, graph alignment, or representation adaptation [2507.23508].

The paper also identifies several limitations and future directions. Hyperbolic operations increase parameter count and can be computationally heavier than purely Euclidean models. The current formulation uses a single Poincaré model, and more advanced or hybrid hyperbolic geometries are suggested for complex modality discrepancies. Additional directions named in the paper include broader modality pairs such as MRI–CT, PET–CT, LiDAR–camera, and SAR–optical, more robust handling of extreme misalignment through coarse-to-fine or hierarchical deformation models, and extensions toward real-time deployment and volumetric 3D registration [2507.23508].

Source: https://www.emergentmind.com/topics/hyperbolic-cycle-alignment-network-hy-cyclealign