Papers
Topics
Authors
Recent
Search
2000 character limit reached

VIRD: Dual-Axis Transformation for Cross-View Pose

Updated 4 July 2026
  • The paper introduces a dual-axis transformation method combining polar conversion and context-enhanced positional attention to achieve view-invariant representations for cross-view pose estimation.
  • The method significantly reduces pose estimation errors on KITTI and VIGOR benchmarks, outperforming competitors without relying on orientation priors.
  • The architecture leverages a CNN backbone and view-reconstruction loss to align features from ground and satellite views, enabling precise localization in autonomous driving and robotics.

Searching arXiv for the VIRD paper and closely related cross-view pose estimation work to ground the article in current papers. arxiv_search(query="VIRD View-Invariant Representation through Dual-Axis Transformation for Cross-View Pose Estimation", max_results=5, sort_by="relevance") arxiv_search(query="View-Invariant Representation through Dual-Axis Transformation cross-view pose estimation", max_results=10, sort_by="relevance") View-Invariant Representation through Dual-Axis Transformation (VIRD) is a cross-view pose estimation method that predicts the $3$-DoF ground-camera pose p=(x,y,θ)p=(x,y,\theta) by matching a ground-view image against a geo-referenced satellite image. It was introduced to address the viewpoint gap between ground and satellite imagery, a gap that existing methods struggle to bridge because of limited spatial correspondences. VIRD constructs view-invariant representations through a dual-axis transformation: it first applies a polar transformation to the satellite view to establish horizontal correspondence, then uses context-enhanced positional attention on the ground and polar-transformed satellite features to resolve vertical misalignment, and finally regularizes the learned descriptors with a view-reconstruction loss (Park et al., 13 Mar 2026).

1. Problem setting and representational objective

In VIRD, the localization task is formulated as cross-view pose estimation. The input is a ground-view image IgI_g and a geo-referenced satellite image IsI_s, and the output is the ground-camera pose p=(x,y,θ)p=(x,y,\theta) relative to the satellite reference frame (Park et al., 13 Mar 2026). The motivating application domain is autonomous driving and robotics, where GNSS-based approaches often degrade due to occlusion and multipath effects.

The method is explicitly designed around the claim that the major obstacle in cross-view localization is the significant viewpoint gap between the ground and satellite views. VIRD addresses that gap by transforming the two views along two axes. The first axis is horizontal: a polar transformation recasts the satellite representation so that its horizontal coordinate corresponds to azimuth. The second axis is vertical: a learned positional-attention mechanism establishes a shared “virtual” vertical axis for both the ground and polar-transformed satellite features. This combination is intended to produce descriptors that are more invariant to viewpoint than descriptors obtained by direct feature matching alone (Park et al., 13 Mar 2026).

A useful clarification is that VIRD does not assume orientation priors at evaluation. Its reported quantitative gains are specifically framed as improvements “without orientation priors,” which places it in the class of cross-view localization methods that must infer orientation jointly with position rather than treating orientation as externally given (Park et al., 13 Mar 2026).

2. Dual-axis transformation pipeline

The VIRD pipeline consists of three stages: feature extraction, descriptor construction via dual-axis transformation, and training objectives coupled to matching and regression (Park et al., 13 Mar 2026).

Feature extraction uses a CNN backbone, either VGG16 or EfficientNet-B0, to produce

FgRC×H×WgF_g\in\mathbb{R}^{C\times H\times W_g}

from IgI_g and

FsRC×A×AF_s\in\mathbb{R}^{C\times A\times A}

from IsI_s. These feature maps are then passed to the descriptor-construction stage.

Descriptor construction proceeds in three substeps. First, the satellite features are polar transformed so that the horizontal axis corresponds to azimuth, yielding

Fs2pRC×H×Ws.F_{s2p}\in\mathbb{R}^{C\times H\times W_s}.

Second, context-enhanced positional attention (CEPA) transforms the vertical dimension of both the ground and satellite features, producing p=(x,y,θ)p=(x,y,\theta)0 and p=(x,y,θ)p=(x,y,\theta)1. Third, vertical directional encoding and projection compress these vertically transformed features along the vertical axis via shared MLPs, then flatten across channels and width to obtain the orientation-aware 1D descriptors

p=(x,y,θ)p=(x,y,\theta)2

Inference follows a coarse-to-fine structure. Descriptors p=(x,y,θ)p=(x,y,\theta)3 and sampled candidate satellite descriptors p=(x,y,θ)p=(x,y,\theta)4 are matched by cosine similarity to obtain a coarse pose p=(x,y,θ)p=(x,y,\theta)5. A regression network then predicts a residual pose p=(x,y,θ)p=(x,y,\theta)6, and the final estimate is

p=(x,y,θ)p=(x,y,\theta)7

(Park et al., 13 Mar 2026).

3. Horizontal and vertical alignment mechanisms

The horizontal part of the dual-axis transformation is the polar transformation. Each satellite feature pixel p=(x,y,θ)p=(x,y,\theta)8 is recast into polar-like coordinates p=(x,y,θ)p=(x,y,\theta)9, where IgI_g0 indexes azimuth and IgI_g1 indexes radius. Centering at a candidate position IgI_g2, VIRD defines

IgI_g3

In the discretized implementation, the transformed coordinates satisfy

IgI_g4

with IgI_g5 ensuring consistent azimuth sampling, while IgI_g6 and IgI_g7 define the radial sampling range (Park et al., 13 Mar 2026).

The vertical part is handled by CEPA, which projects both views onto a learned shared vertical axis of height IgI_g8. CEPA begins with positional attention. It defines three sinusoidal positional encodings of dimension IgI_g9: virtual query positions IsI_s0, ground keys IsI_s1, and satellite keys IsI_s2, where IsI_s3. For view IsI_s4, the attention weights are

IsI_s5

These weights align each virtual vertical row IsI_s6 to actual feature rows IsI_s7 (Park et al., 13 Mar 2026).

CEPA then adds a context-enhancement step for the ground view. Positional attention alone is uniform across horizontal positions, so VIRD refines the ground attention weights using feature context: IsI_s8 where IsI_s9 is channel-wise concatenation, p=(x,y,θ)p=(x,y,\theta)0 is a small conv-net, and the softmax normalizes over the p=(x,y,θ)p=(x,y,\theta)1 axis. The transformed features are then computed as

p=(x,y,θ)p=(x,y,\theta)2

p=(x,y,θ)p=(x,y,\theta)3

The stated rationale for this two-step alignment is explicit. The polar transformation aligns azimuth and reduces the p=(x,y,θ)p=(x,y,\theta)4 orientation gap, while the learned vertical axis avoids reliance on noisy camera parameters and thereby avoids projection artifacts around tall structures. This distinguishes VIRD from methods that depend only on geometric projection or only on content-based attention (Park et al., 13 Mar 2026).

4. Learning objectives, optimization, and implementation regime

VIRD is trained with three losses: a matching loss p=(x,y,θ)p=(x,y,\theta)5, a view-reconstruction loss p=(x,y,θ)p=(x,y,\theta)6, and a regression loss p=(x,y,θ)p=(x,y,\theta)7 (Park et al., 13 Mar 2026). The matching loss is InfoNCE over a grid of candidate poses p=(x,y,θ)p=(x,y,\theta)8. The regression loss refines the coarse match p=(x,y,θ)p=(x,y,\theta)9 by predicting the residual FgRC×H×WgF_g\in\mathbb{R}^{C\times H\times W_g}0.

The view-reconstruction term is central to the method’s invariance claim. Two small decoders FgRC×H×WgF_g\in\mathbb{R}^{C\times H\times W_g}1, together with FgRC×H×WgF_g\in\mathbb{R}^{C\times H\times W_g}2 and FgRC×H×WgF_g\in\mathbb{R}^{C\times H\times W_g}3, reconstruct original and cross views from descriptors. At the ground-truth pose FgRC×H×WgF_g\in\mathbb{R}^{C\times H\times W_g}4, the satellite descriptor is shifted and cropped by FgRC×H×WgF_g\in\mathbb{R}^{C\times H\times W_g}5 to obtain FgRC×H×WgF_g\in\mathbb{R}^{C\times H\times W_g}6. The losses are

FgRC×H×WgF_g\in\mathbb{R}^{C\times H\times W_g}7

FgRC×H×WgF_g\in\mathbb{R}^{C\times H\times W_g}8

FgRC×H×WgF_g\in\mathbb{R}^{C\times H\times W_g}9

with IgI_g0 chosen as most stable in practice (Park et al., 13 Mar 2026).

The implementation regime is specified in detail. The backbones are VGG16 or EfficientNet-B0, both ImageNet pre-trained. The candidate grid is IgI_g1 positions and IgI_g2 orientations at train time, and IgI_g3 positions and IgI_g4 orientations at test time on KITTI; on VIGOR it is IgI_g5 and IgI_g6 at train time, and IgI_g7 and IgI_g8 at test time. The polar radii are IgI_g9 on KITTI and FsRC×A×AF_s\in\mathbb{R}^{C\times A\times A}0 on VIGOR. CEPA uses FsRC×A×AF_s\in\mathbb{R}^{C\times A\times A}1, with FsRC×A×AF_s\in\mathbb{R}^{C\times A\times A}2 for KITTI and FsRC×A×AF_s\in\mathbb{R}^{C\times A\times A}3 for VIGOR, and FsRC×A×AF_s\in\mathbb{R}^{C\times A\times A}4. The loss weights are FsRC×A×AF_s\in\mathbb{R}^{C\times A\times A}5, FsRC×A×AF_s\in\mathbb{R}^{C\times A\times A}6, and regression weight FsRC×A×AF_s\in\mathbb{R}^{C\times A\times A}7; the matching temperature is FsRC×A×AF_s\in\mathbb{R}^{C\times A\times A}8. Optimization uses Adam with learning rate FsRC×A×AF_s\in\mathbb{R}^{C\times A\times A}9, batch size IsI_s0, and IsI_s1 epochs on an NVIDIA RTX A5000. When VGG16 is used, the descriptor channels are compressed by a factor of IsI_s2 after the backbone. The regression search range is IsI_s3 in IsI_s4 and IsI_s5 in IsI_s6 (Park et al., 13 Mar 2026).

5. Quantitative performance and ablation evidence

The reported evaluation covers KITTI and VIGOR and is explicitly framed as “no orientation prior” on KITTI and “unaligned & cross-area” on VIGOR (Park et al., 13 Mar 2026). The main reported median errors are as follows.

Method Position error Orientation error
SliceMatch (VGG16) 11.85 m 7.96°
CCVPE (EffNet-B0) 10.98 m 63.84°
DenseFlow (R18) 18.84 m 42.04°
FG² (DINOv2) 11.72 m 90.42°
VIRD (VGG16) 7.05 m 2.22°
VIRD (EffNet-B0) 5.41 m 1.87°

On KITTI, the EfficientNet-B0 version of VIRD reduces median position and orientation errors by IsI_s7 and IsI_s8, respectively, and the VGG16 version reports IsI_s9 and Fs2pRC×H×Ws.F_{s2p}\in\mathbb{R}^{C\times H\times W_s}.0 (Park et al., 13 Mar 2026).

Method Position error Orientation error
SliceMatch (VGG16) 5.64 m
CCVPE (EffNet-B0) 1.89 m 13.58°
DenseFlow (R18) 2.42 m 2.94°
FG²† (DINOv2) 2.40 m 1.44°
VIRD (VGG16) 1.95 m 1.21°
VIRD (EffNet-B0) 1.55 m 0.96°

On VIGOR, the EfficientNet-B0 version reports Fs2pRC×H×Ws.F_{s2p}\in\mathbb{R}^{C\times H\times W_s}.1 and Fs2pRC×H×Ws.F_{s2p}\in\mathbb{R}^{C\times H\times W_s}.2, corresponding to reductions of Fs2pRC×H×Ws.F_{s2p}\in\mathbb{R}^{C\times H\times W_s}.3 and Fs2pRC×H×Ws.F_{s2p}\in\mathbb{R}^{C\times H\times W_s}.4, respectively (Park et al., 13 Mar 2026).

The ablation results are used to isolate the contribution of the dual-axis design. In the cited ablation, polar transformation alone yields median position Fs2pRC×H×Ws.F_{s2p}\in\mathbb{R}^{C\times H\times W_s}.5 and orientation Fs2pRC×H×Ws.F_{s2p}\in\mathbb{R}^{C\times H\times W_s}.6; adding positional attention yields Fs2pRC×H×Ws.F_{s2p}\in\mathbb{R}^{C\times H\times W_s}.7 and Fs2pRC×H×Ws.F_{s2p}\in\mathbb{R}^{C\times H\times W_s}.8; adding CEPA yields Fs2pRC×H×Ws.F_{s2p}\in\mathbb{R}^{C\times H\times W_s}.9 and p=(x,y,θ)p=(x,y,\theta)00. The same ablation discussion states that the view-reconstruction term further reduces orientation reversal errors, and that CEPA outperforms both pure geometry and content-based attention in cross-area generalization (Park et al., 13 Mar 2026).

6. Conceptual position and relation to earlier invariant-based mapping

VIRD belongs to a broader research tendency that seeks representational invariance under viewpoint change, but its mechanism is distinct from earlier motion-based invariant domains. In “Invariant-based Mapping of Space During General Motion of an Observer” (Yepes et al., 2023), view invariance is obtained from measurable optical flow linked to geometric p=(x,y,θ)p=(x,y,\theta)01D invariants. That work defines an instantaneous camera-centered frame whose p=(x,y,θ)p=(x,y,\theta)02-axis lies along the instantaneous translation vector, removes rotational flow using IMU measurements, and computes the nonlinear functions

p=(x,y,θ)p=(x,y,\theta)03

so that each pixel is represented by p=(x,y,θ)p=(x,y,\theta)04. In that domain, stationary objects neither translate nor deform over time, and the representation supports free-space segmentation, obstacle detection, and moving-object isolation from a single monocular camera without p=(x,y,θ)p=(x,y,\theta)05D reconstruction (Yepes et al., 2023).

That earlier framework and VIRD share the objective of constructing a representation in which nuisance viewpoint variation is suppressed, but they address different observation models and tasks. The 2023 method is instantaneous, monocular, optical-flow-based, and tied to observer motion; VIRD is feature-based, cross-view, and designed for matching a ground-view image to a geo-referenced satellite image. This suggests that “view invariance” in current vision research is not a single technique but a family of constructions that depend strongly on the sensing regime, the nuisance variables to be removed, and the downstream task (Yepes et al., 2023).

Within that family, VIRD is specifically a dual-axis correspondence model rather than a full scene-reconstruction method. Its vertical alignment is learned through positional attention rather than imposed through explicit camera geometry, and its invariance is reinforced through view reconstruction rather than recovered from optical-flow kinematics. A plausible implication is that VIRD should be understood not as a generic invariant representation for all visual tasks, but as a cross-view pose-estimation architecture whose invariance is task-conditioned and descriptor-centric (Park et al., 13 Mar 2026).

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to View-Invariant Representations through Dual-axis Transformation (VIRD).