VIRD: Dual-Axis Transformation for Cross-View Pose
- The paper introduces a dual-axis transformation method combining polar conversion and context-enhanced positional attention to achieve view-invariant representations for cross-view pose estimation.
- The method significantly reduces pose estimation errors on KITTI and VIGOR benchmarks, outperforming competitors without relying on orientation priors.
- The architecture leverages a CNN backbone and view-reconstruction loss to align features from ground and satellite views, enabling precise localization in autonomous driving and robotics.
Searching arXiv for the VIRD paper and closely related cross-view pose estimation work to ground the article in current papers. arxiv_search(query="VIRD View-Invariant Representation through Dual-Axis Transformation for Cross-View Pose Estimation", max_results=5, sort_by="relevance") arxiv_search(query="View-Invariant Representation through Dual-Axis Transformation cross-view pose estimation", max_results=10, sort_by="relevance") View-Invariant Representation through Dual-Axis Transformation (VIRD) is a cross-view pose estimation method that predicts the $3$-DoF ground-camera pose by matching a ground-view image against a geo-referenced satellite image. It was introduced to address the viewpoint gap between ground and satellite imagery, a gap that existing methods struggle to bridge because of limited spatial correspondences. VIRD constructs view-invariant representations through a dual-axis transformation: it first applies a polar transformation to the satellite view to establish horizontal correspondence, then uses context-enhanced positional attention on the ground and polar-transformed satellite features to resolve vertical misalignment, and finally regularizes the learned descriptors with a view-reconstruction loss (Park et al., 13 Mar 2026).
1. Problem setting and representational objective
In VIRD, the localization task is formulated as cross-view pose estimation. The input is a ground-view image and a geo-referenced satellite image , and the output is the ground-camera pose relative to the satellite reference frame (Park et al., 13 Mar 2026). The motivating application domain is autonomous driving and robotics, where GNSS-based approaches often degrade due to occlusion and multipath effects.
The method is explicitly designed around the claim that the major obstacle in cross-view localization is the significant viewpoint gap between the ground and satellite views. VIRD addresses that gap by transforming the two views along two axes. The first axis is horizontal: a polar transformation recasts the satellite representation so that its horizontal coordinate corresponds to azimuth. The second axis is vertical: a learned positional-attention mechanism establishes a shared “virtual” vertical axis for both the ground and polar-transformed satellite features. This combination is intended to produce descriptors that are more invariant to viewpoint than descriptors obtained by direct feature matching alone (Park et al., 13 Mar 2026).
A useful clarification is that VIRD does not assume orientation priors at evaluation. Its reported quantitative gains are specifically framed as improvements “without orientation priors,” which places it in the class of cross-view localization methods that must infer orientation jointly with position rather than treating orientation as externally given (Park et al., 13 Mar 2026).
2. Dual-axis transformation pipeline
The VIRD pipeline consists of three stages: feature extraction, descriptor construction via dual-axis transformation, and training objectives coupled to matching and regression (Park et al., 13 Mar 2026).
Feature extraction uses a CNN backbone, either VGG16 or EfficientNet-B0, to produce
from and
from . These feature maps are then passed to the descriptor-construction stage.
Descriptor construction proceeds in three substeps. First, the satellite features are polar transformed so that the horizontal axis corresponds to azimuth, yielding
Second, context-enhanced positional attention (CEPA) transforms the vertical dimension of both the ground and satellite features, producing 0 and 1. Third, vertical directional encoding and projection compress these vertically transformed features along the vertical axis via shared MLPs, then flatten across channels and width to obtain the orientation-aware 1D descriptors
2
Inference follows a coarse-to-fine structure. Descriptors 3 and sampled candidate satellite descriptors 4 are matched by cosine similarity to obtain a coarse pose 5. A regression network then predicts a residual pose 6, and the final estimate is
7
3. Horizontal and vertical alignment mechanisms
The horizontal part of the dual-axis transformation is the polar transformation. Each satellite feature pixel 8 is recast into polar-like coordinates 9, where 0 indexes azimuth and 1 indexes radius. Centering at a candidate position 2, VIRD defines
3
In the discretized implementation, the transformed coordinates satisfy
4
with 5 ensuring consistent azimuth sampling, while 6 and 7 define the radial sampling range (Park et al., 13 Mar 2026).
The vertical part is handled by CEPA, which projects both views onto a learned shared vertical axis of height 8. CEPA begins with positional attention. It defines three sinusoidal positional encodings of dimension 9: virtual query positions 0, ground keys 1, and satellite keys 2, where 3. For view 4, the attention weights are
5
These weights align each virtual vertical row 6 to actual feature rows 7 (Park et al., 13 Mar 2026).
CEPA then adds a context-enhancement step for the ground view. Positional attention alone is uniform across horizontal positions, so VIRD refines the ground attention weights using feature context: 8 where 9 is channel-wise concatenation, 0 is a small conv-net, and the softmax normalizes over the 1 axis. The transformed features are then computed as
2
3
The stated rationale for this two-step alignment is explicit. The polar transformation aligns azimuth and reduces the 4 orientation gap, while the learned vertical axis avoids reliance on noisy camera parameters and thereby avoids projection artifacts around tall structures. This distinguishes VIRD from methods that depend only on geometric projection or only on content-based attention (Park et al., 13 Mar 2026).
4. Learning objectives, optimization, and implementation regime
VIRD is trained with three losses: a matching loss 5, a view-reconstruction loss 6, and a regression loss 7 (Park et al., 13 Mar 2026). The matching loss is InfoNCE over a grid of candidate poses 8. The regression loss refines the coarse match 9 by predicting the residual 0.
The view-reconstruction term is central to the method’s invariance claim. Two small decoders 1, together with 2 and 3, reconstruct original and cross views from descriptors. At the ground-truth pose 4, the satellite descriptor is shifted and cropped by 5 to obtain 6. The losses are
7
8
9
with 0 chosen as most stable in practice (Park et al., 13 Mar 2026).
The implementation regime is specified in detail. The backbones are VGG16 or EfficientNet-B0, both ImageNet pre-trained. The candidate grid is 1 positions and 2 orientations at train time, and 3 positions and 4 orientations at test time on KITTI; on VIGOR it is 5 and 6 at train time, and 7 and 8 at test time. The polar radii are 9 on KITTI and 0 on VIGOR. CEPA uses 1, with 2 for KITTI and 3 for VIGOR, and 4. The loss weights are 5, 6, and regression weight 7; the matching temperature is 8. Optimization uses Adam with learning rate 9, batch size 0, and 1 epochs on an NVIDIA RTX A5000. When VGG16 is used, the descriptor channels are compressed by a factor of 2 after the backbone. The regression search range is 3 in 4 and 5 in 6 (Park et al., 13 Mar 2026).
5. Quantitative performance and ablation evidence
The reported evaluation covers KITTI and VIGOR and is explicitly framed as “no orientation prior” on KITTI and “unaligned & cross-area” on VIGOR (Park et al., 13 Mar 2026). The main reported median errors are as follows.
| Method | Position error | Orientation error |
|---|---|---|
| SliceMatch (VGG16) | 11.85 m | 7.96° |
| CCVPE (EffNet-B0) | 10.98 m | 63.84° |
| DenseFlow (R18) | 18.84 m | 42.04° |
| FG² (DINOv2) | 11.72 m | 90.42° |
| VIRD (VGG16) | 7.05 m | 2.22° |
| VIRD (EffNet-B0) | 5.41 m | 1.87° |
On KITTI, the EfficientNet-B0 version of VIRD reduces median position and orientation errors by 7 and 8, respectively, and the VGG16 version reports 9 and 0 (Park et al., 13 Mar 2026).
| Method | Position error | Orientation error |
|---|---|---|
| SliceMatch (VGG16) | 5.64 m | – |
| CCVPE (EffNet-B0) | 1.89 m | 13.58° |
| DenseFlow (R18) | 2.42 m | 2.94° |
| FG²† (DINOv2) | 2.40 m | 1.44° |
| VIRD (VGG16) | 1.95 m | 1.21° |
| VIRD (EffNet-B0) | 1.55 m | 0.96° |
On VIGOR, the EfficientNet-B0 version reports 1 and 2, corresponding to reductions of 3 and 4, respectively (Park et al., 13 Mar 2026).
The ablation results are used to isolate the contribution of the dual-axis design. In the cited ablation, polar transformation alone yields median position 5 and orientation 6; adding positional attention yields 7 and 8; adding CEPA yields 9 and 00. The same ablation discussion states that the view-reconstruction term further reduces orientation reversal errors, and that CEPA outperforms both pure geometry and content-based attention in cross-area generalization (Park et al., 13 Mar 2026).
6. Conceptual position and relation to earlier invariant-based mapping
VIRD belongs to a broader research tendency that seeks representational invariance under viewpoint change, but its mechanism is distinct from earlier motion-based invariant domains. In “Invariant-based Mapping of Space During General Motion of an Observer” (Yepes et al., 2023), view invariance is obtained from measurable optical flow linked to geometric 01D invariants. That work defines an instantaneous camera-centered frame whose 02-axis lies along the instantaneous translation vector, removes rotational flow using IMU measurements, and computes the nonlinear functions
03
so that each pixel is represented by 04. In that domain, stationary objects neither translate nor deform over time, and the representation supports free-space segmentation, obstacle detection, and moving-object isolation from a single monocular camera without 05D reconstruction (Yepes et al., 2023).
That earlier framework and VIRD share the objective of constructing a representation in which nuisance viewpoint variation is suppressed, but they address different observation models and tasks. The 2023 method is instantaneous, monocular, optical-flow-based, and tied to observer motion; VIRD is feature-based, cross-view, and designed for matching a ground-view image to a geo-referenced satellite image. This suggests that “view invariance” in current vision research is not a single technique but a family of constructions that depend strongly on the sensing regime, the nuisance variables to be removed, and the downstream task (Yepes et al., 2023).
Within that family, VIRD is specifically a dual-axis correspondence model rather than a full scene-reconstruction method. Its vertical alignment is learned through positional attention rather than imposed through explicit camera geometry, and its invariance is reinforced through view reconstruction rather than recovered from optical-flow kinematics. A plausible implication is that VIRD should be understood not as a generic invariant representation for all visual tasks, but as a cross-view pose-estimation architecture whose invariance is task-conditioned and descriptor-centric (Park et al., 13 Mar 2026).