AsymLoc: Asymmetric Visual Localization

• AsymLoc is an asymmetric visual localization framework that uses a large Teacher model for offline mapping and a lightweight Student for online query processing.
• It employs a joint detector–descriptor distillation scheme combining geometric and probabilistic losses to align heterogeneous feature representations.
• The approach achieves near-teacher localization accuracy with significantly reduced online computational cost and smaller model sizes on edge devices.

Searching arXiv for “AsymLoc” and closely related papers to ground the article in the current literature. arxiv_search(query="^^^^^^^^4all:AsymLoc4 max_results=^^^^4submittedDate4all:AsymLoc4^^^^, sort_by="^^^^^^^^4submittedDate4 arxiv_search(query="^^^^^^^^4ti:\4 OR abs:\4^^^^^^^^"AsymLoc\"", max_results=^^^^4submittedDate4all:AsymLoc4^^^^, sort_by="^^^^^^^^4submittedDate4 arxiv_search(query="AsymLoc", max_results=^^^^4submittedDate4all:AsymLoc4^^^^, sort_by="relevance") AsymLoc most directly denotes a framework for asymmetric visual localization in which a large Teacher model processes pre-mapped database images offline, while a lightweight Student model processes the query image online. The framework is designed for precise and real-time visual localization on resource-constrained edge devices such as smart glasses, where battery life, heat dissipation, latency, and memory are central constraints. Its defining claim is that heterogeneity between database-side and query-side local-feature extractors can be made operationally useful rather than problematic, provided the Student is distilled to remain directly matchable with Teacher-generated map features through fast, parameter-less nearest-neighbor matching (&&&^^^^4all:AsymLoc4^^^^&&&).

^^^^4submittedDate4^^^^. Problem setting and asymmetric formulation

Visual localization in the setting considered by AsymLoc follows a standard three-stage structure: retrieve a shortlist of candidate database images, match local features between the query and those database images, and estimate 6-DoF pose from the matches. AsymLoc changes the usual symmetric assumption that the same local-feature model must run on both sides of the pipeline. Instead, it exploits the fact that database images can be processed offline, so there is no reason to impose query-time efficiency constraints on the map representation (&&&^^^^4all:AsymLoc4^^^^&&&).

The database side is therefore handled by a high-capacity Teacher PRESERVED_PLACEHOLDER_^^^^4all:AsymLoc4^^^^, while the query side is handled by a compact Student PRESERVED_PLACEHOLDER_^^^^4submittedDate4^^^^. If PRESERVED_PLACEHOLDER_^^^^4ti:\4^^^^ is a database image and PRESERVED_PLACEHOLDER_^^^^4 OR abs:\4^^^^ is a query image, the Teacher output is written as

$$\{(\mathbf{w}_i^T,\mathbf{d}_i^T)\}_{i=1}^{N}=T(\mathcal{I}_d),$$

and the Student output as

$$\{(\mathbf{w}_j^S,\mathbf{d}_j^S)\}_{j=1}^{N}=S(\mathcal{I}_q),$$

where $\mathbf{w}$ denotes detector confidence and $\mathbf{d}$ denotes descriptor. The asymmetric pose estimate is

$$\mathbf{T}_{S(\mathcal{I}_q)\rightarrow T(\mathcal{I}_d)}\in SE(3),$$

and the symmetric Teacher–Teacher reference is

$$\mathbf{T}_{T(\mathcal{I}_q)\rightarrow T(\mathcal{I}_d)}\in SE(3).$$

The training objective is to make the former approximate the latter.

A central practical motivation is the desire to avoid heavy learned matchers. The framework explicitly contrasts its design with matchers such as LightGlue, which can add around ^^^^4submittedDate4 OR abs:\4^^^^M parameters, whereas a typical extractor such as SuperPoint has about ^^^^4submittedDate4^^^^.^^^^4 OR abs:\4^^^^M parameters. AsymLoc instead targets direct mutual nearest-neighbor matching between heterogeneous feature spaces.

^^^^4ti:\4^^^^. Detector–descriptor compatibility and the AsymLoc objective

The technical core of AsymLoc is a distillation scheme that aligns Teacher and Student in a joint detector–descriptor space rather than matching descriptors alone. The framework is built from two coupled losses: a geometry-driven matching objective and a joint detector-descriptor distillation objective (&&&^^^^4all:AsymLoc4^^^^&&&).

For Teacher descriptors on image PRESERVED_PLACEHOLDER_^^^^4submittedDate4all:AsymLoc4^^^^ and Student descriptors on image PRESERVED_PLACEHOLDER_^^^^4submittedDate4submittedDate4^^^^, the descriptor similarity matrix is

PRESERVED_PLACEHOLDER_^^^^4submittedDate4ti:\4^^^^

with temperature PRESERVED_PLACEHOLDER_^^^^4submittedDate4 OR abs:\4^^^^. Matching is made detector-aware through the mutual matching matrix

PRESERVED_PLACEHOLDER_^^^^4submittedDate44^^^^

where PRESERVED_PLACEHOLDER_^^^^4submittedDate4^^^^5 and PRESERVED_PLACEHOLDER_^^^^4submittedDate4^^^^6 are row-wise and column-wise softmax operators. This produces a soft mutual-nearest-neighbor-like distribution in which confident keypoints contribute more strongly.

Using ground-truth correspondences PRESERVED_PLACEHOLDER_^^^^4submittedDate4^^^^7 from homography or geometry, the matching loss supervises only reliable Teacher detections through a teacher confidence threshold PRESERVED_PLACEHOLDER_^^^^4submittedDate4^^^^8. The design is explicitly geometry-first: the Student is trained to recover actual correspondences to Teacher features rather than only to mimic feature statistics.

The second component performs knowledge distillation in a detector-weighted similarity space. The framework defines detector-weighted similarities PRESERVED_PLACEHOLDER_^^^^4submittedDate4^^^^9 and PRESERVED_PLACEHOLDER_^^^^4ti:\4all:AsymLoc4^^^^, then aligns their row-wise and column-wise softmax distributions through KL divergence. This transfers what the paper calls the Teacher’s matchability structure: which keypoints are likely to match, how similarity mass is distributed across alternatives, and how detector reliability modulates correspondence probability.

The overall training criterion is

PRESERVED_PLACEHOLDER_^^^^4ti:\4submittedDate4^^^^

with PRESERVED_PLACEHOLDER_^^^^4ti:\4ti:\4^^^^ in the reported experiments. A recurring empirical point is that PRESERVED_PLACEHOLDER_^^^^4ti:\4 OR abs:\4^^^^ alone is not sufficient; the strongest results arise from combining geometric supervision with probabilistic compatibility distillation.

^^^^4 OR abs:\4^^^^. Training protocol and inference pipeline

Training uses synthetic homography pairs generated from COCO. One COCO image is sampled, a random homography is applied to generate a second view, and the resulting geometry provides the correspondence set PRESERVED_PLACEHOLDER_^^^^4ti:\44^^^^. During this process, the Teacher is frozen, and only the Student is optimized under the AsymLoc loss (&&&^^^^4all:AsymLoc4^^^^&&&).

The reported optimization settings are: Adam, learning rate PRESERVED_PLACEHOLDER_^^^^4ti:\4^^^^5, and 5^^^^4all:AsymLoc4^^^^ epochs. The detector confidence threshold is PRESERVED_PLACEHOLDER_^^^^4ti:\4^^^^6. The augmentation pipeline includes brightness, rotation, scaling, Gaussian noise, gamma, hue/saturation/value shifts, blur, and motion blur. Two Teachers are reported: SiLK and SuperPoint. The Students are deliberately very small, with ^^^^4all:AsymLoc4^^^^.^^^^4submittedDate4 OR abs:\4^^^^M, ^^^^4all:AsymLoc4^^^^.^^^^4all:AsymLoc4, ^^^^4all:AsymLoc4^^^^.^^^^4all:AsymLoc4, and ^^^^4all:AsymLoc4^^^^.^^^^4all:AsymLoc44 parameters.

At inference time, the asymmetry of the method becomes operational. Teacher map features are extracted offline and stored. The online device runs only the Student on the query image. Matching is then performed by mutual nearest neighbor, without transformer- or GNN-based learned matchers. This yields the principal systems advantage of the framework: online inference cost is essentially that of the tiny Student alone, while the database retains the representational quality of the larger Teacher.

A common misconception is that the asymmetry lies in using different losses for database and query images. In the framework itself, the decisive asymmetry is architectural and deployment-oriented: a large offline model for the map side and a small online model for the query side.

4. Reported empirical performance and efficiency trade-off

AsymLoc is evaluated on HPatches, ScanNet, IMC^^^^4ti:\4all:AsymLoc4ti:\4ti:\4^^^^, and Aachen Day-Night, with additional appendix results on MegaDepth and XFeat. The reported headline is that AsymLoc reaches up to 95%+ of teacher localization accuracy with order-of-magnitude smaller models, and in one comparison the paper reports up to ^^^^4ti:\4^^^^5× smaller models and around 7× fewer FLOPs while maintaining near-teacher performance (&&&^^^^4all:AsymLoc4^^^^&&&).

The following representative results are explicitly reported.

Setting	Reported AsymLoc result	Standard baseline
SiLK teacher, ^^^^4all:AsymLoc4^^^^.^^^^4submittedDate4 OR abs:\4^^^^M student, HPatches	^^^^4all:AsymLoc4^^^^.6^^^^4all:AsymLoc4 / ^^^^4all:AsymLoc4^^^^.84	^^^^4all:AsymLoc4^^^^.56 / ^^^^4all:AsymLoc4^^^^.8^^^^4all:AsymLoc4
SiLK teacher, ^^^^4all:AsymLoc4^^^^.^^^^4submittedDate4 OR abs:\4^^^^M student, ScanNet	^^^^4 OR abs:\4ti:\4^^^^.9 / 48.9	^^^^4ti:\4^^^^9.7 / 45.^^^^4ti:\4^^^^
SiLK teacher, ^^^^4all:AsymLoc4^^^^.^^^^4submittedDate4 OR abs:\4^^^^M student, IMC^^^^4ti:\4all:AsymLoc4ti:\4ti:\4^^^^	^^^^4all:AsymLoc4^^^^.5^^^^4submittedDate4	^^^^4all:AsymLoc4^^^^.45
SiLK teacher, ^^^^4all:AsymLoc4^^^^.^^^^4submittedDate4 OR abs:\4^^^^M student, Aachen day	8^^^^4 OR abs:\4^^^^.^^^^4 OR abs:\4^^^^ / 87.8	8^^^^4all:AsymLoc4^^^^.^^^^4ti:\4 / 85.^^^^4ti:\4^^^^
SiLK teacher, ^^^^4all:AsymLoc4^^^^.^^^^4submittedDate4 OR abs:\4^^^^M student, Aachen night	7^^^^4submittedDate4^^^^.^^^^4ti:\4 / 84.4	69.7 / 8^^^^4all:AsymLoc4^^^^.^^^^4all:AsymLoc4
SuperPoint teacher, ^^^^4all:AsymLoc4^^^^.^^^^4all:AsymLoc4 student, HPatches	^^^^4all:AsymLoc4^^^^.4^^^^4submittedDate4 / ^^^^4all:AsymLoc4^^^^.76	^^^^4all:AsymLoc4^^^^.^^^^4 OR abs:\4^^^^8 / ^^^^4all:AsymLoc4^^^^.74
SuperPoint teacher, ^^^^4all:AsymLoc4^^^^.^^^^4all:AsymLoc4 student, ScanNet	^^^^4submittedDate4^^^^8.^^^^4 OR abs:\4^^^^ / ^^^^4 OR abs:\4 OR abs:\4^^^^.5	^^^^4submittedDate4^^^^7.5 / ^^^^4 OR abs:\4submittedDate4^^^^.^^^^4all:AsymLoc4^^^^
SuperPoint teacher, ^^^^4all:AsymLoc4^^^^.^^^^4all:AsymLoc4 student, HPatches	^^^^4all:AsymLoc4^^^^.^^^^4 OR abs:\4^^^^9 / ^^^^4all:AsymLoc4^^^^.75	^^^^4all:AsymLoc4^^^^.^^^^4 OR abs:\4 OR abs:\4^^^^ / ^^^^4all:AsymLoc4^^^^.7^^^^4submittedDate4
SuperPoint teacher, ^^^^4all:AsymLoc4^^^^.^^^^4all:AsymLoc4 student, ScanNet	^^^^4submittedDate4^^^^6.9 / ^^^^4 OR abs:\4submittedDate4^^^^.4	^^^^4submittedDate4ti:\4^^^^.^^^^4 OR abs:\4^^^^ / ^^^^4ti:\4^^^^6.6

On Aachen, the paper states that AsymLoc reaches 95.5% of SiLK teacher accuracy and 9^^^^4 OR abs:\4^^^^% of SuperPoint teacher accuracy. Against asymmetric baselines such as Naive Distillation, AML, RKD, CSD, and D^^^^4 OR abs:\4^^^^Still, the framework is reported as best or near-best across almost all metrics; the explicit exception noted is that D^^^^4 OR abs:\4^^^^Still slightly beats AsymLoc by ^^^^4all:AsymLoc4^^^^.^^^^4submittedDate4 on ScanNet @^^^^4ti:\4all:AsymLoc4^^^^°.

Ablation results clarify the role of the two losses. On HPatches / ScanNet, the paper reports: PRESERVED_PLACEHOLDER_^^^^4ti:\4^^^^7 only gives ^^^^4all:AsymLoc4^^^^.5^^^^4 OR abs:\4^^^^ / ^^^^4all:AsymLoc4^^^^.7^^^^4all:AsymLoc4 ^^^^4ti:\4submittedDate4^^^^.6 / ^^^^4 OR abs:\4^^^^5.8; PRESERVED_PLACEHOLDER_^^^^4ti:\4^^^^8 only gives ^^^^4all:AsymLoc4^^^^.57 / ^^^^4all:AsymLoc4^^^^.8^^^^4ti:\4 ^^^^4 OR abs:\4all:AsymLoc4^^^^.^^^^4all:AsymLoc4^^^^ / 46.9; and both together give ^^^^4all:AsymLoc4^^^^.59 / ^^^^4all:AsymLoc4^^^^.8^^^^4 OR abs:\4^^^^, ^^^^4 OR abs:\4submittedDate4^^^^.5 / 48.5. This indicates that geometry and distributional distillation are complementary, while pure geometric supervision can even hurt.

5. Relation to other asymmetry-based and asymptotic localization methods

Although AsymLoc most directly names the asymmetric visual localization framework above, the broader localization literature uses closely related ideas in other modalities. One example is Bayesian joint synchronization and localization based on asymmetric time-stamp exchange, where propagation delay and AoA are fused through Bayesian Recursive Filtering to jointly estimate position and clock parameters. In that setting, the reported RMSEs of position and clock offset estimation are kept below ^^^^4submittedDate4^^^^ meter and ^^^^4submittedDate4^^^^ ns, respectively (Goodarzi et al., 2020).

A different line of work studies localization through asymptotic statistical efficiency. For range-difference measurements, one paper proves consistency and asymptotic normality of the maximum likelihood estimator, then constructs a practical estimator by combining a bias-eliminated linear least-squares initializer with a one-step Gauss–Newton refinement. The stated conclusion is that the refined estimator has the same asymptotic property as ML and achieves the CRLB in the large-sample regime (Zeng et al., 2023). Closely related range-based results for direct range measurements use the same two-step principle: any PRESERVED_PLACEHOLDER_^^^^4ti:\4^^^^9-consistent estimate followed by one Gauss–Newton iteration asymptotically matches nonlinear LS, which itself is shown to be strongly consistent and asymptotically normal under nondegenerate sensor deployment (Zeng et al., 2022).

For bearing-only measurements, an analogous two-step estimator is constructed through a biased linear least-squares solution, a data-driven bias elimination step, a consistent variance estimator based on the reciprocal of the maximum eigenvalue of a specially constructed matrix, and then a single Gauss–Newton iteration. The final estimator is reported as asymptotically equivalent to ML, with overall computational complexity linear in the number of measurements (Hu et al., 10 Jul 2025).

These lines of work are methodologically distinct from the visual-feature formulation of AsymLoc. The visual framework uses offline–online model asymmetry and cross-model distillation; the range-, range-difference-, and bearing-only methods use asymptotic identifiability and one-step efficiency theory. A plausible implication is that “AsymLoc” now names not a single formal doctrine, but a family resemblance across localization methods that exploit asymmetry in sensing, deployment, or estimator construction.

6. Limitations, interpretation, and prospective directions

The visual AsymLoc framework depends on having a strong offline Teacher and a prebuilt database; it is therefore tailored to map-based localization rather than generic pairwise matching. Training relies on homography-generated synthetic pairs, which the paper notes may not capture all real-world match variability. Performance remains close to the Teacher down to around ^^^^4all:AsymLoc4^^^^.^^^^4all:AsymLoc44 parameters, but the appendix reports a sharp decline at ^^^^4all:AsymLoc4^^^^.^^^^4all:AsymLoc4ti:\4 and below. The framework is also specialized to local-feature-based pipelines and is explicitly not a general dense matcher (&&&^^^^4all:AsymLoc4^^^^&&&).

Its empirical profile nonetheless clarifies an important systems point. The method does not attempt to replace map quality with a universally smaller model. Instead, it decouples offline map quality from online query cost. In that sense, its central contribution is not merely a new distillation loss, but a redefinition of what “efficient localization” means in edge deployment: preserve a high-quality database representation, run a tiny model online, and make the two spaces interoperable without adding a learned matcher at inference time.

This suggests a broader research direction in which localization accuracy is constrained less by raw feature capacity than by cross-model compatibility under severe query-side resource limits. Within the literature summarized here, AsymLoc is the clearest formulation of that principle for local-feature visual localization, while adjacent work in timestamp-, range-, and bearing-based localization shows the same general movement toward asymmetric system design and asymptotically optimal inference.