---
title: Visual Floorplan Localization (FLoc)
url: https://www.emergentmind.com/topics/visual-floorplan-localization-floc
type: topic
---

# Visual Floorplan Localization (FLoc)

Visual Floorplan Localization (FLoc) is the problem of estimating where a visual observation was captured within a known indoor floorplan. In the formulations represented here, the target is typically a planar pose \(S=(x,y,\theta)\) or \(\mathbf{s}_t=[s_{x,t},s_{y,t},s_{\phi,t}]\), with \((x,y)\) denoting 2D position in the map and \(\theta\) or \(\phi\) denoting yaw. The input may be a single RGB image, an image sequence with relative motion, or a stationary scan of posed images, together with a 2D floorplan that may encode occupancy geometry alone or richer semantics such as doors and windows. The appeal of FLoc follows from properties repeatedly emphasized in the literature: floorplans are lightweight, readily available, long-term persistent, and robust to changes in visual appearance; the central difficulty is that floorplans are compact and minimalist, so repetitive hallways, corners, and room outlines create severe pose ambiguity [2403.03370], [2507.09291], [2508.01216], [2509.11301].

## 1. Problem formulation and map representations

A common formulation models FLoc as probabilistic inference over a discretized pose space. Given an observation \(O_{I,F}=(I,F)\) or \(O_{\mathcal{I},F}=(\mathcal{I},F)\), the objective is to estimate
\[
\hat S=\arg\max_{S_i\in\mathcal S} p(S_i\mid O),
\]
where \(\mathcal S\) is a finite set of candidate poses obtained by discretizing continuous \(SE(2)\). This formulation appears explicitly in ray-based systems such as F\(^3\)Loc and in later extensions that preserve the same posterior-search structure while changing the observation model [2403.03370], [2507.09291], [2508.01216].

The floorplan itself is represented in several different ways. In F\(^3\)Loc and related geometry-driven systems, the map is primarily an occupancy representation containing walls and doors, and the observation model compares predicted geometric structure against floorplan-derived reference structure [2403.03370]. Later work makes the floorplan semantic, treating it as \(F \in \{0,1,\dots,C\}^{H\times W}\) with classes such as wall, window, and door, or with room polygons that can be used as masks [2507.09291]. Other methods move away from exact vector geometry: SceneAligner explicitly targets rasterized or symbolic floorplans by aligning them to a reconstruction-derived density-map proxy, while Z-FLoc matches geometric primitives extracted from a BEV reconstruction to floorplan primitives through a 2D similarity transform [2605.22581], [2606.04788].

Not all formulations search directly over a discretized \((x,y,\theta)\) grid. LaLaLoc reduces the target to 2 DoF \(P\), interprets the floorplan as an extruded 3D layout model, and localizes panoramas through a shared latent layout space and direct latent pose optimization [2104.09169]. SceneAligner and Z-FLoc instead formulate localization as cross-modal alignment under \(\mathbf{M}\in\mathrm{Sim}(2)\), reflecting the fact that monocular or foundation-model reconstructions may have imperfect metric scale [2605.22581], [2606.04788]. This suggests that contemporary FLoc is less a single algorithmic template than a family of cross-modal pose-estimation problems linked by a common prior map.

## 2. Core observation models: latent layouts, latent rendering, and ray scans

Early modern FLoc systems differ primarily in how they represent the visual observation so that it becomes comparable to a floorplan. LaLaLoc constructs a shared latent embedding space for RGB panoramas and layouts rendered from a floorplan-derived 3D model. Coarse localization is performed by nearest-neighbor retrieval in that latent space, after which pose refinement proceeds either by local Vogel Disc re-sampling or by differentiable latent pose optimization,
\[
\min_{P_r} D(\Phi_{layout}(\Omega(P_r,\mathcal M)),f_p),
\]
where \(f_p\) is the panorama embedding and \(\Omega\) is the renderer. On Structured3D, LaLaLoc reports a median localization error of \(8.3\) cm in the RGB/furnished setting, with pose recall@1 of \(70.6\%\) and within-1 m accuracy of \(87.5\%\) [2104.09169].

LASER preserves the Monte Carlo Localization viewpoint but replaces explicit per-pose image synthesis with latent space rendering. A floor map is rasterized into boundary points, each endowed with geometry-conditioned codebooks, and a pose hypothesis is rendered directly into a circular feature \(\mathbb F=\{\mathbf f^\alpha\}_{\alpha=0}^{V-1}\) whose indexing is rotation-aware. The shared metric space accommodates both map hypotheses and panorama or perspective image queries, and the paper reports sampling speed above \(10\) KHz together with strong perspective and panorama performance on ZInD and Structured3D [2204.00157]. In LASER, orientation is naturally represented as a cyclic shift of the circular descriptor, so yaw search becomes a structured correlation problem rather than a generic embedding comparison.

F\(^3\)Loc establishes the ray-based probabilistic paradigm that many later papers extend. Its observation module predicts floorplan depth rather than pose directly: gravity-aligned RGB is processed by single-view and multi-view branches, their depth distributions are fused by a learned selector,
\[
\mathbf P_{\text{fuse}}=w\,\mathbf P_{\text{mono}}+(1-w)\,\mathbf P_{\text{mv}},
\]
and the result is converted into an equiangular 1D ray scan. The floorplan is pre-rendered into corresponding ray scans, and the observation likelihood becomes
\[
p(\mathbf s_t\mid \mathbf o_t)=e^{-\|\hat{\mathbf r}-\mathbf r_{\mathbf s_t}\|_1}.
\]
A histogram filter over \((x,y,\phi)\) then fuses these observations over time, implemented efficiently as grouped convolution. F\(^3\)Loc reports \(27\) Hz histogram-filter iterations, handles non-upright cameras by virtual roll-pitch augmentation, and improves substantially over earlier floorplan baselines on Gibson and Structured3D [2403.03370].

These observation models reflect three recurrent design choices in FLoc: embedding-based cross-modal retrieval, structured latent rendering, and explicit geometric ray matching. Later work largely retains one of these choices and addresses its failure modes rather than discarding it outright.

## 3. Disambiguation through semantics, context, and contrastive priors

A central claim in recent FLoc research is that geometry alone is often insufficient. The semantic-ray framework of “Supercharging Floorplan Localization with Semantic Rays” keeps the F\(^3\)Loc-style probabilistic pose volume but augments depth rays \(\hat r_d\in\mathbb R^l\) with semantic rays \(\hat r_s\in\{1,\dots,C\}^l\). It constructs a depth probability volume \(P_d\), a semantic probability volume \(P_s\), and fuses them as
\[
P_c=w_sP_s+w_dP_d,\qquad w_d=1-w_s.
\]
Because semantic labels are discrete, the method replaces linear interpolation with majority-vote interpolation, performs coarse-to-fine refinement only on Top-\(k\) candidates, and can optionally mask the posterior with a room polygon when room-type confidence exceeds a threshold. On S3D it reports \(R@1m=58.78\) and \(R@1m30^\circ=57.49\) for the room-aware variant, versus \(22.4\) and \(21.3\) for F\(^3\)Loc; on ZInD it reports \(38.01\) and \(31.86\), versus \(15.07\) and \(11.46\) for F\(^3\)Loc [2507.09291]. The paper explicitly notes that hard ray assignment and hard room masking outperform soft alternatives.

A related but label-free line of work injects scene context into FLoc through pretraining. “Perspective from a Broader Context” argues that room style provides a prior over plausible floorplan regions. It learns a room discriminator from unlabeled room images using a constraint matrix derived from scene and episode metadata, InfoMap clustering, a cluster-level contrastive loss, and a binary style-pair prediction loss. The pretrained encoder is then transferred into the F\(^3\)Loc observation model, yielding consistent gains over F\(^3\)Loc and 3DP on Gibson and Structured3D(full) [2508.01216]. “Perspective from a Higher Dimension” instead uses self-supervised 3D geometric priors: Geometry-Constrained View Invariance (GCVI) and View-Scene Aligned Geometric (VSAG) priors are learned on ScanNet and then injected into the F\(^3\)Loc encoder without increasing inference-time burden. On Structured3D, the resulting single-frame model improves \(SR@1m\) from \(22.4\) to \(55.5\) and \(SR@1m30^\circ\) from \(21.3\) to \(24.0\) [2507.18881].

DisCo-FLoc makes the ambiguity problem explicit by separating candidate generation from disambiguation. A depth-aware ray-regression predictor first produces a Depth-Aware FLoc Probabilistic Map; a second stage then uses dual-level visual-geometric contrastive learning with position-level and orientation-level negatives to re-rank the top candidates. The paper argues that ambiguity is a matching problem under structural repetition rather than merely a depth-estimation problem. On Structured3D(full), it reports \(10.0/59.0/67.0/66.0\) at \(0.1\) m, \(0.5\) m, \(1\) m, and \(1\) m+\(30^\circ\), and it states that it outperforms semantic-based variants without requiring semantic labels [2601.01822]. A plausible implication is that strict pose-conditioned contrastive objectives can substitute for hand-annotated semantics when repeated geometry is the dominant error source.

The proof-of-concept COMPASS points in a similar direction but at descriptor level. It encodes the floorplan into a \(5\times 360\) radial descriptor with normalized range, hit type, range gradient, inverse range, and local range variance, and constructs an image-side hit-type descriptor from dual fisheye images by detecting windows and projecting them to azimuth bins. On a known-pose sample from the Hilti-Trimble SLAM Challenge 2026 dataset, cross-correlation of the hit-type channels peaks at \(0.9486\) with a shift of \(0^\circ\), validating wall-window pattern matching as a structural cue, though not yet a full localization system [2604.25388].

## 4. Uncertainty, reconstruction-grounded alignment, and zero-shot geometry

Another major development is uncertainty-aware FLoc. UnLoc keeps the FLoc/F\(^3\)Loc sequence-localization structure—predict depth, compare against floorplan rays, fuse over time—but replaces deterministic depth with a Laplace-distributed model. For each image column it predicts depth \(\hat d_i\) and uncertainty \(\hat b_i\), trains with
\[
L_d=\sum_{i=1}^{D}\left(\log(\hat b_i)+\frac{|\hat d_i-d_i(\mathbf s)|}{\hat b_i}\right),
\]
and constructs the observation likelihood as a product of Laplace factors. The method uses off-the-shelf pretrained monocular depth encoders, with Depth Anything V2 highlighted as the preferred backbone, rather than environment-specific depth training. On LaMAR HGE, the reported success rate rises from \(1.2\%\) to \(20\%\) for 15-frame sequences and from \(36.4\%\) to \(100\%\) for 100-frame sequences; on LaMAR CAB, UnLoc generalizes substantially better than F\(^3\)Loc [2509.11301]. The key significance is not only better accuracy but explicit propagation of observation confidence into the Bayesian posterior.

Several recent methods depart from exhaustive pose search and instead reconstruct a scene-derived proxy that is subsequently aligned to the floorplan. SceneAligner reconstructs a gravity-aligned 3D scene from an unconstrained image collection, filters the point cloud to retain reliable vertical structures, projects it to a top-down density map \(D\in\mathbb R^{H\times W\times 1}\), and estimates a similarity transform \(\mathbf M\in\mathrm{Sim}(2)\) between that proxy and the floorplan. To bridge the appearance gap between density maps and floorplans, it adapts DINOv3 ViT-B/16 with LoRA and a loss that combines feature matching, coordinate regression, topology preservation, and geometry consistency. On the in-the-wild C3 dataset, it reports combined angular-positional recall \((30^\circ,20\%)\) of \(73.58\), compared with \(32.96\) for C3Po and \(18.28\) for plain DINOv3; on Structured3D it reports combined recall \(51.6\), compared with \(21.3\) for F\(^3\)Loc and \(37.6\) for UnLoc [2605.22581].

Z-FLoc is a zero-shot alternative to learning-based FLoc. It reconstructs a BEV map from monocular images, extracts lines and circles, and matches them to floorplan primitives using minimal solvers embedded in a hybrid RANSAC framework. The alignment is a 2D similarity transform,
\[
\mathbf x'=s\,\mathbf r \mathbf x+\mathbf t,
\]
scored by a consistency term \(C^c\) and a violation term \(C^v\) that penalizes floorplan walls placed inside observed free space. On LaMAR CAB, a strict cross-scene setting, Z-FLoc reports \(100\%\) SR@1m at \(100\) and \(50\) frames, whereas F\(^3\)Loc-mono reports \(0\%\) across all lengths and UnLoc reports \(50\%\) at \(100\) frames and \(16.7\%\) at \(15\) frames [2606.04788]. This suggests that geometry-only floorplan alignment can be more robust than learned cross-modal matching under strong domain shift, albeit with dependence on reconstruction quality and structural primitive availability.

PALMS\(+\) occupies a distinct modular corner of the design space. It reconstructs scale-corrected 3D geometry from posed RGB images using Depth Pro, projects points near camera height into a 2D layout representation, extracts line segments, and matches them to the floorplan by convolution with a recorded-wall kernel and a Certainly Empty Space penalty:
\[
\mathcal H_o=\text{conv}(\mathcal F, RW_{\theta_o}-\alpha CES_{\theta_o}).
\]
It requires no training, outputs a three-dimensional pose posterior, and can initialize a particle filter for sequential localization. On a custom campus dataset, PALMS\(+\) reports \(30.4\%\) full-view localization accuracy versus \(7.6\%\) for PALMS and \(0.0\%\) for F3Loc, and on 33 trajectories it reduces RMSE from \(17.6\) m for F3Loc and \(4.1\) m for PALMS to \(2.2\) m [2511.09724].

## 5. Benchmarks, metrics, and empirical trends

The benchmark ecosystem for FLoc is heterogeneous but increasingly standardized around a small set of datasets. Structured3D and Gibson variants dominate synthetic evaluation; ZInD provides real residential panoramas and perspective crops; LaMAR HGE and CAB stress real-world sequence localization and cross-building generalization; C3 targets in-the-wild floorplan alignment; and some methods introduce campus-scale or challenge-specific datasets for scan-based or fisheye settings [2403.03370], [2507.09291], [2509.11301], [2605.22581], [2511.09724], [2604.25388].

Metrics also reflect methodological differences. Ray-based and sequence-based systems commonly report recall at \(0.1\) m, \(0.5\) m, \(1\) m, and \(1\) m with \(30^\circ\) orientation tolerance; Gibson(t) and LaMAR-style tracking settings additionally report success rate over the final 10 frames and RMSE; SceneAligner reports angular recall, positional recall as a percentage of floorplan diagonal, combined angular-positional recall, PCK, and RMSE; stationary scan methods use heatmap-based direct localization accuracy and trajectory-level error [2403.03370], [2508.01216], [2509.11301], [2605.22581], [2511.09724].

Across the reported settings, several empirical trends are consistent. First, geometry-only floorplan localization remains competitive when the geometry is represented effectively: F\(^3\)Loc improves over LASER on Structured3D monocular evaluation, and Z-FLoc exceeds strong learned baselines on unseen buildings [2403.03370], [2606.04788]. Second, disambiguation cues produce the largest jumps when layouts are repetitive: semantic rays, room-style priors, 3D geometric priors, and dual-level contrastive disambiguation all report substantial gains over geometry-only baselines [2507.09291], [2508.01216], [2507.18881], [2601.01822]. Third, uncertainty matters most on hard real scenes rather than easier synthetic ones, as emphasized by UnLoc’s much larger gains on LaMAR HGE than on Gibson(t) [2509.11301]. Fourth, the field is broadening from precise vector floorplans and bounded indoor apartments toward raster floorplans, large public buildings, campus environments, and unconstrained photo collections [2605.22581], [2511.09724].

Direct numerical comparisons must be interpreted with care because protocols differ. Even so, the aggregate direction is clear in the reported results: on Structured3D-style benchmarks, F\(^3\)Loc reports \(21.3\) combined recall at \(1\) m+\(30^\circ\), SceneAligner reports \(51.6\), and DisCo-FLoc reports \(66.0\) on Structured3D(full); on S3D, the semantic-ray method reports \(57.49\) in the same \(1\) m+\(30^\circ\) recall metric [2403.03370], [2605.22581], [2601.01822], [2507.09291]. This suggests steady progress, but the variation in inputs—single image, sequence, stationary scan, or unconstrained collection—remains a major axis of non-comparability.

## 6. Scope, adjacent problems, and recurring limitations

The term FLoc is sometimes used loosely, and several neighboring problems are better understood as floorplan-conditioned localization or refinement rather than direct visual floorplan localization. “Vision-Based Localization and LLM-based Navigation for Indoor Environments” performs waypoint classification from smartphone imagery and uses a cleaned floorplan image only for LLM-based route generation; it is explicitly described as not a pure floorplan-to-location retrieval method in the usual FLoc sense [2508.08120]. “Floorplan-Aware Camera Poses Refinement” uses a technical floorplan as a structural prior in RGB-D bundle adjustment to refine already-estimated poses rather than localize from scratch [2210.04572]. Fusion-DHL refines IMU-WiFi trajectories with a floorplan-conditioned CNN, and FP-Loc is a LiDAR-specific floor-plan localization system whose conceptual relation to FLoc is strong but whose sensing and optimization pipeline are not vision-based [2105.08837], [2203.00292]. A common misconception is therefore to equate any floorplan-aware localization or navigation system with visual FLoc proper.

The limitations reported across the literature are also recurrent. Repetitive geometry remains the canonical failure mode. Learning-based methods are sensitive to domain shift, environment-specific training, or depth-prediction quality; uncertainty-aware methods alleviate but do not eliminate this dependence [2509.11301]. Semantic methods benefit from doors, windows, and room types, but some papers explicitly note that semantic annotations are expensive and limited in availability, motivating contrastive or self-supervised substitutes [2507.09291], [2601.01822]. Reconstruction-grounded methods depend on gravity estimation and 3D reconstruction quality, and SceneAligner notes that errors in geometry propagate into the density map and then into alignment; Z-FLoc similarly depends on reliable BEV structure and observable geometric primitives [2605.22581], [2606.04788]. PALMS\(+\) identifies transparent surfaces and residual scale errors as important failure sources for monocular-depth-based scan matching [2511.09724].

A broader pattern is that the field is moving from direct cross-modal retrieval toward richer structural mediation. That mediation may take the form of rays, uncertainty distributions, semantic channels, learned context priors, geometric primitives, or 3D-grounded density maps. The shared objective remains unchanged: to bridge the domain gap between appearance-heavy camera observations and sparse architectural plans without sacrificing the compactness and long-term stability that make floorplans attractive priors in the first place.

Source: https://www.emergentmind.com/topics/visual-floorplan-localization-floc