Spatial-Implicit Local Frames

• Spatial-Implicit Local Frames are local, data-conditioned reference systems that encode spatial relations using relative coordinates and implicit neighborhood statistics.
• They are applied in diverse domains such as image decoding, video super-resolution, robotic navigation, and dynamic scene generation to enforce continuity and geometric consistency.
• Modern approaches leverage neural networks and local filters to implement these frames, improving performance metrics and enabling robust spatial reasoning in complex tasks.

Searching arXiv for papers related to “Spatial-Implicit Local Frames” and its main technical instantiations. Spatial-Implicit Local Frames are local, data-conditioned reference structures that encode spatial relations through relative coordinates, local neighborhoods, or latent anchors rather than through a single global parameterization. In the cited literature, the concept appears in several technically distinct forms: cell-centered coordinate systems for continuous image decoding, neighborhood co-occurrence statistics that act as implicit geometric checks in retrieval, position-specific local filters for motion compensation, subject-anchored templates for common-sense spatial reasoning, node- or robot-centered frames for control and navigation, and seed- or camera-centered local spaces for dynamic scene generation (Chen et al., 2020, Jacob et al., 2018, Liu et al., 2020, Collell et al., 2017, Kofinas et al., 2021, Dang et al., 7 Jul 2025, Wu et al., 3 Jul 2025, Team et al., 12 Mar 2026). The common principle is local binding of prediction to spatial context: continuity, invariance, geometric consistency, or spatial inference are enforced where the signal is observed, not by a single globally uniform representation.

1. Conceptual scope and historical development

A useful genealogy begins with locally adaptive differential frames on the roto-translation group. In "Locally Adaptive Frames in the Roto-Translation Group and their Applications in Medical Imaging" (Duits et al., 2015), gauge frames are generalized from images to data representations $U:\mathbb{R}^{d}\rtimes S^{d-1}\to\mathbb{R}$, making it possible to define multiple frames per spatial position, one per orientation. The same broad idea later reappears in more application-specific forms: subject-centered spatial templates for implicit language (Collell et al., 2017), co-occurrence-defined neighborhoods in retrieval (Jacob et al., 2018), cell-centered image decoders (Chen et al., 2020), position-specific local filters for video super-resolution (Liu et al., 2020), and node- or seed-centered frames in robotics and scene generation (Kofinas et al., 2021, Wu et al., 3 Jul 2025).

Across these works, “local” does not always mean an explicit Euclidean frame with an origin and axes. In some formulations, such as LIIF, the frame is literal: each latent cell has a center $c_i$, a scale given by cell size, and relative coordinates $r_i(x)$ (Chen et al., 2020). In others, such as ISTA, the frame is implicit in the neighborhood $\Omega(x)$ and the block-wise co-occurrence tensor of nearby descriptors, without explicit coordinates or rigid alignment (Jacob et al., 2018). The term therefore spans both explicit local coordinate systems and implicit neighborhood-conditioned geometries.

Domain	Local-frame carrier	Representative work
Differential image analysis	One frame per orientation in $SE(d)$	Gauge frames (Duits et al., 2015)
Continuous image representation	Cell center $c_i$, relative coordinate $r_i(x)$, local ensemble	LIIF (Chen et al., 2020)
Image retrieval	Neighborhood $\Omega(x)$ and cluster-pair co-occurrence blocks	ISTA (Jacob et al., 2018)
Video super-resolution	Position-specific dynamic local filters in LC layers	LCVSR (Liu et al., 2020)
Spatial semantics and VideoQA	Subject boxes or discontinuous clips as anchors	Implicit templates (Collell et al., 2017), ImplicitQA (Swetha et al., 26 Jun 2025)
Dynamics, navigation, generation	Node-, robot-, seed-, or camera-centered local spaces	LoCS (Kofinas et al., 2021), Hybrid Map (Dang et al., 7 Jul 2025), LocalDyGS (Wu et al., 3 Jul 2025), InSpatio-WorldFM (Team et al., 12 Mar 2026)

A recurring historical shift is visible. Early work emphasized differential geometry and symbolic spatial relations; later work moved toward neural local decoders, local feature fields, and attention-based memory. This suggests that Spatial-Implicit Local Frames are less a single method than a reusable design pattern for spatially conditioned computation.

2. Continuous image fields and localized implicit bases

The most explicit 2D formulation appears in "Learning Continuous Image Representation with Local Implicit Image Function" (Chen et al., 2020). Let $Z$ be a learned 2D feature map on a low-resolution grid. For a query coordinate $x\in\mathbb{R}^2$, LIIF predicts RGB by aggregating neighboring cell-conditioned predictions: $c_i$0 Here $c_i$1 is typically the four cells defined by floor/ceil in each axis, $c_i$2 is the per-cell feature, $c_i$3 is the cell center, and $c_i$4 is the relative coordinate of $c_i$5 in the local frame of cell $c_i$6, normalized by cell size so that $c_i$7. The decoder is a shared 5-layer ReLU MLP with hidden width 256; optional feature unfolding concatenates $c_i$8 neighboring latent codes, and cell decoding appends the target pixel footprint $c_i$9. The local ensemble is designed to avoid discontinuities caused by nearest-cell switching. Trained with bicubic downsampling, $r_i(x)$0 LR patches, continuous random scales $r_i(x)$1, Adam, batch size 16, and an $r_i(x)$2 loss, LIIF paired with EDSR-baseline achieves PSNR $r_i(x)$3 at $r_i(x)$4 on DIV2K validation and outperforms MetaSR at $r_i(x)$5, with EDSR-LIIF at $r_i(x)$6 dB versus EDSR-MetaSR at $r_i(x)$7 dB and RDN-LIIF at $r_i(x)$8 dB versus RDN-MetaSR at $r_i(x)$9 dB (Chen et al., 2020).

Later INR work generalized locality from cell-centered coordinate systems to localized basis functions. "Learning Spatially Collaged Fourier Bases for Implicit Neural Representation" (Li et al., 2023) replaces global Fourier mixtures by region-wise dispatching,

$\Omega(x)$0

with learnable soft masks $\Omega(x)$1 that collage distinct Fourier patches into different regions. The architecture uses layerwise masks $\Omega(x)$2 and gated sinusoidal features $\Omega(x)$3. The reported gains are task-wide: image fitting improves by over $\Omega(x)$4 dB PSNR relative to the best baselines, and 3D reconstruction reaches $\Omega(x)$5 IoU and $\Omega(x)$6 Chamfer Distance (Li et al., 2023).

"FLAIR: Frequency- and Locality-Aware Implicit Neural Representations" (Ko et al., 19 Aug 2025) makes the frame interpretation explicit. RC-GAUSS combines a sinc term for band-limitation, a raised cosine factor for sharper passbands, and a Gaussian envelope for spatial localization; a learnable modulation $\Omega(x)$7 shifts the center frequency. The paper interprets the resulting network as a redundant local frame or dictionary over the spatial domain, with units behaving like localized Gabor- or wavelet-like atoms, and augments the coordinate input with Wavelet-Energy-Guided Encoding derived from a DWT energy map. On Kodak image fitting, FLAIR reports average PSNR $\Omega(x)$8 dB, SSIM $\Omega(x)$9, and LPIPS $SE(d)$0; on DIV2K arbitrary-scale super-resolution it reports $SE(d)$1 PSNR $SE(d)$2, SSIM $SE(d)$3, LPIPS $SE(d)$4, and $SE(d)$5 PSNR $SE(d)$6, SSIM $SE(d)$7, LPIPS $SE(d)$8 (Ko et al., 19 Aug 2025). The paper also states that it does not formalize frame bounds $SE(d)$9, even though the empirical behavior fits a frame-theoretic interpretation.

3. Implicit neighborhoods, local operators, and differential frames

In retrieval, local frames can be realized without explicit coordinate systems. "Leveraging Implicit Spatial Information in Global Features for Image Retrieval" (Jacob et al., 2018) defines implicit local frames through descriptor neighborhoods $c_i$0 and their co-occurrence statistics. For descriptors $c_i$1 with cluster assignments $c_i$2, ISTA aggregates cluster-pair tensor blocks

$c_i$3

with $c_i$4 for neighboring descriptors in the implementation. Centering is performed against an average co-occurrence tensor $c_i$5, followed by per-block SVD, adaptive truncation, power normalization, cross-cluster normalization, and a two-stage reduction to a final vector of approximately $c_i$6k dimensions. With $c_i$7 and $c_i$8, the intermediate raw dimension is approximately $c_i$9. On Holidays, Oxford5k, and Paris6k, ISTA with MobileNet reports mAP $r_i(x)$0, $r_i(x)$1, and $r_i(x)$2, respectively, outperforming off-the-shelf NetVLAD and original STA (Jacob et al., 2018). The key point is that geometric consistency is enforced through local descriptor co-occurrences rather than explicit frame alignment.

A different operator-level realization appears in "End-To-End Trainable Video Super-Resolution Based on a New Mechanism for Implicit Motion Estimation and Compensation" (Liu et al., 2020). The Dynamic Local Filter Network generates sample-specific and position-specific dynamic local filters $r_i(x)$3 for locally connected layers. For target pixel $r_i(x)$4 and feature channel $r_i(x)$5,

$r_i(x)$6

With $r_i(x)$7 frames, $r_i(x)$8 spatial support, and $r_i(x)$9 output feature maps, the local filter acts as an implicit spatiotemporal frame around each target pixel. The model avoids explicit flow fields and warp grids, and the full system combines DLFN, pixel-shuffle upsampling, and a Global Refinement Network. On Vid4, the reported results are PSNR $\Omega(x)$0 and SSIM $\Omega(x)$1 at $\Omega(x)$2, and PSNR $\Omega(x)$3 and SSIM $\Omega(x)$4 at $\Omega(x)$5; on SPMCS, PSNR $\Omega(x)$6, SSIM $\Omega(x)$7 at $\Omega(x)$8, and PSNR $\Omega(x)$9, SSIM $Z$0 at $Z$1 (Liu et al., 2020).

The differential-geometric lineage remains important. In "Locally Adaptive Frames in the Roto-Translation Group and their Applications in Medical Imaging" (Duits et al., 2015), local frames are computed by exponential curve fits in $Z$2, obtained from the spectral decomposition of a structure tensor or Hessian on the extended position-orientation domain. Because the representation is defined on positions and orientations, multiple frames coexist at a crossing, one per orientation channel. These gauge frames are then used in differential invariants and crossing-preserving PDE flows such as

$Z$3

where $Z$4 are the locally adapted frame vectors. The construction anticipates later neural methods by treating locality and orientation as the primary carriers of spatial organization rather than using a single image-plane frame.

4. Spatial semantics, implicit templates, and cross-frame reasoning

Spatial-Implicit Local Frames also arise in semantic inference. "Acquiring Common Sense Spatial Knowledge through Implicit Spatial Templates" (Collell et al., 2017) defines a subject-anchored local 2D frame for triplets $Z$5, where the object location is represented relative to the subject box. In local coordinates,

$Z$6

optionally normalized by subject size. Two model families are used: REG predicts $Z$7, while PIX predicts an $Z$8 heatmap approximating $Z$9. After removing explicit prepositions from Visual Genome, the paper reports approximately $x\in\mathbb{R}^2$0k implicit instances spanning $x\in\mathbb{R}^2$1 implicit relations and $x\in\mathbb{R}^2$2 unique objects. On generalized triplets, REG$x\in\mathbb{R}^2$3 reports $x\in\mathbb{R}^2$4, $x\in\mathbb{R}^2$5, $x\in\mathbb{R}^2$6, $x\in\mathbb{R}^2$7, $x\in\mathbb{R}^2$8, $x\in\mathbb{R}^2$9; for generalized words, REG$c_i$00 reports $c_i$01, $c_i$02, $c_i$03, $c_i$04, $c_i$05, $c_i$06 (Collell et al., 2017). The central result is that implicit relations such as “riding,” “holding,” or “kicking” induce predictable local spatial arrangements even when geometry is not explicitly stated.

The video counterpart is "ImplicitQA: Going beyond frames towards Implicit Video Reasoning" (Swetha et al., 26 Jun 2025). Here “local frames” are the finite set of video frames actually ingested by a model, typically $c_i$07–$c_i$08 frames. The benchmark contains $c_i$09K multiple-choice QA pairs from $c_i$10 high-quality creative video clips, annotated into nine categories including lateral and vertical spatial reasoning, relative depth and proximity, viewpoint and visibility, motion and trajectory dynamics, causal and motivational reasoning, social interaction, physical context, and inferred counting. The benchmark is visual-only: audio and subtitles are removed. Human performance is $c_i$11 overall accuracy and $c_i$12 macro-average. With $c_i$13 frames, GPT-O3 reports $c_i$14 overall accuracy and $c_i$15 macro-average; in spatial subsets it reports $c_i$16 on lateral reasoning, $c_i$17 on vertical reasoning, $c_i$18 on relative depth and proximity, and $c_i$19 on viewpoint and visibility, all below human baselines of $c_i$20, $c_i$21, $c_i$22, and $c_i$23 (Swetha et al., 26 Jun 2025). The benchmark’s main claim is that many spatial facts in cinematic video are not directly visible in any single frame; they must be reconstructed across discontinuous shots, off-screen events, and changing viewpoints.

These two lines of work correct a common misunderstanding. Spatial-implicit frames are not limited to metric geometry. They also denote local semantic priors over where an object is likely to be, or local temporal windows whose insufficiency forces narrative integration.

5. Object-centric frames in dynamics, visuomotor control, and navigation

"Roto-translated Local Coordinate Frames For Interacting Dynamical Systems" (Kofinas et al., 2021) gives a clean invariance-based formulation. For node $c_i$24, a local frame is centered at $c_i$25 and oriented by $c_i$26. A neighbor $c_i$27 is expressed in $c_i$28’s frame as

$c_i$29

with $c_i$30 and $c_i$31. Message passing and latent edge inference then operate on roto-translation-invariant local coordinates, while trajectory decoding becomes equivariant by inverting the local-to-global transform. On synthetic 2D physics, the reported relation prediction F1 is $c_i$32 for LoCS, compared with $c_i$33 for NRI and $c_i$34 for dNRI (Kofinas et al., 2021). The paper’s broader point is that local frames induce anisotropic filtering on graphs without requiring a fully $c_i$35-equivariant architecture.

In robotic imitation learning, "Rethinking Implicit Spatial Representation in Visuomotor Policy Learning" (Chen et al., 13 Jun 2026) treats spatial softmax pooling as a coordinate extractor. For feature map $c_i$36,

$c_i$37

Each channel thus yields a compact coordinate-like anchor. On three Robomimic short-horizon tasks with ResNet-18 at $c_i$38, SSPool uses $c_i$39 dimensions and achieves the best mean success, $c_i$40, outperforming AvgPool at $c_i$41, MaxPool at $c_i$42, and NoPool at $c_i$43, despite using $c_i$44–$c_i$45 fewer dimensions. The proposed PRISM encoder preserves multiscale implicit spatial information through multiscale SSPool and top-down cross-attention fusion; on ToolHang, PRISM improves average success from $c_i$46 to $c_i$47 while increasing parameters by only $c_i$48 (Chen et al., 13 Jun 2026).

Navigation introduces a map-centric variant. "Bio-Inspired Hybrid Map: Spatial Implicit Local Frames and Topological Map for Mobile Cobot Navigation" (Dang et al., 7 Jul 2025) defines a local frame as a robot-centered maplet of hybrid points $c_i$49, fusing explicit 3D coordinates $c_i$50, learned features $c_i$51, and semantics $c_i$52. An SDF model $c_i$53 and Levenberg–Marquardt registration align observations into the current local frame; local frames are then connected in a factor-graph topological map and exploited by an RRT* planner. On TUM RGB-D, the reported ATE RMSE is $c_i$54 cm on fr1/desk, $c_i$55 cm on fr2/xyz, and $c_i$56 cm on fr3/office, outperforming iMAP, NICE-SLAM, and ESLAM. In planning, the reported runtime is $c_i$57 ms versus $c_i$58 ms for baseline RRT*, and travel distance is $c_i$59 m versus $c_i$60 m (Dang et al., 7 Jul 2025). Here the local frame is both a geometric registration domain and a compact memory structure.

6. Seed- and camera-centered frames in dynamic scene generation and world models

"LocalDyGS: Multi-view Global Dynamic Scene Modeling via Adaptive Local Implicit Feature Decoupling" (Wu et al., 3 Jul 2025) introduces seed-centered local spaces for dynamic scenes. Each seed is $c_i$61, with position $c_i$62, static feature $c_i$63, and scale $c_i$64. A 4D multi-resolution hash encoding and shallow MLP produce a dynamic residual feature $c_i$65, and a weight field predicts $c_i$66, yielding

$c_i$67

Temporal Gaussians are then decoded per seed, with means

$c_i$68

and opacities $c_i$69. Gaussians with opacity below $c_i$70 are deactivated. The default setting uses $c_i$71 Temporal Gaussians per seed and $c_i$72k training iterations. On N3DV, LocalDyGS reports PSNR $c_i$73, DSSIM$c_i$74 $c_i$75, DSSIM$c_i$76 $c_i$77, LPIPS $c_i$78, $c_i$79 FPS, $c_i$80 h training time, and $c_i$81 MB model size; on MeetRoom it reports PSNR $c_i$82; on VRU basketball it reports PSNR $c_i$83, SSIM $c_i$84, and LPIPS $c_i$85 (Wu et al., 3 Jul 2025). The design avoids explicit long-range tracking by activating local spaces only when motion enters them.

"InSpatio-WorldFM: An Open-Source Real-Time Generative Frame Model" (Team et al., 12 Mar 2026) makes the frame notion camera-centric. Each target view defines a fresh local frame through the target camera transform $c_i$86; explicit 3D anchors are rendered into an anchor image by

$c_i$87

while a previously observed reference image and its pose are provided as implicit spatial memory tokens. A self-attention-only Diffusion Transformer processes target latent, anchor image, and reference image jointly, with Projected Relative Positional Encoding injecting camera geometry. The model generates each frame independently rather than through a temporal window, yet enforces multi-view consistency through explicit anchors and implicit memory. Reported performance is approximately $c_i$88 FPS at $c_i$89 on A100 with $c_i$90–$c_i$91 ms interaction latency, and approximately $c_i$92 FPS on RTX 4090 in single-step mode (Team et al., 12 Mar 2026).

A recurrent misconception is that Spatial-Implicit Local Frames necessarily require explicit geometric frames. ISTA shows that local frames can be realized purely through neighborhood co-occurrence statistics (Jacob et al., 2018). Conversely, not every use of “frame” is formal frame theory: FLAIR explicitly states that it does not formalize frame bounds $c_i$93, even though its localized atoms fit that interpretation (Ko et al., 19 Aug 2025). Reported limitations also vary by domain. LIIF notes that extreme upscales may show reduced PSNR versus scale-specific baselines and that fidelity depends on encoder quality and downsampling-kernel match (Chen et al., 2020). ImplicitQA shows that increasing the number of frames beyond $c_i$94 often plateaus, indicating that current temporal aggregation is inadequate for deep spatial-implicit reasoning (Swetha et al., 26 Jun 2025). The bio-inspired navigation system acknowledges drift between local frames (Dang et al., 7 Jul 2025). This suggests that the topic is best understood as a family of locality-enforcing mechanisms whose strengths depend on how well local context, continuity, and cross-frame consistency are coupled to the target task.