Papers
Topics
Authors
Recent
Search
2000 character limit reached

MINav: Efficient Image-Goal Navigation

Updated 4 July 2026
  • MINav is an image-goal navigation method that formulates the problem as an offline goal-conditioned reinforcement learning task using unsupervised data collection and hindsight goal relabeling.
  • It leverages frozen DINOv3 visual features with a sparse similarity-based reward and an offline TD3+BC learning procedure to efficiently learn compact navigation policies.
  • The method enables rapid real-world deployment in under 120 minutes on consumer hardware while outperforming several zero-shot navigation baselines.

MINav is an image-goal visual navigation method that formulates ImageNav as an offline goal-conditioned reinforcement learning problem, combining unsupervised data collection with hindsight goal relabeling and offline policy learning. Its central claim is that a dataset can be collected, an in-domain policy trained, and the result deployed in the real world in less than 120 minutes, on a consumer laptop, and without human intervention (Liu et al., 27 Mar 2026). Within that formulation, MINav uses frozen visual features, sparse goal achievement defined by representation similarity, and an offline TD3+BC-style learning procedure to produce a compact policy that, in the reported experiments, outperforms several zero-shot navigation baselines in target environments and scales favorably with dataset size (Liu et al., 27 Mar 2026).

1. Problem formulation

MINav models image-goal navigation as a goal-conditioned partially observable Markov decision process. The state is a history of visual embeddings,

st[ot3,ot2,ot1,ot]R4×d,s_t \rightsquigarrow [o'_{t-3}, o'_{t-2}, o'_{t-1}, o'_t] \in \mathbb{R}^{4 \times d},

where ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d is the frozen DINOv3 feature of the raw RGB image oto_t. The observation space is RGB imagery, the action space is

A=[vx,vy,ωz][1,1]3,\mathcal{A}=[v_x,v_y,\omega_z]\in[-1,1]^3,

and transitions are induced by robot dynamics together with collision avoidance via LiDAR (Liu et al., 27 Mar 2026).

The goal space is constructed from valid goal embeddings filtered by a spatial-standard-deviation threshold,

G={ϕ(o)σspa(o)>δssd},δssd=0.02.\mathcal{G}=\{\phi(o)\mid \sigma_{\mathrm{spa}}(o)>\delta_{\mathrm{ssd}}\}, \qquad \delta_{\mathrm{ssd}}=0.02.

Goal achievement is defined through a sparse reward based on state-goal similarity:

R(st,g)=1    if    S(st,g)δdone    else    0,R(s_t,g)=1 \;\; \text{if} \;\; S(s_t,g)\ge \delta_{\mathrm{done}} \;\; \text{else} \;\; 0,

with δdone=0.8\delta_{\mathrm{done}}=0.8 and

S(st,g)=14k=t3tcos(ok,g).S(s_t,g)=\frac{1}{4}\sum_{k=t-3}^{t}\cos(o'_k,g).

The discount factor is γ=0.99\gamma=0.99, and the horizon is fixed as HH\to\infty until “done” (Liu et al., 27 Mar 2026).

This formulation makes the representation layer structurally central. A plausible implication is that navigation success depends not only on control learning, but also on the geometry induced by the frozen visual encoder and on the filtering of admissible goals through ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d0.

2. Unsupervised exploration and dataset construction

MINav begins from an unlabeled offline dataset,

ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d1

with no human labels or goals. The data-collection policy is “Pink Uniform Noise,” introduced to maximize state-action coverage under at most two hours of real-robot runtime (Liu et al., 27 Mar 2026).

The procedure generates temporally correlated pink noise in the frequency domain by creating a white-noise spectrum, shaping its magnitude proportionally to ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d2 with ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d3, and applying an inverse FFT to obtain a Gaussian-distributed sequence ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d4. The marginals are then converted to uniform variables through

ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d5

where ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d6 is the standard-normal cumulative distribution function, and finally linearly rescaled to the control range for each action dimension (Liu et al., 27 Mar 2026).

Execution occurs at ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d7 and is upsampled to ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d8 through smoothing. RGB frames are recorded at ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d9 and resized to oto_t0 for DINOv3 feature extraction. LiDAR is used only for safety, stopping the robot if an obstacle is too close. The reported data budgets are approximately oto_t1 steps for one hour and approximately oto_t2 steps for two hours (Liu et al., 27 Mar 2026).

For supervised targets, MINav relies on hindsight goal relabeling. For each transition oto_t3, a hindsight goal is sampled according to

oto_t4

for critic training, while actor updates use oto_t5. The geometric component samples oto_t6 with

oto_t7

then sets oto_t8. The reward under relabeling retains the same similarity-threshold form (Liu et al., 27 Mar 2026).

The empirical motivation for this design is explicit in the reported simulation results: pink uniform exploration obtains the highest normalized state, action, and joint state-action entropy among the compared noise strategies, and yields better downstream policy success rates than Ornstein-Uhlenbeck, white, and pink-Gaussian alternatives under the stated budgets (Liu et al., 27 Mar 2026).

3. Offline policy learning and model architecture

MINav uses an offline TD3+BC procedure. Two critic networks oto_t9 minimize

A=[vx,vy,ωz][1,1]3,\mathcal{A}=[v_x,v_y,\omega_z]\in[-1,1]^3,0

with target

A=[vx,vy,ωz][1,1]3,\mathcal{A}=[v_x,v_y,\omega_z]\in[-1,1]^3,1

The actor A=[vx,vy,ωz][1,1]3,\mathcal{A}=[v_x,v_y,\omega_z]\in[-1,1]^3,2 maximizes

A=[vx,vy,ωz][1,1]3,\mathcal{A}=[v_x,v_y,\omega_z]\in[-1,1]^3,3

with A=[vx,vy,ωz][1,1]3,\mathcal{A}=[v_x,v_y,\omega_z]\in[-1,1]^3,4. Target networks are updated by Polyak averaging with A=[vx,vy,ωz][1,1]3,\mathcal{A}=[v_x,v_y,\omega_z]\in[-1,1]^3,5, and exploration noise satisfies A=[vx,vy,ωz][1,1]3,\mathcal{A}=[v_x,v_y,\omega_z]\in[-1,1]^3,6 (Liu et al., 27 Mar 2026).

Offline model selection is performed with fitted Q-evaluation. A separate critic A=[vx,vy,ωz][1,1]3,\mathcal{A}=[v_x,v_y,\omega_z]\in[-1,1]^3,7 is trained by minimizing

A=[vx,vy,ωz][1,1]3,\mathcal{A}=[v_x,v_y,\omega_z]\in[-1,1]^3,8

where

A=[vx,vy,ωz][1,1]3,\mathcal{A}=[v_x,v_y,\omega_z]\in[-1,1]^3,9

Checkpoints are ranked by the average G={ϕ(o)σspa(o)>δssd},δssd=0.02.\mathcal{G}=\{\phi(o)\mid \sigma_{\mathrm{spa}}(o)>\delta_{\mathrm{ssd}}\}, \qquad \delta_{\mathrm{ssd}}=0.02.0 at initial states (Liu et al., 27 Mar 2026).

The encoder is a frozen DINOv3-ViT-S with G={ϕ(o)σspa(o)>δssd},δssd=0.02.\mathcal{G}=\{\phi(o)\mid \sigma_{\mathrm{spa}}(o)>\delta_{\mathrm{ssd}}\}, \qquad \delta_{\mathrm{ssd}}=0.02.1 parameters, or alternatively ViT-L. The actor is a 3-layer MLP with dimensions G={ϕ(o)σspa(o)>δssd},δssd=0.02.\mathcal{G}=\{\phi(o)\mid \sigma_{\mathrm{spa}}(o)>\delta_{\mathrm{ssd}}\}, \qquad \delta_{\mathrm{ssd}}=0.02.2, ReLU activations, and tanh output. Each critic is a 4-layer MLP with input consisting of state, goal, and action, hidden widths G={ϕ(o)σspa(o)>δssd},δssd=0.02.\mathcal{G}=\{\phi(o)\mid \sigma_{\mathrm{spa}}(o)>\delta_{\mathrm{ssd}}\}, \qquad \delta_{\mathrm{ssd}}=0.02.3, and ReLU nonlinearities. The total policy size is approximately G={ϕ(o)σspa(o)>δssd},δssd=0.02.\mathcal{G}=\{\phi(o)\mid \sigma_{\mathrm{spa}}(o)>\delta_{\mathrm{ssd}}\}, \qquad \delta_{\mathrm{ssd}}=0.02.4 parameters. Optimization uses Adam with learning rate G={ϕ(o)σspa(o)>δssd},δssd=0.02.\mathcal{G}=\{\phi(o)\mid \sigma_{\mathrm{spa}}(o)>\delta_{\mathrm{ssd}}\}, \qquad \delta_{\mathrm{ssd}}=0.02.5, no weight decay, batch size G={ϕ(o)σspa(o)>δssd},δssd=0.02.\mathcal{G}=\{\phi(o)\mid \sigma_{\mathrm{spa}}(o)>\delta_{\mathrm{ssd}}\}, \qquad \delta_{\mathrm{ssd}}=0.02.6, and G={ϕ(o)σspa(o)>δssd},δssd=0.02.\mathcal{G}=\{\phi(o)\mid \sigma_{\mathrm{spa}}(o)>\delta_{\mathrm{ssd}}\}, \qquad \delta_{\mathrm{ssd}}=0.02.7 training steps (Liu et al., 27 Mar 2026).

This architecture is intentionally asymmetric: representation learning is frozen and large, while the control policy is small. This suggests that MINav treats navigation primarily as a problem of exploiting a pretrained perceptual manifold with lightweight task-specific policy fitting, rather than jointly learning perception and control end to end.

4. Computational profile and deployment pipeline

A defining property of MINav is its end-to-end computational economy. The reported hardware is a consumer-grade laptop with an NVIDIA RTX 5070 GPU and G={ϕ(o)σspa(o)>δssd},δssd=0.02.\mathcal{G}=\{\phi(o)\mid \sigma_{\mathrm{spa}}(o)>\delta_{\mathrm{ssd}}\}, \qquad \delta_{\mathrm{ssd}}=0.02.8 RAM. Data collection takes G={ϕ(o)σspa(o)>δssd},δssd=0.02.\mathcal{G}=\{\phi(o)\mid \sigma_{\mathrm{spa}}(o)>\delta_{\mathrm{ssd}}\}, \qquad \delta_{\mathrm{ssd}}=0.02.9 to R(st,g)=1    if    S(st,g)δdone    else    0,R(s_t,g)=1 \;\; \text{if} \;\; S(s_t,g)\ge \delta_{\mathrm{done}} \;\; \text{else} \;\; 0,0 minutes on the robot. Data processing, including feature extraction and SSD filtering, requires R(st,g)=1    if    S(st,g)δdone    else    0,R(s_t,g)=1 \;\; \text{if} \;\; S(s_t,g)\ge \delta_{\mathrm{done}} \;\; \text{else} \;\; 0,1 minutes with ViT-S or R(st,g)=1    if    S(st,g)δdone    else    0,R(s_t,g)=1 \;\; \text{if} \;\; S(s_t,g)\ge \delta_{\mathrm{done}} \;\; \text{else} \;\; 0,2 minutes with ViT-L, while policy training requires R(st,g)=1    if    S(st,g)δdone    else    0,R(s_t,g)=1 \;\; \text{if} \;\; S(s_t,g)\ge \delta_{\mathrm{done}} \;\; \text{else} \;\; 0,3 minutes (Liu et al., 27 Mar 2026).

The timing summary is compact:

Pipeline configuration Total time
1 h collection + ViT-S 85 min
1 h collection + ViT-L 111 min
2 h collection + ViT-S 148 min
2 h collection + ViT-L 193 min

Only the R(st,g)=1    if    S(st,g)δdone    else    0,R(s_t,g)=1 \;\; \text{if} \;\; S(s_t,g)\ge \delta_{\mathrm{done}} \;\; \text{else} \;\; 0,4-hour collection settings satisfy the “under 120 minutes” criterion, namely R(st,g)=1    if    S(st,g)δdone    else    0,R(s_t,g)=1 \;\; \text{if} \;\; S(s_t,g)\ge \delta_{\mathrm{done}} \;\; \text{else} \;\; 0,5 minutes for ViT-S and R(st,g)=1    if    S(st,g)δdone    else    0,R(s_t,g)=1 \;\; \text{if} \;\; S(s_t,g)\ge \delta_{\mathrm{done}} \;\; \text{else} \;\; 0,6 minutes for ViT-L (Liu et al., 27 Mar 2026). The training cost itself is nearly constant across the reported R(st,g)=1    if    S(st,g)δdone    else    0,R(s_t,g)=1 \;\; \text{if} \;\; S(s_t,g)\ge \delta_{\mathrm{done}} \;\; \text{else} \;\; 0,7-hour and R(st,g)=1    if    S(st,g)δdone    else    0,R(s_t,g)=1 \;\; \text{if} \;\; S(s_t,g)\ge \delta_{\mathrm{done}} \;\; \text{else} \;\; 0,8-hour datasets: both are trained for R(st,g)=1    if    S(st,g)δdone    else    0,R(s_t,g)=1 \;\; \text{if} \;\; S(s_t,g)\ge \delta_{\mathrm{done}} \;\; \text{else} \;\; 0,9 steps, with approximately δdone=0.8\delta_{\mathrm{done}}=0.80 minutes of policy optimization. Feature extraction, not RL optimization, becomes the dominant difference between the ViT-S and ViT-L variants (Liu et al., 27 Mar 2026).

The reported scaling figures are correspondingly simple: a δdone=0.8\delta_{\mathrm{done}}=0.81-hour dataset comprises approximately δdone=0.8\delta_{\mathrm{done}}=0.82 samples, a δdone=0.8\delta_{\mathrm{done}}=0.83-hour dataset approximately δdone=0.8\delta_{\mathrm{done}}=0.84 samples, ViT-L feature processing requires approximately δdone=0.8\delta_{\mathrm{done}}=0.85 minutes compared with approximately δdone=0.8\delta_{\mathrm{done}}=0.86 minutes for ViT-S, and the policy remains deployable after these stages without human intervention (Liu et al., 27 Mar 2026).

5. Empirical performance

Simulation experiments include a PointMaze-like environment with 3D ground-truth state. Coverage is evaluated with normalized entropies

δdone=0.8\delta_{\mathrm{done}}=0.87

applied to state entropy δdone=0.8\delta_{\mathrm{done}}=0.88, action entropy δdone=0.8\delta_{\mathrm{done}}=0.89, and joint entropy S(st,g)=14k=t3tcos(ok,g).S(s_t,g)=\frac{1}{4}\sum_{k=t-3}^{t}\cos(o'_k,g).0. Under this metric, pink uniform exploration yields the highest coverage. In the same simulation study, the downstream policy success rate improves with data budget from S(st,g)=14k=t3tcos(ok,g).S(s_t,g)=\frac{1}{4}\sum_{k=t-3}^{t}\cos(o'_k,g).1 to S(st,g)=14k=t3tcos(ok,g).S(s_t,g)=\frac{1}{4}\sum_{k=t-3}^{t}\cos(o'_k,g).2 hours, and fitted Q-evaluation correlates strongly with true success rate, with Spearman S(st,g)=14k=t3tcos(ok,g).S(s_t,g)=\frac{1}{4}\sum_{k=t-3}^{t}\cos(o'_k,g).3 (Liu et al., 27 Mar 2026).

Real-world evaluation uses a Unitree Go2 quadruped in three environments, denoted Simple, Standard, and Complex, with S(st,g)=14k=t3tcos(ok,g).S(s_t,g)=\frac{1}{4}\sum_{k=t-3}^{t}\cos(o'_k,g).4 spatially diverse image goals and S(st,g)=14k=t3tcos(ok,g).S(s_t,g)=\frac{1}{4}\sum_{k=t-3}^{t}\cos(o'_k,g).5 trials per goal, for maximum episode lengths of S(st,g)=14k=t3tcos(ok,g).S(s_t,g)=\frac{1}{4}\sum_{k=t-3}^{t}\cos(o'_k,g).6 to S(st,g)=14k=t3tcos(ok,g).S(s_t,g)=\frac{1}{4}\sum_{k=t-3}^{t}\cos(o'_k,g).7 steps. Reported baselines are Random, NoMaD, ViNT, and GNM. The principal metrics are success rate, completion time, and success weighted by time,

S(st,g)=14k=t3tcos(ok,g).S(s_t,g)=\frac{1}{4}\sum_{k=t-3}^{t}\cos(o'_k,g).8

Among the highlighted results, MINav with a S(st,g)=14k=t3tcos(ok,g).S(s_t,g)=\frac{1}{4}\sum_{k=t-3}^{t}\cos(o'_k,g).9-hour dataset and ViT-S exceeds all baselines on success rate in the Simple environment, achieving γ=0.99\gamma=0.990 compared with a best baseline value of γ=0.99\gamma=0.991. Increasing data from γ=0.99\gamma=0.992 hour to γ=0.99\gamma=0.993 hours raises success rate in the Standard environment from γ=0.99\gamma=0.994 to γ=0.99\gamma=0.995, and in the Complex environment from γ=0.99\gamma=0.996 to γ=0.99\gamma=0.997. ViT-L provides only slight gains, and only in the Complex environment at γ=0.99\gamma=0.998 hours (Liu et al., 27 Mar 2026).

A real-world ablation on noise strategies, using γ=0.99\gamma=0.999-hour datasets in the Standard environment, reports the following:

Noise strategy SR Time STL
White Uniform HH\to\infty0 HH\to\infty1 HH\to\infty2
Pink Gauss HH\to\infty3 HH\to\infty4 HH\to\infty5
Pink Uniform HH\to\infty6 HH\to\infty7 HH\to\infty8

The reported robustness study uses the HH\to\infty9-hour Standard-environment policy under dynamic human interference and on a second platform, the AgileX Limo. On the quadruped, the static and dynamic settings both achieve ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d00 success, with completion times of ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d01 and ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d02 and STL values of ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d03 and ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d04, respectively. On the wheeled platform, the static setting reaches ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d05 success with ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d06 completion time and ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d07 STL, while the dynamic setting reaches ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d08 success with ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d09 completion time and ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d10 STL (Liu et al., 27 Mar 2026).

Taken together, these results position MINav as an explicitly in-domain method rather than a general zero-shot navigator. Its strongest outcomes are reported after collecting data in the target environment and training an offline policy for that environment.

The limitations identified for MINav are concrete. Goal ambiguity can arise because near-wall observations may satisfy ot=ϕ(ot)Rdo'_t=\phi(o_t)\in\mathbb{R}^d11 in representation space without corresponding to true arrival; suggested remedies are stricter SSD filtering or depth. Partial observability and the absence of memory lead to failures on long chains of turns; adding recurrent or LSTM context is proposed as a possible improvement. The sparse reward may slow learning when the similarity margin is small; a learned dense reward via contrastive or regression objectives is suggested as a direction for improving sample efficiency. The policy is also described as blind to robot pose drift, which may be mitigated by fusing odometry or SLAM poses. Finally, the offline-only setting limits continual adaptation, and fitted Q-evaluation may inherit bias from the learned value function (Liu et al., 27 Mar 2026).

A recurrent source of confusion is nomenclature. In the same period, a distinct system named “MinNav” was introduced for tiny aerial robots, using a monocular camera, optical flow, uncertainty estimation, and active perception to navigate through static obstacles, dynamic obstacles, and unknown-shaped gaps (Patil et al., 5 Jun 2026). That method concerns active monocular navigation for aerial robots, whereas MINav concerns image-goal navigation via unsupervised exploration and offline RL for ground robots (Liu et al., 27 Mar 2026). The similarity of names does not indicate a shared methodology.

Within current visual navigation research, MINav is best understood as a compact pipeline defined by five coupled design choices: pink-uniform unsupervised exploration, frozen DINOv3 embeddings, hindsight goal relabeling, offline TD3+BC, and FQE-based checkpoint selection (Liu et al., 27 Mar 2026). The reported results suggest that these components, when assembled under tight runtime and hardware constraints, are sufficient for rapid policy prototyping and deployment in target environments.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to MINav.