---
title: Hamilton-Jacobi Reachability Filters
url: https://www.emergentmind.com/topics/hamilton-jacobi-hj-reachability-filters
type: topic
---

# Hamilton-Jacobi Reachability Filters

Hamilton-Jacobi (HJ) Reachability Filters are a class of safety-critical control methodologies that employ the mathematical framework of Hamilton-Jacobi reachability analysis to monitor system states and enforce state-constraint satisfaction. These filters operate by computing and leveraging the value function associated with the backward reachable set of unsafe or failure states, providing formal guarantees for safe operation—even under nonlinear dynamics, nonconvex constraints, disturbances, and high-dimensional or partially observed systems. Recent work extends traditional state-space HJ filters to latent and data-driven settings, dramatically broadening the scope of safe control in robotics and autonomous systems [2502.00935][2312.15347][2407.09645].

## 1. Mathematical Formulation and Core Principles

The foundational principle of HJ reachability filtering is the backward reachable set characterization for nonlinear control systems,
$$
\dot{x} = f(x, u), \quad x \in \mathbb{R}^n,\; u \in U
$$
given a failure (unsafe) set $\mathcal{F} = \{x : \ell(x) < 0\}$ for some margin $\ell$. The core object is the value function $V(x, t)$, which, under nominal discrete or continuous-time dynamics, evolves according to the (terminal- or infinite-horizon) Hamilton-Jacobi partial differential equation (PDE):
$$
\frac{\partial V}{\partial t}(x, t) + \min_{u \in U} \nabla_x V(x, t) \cdot f(x, u) = 0,
$$
with terminal condition $V(x, T) = \ell(x)$. The zero- or subzero-level sets of $V$ define the backward reachable sets: states that will inevitably reach $\mathcal{F}$ within time $T$, regardless of the admissible control policy [2502.00935][2511.15238]. 

Safety filtering is realized by interpreting $V$ as a certificate: if $V(x, 0) > 0$ there exists a control policy to remain safe; if $V(x, 0) \leq 0$, no control can avert failure [2502.00935]. 

For stochastic or high-dimensional systems, value iteration and RL-style Bellman backups yield discounted or time-relaxed surrogates:
$$
V(x) = (1-\gamma)\ \ell(x) + \gamma\,\min_{u \in U} V(f(x, u))
$$
with $\gamma < 1$ ensuring contraction [2502.00935].

## 2. Classical State-Space HJ Filters

Traditional HJ reachability filters operate by: 
- Precomputing the value function $V(x, t)$ on a discrete grid or via neural approximators [2011.02082][2511.15238], 
- At runtime, querying $V$ to determine whether the current state is safe,
- Modifying or projecting a base/nominal controller's action to ensure future state trajectories never enter the unsafe set $\mathcal{F}$.

Three principal families of such filters, as detailed in [2312.15347], are:

| Filter                 | Core Mechanism                                           | Properties                  |
|------------------------|---------------------------------------------------------|-----------------------------|
| Least-Restrictive (LR) | Directly switches to the optimal safety override if $V(x) \leq 0$ | Minimal intervention, can induce bang-bang control |
| Smooth LR (SLR)        | Solves a QP to minimally modify nominal action on boundary | Smoother, low jerk         |
| Smooth Blending (SB)   | Blends nominal and safe control with parameter $\gamma$   | Continuous, tunable conservativeness |

These filters guarantee forward invariance of the safe set by projecting the base policy onto the set of actions that preserve (or do not decrease) $V(x, t)$ [2312.15347][2307.00193]. In high-dimensional settings, neural approximators or trajectory-optimization solvers may be used in place of grid-based methods [2011.02082][2005.07875].

## 3. Learning-Based and Model-Free Extensions

The classical paradigm of HJ filters is limited by the "curse of dimensionality". To address this, multiple methodologies have been developed:
- **Deep Neural PDE Solvers**: Methods such as DeepReach parameterize $V(x,t)$ by a neural network with periodic or sinusoidal activations, trained using the unsupervised PDE residual loss to approximate the viscosity solution of the HJI variational inequality [2011.02082].
- **Classification-Based Filters**: For control-affine systems, the boundary of the optimal safety action is learned as a collection of binary classifiers, each selecting the bang-bang extremum per control dimension [1803.03237].
- **Model-Free Q-Filters**: Approaches such as Deep QP Safety Filter and verifiable multiplicative Q-networks learn Q-functions or derivatives directly from data, using contraction-based Bellman operators to ensure convergence to the viscosity solution, and enforce safety online via quadratic program (QP) or mixed-integer QCQP checks [2601.21297][2506.15693].
- **HJ-Patch and Barrier Value Function Refinement**: Existing approximate or neural CBFs are "patched" near the safety boundary using local HJ updates, yielding certifiably invariant sets with drastically reduced computational overhead compared to global reachability DP [2304.09850].

## 4. Latent-Space and High-Dimensional Generalizations

Latent HJ reachability filters generalize the state-space HJ formalism to systems where the true state is not directly observable—e.g., robotics with raw image inputs:
- The system is mapped into a learned latent space by a generative world model (e.g., RSSM, transformer-based) trained on multimodal trajectory data [2502.00935].
- Safety/failure sets are specified as classifiers in the latent space: a margin function $\lambda_\theta(z)$ trained on labeled observation-embeddings.
- The HJ-Bellman equation is applied in the latent space, propagating the safe set and synthesizing safety-preserving actions without explicit recovery demonstrations.
- At runtime, the process is: encode observation $o_t$ to latent $z_t$, assess proposed action by imagining its effect via the model, and override with safety-preserving action only if necessary.

Empirical results show that such filters not only generalize safety monitoring to rich observation modalities (vision, proprioception) but also guard against complex hazards not easily hand-coded, such as bag-spill or dexterous manipulation failures. Latent HJ reachability achieved near-parity with privileged state-access filters and outperformed conventional CMDP baselines in both simulated and real hardware [2502.00935].

## 5. Integration with Planning and Control Architectures

HJ reachability filters are compatible with a wide variety of control frameworks and planners:
- **Model Predictive Control (MPC)**: The safety value function $V(x, t)$ is incorporated as a constraint, ensuring the MPC horizon always terminates in the backward reachable set—yielding recursive feasibility and closed-loop safety [2506.23346].
- **Sampling-Based Planning**: Certified neural approximations to the HJ value function (e.g., Fourier Neural Operators) enable contingency-aware pruning of unsafe samples during RRT or incremental multi-goal planning [2603.17022]. Under-approximation guarantees ensure that only truly recoverable states are considered, with recovery policies invoked upon dangerous contingencies.
- **Reinforcement Learning (RL)**: HJ filters act as safety shields in RL, overriding agent actions that would violate the safe set as predicted by the reachability critic. Both "shielded exploration" and safe online adaptation are supported [2407.09645][2601.21297].

## 6. Algorithmic Implementation and Scalability

Key implementation steps for HJ reachability filters include:
1. Collection (or simulation) of observation-action trajectories, with safe and unsafe labels for constraint learning,
2. Solving the HJ PDE via grid-based DP, neural PDE solver, trajectory-optimization, or latent-space Bellman backup, depending on system dimensionality and observability [2005.07875][2011.02082][2502.00935],
3. Runtime evaluation of safety conditions and policy override with efficient lookup (grid or NN), QP/MI-QCQP or learned classifier composition,
4. For latent-space filters, embedding constraints and world dynamics enable operation directly from raw observations [2502.00935].

Scalability strategies include decomposition, local patching, neural architectures attuned to PDE structure (sinusoidal, multiplicative), and layered verification pipelines. Latent and NN-based methods have demonstrated tractable real-time performance on systems with dimension $n=10$–$12$ [2011.02082][2506.23346].

## 7. Empirical Validation and Performance

Table: Example Empirical Performance of HJ Reachability Filters

| System/Scenario                      | Baseline Violation | HJ Filter Violation | Safety Success |
|--------------------------------------|--------------------|---------------------|---------------|
| Vision-based Dubins Car [2502.00935] | 4%                 | 2%                  | 96–97.6%      |
| Block Manipulation (vision)          | 36%                | 20%                 | 80%           |
| Franka Skittles Bag (hardware)       | 73.4%              | 26.4%               | >95% (spill<5%)|
| Rocket Landing (SLR filter) [2312.15347] | –              | 0%                  | 100%          |

In all cases, HJ-based safety filtering reduces failure rates relative to unfiltered or CBF-only baselines, and closes the gap between robust theoretical safety and practical, tractable deployment.

## 8. Key Limitations and Research Directions

Notwithstanding their rigor, HJ reachability filters face challenges:
- State-space grid-based solvers are limited to low-dimensional ($n\lesssim6$) systems without decomposition or neural parameterization [2511.15238][2011.02082].
- Guaranteeing invariance for neural-approximate value functions, especially under nonconvex dynamics or partial observability, requires additional local verification, as in HJ-Patch or formal verification with MIQCQP [2304.09850][2506.15693].
- Real-time, high-fidelity deployment on complex hardware is practical with NN-based surrogates or latent-space models, but their approximation-induced conservatism must be explicitly quantified.
- Integration with RL, MPC, and planning algorithms is an active area, particularly for systems operating in uncertain, dynamic, or unstructured environments [2407.09645][2603.17022].

Recent advances in model-free, verifiable safety Q-filters, hybrid patching algorithms, and latent-space generalizations continue to expand the application and formal robustness of HJ reachability filters in safety-critical autonomous control [2502.00935][2506.15693][2601.21297].

Source: https://www.emergentmind.com/topics/hamilton-jacobi-hj-reachability-filters