---
title: Hamilton–Jacobi Equations with Constraint
url: https://www.emergentmind.com/topics/hamilton-jacobi-equations-with-constraint
type: topic
---

# Hamilton–Jacobi Equations with Constraint

Hamilton–Jacobi equations with constraint comprise several mathematically distinct but structurally related formulations in which the Hamilton–Jacobi evolution is coupled to an additional restriction on admissible gradients, states, controls, maxima, or phase-space variables. In current literature, the expression covers state-constraint problems posed on \(\overline{\Omega}\), lower-bound gradient constraints such as \(\min(-\Delta u-r,\lvert Du\rvert-1)=0\), normalization constraints of the form \(\sup_x u(\cdot,t)=0\), Hamilton–Jacobi–Bellman equations with control or entry-cost constraints, and covariant or multi-time Hamilton–Jacobi systems generated by primary and secondary constraints of singular Lagrangians [2303.17058, 2010.13622, 1804.04315, 1903.08400, 2306.12605].

## 1. Principal meanings of “constraint”

The modern literature does not use a single canonical notion of constraint. Instead, the term denotes several mechanisms by which the Hamilton–Jacobi dynamics is restricted: boundary viability, gradient bounds, global normalization, admissible controls, or algebraic relations among polymomenta and gauge variables. Taken together, these works use “constraint” in several non-equivalent senses.

| Constraint type | Representative equation | Representative source |
|---|---|---|
| State constraint | \(H(x,Du_\lambda,\lambda u_\lambda)\le C_\lambda\) in \(\Omega_\lambda\), \(H(x,Du_\lambda,\lambda u_\lambda)\ge C_\lambda\) on \(\overline{\Omega}_\lambda\) | [2303.17058] |
| Gradient constraint | \(\min(-\Delta u-r,\lvert Du\rvert-1)=0\) | [2010.13622] |
| Global normalization | \(u_t=H(Du)+R(x,I(t))\), \(\sup_{\mathbb{R}^n}u(\cdot,t)=0\) | [1804.04315] |
| Control constraint | \(0=\min_{u\in U}\{\ell(x)+\nabla V(x)^T[f(x)+g(x)u]+u^TRu\}\) | [2004.03558] |
| Singular-system HJ constraint | \(H'_I=P_I+H_I=0\) | [2306.12605] |

A second distinction concerns whether the constraint is part of the PDE itself or part of the dynamical interpretation. In state-constraint and gradient-constraint problems, the constraint is encoded directly in the viscosity inequalities. In normalization-constrained equations, an unknown scalar function \(I(t)\) acts as a Lagrange multiplier chosen so that the spatial maximum remains fixed. In constrained mechanical and field-theoretic HJ formalisms, the Hamilton–Jacobi equations arise from singular Lagrangians and their integrability conditions rather than from a boundary-value problem in physical space [1804.04315, 2306.12605].

## 2. State constraints, boundary viability, and state-constrained selection

In first-order PDE theory, a state constraint is typically encoded by requiring the subsolution inequality in the interior and the supersolution inequality on the closure. For the model \(u+H(x,Du)=0\) with \(H(x,\beta)=\lvert \beta\rvert^p-f(x)\), \(p\in(1,2]\), the constrained problem is
\[
\begin{cases}
u + H(x,Du) \le 0 & \text{in }\Omega,\\
u + H(x,Du) \ge 0 & \text{on }\overline{\Omega},
\end{cases}
\]
with \(\Omega\) open, bounded, and connected, and with the boundary condition understood in the Soner-type viscosity sense [2205.01615]. The same closure-based formulation appears in nonlinear contact-type families
\[
\begin{cases}
H(x,Du_\lambda(x),\lambda u_\lambda(x)) \le C_\lambda, & x\in \Omega_\lambda,\\
H(x,Du_\lambda(x),\lambda u_\lambda(x)) \ge C_\lambda, & x\in \overline{\Omega}_\lambda,
\end{cases}
\]
where \(\Omega_\lambda=(1+r(\lambda))\Omega\) and \(C_\lambda\to c(H)\) [2303.17058].

The analytic consequences are substantial. Under \((\mathcal{C}_0)\), \((\mathcal{C}_1)\), \((\mathcal{C}_3)\), and \((\mathcal{C}_4)\), a comparison principle holds for the critical state-constraint problem, and Perron’s method yields existence [2303.17058]. For \(H(x,\beta)=\lvert \beta\rvert^p-f(x)\), local semiconcavity depends on the first time a minimizing curve hits the boundary; under the conditions
\[
f(x)\equiv \min_{\overline{\Omega}} f \text{ on }\partial\Omega,\qquad
f(x)>\min_{\overline{\Omega}} f \text{ in }\Omega,\qquad
\lvert Df(x)\rvert \le C\big(f(x)-\min_{\overline{\Omega}} f\big)^{1/p},
\]
every minimizing curve has infinite hitting time, and the constrained viscosity solution is globally semiconcave [2205.01615].

The asymptotic selection problem for state-constrained equations introduces an additional ergodic layer. When \(H\) is continuous, convex and coercive in \(p\), monotone in \(u\), and the domains \(\Omega_\lambda\) are star-shaped perturbations of \(\Omega\), the solutions \(u_\lambda\) converge locally uniformly to a selected critical solution \(u_0^{\eta,\zeta}\), characterized as the maximal element of a set \(\mathcal{E}^{\eta,\zeta}\) defined through Mather measures and the linearizations \(\partial_uL(x,v,0)\) and \(\partial_xL(x,v,0)\) [2303.17058]. This places state constraints in direct contact with weak KAM theory, ergodic constants, and vanishing-discount selection.

## 3. Global maximum constraints and unknown Lagrange multipliers

A different use of “constraint” appears in time-dependent equations where an unknown function of time is chosen to keep the spatial maximum equal to zero. The basic model is
\[
\begin{cases}
u_t(x,t)=H(Du(x,t))+R(x,I(t)) & \text{in }\mathbb{R}^n\times(0,\infty),\\
\sup_{x\in\mathbb{R}^n}u(x,t)=0 & \text{for all }t\ge 0,\\
u(x,0)=u_0(x),\quad I(0)=0,
\end{cases}
\]
with \(I(t)\) acting as a Lagrange multiplier [1804.04315]. Under the assumptions \(\partial_I R(x,I)\le -K_2<0\), \(\sup_{|I|\le 2I_M}\|R(\cdot,I)\|_{W^{1,\infty}}<\infty\), \(u_0\in W^{1,\infty}\), and \(H\in C(\mathbb{R}^n;[0,\infty))\) locally Lipschitz with \(H(0)=0\), existence is obtained by solving a relaxed fixed-point problem for \(\varepsilon I^\varepsilon(t)=\sup_x u^\varepsilon(x,t)\) and passing to the limit [1804.04315].

Uniqueness is subtler. The same paper proves uniqueness only under additional structural forms such as
\[
R(x,I)=b(x)-d(x)Q(I)\quad\text{with }Q(I)>0\text{ increasing},
\]
or
\[
R(x,I)=b(x)Q(I)-d(x)\quad\text{with }Q(I)>0\text{ decreasing},
\]
with \(b,d\in W^{1,\infty}\) and \(b\ge b_m>0\) [1804.04315]. It also provides an example with infinitely many solutions when the reaction term is not strictly decreasing in \(I\). This is a recurrent misconception in the area: the maximum constraint alone does not guarantee uniqueness.

In one space dimension, the constrained equation
\[
\begin{cases}
u_t=|u_x|^2+R(x,I(t)) & \text{in }\mathbb{R}\times(0,\infty),\\
\max_{\mathbb{R}}u(\cdot,t)=0 & \text{on }[0,\infty),\\
u(x,0)=u_0(x),
\end{cases}
\]
admits uniqueness of the pair \((u,I)\) for a class of nonseparable \(R\) under assumptions including strict decrease of \(R\) in \(I\), monotonicity of \(b\) on \([0,\infty)\), and strictly increasing \(I(t)\) [1807.03432]. The proof uses the dynamic programming principle, semiconvexity of \(u(\cdot,t)\), and the identity \(R(x^*(t),I(t))=0\) at maximizers.

Under stronger concavity assumptions, the regulator problem becomes an ODE–PDE system. For
\[
u_t(t,x)=|\nabla_xu(t,x)|^2+R(x,I(t)),\qquad \max_x u(t,x)=0,
\]
with \(R\) and \(u_0\) uniformly strictly concave in \(x\), the solution is not merely viscosity but classical,
\[
u\in L^\infty(\mathbb{R}_+;W^{3,\infty}(\mathbb{R}^d))\cap W^{1,\infty}(\mathbb{R}_+;L^\infty(\mathbb{R}^d)),
\]
and the maximizer \(x(t)\) satisfies
\[
R(x(t),I(t))=0,\qquad
\dot x(t)=-[D_x^2u(t,x(t))]^{-1}\nabla_xR(x(t),I(t)) [1505.05994].
\]
This classical reduction is the basis of the constructive fixed-point scheme in that paper.

## 4. Lower-bound gradient constraints and non-convex free boundaries

A distinct branch of the theory studies Hamilton–Jacobi equations with gradient constraints that impose a lower bound on \(\lvert Du\rvert\). The model problem is
\[
\begin{cases}
\min(-\Delta u-1,\lvert Du\rvert-1)=0 & \text{in }\Omega,\\
u=0 & \text{on }\partial\Omega,
\end{cases}
\]
and more generally
\[
\min(-\Delta u-r,\lvert Du\rvert-1)=0\quad\text{in }\Omega,\qquad r\ge 0,
\]
with \(\Omega\subset\mathbb{R}^n\) open and \(\mathbb{R}^n\setminus\Omega\) of positive Lebesgue measure [2010.13622]. The operator
\[
F(X,p)=\min(-\operatorname{tr}(X)-r,\lvert p\rvert-1)
\]
is non-convex in \(p\), in contrast with classical convex gradient-constraint models of the form \(\max\{Lu-f,\lvert Du\rvert-g\}=0\).

The equation naturally separates into two regimes. On \(\{\lvert Du\rvert>1\}\), the “Brownian region,” one has \(-\Delta u=1\). On \(\{\lvert Du\rvert=1\}\), the “eikonal region,” the constraint is active and \(-\Delta u-1\ge 0\) [2010.13622]. This induces a free boundary between the Poisson phase and the eikonal phase. The paper develops comparison by doubling variables, constructs strict supersolutions via
\[
w=(1+\varepsilon)v+\delta(R^2-\lvert x\rvert^2),\qquad \delta=\varepsilon/(4R),
\]
and obtains existence and uniqueness on bounded domains with an exterior cone condition by Perron’s method.

The central regularity result is optimal local Lipschitz continuity:
\[
u\in C^{0,1}_{\mathrm{loc}}(\Omega),\qquad
\|Du\|_{L^\infty(\Omega')}\le C(\|u\|_{L^\infty(\Omega)}+1),
\]
together with continuity of the gradient norm,
\[
|Du|\in C(\Omega),
\]
for every viscosity solution of \(\min(-\Delta u-r,\lvert Du\rvert-1)=0\) [2010.13622]. The proof uses smooth approximations
\[
-\varepsilon\Delta u=\max(\varepsilon r,1-\lvert Du\rvert),
\]
Bernstein-type gradient bounds, an improvement-of-flatness versus diminish-of-oscillation scheme, and Savin’s flatness theory for degenerate elliptic equations.

The regularity threshold is sharp in the sense stated by the authors: Lipschitz is optimal, and higher regularity such as \(C^{1,1}\) is not expected in this lower-bound, non-convex setting [2010.13622]. Even though directional derivatives may jump, \(|Du|\) remains continuous. The model is connected to optimal dividends for multiple insurance companies and to singular stochastic control in reversible investment, where lower-bound gradient constraints arise from admissible dividend or intervention policies.

## 5. Control, games, junctions, and perforated geometries

In control theory, constraints often enter through the admissible control set. For deterministic and stochastic infinite-horizon HJB equations with \(u(t)\

Source: https://www.emergentmind.com/topics/hamilton-jacobi-equations-with-constraint