Vanishing Discount Method in HJ Systems
- The vanishing discount method is a rigorous framework for studying the asymptotic behavior of discounted Hamilton–Jacobi equations using viscosity solution theory and convex duality.
- It leverages generalized Mather and Green–Poisson measures to represent solutions and ensure convergence under coercivity, convexity, and quasi-monotonicity conditions.
- The method underpins selection principles in ergodic theory and optimal control, guiding the uniqueness and stability of limiting viscosity solutions in nonlinear and weakly-coupled systems.
The vanishing discount method is a rigorous analytical framework for studying the asymptotic behavior of solutions to discounted Hamilton–Jacobi equations and systems as the discount parameter tends to zero. This method is central to modern ergodic theory, weak KAM analysis, viscosity solution theory, optimal control, and Mather theory, particularly in describing the limiting selection mechanisms for nonlinear equations, monotone systems, and degenerate boundary-value problems (Ishii et al., 2019, Ishii et al., 2019, Wang et al., 22 Sep 2025, Ishii et al., 2016, Terai, 2020, Ishii et al., 2016).
1. Formal Statement of the Vanishing Discount Problem
Given a compact manifold or domain and a finite index set , the vanishing discount problem for nonlinear, monotone weakly-coupled systems takes the following general form: For each , seek a vector-valued function that solves, in the viscosity sense,
where is continuous and satisfies:
- Coercivity in the gradient: for each ;
- Joint convexity in : is convex for each ;
- Quasi-monotonicity: for with , for all ;
- Existence of limit (ergodic) solution: The system with admits a continuous solution (Ishii et al., 2019).
This formalism applies to scalar equations, actively coupled nonlinear systems, and can be extended to infinite-dimensional settings and noncompact domains (Terai, 2020, Ishii et al., 2019).
2. Convex Duality, Mather Measures, and Green–Poisson Measures
A cornerstone of the vanishing discount method is the representation of solutions via convex duality, utilizing generalized Mather measures for (possibly nonlinear, weakly coupled) systems. For each , the associated Lagrangian is defined by Legendre duality: The set of Mather measures is constructed as families of nonnegative Borel measures on , satisfying normalization and "closedness" constraints: for all test functions (Ishii et al., 2019).
For each , Green–Poisson measures encode constraints connecting -discounted solutions to the test point: The value admits the dual variational representation: The minimum is attained for a Green–Poisson measure, linking analytic and measure-theoretic perspectives.
3. Convergence and Selection Principle
Under the structural hypotheses (coercivity, convexity, monotonicity), the family is equi-Lipschitz and uniformly bounded. As ,
where is the unique viscosity solution to the ergodic system ,
The limiting solution is selected by the Mather measures: for any weak-* limit of the Green–Poisson measures ,
Uniqueness in is enforced by a comparison argument exploiting monotonicity and the duality structure (Ishii et al., 2019, Ishii et al., 2016).
4. Analytical Framework and Proof Strategies
The proofs are built on:
- Duality and convex analysis: Solutions of the discounted problem admit dual representations as minimizing measures over suitable cones defined by subsolution constraints.
- Tightness and compactness: Coercivity ensures measures are supported on a fixed compact set. Weak-* compactness allows passage to limiting Mather measures as .
- Selection principles: Comparison of sub- and supersolutions via dual inequalities forces uniqueness of accumulation points and thus uniform convergence for the full family.
- Holonomy and closedness: The constraints on measures generalize classical holonomy conditions from Aubry–Mather theory, ensuring dynamical invariance and the correct selection of limiting solutions (Ishii et al., 2019, Ishii et al., 2016).
5. Illustrative Examples and Special Cases
- Linear coupling: For , monotonicity reduces to specific matrix conditions (row sums, off-diagonal nonpositivity). The measure-theoretic method recovers classical linear system convergence results.
- Nonlinear monotone coupling: The formalism encompasses with convex and monotone. The same convex–duality approach yields convergence (Ishii et al., 2019).
- Necessity of convexity: Convexity in is crucial; counterexamples in the scalar, nonconvex case demonstrate failure of convergence (Ishii, 2022).
- Infinite systems: The method extends to infinite-dimensional systems with compact index sets and integral couplings, provided coercivity and monotonicity are maintained (Terai, 2020).
- Control-theoretic and weak KAM link: Discounted HJB equations on describe optimal switching Markov-ODE systems; Mather and Green–Poisson measures generalize minimizing actions to the coupled system (Ishii et al., 2019).
6. Extensions and Limitations
While the vanishing discount method enforces convergence and selection under coercivity, convexity, monotonicity, and solvability, the framework's limitations are sharply illustrated by counterexamples:
- Systems with insufficient coupling structure: Even with convex Hamiltonians and monotone couplings, full convergence may fail for weakly-coupled systems not satisfying strong irreducibility or diagonal dominance (Ishii, 2022).
- Nonconvexities and degenerate cases: Failure of convexity in either or may obstruct selection and yield non-uniqueness or oscillatory accumulation points, emphasizing the importance of the duality and measure-theoretic criteria.
7. Summary Table: Key Elements in the Vanishing Discount Method
| Component | Description | Reference |
|---|---|---|
| Discounted system | on , monotone nonlinear | (Ishii et al., 2019) |
| Mather measures | Minimizing Borel measures, generalize classical Mather sets | (Ishii et al., 2019, Ishii et al., 2016) |
| Green–Poisson measures | Discounted analogues, dual representations for | (Ishii et al., 2019) |
| Convergence theorem | Equi-Lipschitz, uniform boundedness, selection via measures | (Ishii et al., 2019, Ishii et al., 2016) |
| Selection principle | Limiting maximal subsolution respecting Mather measures | (Ishii et al., 2019) |
The vanishing discount method thus provides a comprehensive framework for the selection and convergence of solutions of discounted Hamilton–Jacobi systems, grounded in convex duality, measure representations, and monotonicity analysis. It is the preferred tool for rigorously extracting ergodic limits in both scalar and system settings under well-defined structural hypotheses.