---
title: 'Sublinear Markov Semigroups: Theory & Applications'
url: https://www.emergentmind.com/topics/sublinear-markov-semigroups
type: topic
---

# Sublinear Markov Semigroups: Theory & Applications

A sublinear Markov semigroup is a family of nonlinear transition operators that extend the classical Markov semigroup formalism to the context of coherent risk measures and robust stochastic modeling, providing a nonlinear expectation-theoretic framework for continuous-time uncertain processes. Such semigroups, characterized by sublinearity, monotonicity, constant preservation, and the semigroup property, underpin path-space sublinear expectations and give rise to nonlinear analogs of Kolmogorov and Hille–Yosida theory, with applications in control, finance, and robust stochastic processes.

## 1. Definition and Structural Properties

Let \( X \) be a countable state space. Consider \( L = L(X) \), the Banach space of bounded real-valued functions \( f: X \to \mathbb{R} \) with norm \( \|f\| = \sup_{x \in X} |f(x)| \). A family of operators \( \{T_t\}_{t \ge 0} \subseteq \mathcal{O} \), where \( T_t: L \to L \), is a **sublinear Markov semigroup** if:

1. **Upper-transition operators**: For each \( t \ge 0 \) and \( x \in X \), the map \( f \mapsto (T_t f)(x) \) is a sublinear expectation on \( L \); i.e., for all \( x \), \( T_t \) is isotone, constant-preserving, subadditive, and positively homogeneous.
2. **Semigroup property**: \( T_{t+s} = T_t \circ T_s \) for all \( s, t \ge 0 \), with \( T_0 = I \).
3. **Downward continuity**: For each \( t \), every monotone decreasing net \( f_n \searrow f \) in \( L \) satisfies \( T_t f_n \searrow T_t f \) pointwise on \( X \).
4. **Uniformly bounded rate** (optional, often assumed): 
   \[
   \limsup_{h \downarrow 0} \frac{1}{h} \sup_{x \in X} \left[(T_h 1)(x) - 1\right] < +\infty,
   \]
   which implies uniform continuity \( \lim_{h \downarrow 0} \|T_h - I\|_{\mathrm{op}} = 0 \) [2301.10066].

This structure extends directly to convex cones of functions in general state spaces and can be expressed in terms of upper expectations and transition operators [2311.03138][2406.09955]. On general measurable state spaces, the operators act on bounded measurable or continuous functions, and the axioms generalize accordingly [2205.15200][2204.07484].

## 2. Path-Space Construction and Daniell–Kolmogorov Extension

Given an initial sublinear expectation \( E_0 \) on \( L \) and a sublinear Markov semigroup \( \{T_t\} \), a canonical path-space expectation is constructed on \( \Omega = \{\omega: [0,\infty) \to X\} \):

- Define finite-dimensional upper expectations \( E_U \) for each finite set \( U = \{t_1 < \ldots < t_n\} \subset [0,\infty) \) by backward recursion:
  \[
  E_{\{0\}}(f) = E_0(f), \quad
  E_{U \cup \{t\}}(g) = E_U \left(x \mapsto (T_{t - s_n} g(x, \cdot))(x_{s_n}) \right),
  \]
  where \( s_n = \max U \).
- The family \( \{E_U\}_U \) is consistent, i.e., \( E_V(h \circ \pi_U^V) = E_U(h) \) for \( U \subseteq V \).
- By a robust Daniell–Kolmogorov theorem, \( \{E_U\}_U \) extends uniquely to a sublinear expectation \( \mathcal{E}: M \to \overline{\mathbb{R}} \) on the space \( M \) of all \(\sigma\)-measurable functions on path space bounded above or below, inheriting downward and upward continuity properties from \( T_t \) [2301.10066].

This path-space extension is critical for defining nonlinear laws of processes and for studying time-consistent robust (upper) expectations.

## 3. Generator, Hille–Yosida Theory, and Exponential Formula

The (sublinear) infinitesimal generator \( \mathcal{L} \) of a uniformly continuous sublinear Markov semigroup is given by:
\[
\mathcal{L} f(x) = \lim_{h \downarrow 0} \frac{(T_h f)(x) - f(x)}{h}, \quad \text{with domain} \quad \operatorname{Dom}(\mathcal{L}) = \{ f \in L: \text{limit exists uniformly}\}.
\]
The semigroup admits an exponential representation:
\[
T_t f = \exp(t \mathcal{L}) f = \sum_{n=0}^\infty \frac{t^n}{n!} \mathcal{L}^n f,
\]
with convergence in operator norm, provided \( \mathcal{L} \) is bounded [2406.09955]. The generator satisfies a positive maximum principle and Hille–Yosida-type resolvent bounds \( \|(\lambda - \mathcal{L})^{-1}\| \le 1/\lambda \) for all \( \lambda > 0 \), ensuring that every bounded sublinear generator gives rise to a unique uniformly continuous semigroup and vice versa [2301.10066][2406.09955].

In infinite dimensions or weighted continuous spaces, the generator is defined via the strong derivative at zero in the mixed topology, and the nonlinear Euler–Trotter formula reconstructs \( T_t \) from its generator [2204.07484].

## 4. Representation of the Generator and the Nonlinear HJB Structure

On general domains (including \( \mathbb{R}^d \)), sublinear Markov semigroups' pointwise generators have a sup-representation:
\[
A^{(p)} f(x) = \sup_{\alpha \in I} \left\{ -c_\alpha(x) f(x) + b_\alpha(x) \cdot \nabla f(x) + \frac{1}{2} \operatorname{Tr}[Q_\alpha(x) \nabla^2 f(x)] + \int_{y \neq 0} [f(x+y) - f(x) - \nabla f(x) \cdot y \mathbf{1}_{|y|<1}] \nu_\alpha(x, dy) \right\},
\]
where the supremum is over a family of Lévy triplets \((c_\alpha, b_\alpha, Q_\alpha, \nu_\alpha)\), which encode local uncertainty in drift, diffusion, and jump [1909.08324]. This structure gives rise to nonlinear and nonlocal Hamilton–Jacobi–Bellman (HJB) equations.

For finite or countable spaces, the generator reduces to a bounded sublinear rate operator. For diffusion-type semigroups with set-valued volatility/drift, the generator takes the HJB form:
\[
A f(x) = \sup_{(b, a) \in \Gamma(x)} [b f'(x) + \tfrac{1}{2} a f''(x)]
\]
[2205.15200][2311.03138].

## 5. Nonlinear PDE Connections and Viscosity Solutions

For \( u(t, x) := T_t f(x) \), the function \( u \) solves the fully nonlinear PDE:
\[
\partial_t u(t, x) = \mathcal{L} u(t, \cdot)(x), \quad u(0, x) = f(x),
\]
where \( \mathcal{L} \) is the generator above. The solution is typically interpreted in the viscosity sense, and \( T_t f(x) \) provides the unique (bounded) viscosity solution of the associated nonlinear HJB equation [2204.07484][2205.15200][2311.03138][1909.08324].

Moreover, a nonlinear Dynkin formula bounds finite-difference increments of \( T_t f \) in terms of the generator:
\[
-\int_0^t T_s(-A f)(x) \, ds \leq T_t f(x) - f(x) \leq \int_0^t T_s(A f)(x) \, ds
\]
[1909.08324].

## 6. Nonlinear Markov Families and Stochastic Representations

Each sublinear Markov semigroup induces a family of nonlinear path-space expectations associated with a family of semimartingale laws with uncertain local characteristics:
\[
\mathcal{E}^x[\psi] = \sup_{P \in \mathcal{R}(x)} E^P[\psi],
\]
where \( \mathcal{R}(x) \) is the set of laws for which the local characteristics (drift, volatility, jumps) vary over a prescribed set (model uncertainty) [2311.03138][2205.15200]. These nonlinear Markov families satisfy dynamic programming and nonlinear Markov property, and establish a one-to-one correspondence with the nonlocal HJB generator. Classic examples include G-Brownian motion, sublinear Lévy processes, robust diffusions, and Nisio semigroups [2311.03138][2205.15200].

## 7. Applications and Examples

- **Classical Markov Chains**: If each \( T_t \) is linear, we retrieve the classical Markov semigroup \( T_t = e^{tQ} \).
- **Imprecise CTMCs**: For a bounded collection \( \mathscr{Q} \) of rate matrices, the generator is the upper envelope \( \mathcal{L} f(x) = \sup_{Q \in \mathscr{Q}} (Qf)(x) \).
- **Imprecise Poisson Processes**: With jump rates in an interval \( \Lambda \), the sublinear generator becomes \( \mathcal{L} f(z) = \sup_{\lambda \in \Lambda} \lambda [f(z+1) - f(z)] \).
- **Nonlinear Jump-Diffusions** and **Robust Control**: The value function in stochastic control problems is a nonlinear semigroup with HJB generator, describing worst-case control performance.
- **Ergodicity**: Sublinear Markov semigroups admit an ergodic theory in terms of invariant sublinear expectations, spectral properties, and strong laws of large numbers, paralleling the classical setting but adapted to model uncertainty [1705.03549].
- **Nonlinear Feller Theory**: Sublinear semigroups may exhibit smoothing (Feller) properties and have measure-kernel representations with tightness, extending classical integral kernel theory to the nonlinear case [2205.15200][2204.07484].
- **Measure-Theoretic Representations**: Even in the nonlinear context, \( T_t f(x) = \sup_{\mu \in \mathcal{K}_t(x)} \int f(y) \, d\mu(y) \), where \( \mathcal{K}_t(x) \) is a convex, compact subset of probability measures on \( X \) [2204.07484].

## 8. Outlook and Research Directions

Sublinear Markov semigroups are fundamental in model uncertainty, robust control, finance (risk measures), imprecise probability theory, and dynamic programming. Extensions to non-countable state spaces, infinite-dimensional systems, processes with unbounded generators, and path-dependent functionals are active areas of investigation [2301.10066][2311.03138][2204.07484]. The theory forms the analytic backbone for nonlinear expectations, nonlinear PDEs, and robust stochastic analysis, with tight analogs to linear semigroup theory but new phenomena—especially regarding regularity, uniqueness, and the propagation of nonsmoothness under sublinear transition dynamics.

Source: https://www.emergentmind.com/topics/sublinear-markov-semigroups