Papers
Topics
Authors
Recent
2000 character limit reached

Time-Homogeneous Markov Semigroups

Updated 1 December 2025
  • Time-homogeneous Markov semigroups are families of operators with constant transition laws that model probability evolution in time-invariant systems.
  • They use infinitesimal generators and the semigroup property to establish well-defined dynamics in both finite and infinite-dimensional spaces.
  • Their stability and ergodicity are demonstrated via contraction properties and Lyapunov conditions, underpinning applications from diffusion to quantum channels.

A time-homogeneous Markov semigroup is a family of operators describing the evolution of probability distributions or functionals under a stochastic process whose transition laws do not depend on time. These semigroups arise in probability theory, mathematical physics, analysis of partial differential equations, and quantum information theory, underpinning the evolution of Markov processes in discrete or continuous spaces, and finite or infinite-dimensional settings. Central objects of the theory include the semigroup property, infinitesimal generators, spectral and contraction properties, embedding criteria for Markov matrices, and ergodic and stability characteristics.

1. Formal Definition and Semigroup Structure

A time-homogeneous Markov semigroup (Pt)t0(P_t)_{t\ge0} is a family of operators acting on a function space or state space, satisfying:

  • P0=IdP_0 = \mathrm{Id},
  • Ps+t=PsPtP_{s+t} = P_s P_t for all s,t0s,t\ge0 (Chapman–Kolmogorov property),
  • PtP_t is positivity preserving: Ptf0P_t f\ge0 if f0f\ge0,
  • Pt1=1P_t1=1 (preservation of constants, Markov property),
  • strong continuity: in suitable topology, tPtft\mapsto P_t f is continuous for all ff in the domain.

When acting on LpL^p-spaces (or CbC_b spaces), the semigroup may be expressed by

Ptf(x)=Ex[f(Xt)],P_t f(x) = \mathbb{E}_x[f(X_t)],

where X=(Xt)t0X=(X_t)_{t\ge0} is a Markov process with generator LL. The Markov property implies invariance under time translations, i.e., the future evolution depends only on the present state and not on the history or absolute time.

Semigroups may arise as integral operators defined via a kernel pt(x,dy)p_t(x,dy): Ptf(x)=Ef(y)pt(x,dy).P_t f(x) = \int_E f(y)\,p_t(x,dy).

On abstract ordered Banach spaces ("abstract state spaces"), an operator semigroup T=(Tt)t0T=(T_t)_{t\ge0} is time-homogeneous Markov if T0=IT_0=I, Tt+s=TtTsT_{t+s}=T_tT_s, TtT_t is positive and TtT_t maps the state "base" K={xX+:f(x)=1}K = \{x\in X_+ : f(x) = 1\} to itself (Erkurşun-Özcan et al., 2018).

2. Generators and Infinitesimal Description

Every (strongly continuous) Markov semigroup is associated with an infinitesimal generator (L,D(L))(L,D(L)): Lf=limt0+Ptfft,fD(L).L f = \lim_{t\to0^+}\frac{P_t f - f}{t}, \quad f \in D(L). Generation theorems (e.g., Hille–Yosida, Lumer–Phillips) provide analytic criteria ensuring that a (possibly unbounded) linear operator LL generates a strongly continuous contraction semigroup on a Banach or Hilbert space (Andrisani et al., 2011). Dissipativity and surjectivity conditions guarantee existence and uniqueness of the semigroup. The generator encodes the infinitesimal dynamics: for diffusions, LL often has the form L=ΔVL = \Delta - \nabla V\cdot\nabla, with Pt=etLP_t=e^{tL}, or more generally as a (pseudo-)differential or integral operator, such as for Lévy processes: [L0f](x)=12Af(x)+y0[f(x+y)f(x)yf(x)1y1](dy).[L_0f](x) = \frac12 \nabla\cdot A\nabla f(x) + \int_{y\neq0}\left[f(x+y) - f(x) - y\cdot\nabla f(x)\mathbf{1}_{|y|\le1}\right]\ell(dy).

For infinite-dimensional systems, LL acts on an appropriate function space equipped with a locally convex topology, such as the strict topology or mixed topology on Cb(E)C_b(E). In the case of Gauss–Markov processes on separable Hilbert spaces, LL is an explicitly constructed second-order differential operator with domains and core functions reflecting the geometry of HH (Goldys et al., 2013).

3. Structural Properties: Reversibility, Embeddability, and Hypercontractivity

Reversibility and Markov Matrices

A finite Markov matrix MM is reversible if there exists p>0p>0 such that piMij=pjMjip_i M_{ij} = p_j M_{ji} for all i,ji,j (Baake et al., 27 Nov 2025). Embeddability into a continuous-time semigroup M=eQM = e^Q is characterized by:

  • σ(M)R+\sigma(M) \subset \mathbb{R}_+,
  • the principal matrix logarithm Q=logMQ=\log M has non-negative off-diagonals,
  • QQ preserves detailed balance.

If negative eigenvalues occur with even multiplicity, non-reversible embeddings may exist, but never reversible ones. Reducible or weakly reversible cases are treated blockwise or with relaxed equilibrium constraints.

Hypercontractivity and Functional Inequalities

Time-homogeneous Markov semigroups on L2(μ)L^2(\mu) may exhibit hypercontractivity, with the semigroup improving regularity of distributions: PtfLΦu(t)fLΦ0\|P_t f\|_{L^{\Phi_{u(t)}}} \le \|f\|_{L^{\Phi_0}} for a suitable family of Orlicz functions {Φu}\{\Phi_u\}, equivalent to functional inequalities (e.g., log-Sobolev, F-Sobolev). Time-homogeneity simplifies the analysis, as the generator LL remains fixed and invariant measures are stationary (Roberto et al., 2021).

4. Stability, Contraction, and Ergodicity

Semigroup stability is quantified by contraction properties with respect to various distances—total variation, weighted norms, or Kantorovich/Wasserstein metrics (Moral et al., 11 Nov 2025): Dϕ(Pt(x,),Pt(y,))α(t)ϕ(x,y)D_\phi(P_t(x,\cdot), P_t(y,\cdot)) \le \alpha(t) \phi(x,y) under suitable Lyapunov-drift and minorization (Doeblin) conditions. A drift condition Pt0V(x)aV(x)+b1K(x)P_{t_0}V(x) \le a V(x)+ b 1_K(x), together with local minorization, yields a "V-positive" semigroup with quantitative spectral gap (Moral et al., 2021).

On abstract state spaces, the Dobrushin coefficient δ(T)\delta(T) encodes contraction on the "mass-zero" subspace. Uniform asymptotic stability (exponential mixing to a unique stationary state) is equivalent to δ(Tt0)<1\delta(T_{t_0})<1. Lyapunov-type conditions and perturbation bounds yield robust error and sensitivity estimates for invariant states under small generator perturbations (Erkurşun-Özcan et al., 2018).

5. Topological Foundations and Infinite-Dimensional Extensions

Classical C0C_0-semigroup theory is adapted to non-normed or infinite-dimensional topologies. The mixed topology τ1M\tau_1^{\mathscr{M}} on Cκ(E)C_\kappa(E) interpolates between norm and compact-uniform topologies, enabling (bi)continuous semigroup generation and analysis on Polish or Prohorov spaces (Goldys et al., 2022). The generator (L,D(L))(L,D(L)) can be reconstructed via Euler formulas, and Markov core operators provide a criterion for uniqueness of the Fokker–Planck or martingale problem.

For Gauss–Markov semigroups on Hilbert spaces, the strict topology on Cb(Hbw)C_b(H_{\mathrm{bw}}) (bounded-weak) is necessary to ensure strong continuity and the existence of appropriate cores of the generator (Goldys et al., 2013). The infinitesimal generator acts on cylinder test functions via infinite-dimensional Courrège-type formulas.

6. Special Cases, Limitations, and Non-Markovianity

Time-homogeneous Markov semigroups fail to arise from genuinely path-dependent stochastic equations unless special structure is present. In stochastic Volterra equations (SVEs) with Hölder coefficients, the time-homogeneous Markov property is lost unless the kernel K(t)K(t) is exponentially decaying, i.e., K(t)=ceλtK(t)=c e^{-\lambda t}, corresponding exactly to the case where the SVE reduces to an ordinary SDE (Friesen et al., 25 Oct 2025). For generic Volterra or rough models, only "local" (SDE-type) memoryless evolutions generate a time-homogeneous semigroup.

In infinite-dimensional hypocoercive models, such as kinetic Fokker–Planck structures on (Rm)Zd(\mathbb{R}^m)^{\mathbb{Z}^d} or degenerate diffusions, strong smoothing and ergodic properties can be established via careful commutator and Lyapunov-type arguments within the semigroup framework (Kontis et al., 2013).

7. Applications and Further Directions

Time-homogeneous Markov semigroups provide the evolution mechanism for reversible and irreversible Markov processes, including diffusions, jump processes, quantum channels, and interacting particle systems. Extensions encompass semigroups in quantum probability, nonlinear (convex, order-preserving) semigroups relevant for stochastic control and viscosity solutions to Hamilton–Jacobi–Bellman equations (Goldys et al., 2022), and bilateral Markov semigroups associated to generalized Schrödinger equations via Doob transforms between Markov generators and self-adjoint Hamiltonians (Andrisani et al., 2011).

Contemporary research includes operator-theoretic unifications of stability and contractivity across classical and quantum models, investigation of the embedding problem for Markov matrices of arbitrary spectrum or structure, and analysis of ergodicity, spectral gaps, and mixing in unbounded domains and infinite-dimensional systems. Rigorous non-Markovianity results for path-dependent equations further delimit the scope of time-homogeneous semigroup representations (Friesen et al., 25 Oct 2025).

Slide Deck Streamline Icon: https://streamlinehq.com

Whiteboard

Forward Email Streamline Icon: https://streamlinehq.com

Follow Topic

Get notified by email when new papers are published related to Time-Homogeneous Markov Semigroups.