Papers
Topics
Authors
Recent
Search
2000 character limit reached

Time-Homogeneous Markov Semigroups

Updated 1 December 2025
  • Time-homogeneous Markov semigroups are families of operators with constant transition laws that model probability evolution in time-invariant systems.
  • They use infinitesimal generators and the semigroup property to establish well-defined dynamics in both finite and infinite-dimensional spaces.
  • Their stability and ergodicity are demonstrated via contraction properties and Lyapunov conditions, underpinning applications from diffusion to quantum channels.

A time-homogeneous Markov semigroup is a family of operators describing the evolution of probability distributions or functionals under a stochastic process whose transition laws do not depend on time. These semigroups arise in probability theory, mathematical physics, analysis of partial differential equations, and quantum information theory, underpinning the evolution of Markov processes in discrete or continuous spaces, and finite or infinite-dimensional settings. Central objects of the theory include the semigroup property, infinitesimal generators, spectral and contraction properties, embedding criteria for Markov matrices, and ergodic and stability characteristics.

1. Formal Definition and Semigroup Structure

A time-homogeneous Markov semigroup (Pt)t≥0(P_t)_{t\ge0} is a family of operators acting on a function space or state space, satisfying:

  • P0=IdP_0 = \mathrm{Id},
  • Ps+t=PsPtP_{s+t} = P_s P_t for all s,t≥0s,t\ge0 (Chapman–Kolmogorov property),
  • PtP_t is positivity preserving: Ptf≥0P_t f\ge0 if f≥0f\ge0,
  • Pt1=1P_t1=1 (preservation of constants, Markov property),
  • strong continuity: in suitable topology, t↦Ptft\mapsto P_t f is continuous for all ff in the domain.

When acting on P0=IdP_0 = \mathrm{Id}0-spaces (or P0=IdP_0 = \mathrm{Id}1 spaces), the semigroup may be expressed by

P0=IdP_0 = \mathrm{Id}2

where P0=IdP_0 = \mathrm{Id}3 is a Markov process with generator P0=IdP_0 = \mathrm{Id}4. The Markov property implies invariance under time translations, i.e., the future evolution depends only on the present state and not on the history or absolute time.

Semigroups may arise as integral operators defined via a kernel P0=IdP_0 = \mathrm{Id}5: P0=IdP_0 = \mathrm{Id}6

On abstract ordered Banach spaces ("abstract state spaces"), an operator semigroup P0=IdP_0 = \mathrm{Id}7 is time-homogeneous Markov if P0=IdP_0 = \mathrm{Id}8, P0=IdP_0 = \mathrm{Id}9, Ps+t=PsPtP_{s+t} = P_s P_t0 is positive and Ps+t=PsPtP_{s+t} = P_s P_t1 maps the state "base" Ps+t=PsPtP_{s+t} = P_s P_t2 to itself (Erkurşun-Özcan et al., 2018).

2. Generators and Infinitesimal Description

Every (strongly continuous) Markov semigroup is associated with an infinitesimal generator Ps+t=PsPtP_{s+t} = P_s P_t3: Ps+t=PsPtP_{s+t} = P_s P_t4 Generation theorems (e.g., Hille–Yosida, Lumer–Phillips) provide analytic criteria ensuring that a (possibly unbounded) linear operator Ps+t=PsPtP_{s+t} = P_s P_t5 generates a strongly continuous contraction semigroup on a Banach or Hilbert space (Andrisani et al., 2011). Dissipativity and surjectivity conditions guarantee existence and uniqueness of the semigroup. The generator encodes the infinitesimal dynamics: for diffusions, Ps+t=PsPtP_{s+t} = P_s P_t6 often has the form Ps+t=PsPtP_{s+t} = P_s P_t7, with Ps+t=PsPtP_{s+t} = P_s P_t8, or more generally as a (pseudo-)differential or integral operator, such as for Lévy processes: Ps+t=PsPtP_{s+t} = P_s P_t9

For infinite-dimensional systems, s,t≥0s,t\ge00 acts on an appropriate function space equipped with a locally convex topology, such as the strict topology or mixed topology on s,t≥0s,t\ge01. In the case of Gauss–Markov processes on separable Hilbert spaces, s,t≥0s,t\ge02 is an explicitly constructed second-order differential operator with domains and core functions reflecting the geometry of s,t≥0s,t\ge03 (Goldys et al., 2013).

3. Structural Properties: Reversibility, Embeddability, and Hypercontractivity

Reversibility and Markov Matrices

A finite Markov matrix s,t≥0s,t\ge04 is reversible if there exists s,t≥0s,t\ge05 such that s,t≥0s,t\ge06 for all s,t≥0s,t\ge07 (Baake et al., 27 Nov 2025). Embeddability into a continuous-time semigroup s,t≥0s,t\ge08 is characterized by:

  • s,t≥0s,t\ge09,
  • the principal matrix logarithm PtP_t0 has non-negative off-diagonals,
  • PtP_t1 preserves detailed balance.

If negative eigenvalues occur with even multiplicity, non-reversible embeddings may exist, but never reversible ones. Reducible or weakly reversible cases are treated blockwise or with relaxed equilibrium constraints.

Hypercontractivity and Functional Inequalities

Time-homogeneous Markov semigroups on PtP_t2 may exhibit hypercontractivity, with the semigroup improving regularity of distributions: PtP_t3 for a suitable family of Orlicz functions PtP_t4, equivalent to functional inequalities (e.g., log-Sobolev, F-Sobolev). Time-homogeneity simplifies the analysis, as the generator PtP_t5 remains fixed and invariant measures are stationary (Roberto et al., 2021).

4. Stability, Contraction, and Ergodicity

Semigroup stability is quantified by contraction properties with respect to various distances—total variation, weighted norms, or Kantorovich/Wasserstein metrics (Moral et al., 11 Nov 2025): PtP_t6 under suitable Lyapunov-drift and minorization (Doeblin) conditions. A drift condition PtP_t7, together with local minorization, yields a "V-positive" semigroup with quantitative spectral gap (Moral et al., 2021).

On abstract state spaces, the Dobrushin coefficient PtP_t8 encodes contraction on the "mass-zero" subspace. Uniform asymptotic stability (exponential mixing to a unique stationary state) is equivalent to PtP_t9. Lyapunov-type conditions and perturbation bounds yield robust error and sensitivity estimates for invariant states under small generator perturbations (Erkurşun-Özcan et al., 2018).

5. Topological Foundations and Infinite-Dimensional Extensions

Classical Ptf≥0P_t f\ge00-semigroup theory is adapted to non-normed or infinite-dimensional topologies. The mixed topology Ptf≥0P_t f\ge01 on Ptf≥0P_t f\ge02 interpolates between norm and compact-uniform topologies, enabling (bi)continuous semigroup generation and analysis on Polish or Prohorov spaces (Goldys et al., 2022). The generator Ptf≥0P_t f\ge03 can be reconstructed via Euler formulas, and Markov core operators provide a criterion for uniqueness of the Fokker–Planck or martingale problem.

For Gauss–Markov semigroups on Hilbert spaces, the strict topology on Ptf≥0P_t f\ge04 (bounded-weak) is necessary to ensure strong continuity and the existence of appropriate cores of the generator (Goldys et al., 2013). The infinitesimal generator acts on cylinder test functions via infinite-dimensional Courrège-type formulas.

6. Special Cases, Limitations, and Non-Markovianity

Time-homogeneous Markov semigroups fail to arise from genuinely path-dependent stochastic equations unless special structure is present. In stochastic Volterra equations (SVEs) with Hölder coefficients, the time-homogeneous Markov property is lost unless the kernel Ptf≥0P_t f\ge05 is exponentially decaying, i.e., Ptf≥0P_t f\ge06, corresponding exactly to the case where the SVE reduces to an ordinary SDE (Friesen et al., 25 Oct 2025). For generic Volterra or rough models, only "local" (SDE-type) memoryless evolutions generate a time-homogeneous semigroup.

In infinite-dimensional hypocoercive models, such as kinetic Fokker–Planck structures on Ptf≥0P_t f\ge07 or degenerate diffusions, strong smoothing and ergodic properties can be established via careful commutator and Lyapunov-type arguments within the semigroup framework (Kontis et al., 2013).

7. Applications and Further Directions

Time-homogeneous Markov semigroups provide the evolution mechanism for reversible and irreversible Markov processes, including diffusions, jump processes, quantum channels, and interacting particle systems. Extensions encompass semigroups in quantum probability, nonlinear (convex, order-preserving) semigroups relevant for stochastic control and viscosity solutions to Hamilton–Jacobi–Bellman equations (Goldys et al., 2022), and bilateral Markov semigroups associated to generalized Schrödinger equations via Doob transforms between Markov generators and self-adjoint Hamiltonians (Andrisani et al., 2011).

Contemporary research includes operator-theoretic unifications of stability and contractivity across classical and quantum models, investigation of the embedding problem for Markov matrices of arbitrary spectrum or structure, and analysis of ergodicity, spectral gaps, and mixing in unbounded domains and infinite-dimensional systems. Rigorous non-Markovianity results for path-dependent equations further delimit the scope of time-homogeneous semigroup representations (Friesen et al., 25 Oct 2025).

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Time-Homogeneous Markov Semigroups.