Markov Additive Processes
- MAPs are bivariate strong Markov processes combining a Lévy process whose characteristics depend on a modulating Markov chain.
- They generalize classical Lévy processes with phase-dependent dynamics and matrix exponential formulations used in fluctuation theory.
- Their structure underpins practical applications in finance, risk, and queueing, enabling analysis of first passage and exit problems.
A Markov Additive Process (MAP) is a bivariate strong Markov process , where is a continuous-time Markov chain on a finite or more general Polish state space, and evolves (possibly with killing) as a Lévy process whose local characteristics and jump kernel are modulated by the current state of (Döring et al., 2023, Behme et al., 2020, Kyprianou et al., 16 May 2025). The joint law is specified by phase-dependent Lévy dynamics and jump distributions triggered by transitions of , admitting a matrix exponent formulation that generalizes the Lévy-Khintchine structure to the Markov-modulated setting. MAPs extend classical Lévy processes and appear naturally in queueing theory, risk, finance, fragmentation, branching, and self-similar processes.
1. Definition and Structural Components
A MAP with phases is specified by the process , , such that conditional on , the future is distributed as a shifted copy starting from , i.e., the increments of 0 depend only on the current phase. Specifically:
- 1 is a (possibly killed) irreducible Markov chain with generator 2 and killing rates 3.
- In phase 4, 5 evolves as a Lévy process with exponent 6.
- At jumps 7 of 8, 9 increments by a random variable with distribution 0.
The matrix exponent 1 is given by (Döring et al., 2023): 2 where 3, and 4 is entrywise multiplication. Matrix exponential semigroups satisfy: 5 Such constructions apply to both finite- and infinite-dimensional background processes (e.g., Lévy or diffusive modulators) (Kyprianou et al., 16 May 2025, Yaran et al., 8 Dec 2025).
2. Fluctuation Theory and Wiener–Hopf Factorization
MAPs admit a matrix-valued generalization of the Wiener–Hopf factorization. Introducing the ascending and descending ladder MAPs 6, 7 with matrix Laplace exponents 8, 9 (subordinators recording epochs and heights of new maxima and minima), the key factorization is (Döring et al., 2023): 0 where 1 is the invariant law of 2 and 3 is the diagonal matrix with 4. This identity is the matrix analogue of classical Wiener–Hopf for scalar exponents, and underlies fluctuation results for exit and reflection problems (Ivanovs, 2015, D'Auria et al., 2010, Czarna et al., 2018).
The ladder MAPs are constructed by patching together phasewise ladder times and heights, with appropriate inclusion of overshoot corrections for irregular phases.
3. Inverse Problem and Vigon’s Friendship Theory
The “friendship theory” addresses for which pairs of MAP subordinators (i.e., ascending and descending ladders) there exists a MAP bonding them, yielding a complete solution to the inverse problem analogous to Vigon's "équation amicale" for Lévy processes (Döring et al., 2023):
- The measure 5 of the bonding MAP is given as a matrix convolution of the friend processes' Lévy measures:
6
- Compatibility (“7–friendship") and a matrix-monotonicity condition guarantee existence; uniqueness (up to phase rescaling) is shown under killed or certain analytic growth conditions.
This results in a complete characterization of which prescribed ascending/descending ladders correspond to a genuine MAP, and the construction of MAPs with desired fluctuation behavior.
4. Fluctuation Identities and Applications
MAPs support a rich fluctuation theory generalizing that of Lévy processes, including:
- First passage, reflection, and exit identities formulated in terms of scale matrices and Jordan chain techniques for analytic matrix functions (D'Auria et al., 2010, Ivanovs, 2015, Czarna et al., 2018).
- Path decomposition (“splitting”) at extrema, first crossing and last exit, with explicit independence properties conditional on the modulator at the splitting time (Ivanovs, 2015).
- Stability, ergodicity, and mixing rates of functionals such as overshoots and potential measures, with explicit criteria in terms of the ladder MAP data and the parent MAP’s jump and modulator characteristics (Döring et al., 2021).
- Computation and operational formulas structured via the fundamental matrices (G, H, R) and scale objects (Ivanovs et al., 2024).
Practical applications include:
- Insurance risk modeling with default, dividend, or bankruptcy mechanisms (e.g., via 8-scale matrices for level- and state-dependent killing) (Czarna et al., 2018).
- Queueing, risk, and storage models, including Markov-modulated fluid/queueing systems and Markov-modulated generalized Ornstein–Uhlenbeck dynamics (Behme et al., 2020, Ivanovs et al., 2024).
- Option pricing with regime-switching or Lévy-regime asset models (Woodford et al., 2019).
5. Generalizations, Self-Similarity, and Scaling Limits
MAPs naturally arise as the additive component in Lamperti–Kiu representations of multidimensional or multi-type self-similar Markov processes (ssMp) (Haas et al., 2016, Kyprianou et al., 27 Jun 2025, Yaran et al., 2024):
- There is a bijection between ssMps on Banach spaces (with arbitrary norm) and MAPs on 9, where S is the sphere in the chosen norm (Kyprianou et al., 27 Jun 2025).
- Many real and multidimensional self-similar processes (e.g., stable laws, Bessel, Dunkl, or reflecting Brownian motion in the orthant) correspond to explicit MAPs with well-defined modulator and additive component.
- Scaling limits of Markov chains with rare large jumps and modulated types converge to (possibly killed or absorbed) MAPs, and fragmentation or branching trees can be encoded via their associated MAP functionals (Haas et al., 2016, Stephenson, 2017, Liang et al., 24 Dec 2025).
6. Quantitative Limit Laws and Martingale Structure
Limit theorems for MAPs extend classical additive functional results to the Markov modulated setting (Kyprianou et al., 16 May 2025):
- Under positive recurrence, the additive component 0 satisfies a strong law of large numbers (SLLN): 1.
- Fluctuations converge to time-changed Brownian motion depending on the modulator's recurrence type and the structure of the additive part.
- The martingale structure of MAPs supports chaotic and predictable representations, orthogonal decomposition of 2-functionals, and stochastic integral expansions (notably, via Teugels martingales and Gram–Schmidt orthogonalization), facilitating analysis and replication in mathematical finance and filtering (Palmowski et al., 2016, Yaran et al., 8 Dec 2025).
7. Computation, Structure, and Further Applications
Explicit computation of fluctuation identities or exit distributions involves advanced matrix-analytic and spectral techniques:
- Matrix equations for first passage, scale matrices, and potentials are often solved via cyclic/logarithmic reduction or spectral factorization (Ivanovs et al., 2024).
- Many identities in risk/queueing (e.g., ruin probabilities, expected discounted dividends) are formulated in terms of the solution to Volterra-type matrix integral equations or explicit factorization of matrix exponents (Czarna et al., 2018).
- Travelling wave solutions and spine decompositions for multitype branching processes with MAP motion underpin modern developments in branching models with spatial or environmental structure (Liang et al., 24 Dec 2025).
MAPs thus unify and extend classical stochastic process theory, providing matrix-valued fluctuation identities, intricate connections to self-similarity, and versatile tools for modeling, analysis, and computation in a wide range of applied probability contexts.
References:
- (Döring et al., 2023) Markov additive friendships
- (Ivanovs, 2015) Splitting and time reversal for Markov additive processes
- (Ivanovs et al., 2024) One-sided Markov additive processes with lattice and non-lattice increments
- (Behme et al., 2020) Markov-modulated generalized Ornstein-Uhlenbeck processes and an application in risk theory
- (D'Auria et al., 2010) First passage process of a Markov additive process, with applications to reflection problems
- (Stephenson, 2017) On the exponential functional of Markov Additive Processes, and applications to multi-type self-similar fragmentation processes and trees
- (Kyprianou et al., 16 May 2025) The strong law of large numbers and a functional central limit theorem for general Markov additive processes
- (Yaran et al., 2024) Long Time Behavior of General Markov Additive Processes
- (Yaran et al., 8 Dec 2025) Chaotic and Predictable Representations for Markov Additive Processes with Levy Modulator
- (Döring et al., 2021) Stability of overshoots of Markov additive processes
- (Liang et al., 24 Dec 2025) From multitype branching Brownian motions to branching Markov additive processes
- (Haas et al., 2016) Bivariate Markov chains converging to Lamperti transform Markov Additive Processes
- (Kyprianou et al., 27 Jun 2025) Norm-dependent Lamperti-type MAP representations of stable processes and Brownian motions in the orthant
- (Czarna et al., 2018) Fluctuation identities for omega-killed Markov additive processes and dividend problem
- (Palmowski et al., 2016) A note on chaotic and predictable representations for Itô-Markov additive processes
- (Woodford et al., 2019) A comparison of European and Asian options under Markov additive processes