---
title: Autoregressive LLMP Models
url: https://www.emergentmind.com/topics/autoregressive-llmp-a-llmp
type: topic
---

# Autoregressive LLMP Models

The autoregressive long-term memory process (A-LLMP) encompasses a class of autoregressive time-series models characterized by either (i) a power-law memory kernel generating self-affine, long-memory Gaussian processes, or (ii) stationary non-Gaussian processes with heavy-tailed Mittag–Leffler (ML) marginals or innovations. These frameworks, formulated in [1508.07715] and [2601.06610], generalize classical AR and ARMA/ARFIMA processes by introducing either explicit power-law memory or non-standard, infinitely divisible noise laws. In both cases, the resultant dynamics exhibit anomalous fluctuation regimes, non-trivial moment properties, and non-classical estimation challenges.

## 1. Formal Definitions and Model Classes

Two distinct A-LLMP model classes are established in the literature:

1. **Infinite-order Gaussian A-LLMP with Power-law Memory** [1508.07715]:

   $$
   x_n = \frac{\gamma}{\zeta(\beta)} \sum_{k=1}^\infty \frac{x_{n-k}}{k^{\beta}} + \varepsilon_n,
   $$
   where $\gamma\in(0,1)$, $\zeta(\beta)=\sum_{k=1}^\infty k^{-\beta}$ (Riemann zeta function), $\beta>1$ (memory exponent), and $\varepsilon_n$ i.i.d. Gaussian ($\langle \varepsilon_n^2\rangle=\sigma^2$).

2. **AR(1) Process with Mittag–Leffler Component ("LLMP-AR(1)")** [2601.06610]:
   
   $$
   Y_t = \rho Y_{t-1} + \varepsilon_t, \quad |\rho|<1,
   $$
   with either (A) ML($\alpha,1$) marginals (i.e., $Y_t\sim$ ML($\alpha,1$)), or (B) ML($\alpha,1$) i.i.d. innovations $\varepsilon_t$. The Mittag–Leffler law has Laplace transform
   $$
   \varphi_M(s) = \mathbb{E}[e^{-sM}] = \frac{1}{1 + s^{\alpha}},\quad 0<\alpha \leq 1.
   $$

Both classes are "autoregressive with long memory," but differ fundamentally in the domain (Gaussian vs. heavy-tailed), the mechanism (kernel vs. innovation law), and the analytical methods required for their study.

## 2. Memory Kernels and Fluctuation Scaling

In the infinite-order Gaussian A-LLMP, the power-law kernel $K(k)\sim k^{-\beta}$ directly encodes long memory. The fundamental feature is the scaling of root-mean-square displacement (RMSD)
$$
\Delta(m) = \langle (x_{n+m} - x_n)^2 \rangle^{1/2}
$$
as a function of lag $m$. Using discrete Fourier analysis, the variance increment has the explicit form
$$
\{\Delta(m)\}^2 = \frac{4\sigma^2}{N} \sum_{k=0}^{N/2-1} \frac{1 - \cos(\omega_k m)}{|1 - F(\omega_k)|^2},
$$
where $F(\omega_k)$ contains the power-law memory [1508.07715]. For small lags $m\ll m_\text{sat}$,
$$
\Delta(m) \propto m^H, \quad H < \tfrac{1}{2}
$$
with the Hurst exponent $H$ controlled by $\beta$ (and weakly by $\gamma$). Larger $m$ yield saturation ($\Delta(m)\to\text{const}$) due to stationarity ($\gamma<1$). For $\gamma\to1$, the model approaches a nonstationary fractional scaling regime, analogous to ARFIMA($0,d,0$), though with a distinct kernel construction.

## 3. Mittag–Leffler AR(1) Structure, Marginals, and Innovations

In the LLMP-AR(1) paradigm, two structurally distinct regimes are considered [2601.06610]:

- **A. Marginal ML($\alpha,1$):** The AR(1) is constructed so $Y_t\sim \mathrm{ML}(\alpha,1)$ strictly stationary. The Laplace recursion yields the required innovation law:
  $$
  \varphi_{\varepsilon}(s) = \frac{1+(\rho s)^\alpha}{1+s^\alpha}.
  $$
  The explicit density is obtained as a contour integral.

- **B. Innovation ML($\alpha,1$):** Taking the $\varepsilon_t$ as i.i.d. ML($\alpha,1$), the MA($\infty$) form shows the marginal Laplace transform:
  $$
  \varphi_Y(s) = \prod_{i=0}^\infty \frac{1}{1 + (\rho^i s)^\alpha}.
  $$
  
Both are heavy-tailed, possess only fractional moments up to order $\alpha$, and lack finite variance. Classical second-order autocorrelations are undefined; alternative measures (codifference, fractional covariation) are considered but not explicitly derived in [2601.06610].

## 4. Statistical Estimation by Empirical Laplace Methods

Parameter estimation in LLMP-AR(1) models leverages the empirical Laplace transform:
$$
\varphi_n(s) = \frac{1}{n} \sum_{i=1}^n e^{-sZ_i}
$$
for observed samples $\{Z_i\}$. For the time series $\{Y_t\}$, residuals $\hat{\varepsilon}_t = Y_t - \rho Y_{t-1}$ are computed for candidate $\rho$. The loss
$$
S_n(\theta) = \sum_{j=1}^m w_j [\varphi_n(s_j) - \varphi(s_j;\theta)]^2
$$
is minimized for $\theta = (\alpha,\rho)$. Consistency and asymptotic normality with $\sqrt{n}$-rate hold under standard regularity assumptions. Simulations with $N=500$, $n=1000$ for $(\alpha,\rho)=(0.4,0.4)$ and $(0.6,0.8)$ demonstrate that the root-mean-square error (RMSE) and mean absolute error (MAE) of estimates are $<0.06$ in all parameters, and the method yields concentrated boxplots around the true values [2601.06610].

## 5. Analytical Methods and Hurst/Memory Exponent Relation

For Gaussian A-LLMPs, analytical relationships between fluctuation exponents and kernel parameters are established via Yule–Walker equations. Using the autocovariance ansatz $C(m)=C(0)[1-\beta'm^p]$ with $p=2H$, the first three Yule–Walker equations yield coupled constraints for $\beta'$ and $p$ [1508.07715]. Numerical solution provides $H(\beta)$, showing that arbitrary subdiffusive dynamics ($H<1/2$) can be realized by tuning $\beta>1$. Fast RMSD evaluation leverages Fourier-space sums, while direct time-series simulation enables empirical increment computation.

In the LLMP-AR(1) case, closed-form expressions via Laplace transforms dictate both stationary marginals and required innovation laws. The nonexistence of higher moments and classical autocorrelation necessitates alternative statistical tools for fluctuation and dependence analysis.

## 6. Implications, Applications, and Empirical Evidence

A-LLMPs provide a mathematically controlled approach to generating processes with self-affine, subdiffusive scaling at small lags—encompassing both Gaussian long-memory and heavy-tailed, infinite-variance regimes. By tuning model parameters ($\beta$ or $\alpha$), the scaling of small-m fluctuations can be prescribed throughout the admissible range ($H<1/2$ for Gaussian, heavy tails for ML).

Empirical Laplace-based inference on high-frequency trading inter-arrival data highlights the appropriateness of the ML law in capturing observed heavy tails [2601.06610]. A plausible implication is that such autoregressive mechanisms may underlie observed non-Gaussian scaling in finance and complex systems, where both long-memory and heavy-tailed fluctuations coexist.

These models extend the theoretical toolkit beyond AR, ARMA, and ARFIMA, enabling precise analysis of anomalous time-series fluctuation regimes, both in physically motivated Gaussian contexts and in heavy-tailed, high-frequency empirical domains.

Source: https://www.emergentmind.com/topics/autoregressive-llmp-a-llmp