---
title: Permutation Entropy in Time Series
url: https://www.emergentmind.com/topics/permutation-entropy
type: topic
---

# Permutation Entropy in Time Series

Permutation entropy (PE) is a complexity measure for time series and multidimensional data based on the probability distribution of ordinal patterns (permutations) extracted from subsequences of the data. Originally introduced by Bandt and Pompe (2002), PE quantifies the diversity and structure of temporal or spatial ordering without reference to amplitude, making it robust, computationally efficient, and broadly applicable to nonlinear, stochastic, and multichannel signals [2102.06786]. Over two decades, PE has spawned a range of methodological advances—including graph and multivariate extensions, weighted generalizations, multiscale analysis, and complexity–entropy planes—that have been widely adopted in data science, neuroscience, physics, and engineering.

## 1. Mathematical Definition and Algorithmic Procedure

Permutation entropy is defined for a real-valued sequence $\{x_t\}_{t=1}^{N}$ by considering the distribution of ordinal patterns formed from embedding vectors:
\[
w_p = (x_p, x_{p+\tau}, \ldots, x_{p+(d-1)\tau}),\quad p = 1, \ldots, N-(d-1)\tau,
\]
where $d \geq 2$ is the embedding dimension (pattern length), and $\tau \geq 1$ is the delay. Each $w_p$ is mapped to a permutation $\pi_p$ of $\{0,1,\ldots,d-1\}$ that describes the ascending rank order of its components (ties are broken by time index). The empirical frequency $p(\Pi_i)$ of each of the $d!$ possible patterns $\Pi_i$ is counted over all windows [2102.06786, 2312.00964].

The (Shannon) permutation entropy is
\[
H_{\mathrm{PE}}(d,\tau) = -\sum_{i=1}^{d!} p(\Pi_i)\ln p(\Pi_i),
\]
with normalized form
\[
h_{\mathrm{PE}}(d,\tau) = \frac{H_{\mathrm{PE}}(d,\tau)}{\ln d!},\qquad 0\leq h_{\mathrm{PE}}\leq1.
\]

Algorithmically, PE is computed by scanning the series with a sliding window (possibly on a windowed data segment), extracting ordinal patterns, tallying frequencies, and calculating the entropy of the resulting distribution. The effective sample size must greatly exceed $d!$ for statistical reliability [2102.06786].

## 2. Parameter Selection: Embedding Dimension and Delay

Proper selection of embedding dimension $d$ and delay $\tau$ is critical. Several automated methods for $\tau$ selection are available:

- **Frequency-domain:** Uses spectral estimates to set $\tau$ based on the highest significant frequency via least-median-of-squares regression on the Fourier modulus [1905.06443].
- **Permutation Auto-Mutual Information (PAMI):** Finds the first minimum of the auto-mutual information of the ordinal pattern process [1905.06443].
- **Multiscale PE (MPE):** Examines $h_{d,\tau}$ as a function of $\tau$, choosing $\tau$ at key maxima or resonance [1905.06443].
- **Topological Data Analysis (TDA):** Applies persistent homology to point clouds formed from embedding vectors to select $\tau$ maximizing topological signatures [1905.04329].

The embedding dimension $d$ can be chosen by:
- **False Nearest Neighbours (FNN):** The smallest $d$ at which the fraction of false neighbours drops below a threshold [1905.06443].
- **Permutation entropy maximization:** Plotting normalized $h'_n = H(n,\tau)/(n-1)$ and selecting $n$ at the peak [1905.06443].

Practical guidelines recommend $3\leq n\leq7$ and $\tau=1$ as defaults, with data-driven checks for system-specific tuning [1905.06443, 1905.04329].

## 3. Extensions: Multivariate, Weighted, Graph, and Global PE

### Weighted and Generalized Weighted PE

Weighted permutation entropy (WPE) enhances classical PE by weighting patterns according to fluctuation amplitude (e.g., local variance in the window) [2207.01169]. The generalized weighted version introduces a scaling exponent $\alpha\geq0$,
\[
P_\alpha(\pi) = \frac{\sum_{i:\pi_i=\pi} w_i^{\alpha}}{\sum_{j} w_j^{\alpha}},
\]
allowing continuous emphasis on large or small fluctuations. $\alpha=0$ recovers standard PE; $\alpha=1$ is WPE. Scanning $\alpha$ yields the complexity–entropy–scale causality box [2207.01169].

### Multivariate and Graph Extensions

Multivariate PE encodes both temporal structure and cross-channel dependencies by building a graph whose vertices encapsulate all time-channel pairs and applying permutation entropy over graph-neighbor-based embeddings [2203.00550]. This approach outperforms marginal and channel-wise PEs by capturing true multichannel interactions.

Graph-based PE, and its continuous variants, extend pattern extraction to generic, possibly non-regular, domains such as sensor networks or fMRI brain graphs. Local neighborhood-averages replace time-delay embedding, and ordinal activations enable amplitude-sensitive nonlinearities [2110.00628, 2407.07524]. The “ordinal deep learning” paradigm uses monotonic nonlinearities and trainable statistics for further flexibility [2407.07524].

### Global Permutation Entropy (GPE)

Global permutation entropy computes the distribution of all possible subsequences of $k$ (not necessarily consecutive) values,
\[
p(\sigma) = \frac{\#\{(i_1,\dots,i_k): \text{pattern} = \sigma\}}{\binom{n}{k}},
\]
which provides sensitivity to long-range and multi-scale dependencies. This requires advanced combinatorial counting algorithms but converges more rapidly and requires less parameter tuning than classical PE [2508.19955].

## 4. Statistical Complexity and the Complexity–Entropy Plane

Permutation entropy is frequently paired with statistical complexity measures, especially the Jensen–Shannon complexity $C$:
\[
C = Q_0 \cdot \frac{D_{\mathrm{JS}}[P\,\|\,U]}{D_{\mathrm{JS}}^{\max}} \cdot h_{\mathrm{PE}},
\]
where $P$ is the observed pattern distribution and $U$ is uniform. Plotting $(h_{\mathrm{PE}}, C)$ in the complexity–entropy plane locates a process on the continuum from order (periodic) through deterministic chaos to stochasticity [2410.19013, 2102.06786, 2403.16910, 2102.06786, 2102.06786, 2102.06786]. This analysis distinguishes noise (high entropy, low complexity), periodicity (low entropy, low complexity), and chaos/intermittency (intermediate entropy, high complexity).

Extensions such as Tsallis or Rényi PE allow construction of families of complexity–entropy curves, each parameterized by the corresponding entropy index, further refining dynamical regime discrimination [2102.06786].

## 5. Theoretical Properties and Generalizations

- **Invariance:** PE is invariant under strictly monotonic transformations and amplitude rescalings [2102.06786, 2312.00964]. Thus, it is robust to many forms of observational noise, but does not detect amplitude modulation.
- **Relation to Dynamical Invariants:** For deterministic, piecewise-monotone maps, the permutation-entropy rate converges (with increasing pattern length) to the Kolmogorov–Sinai entropy (metric entropy) [2003.13728, 1812.05075].
- **Complexity Classes:** The diversity of observed patterns falls into exponential, sub-factorial, or factorial growth regimes, separating deterministic systems (sub-linear pattern growth) from stochastic processes (full factorial) [2103.11762].
- **Normalization and Divergence:** In white noise, $h_{\mathrm{PE}}\to1$ as all patterns appear equally likely. For random processes, “classical” PE's per-symbol entropy diverges; generalized permutation entropies (e.g., $Z$-entropy) maintain finite normalization, sharply distinguishing disorder from deterministic chaos [2003.13728, 2103.11762].

## 6. Practical Applications Across Domains

Permutation entropy and its variants have been widely adopted:

- **Neuroscience:** Quantification of EEG complexity and sleep stage transitions; diagnosis of insomnia and tracking of anesthesia depth [2312.07129].
- **Engineering:** Fault detection in electromechanical systems such as wind turbines via complexity differentials across phases [1601.05387].
- **Communications:** Radio-frequency signal classification under noise by exploiting the amplitude-agnostic, structure-sensitive nature of PE-derived features [2312.00964].
- **Space Physics:** Characterization of solar wind regimes by complexity-entropy analysis, discriminating turbulence from coherent structures [2403.16910].
- **Climate and Environmental Data:** Detection of local mixing and instrument oversampling scales via reversal metrics applied to the delay parameter, enabling time-scale aware signal retention and analysis [2010.12384].

A strong trend is the use of PE in conjunction with the complexity–entropy plane for regime classification, multi-scale/multivariate structure detection, and time-varying complexity monitoring.

## 7. Available Software and Computational Remarks

Numerous efficient implementations now exist. The ordpy Python package is a comprehensive toolbox for PE, generalized entropies, complexity measures, and ordinal networks applicable to time series and two-dimensional images [2102.06786]. Julia-based and other high-performance libraries are available for global permutation entropy and for advanced graph and multivariate extensions [2508.19955].

Computational cost is dominated by the sorting required for each length-$d$ window ($O(N\,d\log d)$); factorial growth in the number of patterns restricts feasible dimensions to $d\leq7$ unless massive sample sizes are available [2102.06786]. Advanced graph and global algorithms exploit combinatorial data structures to remain tractable for practical problems [2508.19955, 2203.00550].

---

Permutation entropy and its modern extensions comprise a versatile, theoretically rigorous, and application-proven framework for symbolic time series analysis, complexity quantification, and nonlinear signal discrimination across physics, engineering, and neuroscience. Continuous advances in multiscale, multivariate, graph-based, and information-theoretic methodologies have made PE central to contemporary nonlinear data analytics [2102.06786, 2207.01169, 2203.00550, 2103.11762, 2410.19013, 2010.12384, 2403.16910, 2508.19955].

Source: https://www.emergentmind.com/topics/permutation-entropy