---
title: Probabilistic Signal Temporal Logic (PSTL)
url: https://www.emergentmind.com/topics/probabilistic-signal-temporal-logic-pstl
type: topic
---

# Probabilistic Signal Temporal Logic (PSTL)

Probabilistic Signal Temporal Logic (PSTL) is a family of formal specification languages extending classical Signal Temporal Logic (STL) to rigorously reason about temporal properties of systems under stochastic uncertainty. PSTL applies when system dynamics, environment, or specification satisfaction are subject to randomness, measurement noise, or epistemic uncertainty in model parameters. Instead of strictly Boolean satisfaction, PSTL enables specifying and analyzing the probability that a system trajectory satisfies a temporal logic formula, admitting both verification and synthesis tasks with quantified probabilistic guarantees. This article presents the core definitions, semantic frameworks, algorithmic techniques, and methodological variants of PSTL as developed in recent literature.

## 1. Core Syntax and Semantics of PSTL

PSTL extends STL formulas—which are interpreted over real-valued, discrete-time trajectories $x(0), x(1), \dots \in \mathbb{R}^n$—by introducing probabilistic operators. A canonical form expresses a “chance constraint”:

\[
P_{\geq 1-\delta}[\psi]
\]

which asserts that “the probability that trajectory $\xi$ satisfies the STL subformula $\psi$ is at least $1-\delta$” [2005.05040]. In formal terms, given a stochastic system model $M(\theta)$ parameterized by $\theta \in \Theta$, the chance-constraint semantics are:

\[
\mathrm{Pr}[M(\theta) \models \psi] \geq 1-\delta
\]

with the binary satisfaction function $f_\psi^\delta(\theta) = 1$ if the above holds, 0 otherwise.

Atomic predicates have affine form $\alpha(x) \ge 0$; Boolean connectives ($\neg$, $\wedge$), and temporal operators (“bounded until” $[a,b]$) retain standard STL structure. Robustness semantics $\rho^\psi(\xi, t)$ return real-valued scores, further enabling a quantitative notion of satisfaction.

Related, alternative PSTL grammars—such as those of [1510.08474] and [2105.06121]—allow two-layer formulations, distinguishing between a Boolean-valued “instance” layer and an inner probabilistic “event” layer, and generalizing atomic predicates to probabilistic or statistical events (e.g., Bernoulli random fields or beliefs over latent states).

## 2. Probabilistic Reasoning Models and Inference

PSTL admits several frameworks for reasoning about the probability of formula satisfaction:

- **Two-noise-layer models**: System behavior may be driven by both intrinsic dynamical noise (process noise $w(t)$) and extrinsic measurement noise ($e(t)$), requiring a hierarchical approach to reasoning over both [2005.05040]. The system model is specified as
  \[
  x(t+1) = A x(t) + B u(t) + G w(t),\qquad y(t) = C(\theta) x(t) + e(t)
  \]
  with both $w(t)$ and $e(t)$ i.i.d. Gaussian.

- **Belief-space temporal logic**: Probabilistic predicates reference beliefs over unobserved states, as in partially observable Markov decision processes (POMDPs), allowing explicit encoding of chance constraints on belief updates computed via recursive Bayesian inference [1510.08474].

- **Adaptive, data-driven models**: When system parameters $\theta$ are uncertain and to be inferred from data, a prior $p(\theta)$ is updated to a posterior $p(\theta|\mathcal{D})$ using likelihoods derived from trajectory observations, typically via Gaussian models [2005.05040, 1510.07313]. The confidence that the true system satisfies the property is then
  \[
  \mathrm{Conf}[S \models \psi | \mathcal{D}] = \int_\Theta f_\psi^\delta(\theta) p(\theta|\mathcal{D}) d\theta
  \]
  providing a scalar between 0 and 1 representing the posterior probability of satisfaction, given collected data.

- **Random predicate semantics**: Satisfaction itself is a random variable. The satisfaction probability is estimated by propagating predicate-level Bernoulli distributions through the temporal logic formula using conditional-independence approximations [2105.06121].

## 3. Algorithmic Approaches for Verification and Synthesis

Multiple algorithmic templates have been proposed for PSTL model checking, verification, and controller synthesis:

- **Chance-constrained reduction**: The probability constraint $\mathrm{Pr}[\psi] \geq 1-\delta$ is structurally reduced to a family of finite, probabilistic constraints on atomic predicates, typically in the form:
  \[
  \mathrm{Pr}[\alpha(x(t)) \geq 0] \geq 1-\delta
  \]
  For linear-Gaussian models, this is equivalent to an affine constraint involving the quantile of the normal distribution [2005.05040, 1510.07313]:
  \[
  \tilde{\theta}_0 + \tilde{\theta}^\top \mu_x + \sqrt{\tilde{\theta}^\top \Sigma_x \tilde{\theta}} \, q^{-1}(\delta) \geq 0
  \]

- **Convex and mixed-integer programming**: Chance constraints can be encoded as second-order cone constraints or via mixed-integer encodings (when temporal operators or logic connectives are involved), enabling efficient verification or receding-horizon controller synthesis using SOCP or MISOCP solvers [1510.07313].

- **Robust polytope construction**: Satisfaction sets in parameter space (e.g., the set $\mathcal{S} = \{\theta: f_\psi^\delta(\theta)=1\}$) are approximated by polytopes using LP-based techniques (e.g., via Farkas’ lemma), with piecewise-affine refinement for nonlinearity in quantiles [2005.05040].

- **Monte Carlo and sampling-based confidence estimation**: Confidence integrals are computed by rejection sampling in parameter space (for $\theta$) or direct sampling of trajectories, with statistical error controlled by concentration inequalities [2005.05040, 1510.07313, 2203.00078].

- **Elliptical Slice Sampling (ESS) and Multilevel Splitting**: Efficient, rejection-free MCMC sampling from Gaussian (or Gaussian mixture) trajectory distributions restricted to satisfying a robustness constraint enables scalable estimation of rare event probabilities under STL constraints, explicitly avoiding over-counting or conservative approximations [2203.00078].

- **Gradient-based MAP inference**: By recasting PSTL-constrained synthesis as MAP inference for control trajectories, differentiable semantics (log-odds propagations) enable optimization with gradient ascent and efficient GPU parallelism [2105.06121].

## 4. Specialized PSTL Variants and Comparison

Distinct PSTL formulation variants have been developed:

| Variant           | Main Feature                                 | Reference              |
|-------------------|----------------------------------------------|------------------------|
| “Chance-constraint” PSTL | Global probability threshold $P_{\geq 1-\delta}[\psi]$ | [2005.05040]          |
| Belief-space PSTL | Predicates over time-evolving agent beliefs  | [1510.08474]           |
| PrSTL (Probabilistic STL) | Adaptive logic, chance constraints on parametric predicates, update with data | [1510.07313]   |
| Random STL (RSTL) | Randomized predicate satisfaction, smooth probability propagation | [2105.06121]     |

PSTL reduces to standard STL when all randomness is degenerate (Dirac delta), beliefs are deterministic, or predicates are exact. The logic recovers temporal logic for POMDPs (when beliefs are updated via Bayesian inference) in the appropriate limit [1510.08474, 2105.06121].

A notable alternative to probability-centric PSTL is STL “erosion” [2503.04762], which reduces the probabilistic model checking problem to deterministic STL verification over a tightened (eroded) specification, using high-probability bounds on stochastic perturbations. This approach avoids explicit chance constraints but guarantees correctness (but not completeness) by design.

## 5. Illustrative Numerical Examples

Numerical studies provide significant insights:

- **Data-driven PSTL with two-state model**: For
  \[
  x(t+1) = [a\ 0;\ 1-a^2\ a]\,x(t) + [\sqrt{1-a^2};\ -a \sqrt{1-a^2}] u(t) + I_2 w(t)
  \]
  and output $y(t) = \theta^\top x(t) + e(t)$, the PSTL property $P_{\geq 0.99}[ (|y| \leq 0.5)\ U_{[2,4]} (|y| \leq 0.1)]$ is checked by LP over $\theta$-space and post-data Bayesian updating [2005.05040]. Prior to data, confidence is low ($\approx$ 2.7%). With $N=50$ experiments, posterior confidence rises sharply ($\approx$ 90%).

- **Quadrotor safety under PrSTL**: A quadrotor navigates under an uncertain ceiling with probabilistic classifier boundaries updated from sensor data, enforcing $\mathrm{Pr} [ \alpha_k^\top [x_k,y_k,z_k] < 0 ] \geq 0.95$. Online SOCP ensures safety as knowledge is refined [1510.07313].

- **Probabilistic verification by STL erosion**: For a double integrator with a safety reach-avoid specification, erosion with appropriate radii (from high probability bounds) yields eroded obstacles and goals on which deterministic STL verification guarantees original probabilistic satisfaction [2503.04762].

- **Sampling-based verification**: Elliptical Slice Sampling with multilevel splitting enables efficient estimation of small satisfaction probabilities (down to $10^{-4}$), even for high-dimensional (100+) trajectory spaces or rare events [2203.00078].

- **Controller synthesis under belief-space PSTL**: Receding-horizon forward search with beam pruning solves high-dimensional belief-space surveillance and search tasks for UAVs, scaling tractably to horizon lengths $H=70$–$90$ [1510.08474].

## 6. Theoretical Guarantees, Limitations, and Computational Complexity

Theoretical properties of PSTL frameworks vary:

- **Soundness**: All approaches provide probabilistic soundness with respect to the model assumptions and noise structure, i.e., computed confidence is a lower bound on true satisfaction probability [2005.05040, 2503.04762, 1510.07313].
- **Completeness**: For convex/decomposable formulations (e.g., PWA or SOCP relaxations), exactness is achieved in the limit (as cell partitioning/refinements increase) [2005.05040, 1510.07313].
- **Scalability**: Sampling-based and gradient approaches—especially when GPU-accelerated—allow scaling synthesis and verification to long horizons and high-dimensional state spaces [2105.06121, 2203.00078].
- **Adaptivity**: Bayesian and data-driven PSTL updates satisfaction probabilities in real time as more data is acquired, allowing the logic to adapt to evolving knowledge [1510.07313, 2005.05040].
- **Limitations**: Most tractable methods require affine or linear-Gaussian models; extension to nonlinear or non-Gaussian dynamics often requires additional approximation, linearization, or conservative bounding [1510.07313, 2203.00078]. Nonconvexity precludes global optimality for gradient or sampling algorithms [2105.06121].

## 7. Significance and Applications

PSTL provides a rigorous, compositional, and quantitatively meaningful language for specifying, verifying, and synthesizing controllers for systems in which uncertainty is fundamental. Domains include learning-based or data-driven CPS, robotic planning under sensor noise, formal safety analysis of autonomy in stochastic environments, and adaptive mission planning with belief-space reasoning [2005.05040, 1510.07313, 1510.08474, 2203.00078].

Key contributions include seamless integration of probabilistic inference (Bayesian and frequentist), systematic connection to robust and chance-constrained optimization (SOCP, MISOCP), and establishment of scalable, efficient algorithms for real-time control and verification. The abstraction of temporal logic specifications to soft, probabilistically meaningful constraints positions PSTL as a central framework for formal reasoning about complex, uncertain cyber-physical systems.

Source: https://www.emergentmind.com/topics/probabilistic-signal-temporal-logic-pstl