---
title: Empirical Observability Gramian
url: https://www.emergentmind.com/topics/empirical-observability-gramian
type: topic
---

# Empirical Observability Gramian

The empirical observability Gramian is a simulation-based, data-driven generalization of the classical observability Gramian for nonlinear, parametric, time-varying, and even stochastic systems. It quantifies the local sensitivity of system output trajectories to small perturbations in initial state and is central to observability analysis, sensor placement, and model reduction in nonlinear dynamical systems. Empirical Gramians unify theory and computation for both finite-dimensional systems and distributed parameter (PDE) models, with efficient algorithms and well-understood interpretative properties.

## 1. Mathematical Definition and Construction

The empirical observability Gramian, denoted $W_o^\varepsilon$, encodes the effect of infinitesimal state perturbations on output trajectories. For a general nonlinear system
\[
\dot{x} = f(x, u),\qquad y = h(x),
\]
and a nominal initial state $x_0$, outputs are simulated for initial states $x_0^{+i} = x_0 + \varepsilon e_i$ and $x_0^{-i} = x_0 - \varepsilon e_i$ along each standard basis $e_i$ in $\mathbb{R}^n$, with $\varepsilon > 0$ a small perturbation. The empirical Gramian over $[0, T]$ is computed as
\[
W_o^\varepsilon(x_0, u; T) = \frac{1}{4\varepsilon^2} \int_{0}^{T} \Phi^\varepsilon(t)^\top \Phi^\varepsilon(t)\,dt,
\]
where $\Phi^\varepsilon(t) = [y^{+1}(t) - y^{-1}(t),\dots,y^{+n}(t) - y^{-n}(t)]$, with $y^{\pm i}(t)$ the outputs under the perturbed initial states. In the limit $\varepsilon \to 0$, $W_o^\varepsilon$ reduces to the linear observability Gramian if $f$ and $h$ are linear [2206.02361][1411.7016][1611.08056][2402.14711][1611.00675][2006.07451].

For discrete-time systems, the sum replaces the integral. The construction generalizes straightforwardly to PDEs by perturbing low-dimensional subspaces of the initial condition, and to nonlinear or data-driven measurement operators [1111.5846][1401.0235][2501.01726].

## 2. Computational Algorithms and Practical Choices

Algorithmic computation involves the following steps:
1. Select a nominal $(x_0, u(t))$, perturbation magnitude $\varepsilon$, and simulation horizon $T$.
2. For each state direction $i=1,\dots,n$, simulate outputs from $x_0 \pm \varepsilon e_i$.
3. At each time $t_k$, compute output differences and form $\Phi^\varepsilon(t_k)$.
4. Approximate the integral by a quadrature rule (e.g., Riemann, trapezoidal).
5. Accumulate $W_o^\varepsilon = \frac{1}{4\varepsilon^2} \sum_k \Phi^\varepsilon(t_k)^\top \Phi^\varepsilon(t_k) \Delta t$.

Essential parameter considerations:
- $\varepsilon$ must be small enough for local linearity, but robust to numerical noise (empirically $10^{-3}$–$10^{-5}$ times typical state magnitude).
- $T$ must capture all relevant system dynamics.
- Sampling interval $\Delta t$ must resolve system time scales [2206.02361][1611.00675][2501.01726][1405.6412].

For high-dimensional systems (e.g., PDEs, large-scale networks), the method generalizes by restricting perturbations to a subspace of the initial state, often corresponding to modal decomposition or a physically meaningful basis [2501.01726][1111.5846][1401.0235].

Averaging over multiple perturbation scales can enhance robustness in the presence of nonlinearities [1611.00675]. Centering options (arithmetic mean, steady-state, etc.) are available for conditioning and interpretability.

## 3. Interpretation: Spectral Measures and Observability Indices

$W_o^\varepsilon$ is a symmetric positive semidefinite matrix. Its eigenvalues $\lambda_j$ and corresponding eigenvectors $v_j$ illuminate observability structure:
- **Large $\lambda_j$**: Perturbations along $v_j$ cause strong output variations—those state components are highly observable.
- **Small $\lambda_j$**: Weak sensitivity—corresponding directions are nearly unobservable.

Key scalarizations used in sensor placement and system analysis include:
- **Minimum eigenvalue $\lambda_{\min}$**: Worst-case or weakest observable direction.
- **Condition number $\kappa = \lambda_{\max}/\lambda_{\min}$**: Observability "balance" or numerical stability.
- **Determinant $\det W_o$ or $(\det W_o)^{1/n}$**: Overall "volume" of the output-perturbation ellipsoid, global observability measure.
- **Trace $\operatorname{Tr}(W_o)$**: Sum of observable variances, but insensitive to unobservable modes [2206.02361][1411.7016][1405.6412][2105.13423].

Interpretation underpins sensor selection, control design (via feedback optimization), and model reduction. For example, maximizing the minimum eigenvalue ensures all state directions are sufficiently sensed, whereas maximizing determinant improves overall system identifiability [1411.7016][2402.14711][2501.01726].

## 4. Extensions: Stochastic, Delayed, and PDE Systems

### Stochastic Systems
The empirical observability Gramian extends to stochastic systems with process noise:
\[
dX = f(X, u)\,dt + \sigma(X, u)\,dW, \quad Y = h(X).
\]
Here, $W_o^\varepsilon$ becomes a random matrix due to process noise, and observability properties are characterized by the statistics (mean, variance) of eigenvalues computed via Monte Carlo runs. The "2n-simulation" methodology ensures positive semidefiniteness, and process noise can actually render previously unobservable modes observable (stochastic observability) [2006.07451][2310.00127].

### Delay, Composite, and Nonlinear Output Operators
Nonlinear delayed outputs, as in neural encoding models, are treated by simulating the full composite measurement chain—no analytic derivative of the nonlinearity or delay is needed. The Gramian is still constructed by finite-difference output trajectories [2206.02361].

### PDE/Continuum Systems
For infinite-dimensional systems (PDEs), the Gramian quantifies the observability of finite-dimensional subspaces (e.g., modal amplitudes or physical modes). Convergence and consistency results guarantee that discretized/empirical Gramians recover the true unobservability index in the limit of fine discretization [1111.5846][1401.0235][2501.01726].

## 5. Sensor Placement and Optimal Configuration

Sensor/actuator placement is a canonical application. Given candidate outputs (sensors), individual empirical Gramians $(W_o^\varepsilon)_i$ are precomputed. The sensor placement problem is formulated as
\[
W_o^\varepsilon(\beta) = \sum_{i=1}^{p} \beta_i (W_o^\varepsilon)_i,\qquad \beta_i \in \{0,1\},\quad \sum \beta_i = r,
\]
where $r$ is the desired number of sensors. The objective is typically to **minimize an unobservability metric** such as $\kappa(W_o)+w[1/\lambda_{\min}(W_o)]$ or maximize $\log\det W_o^\varepsilon$ or $\lambda_{\min}(W_o^\varepsilon)$. Convex relaxations (e.g., $\beta_i\in[0,1]$) and combinatorial solvers (e.g., NOMAD/MADS, greedy submodular maximization) are employed for tractability [1405.6412][1411.7016][2402.14711][2501.01726][2310.00127].

Sensor selection criteria adapt to regime: when observability is low (few sensors), prioritizing $\lambda_{\min}$ or $\kappa$ avoids nearly-unobservable configurations. In large systems, maximizing determinant improves global performance. These approaches are robust to system perturbations and parameter changes, as demonstrated empirically on power networks and bioinspired sensing models [1405.6412][2206.02361][2501.01726][2411.7016].

Table: Scalar Observability Measures (abbreviated)
| Metric           | Interpretation                      | Limitations/Use Context             |
|------------------|-------------------------------------|-------------------------------------|
| $\det W_o$       | Volume, overall observability       | Insensitive to weakest direction    |
| $\lambda_{\min}$ | Worst-case, guarantees no blind spot| Neglects high-energy directions     |
| $\kappa$         | Balance, numerical stability        | May prefer flat but small ellipsoids|
| $\operatorname{Tr}$ | Sum of output energy             | Ignores completely unobservable directions |

## 6. Connections to Variational Analysis and Model Reduction

The empirical Gramian is closely related to the variational (linearized) observability Gramian, and formal equivalence can be shown for small perturbations. Taylor expansion of nonlinear outputs around $x_0$ yields that the finite-difference-based empirical Gramian approximates the variational Gramian to $O(\varepsilon^2)$. This connection extends to Lyapunov exponents, which can be used to jointly characterize observability and system stability. Scalar measures such as log-determinant of the Gramian have been shown to relate to sums of Lyapunov exponents [2402.14711][1902.09836].

Empirical Gramians underpin practical model reduction via (empirical) balanced truncation for nonlinear and parametric systems, especially where explicit linearization is infeasible or unavailable [1611.00675][1902.09836]. The balanced empirical Gramian identifies and retains the most observable states, supporting projection-based model order reduction.

## 7. Limitations, Consistency, and Theoretical Guarantees

Practical and theoretical limitations include:
- **Locality**: $W_o^\varepsilon$ reflects observability only in the neighborhood of $(x_0,u(t))$; global observability cannot be inferred.
- **Computational scaling**: For high-dimensional or PDE systems, cost is $O(n^2 K)$ (with $K$ the number of time steps), but parallel and GPU-based algorithms can mitigate this.
- **Choice of perturbation $\varepsilon$**: Must balance linearization validity against numerical noise.
- **Unobservable subspaces**: If $W_o^\varepsilon$ is singular (zero minimum eigenvalue), the system is locally unobservable in some directions.
- **PDE systems**: Finite-dimensional empirical Gramians converge to the true unobservability index under well-posed discretizations, with explicit convergence theorems [1111.5846][1401.0235].

Empirical Gramians are consistent estimators of true linearized observability properties under standard regularity and discretization assumptions, both for ODE and PDE settings. Theoretical results guarantee convergence and robustness to discretization choices, ensuring reliability of the measure in both applied and theoretical contexts [1111.5846][1401.0235][1611.00675][2501.01726].

---

**References:**  
- [2206.02361] Neural-inspired Measurement Observability  
- [1411.7016] Adaptive Optimal PMU Placement Based on Empirical Observability Gramian  
- [2402.14711] Observability for Nonlinear Systems: Connecting Variational Dynamics, Lyapunov Exponents, and Empirical Gramians  
- [1611.00675] emgr - The Empirical Gramian Framework  
- [2501.01726] Sensor Placement on a Cantilever Beam Using Observability Gramians  
- [1111.5846] The Consistency of Partial Observability for PDEs  
- [1405.6412] Optimal PMU Placement for Power System Dynamic State Estimation by Using Empirical Observability Gramian  
- [2310.00127] Sensor Placement for Flapping Wing Model Using Stochastic Observability Gramians  
- [2006.07451] Empirical Observability Gramian for Stochastic Observability of Nonlinear Systems  
- [1902.09836] Empirical Differential Gramians for Nonlinear Model Reduction

Source: https://www.emergentmind.com/topics/empirical-observability-gramian