---
title: Derivative-Based Global Sensitivity Indices
url: https://www.emergentmind.com/topics/derivative-based-global-sensitivity-indices
type: topic
---

# Derivative-Based Global Sensitivity Indices

Derivative-based global sensitivity indices (DGSM) quantify the global influence of each input variable on model outputs by integrating (typically squared) local partial derivatives over the input space. Unlike classical variance-based Sobol’ indices, which decompose variance through ANOVA expansions, DGSM leverage gradient information to provide computationally efficient screening and upper bounds—especially vital in high-dimensional or computationally intensive models. DGSM extend to arbitrary distributions via Poincaré-type inequalities and admit efficient estimation via adjoint, surrogate, and spectral methods. Their generalization to functional outputs, active learning, and their rigorous connection to total-effect Sobol’ indices and entropy-based GSA underpin their centrality in contemporary uncertainty quantification.

## 1. Mathematical Definition and Theoretical Foundations

Let \( X = (X_1, ..., X_d) \) be a vector of independent input variables with probability measure \(\mu = \bigotimes_{i=1}^d \mu_i\), and let \( f: \Omega \subseteq \mathbb{R}^d \to \mathbb{R} \) be a square-integrable response function with square-integrable partial derivatives. The derivative-based global sensitivity measure for variable \( X_i \) is defined as
\[
\nu_i = \mathbb{E}\left[ \left( \frac{\partial f}{\partial x_i}(X) \right)^2 \right] = \int_\Omega \left( \frac{\partial f}{\partial x_i}(x) \right)^2 d\mu(x)
\]
Optionally, normalization by model variance \( D = \mathrm{Var}[f(X)] \) yields
\[
S^D_i = \frac{\nu_i}{D}
\]
which is analogous in interpretation to a first-order or total-effect Sobol’ index [1902.04630].

The generalization to functional outputs \( f(s, \theta) \), where \( s \) is a space or time variable and \( \theta \) a vector of parameters, involves integrating squared sensitivities over the output domain:
\[
\nu_j(f;X) = \int_X \mathbb{E}_{\theta} \left[ \left( \frac{\partial f}{\partial \theta_j}(s, \theta) \right)^2 \right] ds
\]
and normalizing by the trace of output covariance \( \operatorname{Tr}(C) = \int_X \operatorname{Var}_{\theta}[f(s, \theta)] ds \) to enable direct ranking [1902.04630].

## 2. Links with Sobol’ Indices and Bounding Results

Sobol’ total-effect indices \( S_{T_i} \) satisfy rigorous upper bounds in terms of DGSM and Poincaré-type constants:
\[
S_{T_i} \leq C(\mu_i) \frac{\nu_i}{D}
\]
with the optimal constant \( C(\mu_i) \) defined for general Boltzmann measures (densities of the form \( e^{-v(x)} \)) as
\[
C(\mu_i) = 4\, C_{1,i}^2,\quad C_{1,i} = \sup_{x \in \mathbb{R}} \frac{\min\{F_i(x), 1-F_i(x)\}}{\rho_i(x)}
\]
and specializing to \( (b-a)^2/\pi^2 \) for uniform and \( \sigma^2 \) for Gaussian marginals [1202.0943]. These inequalities are sharp for linear responses. Lower bounds via Cauchy–Schwarz and Hardy–Littlewood–Polya techniques further bracket \( S_{T_i} \) in terms of DGSM. For arbitrary measures, Cheeger or log-Sobolev constants enter the bounds [1605.07830, 1412.2619].

In settings with functional outputs, the bound extends pointwise and is aggregated over the functional domain:
\[
S_j^{\rm tot}(f; X) \leq \alpha_j \cdot \frac{\nu_j(f; X)}{\operatorname{Tr}(C)}
\]
where \( \alpha_j \) is the Poincaré constant for \( \theta_j \), specific to its marginal law [1902.04630].

## 3. Numerical Estimation, Surrogate, and Spectral Methods

DGSM estimation exploits both finite-difference and automatic/adjoint differentiation for gradient evaluation, yielding practical computational costs:
- Monte Carlo: \( N(d+1) \) model evaluations per \( N \) samples for all \( d \) variables.
- With adjoint-mode differentiation: all gradients at a single point can be computed for \( \sim 6 \) model runs—essentially dimension-independent cost [1412.2619, 1605.07830].

Polynomial chaos expansions (PCE) offer analytical computation of DGSM via post-processing:
\[
\nu_i = s_i^2 \sum_{\alpha: \alpha_i > 0} a_\alpha^2 N_{\alpha_i}^{(i)}
\]
where \( a_\alpha \) are PCE coefficients, \( s_i \) the scaling, and \( N_{\alpha_i}^{(i)} \) the univariate polynomial derivative norm [1405.5740]. Poincaré chaos expansions ("PoinCE") generalize this by constructing bases such that derivatives are orthogonal with respect to the input measure. Parseval-type equalities enable closed-form expressions for both Sobol’ and DGSM indices within this framework, allowing gradient-enhanced PoinCE regression to produce highly accurate and robust sensitivity estimates, even in data-scarce settings [2510.03056, 2107.00394].

## 4. Active Learning and Gaussian Process Surrogates for DGSM

Gaussian process (GP) surrogates allow estimation of DGSM and their uncertainty through the GP posterior gradient's mean and covariance:
\[
\widehat{\nu}_i = \int \left(\mu'_{\partial,i}(x)^2 + \sigma^2_{\partial,i}(x)\right) p(x) dx
\]
Specialized active learning strategies utilize acquisition functions targeting uncertainty reduction in DGSM, optimizing sample efficiency. Criteria include gradient variance, variance reduction, and information gain, extendable to both local and global gradient structures, and are computationally accelerated via chunking and K-means approximations [2601.11790, 2407.09739]. Empirical studies demonstrate substantial sample efficiency gains for DGSM estimation, especially under stringent evaluation budgets.

## 5. Extensions to Functional Outputs and High-dimensional Inputs

For models with high-dimensional parameter spaces and vector- or function-valued outputs, DGSM compute through integration or weighting over functional domains. Karhunen–Loève (KL) expansions reduce both input and output dimensionality, enabling efficient computation of sensitivities with adjoint-based gradients [1902.04630]. The adjoint approach allows all partial derivatives for a given sample with low additional computational burden, scalable to large numbers of input parameters.

Functional DGSM bounds guide reduced-order modeling: selecting only those input modes or basis functions with significant DGSM suffices to achieve accurate surrogates whose predicted uncertainty and variable ranking closely match the full model [1902.04630].

## 6. Advanced Frameworks: Shapley and Entropy-based Indices

The derivative-based Shapley value (DerSHAP) merges the axiomatic fairness of Shapley values with the efficiency of DGSM. Given
\[
\phi_i = \mathbb{E}\left[ \left( \frac{\partial f}{\partial x_i} \right)^2 \right] + \frac{1}{2} \sum_{j \neq i} \left| \mathbb{E}\left[\frac{\partial f}{\partial x_i} \frac{\partial f}{\partial x_j} \right] \right|
\]
DerSHAP robustly evaluates interaction effects and is computationally tractable even in high dimensions, directly accommodating dependent inputs via the joint covariance structure [2303.15183].

Entropic DGSM-based proxies exploit inequalities from transformation entropy:
\[
H(Y \mid X_{\sim i}) \leq H(X_i) + \mathbb{E}[\ln|\partial g/\partial x_i|]
\]
Exponentiation enforces positivity and defines tractable screening proxies that remain accurate in non-Gaussian and multi-modal settings, complementing variance-based proxies in such contexts [2310.00551].

## 7. Practical Considerations, Limitations, and Applications

DGSM are especially valuable for high-dimensional screening, efficient surrogate construction, and guiding reduced-order modeling. Their efficacy is maximized when gradient information is readily available (e.g., algorithmic or adjoint differentiation), and they are particularly well-suited for models where Sobol' MC estimation is prohibitive due to dimensionality [1605.07830, 1412.2619].

Limitations include:
- Sensitivity estimates may be loose in cases of strong nonlinearity, synergy, or when distributions exhibit heavy tails or significant skewness.
- Poincaré and Cheeger constants must be chosen appropriately for tightness of the Sobol’ bound; otherwise, bounds may be overly conservative.
- DGSM-based screening relies on the assumption that small averaged derivatives imply a variable's unimportance, which can be violated if strong interactions exist without corresponding large derivatives [1412.2619, 1202.0943].

Applications range from engineering uncertainty quantification (e.g., environmental and flood models, biotransport, circuit and mechanical systems) to machine learning explainability tools where gradient information enables efficient, scalable sensitivity ranking [2107.00394, 1510.04361, 2510.03056, 2303.15183].

---

In summary, derivative-based global sensitivity indices provide a mathematically rigorous, computationally efficient, and broadly generalizable foundation for high-dimensional global sensitivity analysis. They underpin state-of-the-art advances in dimension reduction, surrogate modeling, and experiment design in uncertainty quantification, and they serve as indispensable tools for both preliminary screening and quantitative ranking of influential variables in complex systems.

Source: https://www.emergentmind.com/topics/derivative-based-global-sensitivity-indices