---
title: Sensitivity Analysis in Scientific Models
url: https://www.emergentmind.com/topics/sensitivity-analysis
type: topic
---

# Sensitivity Analysis in Scientific Models

Sensitivity analysis is the systematic investigation of how variations in model inputs affect outputs, central in quantifying, attributing, and managing uncertainty in mathematical, statistical, and computational models. It provides critical contextual information about the dependence of model conclusions on underlying assumptions and parameter choices, supporting robust model design, calibration, validation, and interpretation across scientific, engineering, and statistical domains.

## 1. Conceptual Framework and Definitions

Sensitivity analysis (SA) quantifies how uncertainty in model outputs can be apportioned or attributed to different sources of uncertainty in model inputs. Two distinct yet complementary questions structure the uncertainty modeling workflow:

- **Uncertainty Analysis (UA):** "How uncertain is the prediction?" This involves propagating input uncertainty through the model to obtain summary statistics (mean, variance, quantiles) of the output.
- **Sensitivity Analysis (SA):** "Which uncertain input factors are responsible for the uncertainty in the prediction, and by how much?" Here, the goal is to decompose output variance or performance metrics into contributions from each input and their interactions [1711.11359].

A rigorous sensitivity analysis explores the full hypercube of plausible input values, not just one-factor-at-a-time (OAT) perturbations, ensuring identification of interaction effects and nonlinearity. Local sensitivity examines infinitesimal perturbations at a fixed input point (typically via derivatives or Jacobians), whereas global sensitivity assesses input importance integrated over the full domain (typically variance-based or moment-independent measures) [2204.01823]. Distinction from uncertainty analysis is essential: UA maps output distributions; SA apportions their uses or variances back to inputs.

## 2. Methodological Approaches

### 2.1 Local Sensitivity

Local (OAT) sensitivity measures the effect of infinitesimal or finite perturbations of individual inputs near a reference point. For deterministic differentiable models $y = f(x)$, the basic quantity is the derivative $\partial f / \partial x_i$ at $x^*$ or its normalized variant $\phi_i = (x_i^* / f(x^*)) (\partial f / \partial x_i)$, interpreted as the output’s percent change per percent change in input [2103.06227].

### 2.2 Global Sensitivity

**Global sensitivity analysis** aggregates effects over the entire admissible input space, capturing interaction and nonlinear dependencies. The dominant paradigm is variance decomposition:

- **Sobol’ Indices:** The ANOVA (variational) decomposition of $f(x)$ produces partial variances $D_i = \text{Var}_{x_i}[\mathbb{E}_{\sim x_i} f(x)]$. The first-order Sobol’ index $S_i = D_i / \text{Var}(f(x))$ measures the main effect of $x_i$; the total index $S_i^{\text{tot}}$ aggregates all terms (main and interaction) involving $x_i$ [1701.05494, 1711.11359].
- **Screening Methods (Morris):** For high-dimensional models, the Morris method computes “elementary effects” along randomized OAT trajectories, ranking factors by the mean ($\mu^*_i$) and standard deviation ($\sigma_i$) of local differences [2001.03965].

Global indices are estimated via Monte Carlo, Latin hypercube, or quasi-Monte Carlo (QMC) methods, with recent advances in mixed deterministic-stochastic QMC (“symmetrized shaking”) providing faster convergence for smooth integrands [1701.05494].

### 2.3 Analytic and Surrogate-Based Sensitivity

For differentiable models with known input distributions, analytic Taylor expansions yield explicit formulas for output variance as polynomials in input central moments and derivatives of $f$ (the “analytic variance-propagation” approach) [1608.07794]. Polynomial chaos expansions (PCE) serve as surrogate models facilitating rapid sensitivity computation, especially when inputs are correlated or models are computationally expensive [2306.00555].

### 2.4 Sensitivity in Structured Statistical Models

In discrete probabilistic graphical models, sensitivity analysis leverages the algebraic/monomial structure of atomic probabilities. For Bayesian networks and certain generalizations, output probabilities are rational functions (or multilinear polynomials) of parameters; sensitivity functions and global distance measures (e.g., Chan–Darwiche distance) admit closed-form or polynomial representations [1512.02266, 1901.02062].

### 2.5 Sensitivity in Causal Inference

Sensitivity analysis underpins robustness assessments to violations of core identification assumptions in causal inference, such as unmeasured confounding, selection bias, or ignorability. Notable frameworks include:

- **Bounding Factor Approaches:** Sharp analytical bounds for the influence of unobserved confounders based on maximal exposure–confounder and confounder–outcome relative risks [1507.03984].
- **Marginal Structural Models:** Sensitivity models for deviations from ignorability in MSMs parameterized by sensitivity parameters (e.g., odds ratio, outcome shift, or contamination fraction), with efficient estimation procedures [2210.04681].
- **Transportability and Partial Identification:** Exponential-tilt and change-of-measure models quantify the impact of assumption violations when generalizing from one population to another, yielding bounds on estimands such as risk or average treatment effect [2309.06305, 2306.08084, 2202.03408].

## 3. Computational Algorithms and Practical Computation

Efficient computation is central in large-scale models or high-dimensional Bayesian networks. Notably:

- **Variance-Based Indices:** Standard estimation uses the Saltelli sampling scheme: two independent design matrices, construction of “hybrid” samples replacing individual columns, and estimation via sample variances and covariances [1711.11359, 2001.03965].
- **Junction Tree Sensitivity in Bayesian Networks:** For discrete Bayesian networks, coefficients of sensitivity functions for all marginals with respect to all parameters can be computed via at most three belief propagations in a junction tree (one inward and two outward), yielding all relevant quotient-of-linears forms for OAT analysis. This is orders-of-magnitude more efficient than naive re-evaluation for each parameter [1301.3868].
- **Surrogate Modeling:** Polynomial chaos expansion (PCE) surrogate fitting, especially in the presence of correlated or non-Gaussian inputs, enables efficient computation of both “Full” and “Independent” indices via change-of-variables and basis permutation [2306.00555].
- **Visualization:** Advanced computational environments combine matrix, spatial, and constellation plot views to visually summarize local and global sensitivities, supporting complex algorithmic pipelines and interactive diagnostic evaluation [2204.01823].

## 4. Applications and Empirical Findings

Sensitivity analysis is foundational in model calibration, validation, uncertainty quantification, model reduction, and policy development across disciplines.

- **High-Dimensional PDE Models:** In environmental modeling, such as pollution forecasting, variance-based SA quantifies contributions of input uncertainties, with hybrid QMC/Monte Carlo yielding lower estimator variance even in non-smooth regimes [1701.05494].
- **Bayesian Neural Networks:** Decomposition of predictive uncertainty into epistemic and aleatoric components, with sensitivity defined as the derivative of uncertainty with respect to features, allows modelers to identify inputs responsible for reducible (data-limited) versus irreducible (inherent noise) uncertainty. Such decomposition aligns well with physical understanding and guides data acquisition [1712.03605].
- **Causal Mediation and Transportability:** Sensitivity of decomposed causal effects (e.g., mediated health disparities) to unmeasured mediator–outcome confounding is quantitatively assessed using regression coefficient or $R^2$ parameterizations, providing contour plots and robustness values to describe the minimum confounder strength required to overturn conclusions [2205.13127, 2202.03408].
- **Principal Stratification and LATE:** In noncompliance and instrumental variable analyses, multifaceted sensitivity models (odds ratio, mean ratio, standardized mean difference) have been developed, allowing estimator modification and nonparametric inference under deviations from untestable assumptions [2303.05032].

## 5. Limitations and Common Pitfalls

A systematic review of published practice demonstrates that a large fraction of sensitivity analyses fail to explore the full input space, relying on OAT approaches inappropriate for nonlinear or high-dimensional models, resulting in severe underestimation of interaction effects and misleading input importance rankings [1711.11359]. Sobol’ indices require input independence unless corrected. In the presence of correlated inputs, both variance-based and derivative indices must be adapted to account for changed marginal and conditional contributions [2306.00555].

Gradient-based (local) methods capture only first-order and local behavior, missing higher-order, nonlinear, or global effects, and their interpretability is limited in strongly nonlinear or interaction-rich models. The computational cost of standard global methods scales poorly with dimensionality unless surrogates or dimensionality reduction techniques are employed.

## 6. Best Practices and Future Directions

Consensus best practices, synthesized across foundational and applied literature, recommend:

- **Comprehensive Exploration:** Use global (variance-based or screening) methods to ensure proper exploration of the input space before interpreting input importance or fixing parameters [1711.11359, 1701.05494].
- **Combined Local and Global SA:** Employ local derivative-based analysis for calibration and local diagnostics, supplementing with global methods for overall input attribution [2103.06227].
- **Design of Experiments:** Use stratified, quasi-random, or Latin hypercube sampling to efficiently cover the multidimensional parameter space.
- **Reporting and Benchmarking:** Visualize both uncertainty and sensitivity outcomes; report point estimates and robustness or bias contours; relate sensitivity parameter magnitudes to benchmarks derived from observed covariates [2205.13127, 2309.06305].
- **Correlated Inputs:** Explicitly model input dependencies; compute both Full and Independent global indices and interpret accordingly [2306.00555].
- **Model Structure:** For structured probabilistic models, exploit algebraic or polynomial properties for analytic or highly efficient sensitivity computation [1512.02266, 1901.02062].

Key future directions include development of higher-order, global, and model-agnostic indices for sensitivity to specific uncertainty types (e.g., epistemic versus aleatoric), algorithms for high-dimensional models with complex input dependencies, and integrated workflows coupling sensitivity analysis with active data acquisition or optimization [1712.03605, 1701.05494].

---

**References:**  
- Sensitivity analysis for Bayesian neural networks [1712.03605]  
- Monte Carlo and QMC with “symmetrised shaking” [1701.05494]  
- Analytic multivariate variance propagation [1608.07794]  
- Visualization-driven global/local sensitivity in parameter space [2204.01823]  
- Sensitivity analysis in integrated assessment climate-economy models [2103.06227]  
- Assumption-free bounding-factor sensitivity in causal inference [1507.03984]  
- Global sensitivity in MSMs [2210.04681]  
- Systematic review and best practice guide for SA [1711.11359]  
- Algebraic/probabilistic graphical sensitivity analysis [1512.02266, 1901.02062]  
- Correlated input adaptations [2306.00555]  
- Efficient network sensitivity propagation [1301.3868]  
- Causal decomposition/mediation sensitivity to confounding [2205.13127]  
- Global SA methodology review in biomedicine [2001.03965]  
- Sensitivity for principal stratification violations [2303.05032]  
- Sensitivity to exchangeability in prediction transport [2306.08084]  
- Linear estimator identification-failure bounds [2309.06305]  
- ADE under continuous exposure and marginal odds-ratio bounds [2511.06243]

Source: https://www.emergentmind.com/topics/sensitivity-analysis