---
title: Missingness Simulation Techniques
url: https://www.emergentmind.com/topics/missingness-simulation
type: topic
---

# Missingness Simulation Techniques

Missingness simulation refers to the artificial introduction of missing data into otherwise complete datasets according to precisely defined stochastic mechanisms. This controlled amputation of data is foundational for methodological evaluation, sensitivity analysis, benchmarking of imputation and inference algorithms, and theoretical investigation of missing data under various mechanisms—including MCAR (missing completely at random), MAR (missing at random), MNAR (missing not at random), and structural extensions such as block or jointly dependent missingness patterns. Simulation facilitates empirical assessment of estimators’ properties, robustness of analysis pipelines, and reproducibility of statistical results in the presence of structured or non-ignorable missingness.

## 1. Formal Missingness Taxonomy and Mechanisms

The simulation of missingness exploits the classical Rubin taxonomy (MCAR, MAR, MNAR) and its structured generalizations. In the multivariate setting, the missingness mechanism is formalized as a set of conditional distributions for indicator variables $M_j$ that may depend on the data matrix $\mathbf X$ and, in the structured setting, on the other missingness indicators $\mathbf M_{-j}$:

- **MCAR**: $P(M_j\,|\,\mathbf X, \mathbf M_{-j}) = P(M_j\,|\,\gamma_j)$; completely independent of data.
- **MAR**: $P(M_j\,|\,\mathbf X, \mathbf M_{-j}) = P(M_j\,|\,\mathbf X_{\rm obs}, \gamma_j)$; depends only on observed values.
- **MNAR**: $P(M_j\,|\,\mathbf X, \mathbf M_{-j}) = P(M_j\,|\,\mathbf X_{\rm obs}, \mathbf X_{\rm mis}, \gamma_j)$; depends on unobserved information and can induce non-ignorability.
- **Structured Missingness (SM)**: Each $M_j$ can functionally or stochastically depend on multiple other indicators $\mathbf M_{-j}$, allowing for block, monotone, and sequential patterns [2307.02650].

Practical models use generalized linear models (logistic/probit/canonical links), with MCAR realized by coefficients $\beta=\gamma=0$, MAR by setting $\gamma=0$, and MNAR by inclusion of unobserved/self variables in predictors.

## 2. Simulation Algorithms and Mask Generation

The central workflow is: (i) generate a complete dataset from a specified data-generating process, (ii) impose missingness using a random mask sampled from the desired mechanism, (iii) analyze or impute. Algorithms are tailored to the required missingness pattern.

### General SM Simulation

For a dataset of $n$ subjects and $p$ variables [2307.02650]:
```python
def expit(x): return 1/(1+np.exp(-x))
for j in range(p):
    for i in range(n):
        linpred = α_j + X[i,:] @ β_j + M[i,:] @ γ_j
        p_miss = expit(linpred)
        M[i, j] = np.random.binomial(1, p_miss)
        if block_structure and strong:  # deterministic block
            for k > j: M[i, k] = 1
```
The same logic generalizes to block or monotone mechanisms by forced ties or mixture models. In high dimensions, vectorized or matrix-based amputation (e.g., Bernoulli amputation using copula-dependence) is employed [2407.18572].

### Specializations

- **Block/Sporadic Structured EHR**: Remove specified entire rows/columns (block), then superimpose entrywise intermittent missingness by applying masked Bernoulli draws with heterogeneous probability matrices $\Theta = \alpha\beta^T$ [2506.09208].
- **State- and Time-Dependent HMMs**: At each $t$: $R_t \sim \operatorname{Bern}(p_{\mathrm{miss}})$. $p_{\mathrm{miss}}$ parameterized via state, time, or both; three-level simulation: sample $S_t$, then $Y_t$, then $R_t$ [2109.02770].
- **Tensor/Array MNAR**: For each $(i,j,k)$, sample $O_{i,j,k} \sim \mathrm{Bernoulli}(g_\theta(T_{i,j,k}))$, with $g_\theta(x) = \mathrm{logit}^{-1}(b_0 + b_1 x)$ [2509.06225].

## 3. Advanced and Structured Missingness: Copulas, Patterns, and Hierarchies

Bernoulli amputation unifies most MCAR/MAR/MNAR/SM patterns within a single framework: Given margins $p_{i,j}$ and a $d$-variate copula $C$, sample $M_{i, j} = 1_{U_{i, j} \leq p_{i, j}}$, $U_{i, \cdot} \sim C$ [2407.18572]. This supports:

- MCAR/MAR/MNAR by selective dependence in $p_{i,j}(Y)$
- Block missingness via comonotone copulas
- Monotone missingness by introducing a latent cutpoint $J_i$ sampled from a categorical, imposing monotonicity across variables

Detailed mathematical characterization of joint probabilities and pairwise missingness correlations is given via survival copula transforms, fully controlling dependence within or across rows and columns.

## 4. Missingness Simulation in Causal and Inference Frameworks

When simulating for causal inference with missing data, missingness must be applied post-treatment assignment with precise attention to the identifiability conditions, e.g., as encoded by m-DAGs [2301.06739], guaranteeing proper estimation of effects under various mechanism types:

- **Causal m-DAG simulation**: Construct latent variable and outcome DAG, then generate missingness indicators by logistic/threshold models aligned with canonical graphs (e.g., outcome-induced, sequential, or block missingness).
- **Design-based inference**: Missingness is a fixed function $\eta(\cdot)$ of all unit attributes; for randomization-based analysis, masks are invariant under permutation of treatment [2310.18556].

When outcome or key confounder missingness is MNAR, substantive-model-compatible imputation, or imputation + re-imputation within permutation tests, can be embedded into every randomization replicate to preserve finite-sample inference guarantees [2310.18556, 2411.13829].

## 5. Applications in Sensitivity Analysis and Evaluation

Missingness simulation under a spectrum of plausible mechanisms is foundational for sensitivity analysis, particularly for MNAR or selection models. In simulation-based sensitivity analysis (SSA) [1501.05788]:

- Construct a grid $\Gamma$ of non-ignorability parameters
- For each $\gamma \in \Gamma$, (i) fit the model, (ii) generate complete data, (iii) impose missingness under $P(R=1|D;\gamma)$, (iv) compute distance (e.g., $d_{\mathrm{KNN}}$) between actual and generated incomplete datasets
- Exclude $\gamma$ where distance is “too large” ($\mathrm{ASL}_\gamma < \alpha$); among remaining, select most plausible (minimum $d_{\mathrm{KNN}}$) or provide an interval of estimates

The practical implementation must report both point and interval estimates and quantify the shape similarity between empirical and synthetic incomplete data.

Metrics commonly used in evaluation studies include:

| Metric      | Definition                                             | Purpose                     |
|-------------|-------------------------------------------------------|-----------------------------|
| Bias        | $\mathbb{E}[\hat\theta] - \theta_{\text{true}}$       | Assess estimator bias        |
| RMSE        | $\sqrt{\mathbb{E}[(\hat\theta - \theta_{\text{true}})^2]}$ | Aggregate error (variance + bias) |
| Coverage    | Proportion of CIs containing $\theta_{\text{true}}$    | Calibrate CI performance    |
| Predictive AUC/MSE | AUC for binary outcome, MSE for continuous    | Prediction accuracy         |

## 6. Handling Simulation Failures and Reporting Standards

Missingness simulation must address not only the imposed missing data but also secondary “simulation missingness” due to incomplete or failed simulation runs (DGM failure, method failure, metric non-computability) [2409.18527]. Each layer of missingness is tracked by indicator functions for data generation, method application, and metric computation; corresponding missing rates ($\delta_D$, $\delta_M$, $\delta_P$) inform reporting and exclusion rules.

Best practice for missingness reporting in simulation studies includes:

1. Quantify and report missingness rates by method and condition.
2. Use thresholds (e.g., $\delta^{(m,c)} > 10\%$) to flag exclusion.
3. State and justify handling strategy (case-wise, list-wise, method replacement).
4. Run sensitivity analyses across plausible strategies.
5. Share code and unaggregated replication-level data and indicators.

This protocol ensures methodological validity and reproducibility in simulation-based methodological research.

## 7. Selected Illustrative Examples

- **EHR Matrix Completion**: Block removal of large submatrices representing hospitals/sites, combined with Bernoulli (MAR) entrywise deletion to mimic variable patient-record structure [2506.09208].
- **Tensor MNAR**: Observed-mask modeled as logistic function of latent tensor values, enabling value-dependent non-ignorability [2509.06225].
- **IRT Omitted/Not-Reached**: Sequential omitted/not-reached item indicators defined via cumulative logit models conditional on latent “missingness propensity” $\zeta_i$, correlated with ability $\theta_i$ to induce non-ignorable missing data [1904.03767].

## References

- [2307.02650] "A Complete Characterisation of Structured Missingness"
- [2506.09208] "Integrated Analysis for Electronic Health Records with Structured and Sporadic Missingness"
- [2509.06225] "Generalized Tensor Completion with Non-Random Missingness"
- [2407.18572] "Bernoulli amputation"
- [2411.13829] "Sensitivity analysis methods for outcome missingness using substantive-model-compatible multiple imputation and their application in causal inference"
- [2310.18556] "Design-Based Causal Inference with Missing Outcomes: Missingness Mechanisms, Imputation-Assisted Randomization Tests, and Covariate Adjustment"
- [1501.05788] "Simulation-based Sensitivity Analysis for Non-ignorable Missing Data"
- [1904.03767] "An IRT-based Model for Omitted and Not-reached Items"
- [2409.18527] "Handling Missingness, Failures, and Non-Convergence in Simulation Studies: A Review of Current Practices and Recommendations"
- [2109.02770] "Ignorable and non-ignorable missing data in hidden Markov models"
- [2301.06739] "Recoverability and estimation of causal effects under typical multivariable missingness mechanisms"

This body of recent work establishes missingness simulation as a rigorously formalized, empirically essential component of modern statistical research, enabling advances in both methodological robustness and practical data analytic workflows.

Source: https://www.emergentmind.com/topics/missingness-simulation