---
title: Modality Missing-Not-at-Random (MMNAR)
url: https://www.emergentmind.com/topics/modality-missing-not-at-random-mmnar
type: topic
---

# Modality Missing-Not-at-Random (MMNAR)

Modality Missing-Not-at-Random (MMNAR) denotes multimodal settings in which the availability of an entire modality is itself informative: whether a modality is observed or absent is shaped by latent state, acquisition policy, clinician behavior, or the unseen modality content, rather than by random nuisance missingness alone. In recent clinical multimodal work, MMNAR is defined precisely in this sense: modality observation patterns are endogenous, clinically meaningful, and predictive of outcomes, with examples such as discharge summaries missing for \(24.5\%\) of MIMIC-IV patients and imaging or documentation being ordered selectively by severity, diagnostic complexity, or institutional practice [2509.17228]. More generally, the standard missing-data taxonomy writes
\[
p_\phi(M\mid X)=
\begin{cases}
p_\phi(M) & \text{(MCAR)}\\
p_\phi(M\mid X^{\text{obs}}) & \text{(MAR)}\\
p_\phi(M\mid X^{\text{obs}},X^{\text{mis}}) & \text{(MNAR)},
\end{cases}
\]
and MMNAR is the modality-level instantiation of the third regime [2605.25439].

## 1. Definition and formal scope

A modality-level missingness pattern can be represented by a binary mask \(M=(M^{(1)},\dots,M^{(K)})\), where \(M^{(k)}\) indicates whether modality \(k\) is available. In the MMNAR regime, the probability of a modality pattern need not be a function only of the observed modalities; it may depend on unobserved modality values or on latent causes that jointly influence both modality content and modality presence. This is the statistical core of non-ignorability, carried from classical MNAR theory into multimodal learning [2105.12921].

Clinical multimodal datasets make this concrete. In the MIMIC-IV setting used for causal representation learning under MMNAR, structured data are available for \(100\%\) of patients, discharge summaries for \(75.5\%\), radiology reports for \(85.0\%\), at least one text modality for \(89.5\%\), and chest X-rays for \(26.1\%\) [2509.17228]. The paper attributes these highly nonuniform observation rates to clinician-assigned observation patterns, institutional protocols, patient severity, adherence, and resource constraints. A plausible implication is that modality presence itself becomes a proxy variable for latent health state and care process.

The literature also distinguishes direct and indirect relevance to MMNAR. Some methods explicitly treat modality observation patterns as first-class variables in the representation or generative model [2509.17228; 2605.25439]. Others are only adjacent: they are designed for incomplete multimodal prediction and may perform well under simulated “MNAR” settings, but they do not define or estimate a missingness mechanism \(p(R\mid X,Y,\ldots)\) [2601.21950].

## 2. Structural mechanisms behind non-random modality absence

A central structural point is that non-ignorability does not require direct dependence of missingness on the missing variable itself. In hidden Markov models, missingness can be state-dependent:
\[
p(M_t,Y_t\mid S_t)=p(M_t\mid S_t)\,p(Y_t\mid S_t),
\]
so the same latent state \(S_t\) drives both the observation process and the data-generating process [2109.02770]. The paper shows that this is already enough to make missingness non-ignorable. For MMNAR, the direct analogue is a shared latent representation \(Z\) or \(Z_t\) that governs both modality contents and modality-presence indicators. This clarifies a common misconception: a modality can be missing-not-at-random because of shared latent causes, even if no explicit self-dependence on the unseen raw modality is written down.

A second structural regime is the “no self-censoring” model. For multivariate binary outcomes with non-monotone missingness, the No Self-Censoring (NSC) assumption is
\[
M_k \perp Y_k \mid M_{-k},Y_{-k}.
\]
Under NSC, the missingness of component \(k\) may depend on other outcomes and other missingness indicators, including outcomes that are themselves missing, but not on its own value after conditioning on the rest [2302.12894]. The paper proves that, for binary outcomes, NSC and MAR intersect only in MCAR. For MMNAR, this is highly informative because it separates self-dependent modality missingness from cross-modality dependence: a modality may be absent because of the rest of the partially observed system without being self-censored by its own latent content.

A third mechanism is latent-class dependence. In model-based clustering with informative missingness, the MNAR\(_z\) model assumes missingness depends on class membership:
\[
f_k(c_i\mid y_i;\psi_k)=\prod_{j=1}^d \rho(\alpha_k)^{c_{ij}}\big(1-\rho(\alpha_k)\big)^{1-c_{ij}}.
\]
Although \(c_i\) is conditionally independent of \(y_i\) given class \(k\), it remains marginally informative because class membership is latent and tied to the data [2112.10425]. This shows that structured missingness patterns can function as latent-subgroup indicators. In modality terms, systematic absence of an image, note, or lab block may identify clinically distinct subpopulations.

## 3. Modeling paradigms for MMNAR and adjacent MNAR settings

One major paradigm is explicit joint modeling of data and mask. PRDIM writes
\[
p_{\theta,\phi}(X,M)=p_\theta(X)\,p_\phi(M\mid X),
\]
and treats the missing mask as non-ignorable under MNAR [2605.25439]. Its “pattern recognizer” \(D_\phi\) approximates \(p_\phi(M\mid X)\), and the mask model enters both the ELBO and the reverse diffusion updates through a guidance term. This is a direct operationalization of the MMNAR principle that an absence pattern is informative and should constrain imputation or generation.

A related generative perspective appears in GNR, whose abstract states that the complete data and missing mask are treated as “two modalities of incomplete data on an equal footing,” using a “conjunction model” decomposition and concurrent reconstruction of data and mask [2308.08158]. Although the detailed method description is not available in the supplied material, the framing is directly relevant to MMNAR: the availability pattern is modeled as an information-bearing object rather than a passive bookkeeping device.

Another paradigm is pattern-mixture recursion under sparse pattern support. MISPR develops a constructive characterization of the full law by recursively identifying pattern-specific extrapolation densities:
\[
p(X^{(1)}, O, R=r)
=
p(X^{(1)}_{\mathbb{M}(r)} \mid X_{\mathbb{O}(r)}, O, R=r)\,
p(X_{\mathbb{O}(r)} \mid O, R=r)\,
p(O, R=r).
\]
It then uses a pattern DAG to determine which supported patterns can supply the Gibbs factors needed to impute a given unsupported or partially supported pattern [2507.16107]. This is particularly relevant to MMNAR because unsupported combinations of observed and missing modalities are routine in high-dimensional multimodal systems. A plausible implication is that MMNAR handling should be pattern-sensitive rather than based on indiscriminate borrowing across all modality configurations.

A more indirect but practically important line uses classical selection models to derive modified imputation conditionals. In sequential regression multiple imputation under cross-variable MNAR, the ideal conditional takes the form
\[
f(X_j \mid X_{(-j)},R) \propto f(X_j \mid X_{(-j)}) \prod_{k \neq j} f(R_k \mid X_j, X_{(-j)}),
\]
which leads, after approximation, to imputation models containing missingness indicators, interactions, or fixed offsets derived from explicit missingness models [2103.02033]. For MMNAR, this provides a classical rationale for feeding modality-presence indicators into modality-imputation models rather than conditioning only on observed content.

## 4. MMNAR-aware multimodal representation learning

The most explicit multimodal MMNAR framework in the supplied literature is the causal representation learning model for clinical records. For patient \(i\), it defines a modality set \(\mathcal M\), observed modalities \(\mathcal M_i\subseteq\mathcal M\), observed inputs \(\bm x_i^{\text{obs}}\), and a modality indicator vector \(\bm\delta_i=[\delta_i^{(m)}]_{m\in\mathcal M}\) [2509.17228]. The method learns a missingness embedding
\[
\bm z_i=\mathrm{MLP}(\bm\delta_i),
\]
uses it to gate modality embeddings,
\[
e_{i,\mathrm{gate}}^{(m)}=\delta_i^{(m)}\cdot \sigma(W^{(m)}\bm z_i+b^{(m)})\cdot e_i^{(m)},
\]
and then performs attention-based multimodal fusion. The observation pattern is therefore embedded, reconstructed, and used to modulate the contribution of each available modality.

This MMNAR-aware fusion is paired with cross-modal reconstruction and contrastive learning. During training, an observed modality is randomly masked, a partial representation \(\bm h_i^{\setminus m}\) is formed from the remaining modalities, and a decoder reconstructs the held-out modality embedding:
\[
e_{i,\mathrm{rec}}^{(m)}=\phi^{(m)}(\bm h_i^{\setminus m}).
\]
The reconstruction and InfoNCE-style contrastive losses are intended to enforce “semantic sufficiency,” so that the representation captures patient state rather than collapsing into a code for the missingness pattern alone [2509.17228]. This suggests an architectural principle for MMNAR: informative missingness should be modeled, but the learned state should still be able to support cross-modal inference under counterfactual modality configurations.

The same framework adds a rectifier for pattern-specific residual bias. After learning a shared representation \(\bm h_i\), task predictions are decomposed as
\[
y_{i,t}=g_{\psi_t'}(\bm h_i)+\tau_{\bm\delta_i,t}+\varepsilon_{i,t},
\]
where \(\tau_{\bm\delta_i,t}\) is estimated by cross-fitted residual averages within each missingness pattern and used only when its magnitude exceeds a threshold \(\kappa\) [2509.17228]. This is not a formal causal identification result, but it is a direct recognition that even a pattern-aware representation may leave residual bias associated with specific clinician-assigned observation patterns.

An adjacent but distinct strategy is uncertainty-aware fusion. AUM models each unimodal embedding as
\[
p(\mathbf z_i^m\mid \mathbf x_i^m)\sim \mathcal N\!\big(\mu_i^m,(\sigma_i^m)^2\mathbf I\big),
\]
uses uncertainty-aware attention with weights inversely related to aggregated uncertainty, and propagates means and variances through a bipartite patient–modality graph [2601.21950]. Missing modalities are conceptually initialized with high uncertainty and receive negligible attention. The paper is explicit, however, that this is not a causal missingness model; it models predictive uncertainty conditional on observed modalities rather than \(p(R\mid X,Y,\ldots)\). This suggests a useful distinction within the MMNAR literature: mechanism-aware models use missingness patterns as explicit variables, whereas proxy methods attenuate the damage of non-random missingness by downweighting unreliable or effectively absent evidence.

## 5. Testing, sensitivity analysis, and design for MMNAR investigation

Because MNAR and MMNAR are generally not identifiable from the primary incomplete sample alone, several papers focus on diagnosis rather than direct correction. One route is null-only testing. Under a logistic missingness model
\[
P(D=1\mid X=x,Y=y)=\pi(x^\top\beta+\gamma y),
\]
testing MAR versus MNAR reduces to
\[
H_0:\gamma=0 \quad \text{versus} \quad H_a:\gamma\neq 0.
\]
The score tests of Wang, Lu, and Liu require estimation only under the null MAR model, which circumvents the non-identifiability of the full MNAR alternative [2105.12921]. For MMNAR, this suggests testing whether a modality-presence indicator remains associated with a low-dimensional summary of the missing modality after conditioning on observed modalities.

A second route is targeted recovery or follow-up sampling. In the selection-model framework, a deliberately designed recovery sample makes MNAR testable because it reveals the missing value among cases that were initially unobserved [2208.07813]. For logistic missingness models, the paper shows that targeted follow-up changes only the intercept of the augmented missingness model, leaving the coefficients governing dependence on the missing value unchanged. The direct MMNAR analogue is targeted modality reacquisition: reacquiring a missing modality for a strategically chosen subset can support valid tests of whether modality absence depends on its own unseen content.

A third route is sensitivity analysis around restricted MNAR models. Under NSC, self-censoring interactions are excluded, but they can be reintroduced via parameters \(\lambda_{M_kY_k}\), yielding the shifted conditional model
\[
\operatorname{logit}\{\hat p_\lambda(Y_k\mid Y_{-k},M_{-k})\}
=
\operatorname{logit}\{\hat p(Y_k\mid Y_{-k},M_{-k})\}
+
\lambda_{MY}.
\]
These \(\lambda_{M_kY_k}\) are interpreted as conditional log-odds ratios linking missingness to the variable’s own value and serve as sensitivity parameters rather than identified quantities [2302.12894]. For MMNAR, this provides a principled decomposition between cross-modality missingness dependence and self-modality missingness dependence.

Finally, modified chained-equations imputation provides a practical but assumption-driven diagnostic layer. The derivations for SRMI under cross-variable MNAR show why missingness indicators, interactions between missingness indicators and observed covariates, and fixed offsets constructed from missingness models should appear in the imputation regression [2103.02033]. In modality terms, this explains why imputation models that omit the modality mask are misspecified under MMNAR-like cross-modality dependence.

## 6. Empirical evidence, limitations, and unresolved directions

Direct empirical evidence for MMNAR-aware multimodal prediction is strongest in clinical representation learning. On MIMIC-IV, the MMNAR-aware framework achieves AUC \(0.8657\) for 30-day readmission, \(0.9824\) for post-discharge ICU admission, and \(0.9472\) for in-hospital mortality, with reported relative gains of \(8.4\%\), \(13.1\%\), and \(4.7\%\) over the strongest baselines; on eICU it reaches AUC \(0.9294\) for readmission and \(0.9380\) for mortality, with a reported \(13.8\%\) gain for readmission [2509.17228]. The ablations are especially informative: the “+ MMNAR” component alone contributes large improvements before reconstruction and rectification are added, indicating that pattern-aware fusion is not merely a minor auxiliary feature.

Evidence from adjacent work is more qualified. AUM reports improvements of \(2.26\%\) AUC-ROC on MIMIC-IV mortality prediction and \(2.17\%\) on eICU, and it remains robust up to a missing ratio of \(0.3\) under a simulated MNAR scenario while maintaining around \(0.85\) AUC-ROC [2601.21950]. Yet the same paper states that it does not model the missingness process itself. Its relevance to MMNAR is therefore practical rather than formal: heteroscedastic uncertainty and reliability-aware graph aggregation can mitigate some downstream harms of informative missingness without addressing selection bias in the Rubin/Pearl sense.

Generative MNAR methods also show that explicit mask modeling matters outside multimodal fusion proper. PRDIM reports strong MNAR imputation performance across time series, images, and tabular data, with its main mechanism being joint modeling of data and mask via a pattern recognizer [2605.25439]. MISPR is comparable to MICE under MAR, superior and less biased under MNAR, and specifically designed for sparse pattern support, where unsupported combinations of missingness patterns would otherwise force unjustified extrapolation [2507.16107]. These results suggest that MMNAR research should treat the combinatorics of modality patterns as a primary modeling problem rather than a preprocessing nuisance.

The main limitation across the literature is that explicit MMNAR handling remains only partially solved. Direct multimodal MMNAR work is concentrated in clinical prediction and still relies on proxy causal assumptions, pattern embeddings, and post-hoc rectification rather than a fully identified modality-level selection model [2509.17228]. Adjacent uncertainty-aware multimodal fusion improves robustness but leaves the missingness mechanism unmodeled [2601.21950]. Pattern-recursive and MMD-based estimators provide principled robustness or identification templates, but they are developed for classical variable-level settings rather than high-dimensional multimodal encoders and decoders [2507.16107; 2503.00448]. A persistent gap, therefore, is explicit modeling of \(p(R\mid X,Y,\ldots)\) for high-dimensional modality blocks under realistic sparse-support regimes, together with diagnostics and sensitivity analyses that remain valid when modality absence is driven by latent semantics, acquisition policy, and institutional workflow rather than by random dropout alone.

Source: https://www.emergentmind.com/topics/modality-missing-not-at-random-mmnar