---
title: Nonresponse Instrument in Survey Research
url: https://www.emergentmind.com/topics/nonresponse-instrument
type: topic
---

# Nonresponse Instrument in Survey Research

Nonresponse instrument denotes a family of methodological devices used to address unit or item nonresponse, especially when missingness is nonignorable. In the literature represented here, the term covers several distinct objects: an internally generated latent proxy for response propensity, a shadow variable or instrumental variable used to identify missing-not-at-random models through exclusion restrictions, and broader operational tools for weighting, calibration, follow-up design, or robustness assessment. The term is therefore not synonymous with a single estimation strategy, and some papers are explicit that what they construct is not an instrumental variable in the econometric sense [1207.4385, 2509.14520].

## 1. Scope, terminology, and conceptual boundaries

Survey sampling conventionally distinguishes **unit nonresponse** from **item nonresponse**. With finite population \(U=\{1,\dots,N\}\), sample \(s\subset U\), and respondent set \(r\subseteq s\), unit response is represented by
\[
R_k=
\begin{cases}
1,& k\in r,\\
0,& k\in \bar r=s\setminus r.
\end{cases}
\]
For a study variable \(y_j\), item response among respondents is represented by
\[
r_j=\{k \text{ answers } y_j \mid k\in r\}.
\]
One paper emphasizes the bridge between the two by quoting the view that unit nonresponse is “just an extreme form of item nonresponse” [1207.4385].

Across the literature, a nonresponse instrument may mean different things. In one line of work, it is a **latent adjustment variable** inferred from within-survey item-response indicators and inserted into a response-propensity model. In another, it is a **shadow variable** \(Z\) in a decomposition \(X=(U,Z)\), where \(Z\) is excluded from the nonresponse propensity but remains informative about \(Y\). In a third, it is an **instrumental variable** that predicts response but is excluded from the outcome model. A separate econometric usage concerns individuals who do not respond to an instrument in treatment selection; that object belongs to the marginal treatment effect literature and is conceptually different from survey nonresponse instruments [2509.12557, 2311.08691, 2204.10445].

The common motivation is bias. If the response probability of unit \(k\) is
\[
p_k=P(R_k=1\mid k\in s),
\]
nonresponse bias depends on the association between \(y_{kj}\) and \(p_k\). Under NMAR, that association arises because the outcome itself, or latent factors tied to it, affects participation [1207.4385].

## 2. Internal-survey latent proxies for response propensity

A prominent survey-sampling interpretation of nonresponse instrument is an internally constructed latent proxy for willingness to respond. In this formulation, the latent variable \(\theta_k\) is interpreted as the unit’s “will to respond to the survey” or “tendency to respond,” inferred from binary item-response indicators
\[
x_{k\ell}=
\begin{cases}
1,& \text{unit }k\text{ answers item }\ell,\\
0,& \text{otherwise},
\end{cases}
\qquad \ell=1,\dots,m.
\]
The corresponding vector is
\[
\mathbf x_k=(x_{k1},\dots,x_{km})'.
\]
The paper assumes that \(\mathbf x_k\) are manifestations of a single latent continuous trait \(\theta_k\), estimated by a latent trait model, specifically the two-parameter logistic model
\[
q_{k\ell}=P(x_{k\ell}=1\mid \theta_k,R_k=1)
=\frac{1}{1+\exp\bigl(-(\beta_{\ell0}+\beta_{\ell1}\theta_k)\bigr)}.
\]
The Rasch model is the special case with common discrimination. The framework relies on three standard assumptions: conditional independence,
\[
P(\mathbf x_k\mid \theta_k)=\prod_{\ell=1}^m P(x_{k\ell}\mid \theta_k),
\]
monotonicity, and unidimensionality [1207.4385].

Estimation proceeds by marginal maximum likelihood, typically under \(\theta_k\sim N(0,1)\), followed by empirical Bayes estimation of \(\theta_k\). A practically distinctive step concerns unit nonrespondents, who have no observed item responses. The proposed solution sets
\[
x_{k\ell}=0,\qquad \forall \ell=1,\dots,m,
\]
adds a single phantom respondent \(\widetilde k\) with the all-zero response pattern, estimates the latent trait model on \(\widetilde r=r\cup\{\widetilde k\}\), computes \(\widehat\theta_{\widetilde k}\), and assigns
\[
\widehat\theta_k=\widehat\theta_{\widetilde k},\qquad \forall k\in\bar r.
\]
This is the paper’s key construction of an internal nonresponse proxy [1207.4385].

Once \(\widehat\theta_k\) is available, unit response propensity is modeled by
\[
p_k=P(R_k=1\mid \widehat\theta_k)
=\frac{1}{1+\exp\bigl(-(\alpha_0+\alpha_1\widehat\theta_k)\bigr)},
\qquad k\in s,
\]
and item response probabilities \(\widehat q_{kj}\) are estimated from the latent trait model. The resulting estimator for the total of variable \(y_j\) is
\[
\widehat Y_{j,pq}=\sum_{k\in r_j}\frac{y_{kj}}{\pi_k\widehat p_k\widehat q_{kj}}.
\]
The paper is explicit that this is **not** an instrumental-variable strategy in the exclusion-restriction sense: the latent score is intended to be related to the variable of interest, because that relationship is what makes it useful for reducing nonresponse bias [1207.4385].

The simulation evidence is substantial. In a binary-outcome setting based on British Social Attitudes abortion items, the naive estimator had around \(-56\%\) relative bias, while the proposed estimator reduced that to around \(8\%-9\%\). In a second simulation with six continuous variables, the naive estimator had roughly \(41\%\) to \(58\%\) relative bias, while the proposed estimator reduced this to roughly \(-9\%\) to \(-11\%\). The paper also reports Cronbach’s alpha, two-way and three-way margin residuals \((O-E)^2/E\), point-measure correlations, and discussion of PCA of residuals for unidimensionality, because if the selected items do not load on a common response-propensity dimension, \(\widehat\theta_k\) is unlikely to work as an adjustment proxy [1207.4385].

## 3. Shadow variables excluded from the nonresponse propensity

A second and influential meaning of nonresponse instrument is the **shadow variable**. Here the covariates are partitioned as
\[
X=(U,Z),
\]
and \(Z\) is a nonresponse instrument if it satisfies
\[
P(R=1\mid Y,X)=P(R=1\mid Y,U),
\]
while
\[
p(Y\mid X)=p(Y\mid U,Z)\ \text{depends on } Z.
\]
Thus \(Z\) is excluded from the nonresponse mechanism once \(Y\) and \(U\) are conditioned on, but remains useful for the outcome model. The literature is explicit that this differs from an ordinary covariate, which may enter both \(p(Y\mid X)\) and \(P(R=1\mid Y,X)\) [2509.12557, 2509.14520].

Within this framework, one semiparametric path specifies a parametric data model \(p(Y\mid U,Z;\theta)\) and leaves the propensity nonparametric. The key identity is
\[
p(Z\mid Y,U,R=1)=p(Z\mid Y,U)
=\frac{p(Y\mid U,Z;\theta)p(U,Z)}
{\int p(Y\mid U,z;\theta)p(U,z)\,dz},
\]
which yields a respondent-based pseudo-likelihood. A second path specifies a parametric or semiparametric propensity model and leaves \(p(Y\mid U,Z)\) nonparametric. In the review, examples include
\[
P(R=1\mid Y,U)=\Psi(\alpha+\beta U+\gamma Y)
\]
and the exponential tilting model
\[
P(R=1\mid Y,U)=\left[1+\exp\{h(U)+\gamma Y\}\right]^{-1}.
\]
The review also summarizes a doubly robust framework in which consistency for \(E(Y)\) requires a correct log-odds ratio model and one of two nuisance models [2509.14520].

Because the shadow variable is often not known in advance, one paper studies instrument, variable, and model selection under nonignorable nonresponse. For a candidate \(Z_k\), it compares two estimators of
\[
F_1(z)=P(Z\le z\mid R=1)
\]
through the validation criterion
\[
\mathrm{VC}(k)=\frac{1}{N}\sum_{i=1}^N
\left|\widehat F_{1k}(z_{ki})-\widehat F_1(z_{ki})\right|.
\]
The selected set is then refined by nonparametric variable selection using
\[
R e^Y \perp X\mid X_C,\qquad X_C=X_A\cup X_B,\qquad Z_*=X_C\cap Z_S.
\]
Under regularity conditions, the paper states
\[
P(\widehat Z_*=Z_*)\to 1,\qquad
P(\widehat X_*=X_*)\to 1,\qquad
P(\widehat M_*=\text{most compact correct model})\to 1,
\]
and the final pseudo-likelihood estimator of \(\theta\) is consistent and asymptotically normal [2509.12557].

Categorical shadow variables create a separate identification problem because completeness can fail even in simple models. One paper therefore replaces completeness with a verifiable sufficient condition based on the respondents’ outcome model. Under
\[
P(\delta=1\mid y,\bm x;\bm\phi)
=P(\delta=1\mid y,\bm u;\bm\phi)
=\Psi\{h(\bm u;\bm\alpha)+g(\bm u;\bm\beta)m(y)\},
\]
and the requirement that for each \(\bm u\) there exist \(\bm z_1,\bm z_2\) such that
\[
\frac{p(y\mid \bm u,\bm z_1,\delta=1)}
{p(y\mid \bm u,\bm z_2,\delta=1)}
\text{ is monotone in } y,
\]
the parameter \((\bm\phi^\top,\bm\gamma^\top)^\top\) is identifiable. In the fully categorical case, the paper shows that completeness is necessary and sufficient for identifiability [2304.02270].

## 4. Response-predicting instruments excluded from the outcome model

A distinct IV tradition defines the nonresponse instrument in the opposite way: \(Z\) affects response behavior but is excluded from the outcome model. In this line, the full data are
\[
W=(Y,Z,U),
\]
the observed data are
\[
O=(R,RY,X),\qquad X=(Z,U),
\]
and the target is the population mean
\[
\mu_0=E(Y).
\]
The central IV conditions are
\[
Z\not\!\perp\!\!\!\perp R\mid U
\quad\text{and}\quad
Z\perp Y\mid U.
\]
To encode nonignorability, the response mechanism is parameterized through an extended propensity score
\[
\pi(w;\eta,\gamma)=\operatorname{expit}\{\eta(x)+h(y,x;\gamma)\},
\]
where
\[
h(y,x)=\log\left\{
\frac{p(R=1\mid y,x)/p(R=0\mid y,x)}
{p(R=1\mid Y=0,x)/p(R=0\mid Y=0,x)}
\right\}.
\]
Under the preferred factorization,
\[
p(w;\psi,\beta,\zeta)=p(y\mid u;\psi)\,p(z\mid u;\beta)\,p(u;\zeta),
\]
the nuisance components \(p(y\mid u;\psi)\) and \(p(z\mid u;\beta)\) are variation independent. The resulting estimator is doubly robust in the paper’s specific sense: consistency holds if \(\eta(x;\xi)\) is correct and either \(p(z\mid u;\beta)\) or \(p(y\mid u;\psi)\) is correct [2311.08691].

The empirical illustration uses HIV testing refusal in Mochudi, Botswana, with interviewer experience as the instrumental variable. The complete-case estimate of HIV prevalence is \(0.214\) \((0.202,0.227)\), the MAR/IPW estimate is \(0.213\) \((0.200,0.225)\), and the proposed estimator is \(0.283\) \((0.119,0.447)\). The estimated selection-bias parameter is
\[
\tilde\gamma=-1.854,\quad 95\%\,\text{CI }(-5.984,2.277),
\]
suggesting that HIV-positive individuals may have been less likely to participate in testing, though the estimate is not statistically significant [2311.08691].

A more recent formulation introduces a **multiplicative instrumental variable model** for MNAR outcomes. The observed data are
\[
O=(X,RY,R,Z),
\]
with target functional \(\psi_0\) defined through
\[
0=E[h(Y;\psi_0)].
\]
The missing-case quantity is
\[
\beta=E[h(Y;\psi_0)\mid R=0].
\]
The assumptions are
\[
Y \perp (Z,R)\mid (U,X),\qquad
U \perp Z \mid X,
\]
and the multiplicative selection model
\[
P(R=0\mid Z,U,X)=\exp\{\alpha_z(Z,X)+\alpha_u(U,X)\},
\]
with \(\alpha_z(z,x)\neq \alpha_z(z',x)\) for \(z\neq z'\). For binary \(Z\), the identification formula is a single-arm Wald ratio:
\[
\delta(X)=\frac{\delta^Y(X)}{\delta^R(X)},
\qquad
\beta=E_{X\mid R=0}[\delta(X)\mid R=0],
\]
where
\[
\delta^R(X)=\pi_1(X)-\pi_0(X),\qquad
\delta^Y(X)=\mu_1(X)-\mu_0(X).
\]
The paper states that under the assumptions, any regular statistical functional of the missing outcome is nonparametrically identified, and it develops semiparametric multiply robust IV estimators [2509.22499].

## 5. Model-assisted, calibration, and benchmark-based instruments

In a broader survey-methodological sense, nonresponse instrument can denote a practical inferential device that combines response weighting with prediction or calibration rather than an exclusion-restriction variable. One paper studies model-assisted estimators under MAR by treating nonresponse as a second phase of sampling. With a working model
\[
\xi:\ y_k=m(x_k)+\varepsilon_k,
\]
the practical estimator is
\[
\widehat{t}_{m_r,\widehat p}
=
\sum_{k\in U} m_r(x_k)+\sum_{k\in s_r}\frac{y_k-m_r(x_k)}{\pi_k \widehat p_k},
\]
which reduces to the standard nonresponse-adjusted Horvitz–Thompson estimator
\[
\widehat t_{NWA}=\sum_{k\in s_r}\frac{y_k}{\pi_k\widehat p_k}
\]
when the prediction term is dropped. Response probabilities are mainly estimated by calibration through
\[
Q(\alpha)=\sum_{k\in U} x_k-\sum_{k\in s_r}\frac{x_k}{\pi_k}F(x_k^\top \alpha)=0.
\]
In the GREG case, calibration forces the auxiliary-total discrepancy term to vanish, so the troublesome remainder disappears asymptotically [2208.04621].

The simulation hierarchy is explicit. When both the response model and the working model fit well, the proposed estimator and \(\widehat t_{NWA}\) have bias near zero, but the proposed estimator can attain very small standard deviations; in scenario 1 with GREG, \(RB<0.001\) and \(RSd=0.003\), versus \(RSd=0.019\) for HT and \(0.039\) for imputation. When the response model is wrong but the working model is good, the proposed estimator remains best among feasible estimators; with GREG in scenario 2 it still has \(RB<0.001\) and \(RSd=0.003\), while NWA has \(RB=0.057\) and \(RSd=0.080\) [2208.04621].

External benchmarks can play a closely related role. In multiple imputation for voter turnout, known voter turnout totals and demographic margins are incorporated directly into the missing-data model. The paper defines a hybrid MD-AM model comprising a pattern-mixture model for unit nonresponse and selection models for item nonresponse. In the North Carolina CPS application, the known turnout rate is about \(0.49\), and the intercept matching algorithm draws
\[
\hat T_V^{(t+1)} \sim N(T_V,V_V)
\]
and adjusts the unit-nonresponse effect on voting so that the imputed completed-data total matches the benchmark. The paper is explicit that these margins are not instruments in the classical IV sense; they are calibration targets and identification restrictions embedded in the imputation mechanism. The final estimated overall turnout is about \(0.50\), close to the auxiliary target by construction [2209.05220].

## 6. Sensitivity analysis, follow-up design, and non-instrument alternatives

When no credible nonresponse instrument is available, several papers replace point identification with sensitivity analysis or decision-theoretic tools. One approach concerns whether to stop or continue data collection under possibly nonignorable unit nonresponse for multivariate continuous variables. The method fits a finite mixture of multivariate normal distributions to respondents,
\[
\mathbf y_i \mid z_i,\boldsymbol\mu,\boldsymbol\Sigma \sim N(\boldsymbol\mu_{z_i}, \boldsymbol\Sigma_{z_i}),
\qquad
z_i\mid \boldsymbol\pi\sim \text{Multinomial}(\pi_1,\dots,\pi_K),
\]
and then generates nonrespondent imputations by replacing \(\boldsymbol\pi^m\) with scenario-specific \(\boldsymbol\pi^*\). Follow-up sample sizes are compared using utility measures
\[
\theta_\delta^{(s)},\qquad \tau_\delta^{(s)},\qquad \rho_\delta^{(s)},
\]
and a cost function
\[
C_f^{(s,j)} = C_0^{(s,j)} + \sum_{i \in \mathbf Y_f^{s,j}} c_i^{(s,j)}.
\]
In the Census of Manufactures application, moving from no follow-up to following up on \(25\%\) or \(50\%\) of nonrespondents sharply reduces the error measures, while gains beyond about \(50\%\) appear limited relative to added cost [1511.02189].

Another line develops **worst-case resistance testing** as a nonresponse-bias diagnostic. WCRT asks how many nonrespondents, with what effect size, would be needed to reverse a study’s conclusion. For correlations, it constructs “n-curves” plotting the required nonresponse count against the assumed nonresponse effect size. In the empirical example, the observed correlation between shopping experience and satisfaction is about \(r=0.94\); at \(\alpha=0.05\), it would take \(5670\) nonrespondents if \(r_2=-0.1\), \(1175\) if \(r_2=-0.5\), and \(454\) if \(r_2=-0.9\) to negate significance. For the weaker correlation between intentions and enjoyment, about \(r=0.24\), the corresponding numbers are \(427\), \(103\), and \(43\). The paper is explicit that WCRT is not a questionnaire or psychometric scale, but a statistical diagnostic / sensitivity-analysis tool [2301.08377].

A more general alternative dispenses with instruments altogether and treats nonresponse as a partial-identification problem. In panel-data stochastic-dominance testing, the observed data are \((Y_i^A,Y_i^B,Z_i^A,Z_i^B)\) with monotone baseline nonresponse, and inference is based on sharp upper and lower bounds for dominance functionals. The test uses pseudo-empirical likelihood and a design-effect-adjusted likelihood-ratio statistic compared to a \(\chi^2_1\) critical value. The paper is explicit that it does not offer a classical instrumental variable for nonresponse; instead, it provides an assumption-indexed bounding and testing device for settings in which no credible exclusion variable exists [2406.15702].

The cumulative literature therefore supports a precise terminological conclusion. In one usage, a nonresponse instrument is a latent internal proxy for willingness to respond; in another, it is a shadow variable excluded from the nonresponse mechanism but informative for the outcome; in another, it is a response-predicting instrumental variable excluded from the outcome model; and in broader survey practice it may refer to a methodological instrument for weighting, calibration, follow-up design, or robustness assessment. Treating these objects as interchangeable obscures the identifying assumptions that each requires [1207.4385, 2509.14520, 2311.08691, 1511.02189].

Source: https://www.emergentmind.com/topics/nonresponse-instrument