---
title: 'Deming Regression: Methods, Extensions, and Robustness'
url: https://www.emergentmind.com/topics/deming-regression
type: topic
---

# Deming Regression: Methods, Extensions, and Robustness

Searching arXiv for recent and foundational papers on Deming regression and its extensions.
Deming regression is a linear errors-in-variables method for estimating the relationship between two variables when both are measured with error. In its classical form, it posits latent “true” values linked by a linear model and observed through additive noise, with inference governed by a known error-variance ratio. Relative to ordinary least squares, which assumes the predictor is measured without error, Deming regression symmetrically allocates uncertainty to both axes and thereby addresses attenuation bias in slope estimation. Recent work has extended this classical formulation in several directions, including generalized heteroscedastic weighting, two-stage uncertainty propagation for estimated or privacy-perturbed variables, multivariate reduction via the Frisch–Waugh–Lovell theorem, bootstrap-based inference, precision-profile weighting for method comparison, and robustified Deming-type procedures for contaminated data [2405.20992], [2411.07836], [2508.02888], [2105.04628].

## 1. Classical formulation and estimator

In the classical univariate setup, one observes pairs $(x_i,y_i)$, or equivalently $(X_t,Y_t)$ in time-indexed notation, that are noisy versions of latent variables obeying a linear relation such as
$$
Y_i = \beta_0 + \beta_1 X_i
$$
or
$$
Y_t^* = \alpha + \beta X_t^* + \varepsilon_t.
$$
The measurement model is additive:
$$
x_i = X_i + \varepsilon_i,\qquad y_i = Y_i + \delta_i,
$$
or, in alternative notation,
$$
X_t = X_t^* + u_t,\qquad Y_t = Y_t^* + v_t.
$$
Across the cited treatments, the standard assumptions are zero-mean Gaussian measurement errors, independence across observations, independence between the $x$- and $y$-side errors, and independence from the latent true variables [2405.20992], [2411.07836], [2508.02888].

The key structural quantity is the ratio of error variances. One notation is
$$
\lambda = \frac{\operatorname{Var}(\varepsilon)}{\operatorname{Var}(\delta)} = \frac{\sigma_x^2}{\sigma_y^2},
$$
while another paper uses
$$
\delta = \frac{\sigma_G^2}{\sigma_E^2}.
$$
These are reciprocal conventions for the same role: a known or analyst-fixed relative weighting of error contributions in the two variables [2405.20992], [2411.07836].

Classical Deming regression is obtained by minimizing a weighted orthogonal sum of squares. One formulation is
$$
SS = \sum_{i=1}^{N}\left[(x_i - X_i)^2 + \lambda (y_i - Y_i)^2\right].
$$
Under the linear relation and normality assumptions, this yields closed-form slope and intercept estimators. Using centered sums
$$
u = \sum_{i=1}^{N}(x_i - \bar{x})^2,\quad
q = \sum_{i=1}^{N}(y_i - \bar{y})^2,\quad
p = \sum_{i=1}^{N}(x_i - \bar{x})(y_i - \bar{y}),
$$
one paper gives
$$
\hat{\beta}_1 =
\frac{(\lambda q - u) + \sqrt{(u - \lambda q)^2 + 4\lambda p^2}}{2\lambda p},
\qquad
\hat{\beta}_0 = \bar{y} - \hat{\beta}_1\bar{x}
$$
[2405.20992]. In a centered vector notation for the slope alone,
$$
\hat{\alpha}_{\text{Deming}} =
\frac{G^\top G - \delta E^\top E
+\sqrt{(G^\top G - \delta E^\top E)^2 + 4\delta(E^\top G)^2}}
{2\,E^\top G},
$$
with the intercept recovered after centering [2411.07836]. A homoscedastic method-comparison formulation writes the slope as
$$
\hat\beta =
\frac{ S_{yy} - \lambda S_{xx} + \sqrt{(S_{yy} - \lambda S_{xx})^2 + 4\lambda S_{xy}^2} }{ 2 S_{xy} },
$$
again with $\hat\alpha = \bar y - \hat\beta \bar x$ [2508.02888].

A geometric interpretation follows directly from the criterion: the fitted line minimizes weighted perpendicular departures rather than vertical departures. This is why Deming regression is frequently described as generalized orthogonal regression, with ordinary orthogonal regression recovered when the measurement variances are equal [2405.20992], [2508.02888].

## 2. Relationship to ordinary least squares and attenuation

The central contrast with ordinary least squares is the error model. OLS assumes that the predictor is measured without error and all uncertainty lies in the response. Deming regression instead treats both axes as noisy. In one exposition, OLS regression of $Y$ on $X$ corresponds to the limiting case $\sigma_x^2=0$, or $\lambda=\infty$, while orthogonal regression corresponds to $\lambda=1$ [2405.20992]. Another exposition states that for $\lambda=0$ one recovers standard OLS with error only in $Y$, reflecting the alternative ratio convention [2411.07836]. These statements are consistent once the differing definitions of the variance ratio are taken into account.

When the regressor is measured with classical error, OLS exhibits attenuation bias. One paper derives the large-sample limit
$$
\hat{\alpha} \xrightarrow[]{p}
\alpha \times
\frac{\mathbb{E}[E_t^{*2}]}{\mathbb{E}[E_t^{*2}] + \sigma_\eta^2},
$$
which is strictly smaller in magnitude than the true slope when $\sigma_\eta^2>0$ [2411.07836]. Another paper describes the same phenomenon as “attenuation bias” and “regression dilution,” emphasizing that ignoring predictor error biases the estimated slope towards $0$ [2405.20992].

The empirical implications are emphasized in multiple application domains. In the atrial fibrillation risk-association study, a weighted least squares fit yielded a clearly smaller slope magnitude than the Deming fit, underestimating the strength of association between stroke and bleeding risk [2405.20992]. In the airborne-fraction application, ordinary least squares estimates are reported as slightly lower than Deming estimates for plausible values of the variance ratio, and OLS estimates often lie outside Deming bootstrap confidence intervals for certain values of $\delta$ [2411.07836]. This suggests that Deming’s correction is materially relevant whenever regressor-side noise is not negligible, although the extent of correction depends on the assumed variance ratio.

A common misconception is that any linear regression treating both variables symmetrically is interchangeable with Deming regression. The cited papers distinguish total least squares or orthogonal regression as the special equal-variance case, not the general one [2411.07836], [2508.02888]. Another misconception is that weighting only by response-side variance suffices under heteroscedasticity; the generalized formulations below are motivated precisely by the inadequacy of such asymmetric weighting.

## 3. Generalized and heteroscedastic Deming regression

Many practical settings violate the homoscedastic assumption. If observation-specific error variances are known or estimated,
$$
u_i = \operatorname{Var}(\varepsilon_i),\qquad
v_i = \operatorname{Var}(\delta_i),
$$
then the generalized Deming objective becomes
$$
\chi^{2} = \sum_{i=1}^{N}\left[ \frac{(x_{i} - X_{i})^2}{u_i} + \frac{(y_{i} - Y_{i})^2}{v_i} \right].
$$
A weighted iterative solution is then required because the weights depend on the unknown slope [2405.20992]. One formulation uses
$$
w_i = \left[v_i + (\hat{\beta}_1)^2 u_i\right]^{-1},
$$
weighted means $(\bar x_w,\bar y_w)$, centered variables $(x_i',y_i')$, and
$$
z_i = w_i (v_i x_i' + \hat{\beta}_1 u_i y_i'),
$$
leading to
$$
\hat{\beta}_{1} = \frac{\sum_{i=1}^{n} w_i z_i y_i'}{\sum_{i=1}^{n} w_i z_i x_i'},
\qquad
\hat{\beta}_0 = \bar{y}_w - \hat{\beta}_1 \bar{x}_w.
$$
Because $w_i$ depends on $\hat\beta_1$, analytic closed forms give way to iterative updating [2405.20992].

A more fully likelihood-based heteroscedastic formulation appears in precision-profile-weighted Deming regression for method comparison. There, paired measurements $(X_i,Y_i)$ are linked through a latent concentration $\mu_i$ with method-specific variance functions
$$
X_i \sim N\{\mu_i, g(\mu_i)\},
\qquad
Y_i \sim N\{\alpha + \beta \mu_i,\; h(\alpha + \beta \mu_i)\}.
$$
The negative log-likelihood is
$$
L(\alpha,\beta,\mu_1,\dots,\mu_n) = \sum_{i=1}^n \left[ \frac{(X_i - \mu_i)^2}{g_i} + \frac{(Y_i - \alpha - \beta \mu_i)^2}{h_i} + \log g_i + \log h_i \right],
$$
where $g_i=g(\mu_i)$ and $h_i=h(\alpha+\beta\mu_i)$ [2508.02888]. This reduces to classical Deming when $g_i$ and $h_i$ are constant. It also yields a conditional maximum-likelihood estimate of the latent value,
$$
\hat\mu_i = \frac{h_i X_i + g_i \beta\,(Y_i - \alpha)}{h_i + g_i \beta^2},
$$
which is the heteroscedastic analogue of projecting each point onto the fitted line [2508.02888].

The precision-profile framework explicitly models nonconstant variance through variance-as-a-function-of-level. The cited paper lists three functional forms: constant variance,
$$
g(\mu)=\sigma^2,
$$
constant coefficient of variation,
$$
g(\mu)=(K\mu)^2,
$$
and the Rocke–Lorenzato model,
$$
g(\mu)=\sigma^2+(K\mu)^2.
$$
An analogous function $h$ is used for the second method [2508.02888]. The paper argues that ignoring such heteroscedasticity wastes information and may induce bias if a single constant variance ratio is imposed where the effective ratio varies with level.

This body of work suggests a broad interpretation of generalized Deming regression: it is not merely classical Deming with unequal weights, but a family of errors-in-variables estimators in which the contribution of each observation is determined by known, estimated, or modeled precision structures.

## 4. Two-stage frameworks and uncertainty propagation

A 2024 development recasts Deming regression as the second stage of a broader pipeline for variables that are themselves estimated quantities rather than direct noiseless covariates [2405.20992]. The motivating examples include predicted clinical risks, direct measurements with known standard deviations, and privacy-perturbed data.

In stage 1, one obtains paired values together with error variances. For each unit, the framework requires observed or estimated values $(z_i,w_i)$ and associated error variances $(\sigma^2_{zi},\sigma^2_{wi})$. The paper describes two principal routes: prediction models, such as logistic or multinomial logistic regression producing point predictions and standard errors of prediction; and direct measurements or privacy mechanisms with known induced noise variance [2405.20992].

In stage 2, transformations may be applied to obtain approximate linearity. With monotone transforms
$$
x_i=f_1(z_i),\qquad y_i=f_2(w_i),
$$
the transformed variances are propagated by the delta method:
$$
\sigma^2_{xi}\approx \bigl(f_1'(z_i)\bigr)^2 \sigma^2_{zi},
$$
and analogously for $y_i$ [2405.20992]. This supports Deming regression on transformed quantities even when the original variables are probabilities or otherwise bounded.

The same paper formalizes three uncertainty scenarios. In Scenario A, stage-1 variances are ignored and simple Deming regression is applied directly. In Scenario B, all uncertainty is assumed captured by known heteroscedastic variances, leading to generalized Deming least squares. In Scenario C, known stage-1 variances are combined with an additional unknown variance component through a maximum-likelihood model:
$$
x_i = X_i + e_{xi} + \varepsilon_i,\qquad
y_i = Y_i + e_{yi} + \delta_i,
$$
with known per-observation variances for $(e_{xi},e_{yi})$ and extra constant-variance components $(\varepsilon_i,\delta_i)$ scaled by a known ratio [2405.20992].

To choose among these scenarios, the paper proposes the heuristic
$$
r =
\frac{\overline{\sqrt{\sigma^2_{yi}}}}{\sigma_e},
$$
where $\overline{\sqrt{\sigma^2_{yi}}}$ is the mean of known or estimated standard deviations on the transformed response scale and $\sigma_e$ is the residual standard deviation from a Scenario B Deming fit. The proposed interpretation is: $r\approx 0$ suggests Scenario A, $r\approx 1$ or larger suggests Scenario B, and intermediate values suggest Scenario C [2405.20992].

The two-stage viewpoint broadens the scope of Deming regression from direct method-comparison settings to downstream association analysis after an upstream modeling or perturbation process. A plausible implication is that Deming regression can function as an uncertainty-propagating meta-regression tool whenever upstream procedures produce per-observation standard errors.

## 5. Multivariate extensions, bootstrap inference, and prediction

A notable 2024 contribution shows how multivariate Deming regression can be reduced to the univariate case using the Frisch–Waugh–Lovell theorem [2411.07836]. In the extended airborne-fraction model,
$$
G_t = \alpha E_t + \gamma_1\,ENSO_t + \gamma_2\,VAI_t + u_t,
$$
the additional regressors are collected in $W_t=[ENSO_t,\ VAI_t]$. Defining
$$
P_W = W (W^\top W)^{-1} W^\top,\qquad M_W = I - P_W,
$$
one forms residualized variables
$$
\tilde{G}=M_W G,\qquad \tilde{E}=M_W E.
$$
The paper states that estimating the multivariate Deming model is equivalent to applying univariate Deming regression to $(\tilde G,\tilde E)$ with the same variance ratio [2411.07836]. This provides a practically implementable route to multivariate Deming when the auxiliary regressors are treated as measured without error.

Inference remains nontrivial because the Deming estimator is nonlinear in sample moments and often involves latent variables or iterative weights. Several cited works therefore rely on resampling. The airborne-fraction paper proposes a model-based residual bootstrap: fit Deming, compute centered residuals, resample them, generate pseudo-responses, refit Deming on each bootstrap sample, and use the resulting empirical distribution for standard errors and percentile confidence intervals [2411.07836]. The two-stage clinical-risk paper uses bootstrap to estimate the covariance matrix of $(\hat\beta_0,\hat\beta_1,\hat\sigma^2)$ in its maximum-likelihood Scenario C and reports bootstrap-based confidence intervals more generally [2405.20992]. The precision-profile paper uses jackknife resampling for standard errors and covariance of $(\hat\alpha,\hat\beta)$ [2508.02888].

Prediction under measurement error is also addressed explicitly. For a new transformed input $x_{\text{new}}$, one paper writes
$$
y_{\text{new}} = \hat{\beta}_0 + \hat{\beta}_1 x_{\text{new}} + e_y
= \hat{\boldsymbol{\beta}}^\top X_{\text{new}} + e_y,
$$
with $X_{\text{new}}=(1,x_{\text{new}})^\top$, and derives
$$
\operatorname{Var}(y_{\text{new}})
=
X_{\text{new}}^\top \operatorname{Cov}(\hat{\boldsymbol{\beta}}) X_{\text{new}}
+ (\hat{\beta}_1^2 + \operatorname{Var}(\hat{\beta}_1))\operatorname{Var}(x_{\text{new}})
+ \operatorname{Var}(e_y).
$$
A $(1-\alpha)100\%$ prediction interval on the transformed scale is then
$$
\hat{y}_{\text{new}}
\pm
t_{1-\alpha/2,n-2}\sqrt{\operatorname{Var}(y_{\text{new}})}
$$
[2405.20992]. This formula differs from standard WLS prediction by retaining uncertainty in the new $x$ value rather than assuming it error-free.

Taken together, these contributions indicate that recent Deming literature is not limited to point estimation. It increasingly treats inference, prediction, and multivariate adjustment as first-class components of the methodology.

## 6. Applications and substantive interpretations

The cited papers anchor Deming regression in several domains. In clinical risk association for atrial fibrillation patients, the two-stage framework was applied to 58,088 patients with first AF admission in New Jersey, aggregated into 1,749 distinct patient groups defined by combinations of 11 categorical or dummy predictors [2405.20992]. A multinomial logistic regression produced predicted probabilities and standard errors for stroke-only, bleeding-only, both, or neither. These were aggregated into stroke and bleeding risks with associated prediction variances, transformed to incidences per 10,000, and log-transformed for approximate linearity. The scenario-selection heuristic yielded $r\approx 0.9536$, leading to Scenario B: generalized Deming with known per-observation variances [2405.20992].

On the log–log scale, the fitted Deming relation was
$$
\log(\text{stroke incidence}) = \beta_0 + \beta_1 \log(\text{bleeding incidence}),
$$
with estimates
$$
\hat{\beta}_1 = 1.681,\qquad \hat{\beta}_0 = -4.017,
$$
and 95% confidence intervals $(1.385,1.976)$ and $(-5.369,-2.665)$, respectively [2405.20992]. The weighted least squares comparator, which ignored predictor error and stage-1 variances, produced a smaller slope $\hat{\beta}_1=1.355$ and much poorer bootstrap coverage. The paper interprets $\hat\beta_1\approx 1.68$ as a super-linear relationship between bleeding-risk groups and stroke-risk groups [2405.20992].

In climate science, Deming regression was used to estimate the carbon dioxide airborne fraction. The simple specification
$$
G_t=\alpha E_t+u_t
$$
and the extended specification
$$
G_t = \alpha E_t + \gamma_1\,ENSO_t + \gamma_2\,VAI_t + u_t
$$
were both studied under measurement error in emissions [2411.07836]. Instrumental-variable estimates were reported as 44.8% $(\pm 1.4\%; 1\sigma)$ for the simple specification and 47.3% $(\pm 1.1\%; 1\sigma)$ for the extended specification [2411.07836]. Deming slopes varied across $\delta\in\{0.2,0.5,1,2,5\}$, illustrating sensitivity to the assumed variance ratio. The paper emphasizes that OLS and IV estimates were not statistically different in that dataset, whereas Deming serves partly as a sensitivity analysis when $\delta$ is not known [2411.07836].

In method comparison for assays, precision-profile-weighted Deming regression was applied to vitamin D measurements and to a CLSI EP09 example. For the vitamin D data, external precision profiles
$$
g(u)=3.792\times10^{-16}+0.0691\,u^{1.27},
\qquad
h(u)=0.06106+7.019\times10^{-5}u^{2.18}
$$
were used in a weighted Deming fit, yielding
$$
\hat\alpha=-3.955,\qquad \hat\beta=1.105
$$
with standard errors $0.605$ and $0.024$ [2508.02888]. For the EP09 dataset, the fitted RL precision-profile model yielded
$$
\hat\alpha=-0.129,\qquad \hat\beta=1.030
$$
with narrower confidence intervals than Passing–Bablok, which the paper interprets as consistent with higher efficiency of maximum likelihood under its parametric assumptions [2508.02888].

These applications show that Deming regression supports quite different inferential goals: estimating a latent trade-off between competing clinical risks, correcting emissions-response relationships for measurement error, and calibrating one assay against another under concentration-dependent precision.

## 7. Robust variants, limitations, and methodological debates

Robustification has emerged as a response to Deming regression’s sensitivity to outliers and contamination. A 2021 paper introduces M-Deming and MM-Deming by modifying Linnet’s weighted Deming regression with robust M- and MM-estimation ideas [2105.04628]. M-Deming inserts Huber-type weights based on standardized orthogonal residuals, while MM-Deming uses a high-robustness starting line derived from a robust covariance estimate followed by Tukey bisquare iteration [2105.04628]. The author states that M-Deming shows superior qualities to Passing–Bablok regression and does not suffer from bias when the data to be validated have a reduced precision [2105.04628].

The same paper also proposes a unified graphical and testing framework in $(\beta_0,\beta_1)$ space. Bootstrap estimates of intercept and slope are summarized by a robust covariance matrix, and the null hypothesis $(0,1)$ is tested via the squared Mahalanobis distance
$$
D^2 =
(\hat{\boldsymbol{\mu}}-\boldsymbol{\beta}_0)^\top
\hat{\Sigma}^{-1}
(\hat{\boldsymbol{\mu}}-\boldsymbol{\beta}_0),
$$
compared with a $\chi^2_2$ cutoff [2105.04628]. The paper emphasizes that interpretation of the graph is more important than the probability obtained from the test and reports that the unified method shows much higher power and allows a significant reduction in the sample size required for validations [2105.04628].

Despite these extensions, several limitations recur across the literature. The most persistent is dependence on the assumed variance ratio. The airborne-fraction paper states that Deming regression depends critically on $\delta$ and that different choices can noticeably change the slope estimate [2411.07836]. The clinical-risk paper similarly notes that the slope depends on the assumed $\lambda$ and does not address its estimation, recommending prior knowledge or sensitivity analysis in practice [2405.20992]. The precision-profile paper argues that what matters is the shape and ratio of the variance profiles rather than their common multiplicative scale, but still requires at least approximate knowledge of relative precision when external precision studies are unavailable [2508.02888].

A second limitation is the strength of the distributional assumptions. The cited works repeatedly assume Gaussian measurement errors, independence across observations, and independence between measurement errors and latent variables [2405.20992], [2411.07836], [2508.02888]. Robust alternatives partly address gross contamination, but the broader robustness of classical Deming to nonnormality is not established in these papers.

A third issue concerns heteroscedasticity and model specification. Precision-profile weighting is designed precisely because constant-variance Deming is often unrealistic over wide concentration ranges [2508.02888]. Conversely, the robust-method-comparison paper is skeptical of weighted Deming as a default solution under heterogeneous error, stating that weighted Deming “should be also abandoned” in the author’s simulations because of instability under detection limits and mixed errors [2105.04628]. This constitutes a genuine methodological tension in the recent literature: one line of work improves Deming by explicit variance modeling, while another argues that robustification and joint inference may be more reliable than conventional weighted Deming in some validation settings.

A fourth limitation is computational. Classical Deming is closed-form, but generalized, multivariate, and likelihood-based variants require iterative optimization, resampling, and sometimes latent-value estimation [2405.20992], [2411.07836], [2508.02888]. One paper notes that an R package implementing the two-stage methodology was under development [2405.20992], while another provides R routines such as `PWD_known`, `PWD_inference`, `PWD_resi`, and `PWD_outlier` for precision-profile-weighted Deming workflows [2508.02888].

Overall, the recent arXiv literature presents Deming regression as a mature but actively evolving component of the errors-in-variables toolkit. Its classical role as a symmetric alternative to OLS remains foundational, but current developments increasingly focus on heteroscedastic variance structures, multistage uncertainty propagation, multivariate reduction, bootstrap inference, and robustness to contamination. This suggests that “Deming regression” now denotes not a single estimator but a family of closely related procedures built around one core principle: linear association should be estimated in a way that explicitly acknowledges error in both variables [2405.20992], [2411.07836], [2508.02888], [2105.04628].

Source: https://www.emergentmind.com/topics/deming-regression