---
title: Least Product Relative Error Estimator
url: https://www.emergentmind.com/topics/least-product-relative-error-lpre-estimator
type: topic
---

# Least Product Relative Error Estimator

The Least Product Relative Error (LPRE) estimator is a statistical estimation method for multiplicative regression models, defined by the minimization of the product of two relative errors: one relative to the observed response and one relative to the model-predicted value. LPRE estimation is strictly scale-invariant, admits a uniquely defined solution due to the convexity of its loss function, and has been established for standard parametric, semiparametric single-index, and functional regression settings. LPRE demonstrates superior robustness compared to least-squares-type estimators, especially under skewed or heavy-tailed noise, while achieving strong large-sample properties including asymptotic normality and root-n consistency [1609.01553], [1309.0220], [2301.01076].

## 1. Model Formulations and Scope

The canonical LPRE estimator is applicable to the multiplicative regression model:
$$
Y_i = \exp(X_i^T \beta_0)\, \varepsilon_i,
$$
where $Y_i > 0$ denotes the response, $X_i \in \mathbb R^p$ is a (possibly augmented) covariate vector, $\beta_0 \in \mathbb R^p$ is the true parameter, and $\varepsilon_i > 0$ is an error variable with $E(\varepsilon_i|X_i) = E(\varepsilon_i^{-1}|X_i) = 1$ [1309.0220]. In the semiparametric single-index extension,
$$
y_i = \exp\big\{\,g(x_i^T\beta_0)\,\big\}\, \varepsilon_i,
$$
$\beta_0$ (with $\|\beta_0\| = 1$ for identifiability) appears only through $x_i^T\beta_0$ and $g(\cdot)$ is an unknown smooth link [1609.01553]. Functional LPRE generalizes the model to scalar-on-function regression,
$$
Y_i = \exp\left\{\int_0^1 X_i(t)\,\beta(t)\,dt\right\} \varepsilon_i,
$$
where $X_i(t)$ and $\beta(t)$ are square-integrable functions on $[0,1]$ [2301.01076].

LPRE estimates parameters by focusing on errors expressed as ratios, thereby providing a natural analysis of scale-invariant models.

## 2. LPRE Criterion and Core Properties

For data $(X_i, Y_i)$, define for each $i$:
$$
e_i^{(1)}(\beta) = \frac{Y_i - \mu_i(\beta)}{Y_i}, \qquad e_i^{(2)}(\beta) = \frac{Y_i - \mu_i(\beta)}{\mu_i(\beta)},
$$
with $\mu_i(\beta) = \exp(X_i^T\beta)$. The LPRE loss is
$$
L(Y_i, \mu_i(\beta)) = |\ e_i^{(1)}(\beta)|\, \cdot\, |e_i^{(2)}(\beta)| = \frac{[Y_i - \mu_i(\beta)]^2}{Y_i \mu_i(\beta)}.
$$
The aggregate criterion for $n$ observations is then
$$
J(\beta) = \sum_{i=1}^n \frac{[Y_i - \exp(X_i^T\beta)]^2}{Y_i\, \exp(X_i^T\beta)} = \sum_{i=1}^n \left[ Y_i\,e^{-X_i^T\beta} + Y_i^{-1} e^{X_i^T\beta} - 2 \right].
$$
This criterion is strictly convex, continuous, and smooth in $\beta$ under standard moment conditions [1309.0220]. For single-index and functional models, analogous forms express $J(\beta)$ or functional equivalents via the index $x_i^T\beta$ or integral $\int X_i(t)\beta(t)dt$ [1609.01553], [2301.01076].

The scale-invariant property is immediate, since rescaling $Y$ or any covariate leaves $J(\beta)$ unchanged.

## 3. Estimation Algorithms and Computational Aspects

For linear models, parameter estimation proceeds by direction minimization of $J(\beta)$. Gradient and Hessian are available in closed form:
$$
\nabla J(\beta) = \sum_{i=1}^n \big[ -Y_i e^{-X_i^T\beta} + Y_i^{-1} e^{X_i^T\beta} \big] X_i,
$$
$$
\nabla^2 J(\beta) = \sum_{i=1}^n \big[ Y_i e^{-X_i^T\beta} + Y_i^{-1} e^{X_i^T\beta} \big] X_i X_i^T.
$$
Newton–Raphson steps ensure rapid and globally convergent optimization due to strict convexity. The unique minimizer exists under positive-definiteness of $\sum X_iX_i^T$ [1309.0220].

Single-index and functional models require more elaborate schemes:
- **Single-index LPRE**: Employs a two-stage procedure. First, for given $\beta$, $g(\cdot)$ is estimated by local linear smoothing of $\log y_i$ against $x_i^T\beta$ (using bandwidth $h \sim n^{-2/15}$). Then, $\beta$ is updated (subject to $\|\beta\|=1$) via Newton–Raphson on the profile LPRE criterion, leveraging the derivative $\hat{g}'$ estimated with a bandwidth $h_1 \sim n^{-1/5}$ [1609.01553].
- **Functional LPRE**: Expands $\beta(t)$ in a B-spline basis, applies penalized LPRE least squares, and solves the resulting convex problem via Newton–Raphson. Spline penalty order and knot selection control smoothness [2301.01076].

For massive data, optimal subsampling strategies (A-optimal or Hessian-free L-optimal) further accelerate functional LPRE, with rigorous guarantees on the quality of the estimator from subsamples.

## 4. Large-Sample Theory and Statistical Guarantees

For linear multiplicative models, under mild regularity conditions including bounded moments and $E(\varepsilon_i|\cdot)=E(\varepsilon_i^{-1}|\cdot)=1$, the LPRE estimator satisfies
$$
\sqrt{n}\,(\hat\beta_n - \beta_0) \xrightarrow{d} N(0,\, D^{-1} V D^{-1}),
$$
with
$$
D = E \left[ X X^T (\varepsilon + \varepsilon^{-1}) \right],\quad V = E \left[ X X^T (\varepsilon - \varepsilon^{-1})^2 \right],
$$
and a consistent covariance estimator $\,\hat D^{-1} \hat V \hat D^{-1}$ available by plug-in [1309.0220].

In the single-index semiparametric case, the estimator $(\hat\beta, \hat g)$ is root-n consistent and asymptotically normal, with an explicit sandwich covariance formula reflecting the unit-norm constraint. The link estimator $\hat g(z)$ achieves uniform error $O_p(n^{-2/5}(\log n)^{1/2})$ over compact supports [1609.01553].

For the functional setting, with $J$ basis functions and suitably regularized $\beta(t)$, one obtains
$$
\|\widehat\beta - \beta\|_{L^2} = O_P(n^{-1/2} K^{1/2}),
$$
and for fixed $t$,
$$
\sqrt{n/K} \, [\,\hat\beta(t) - \beta(t)\, ] \xrightarrow{d} N(0,\, \mathbf B(t)^T V_{\text{full}} \mathbf B(t)),
$$
where $K$ is the number of spline knots and $V_{\text{full}}$ is a model-dependent variance matrix [2301.01076].

Subsampling versions inherit analogous central limit theorems, with variance inflation reflecting subsample size $r \ll n$.

## 5. Empirical Comparisons and Application Results

Simulation studies compare LPRE to least-squares (LS) estimators on transformed (log) data, least absolute deviation (LAD) regression, and least absolute relative error (LARE):
- Under log-uniform and structurally “adversarial” noise (i.e., $\log \varepsilon \sim U(-2,2)$, or distributions with $\mathbb E(\varepsilon)=\mathbb E(\varepsilon^{-1})=1$), LPRE outperforms LS, LAD, and LARE with much smaller bias and MSE.
- Under normal error distributions ($\log\varepsilon\sim N(0,1)$), LPRE and LS perform similarly, but LPRE generally yields smaller standard error and improved robustness.
- In a real data application to percent body fat prediction ($n=251$, 12 predictors), LPRE produces lower values of median absolute error (MPE), product-relative error (MPPE), additive-relative error (MAPE), and squared error (MSPE) than LS regression or LAD, both in- and out-of-sample. LPRE also selects biceps circumference as significant where other methods do not [1309.0220], [1609.01553].

For the semiparametric body-fat example ($n=250$), LPRE and LS agree on core predictors, but differ on the sign and significance of certain variables (e.g., knee and ankle), illustrating higher stability and resistance to influential observations for LPRE.

## 6. Practical Implementation and Robustness

LPRE estimators require no tuning of scale factors and are invariant to units of both response and covariates, necessitating only choice of local smoothing bandwidths or spline penalty parameters. In the single-index model, bandwidths are typically chosen by cross-validation or generalized cross-validation (GCV). Newton–Raphson optimization converges rapidly from any reasonable initialization due to strict convexity.

The underlying product-of-relative-errors loss down-weights large residuals when the magnitude of $Y_i$ or the predicted value is large, imparting natural robustness against outliers or heteroskedasticity. Variance estimation is straightforward either by plug-in or bootstrap, with theoretically established accuracy under model conditions.

For functional and high-dimensional data, optimal and Hessian-free subsampling schemes enable LPRE computation with rigorously controlled loss of precision and scalable complexity.

## 7. Extensions and Related Methodology

LPRE methodology generalizes readily to semiparametric and functional models, each retaining the core scale-invariance and convexity properties. The framework is fundamentally distinct from least-squares or absolute value regression approaches, which are sensitive to units or may produce non-unique solutions in non-smooth or high-dimensional settings.

LPRE is situated among robust, interpretable, and computation-friendly regression frameworks for multiplicative structures, with particular efficacy in applied problems involving relative, proportional, or scale-dependent data structures. Its empirical and inferential characteristics are governed by explicit moment and regularity assumptions, distinguishing it from less robust or less well-characterized alternatives [1309.0220], [1609.01553], [2301.01076].

Source: https://www.emergentmind.com/topics/least-product-relative-error-lpre-estimator