---
title: Robust Univariate Mean Estimator (RUME)
url: https://www.emergentmind.com/topics/robust-univariate-mean-estimator-rume
type: topic
---

# Robust Univariate Mean Estimator (RUME)

A Robust Univariate Mean Estimator (RUME) refers to any estimator of the mean for univariate data that delivers strong robustness guarantees—specifically, diminished sensitivity to outliers and heavy tails, high breakdown point, and, when possible, optimal non-asymptotic deviation bounds. The RUME framework encompasses a wide range of techniques, including median-of-means, trimmed means, quantile-based methods, M-estimators, block-wise filter approaches, and more recent semiparametric generalizations. RUMEs have become the central tools for robust location estimation under minimal moment assumptions, offering provable sub-Gaussian performance even under heavy-tailed and contaminated data scenarios.

## 1. Core Definitions and Methodologies

The canonical RUME is the **median-of-means (MoM) estimator**. For i.i.d. data $X_1,\ldots,X_n$ with $\mathbb{E}X_i=\mu$, split the data into $k$ disjoint blocks ($B_1,\ldots,B_k$), compute each block mean $m_j = \frac{1}{|B_j|}\sum_{i\in B_j} X_i$, and return $\widehat\mu_{\rm MoM} = \mathrm{median}(m_1,\ldots,m_k)$. Choosing $k \asymp \log(1/\delta)$ provides, under finite variance, the sub-Gaussian deviation:
\[
|\widehat\mu_{\rm MoM} - \mu| \leq C \sigma \sqrt{\frac{\log(1/\delta)}{n}}
\]
with probability at least $1-\delta$, where $\sigma^2 = \mathrm{Var}(X_i)$ [1906.04280, 1112.3914, 1504.04580].

Advanced RUMEs include:
- **Trimmed mean**: sorts the data, discards the smallest and largest $\alpha n$ observations, and averages the center [2302.06710]. 
- **Self-normalized block estimators**: use block means, compute empirical variances per block, and aggregate with weights inversely proportional to variance ($\alpha_j \propto 1/\sigma_j^p$) [2006.01986].
- **(Pseudo-)Huber M-estimators**: solve $\sum_{i} \psi_\tau(X_i-\mu)=0$ with adaptive tuning of $\tau$ [2107.00118, 1812.03523].
- **Sample-reuse interval estimators**: deliver interval bounds for $E[q(V, \Delta)]$ under partial knowledge of distributional uncertainty [0810.4727].

Recent innovations classify RUMEs semiparametrically using the orderliness of quantile combinations, motivating new block/binomial means and $LL$-means (e.g., median Hodges-Lehmann) with superior bias properties [2403.12110]. Other RUMEs leverage empirical characteristic functions [2004.02287], Bayesian aggregation [1906.01204], or iterative filter-based procedures [2007.15839].

## 2. Statistical Guarantees and Robustness Properties

RUMEs are characterized by:
- **High breakdown point**: Many attain breakdown $1/2$ or close; MoM tolerates up to a $50\%$ fraction of contaminated blocks [1112.3914, 2302.06710]. Trimmed/winsorized means and block/binomial RUMEs are tunable to the contamination level, trading bias and breakdown.
- **Sub-Gaussian deviation**: Under only finite variance, RUMEs achieve
  \[
  \Pr\left( |\widehat{\mu} - \mu| > t \right) \leq 2 \exp\left(-c \frac{n t^2}{\sigma^2}\right)
  \]
  for suitable $t$ and $c$ [1906.04280, 1812.03523].
- **Minimax optimality**: For Huber's $\epsilon$-contamination,
  \[
  |\widehat\mu - \mu| = O(\sigma \sqrt{\epsilon} + \sigma\sqrt{(\log(1/\delta))/n})
  \]
  is minimax-optimal under finite variance [1907.00927]. For only finite $q$th moments, the optimal error is $O(\epsilon^{1-1/q})$ [2302.06710].
- **Redescending influence**: Truncation or weighting guarantees that the effect of extreme outliers is suppressed [1601.08003, 2006.01986].
- **Asymptotic efficiency**: Recent advances yield RUMEs asymptotically achieving the Cramér–Rao lower bound for finite-variance families, e.g., self-normalized estimators [2006.01986, 2107.00118].

## 3. Representative Algorithms and Computational Complexity

A comparison of primary RUME classes and their computational profiles is as follows:

| RUME Type                     | Operations              | Complexity          | Tuning           |
|-------------------------------|-------------------------|---------------------|------------------|
| Median-of-means (MoM)         | Partition, medians      | $O(n)$              | Number of blocks |
| Trimmed mean                  | Sort, discard extremes  | $O(n \log n)$       | Trimming level $\alpha$ |
| Self-normalized block mean    | Block stats, weighted avg | $O(n)$            | $p, k$           |
| Huber/Catoni M-estimator      | Solve fixed-point eqn   | $O(n \log(1/\epsilon))$ | Scale param |
| Filter/QUE-based (regret)     | Iterative weights       | $O(n \log(1/\epsilon))$ | None              |
| Bayesian MoM (BMM)            | Dirichlet resample      | $O(n J)$            | $\alpha, J$      |
| Truncated quadratic (RMQ)     | Sliding window          | $O(n \log n)$       | Cutoff $c$       |
| Sample-reuse bounds           | Monte Carlo w/ reuse    | $O(n + n \log (V_{\max}/V_{\min}))$ | None      |

Median-of-means and block-weighted estimators are fully linear-time, only requiring a partition and aggregation [1112.3914, 2006.01986]. Truncated quadratic RMQ (robust mean quadratic) is $O(n \log n)$ due to sorting [1601.08003]. Pseudo-Huber self-tuned estimators require convex optimization but are practical and need no variance input [2107.00118].

## 4. Theoretical Insights: Breakdown, Bias, and Influence

Modern RUME designs leverage statistical theory to balance resistance to contamination with efficiency:
- **Breakdown point**: MoM achieves 50%. Standard trimmed means and winsorized means achieve breakdown $\alpha$ (with $\alpha$ set to the projected contamination level) [2302.06710, 2403.12110]. Median Hodges-Lehmann achieves $1-1/\sqrt{2}\approx0.2929$ [2403.12110].
- **Bias/Variance trade-offs**: For lightly contaminated data, asymptotic bias is negligible for MoM and blockwise RUMEs. Median-of-means and blockwise estimators can incur a constant factor loss in efficiency compared to the mean (e.g., $\sqrt{\pi/2}$ for MoM), but new constructions close this gap [2006.01986, 2107.00118].
- **Redescending and adaption**: Influence functions for RUMEs are either bounded and redescending (e.g., truncated quadratic, Huber-type) or null beyond a region (MoM, trimmed mean) [1601.08003, 2302.06710]. In weighted blockwise RUMEs, block means with inflated variance due to outliers get downweighted [2006.01986].

## 5. Extensions, Generalizations, and Recent Developments

- **Unified RUME frameworks**: Filter-based meta-problems and quantum-entropy (QUE) scores unify robust and heavy-tailed mean estimation for both one- and high-dimensional data, obtaining both computational efficiency and minimax optimality [2007.15839].
- **Semiparametric classification**: Distributional orderliness via quantile averages ($\mathrm{QA}(\epsilon,\gamma)$), as in [2403.12110], enables a taxonomy of robust means—trimmed, Winsorized, block/binomial, and $LL$-means, with explicit bias and breakdown formulas.
- **Adaptive/self-tuned M-estimators**: Pseudo-Huber estimators with self-tuned scale parameters remove the need for variance estimation while achieving both sub-Gaussian finite-sample rates and asymptotic normality [2107.00118].
- **Empirical characteristic function estimators**: These obtain tight (nearly sub-Gaussian) deviation, even for unbounded mean, and can be refined to achieve exact shift-equivariant optimality [2004.02287].

## 6. Comparative Evaluation and Application Domains

Compared to classical mean, sample median, and traditional M-estimators, RUMEs:
- Require only finite variance for sub-Gaussian deviation (mean requires exponential concentration/outlier-free data) [1112.3914, 1812.03523].
- Are fundamentally superior in presence of outliers or heavy tails. The mean fails completely under even small contamination; MoM, trimmed, and blockwise estimators remain accurate up to the breakdown threshold [1112.3914, 2302.06710].
- Are widely applied in statistical learning with adversarial noise, heavy-tailed regression, robust risk minimization, bandit problems, image processing (RMQ-RUME for edge-preserving smoothing [1601.08003]).

Practical recommendations:
- Use MoM or trimmed mean when only variance or contamination bound is known, as they are tuning-free and provide worst-case guarantees.
- Employ adaptive/self-tuned methods when efficiency and absence of variance information are critical [2107.00118].
- For distributional uncertainty models, use sample-reuse RUME for interval bounding [0810.4727].
- For superior bias under right-skewed or nonparametric families, recent semiparametric block/binomial or $LL$-means are recommended [2403.12110].

## 7. Summary Table of Principal RUME Types

| Estimator                        | Breakdown   | Optimality          | Key Reference        |
|----------------------------------|-------------|---------------------|----------------------|
| Median-of-means (MoM)            | $1/2$       | Sub-Gaussian, robust| [1112.3914, 1906.04280]  |
| Trimmed mean                     | $\alpha$    | Minimax optimality  | [2302.06710]         |
| Self-normalized block mean       | $<1/2$      | Asymptotically efficient  | [2006.01986]         |
| Pseudo-Huber/adaptive $M$-est.   | ---         | Asymptotically efficient | [2107.00118]    |
| Robust mean (characteristic fn.) | ---         | Nearly sub-Gaussian | [2004.02287]         |
| Filter/QUE meta-algorithms       | tunable     | Minimax/efficient   | [2007.15839]         |
| Median Hodges-Lehmann            | $\approx0.29$ | Lowest max bias    | [2403.12110]         |
| Truncated quadratic (RMQ)        | $1/2$       | Redescending, metric use | [1601.08003]   |

## References

- "Efficient Robust Mean Value Calculation of 1D Features" [1601.08003]
- "Uniform bounds for robust mean estimators" [1812.03523]
- "Trimmed sample means for robust uniform mean estimation and regression" [2302.06710]
- "Robust mean estimation and regression under heavy-tailed distributions—a survey" [1906.04280]
- "Robust empirical mean Estimators" [1112.3914]
- "Robust and efficient mean estimation: an approach based on the properties of self-normalized sums" [2006.01986]
- "A Unified Approach to Robust Mean Estimation" [1907.00927]
- "Do we need to estimate the variance in robust mean estimation?" [2107.00118]
- "Nearly Optimal Robust Mean Estimation via Empirical Characteristic Function" [2004.02287]
- "Robust and Heavy-Tailed Mean Estimation Made Simple, via Regret Minimization" [2007.15839]
- "Robust Mean Estimation with the Bayesian Median of Means" [1906.01204]
- "Robust Estimation of Mean Values" [0810.4727]
- "Robust estimations from distribution structures: I. Mean" [2403.12110]
- "Robust estimation of U-statistics" [1504.04580]

Source: https://www.emergentmind.com/topics/robust-univariate-mean-estimator-rume