---
title: Hájek Estimator in Clustered & Stratified Designs
url: https://www.emergentmind.com/topics/hajek-estimator
type: topic
---

# Hájek Estimator in Clustered & Stratified Designs

The Hájek estimator encompasses a broad class of ratio estimators prominently used for unbiased estimation of sample average treatment effects (SATE) in clustered and stratified experimental designs. It is pivotal in design-based inference frameworks, extending to generalized U-statistics and supporting theoretically robust variance estimation, including the development of jackknife and hybrid variance estimators. The estimator retains Neyman-style conservativeness and delivers valid inference under varied strata sizes and covariate structures, particularly when heterogeneity and small sample sizes challenge standard variance estimation strategies [2406.10473][2509.12356].

## 1. Mathematical Formulation and Properties

Consider a stratified, clustered randomized experiment with \( B \) strata (blocks). Within stratum \( b \), there are \( n_b \) clusters, each cluster \( i \in b \) containing \( m_{bi} \) units. The normalized cluster weights are defined by
\[
w_{bi} = \frac{m_{bi}}{\sum_{b'=1}^B \sum_{i' \in b'} m_{b'i'}}
\]
and the stratum weights by \( \omega_b = \sum_{i \in b} w_{bi} \), summing to one across all strata.

The observed, cluster-weighted means in each stratum (for treatment \( z \in \{0,1\} \)) are
\[
\bar y_{bz}^{\rm obs} = \frac{\sum_{i\in b:\,Z_{bi}=z} w_{bi} Y_{bi}}{\sum_{i\in b:\,Z_{bi}=z} w_{bi}}
\]
with \( Z_{bi} \) indicating cluster assignment. The Hájek estimator for SATE is
\[
\hat\tau_{\rm HA} = \sum_{b=1}^B \omega_b \left( \bar y_{b1}^{\rm obs} - \bar y_{b0}^{\rm obs} \right)
\]
which is unbiased for the finite-population SATE:
\[
\tau = \sum_{b=1}^B \omega_b \left( \bar y_{b1} - \bar y_{b0} \right)
\]
whenever each stratum's randomization is complete [2406.10473].

## 2. Design-Based Variance Estimation

Variance estimation for the Hájek estimator in clustered, stratified settings relies on weighting and stratum-specific variance calculations. For each cluster and arm, define
\[
\gamma_{bi}(r_z) = w_{bi}\left( Y_{bi}(z) - r_z \right)
\]
with \( r_z \) typically replaced by an estimate of the marginal mean. Within each stratum, the sample variance is
\[
s_{bz}^2(r_z) = \frac{1}{n_{bz}-1} \sum_{i:Z_{bi}=z} \left[ \gamma_{bi}(r_z) - \bar\gamma_{bz}^{\rm obs}(r_z) \right]^2
\]
The **large-stratum variance estimator** is
\[
\hat v_{\rm large}(\hat\tau_{\rm HA}) = \sum_{b=1}^B \omega_b^2 \left\{ \frac{s_{b1}^2(\hat\rho_1)}{n_{b1}} + \frac{s_{b0}^2(\hat\rho_0)}{n_{b0}} \right\}
\]
where \( \hat\rho_z \) are the weighted stratum marginal means. This estimator is asymptotically conservative—its expectation exceeds the true sampling variance unless treatment effects are constant within clusters [2406.10473].

To maintain finite-sample validity, especially for small strata (e.g., matched pairs), a **hybrid variance estimator** is recommended:
- Use the large-stratum estimator if \( n_b \ge 4 \).
- Use a pairwise estimator if \( n_b = 2 \).
Combine by stratum size:
\[
\hat v_{\rm hybrid}(\hat\tau) = \sum_{b=1}^B \omega_b^2 \nu_b^{(e_b)}
\]
with \( e_b \in \{l,s\} \) (large/pairwise) [2406.10473].

## 3. Asymptotics, Conservativeness, and Theoretical Guarantees

Key regularity conditions for consistency include: bounded cluster sizes, non-degenerate assignment probabilities within strata, increasing number or size of strata, and control on extreme values to ensure central limit theorems apply. Both large-stratum and hybrid estimators guarantee
\[
\liminf_{\text{sample size} \rightarrow \infty} \frac{E\{\hat v\}}{\Var(\hat\tau)} \ge 1
\]
so that Wald-type confidence intervals achieve at least nominal asymptotic coverage [2406.10473].

In hypothesis testing, score-style tests based on inversion of the Hájek estimating equations yield exact levels under the sharp null and are asymptotically valid under the weak null.

## 4. Extensions: Covariate Adjustment and Regression Approaches

Precision gains are available via regression adjustment within the Hájek framework. Using weighted least squares (WLS), regress outcomes on treatment indicators and baseline covariates with weights \( w_{bi}/\pi_{bZ_{bi}} \). The resulting coefficient on \( Z \) is a covariate-adjusted Hájek estimator \( \hat\tau_{\rm adj} \), which remains unbiased for SATE by design-based arguments. Variance estimation on regression residuals, optionally employing cluster-robust adjustments (e.g., HC2 or CR2), ensures conservative inference even with model misspecification [2406.10473].

## 5. Generalized U-Statistics, Hájek Projection, and Jackknife Variance Estimation

For generalized U-statistics, the asymptotic behavior of the estimator’s variance is governed by the Hájek projection, the leading term in the Hoeffding decomposition. The **Hájek-domination condition** requires
\[
\frac{\Var(U_{n,s,\omega})}{\Var(P_1 U_{n,s,\omega})} \rightarrow 1
\]
where \( U_{n,s,\omega} \) is the U-statistic, and \( P_1 U_{n,s,\omega} \) its order-1 projection. Under this condition and \( s = o(n) \), nonparametric jackknife and delete-\( d \) jackknife variance estimators achieve ratio-consistency:
\[
\frac{\hat\sigma^2_{JK}}{\Var(U_{n,s,\omega})} \overset{p}{\rightarrow} 1
\]
This framework encompasses classical fixed-order results as special cases and generalizes to settings where the kernel order grows with \( n \) or sampling is incomplete. It places the regular jackknife on equal theoretical footing with the infinitesimal jackknife [2509.12356].

## 6. Empirical Performance and Practical Recommendations

Simulation studies indicate that the Hájek estimator is unbiased under heterogeneous treatment effects, even when other estimators (e.g., Imai–King–Nall, regression with fixed effects) become biased, especially when heterogeneity correlates with cluster or stratum size. The large-strata variance estimator is conservative in small strata, leading to over-coverage, while the hybrid estimator restores nominal coverage levels without excessive interval width.

Applied examples—nutritional studies in paired clusters, educational trials with cluster-level covariates—demonstrate that the hybrid variance estimator yields coverage near nominal, while traditional estimators can over-cover by a large margin. Covariate adjustment reduces standard error without jeopardizing coverage [2406.10473].

## 7. Significance and Connections to Broader Methodological Literature

The Hájek estimator and its associated variance estimators constitute a robust, design-based approach to impact estimation in randomized experiments with complex assignment structures (clustering, stratification, fine blocking). They require only randomization (not model specification) for validity. The connection to U-statistics and jackknife variance estimation aligns with longstanding principles in nonparametric inference and further supports its extensibility to modern high-dimensional and adaptive designs [2509.12356].

Under the minimal variance-dominance condition, validity of asymptotic normal approximations and jackknife variance estimates is unified across a wide array of applications, from classical fixed-order statistics to contemporary nonparametric regression estimators. This approach ensures rigorous, reproducible inference in both large-scale and small-sample, highly stratified designs.

Source: https://www.emergentmind.com/topics/hajek-estimator