Papers
Topics
Authors
Recent
Search
2000 character limit reached

Cluster Jackknife: Resampling & Variance Estimation

Updated 4 July 2026
  • Cluster jackknife is a family of resampling techniques that treats clusters as the fundamental unit to robustly estimate variance and assess model sensitivity.
  • It computes leave-one-cluster-out estimates to construct conservative variance estimators such as CV₃ and CV₃J, thereby mitigating issues from cluster heterogeneity.
  • It leverages cluster sufficient statistics for computational efficiency, making it applicable in linear, nonlinear, and multiway clustered models.

Cluster jackknife is a family of resampling, variance-estimation, and diagnostic procedures that treats the cluster—not the individual observation—as the operative unit of deletion. In clustered regression models, its canonical form is the delete-one-cluster jackknife that generates leave-one-cluster-out estimates and uses their dispersion to construct cluster-robust variance estimators such as CV3_3 and CV3J_{3\mathrm J} (MacKinnon et al., 2022). In the broader literature, the same logic is adapted to settings in which the relevant unit is a spatial block, a treatment-assignment cluster, a background source in strong lensing, or even a synthetic subsample used as a computational device for massive data (Mohammad et al., 2021, Nishida et al., 1 May 2025, Wu et al., 2023).

1. Cluster as the Fundamental Unit

In the standard clustered linear regression setup, there are GG disjoint clusters indexed by g=1,,Gg=1,\dots,G, with cluster gg containing NgN_g observations and total sample size N=g=1GNgN=\sum_{g=1}^G N_g. The model is written at the cluster level as

yg=Xgβ+ug,g=1,,G,y_g = X_g \beta + u_g,\qquad g=1,\ldots,G,

and OLS takes the stacked form

β^=(XX)1Xy=(g=1GXgXg)1g=1GXgug.\hat\beta = (X'X)^{-1}X'y = \Big(\sum_{g=1}^G X_g'X_g\Big)^{-1}\sum_{g=1}^G X_g'u_g.

A central object is the cluster score

sg=Xgug,s_g = X_g'u_g,

so that the distribution of 3J_{3\mathrm J}0 depends on disturbances only through the cluster scores. Under correct specification and cluster independence,

3J_{3\mathrm J}1

This formulation makes the conceptual point that under clustered dependence the effective observational unit for inference is the cluster. The same perspective motivates cluster-level leverage, partial leverage, and influence diagnostics. Cluster leverage is defined as

3J_{3\mathrm J}2

where 3J_{3\mathrm J}3 is the 3J_{3\mathrm J}4-th diagonal block of the hat matrix. Its average is 3J_{3\mathrm J}5, since 3J_{3\mathrm J}6. For a coefficient 3J_{3\mathrm J}7, cluster partial leverage is

3J_{3\mathrm J}8

so 3J_{3\mathrm J}9 and the average is GG0. High GG1 or GG2 indicates that a cluster has unusually large potential influence on fitted values or on the coefficient of interest. Realized influence is then examined through the delete-one-cluster estimator

GG3

with large deviations GG4 signaling that results are sensitive to cluster GG5 (MacKinnon et al., 2022).

2. Jackknife Variance Estimators

The conventional Liang–Zeger style cluster-robust variance estimator, denoted CVGG6, is

GG7

where GG8. CVGG9 is a sandwich estimator, not a jackknife estimator.

The cluster jackknife estimator CVg=1,,Gg=1,\dots,G0 replaces raw empirical scores with leave-one-cluster variability: g=1,,Gg=1,\dots,G1 An equivalent score-based expression is

g=1,,Gg=1,\dots,G2

where g=1,,Gg=1,\dots,G3 and g=1,,Gg=1,\dots,G4 is the g=1,,Gg=1,\dots,G5-th block of the residual-maker g=1,,Gg=1,\dots,G6. A closely related estimator is

g=1,,Gg=1,\dots,G7

The distinction between CVg=1,,Gg=1,\dots,G8 and CVg=1,,Gg=1,\dots,G9 is only the centering point, gg0 versus gg1. Their difference is positive semidefinite, so CVgg2 is weakly more conservative. In finite samples, both are generally more conservative than CVgg3, and the simulations summarized in the literature report lower rejection frequencies for CVgg4 and CVgg5, especially when clusters are heterogeneous or gg6 is modest. The same literature also emphasizes that CVgg7 is the cluster analogue of HCgg8, while CVgg9 plays the role of a simple sandwich estimator (MacKinnon et al., 2022).

3. Computation and Software

A naive implementation of cluster jackknife would re-estimate the model NgN_g0 times. The computational advance in the modern literature is to exploit cluster sufficient statistics,

NgN_g1

so that once NgN_g2 and NgN_g3 are available, each leave-one-cluster estimate requires only a NgN_g4 subtraction, a NgN_g5 subtraction, one inversion of a NgN_g6 matrix, and one matrix–vector multiplication. Cluster leverage is likewise computed from

NgN_g7

without forming the full NgN_g8 hat matrix. The same computations deliver influence measures, CVNgN_g9, and CVN=g=1GNgN=\sum_{g=1}^G N_g0. The paper emphasizes that computing CVN=g=1GNgN=\sum_{g=1}^G N_g1 as a jackknife is simpler and usually faster than computing it via cluster-specific inverses of N=g=1GNgN=\sum_{g=1}^G N_g2 (MacKinnon et al., 2022).

Context Software Reported functionality
Linear regression with clustered disturbances summclust Computes N=g=1GNgN=\sum_{g=1}^G N_g3, N=g=1GNgN=\sum_{g=1}^G N_g4, N=g=1GNgN=\sum_{g=1}^G N_g5, N=g=1GNgN=\sum_{g=1}^G N_g6, CVN=g=1GNgN=\sum_{g=1}^G N_g7, CVN=g=1GNgN=\sum_{g=1}^G N_g8, and CVN=g=1GNgN=\sum_{g=1}^G N_g9
Staggered-adoption DiD / CSDID csdidjack, didjack Computes cluster-jackknife standard errors for aggregated ATT
Logistic regression logitjack Reports CVyg=Xgβ+ug,g=1,,G,y_g = X_g \beta + u_g,\qquad g=1,\ldots,G,0, CVyg=Xgβ+ug,g=1,,G,y_g = X_g \beta + u_g,\qquad g=1,\ldots,G,1L, optionally CVyg=Xgβ+ug,g=1,,G,y_g = X_g \beta + u_g,\qquad g=1,\ldots,G,2, and WCLR/WCLU procedures
Two-way clustered linear regression twowayjack Reports CVyg=Xgβ+ug,g=1,,G,y_g = X_g \beta + u_g,\qquad g=1,\ldots,G,3 and CVyg=Xgβ+ug,g=1,,G,y_g = X_g \beta + u_g,\qquad g=1,\ldots,G,4 for scalar hypotheses

In nonlinear and multiway settings, full delete-one-cluster re-estimation can be expensive. For clustered logit, a linearized cluster-jackknife variance estimator CVyg=Xgβ+ug,g=1,,G,y_g = X_g \beta + u_g,\qquad g=1,\ldots,G,5L replaces exact leave-one-cluster maximum-likelihood estimates by first-order approximations based on cluster scores and Hessians, and the simulations report that CVyg=Xgβ+ug,g=1,,G,y_g = X_g \beta + u_g,\qquad g=1,\ldots,G,6L is usually very close to CVyg=Xgβ+ug,g=1,,G,y_g = X_g \beta + u_g,\qquad g=1,\ldots,G,7 while being much cheaper to compute (MacKinnon et al., 2024). For two-way clustering, twowayjack implements a three-component cluster-jackknife construction and a max-se rule that always yields defined scalar tests, while csdidjack and didjack apply leave-one-cluster-out recomputation to the aggregated ATT in Callaway–Sant’Anna Difference-in-Differences estimation (MacKinnon et al., 2024, Karim et al., 12 Feb 2026).

4. Generalizations in Econometrics

In staggered-adoption DiD, the cluster jackknife is applied to the aggregated CSDID estimator. If yg=Xgβ+ug,g=1,,G,y_g = X_g \beta + u_g,\qquad g=1,\ldots,G,8 denotes the full-sample aggregated ATT and yg=Xgβ+ug,g=1,,G,y_g = X_g \beta + u_g,\qquad g=1,\ldots,G,9 is the estimate obtained after omitting cluster β^=(XX)1Xy=(g=1GXgXg)1g=1GXgug.\hat\beta = (X'X)^{-1}X'y = \Big(\sum_{g=1}^G X_g'X_g\Big)^{-1}\sum_{g=1}^G X_g'u_g.0, the proposed CVβ^=(XX)1Xy=(g=1GXgXg)1g=1GXgug.\hat\beta = (X'X)^{-1}X'y = \Big(\sum_{g=1}^G X_g'X_g\Big)^{-1}\sum_{g=1}^G X_g'u_g.1 variance is

β^=(XX)1Xy=(g=1GXgXg)1g=1GXgug.\hat\beta = (X'X)^{-1}X'y = \Big(\sum_{g=1}^G X_g'X_g\Big)^{-1}\sum_{g=1}^G X_g'u_g.2

The simulation evidence in that paper shows that default asymptotic and multiplier-bootstrap inference can reject a true null far too often when clusters or treated clusters are few, whereas the cluster jackknife greatly improves inference (Karim et al., 12 Feb 2026).

For clustered logistic regression, the exact cluster jackknife is defined by recomputing the logit estimator β^=(XX)1Xy=(g=1GXgXg)1g=1GXgug.\hat\beta = (X'X)^{-1}X'y = \Big(\sum_{g=1}^G X_g'X_g\Big)^{-1}\sum_{g=1}^G X_g'u_g.3 times, once per omitted cluster, and using

β^=(XX)1Xy=(g=1GXgXg)1g=1GXgug.\hat\beta = (X'X)^{-1}X'y = \Big(\sum_{g=1}^G X_g'X_g\Big)^{-1}\sum_{g=1}^G X_g'u_g.4

Because that can be computationally demanding, the paper develops the linearized estimator CVβ^=(XX)1Xy=(g=1GXgXg)1g=1GXgug.\hat\beta = (X'X)^{-1}X'y = \Big(\sum_{g=1}^G X_g'X_g\Big)^{-1}\sum_{g=1}^G X_g'u_g.5L and linearized wild cluster bootstrap procedures WCLR and WCLU, including score-transformed variants. The simulation results strongly favor the new methods over the conventional cluster-robust variance estimator (MacKinnon et al., 2024).

With two-way clustering, the jackknife construction is extended componentwise. Leave-one-β^=(XX)1Xy=(g=1GXgXg)1g=1GXgug.\hat\beta = (X'X)^{-1}X'y = \Big(\sum_{g=1}^G X_g'X_g\Big)^{-1}\sum_{g=1}^G X_g'u_g.6-out, leave-one-β^=(XX)1Xy=(g=1GXgXg)1g=1GXgug.\hat\beta = (X'X)^{-1}X'y = \Big(\sum_{g=1}^G X_g'X_g\Big)^{-1}\sum_{g=1}^G X_g'u_g.7-out, and leave-one-intersection-out estimators produce

β^=(XX)1Xy=(g=1GXgXg)1g=1GXgug.\hat\beta = (X'X)^{-1}X'y = \Big(\sum_{g=1}^G X_g'X_g\Big)^{-1}\sum_{g=1}^G X_g'u_g.8

which are combined as

β^=(XX)1Xy=(g=1GXgXg)1g=1GXgug.\hat\beta = (X'X)^{-1}X'y = \Big(\sum_{g=1}^G X_g'X_g\Big)^{-1}\sum_{g=1}^G X_g'u_g.9

Because conventional two-way CRVEs can be indefinite, the paper also proposes a max-se rule, and its simulations recommend CVsg=Xgug,s_g = X_g'u_g,0 as the preferred choice (MacKinnon et al., 2024).

In judge designs with multidimensional clustering, cluster jackknife refers to modifying the IV projection matrix so that all entries corresponding to within-cluster dependence vanish. The multidimensional cluster jackknife IV estimator uses

sg=Xgug,s_g = X_g'u_g,1

and then

sg=Xgug,s_g = X_g'u_g,2

The paper’s Monte Carlo evidence shows that this multidimensional cluster jackknife can be essentially unbiased when clustering is complex and spans multiple dimensions (Ligtenberg et al., 2024).

5. Variants Outside Classical Clustered Regression

In large-data analysis with limited computational resources, the cluster jackknife can be synthetic rather than intrinsic. The proposed Jackknife Debiased Subsample estimator treats each subsample as a cluster, applies a delete-1 jackknife within each subsample, and averages the debiased cluster-level estimates: sg=Xgug,s_g = X_g'u_g,3 The paper shows that jackknife debiasing reduces the leading subsampling bias from sg=Xgug,s_g = X_g'u_g,4 to sg=Xgug,s_g = X_g'u_g,5, while the asymptotic variance remains of order sg=Xgug,s_g = X_g'u_g,6 (Wu et al., 2023).

In strong-lensing mass modeling, the omitted unit is not an econometric cluster but an entire background source. The jackknife procedure removes all images of one source, re-optimizes the mass model on the remaining sources, predicts the omitted images, and evaluates residuals

sg=Xgug,s_g = X_g'u_g,7

The normalized residuals sg=Xgug,s_g = X_g'u_g,8 and sg=Xgug,s_g = X_g'u_g,9 form a “Jackknife distribution” that is used to validate the predictive adequacy of the mass model rather than to estimate the variance of the target cosmological parameter directly (Nishida et al., 1 May 2025). In the Refsdal analysis, the same source-based jackknife is used to test whether normalized residuals are close to 3J_{3\mathrm J}00; the authors report 3J_{3\mathrm J}01 values of 3J_{3\mathrm J}02, 3J_{3\mathrm J}03, 3J_{3\mathrm J}04, and 3J_{3\mathrm J}05 across four mass models, and use these diagnostics to support the robustness of the final 3J_{3\mathrm J}06 constraint (Liu et al., 12 Sep 2025).

For covariance estimation of the two-point correlation function, delete-one jackknife over spatial subvolumes must account for auto-pairs and cross-pairs. One paper derives pair-weighting corrections and a “match” scheme, and reports that corrected internal resampling recovers the amplitude and structure of the covariance matrix, as represented by its principal components, to within 3J_{3\mathrm J}07 in 1000 QUIJOTE simulations (Mohammad et al., 2021). A related “jackknife on mocks” approach estimates a covariance within each mock by delete-3J_{3\mathrm J}08 jackknife over spatial sub-volumes and then averages across mocks; in the BOSS DR11 application it yields similar galaxy-clustering covariance estimates while requiring 3J_{3\mathrm J}09 times fewer simulations to get similar accuracy on variance (Escoffier et al., 2016).

6. Interpretation, Diagnostics, and Limitations

A recurrent theme in the literature is that cluster jackknife is not merely a more conservative replacement for CV3J_{3\mathrm J}10; it is also a diagnostic framework. High cluster leverage 3J_{3\mathrm J}11, high partial leverage 3J_{3\mathrm J}12, and large deviations of 3J_{3\mathrm J}13 from 3J_{3\mathrm J}14 identify clusters that dominate identification or instability. The scaled variance

3J_{3\mathrm J}15

is reported to be particularly predictive of size distortions in cluster-robust tests, with CV3J_{3\mathrm J}16 the most sensitive. The empirical guidance is to compare CV3J_{3\mathrm J}17 and CV3J_{3\mathrm J}18: if they are close and leverage diagnostics are mild, CV3J_{3\mathrm J}19 is probably fine; if they differ substantially and leverage heterogeneity is large, prefer CV3J_{3\mathrm J}20 or bootstrap methods (MacKinnon et al., 2022).

The method also has failure modes. Omit-one-cluster samples can be singular, especially in one-sided designs such as a regressor that is nonzero in only one cluster. In those cases software may use a generalized inverse, may set some coefficients to 0, or may report versions of CV3J_{3\mathrm J}21 and CV3J_{3\mathrm J}22 that drop singular omit-one-cluster subsamples. In nonlinear models, delete-one-cluster estimation can fail because of perfect separation, and in two-way clustering the three-term variance matrix can be indefinite even before any jackknife correction. These are not secondary implementation issues; they are informative about the fragility of the design (MacKinnon et al., 2022).

A broader theoretical caution comes from general jackknife theory. In a cluster/block interpretation, the delete-3J_{3\mathrm J}23 choice is not innocuous: the paper on jackknife, bootstrap, and Taylor-series bias correction argues that bounded coefficients are essential, while delete-1 3J_{3\mathrm J}24-jackknife can exhibit drastically different, and in worst cases exploding, bias and variance behavior. This suggests caution in extending cluster jackknife to aggressive higher-order delete-3J_{3\mathrm J}25 schemes without checking the implied weights (Jiao et al., 2017).

Taken together, the literature treats cluster jackknife less as a single estimator than as a design principle: delete the unit that carries the relevant dependence, identification, or predictive structure, and use the resulting leave-one-unit-out variation either to estimate uncertainty or to test robustness. This suggests that the method is most informative when the omitted unit coincides with the substantive unit at which the inferential problem is actually generated.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Cluster Jackknife.