Similarity-Weighted Bayesian Bootstrap
- SWBB is a semiparametric extension of the Bayesian bootstrap that employs distance-based Dirichlet weights to borrow information across similar clusters.
- It models the joint distribution of cluster- and individual-level confounders nonparametrically while using parametric mediator and outcome regressions for causal mediation in CRTs.
- Empirical evaluations show SWBB achieves lower RMSE and narrower credible intervals compared to traditional bootstrap methods in small-cluster settings.
Similarity-Weighted Bayesian Bootstrap (SWBB) is a modification of Rubin’s Bayesian bootstrap tailored to clustered data and, specifically, to causal mediation in cluster randomized trials (CRTs) with a small number of clusters and a cluster-level mediator. In the semiparametric framework developed for causal mediation in CRTs, SWBB models the joint distribution of cluster-level and individual-level confounders nonparametrically, while outcome and mediator regressions remain parametric. Its distinguishing feature is an explicit similarity-based information-borrowing mechanism across clusters, implemented through distance-dependent Dirichlet weights, so that inference borrows more from confounder profiles that are closer in covariate space (Bae et al., 11 Jun 2026).
1. Definition and scope
The classical Bayesian bootstrap represents an unknown distribution as a discrete distribution supported on the observed values, with random Dirichlet weights. In the SWBB construction, that nonparametric representation is retained, but it is applied not to the full data distribution but to the joint distribution of the confounders , where denotes the cluster-level confounder vector for cluster and denotes the individual-level confounder vector for individual in cluster (Bae et al., 11 Jun 2026).
SWBB extends the standard Bayesian bootstrap in three ways. First, it maintains a discrete support on the observed confounders. Second, it introduces a distance metric between clusters and , which encodes an explicit similarity-based information-borrowing mechanism across clusters. Third, it uses this distance to define Dirichlet priors on cluster-to-cluster weights
0
so that a target cluster 1 can borrow confounder information from all observed clusters, but more strongly from clusters deemed closer in covariate space.
This construction is meant to address a specific inferential problem. In CRT mediation settings with a small number of clusters, asymptotic variance approximations can be unreliable, fully parametric models for 2 can be unstable or misspecified, and cluster-specific empirical distributions can be too noisy when within-cluster confounder variation is limited. SWBB is designed to remain conjugate and computationally simple while reducing variance by borrowing strength primarily from similar clusters (Bae et al., 11 Jun 2026).
2. Hierarchical formulation and similarity mechanism
The SWBB factorization begins from the modeling device
3
under which, for an observed pair 4,
5
Each factor is modeled with BB-type Dirichlet weights (Bae et al., 11 Jun 2026).
At the cluster level,
6
Within a donor cluster 7,
8
The novel component is the inter-cluster allocation
9
for which SWBB places a Dirichlet prior with base measure proportional to a similarity vector derived from pairwise cluster distances (Bae et al., 11 Jun 2026).
The distance is
0
Here, 1 is the average pairwise distance in the cluster-level confounder space, and 2 is the average pairwise distance between the individual-level confounder sets of clusters 3 and 4, using a standard norm such as 5 or 6. The parameter 7 controls the relative importance of cluster-level and individual-level distances, whereas 8 controls how quickly similarity decays. As 9, cross-cluster borrowing becomes negligible and SWBB approaches the standard Bayesian bootstrap; for larger 0, borrowing becomes more global (Bae et al., 11 Jun 2026).
A useful interpretation is obtained by defining
1
The quantity 2 is interpreted as the number of “pseudo-subjects” contributed from cluster 3 to the conditional confounder distribution for target cluster 4. Under this scaling, smaller target clusters receive more pseudo-subjects, and among potential donor clusters, those with higher similarity contribute more. This generalizes the hierarchical Bayesian bootstrap (HBB), whose borrowing weights depend only on sample sizes rather than similarity (Bae et al., 11 Jun 2026).
The resulting joint discrete distribution can be written as
5
Accordingly, SWBB is a nonparametric prior on the joint empirical distribution of multilevel confounders with a hierarchical structure: 6
3. Place within semiparametric causal mediation
The observed data are
7
with treatment 8, cluster-level mediator 9, and individual-level outcome 0. The framework combines SWBB for the confounder distribution with parametric regression models for the mediator and outcome. The outcome model is a generalized linear mixed model,
1
with 2 and 3. The mediator model is a cluster-level generalized linear model,
4
with 5. The overall procedure is therefore semiparametric: 6 and 7 are parametric, while 8 is modeled nonparametrically through SWBB (Bae et al., 11 Jun 2026).
The causal estimands are the natural indirect effect (NIE) and natural direct effect (NDE). At the population level,
9
Identification is based on cluster-level SUTVA, sequential ignorability with baseline confounders 0, and positivity. In CRTs with cluster randomization, the exposure ignorability condition is guaranteed by design (Bae et al., 11 Jun 2026).
Under these assumptions, nested potential outcomes are identified by the mediation formula. At the population level,
1
SWBB supplies the nonparametric 2, and hence 3 and 4, that enter these integrals. In this sense, SWBB occupies the confounder-distribution component of the mediation functional rather than the outcome or mediator regression component (Bae et al., 11 Jun 2026).
4. Computational implementation
The implementation proceeds within MCMC. At each iteration, cluster-level weights 5 are drawn from 6, inter-cluster weights 7 are drawn from their posterior Dirichlet distributions using precomputed distances 8, and within-cluster weights 9 are drawn from 0. These draws determine the discrete approximation
1
Mediator and outcome model parameters are then sampled by standard MCMC; the paper notes implementation via Stan or similar, but does not spell out the exact sampler (Bae et al., 11 Jun 2026).
Potential mediators are simulated from the mediator model, often using either the GLM predictive mean or a draw from the predictive distribution. The mediation functionals are then computed as weighted sums over the SWBB support points. For example, the population-level nested potential outcome is approximated by summing over cluster-level weights, inter-cluster borrowing weights, and within-cluster empirical weights, with the parametric outcome regression evaluated at the sampled or plug-in mediator value. NDE, NIE, and ATE are obtained at each iteration as differences of nested potential outcomes, and posterior summaries are formed from the resulting draws (Bae et al., 11 Jun 2026).
In the reported implementation, 4,000 iterations are used, with 2,000 discarded as burn-in. The principal computational costs are the one-time computation of pairwise 2, which is 3 naively, and the MCMC for the parametric models. With 4 and moderate cluster sizes, the approach is described as tractable (Bae et al., 11 Jun 2026).
5. Empirical behavior in simulations and in the BIGPIC trial
The simulation study uses 1,000 datasets per scenario with 5 clusters and 6 individuals per cluster. Treatment is randomized as 7. Cluster-level confounders consist of three variables, and individual-level confounders have six components with a mix of binary and continuous variables. Three scenarios are considered: 8, weak dependence, and strong dependence. Under the chosen structural models, the true NIE, NDE, and ATE are 9, 0, and 1, respectively (Bae et al., 11 Jun 2026).
Across these scenarios, bias is essentially 2 for all methods, so BB, HBB, and SWBB are all approximately unbiased. The primary difference appears in RMSE. For NIE and ATE, SWBB attains lower RMSE than BB and HBB, especially for 3. In the independence scenario, NIE RMSE decreases from 4 under BB to 5 under SWBB with 6, about a 7 improvement; ATE RMSE decreases from 8 to 9, about a 0–1 improvement. In the strong-dependence scenario, NIE RMSE again decreases from 2 to 3. For NDE, RMSE differences are minimal, which the paper attributes to the linear mixed-model structure, under which the direct effect behaves like an intercept shift and is less sensitive to uncertainty in the confounder distribution. Coverage probabilities for nominal 4 intervals remain around 5–6 for all estimands and methods. Very small 7 produces RMSE close to BB, increasing 8 to approximately 9 lowers RMSE, and larger values such as 0 or 1 produce little further change. Changing 2 has minor influence in these simulations, and 3 is recommended (Bae et al., 11 Jun 2026).
The empirical application is the BIGPIC CRT in Western Kenya, comprising 4 health facility clusters randomized to four arms: usual care, usual care plus microfinance, group medical visits, and group medical visits plus microfinance. The outcome is 1-year change in systolic blood pressure. The mediator is a cluster-level sociometric network summary at 12 months, with density, transitivity, cohesion, and average path length analyzed separately. Pairwise treatment contrasts are constructed as GMV given MF and MF given GMV. Individual-level confounders include age, gender, livestock ownership, employment status, diabetes status, and cluster-centered baseline systolic blood pressure. Cluster-level confounders include county, facility type, baseline GISE, the cluster mean of baseline systolic blood pressure, and the cluster-level means of the individual-level confounders. In practice, SWBB is used with 5, 6, and 7 (Bae et al., 11 Jun 2026).
For both treatment comparisons and all four mediators, the population-level NIE, NDE, and ATE have 8 credible intervals that include 9, so the analysis does not find evidence of statistically significant mediation or total effects through these network summaries. SWBB nevertheless yields narrower credible intervals than BB and HBB without altering the substantive conclusion. For the comparison UC-MF versus GMV-MF with density as mediator, the ATE interval length is 00 under BB, 01 under HBB, and 02 under SWBB, approximately 03 shorter for SWBB. Similar reductions of approximately 04–05 are reported for NIE and ATE across mediators in both pairwise comparisons, with more modest reductions for NDE. Conditional analyses stratified by GISE or diabetes status produce wider intervals because of smaller effective sample sizes, but SWBB still gives the most precise estimates among the three bootstrap methods (Bae et al., 11 Jun 2026).
6. Assumptions, limitations, and relation to adjacent bootstrap methods
Beyond the usual causal assumptions, SWBB relies on several modeling assumptions. The discrete support on observed confounders implies an exchangeability-type requirement: the observed clusters and individuals are taken to represent the target population. The factorization uses the independence condition 06 as a modeling device to separate within-cluster and cross-cluster components. The distance 07 must be a reasonable proxy for similarity in the true confounder distributions, and the tuning parameters 08, 09, and 10 are fixed rather than learned. The method also inherits the limitation that it can only extrapolate within the observed covariate support, not beyond it. The current implementation is single-mediator, and the mediator model is deliberately kept parametric for stability with few clusters (Bae et al., 11 Jun 2026).
The paper suggests several extensions: combining SWBB with more flexible outcome and mediator models such as BART, DP mixtures, or nested dependent DPs; extending SWBB to smoothed Bayesian bootstrap variants; developing sensitivity analyses for violations of sequential ignorability; and moving to multiple or time-varying mediators under weaker identification assumptions. These are proposed directions rather than implemented components (Bae et al., 11 Jun 2026).
A concise comparison clarifies where SWBB sits among adjacent methods.
| Method | Weighting mechanism | Distinguishing feature |
|---|---|---|
| BB | Dirichlet weights on observed support | No cross-cluster borrowing |
| HBB | Cross-cluster borrowing tied to sample sizes | Can over-borrow from large but dissimilar clusters |
| SWBB | Distance-based Dirichlet borrowing weights | Borrowing targeted to similar clusters |
| WBB / CWBB | Random weights in the log-likelihood objective | Optimization-based approximate posterior sampling |
The distinction between SWBB and the weighted Bayesian bootstrap terminology used elsewhere is important. In the constrained weighted Bayesian bootstrap literature, “weighted Bayesian bootstrap” refers to Newton and Raftery’s optimization-based sampler: random Dirichlet- or exponential-derived weights are placed directly on the log-likelihood, and each weighted optimization yields an approximate posterior draw. That framework is parametric or semiparametric, its weights are independent of the data, and it does not implement similarity-based weighting (Rosen et al., 2 Jun 2026). By contrast, SWBB is a BB-type prior on the empirical confounder distribution itself, with explicit distance-based borrowing across clusters (Bae et al., 11 Jun 2026).
Relative to broader nonparametric Bayes, SWBB is more modest than Dirichlet process mixtures because it keeps the support fixed at observed confounders and randomizes only the weights. This suggests a tradeoff emphasized in the source material: exact conjugacy and computational simplicity are retained, while latent mixture structure is not modeled. The paper is methodological and empirical rather than asymptotic; explicit asymptotic theorems are not developed for SWBB. A plausible implication is that its finite-sample appeal, particularly in small-11 CRTs, rests less on large-sample theory than on the combination of exact Dirichlet updating for the confounder distribution, semiparametric causal identification, and the observed simulation evidence for nominal coverage and reduced RMSE (Bae et al., 11 Jun 2026).