Papers
Topics
Authors
Recent
Search
2000 character limit reached

Similarity-Weighted Bayesian Bootstrap

Updated 4 July 2026
  • SWBB is a semiparametric extension of the Bayesian bootstrap that employs distance-based Dirichlet weights to borrow information across similar clusters.
  • It models the joint distribution of cluster- and individual-level confounders nonparametrically while using parametric mediator and outcome regressions for causal mediation in CRTs.
  • Empirical evaluations show SWBB achieves lower RMSE and narrower credible intervals compared to traditional bootstrap methods in small-cluster settings.

Similarity-Weighted Bayesian Bootstrap (SWBB) is a modification of Rubin’s Bayesian bootstrap tailored to clustered data and, specifically, to causal mediation in cluster randomized trials (CRTs) with a small number of clusters and a cluster-level mediator. In the semiparametric framework developed for causal mediation in CRTs, SWBB models the joint distribution of cluster-level and individual-level confounders nonparametrically, while outcome and mediator regressions remain parametric. Its distinguishing feature is an explicit similarity-based information-borrowing mechanism across clusters, implemented through distance-dependent Dirichlet weights, so that inference borrows more from confounder profiles that are closer in covariate space (Bae et al., 11 Jun 2026).

1. Definition and scope

The classical Bayesian bootstrap represents an unknown distribution FF as a discrete distribution supported on the observed values, with random Dirichlet weights. In the SWBB construction, that nonparametric representation is retained, but it is applied not to the full data distribution but to the joint distribution of the confounders (C,V)(\mathbf{C},\mathbf{V}), where Vj\mathbf{V}_j denotes the cluster-level confounder vector for cluster jj and Cji\mathbf{C}_{ji} denotes the individual-level confounder vector for individual ii in cluster jj (Bae et al., 11 Jun 2026).

SWBB extends the standard Bayesian bootstrap in three ways. First, it maintains a discrete support on the observed confounders. Second, it introduces a distance metric dljd_{lj} between clusters ll and jj, which encodes an explicit similarity-based information-borrowing mechanism across clusters. Third, it uses this distance to define Dirichlet priors on cluster-to-cluster weights

(C,V)(\mathbf{C},\mathbf{V})0

so that a target cluster (C,V)(\mathbf{C},\mathbf{V})1 can borrow confounder information from all observed clusters, but more strongly from clusters deemed closer in covariate space.

This construction is meant to address a specific inferential problem. In CRT mediation settings with a small number of clusters, asymptotic variance approximations can be unreliable, fully parametric models for (C,V)(\mathbf{C},\mathbf{V})2 can be unstable or misspecified, and cluster-specific empirical distributions can be too noisy when within-cluster confounder variation is limited. SWBB is designed to remain conjugate and computationally simple while reducing variance by borrowing strength primarily from similar clusters (Bae et al., 11 Jun 2026).

2. Hierarchical formulation and similarity mechanism

The SWBB factorization begins from the modeling device

(C,V)(\mathbf{C},\mathbf{V})3

under which, for an observed pair (C,V)(\mathbf{C},\mathbf{V})4,

(C,V)(\mathbf{C},\mathbf{V})5

Each factor is modeled with BB-type Dirichlet weights (Bae et al., 11 Jun 2026).

At the cluster level,

(C,V)(\mathbf{C},\mathbf{V})6

Within a donor cluster (C,V)(\mathbf{C},\mathbf{V})7,

(C,V)(\mathbf{C},\mathbf{V})8

The novel component is the inter-cluster allocation

(C,V)(\mathbf{C},\mathbf{V})9

for which SWBB places a Dirichlet prior with base measure proportional to a similarity vector derived from pairwise cluster distances (Bae et al., 11 Jun 2026).

The distance is

Vj\mathbf{V}_j0

Here, Vj\mathbf{V}_j1 is the average pairwise distance in the cluster-level confounder space, and Vj\mathbf{V}_j2 is the average pairwise distance between the individual-level confounder sets of clusters Vj\mathbf{V}_j3 and Vj\mathbf{V}_j4, using a standard norm such as Vj\mathbf{V}_j5 or Vj\mathbf{V}_j6. The parameter Vj\mathbf{V}_j7 controls the relative importance of cluster-level and individual-level distances, whereas Vj\mathbf{V}_j8 controls how quickly similarity decays. As Vj\mathbf{V}_j9, cross-cluster borrowing becomes negligible and SWBB approaches the standard Bayesian bootstrap; for larger jj0, borrowing becomes more global (Bae et al., 11 Jun 2026).

A useful interpretation is obtained by defining

jj1

The quantity jj2 is interpreted as the number of “pseudo-subjects” contributed from cluster jj3 to the conditional confounder distribution for target cluster jj4. Under this scaling, smaller target clusters receive more pseudo-subjects, and among potential donor clusters, those with higher similarity contribute more. This generalizes the hierarchical Bayesian bootstrap (HBB), whose borrowing weights depend only on sample sizes rather than similarity (Bae et al., 11 Jun 2026).

The resulting joint discrete distribution can be written as

jj5

Accordingly, SWBB is a nonparametric prior on the joint empirical distribution of multilevel confounders with a hierarchical structure: jj6

3. Place within semiparametric causal mediation

The observed data are

jj7

with treatment jj8, cluster-level mediator jj9, and individual-level outcome Cji\mathbf{C}_{ji}0. The framework combines SWBB for the confounder distribution with parametric regression models for the mediator and outcome. The outcome model is a generalized linear mixed model,

Cji\mathbf{C}_{ji}1

with Cji\mathbf{C}_{ji}2 and Cji\mathbf{C}_{ji}3. The mediator model is a cluster-level generalized linear model,

Cji\mathbf{C}_{ji}4

with Cji\mathbf{C}_{ji}5. The overall procedure is therefore semiparametric: Cji\mathbf{C}_{ji}6 and Cji\mathbf{C}_{ji}7 are parametric, while Cji\mathbf{C}_{ji}8 is modeled nonparametrically through SWBB (Bae et al., 11 Jun 2026).

The causal estimands are the natural indirect effect (NIE) and natural direct effect (NDE). At the population level,

Cji\mathbf{C}_{ji}9

Identification is based on cluster-level SUTVA, sequential ignorability with baseline confounders ii0, and positivity. In CRTs with cluster randomization, the exposure ignorability condition is guaranteed by design (Bae et al., 11 Jun 2026).

Under these assumptions, nested potential outcomes are identified by the mediation formula. At the population level,

ii1

SWBB supplies the nonparametric ii2, and hence ii3 and ii4, that enter these integrals. In this sense, SWBB occupies the confounder-distribution component of the mediation functional rather than the outcome or mediator regression component (Bae et al., 11 Jun 2026).

4. Computational implementation

The implementation proceeds within MCMC. At each iteration, cluster-level weights ii5 are drawn from ii6, inter-cluster weights ii7 are drawn from their posterior Dirichlet distributions using precomputed distances ii8, and within-cluster weights ii9 are drawn from jj0. These draws determine the discrete approximation

jj1

Mediator and outcome model parameters are then sampled by standard MCMC; the paper notes implementation via Stan or similar, but does not spell out the exact sampler (Bae et al., 11 Jun 2026).

Potential mediators are simulated from the mediator model, often using either the GLM predictive mean or a draw from the predictive distribution. The mediation functionals are then computed as weighted sums over the SWBB support points. For example, the population-level nested potential outcome is approximated by summing over cluster-level weights, inter-cluster borrowing weights, and within-cluster empirical weights, with the parametric outcome regression evaluated at the sampled or plug-in mediator value. NDE, NIE, and ATE are obtained at each iteration as differences of nested potential outcomes, and posterior summaries are formed from the resulting draws (Bae et al., 11 Jun 2026).

In the reported implementation, 4,000 iterations are used, with 2,000 discarded as burn-in. The principal computational costs are the one-time computation of pairwise jj2, which is jj3 naively, and the MCMC for the parametric models. With jj4 and moderate cluster sizes, the approach is described as tractable (Bae et al., 11 Jun 2026).

5. Empirical behavior in simulations and in the BIGPIC trial

The simulation study uses 1,000 datasets per scenario with jj5 clusters and jj6 individuals per cluster. Treatment is randomized as jj7. Cluster-level confounders consist of three variables, and individual-level confounders have six components with a mix of binary and continuous variables. Three scenarios are considered: jj8, weak dependence, and strong dependence. Under the chosen structural models, the true NIE, NDE, and ATE are jj9, dljd_{lj}0, and dljd_{lj}1, respectively (Bae et al., 11 Jun 2026).

Across these scenarios, bias is essentially dljd_{lj}2 for all methods, so BB, HBB, and SWBB are all approximately unbiased. The primary difference appears in RMSE. For NIE and ATE, SWBB attains lower RMSE than BB and HBB, especially for dljd_{lj}3. In the independence scenario, NIE RMSE decreases from dljd_{lj}4 under BB to dljd_{lj}5 under SWBB with dljd_{lj}6, about a dljd_{lj}7 improvement; ATE RMSE decreases from dljd_{lj}8 to dljd_{lj}9, about a ll0–ll1 improvement. In the strong-dependence scenario, NIE RMSE again decreases from ll2 to ll3. For NDE, RMSE differences are minimal, which the paper attributes to the linear mixed-model structure, under which the direct effect behaves like an intercept shift and is less sensitive to uncertainty in the confounder distribution. Coverage probabilities for nominal ll4 intervals remain around ll5–ll6 for all estimands and methods. Very small ll7 produces RMSE close to BB, increasing ll8 to approximately ll9 lowers RMSE, and larger values such as jj0 or jj1 produce little further change. Changing jj2 has minor influence in these simulations, and jj3 is recommended (Bae et al., 11 Jun 2026).

The empirical application is the BIGPIC CRT in Western Kenya, comprising jj4 health facility clusters randomized to four arms: usual care, usual care plus microfinance, group medical visits, and group medical visits plus microfinance. The outcome is 1-year change in systolic blood pressure. The mediator is a cluster-level sociometric network summary at 12 months, with density, transitivity, cohesion, and average path length analyzed separately. Pairwise treatment contrasts are constructed as GMV given MF and MF given GMV. Individual-level confounders include age, gender, livestock ownership, employment status, diabetes status, and cluster-centered baseline systolic blood pressure. Cluster-level confounders include county, facility type, baseline GISE, the cluster mean of baseline systolic blood pressure, and the cluster-level means of the individual-level confounders. In practice, SWBB is used with jj5, jj6, and jj7 (Bae et al., 11 Jun 2026).

For both treatment comparisons and all four mediators, the population-level NIE, NDE, and ATE have jj8 credible intervals that include jj9, so the analysis does not find evidence of statistically significant mediation or total effects through these network summaries. SWBB nevertheless yields narrower credible intervals than BB and HBB without altering the substantive conclusion. For the comparison UC-MF versus GMV-MF with density as mediator, the ATE interval length is (C,V)(\mathbf{C},\mathbf{V})00 under BB, (C,V)(\mathbf{C},\mathbf{V})01 under HBB, and (C,V)(\mathbf{C},\mathbf{V})02 under SWBB, approximately (C,V)(\mathbf{C},\mathbf{V})03 shorter for SWBB. Similar reductions of approximately (C,V)(\mathbf{C},\mathbf{V})04–(C,V)(\mathbf{C},\mathbf{V})05 are reported for NIE and ATE across mediators in both pairwise comparisons, with more modest reductions for NDE. Conditional analyses stratified by GISE or diabetes status produce wider intervals because of smaller effective sample sizes, but SWBB still gives the most precise estimates among the three bootstrap methods (Bae et al., 11 Jun 2026).

6. Assumptions, limitations, and relation to adjacent bootstrap methods

Beyond the usual causal assumptions, SWBB relies on several modeling assumptions. The discrete support on observed confounders implies an exchangeability-type requirement: the observed clusters and individuals are taken to represent the target population. The factorization uses the independence condition (C,V)(\mathbf{C},\mathbf{V})06 as a modeling device to separate within-cluster and cross-cluster components. The distance (C,V)(\mathbf{C},\mathbf{V})07 must be a reasonable proxy for similarity in the true confounder distributions, and the tuning parameters (C,V)(\mathbf{C},\mathbf{V})08, (C,V)(\mathbf{C},\mathbf{V})09, and (C,V)(\mathbf{C},\mathbf{V})10 are fixed rather than learned. The method also inherits the limitation that it can only extrapolate within the observed covariate support, not beyond it. The current implementation is single-mediator, and the mediator model is deliberately kept parametric for stability with few clusters (Bae et al., 11 Jun 2026).

The paper suggests several extensions: combining SWBB with more flexible outcome and mediator models such as BART, DP mixtures, or nested dependent DPs; extending SWBB to smoothed Bayesian bootstrap variants; developing sensitivity analyses for violations of sequential ignorability; and moving to multiple or time-varying mediators under weaker identification assumptions. These are proposed directions rather than implemented components (Bae et al., 11 Jun 2026).

A concise comparison clarifies where SWBB sits among adjacent methods.

Method Weighting mechanism Distinguishing feature
BB Dirichlet weights on observed support No cross-cluster borrowing
HBB Cross-cluster borrowing tied to sample sizes Can over-borrow from large but dissimilar clusters
SWBB Distance-based Dirichlet borrowing weights Borrowing targeted to similar clusters
WBB / CWBB Random weights in the log-likelihood objective Optimization-based approximate posterior sampling

The distinction between SWBB and the weighted Bayesian bootstrap terminology used elsewhere is important. In the constrained weighted Bayesian bootstrap literature, “weighted Bayesian bootstrap” refers to Newton and Raftery’s optimization-based sampler: random Dirichlet- or exponential-derived weights are placed directly on the log-likelihood, and each weighted optimization yields an approximate posterior draw. That framework is parametric or semiparametric, its weights are independent of the data, and it does not implement similarity-based weighting (Rosen et al., 2 Jun 2026). By contrast, SWBB is a BB-type prior on the empirical confounder distribution itself, with explicit distance-based borrowing across clusters (Bae et al., 11 Jun 2026).

Relative to broader nonparametric Bayes, SWBB is more modest than Dirichlet process mixtures because it keeps the support fixed at observed confounders and randomizes only the weights. This suggests a tradeoff emphasized in the source material: exact conjugacy and computational simplicity are retained, while latent mixture structure is not modeled. The paper is methodological and empirical rather than asymptotic; explicit asymptotic theorems are not developed for SWBB. A plausible implication is that its finite-sample appeal, particularly in small-(C,V)(\mathbf{C},\mathbf{V})11 CRTs, rests less on large-sample theory than on the combination of exact Dirichlet updating for the confounder distribution, semiparametric causal identification, and the observed simulation evidence for nominal coverage and reduced RMSE (Bae et al., 11 Jun 2026).

Definition Search Book Streamline Icon: https://streamlinehq.com
References (2)

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Similarity-Weighted Bayesian Bootstrap (SWBB).