---
title: Conformal Selective Borrowing (CSB)
url: https://www.emergentmind.com/topics/conformal-selective-borrowing-csb
type: topic
---

# Conformal Selective Borrowing (CSB)

Conformal Selective Borrowing (CSB) is a statistical framework for individualized, data-adaptive borrowing of information across heterogeneous datasets, with rigorous finite-sample guarantees. Fundamentally, CSB combines conformal inference for exchangeability testing with robust estimation (notably, doubly robust estimators) and exact randomization-based hypothesis testing. Its applications include hybrid controlled trials (HCTs) that combine randomized controlled trials (RCTs) with external controls (ECs), multi-regional clinical trials under covariate/outcome mismatch, and selective conformal prediction under interventions in causal discovery settings. The central objective of CSB is to optimize the bias-variance trade-off by adaptively borrowing only those external samples that are statistically indistinguishable—at the level of potential outcome distributions or calibration score behavior—from the target or primary population, while strictly controlling type I error and providing robust inference in finite samples [2505.00217] [2410.11713] [2602.02703] [2603.02204].

## 1. Conceptual Foundation and Motivation

CSB arises from the need to improve efficiency (statistical power and precision) in estimation and inference when primary data (e.g., from an RCT or target region) are limited, but additional, possibly biased, auxiliary or external data are available. Borrowing external data naively can introduce bias via unmeasured confounding, distributional shift, or intervention-induced outcome drift. CSB addresses two critical sources of mismatch:

- **Covariate shift**: Distributional differences in observed covariates between the auxiliary and target samples.
- **Outcome incomparability (hidden bias/drift)**: Differences in the conditional outcome distributions not explained by measured covariates.

The CSB methodology provides a solution by carrying out unit-level, finite-sample-valid exchangeability tests, borrowing only auxiliary units that pass these tests. This paradigm achieves robustness to unmeasured confounding and drift, while maintaining (or often improving) efficiency over strictly target-only analyses [2505.00217] [2410.11713] [2602.02703] [2603.02204].

## 2. Algorithmic Structure of CSB

### 2.1 Conformal Exchangeability Testing

At the core of CSB is the computation of conformal (nonconformity) scores $s_j$ for candidate auxiliary units $j$. These scores quantify the degree to which each external observation aligns with the reference (target) distribution. In the HCT context, nearest-neighbor-based scores are widely used:
$$
s_j = \min\left\{ d(X_j, X_i) : i\in\mathcal{C}, Y_i = Y_j \right\}
$$
where $\mathcal{C}$ is the calibration set of RCT controls, $X$ denotes covariates, and $Y$ is the (binary) outcome [2505.00217].

A label-conditional extension (LC-NN) compares these scores within strata of $Y$ to enforce conditional validity, crucial for binary outcomes [2505.00217]. In broader settings, such as MRCT or regression, nonconformity scores based on regression residuals are adopted:
$$
s_j = \left| Y_j - \hat{f}_{-j}(X_j) \right|
$$
where $\hat{f}_{-j}$ is a predictor (e.g., regression model) trained on the reference sample [2410.11713] [2602.02703].

### 2.2 Conformal $p$-Value and Selection

The conformal $p$-value for each external observation quantifies its compatibility with the reference set:
$$
p_j = \frac{1 + \sum_{i\in \text{Ref}} I\{ s_i \geq s_j \}}{|\text{Ref}| + 1}
$$
These $p_j$ are finite-sample valid under exchangeability of $j$ with the reference. Fixing a threshold $\gamma$ yields the selected set:
$$
\hat{E}(\gamma) = \{ j : p_j > \gamma \}
$$
Thus, $E(\gamma)$ is the adaptively "borrowed" subset [2505.00217] [2410.11713] [2602.02703].

### 2.3 Robust Estimation and Inference

CSB can be integrated with doubly robust (AIPW or DR) estimation of the parameter of interest. For example, in HCTs for binary outcomes, the CSB estimator has the general form:
$$
\hat{\tau}_{\mathrm{CS}}(\gamma) = \frac{1}{n}\sum_{i=1}^n [ S_i \hat{\Delta}_i + (S_i A_i / \hat{e}(X_i)) \hat{R}_{1,i} - \hat{W}_i \hat{R}_{0,i} ]
$$
where the external sample is restricted to $\hat{E}(\gamma)$. For region-specific ATEs in MRCTs, similar DR forms with observed covariates are used [2505.00217] [2602.02703].

### 2.4 Threshold Optimization

Bias/variance tradeoffs are governed by the choice of $\gamma$. CSB uses a mean squared error (MSE) proxy, often estimated via bootstrap, to select the optimal threshold:
$$
\gamma^* = \arg\min_{\gamma \in \Gamma} \widehat{\mathrm{MSE}}(\gamma)
$$
where
$$
\widehat{\mathrm{MSE}}(\gamma) = (\hat{\tau}_\gamma - \hat{\tau}_1)^2 - \widehat{\mathrm{Var}}(\hat{\tau}_\gamma - \hat{\tau}_1) + \widehat{\mathrm{Var}}(\hat{\tau}_\gamma)
$$
[2410.11713] [2505.00217] [2602.02703].

### 2.5 Randomization Inference

Final inference is performed via a Fisher randomization test, re-randomizing treatment assignments and re-selecting auxiliary units as per the CSB procedure at each permutation. This produces exact finite-sample type I error control, even after data-adaptive selection [2505.00217] [2410.11713] [2602.02703].

## 3. Theoretical Guarantees

CSB provides the following guarantees:

- **Finite-Sample Validity**: The conformal $p_j$ satisfy $P(p_j \leq \alpha) \leq \alpha$ under exchangeability, with label-conditional validity in the LC-NN extension [2505.00217] [2410.11713].
- **Exact Type I Error Control**: The Fisher randomization test with a selection-aware CSB statistic yields $P(p^FRT \leq \alpha) \leq \alpha$ for any fixed threshold $\gamma$, even after threshold selection [2505.00217] [2410.11713] [2602.02703].
- **Adaptive Power–Robustness Trade-Off**: When no hidden bias is present, CSB closely matches the power and bias of full-borrowing; when bias is present, CSB adapts by discarding contaminated units, maintaining small bias and lowered MSE relative to both no-borrow and full-borrow strategies [2410.11713] [2505.00217] [2602.02703].
- **Contamination-Robust Coverage**: In interventions with possibly contaminated calibration sets, CSB allows explicit finite-sample lower bounds on coverage:
$$
P(Y \in C) \geq 1 - \alpha - g(\delta, n)
$$
where $g(\delta, n) = \frac{\delta n}{(1-\delta) n + 1}$ and $\delta$ is the contamination fraction. A coverage correction is possible by inflating the nominal level [2603.02204].

## 4. Methodological Extensions and Applications

### 4.1 Hybrid and Multi-Regional Controlled Trials

In HCTs, CSB combines nearest-neighbor conformal tests with doubly robust AIPW estimators for risk difference, risk ratio, or odds ratio for binary outcomes [2505.00217]. In MRCTs, CSB enables selective borrowing for region-specific estimands, combining small-sample covariate-rich estimators with large-sample restricted estimators and using conformal inference to select borrowable auxiliary-region patients adaptively [2602.02703].

### 4.2 Selective Conformal Inference under Interventions

In interventional regimes, such as genomics experiments, CSB restricts calibration scores to interventions estimated (via partial causal learning) to leave the test variable unaffected. This leads to (i) tighter intervals, (ii) explicit coverage loss formulas under contamination, and (iii) algorithms such as perturbation-intersection and local invariant causal prediction to identify eligible calibration sets [2603.02204].

### 4.3 Finite-Sample Inference and Post-Selection Validity

CSB's selection step is always "replayed" at each permutation of the randomization test, preserving exact type I error control even after selection. This is critical for valid post-selection inference in small samples or high-dimensional settings [2505.00217] [2410.11713].

## 5. Empirical Results

Simulations and real-data analyses across diverse applications consistently support the efficiency and robustness of CSB. Key findings include:

- **Simulation studies**: Under no bias (e.g., $b=0$), full-borrowing and CSB lead to ≥20% reductions in MSE versus no-borrowing. As hidden bias is introduced, CSB adapts, maintaining small bias and controlling type I error, while full-borrowing becomes severely biased [2505.00217] [2410.11713].
- **Lung cancer hybrid trial**: CSB-FRT strictly controlled the type I error, selected 264 of 335 matched ECs, and yielded estimates between those of no-borrowing and full-borrowing approaches [2505.00217] [2410.11713].
- **Multi-regional trial**: CSB produced 10–50% reductions in mean squared error, sharper confidence intervals, and higher power than both NB-AllCov and full-borrowing estimators [2602.02703].
- **Intervention studies**: In both synthetic and real CRISPRi data, CSB significantly tightened conformal prediction intervals when support sets could be identified, with predicted coverage losses matching theoretical lower bounds [2603.02204].

## 6. Practical Implementation Considerations

CSB is computationally feasible for moderate sample sizes and is compatible with parallel computation. Tuning parameters include the choice of distance metric (Euclidean on standardized covariates is typical), number of folds (CV+ with $K=10$ is recommended), and threshold grid. Bootstrapping is used for threshold optimization. In practice, the Fisher randomization test with $B$ in the range 2000–10000 permutations typically suffices [2505.00217] [2410.11713].

Limitations include potential over-borrowing when bias is extremely subtle (no uniform power gain under strict type I error), and inability to remove bias arising from unmeasured confounders or covariates not present in both datasets [2505.00217] [2602.02703]. For weak null hypotheses, asymptotic validity requires studentized statistics [2505.00217].

## 7. Summary and Outlook

CSB constitutes a unified, finite-sample-valid framework for robust, individualized information borrowing across heterogeneous data regimes, combining conformal inference, robust estimation, and randomization-based inference. The method is scalable, generic, and offers substantial efficiency gains without compromising validity. The growing suite of applications—in hybrid and multi-regional clinical trials, causal discovery, and statistical prediction under interventions—demonstrates its adaptability and relevance for modern statistical challenges where heterogeneity and small-sample validity concerns are paramount [2505.00217] [2410.11713] [2602.02703] [2603.02204].

Source: https://www.emergentmind.com/topics/conformal-selective-borrowing-csb