SurrogateSHAP: A Surrogate-Based SHAP Framework
- SurrogateSHAP is a method that uses surrogate models (e.g., SLIM trees and neural networks) to approximate conditional expectations required for Shapley-style attributions.
- It replaces computationally expensive direct expectation calculations with tractable, dependence-aware surrogates, enhancing efficiency and interpretability.
- The framework applies to various domains—including tabular and graph-structured data—by addressing path dependency issues and aligning explanations with the data support.
Searching arXiv for SurrogateSHAP and closely related surrogate-based SHAP papers. SurrogateSHAP denotes a class of SHAP-oriented explanation methods in which a surrogate representation is used to make Shapley-style attribution computationally feasible, dependence-aware, or structurally interpretable. In the literature summarized here, the term refers most directly to a surrogate model-based tree framework for computing Shapley values and SHAP values using conditional expectations and to a surrogate neural network that learns conditional expectations under arbitrary feature subsets; closely related work uses surrogate trees for prediction shifts and tensor-network surrogates for graph-structured coalition games (Zhou et al., 2022). The common objective is not merely post hoc approximation of a prediction surface, but construction of a tractable engine for evaluating SHAP-relevant set functions such as conditional expectations, interventional means under subgroup conditionals, or masked coalition values (Richman et al., 2023).
1. Conceptual scope and historical positioning
The most direct use of the name SurrogateSHAP appears in work that fits a surrogate model to the fitted response and then uses that surrogate to approximate the conditional expectation needed by Shapley-style value functions (Zhou et al., 2022). In that formulation, the central problem is that both global Shapley and local SHAP require repeated evaluation of conditional expectations over many subsets , which is computationally expensive under feature dependence. The proposed remedy is to replace direct conditional-expectation computation by a structured surrogate, specifically a SLIM tree whose terminal nodes contain simple local models and whose path probabilities are estimated from data rather than treated as independent by default (Zhou et al., 2022).
A second major line uses a surrogate neural network that learns, in one shot, the subset-conditioned expectation
for arbitrary . This yields an efficient route to conditional SHAP for neural networks and other regression models while properly considering the dependence structure in the feature components (Richman et al., 2023).
Related work extends the surrogate principle beyond local prediction explanation. For explaining prediction shifts between two distributions and , a surrogate decision tree can be trained on black-box outputs over , and Shapley values are then assigned to subgroup conditional probability changes induced by tree splits (Bewley et al., 13 Apr 2026). For graph-structured inputs, a compact tensor-network surrogate can approximate the coalition-value function and then support deterministic recovery of Shapley values and higher-order interaction indices from the learned multilinear extension (Heidari et al., 1 Jun 2026).
This positioning also clarifies what SurrogateSHAP is not. DeepSHAP explains composite models by propagating Shapley-style attributions through the internal components of a model stack rather than by fitting a surrogate around the relevant value function, so it is a precursor in the Shapley-based explanation line rather than SurrogateSHAP itself (Chen et al., 2019). Likewise, WOODELF is an exact, model-specific SHAP/Banzhaf computation framework for decision trees and tree ensembles and is explicitly not a surrogate-model method in the usual SurrogateSHAP sense (Nadel et al., 12 Nov 2025).
2. Conditional-expectation foundations
A defining feature of SurrogateSHAP is its emphasis on conditional rather than purely marginal or path-independent semantics. In the surrogate model-based tree formulation, the Shapley coefficient for feature is written as
0
with two value functions distinguished by interpretation regime: for global Shapley,
1
and for SHAP,
2
The computational bottleneck is therefore the same in both settings: repeated estimation of 3 when predictors are dependent (Zhou et al., 2022).
The conditional expectation network formulation makes the same issue explicit for regression models. It contrasts conditional SHAP, based on
4
with the usual interventional approximation
5
The distinction matters because conditional SHAP respects the observed dependence structure among features, whereas unconditional SHAP breaks dependence by integrating over the marginal distribution of the missing features as if they were independent of the observed ones (Richman et al., 2023).
The conditional-expectation viewpoint also underlies criticisms of independence-based approximations. The surrogate model-based tree paper identifies a path dependency issue in Tree SHAP: splitting variables are treated as independent of other variables along the path, which can be inaccurate under correlation (Zhou et al., 2022). The conditional expectation network paper makes the complementary point that interventional SHAP can evaluate the model at feature combinations that may never occur in the data; its actuarial example states that unconditional SHAP can extrapolate into an unsupported region, while conditional SHAP remains aligned with the data-generating support (Richman et al., 2023).
A broader theoretical caution appears in work on aggregate SHAP for feature elimination. There, the standard global importance score
6
is shown to be unsound for feature removal if computed only on the original data support. The proposed fix is to aggregate over the extended distribution 7, the product of the marginals, under which small aggregate SHAP values do imply that a feature can be safely discarded (Bhattacharjee et al., 29 Mar 2025). This suggests that surrogate-based SHAP frameworks must be interpreted relative to the distributional semantics they approximate.
3. Surrogate constructions and computational mechanisms
Several distinct surrogate constructions appear in the literature, each tailored to a different SHAP-relevant object. The following summary is confined to the formulations explicitly described in the cited papers.
| Paper | Surrogate object | Target quantity |
|---|---|---|
| (Zhou et al., 2022) | SLIM tree with local models | 8 |
| (Richman et al., 2023) | Masked-input neural network | 9 for all 0 |
| (Bewley et al., 13 Apr 2026) | Surrogate decision tree | Prediction shift 1 via subgroup conditionals |
| (Heidari et al., 1 Jun 2026) | Graph-aligned tensor network | Coalition-value function 2 and multilinear extension |
In the SLIM-tree formulation, the key decomposition is
3
where 4 is a terminal node event, 5 is the path probability of reaching node 6 given the subset 7, and 8 is the local conditional expectation in that region (Zhou et al., 2022). If a splitting variable is in 9, the corresponding split probability is 1 once the instance is consistent with the split; if it is not in 0, the method rejects the usual independence assumption and instead fits a machine learning model locally to estimate
1
Within each terminal node, the local conditional expectation is taken to be additive,
2
with implementation using linear B-splines and weighted least squares (Zhou et al., 2022).
The conditional expectation network uses masked inputs. For a mask vector 3 and subset 4, the masked input is
5
A single neural network 6 is trained so that
7
for many 8 pairs (Richman et al., 2023). The empirical risk is triple-calibrated through three classes of examples: original inputs with target 9, fully masked inputs with target 0, and random partial masks with target 1. This enforces recovery of the full model at 2 and the null model at full masking (Richman et al., 2023).
The surrogate-tree method for prediction shifts changes the target quantity. Given two distributions 3 and 4, with
5
the prediction shift is 6. The surrogate tree is trained on black-box outputs over 7, but its impurity is not a standard predictive impurity. Instead, the proposed leaf impurity is
8
so that the tree is grown to minimize unexplained prediction shift rather than ordinary variance or Gini criteria (Bewley et al., 13 Apr 2026).
The tensor-network formulation treats the full coalition table as a structured multilinear object. For masked graph inputs, the game value is
9
and the multilinear extension is
0
A graph-aligned tensor network learns a surrogate 1, after which Shapley values are recovered deterministically by
2
The paper’s “Gate Replacement Principle” states that differentiated variables are handled by replacing 3 by 4 and contracting the tensor network as usual (Heidari et al., 1 Jun 2026).
4. Relation to other SHAP approximation paradigms
SurrogateSHAP belongs to a broader family of SHAP approximations, but its mechanism is distinct from several neighboring lines of work. A useful contrast is with methods that fit surrogate regressions directly on coalition samples. KernelSHAP, LeverageSHAP, and PolySHAP solve weighted regression problems over sampled coalitions and then return the exact Shapley values of the surrogate approximation; OddSHAP refines this family by proving that the Shapley value depends exclusively on the odd component of the set function and by performing regression only on the odd subspace (Fumagalli et al., 1 Feb 2026). This is surrogate estimation in the regression-on-coalitions sense, whereas the SLIM-tree and conditional-expectation-network formulations use surrogates to approximate the conditional-expectation engine itself (Zhou et al., 2022).
Another nearby line is the ensemble approximation of SHAP. ER-SHAP repeatedly samples random feature subspaces of size 5, computes “small” SHAP values on those subspaces, and averages them: 6 ERW-SHAP adds neighborhood generation and distance-based weights, while ER-SHAP-RF uses a random forest to define a feature-selection probability distribution (Utkin et al., 2021). These methods are explicitly described as surrogate SHAP-style local explanation strategies, but the proxy is an ensemble of many small SHAP computations rather than a single surrogate model (Utkin et al., 2021).
DeepSHAP is related in philosophy but not in mechanism. It is presented as a framework for layer wise propagation of Shapley values that builds upon DeepLIFT, supports mixed model stacks such as a neural network feature extractor into a tree model, and justifies use of a background distribution by averaging single-reference SHAP values over background samples (Chen et al., 2019). The essential operation is propagation of attributions through local components, not surrogate regression or surrogate conditional-expectation estimation.
The exact-computation literature also provides a contrast. WOODELF constructs pseudo-Boolean formulas for tree ensembles and computes Background SHAP, Path-Dependent SHAP, Shapley interaction values, Banzhaf values, and Banzhaf interaction values in a unified framework. It is explicitly positioned as an exact attribution engine rather than a surrogate explanation model (Nadel et al., 12 Nov 2025). This distinction matters because “surrogate” in SurrogateSHAP ordinarily refers to a learned intermediary whose fidelity and assumptions become part of the explanation semantics.
5. Empirical performance and reported use cases
The surrogate model-based tree paper reports simulation studies in Linear, Nonlinear, Interaction, and Binary response scenarios with correlations 7, using 8 samples for estimation and an additional 9 for out-of-sample testing of the surrogate tree (Zhou et al., 2022). For global Shapley, the reported squared errors of the proposed MBT method are described as very small, often around 0 to 1, with examples including 2, 3, 4, 5, 6, and 7, whereas the marginal, empirical conditional, and M.A.SHAP baselines are substantially worse (Zhou et al., 2022). In the bike-sharing case study, the surrogate tree fitted to XGBoost predictions achieves training 8 and test 9, and the resulting global rankings broadly agree with permutation importance and Tree SHAP aggregation (Zhou et al., 2022).
The conditional expectation network paper emphasizes computational reuse rather than a single headline metric. One surrogate network can be used for conditional SHAP, drop1, anova, MCEP, and loss attribution, thereby avoiding both fitting 0 separate models and nested conditional Monte Carlo for every subset (Richman et al., 2023). In the actuarial motor insurance example, it reports that the surrogate reproduces both full and null model losses well and that conditional SHAP gives sensible explanations in settings where unconditional SHAP can overstate importance for variables whose combinations are out of support (Richman et al., 2023).
For distribution shift explanation, the surrogate-tree variant shows a sharp reduction in incompleteness when trained with the proposed impurity objective. On Pima Indians Diabetes with 10-leaf surrogates, the paper reports about 1 unexplained for a naive surrogate and about 2 unexplained for the optimized surrogate, where
3
Across 250 real distribution shifts over five Folktables tasks, the method is reported to run efficiently, usually achieve low unexplained shift, produce parsimonious explanations with a few dominant subgroup conditionals, and exhibit median R-Faithfulness above 4 for all model classes, including neural networks with surrogates (Bewley et al., 13 Apr 2026).
For graph-structured inputs, TN-SHAP-G reports extremely close agreement with exact Shapley values on small molecular graphs: on Benzene, O1 cosine 5 and O2 cosine 6; on Mutagenicity, O1 cosine 7 and O2 cosine 8 (Heidari et al., 1 Jun 2026). Against sampling-based estimators such as permutation sampling and SHAP-IQ, it is reported to reach about 9 cosine similarity with roughly 0–1 fewer model queries, and on PROTEINS it maintains test 2 across graphs up to 600 nodes with Shapley efficiency gaps on the order of 3 to 4 (Heidari et al., 1 Jun 2026). This suggests that surrogate-based SHAP is not confined to tabular local explanation, but can serve as an amortized attribution engine in structured domains.
6. Assumptions, limitations, and interpretive issues
The main limitations of SurrogateSHAP are tied to what the surrogate is assumed to approximate. In the SLIM-tree framework, three assumptions are explicit: only the top important variables are used in each split node to compute path probabilities; the local conditional expectation in each terminal node is additive; and thresholding ignores unselected subsets, improving speed at the cost of accuracy (Zhou et al., 2022). The thresholded subset family
5
is justified by the Shapley weight structure, but the paper notes that stronger feature correlation generally requires larger 6, and even 7 can leave about 10,000 subsets when 8 (Zhou et al., 2022).
The conditional expectation network introduces a different set of design constraints. Its calibration requires careful mask selection, ideally satisfying 9, and the training data are synthetically expanded through full masking and random partial masking (Richman et al., 2023). This suggests that fidelity depends not only on network capacity but also on whether the mask state yields a stable and non-conflicting representation of “missingness.” The paper also frames the surrogate as a regularized proxy, which is useful computationally but means that explanation faithfulness remains mediated by surrogate fit (Richman et al., 2023).
In the shift-explanation setting, the surrogate is only an approximation to the black-box model, so the decomposition is explicitly augmented by a residual factor 0 and evaluated through PercentUnexplained (Bewley et al., 13 Apr 2026). That residual is not a peripheral quantity; it is the completeness diagnostic that determines whether the subgroup-conditional explanation is near-complete or only partial.
A recurrent misconception is that any SHAP-based approximation is interchangeable with SurrogateSHAP. The literature summarized here does not support that equivalence. DeepSHAP uses propagation, ER-SHAP uses ensembles of small SHAP runs, OddSHAP uses odd-subspace regression, and WOODELF is exact on tree ensembles rather than surrogate-based (Chen et al., 2019). Another misconception is that aggregate SHAP values can always justify feature removal. The safe-discarding results show that this is false on the original support and only becomes theoretically sound when the aggregation is performed over the extended distribution 1 or a scrambled sample approximating it (Bhattacharjee et al., 29 Mar 2025).
Taken together, these constraints indicate that SurrogateSHAP is best understood not as a single algorithm but as a surrogate-centered design pattern for SHAP computation. This suggests a unifying principle: the quality of the explanation is determined by how faithfully the surrogate captures the specific SHAP-relevant object—conditional expectations, subgroup interventional means, or coalition-value functions—rather than by surrogate accuracy in an undifferentiated predictive sense.