Papers
Topics
Authors
Recent
Search
2000 character limit reached

CC-SHAP: Fast Shapley Attribution

Updated 13 July 2026
  • The paper introduces a budgeted CC-SHAP method that selects top-k contributive cooperators using second-order gradient interactions to efficiently approximate Shapley values.
  • It reduces the exponential complexity of feature coalition enumeration to O(M·N) evaluations by focusing on the most influential feature interactions while maintaining error bounds.
  • Empirical evaluations on datasets like Census Income, German Credit, and Criteo CTR demonstrate that CC-SHAP outperforms Kernel- and permutation-based methods in both accuracy and speed.

Searching arXiv for papers on CC-SHAP and related terminology. CC-SHAP is a fast Shapley-value estimation method for deep neural network explanations based on selecting a small set of feature-specific “contributive cooperators,” thereby avoiding enumeration of all possible input feature coalitions. In the original paper, the method is named SHEAR and is presented as an acceleration strategy for Shapley explanation in DNNs under a fixed evaluation budget; the core idea is to use second-order cross-feature information to retain only the most relevant cooperative interactions for each explained feature (Wang et al., 2022).

1. Problem setting and nomenclature

Shapley values provide an additive attribution of a model prediction to input features, but their direct computation requires enumeration over all subsets of features, which induces exponentially growing complexity. CC-SHAP addresses this bottleneck by replacing full coalition enumeration with a restricted coalition family tailored separately for each feature. The restriction is not arbitrary: it is guided by a feature-interaction quantity derived from mixed second derivatives of the DNN value function.

In the source paper, the method is called SHEAR, whereas the designation CC-SHAP refers to the same contributive-cooperator mechanism summarized under the name “contributive cooperator selection.” The setting assumes a differentiable DNN value function fv:2MRf_v:2^M\to\mathbb{R} on feature set U={1,,M}U=\{1,\dots,M\}, an instance xRMx\in\mathbb{R}^M, and a reference or baseline xˉ\bar x. The objective is to approximate each feature attribution ϕi\phi_i accurately while using only N2MN\ll 2^M total model evaluations (Wang et al., 2022).

2. Contributive cooperators and cross-contribution

A contributive cooperator for feature ii is a feature jij\neq i whose joint second-derivative with ii is large. The paper formalizes this by the cross-contribution

ηi,j=xixˉi14i,j2fv(U)+j,i2fv(U)xjxˉj.\eta_{i,j} = |x_i-\bar x_i| \cdot \frac14 \cdot \left|\nabla^2_{i,j}f_v(U)+\nabla^2_{j,i}f_v(U)\right| \cdot |x_j-\bar x_j|.

This quantity measures how strongly U={1,,M}U=\{1,\dots,M\}0 and U={1,,M}U=\{1,\dots,M\}1 “cooperate.” The approximation strategy is then to choose, for each feature U={1,,M}U=\{1,\dots,M\}2, a subset U={1,,M}U=\{1,\dots,M\}3 consisting of the top-U={1,,M}U=\{1,\dots,M\}4 features U={1,,M}U=\{1,\dots,M\}5 ranked by U={1,,M}U=\{1,\dots,M\}6. Those selected features are the contributive cooperators (Wang et al., 2022).

The construction is explicitly local to feature U={1,,M}U=\{1,\dots,M\}7. Rather than seeking one global coalition basis for all explanations, CC-SHAP assigns each explained feature its own restricted cooperative neighborhood. This matters because Shapley interactions are generally heterogeneous across features: a feature that is jointly important with one subset of variables need not interact strongly with another. A plausible implication is that the method allocates computational budget where interaction structure is most consequential for the specific attribution being estimated.

The paper further derives the practical selection rule from an approximation of an error-control coefficient: U={1,,M}U=\{1,\dots,M\}8 which leads directly to the use of U={1,,M}U=\{1,\dots,M\}9 as a one-point proxy for the importance of keeping feature xRMx\in\mathbb{R}^M0 in the coalition family for feature xRMx\in\mathbb{R}^M1.

3. Shapley chain rule and approximation objective

The theoretical basis of CC-SHAP is a Shapley chain rule stating that

xRMx\in\mathbb{R}^M2

where

xRMx\in\mathbb{R}^M3

and

xRMx\in\mathbb{R}^M4

This identity expresses the effect of removing a feature xRMx\in\mathbb{R}^M5 from the coalition universe of feature xRMx\in\mathbb{R}^M6 in terms of a second-order interaction term plus higher-order infinitesimals (Wang et al., 2022).

From this, the paper derives the error bound

xRMx\in\mathbb{R}^M7

with

xRMx\in\mathbb{R}^M8

By repeatedly removing all features not retained in a chosen subset xRMx\in\mathbb{R}^M9, the summary gives

xˉ\bar x0

This yields the coalition-selection objective

xˉ\bar x1

Equivalently, CC-SHAP minimizes the neglected interaction mass by preserving the xˉ\bar x2 strongest cooperators. The theoretical interpretation is direct: the residual approximation error is controlled by the omitted cross-contributions. The paper also states that as xˉ\bar x3 increases the upper bound decays to zero, and when xˉ\bar x4 one recovers the exact Shapley (Wang et al., 2022).

4. Algorithmic workflow and computational profile

The algorithm takes as input a DNN xˉ\bar x5, an instance xˉ\bar x6, a baseline xˉ\bar x7, and a budget xˉ\bar x8 of total evaluations. In the algorithm summary, one sets xˉ\bar x9; in the practical guidance, the recommendation is ϕi\phi_i0. For each feature ϕi\phi_i1, the method proceeds in three main steps (Wang et al., 2022).

First, it computes ϕi\phi_i2 for every ϕi\phi_i3. The summary notes that one backward pass per feature can yield all ϕi\phi_i4. Second, it selects the top-ϕi\phi_i5 features by ϕi\phi_i6 to form ϕi\phi_i7, using a greedy sort of complexity ϕi\phi_i8. Third, it estimates ϕi\phi_i9 by enumerating all N2MN\ll 2^M0 coalitions of N2MN\ll 2^M1, while handling all other features with antithetic sampling.

Let N2MN\ll 2^M2 be all subsets of N2MN\ll 2^M3. Pair each N2MN\ll 2^M4 with N2MN\ll 2^M5 and its antithetic complement in N2MN\ll 2^M6. The attribution estimate is

N2MN\ll 2^M7

where N2MN\ll 2^M8 are the Shapley weights restricted to N2MN\ll 2^M9. This step costs ii0 forward passes.

The summary reports the per-feature complexity as one backward pass ii1 plus ii2 forwards ii3, with overall sequential cost

ii4

In condensed form, the method reduces the ii5 blowup of exact Shapley to ii6 evaluations by combining cross-gradient-based cooperator selection with a small ii7 enumeration augmented by antithetic sampling (Wang et al., 2022).

5. Empirical evaluation

The empirical study covers three datasets: Census Income, German Credit, and Criteo CTR. Census Income contains 5 continuous and 8 categorical features with train/val/test split ii8. German Credit contains 7 continuous and 9 categorical features with split ii9. Criteo CTR contains 13 continuous and 26 one-hot features with split jij\neq i0. The models are a 3-layer MLP with hidden size 64 and ReLU for Census and German, trained with Adam at learning rate jij\neq i1, and DeepFM with embedding dimension 32 for Criteo, trained with Adam at learning rate jij\neq i2 (Wang et al., 2022).

The baselines are Kernel-SHAP (KS), KS-Welford (KS-WF), KS-Pair, Permutation Sampling (PS), and Antithetic Permutation (APS). Evaluation uses five metrics:

  • Absolute Error (AE): jij\neq i3 against true brute-force Shapley.
  • Ranking Accuracy (ACC): agreement of sorted attributions with the ground-truth ranking.
  • Faithfulness: Pearson correlation between jij\neq i4 and jij\neq i5.
  • Monotonicity: fraction of forward-add steps that preserve decreasing contribution order.
  • Throughput: number of test instances divided by total explanation time.

The reported findings are consistent across these criteria. For fixed jij\neq i6, CC-SHAP attains the lowest AE and highest ACC. It also yields the best faithfulness and monotonicity curves. In throughput-versus-ACC trade-off, it lies on the Pareto-front and outperforms all baselines. The summary therefore characterizes the method as outperforming state-of-the-art Kernel- and Permutation-based approximations in both accuracy and speed without sacrificing faithfulness (Wang et al., 2022).

6. Practical use, scope, and relation to adjacent SHAP lines

The practical guidance is budget-centric. One chooses an evaluation budget jij\neq i7, sets jij\neq i8, and uses the corresponding jij\neq i9 restricted enumeration. The summary states that increasing ii0 improves accuracy roughly exponentially because ii1. Small ii2, such as ii3–ii4, still captures most salient cooperations, whereas larger ii5 implies larger ii6, more cooperators, and an error bound that decays toward zero. Proposed extensions include using second-order cross-contributions beyond a single point, adaptively selecting ii7 per feature based on a desired local error bound, extending to group interactions through higher-order Shapley chains, and parallelizing across features or antithetic coalitions on multi-GPU or distributed backends (Wang et al., 2022).

The method belongs to the broader literature on reducing the computational burden of SHAP, but its mechanism is specific. It is not an exact SHAP algorithm; rather, it is a budgeted approximation scheme with provable error control based on featurewise second-order cooperation. This contrasts with work on exact tractability for specific model classes. For example, exact SHAP for arbitrary tensor networks is stated to be ii8-hard, whereas for Tensor Trains the problem lies in ii9, and decision trees, ensembles, linear models, and linear RNNs inherit that ηi,j=xixˉi14i,j2fv(U)+j,i2fv(U)xjxˉj.\eta_{i,j} = |x_i-\bar x_i| \cdot \frac14 \cdot \left|\nabla^2_{i,j}f_v(U)+\nabla^2_{j,i}f_v(U)\right| \cdot |x_j-\bar x_j|.0 exact algorithm through TT reductions (Marzouk et al., 24 Oct 2025). That comparison places CC-SHAP in the regime where exact SHAP remains intractable or impractical and selective approximation is the operative strategy.

A separate source of ambiguity is nomenclature. The label cc-Shapley is also used by Martin and Haufe for causal context Shapley, an interventional modification of observational Shapley values that uses a structural causal model and do-calculus to eliminate collider-bias-induced spurious associations (Martin et al., 23 Feb 2026). That method is conceptually different from CC-SHAP/SHEAR. The former changes the semantics of the value function by moving from conditioning to intervention; the latter keeps the Shapley target fixed and accelerates its computation via contributive cooperator selection. This distinction is essential because the two methods address different failure modes: one concerns computational complexity, the other causal interpretability.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to CC-SHAP.