---
title: Chunked Data Shapley (C-DaSh)
url: https://www.emergentmind.com/topics/chunked-data-shapley-c-dash
type: topic
---

# Chunked Data Shapley (C-DaSh)

Searching arXiv for recent and directly related papers on Chunked Data Shapley and adjacent structured Shapley approximations.
Chunked Data Shapley (C-DaSh) is a scalable approximation to Data Shapley for large tabular datasets that changes the unit of valuation from individual tuples to chunks of tuples, with the aim of making dataset quality assessment feasible at scales where exact or existing approximate Shapley methods are too slow [2508.16255]. In C-DaSh, the dataset is partitioned into non-overlapping chunks, a Shapley-style contribution is estimated for each chunk rather than each tuple, and the resulting chunk scores are used as data-quality signals for identifying high-quality and low-quality regions of the data [2508.16255]. The method is positioned within a broader line of research on efficient data valuation that includes the original Data Shapley framework [1904.02868], grouped valuation via Owen values [1905.01805], stability-based small-coalition approximations [2206.00511], cardinality-restricted semivalues such as \(\delta\)-Shapley [2311.05346], proxy formulations such as DU-Shapley [2306.02071], and model-specific scalable coalition evaluation for LLM alignment [2512.15765]. Within that landscape, C-DaSh is distinctive in that it is explicitly chunk-based, is aimed at practical dataset quality assessment, and is empirically evaluated on large tabular classification and regression tasks with reported speedups between \(80\times\) and \(2300\times\) over prior approximations [2508.16255].

## 1. Conceptual basis and relation to Data Shapley

Data Shapley treats each training datum as a player in a cooperative game and assigns value according to average marginal contribution to model performance over all subsets of the dataset [1904.02868]. In the standard formulation used for supervised learning, a dataset \(D=\{(x_i,y_i)\}_{i=1}^n\), a learning algorithm \(\mathcal A\), and a performance function \(V(S)\) over subsets \(S\subseteq D\) define the game, and the Shapley value of datum \(i\) is the expectation of \(V(S_\pi^i\cup\{i\})-V(S_\pi^i)\) over permutations \(\pi\) [1904.02868]. The same player-by-subset logic underlies dataset valuation more broadly, including owner-level games [2306.02071] and source-level valuation for LLM alignment [2512.15765].

C-DaSh adopts this game-theoretic view but changes the granularity of the players. Instead of asking for the value of each tuple \(x_j\), it partitions the dataset into \(c\) distinct, non-overlapping chunks \((ch_1,\dots,ch_c)\) and estimates a score \(ds_j\) for each chunk [2508.16255]. The practical motivation is explicit: the paper argues that the granularity of valuation itself must be changed when exact Data Shapley, with complexity \(O(2^n)\), and tuple-level approximations such as TMC-Shapley and G-Shapley remain too expensive for large datasets [2508.16255].

This chunk-level reformulation places C-DaSh in partial continuity with earlier grouped-valuation ideas. “Computing a Data Dividend” studies individual sample valuation with Shapley values and contributor-level or coalition-structured valuation with Owen values, where pre-defined groups of samples are treated as coalitions and attribution is available both within and across groups [1905.01805]. That paper is a conceptual precursor to chunked valuation, but its exact polynomial-time algorithms are restricted to structured frequency-based decision rules and binary \(k\)-NN classification rather than general tabular ML pipelines [1905.01805]. C-DaSh, by contrast, is presented as a practical approximation for large tabular datasets using chunk-level Shapley-style estimation and SGD-based model-state updates [2508.16255].

A further distinction is that C-DaSh is not merely “group Shapley” in the sense mentioned in the original Data Shapley paper, where one can compute Shapley values for groups by replacing point \(i\) with group \(i\) if the number of groups is reasonable [1904.02868]. It adds a specific computational recipe: optimized subset selection, one-step SGD checkpoint updates, and iterative chunk scoring geared toward large-scale dataset quality assessment [2508.16255].

## 2. Formal formulation and chunk-level approximation

The dataset in C-DaSh is written as
\[
D = \left( x_1,\ x_2,\ x_3,\ \ldots,\ x_n\right),
\]
with learning algorithm \(\mathcal A\) and performance metric \(M\), where examples of \(M\) include accuracy, F1, MSE, and RMSE [2508.16255]. The paper restates the standard tuple-level Data Shapley value for tuple \(x_j\) under metric \(M\) as
\[
ds_{x_j}^M = \sum_{Z \subseteq D \setminus \{j\}} \frac{|Z|! \cdot (|D| - |Z| - 1)!}{|D|!} \left(M(Z \cup \{j\}) - M(Z)\right),
\]
with \(M(\cdot)\) serving directly as the utility function induced by training \(\mathcal A\) on a subset and evaluating performance [2508.16255].

C-DaSh replaces tuple-level players by chunks. The dataset is partitioned into \(c\) chunks of equal size \(l\), with \(c \ll n\) and \(l \ll n\), and the chunk score vector is denoted
\[
DS = (ds_1, ds_2, ds_3, \ldots, ds_c).
\]
The chunks are described as distinct, non-overlapping, and usually equal-sized [2508.16255]. For classification experiments they are formed by fixed-size grouping, while for regression or time-sensitive datasets the paper also uses semantically meaningful temporal chunks such as daily or monthly intervals [2508.16255].

The chunk-level approximation is given as
\[
ds_{ch_j}^M = \sum_{Z \subseteq \mathcal{S} \setminus \{j\}} \frac{C}{|D| \cdot |Z|} \left(M(w_j(Z \cup \{j\})) - M(w_j(Z))\right),
\]
where \(ch_j\) is the \(j\)-th chunk, \(\mathcal S\) is the selected collection of subsets, \(Z \subseteq \mathcal S\setminus\{j\}\) is a selected subset not containing chunk \(j\), \(C\) is a constant variable, and \(w_j(\cdot)\) denotes a model checkpoint or parameter state associated with chunk \(j\) and subset \(Z\) [2508.16255]. The marginal term \(M(w_j(Z \cup \{j\})) - M(w_j(Z))\) is the estimated contribution of adding chunk \(j\) [2508.16255].

The paper states explicitly that this is not the classical Shapley coefficient. The weighting term is
\[
\frac{C}{|D| \cdot |Z|},
\]
and the paper does not further derive this weighting or provide a theoretical proof for it [2508.16255]. This matters for interpretation. C-DaSh is therefore a chunk-level approximation introduced for practicality rather than a theorem-backed unbiased estimator of either point-level or exact chunk-level Shapley values [2508.16255].

A useful comparison is with several other structured approximations. The Layered Shapley Algorithm estimates the original full-data Shapley value by stratifying coalitions by size and sampling disproportionately from small coalitions, with sample allocation \(m_k \propto 1/k^2\) under a diminishing-returns condition \(v_i(C)\le c/k\) [2206.00511]. \(\delta\)-Shapley similarly restricts valuation to a band of coalition sizes and treats the result as a semivalue rather than exact Shapley [2311.05346]. DU-Shapley reduces the state space by approximating owner-level coalition utility through total aggregate dataset size \(n_{\mathcal S}\) and replacing combinatorial averages by a discrete uniform average over \(I\) representative size points [2306.02071]. These methods do not partition the data into chunks as players in the same way as C-DaSh, but they share the broader premise that valuation can be made practical by exploiting structure rather than treating all coalitions uniformly.

## 3. Algorithmic workflow

C-DaSh proceeds through a fixed pipeline centered on chunking, subset selection, and single-iteration SGD updates [2508.16255]. First, the dataset is partitioned into \(c\) non-overlapping chunks of size \(l\). Second, chunk scores are initialized as \(ds_j=0\) for \(j=1,\ldots,c\). Third, \(k\) candidate subsets are randomly initialized and then filtered through a subset selection mechanism [2508.16255].

The subset selection stage is one of the main algorithmic components emphasized in the paper. It imposes two constraints. First, each chunk should not appear in more than \(25\%\) of the selected subsets. Second, subsets that fail a threshold test are regenerated: for classification, subsets with metric lower than \(th\) are regenerated; for regression, subsets with metric higher than \(th\) are regenerated [2508.16255]. This is intended to make the selected subset family both diverse and sufficiently informative [2508.16255].

After subset selection, model parameters are initialized randomly,
\[
w_0 \leftarrow \text{Random Parameters}.
\]
Then, for each chunk \(ch_j\), C-DaSh considers subsets \(Z\subseteq \mathcal S\setminus\{j\}\), builds a model state using subset information, estimates the performance difference when \(ch_j\) is added, and accumulates a chunk-level Shapley-like contribution [2508.16255]. The central approximation that keeps the procedure scalable is the use of one-step SGD checkpoint updates rather than full retraining from scratch.

The model checkpoint update is
\[
w_j(Z) = w_{j-1} - \eta_j \sum_{x \in Z} \nabla \mathcal{L}(w_j, x),
\]
where \(w_{j-1}\) is the previous checkpoint, \(\eta_j\) is the learning rate at chunk \(ch_j\), and \(\mathcal L\) is the optimized loss function [2508.16255]. The paper presents this as a single-iteration stochastic gradient descent approximation mechanism for estimating how the model would change when trained on subset \(Z\) [2508.16255]. The intuition given is that model parameters encode “knowledge information” from previously included data, making marginal contribution estimation more accurate than subset-only black-box evaluation [2508.16255].

The loop is repeated until a truncation criterion is satisfied, described as following “a similar approach” to Ghorbani et al. [2508.16255]. The paper does not provide a precise mathematical stopping rule for truncation, so that aspect is not fully specified [2508.16255].

An implementation-oriented summary consistent with the paper is given below.

| Stage | Operation | Key controls |
|---|---|---|
| Partitioning | Split \(D\) into non-overlapping chunks \(ch_1,\dots,ch_c\) | chunk size \(l\) |
| Subset selection | Generate \(k\) subsets, enforce 25% chunk-frequency cap, threshold-filter weak subsets | \(k\), \(th\) |
| Scoring | Use one-step SGD checkpoints and accumulate chunk contributions | \(\eta\), \(C\), truncation criterion |

This suggests that C-DaSh is best understood as a practical chunk-level valuation pipeline rather than a closed-form valuation rule. A plausible implication is that its behavior depends materially on how chunk size, subset diversity, and threshold filtering interact with the data distribution and the training dynamics.

## 4. Computational rationale and empirical scaling

The computational motivation for C-DaSh is direct. Exact Data Shapley has complexity
\[
O(2^n),
\]
and the paper summarizes TMC-Shapley as \(O(m\cdot n)\), with \(m\approx 3n\) in practice, leading to roughly \(O(n^2)\) behavior, while G-Shapley is given as
\[
O(n \cdot T \cdot d),
\]
where \(T\) is the number of gradient descent steps or permutation passes and \(d\) is model parameter dimensionality [2508.16255]. These approximations remain expensive on large datasets with tens or hundreds of thousands of tuples [2508.16255].

For C-DaSh, no formal asymptotic complexity formula is given. The paper instead argues qualitatively that computation drops because valuation is performed over chunks and only \(k\) selected subsets are used, with \(k \ll c\) and \(k \ll n\) [2508.16255]. Thus the empirical efficiency gain comes from three sources: fewer players to value, fewer subsets to evaluate, and one-step SGD updates instead of full retraining [2508.16255].

The reported speedups are substantial. For the best chunk size of 250, the paper reports:

| Dataset | Speedup over G-Shapley | Speedup over TMC-Shapley |
|---|---:|---:|
| Adult | \(108\times\) | \(1890\times\) |
| Bank Marketing | \(80.68\times\) | \(1365.51\times\) |
| MIMIC-III | \(200\times\) | \(2300\times\) |

These values are drawn from Table 3 and are summarized in the abstract as speedups between \(80\times\) and \(2300\times\) [2508.16255]. The speedup metric is
\[
S = \frac{T_1}{T_2},
\]
where \(T_1\) is baseline runtime and \(T_2\) is C-DaSh runtime with subset selection [2508.16255].

The paper also reports a chunk-size tradeoff. Speed improves as chunk size increases up to around 250, then degrades beyond that because larger chunks mix high- and low-quality tuples and make subset selection less effective [2508.16255]. This suggests a nontrivial bias-variance-style compromise: smaller chunks preserve finer resolution but reduce scalability; larger chunks increase efficiency but blur localized quality signals. The paper’s own recommended operating point is around 250 tuples per chunk [2508.16255].

This tradeoff has close analogues in related literature. The stability-based Layered Shapley work argues that large coalitions carry little incremental signal under \(O(1/k)\) marginal bounds and can therefore be sampled only rarely [2206.00511]. \(\delta\)-Shapley similarly argues that small-to-medium coalitions often carry most of the useful valuation signal per unit compute, with reported speedup of up to \(9.9\times\) while preserving rank correlation with Monte Carlo Shapley in the range \([0.84,0.98]\) across several datasets [2311.05346]. DU-Shapley reduces combinatorial support from \(2^I\) to \(I\) under a size-based utility assumption [2306.02071]. C-DaSh differs in mechanism, but the same general principle is visible: coarse-graining the coalition problem is what makes large-scale valuation tractable.

## 5. Empirical use for dataset quality assessment

The paper evaluates C-DaSh on five real-world tabular datasets. The classification datasets are Adult, Bank Marketing, and MIMIC-III; the regression datasets are Air Quality and Household Power Consumption (HPC) [2508.16255]. For classification, the model is an MLP with two hidden layers; for regression, a similarly structured MLP for regression is used [2508.16255]. Categorical variables are one-hot encoded, and the main baselines are G-Shapley and TMC-Shapley from Ghorbani et al. [2508.16255].

The core evaluation protocol is valuation-guided removal. Chunk or data scores are computed, the lowest-scoring fraction \(\lambda\%\) is removed, the predictor is retrained, and downstream performance is measured. For classification the metric is accuracy; for regression it is RMSE. The MLP is trained five times per experiment and average performance is reported [2508.16255]. The rationale is standard in data valuation: if removing low-valued data improves performance, the valuation method has identified harmful or low-quality regions.

Across the three classification datasets, the paper reports that C-DaSh yields slightly better or similar accuracy to G-Shapley on Adult, is competitive with or slightly better than G-Shapley on Bank Marketing, and shows the clearest advantage on MIMIC-III, outperforming G-Shapley by about \(7\%\) and TMC-Shapley by about \(15\%\) in some removal settings [2508.16255]. These claims are specifically tied to the removal-based evaluation used in the paper.

The paper also performs controlled corruption experiments on Adult by injecting Gaussian noise into \(20\%\) of tuples and label corruption into \(20\%\) of labels [2508.16255]. For Gaussian noise, at \(\lambda=20\%\), C-DaSh reportedly outperforms G-Shapley by about \(30\%\) and TMC-Shapley by about \(40\%\) [2508.16255]. For label corruption, TMC-Shapley is better at very small removal \((\lambda=10\%)\), but C-DaSh is better at larger \(\lambda\) [2508.16255]. This suggests that chunk-level valuation is especially effective when low-quality data are regionally concentrated enough for chunking to capture them [2508.16255].

For outlier detection, the paper uses Local Outlier Factor after data removal and reports that C-DaSh achieves the lowest LOF scores across all three classification datasets and tested \(\lambda\) values, especially strong at \(\lambda=0.1\) [2508.16255]. The intended interpretation is that C-DaSh captures many outliers early [2508.16255].

The paper also compares C-DaSh with a “chunk average” baseline, where tuple-level Shapley scores from G-Shapley or TMC-Shapley are averaged within chunks. The text notes wording inconsistencies, but the intended conclusion is that native chunk evaluation in C-DaSh can identify low-quality chunks more precisely than simple post-hoc averaging, especially at higher removal percentages [2508.16255]. This is an important distinction: chunking is not just an aggregation of tuple-level values after the fact, but part of the valuation mechanism itself.

For regression, the paper evaluates C-DaSh on Air Quality and HPC and states that daily chunks outperform monthly chunks because monthly chunks are too coarse and mix good and bad temporal segments [2508.16255]. This reinforces the chunk-granularity theme: semantically meaningful chunking can be beneficial, but chunks that are too coarse degrade discriminatory power.

## 6. Position within the broader research landscape

C-DaSh sits within a broader family of scalable data valuation methods, but its method of scaling is distinct. The original Data Shapley framework supplies the normative and formal baseline: value is expected marginal contribution under retraining-and-evaluation utility, with axiomatic motivation from null-player, symmetry, and additivity [1904.02868]. Its major practical bottlenecks are the combinatorial number of subsets and the cost of repeated model retraining [1904.02868].

Several later works preserve the original player definition while exploiting structure in coalition space. “Differentially Private Shapley Values for Data Evaluation” shows that under empirical risk minimization and uniform stability, marginal contribution can decay as \(O(1/k)\), motivating the Layered Shapley Algorithm, which stratifies coalitions by size and allocates expected samples as
\[
m_k=\frac{c^2}{2\alpha^2 k^2}\ln\frac{2n}{\beta}
\]
to estimate the full-data Shapley value while touching only a small fraction of the dataset per query [2206.00511]. That work is not chunk-based in the sense of prepartitioned groups, but it is conceptually close to small-chunk or random-chunk Shapley estimation [2206.00511].

“Accelerated Shapley Value Approximation for Data Evaluation” reaches a similar conclusion through \(\delta\)-Shapley, a semivalue that truncates coalition sizes to a band \([B_L,B_U]\) and reports preserved ranking behavior with up to \(9.9\times\) speedup [2311.05346]. Again, the restriction is by coalition cardinality rather than by fixed chunks.

DU-Shapley follows a different route. It assumes coalition utility depends primarily on aggregate sample size \(n_{\mathcal S}\), replacing combinatorial averages by the deterministic proxy
\[
\psi_i(u)=\frac{1}{I}\sum_{k=0}^{I-1}\bigl[w(k\mu_{-i}+n_i)-w(k\mu_{-i})\bigr],
\]
with support size \(I\) rather than \(2^I\) [2306.02071]. This is not chunking either, but it is another example of structured reduction of the valuation problem.

At the opposite end, CHG Shapley changes the utility function itself. Rather than approximating the original retraining-based Shapley game through coalition sampling or chunking, it defines a gradient-and-hardness surrogate utility with closed-form Shapley values computable during a single training trajectory [2406.11730]. That method is not chunked, but it is relevant as a methodological contrast: C-DaSh approximates valuation by changing the player granularity, whereas CHG Shapley approximates valuation by changing the game [2406.11730].

For grouped or source-level settings, there are also complementary lines of work. “Computing a Data Dividend” provides an Owen-value foundation for pre-defined contributor groups [1905.01805]. For LLM alignment under Direct Preference Optimization, coalition utilities can be synthesized by arithmetic on singleton fine-tuned models rather than retraining each coalition, reducing the number of DPO fine-tunings from \(2^n\) to \(n\) in the exact coalition-enumeration setting [2512.15765]. That work is not chunking examples, but it is naturally compatible with chunk-level players if chunks are treated as data sources [2512.15765].

A plausible synthesis is that C-DaSh represents one specific answer to the scalability problem: change the granularity of the cooperative game itself. Other methods preserve the original point-level game but restrict coalition sizes, exploit diminishing returns, use deterministic proxies, or exploit model-specific algebraic structure. These approaches are complementary rather than interchangeable.

## 7. Assumptions, limitations, and interpretive cautions

The paper presents C-DaSh as a practical method for dataset quality assessment on large tabular data, but it also leaves several points formally unresolved. First, no formal approximation error bound, consistency theorem, or variance analysis is given [2508.16255]. The chunk-level weighting term and the one-step SGD update are heuristic approximations rather than theorem-backed estimates of exact Shapley values [2508.16255]. This should be distinguished from methods such as the Layered Shapley Algorithm, which provides \((\alpha,\beta)\)-style guarantees under diminishing marginal contribution assumptions [2206.00511], or DU-Shapley, which provides an explicit finite-sample approximation bound under its size-based utility model [2306.02071].

Second, chunk granularity is a central tradeoff. If chunks are too large, they mix high- and low-quality tuples and blur the score. The paper explicitly reports degradation beyond chunk size about 250 [2508.16255]. If chunks are too small, scalability gains shrink. This suggests that chunk size is not just an engineering parameter but part of the valuation model itself.

Third, C-DaSh values chunks, not individual points. It therefore identifies problematic regions rather than necessarily isolating the exact tuple responsible for low quality [2508.16255]. This is advantageous for workflows such as dataset debugging, cleaning, and regional inspection, but it changes the semantics relative to point-level Data Shapley [2508.16255].

Fourth, the method depends on how corruption is distributed. The paper’s favorable results in Gaussian noise, label corruption, and time-sensitive regression settings suggest that chunk-level scoring is especially helpful when harmful data are spatially or temporally concentrated enough that chunks can localize them [2508.16255]. A plausible implication is that uniformly scattered corruption may be harder to detect with chunk-level valuation, because every chunk may contain a mixture of clean and noisy tuples.

Fifth, the subset-selection mechanism favors subsets that already perform reasonably well. The paper uses threshold-based regeneration of weak subsets and limits chunk repetition across subsets [2508.16255]. This may improve efficiency, but it may also bias the evaluation toward “good coalitions” and underrepresent difficult or atypical regions, a caveat the paper itself notes indirectly in discussing the subset selection design [2508.16255].

Sixth, the method is evaluated only on tabular datasets. The paper explicitly positions C-DaSh as intended and validated primarily for large tabular datasets and does not experimentally validate image, text, or multimodal settings [2508.16255]. This distinguishes it from broader data valuation literature, much of which includes image and biomedical tasks [1904.02868] or deep-learning selection settings [2406.11730].

Finally, reproducibility is only partial. The paper specifies some hyperparameters, including \(\eta=0.001\), \(th=0.5\) for classification, \(th=25\) for regression, \(k=50\) as a common subset count, and tested chunk sizes \(50,100,150,250,500,1000\), while also noting an inconsistency between 250 and 256 in different sections [2508.16255]. It does not provide full architecture details, exact train/validation split details, random seed protocol, or exact truncation implementation [2508.16255].

Taken together, these points indicate that C-DaSh is best read as a practically motivated region-level valuation heuristic with strong empirical runtime gains and useful dataset-quality signals, rather than as a formally characterized estimator of exact Data Shapley [2508.16255]. Within its validated scope—large tabular classification and regression pipelines—it offers a direct and operationally meaningful way to move from tuple-level valuation to chunk-level dataset quality assessment.

Source: https://www.emergentmind.com/topics/chunked-data-shapley-c-dash