Papers
Topics
Authors
Recent
Search
2000 character limit reached

ACDC: Accumulated Cutoff Discrepancy Criterion

Updated 5 July 2026
  • ACDC is a robust model selection method that accumulates component-level discrepancies to determine the number of latent processes in misspecified models.
  • It uses a truncation cutoff (ρ) to ignore minor discrepancies, balancing the sensitivity of likelihood-based methods with nonparametric robustness.
  • Empirical results show that ACDC outperforms traditional criteria like AIC, BIC, and the Elbow method in both synthetic and real-data scenarios.

Accumulated Cutoff Discrepancy Criterion (ACDC) is a robust model selection criterion for discovering a mechanistically meaningful number of latent processes in misspecified latent variable models. In the formulation proposed in “Robust Model Selection for Discovery of Latent Mechanistic Processes,” ACDC accumulates component-wise discrepancies after truncation at a tolerance level ρ\rho and selects the smallest KK minimizing the resulting robust loss. Its stated objective is to combine the sensitivity of likelihood-based methods with the robustness of nonparametric ones, especially in settings where likelihood-based criteria overestimate the number of latent processes under misspecification while robust nonparametric procedures can be overly conservative (Li et al., 25 Feb 2026).

1. Problem setting and motivation

The criterion is formulated for latent structures that consist of KoK_o mechanistic processes, where KoK_o is unknown. One considers a sequence of model families

m(K)={Pθ:θΘ(K)},K=1,2,,m^{(K)}=\{P_\theta:\theta\in\Theta^{(K)}\},\qquad K=1,2,\ldots,

where KK counts processes or components (Li et al., 25 Feb 2026).

A canonical example is a mixture model with

m(K)={Pθ=k=1KηkFϕk:θ=(η,ϕ1,,ϕK)Θ(K)},m^{(K)}=\left\{P_\theta=\sum_{k=1}^K \eta_k F_{\phi_k}:\theta=(\eta,\phi_1,\ldots,\phi_K)\in\Theta^{(K)}\right\},

latent labels zn{1,,K}z_n\in\{1,\ldots,K\},

znθCategorical(η),xnzn=k,θFϕk.z_n\mid \theta \sim \mathrm{Categorical}(\eta),\qquad x_n\mid z_n=k,\theta\sim F_{\phi_k}.

This formulation places ACDC in a general family of component-based latent variable models rather than restricting it to a single architecture (Li et al., 25 Feb 2026).

The central motivation is misspecification. Likelihood-based criteria such as AIC, BIC, and marginal likelihood are consistent when m(Ko)m^{(K_o)} is well-specified. Under misspecification, however, they asymptotically select models approaching

KK0

the closest element to the truth in Kullback–Leibler divergence, typically with no finite KK1, which leads to overestimating KK2. Robust nonparametric methods are less sensitive to parametric misspecification but can underestimate KK3 and lack generality. ACDC is defined to address this tension through a component-level, mechanism-aware discrepancy (Li et al., 25 Feb 2026).

2. Mechanistic framework and component-level discrepancy

The general framework allows observations KK4 to depend on covariates KK5. Each observation is represented as a deterministic combination of component contributions,

KK6

with the “no-contribution” property

KK7

Each component contribution is

KK8

where KK9, KoK_o0, and KoK_o1 are independent noise variables (Li et al., 25 Feb 2026).

The distinctive feature of ACDC is its mechanism-aware component-level discrepancy. Rather than comparing only fitted and observed distributions at the aggregate level, it defines a discrepancy through the conditional distribution of the component noise KoK_o2 given observed data, for indices that are “used” KoK_o3. For model parameter KoK_o4 and data distribution KoK_o5, the inferred distribution of the KoK_o6-th component noise is

KoK_o7

and the component-level discrepancy is

KoK_o8

Here KoK_o9 is a divergence or distance between probability measures, with examples including KL divergence, Wasserstein distance, and MMD (Li et al., 25 Feb 2026).

In the plug-in implementation, one fits a point estimator KoK_o0, computes per-sample conditional noise laws

KoK_o1

usage indicators KoK_o2, and counts KoK_o3, then aggregates these into an empirical component noise distribution KoK_o4 and evaluates

KoK_o5

(Li et al., 25 Feb 2026).

For mixture models, the paper also gives a component-level realized discrepancy via responsibilities

KoK_o6

followed by

KoK_o7

The paper develops ACDC and its theory using the noise-based construction, while this mixture-specific formulation illustrates the same mechanistic principle (Li et al., 25 Feb 2026).

3. Criterion, computation, and cutoff calibration

For a fixed KoK_o8, ACDC defines the robust loss as

KoK_o9

where m(K)={Pθ:θΘ(K)},K=1,2,,m^{(K)}=\{P_\theta:\theta\in\Theta^{(K)}\},\qquad K=1,2,\ldots,0 is the cutoff level. The selected number of components is

m(K)={Pθ:θΘ(K)},K=1,2,,m^{(K)}=\{P_\theta:\theta\in\Theta^{(K)}\},\qquad K=1,2,\ldots,1

The outer minimum resolves ties in favor of parsimony (Li et al., 25 Feb 2026).

A notable detail is that ACDC sorts nothing explicitly. It accumulates component-wise discrepancies through a sum after truncation at m(K)={Pθ:θΘ(K)},K=1,2,,m^{(K)}=\{P_\theta:\theta\in\Theta^{(K)}\},\qquad K=1,2,\ldots,2. The truncation prevents misspecification within the acceptable tolerance from influencing the loss and thereby prevents overfitting by adding spurious components (Li et al., 25 Feb 2026).

Operationally, the procedure runs over m(K)={Pθ:θΘ(K)},K=1,2,,m^{(K)}=\{P_\theta:\theta\in\Theta^{(K)}\},\qquad K=1,2,\ldots,3. For each m(K)={Pθ:θΘ(K)},K=1,2,,m^{(K)}=\{P_\theta:\theta\in\Theta^{(K)}\},\qquad K=1,2,\ldots,4, the model is fit to obtain m(K)={Pθ:θΘ(K)},K=1,2,,m^{(K)}=\{P_\theta:\theta\in\Theta^{(K)}\},\qquad K=1,2,\ldots,5; the conditional noise laws and usage indicators are computed; the empirical component noise distributions are formed; and the discrepancies m(K)={Pθ:θΘ(K)},K=1,2,,m^{(K)}=\{P_\theta:\theta\in\Theta^{(K)}\},\qquad K=1,2,\ldots,6 are evaluated. The criterion is then assembled as m(K)={Pθ:θΘ(K)},K=1,2,,m^{(K)}=\{P_\theta:\theta\in\Theta^{(K)}\},\qquad K=1,2,\ldots,7, and m(K)={Pθ:θΘ(K)},K=1,2,,m^{(K)}=\{P_\theta:\theta\in\Theta^{(K)}\},\qquad K=1,2,\ldots,8 is selected as the smallest minimizer. The computational cost is dominated by model fitting for each m(K)={Pθ:θΘ(K)},K=1,2,,m^{(K)}=\{P_\theta:\theta\in\Theta^{(K)}\},\qquad K=1,2,\ldots,9 and by evaluation of the divergence KK0 on the empirical component noise distributions. Per-component effective sample size is KK1 (Li et al., 25 Feb 2026).

The paper gives several strategies for choosing KK2. A domain-knowledge calibration uses related datasets with ground-truth labels or in silico mixtures to maximize an accuracy metric such as F-measure over KK3, then transfers the calibrated KK4 to new datasets of similar type. A generally applicable unlabeled approach plots KK5 as a function of KK6 for each KK7, with small KK8 used for visual separation, and chooses the smallest KK9 at the first “stability interval” where one m(K)={Pθ=k=1KηkFϕk:θ=(η,ϕ1,,ϕK)Θ(K)},m^{(K)}=\left\{P_\theta=\sum_{k=1}^K \eta_k F_{\phi_k}:\theta=(\eta,\phi_1,\ldots,\phi_K)\in\Theta^{(K)}\right\},0 curve remains minimal across a substantial range of m(K)={Pθ=k=1KηkFϕk:θ=(η,ϕ1,,ϕK)Θ(K)},m^{(K)}=\left\{P_\theta=\sum_{k=1}^K \eta_k F_{\phi_k}:\theta=(\eta,\phi_1,\ldots,\phi_K)\in\Theta^{(K)}\right\},1. An automated version defines a minimum stability width m(K)={Pθ=k=1KηkFϕk:θ=(η,ϕ1,,ϕK)Θ(K)},m^{(K)}=\left\{P_\theta=\sum_{k=1}^K \eta_k F_{\phi_k}:\theta=(\eta,\phi_1,\ldots,\phi_K)\in\Theta^{(K)}\right\},2, tracks intervals m(K)={Pθ=k=1KηkFϕk:θ=(η,ϕ1,,ϕK)Θ(K)},m^{(K)}=\left\{P_\theta=\sum_{k=1}^K \eta_k F_{\phi_k}:\theta=(\eta,\phi_1,\ldots,\phi_K)\in\Theta^{(K)}\right\},3 over which a single m(K)={Pθ=k=1KηkFϕk:θ=(η,ϕ1,,ϕK)Θ(K)},m^{(K)}=\left\{P_\theta=\sum_{k=1}^K \eta_k F_{\phi_k}:\theta=(\eta,\phi_1,\ldots,\phi_K)\in\Theta^{(K)}\right\},4 is best, and selects the first interval whose width is at least m(K)={Pθ=k=1KηkFϕk:θ=(η,ϕ1,,ϕK)Θ(K)},m^{(K)}=\left\{P_\theta=\sum_{k=1}^K \eta_k F_{\phi_k}:\theta=(\eta,\phi_1,\ldots,\phi_K)\in\Theta^{(K)}\right\},5 (Li et al., 25 Feb 2026).

Divergence choice is part of the practical specification. The recommended default is KL divergence because of its connection to likelihood and invariance to smooth reparameterizations of m(K)={Pθ=k=1KηkFϕk:θ=(η,ϕ1,,ϕK)Θ(K)},m^{(K)}=\left\{P_\theta=\sum_{k=1}^K \eta_k F_{\phi_k}:\theta=(\eta,\phi_1,\ldots,\phi_K)\in\Theta^{(K)}\right\},6. In high-dimensional settings, KL estimation via m(K)={Pθ=k=1KηkFϕk:θ=(η,ϕ1,,ϕK)Θ(K)},m^{(K)}=\left\{P_\theta=\sum_{k=1}^K \eta_k F_{\phi_k}:\theta=(\eta,\phi_1,\ldots,\phi_K)\in\Theta^{(K)}\right\},7-NN can degrade; the paper suggests exploiting structure or using Sinkhorn, described there as entropy-regularized Wasserstein, for stability. It also provides consistent KL estimators, including a one-sample m(K)={Pθ=k=1KηkFϕk:θ=(η,ϕ1,,ϕK)Θ(K)},m^{(K)}=\left\{P_\theta=\sum_{k=1}^K \eta_k F_{\phi_k}:\theta=(\eta,\phi_1,\ldots,\phi_K)\in\Theta^{(K)}\right\},8-NN estimator, a bias-corrected variant, and an adaptive-m(K)={Pθ=k=1KηkFϕk:θ=(η,ϕ1,,ϕK)Θ(K)},m^{(K)}=\left\{P_\theta=\sum_{k=1}^K \eta_k F_{\phi_k}:\theta=(\eta,\phi_1,\ldots,\phi_K)\in\Theta^{(K)}\right\},9 version with zn{1,,K}z_n\in\{1,\ldots,K\}0 and zn{1,,K}z_n\in\{1,\ldots,K\}1 (Li et al., 25 Feb 2026).

4. Robust model selection consistency

The theoretical target is a robust model selection consistency property defined through a distribution-level discrepancy zn{1,,K}z_n\in\{1,\ldots,K\}2 and the component-level discrepancy zn{1,,K}z_n\in\{1,\ldots,K\}3. For each zn{1,,K}z_n\in\{1,\ldots,K\}4,

zn{1,,K}z_n\in\{1,\ldots,K\}5

and the worst-case component-wise discrepancy at the true zn{1,,K}z_n\in\{1,\ldots,K\}6 is

zn{1,,K}z_n\in\{1,\ldots,K\}7

A model selection procedure zn{1,,K}z_n\in\{1,\ldots,K\}8 is zn{1,,K}z_n\in\{1,\ldots,K\}9-robustly consistent for znθCategorical(η),xnzn=k,θFϕk.z_n\mid \theta \sim \mathrm{Categorical}(\eta),\qquad x_n\mid z_n=k,\theta\sim F_{\phi_k}.0 and znθCategorical(η),xnzn=k,θFϕk.z_n\mid \theta \sim \mathrm{Categorical}(\eta),\qquad x_n\mid z_n=k,\theta\sim F_{\phi_k}.1 if, whenever the mismatch or “gap condition”

znθCategorical(η),xnzn=k,θFϕk.z_n\mid \theta \sim \mathrm{Categorical}(\eta),\qquad x_n\mid z_n=k,\theta\sim F_{\phi_k}.2

holds, then

znθCategorical(η),xnzn=k,θFϕk.z_n\mid \theta \sim \mathrm{Categorical}(\eta),\qquad x_n\mid z_n=k,\theta\sim F_{\phi_k}.3

(Li et al., 25 Feb 2026).

For mixture models, the paper states that ACDC using the noise-based component discrepancy is znθCategorical(η),xnzn=k,θFϕk.z_n\mid \theta \sim \mathrm{Categorical}(\eta),\qquad x_n\mid z_n=k,\theta\sim F_{\phi_k}.4-robustly consistent provided znθCategorical(η),xnzn=k,θFϕk.z_n\mid \theta \sim \mathrm{Categorical}(\eta),\qquad x_n\mid z_n=k,\theta\sim F_{\phi_k}.5 is one of KL divergence, Wasserstein distance, or MMD. The theorem specifies that for KL divergence, znθCategorical(η),xnzn=k,θFϕk.z_n\mid \theta \sim \mathrm{Categorical}(\eta),\qquad x_n\mid z_n=k,\theta\sim F_{\phi_k}.6 and znθCategorical(η),xnzn=k,θFϕk.z_n\mid \theta \sim \mathrm{Categorical}(\eta),\qquad x_n\mid z_n=k,\theta\sim F_{\phi_k}.7; for Wasserstein distance or MMD, znθCategorical(η),xnzn=k,θFϕk.z_n\mid \theta \sim \mathrm{Categorical}(\eta),\qquad x_n\mid z_n=k,\theta\sim F_{\phi_k}.8 and znθCategorical(η),xnzn=k,θFϕk.z_n\mid \theta \sim \mathrm{Categorical}(\eta),\qquad x_n\mid z_n=k,\theta\sim F_{\phi_k}.9. For probabilistic matrix factorization with m(Ko)m^{(K_o)}0, ACDC is m(Ko)m^{(K_o)}1-robustly consistent with m(Ko)m^{(K_o)}2 and

m(Ko)m^{(K_o)}3

(Li et al., 25 Feb 2026).

The proof idea reported in the paper is that m(Ko)m^{(K_o)}4, whereas for m(Ko)m^{(K_o)}5, m(Ko)m^{(K_o)}6 in probability, so the minimum is achieved at m(Ko)m^{(K_o)}7 once parsimony resolves ties. The paper presents this as the formal mechanism through which ACDC balances sensitivity and robustness: likelihood-based criteria optimize predictive fit and may add spurious components under misspecification, while ACDC measures component-level mechanistic alignment via noise distributions and ignores discrepancies below tolerance m(Ko)m^{(K_o)}8 (Li et al., 25 Feb 2026).

5. Model classes and empirical evaluation

The paper develops ACDC for several latent variable model classes. In unsupervised probabilistic matrix factorization, the setting is m(Ko)m^{(K_o)}9 with components KK00, contributions KK01 when active, and

KK02

Classical instances include nonnegative matrix factorization with KK03 and factor analysis with KK04. The same noise-based discrepancy extends to supervised PMF variants by conditioning on KK05. Mixture models appear in unsupervised form through KK06 and in covariate-dependent form through KK07 (Li et al., 25 Feb 2026).

The empirical study covers both synthetic and real-data settings. In mixture simulations with multivariate skew-normal mixtures, varying KK08, dimensions KK09, KK10 up to KK11, and varying misspecification and cluster sizes, the baselines were Elbow, Silhouette, and Gap statistic, with parameter estimates by EM and ACDC using KL with KK12-NN. The reported metrics were mean absolute error (MAE), mean 0–1 loss, and median signed deviation. In low dimension, ACDC was best overall with MAE KK13, 0–1 loss KK14, and median KK15; competitors had MAE at least KK16 and 0–1 loss at least KK17. In high dimension, ACDC was approximately tied with Silhouette and much better than Elbow and Gap, with Wilcoxon tests showing significant MAE improvements for ACDC versus Elbow and Gap (Li et al., 25 Feb 2026).

In flow cytometry, twelve datasets were used. On training datasets 1–6, F-measure versus KK18 curves aligned, and a single KK19 maximized average F-measure and per-dataset F-measure. On test datasets 7–12, ACDC matched coarsened posterior average accuracy at far lower computational cost, reported as Python ACDC at KK20h versus Julia coarsened posterior at KK21h. The paper describes ACDC as comparable to nonparametric methods in this setting, while Elbow performed best on dataset 7, characterized there as a hard case (Li et al., 25 Feb 2026).

For single-cell RNA-seq using Tabula Muris, the experiments used 80 uniform subsets across 20 tissues with ground-truth cell types and Gaussian mixtures on PCA features under clear misspecification. Both KL and unbalanced Sinkhorn worked well; KL had slight overestimation bias with median KK22, whereas Sinkhorn had slight underestimation with median KK23. Automated KK24 selection was close to manual selection, with manual MAE KK25 versus automated KK26. Compared with Elbow, Gap, Silhouette, Seurat, and SC3, ACDC achieved the best MAE (KK27) and lowest 0–1 loss (KK28), while ARI and AMI were comparable to Seurat; Seurat had median KK29 bias and SC3 showed gross overestimation (Li et al., 25 Feb 2026).

The PMF applications include mutational signature discovery under Poisson NMF and hyperspectral unmixing under Gaussian factor analysis. In synthetic breast cancer datasets based on COSMIC v2 and PCAWG, under both well-specified and misspecified scenarios, BIC always picked KK30 and Parallel Analysis consistently underestimated, often selecting KK31. ACDC selected KK32 or KK33, where signatures and exposures had meaningful errors and the decomposition remained interpretable. In the hyperspectral unmixing example with ground truth of five end-members, ACDC selected KK34, which the paper states maximizes sARI; BIC overfit with KK35, and Parallel Analysis underfit with KK36 (Li et al., 25 Feb 2026).

The acronym ACDC is not unique in the arXiv literature. In “Approximate confidence distribution computing,” ACDC denotes Approximate Confidence Distribution Computing, a likelihood-free inferential method that targets a confidence distribution rather than a Bayesian posterior. The data provided for that paper explicitly states that the phrase “Accumulated Cutoff Discrepancy Criterion” does not appear there, and that the method is a frequentist alternative to ABC rather than a model selection criterion for latent mechanistic processes (Thornton et al., 2022).

A second, analytically distinct usage arises in work on Dirichlet forms and heat kernel bounds. In “Energy inequalities for cutoff functions and some applications,” the supplied terminology maps the query term to the pair KK37 and KK38, together with an accumulated inequality across chains of annuli. In that setting, the core inequality is

KK39

and the accumulated form controls the energy of a cutoff KK40 built from multiple annuli. This suggests a broader overlap in cutoff-based terminology, but it is a distinct analytic construction from the model selection criterion developed in 2026 (Andres et al., 2012).

Within the 2026 formulation, the stated limitations are substantive. ACDC requires a mechanistically meaningful discrepancy at the component level and a modest misspecification regime; if misspecification is very large, robust recovery of KK41 is generally impossible. KL estimation in high dimension is statistically hard, and calibration of KK42 is problem-dependent, with principled heuristics and domain-informed strategies but no universal rule. The paper identifies potential extensions to topic models, supervised factor analysis, functional clustering, hierarchical mixtures, time-series models, nonlinear generative models such as VAEs, and hierarchical structures with nested discrepancies and multi-stage ACDC (Li et al., 25 Feb 2026).

In this sense, Accumulated Cutoff Discrepancy Criterion designates a specific robust model selection procedure centered on component-level discrepancy truncation, not a generic family of cutoff-based methods. Its defining features are the robust loss KK43, the parsimonious selection rule for KK44, and the use of mechanism-aware discrepancies to recover a mechanistically meaningful number of latent processes under misspecification (Li et al., 25 Feb 2026).

Definition Search Book Streamline Icon: https://streamlinehq.com
References (3)

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Accumulated Cutoff Discrepancy Criterion (ACDC).