---
title: Discrepancy-Confusion Uncertainty in DECERN
url: https://www.emergentmind.com/topics/discrepancy-confusion-uncertainty
type: topic
---

# Discrepancy-Confusion Uncertainty in DECERN

Discrepancy-confusion uncertainty is a composite informativeness measure introduced for active fine-grained image classification in DECERN. It is designed to identify unlabeled fine-grained images whose feature representations are both directionally ambiguous with respect to any one category and structurally unstable under small, semantically-informed perturbations. In that formulation, discrepancy uncertainty measures how much the model’s predicted distribution on a perturbed feature shifts away from its original prediction, whereas confusion uncertainty measures how high the entropy of the model’s prediction becomes on the perturbed feature. The resulting score is used to form uncertainty candidates, after which uncertainty-weighted clustering and calibration diversity are applied to select annotation queries [2509.24181].

## 1. Definition and motivation

In fine-grained classification, many subcategories share very similar visual semantics, and traditional uncertainty metrics such as margin, entropy, and confidence often fail to distinguish samples that sit on subtle decision boundaries or whose internal feature structure is fragile. Discrepancy-confusion uncertainty was introduced to address that failure mode by explicitly probing category directionality and structural stability through local feature-fusion perturbations [2509.24181].

The measure has two components. **Discrepancy uncertainty** quantifies how much the model’s predicted distribution on the perturbed feature shifts away from the original prediction, implemented as a cross-entropy term between fused and original distributions. **Confusion uncertainty** quantifies how high the entropy of the model’s prediction becomes on the fused feature, indicating loss of directional signal. The combination is intended to produce a richer, two-dimensional view of informativeness, targeting samples that are both hard to steer toward any one class and whose local feature manifold is unstable [2509.24181].

This construction is specific to active learning in fine-grained settings. It does not begin from a generic pool-based uncertainty score computed directly on the original image; instead, it asks how the classifier behaves under local, class-conditioned feature perturbations that are derived from the current labeled set.

## 2. Mathematical construction in DECERN

Let the unlabeled pool be $\mathcal D^u=\{x_i^u\}$ and the labeled pool be $\mathcal D^l=\{(x_i^l,y_i^l)\}$. For an unlabeled sample $x^u$, DECERN defines a feature encoder $\mathcal F_z(\cdot)$ and classifier $\mathcal F_c(\cdot)$, with
$$
z^u=\mathcal F_z(x^u),\qquad p^u=\mathcal F_c(z^u).
$$
For class $j$, the class anchor is the average feature over labeled examples of that class,
$$
z_j^a=\frac{\sum_{(x,y)\in\mathcal D^l}\mathbf 1\{y=j\}\cdot \mathcal F_z(x)}{\sum \mathbf 1\{y=j\}},
$$
and the corresponding averaged class prediction is
$$
p_j^a=\frac{\sum \mathbf 1\{y=j\}\cdot \mathcal F_c(\mathcal F_z(x))}{\sum \mathbf 1\{y=j\}}.
$$
A binary mask $M$ is computed from the top-$K$ positions of the gradient $\partial \log p^u/\partial z^u$, isolating the most salient feature dimensions. The fusion strength for class $j$ is set as $\alpha_j=p_j^u$. Local feature fusion is then defined by
$$
\phi(z^u,z_j^a;\alpha_j,M)
=(1-M)\odot z^u
+M\odot\big[(1-\alpha_j)\cdot z^u+\alpha_j\cdot z_j^a\big].
$$
This operator perturbs only the salient feature positions, nudging the unlabeled feature toward the class anchor in a confidence-weighted manner [2509.24181].

From this construction, three prediction distributions are considered for class $j$:
$$
p_j^b=(1-\alpha_j)\cdot p^u+\alpha_j\cdot p_j^a,
$$
$$
p_j^w=(1-R\cdot \alpha_j)\cdot p^u+(R\cdot \alpha_j)\cdot p_j^a,
$$
$$
p_j^m=\mathcal F_c[\phi(z^u,z_j^a;\alpha_j,M)],
$$
where the fusion ratio is
$$
R=\frac{\#\text{positions in }M==1}{\dim(z^u)}.
$$

The category-level score is built from an entropy term and a cross-entropy term,
$$
S_c=-\sum_k p_k^m\log p_k^m,\qquad
S_d=-\sum_k p_k^{*,}\log p_k^m,
$$
where $p^{*,}$ is one of $\{p^u,p_j^b,p_j^w\}$. A category weighting
$$
\beta_j=1-\frac{1+\cos(z^u,z_j^a)}{2}
$$
measures how far the unlabeled feature lies from the class-$j$ anchor in cosine space. The category-level discrepancy-confusion score is then
$$
S_{dc}(j)=(S_c)^{1-\beta_j}+(S_d)^{\beta_j}.
$$

Finally, the instance-level score averages over all $N_c$ classes and the three fusion modes:
$$
S(x^u)=\frac{1}{N_c}\sum_j\Big[
(1-R)\cdot S_{dc}(p^u,p_j^m;\beta_j)
+R\cdot S_{dc}(p_j^b,p_j^m;\beta_j)
+S_{dc}(p_j^w,p_j^m;\beta_j)
\Big].
$$
In this formulation, discrepancy-confusion uncertainty is therefore not a single entropy statistic. It is an aggregation over class anchors, saliency-restricted perturbations, and multiple fused distributions [2509.24181].

## 3. Candidate formation, uncertainty-weighted clustering, and calibration diversity

DECERN integrates discrepancy-confusion uncertainty into a multi-stage active learning pipeline. The first stage computes $S(x^u)$ for every unlabeled sample and applies dynamic thresholding. If $\mu$ and $\sigma$ are the mean and standard deviation of $S(x^u)$ over the current unlabeled pool, the threshold is
$$
\zeta=\mu+\lambda\cdot \sigma,
$$
with $\lambda$ driven by the skewness of $\{S(x^u)\}$. All samples with $S(x^u)>\zeta$ become uncertainty candidates [2509.24181].

The second stage performs **uncertainty-weighted clustering**. K-means is run on the candidate features $\{z^u\mid x^u\in C\}$ to form $B$ clusters, while weighting each point by its discrepancy-confusion score. The stated purpose is to pull centroids toward high-uncertainty regions. Let the centroid of cluster $\mathcal C_k$ be denoted $z^{\mathcal C_k}$.

The third stage applies **calibration diversity sampling**. For each cluster $\mathcal C_k$, one sample is selected by balancing local representativeness against global diversity:
$$
i_k=\arg\max_{i\in \mathcal C_k}\Big[
-\xi\cdot (1-\cos(z_i^u,z^{\mathcal C_k}))
+(1-\xi)\cdot \min_j(1-\cos(z_i^u,z_j^a))
\Big],
$$
where $\xi\in[0,1]$ balances the two objectives. Local representativeness is defined as proximity to the cluster centroid, and global diversity is defined as distance from all class anchors. Selected samples are queried from the oracle, added to $\mathcal D^l$, and the network is retrained in the next active learning cycle [2509.24181].

Within DECERN, discrepancy-confusion uncertainty thus plays an upstream filtering role rather than serving as the sole acquisition function. It defines the candidate set that is subsequently diversified by clustering and calibrated against the anchor geometry of the labeled set.

## 4. Relation to other discrepancy and confusion formulations

The terms **discrepancy** and **confusion** appear in several technically distinct literatures, and discrepancy-confusion uncertainty occupies a specific position among them.

In flexible visual recognition, confusion and ignorance are separated under Subjective Logic. There, confusion is defined as conflicting evidence, implemented as total mass on all non-singleton subsets, while ignorance is the absence of evidence, implemented as mass on the empty set. By contrast, discrepancy-confusion uncertainty in DECERN does not operate with hyper-opinions, non-singleton masses, or ignorance mass; its confusion term is the entropy of the classifier output on locally fused features [2309.07403].

In diffusion MRI, NUQ uses the maximum mean discrepancy metric to compare samples drawn from posterior distributions of microstructure measures. The resulting score is a pooled quality score that captures noise-induced uncertainty by comparing entire posterior distributions. This is again different from DECERN: the discrepancy in NUQ is a kernel two-sample discrepancy between posterior samples, whereas the discrepancy term in discrepancy-confusion uncertainty is a cross-entropy shift between original and fused predictive distributions [2203.01921].

In open-set medical image segmentation, ASFOSDA combines Class-aware Decomposed Uncertainty and Class-agnostic Prototype Discrepancy. There, uncertainty is decomposed into aleatoric and epistemic components, and discrepancy is defined through cross-domain and self-domain cosine-based prototype differences. This differs from DECERN’s category-wise local feature fusion, but both methods combine uncertainty estimation with a diversity mechanism rather than relying on uncertainty alone [2606.08749].

In mechanistic electrophysiology, model discrepancy denotes the model–reality gap and is represented either explicitly as a discrepancy function $\delta(v)$ added to the simulator output or empirically through the variability of predictions from parameter sets trained on different experimental protocols. Those usages concern misspecification in scientific simulators, not class-boundary ambiguity in discriminative representation learning [2001.04230; 2302.02942].

In quantum measurement theory, discrepancy-based error definitions compare actual and ideal values, while an operational approach defines error and disturbance through the distinguishability of devices. That literature uses “confusion” in an operational sense tied to distinguishability tests rather than entropy under feature perturbation [1612.02051].

Taken together, these formulations show that discrepancy-confusion uncertainty is a domain-specific construct: it is neither synonymous with model discrepancy, nor with kernel discrepancy, nor with evidential confusion.

## 5. Empirical behavior in active fine-grained classification

DECERN was evaluated on 7 fine-grained image datasets across 26 distinct experimental settings, using ResNet50 and ViT backbones and budgets $K\cdot N_c$ with $K=1,2$. Table 1 reports that DECERN outperforms 8 state-of-the-art active learning methods, and in every setting it is best or second-best. Figure 2 shows accuracy over 8 active learning cycles on Caltech101, StanfordDogs, and BronzeDing, with DECERN’s curve consistently above competitors [2509.24181].

The ablation study directly isolates the role of discrepancy-confusion uncertainty. Table 3 shows that removing either the discrepancy term $S_d$ or the confusion term $S_c$ reduces accuracy by 1–2 points. The same table also reports that dropping the uncertainty-weighted clustering or the calibration diversity component harms performance. The t-SNE visualizations in Figure 3 show that DECERN’s selected samples cover decision boundary regions more uniformly and avoid redundant clusters seen in other active learning methods [2509.24181].

Hyperparameter studies in Figure 5 report stable performance for moderate fusion ratio $R\approx 0.1$, dynamic thresholding $\zeta$, and diversity balance $\xi\approx 0.8$. Within the reported evidence, discrepancy-confusion uncertainty is therefore not presented as an isolated scoring heuristic; it is validated as part of a selection pipeline in which uncertainty, clustering, and diversity calibration jointly determine query quality [2509.24181].

## 6. Interpretation, scope, and common misconceptions

A common simplification is to equate discrepancy-confusion uncertainty with ordinary predictive entropy. That is not the construction used in DECERN. Traditional entropy and margin operate in the original feature space, whereas discrepancy-confusion uncertainty explicitly simulates semantically-informed local perturbations through class anchors, a salient-dimension mask, and confidence-weighted fusion. The resulting score tests whether the model’s decision flips drastically and whether the prediction becomes highly uncertain under that perturbation [2509.24181].

A second simplification is to treat the method as a generic diversity sampler. In DECERN, diversity enters after uncertainty candidate formation. Uncertainty-weighted clustering is applied only to samples with $S(x^u)>\zeta$, and calibration diversity then trades off local representativeness against global diversity relative to class anchors. This suggests that the method is intended to select samples that are simultaneously uncertain, non-redundant, and anchor-distant, rather than globally diverse in isolation [2509.24181].

A third potential confusion concerns the word **confusion** itself. In DECERN, confusion uncertainty is the entropy of the classifier’s output on a locally fused feature. In evidential flexible recognition, confusion is total mass on non-singleton subsets and is explicitly separated from ignorance, the mass on the empty set. The two notions address different decision problems: one probes local manifold fragility in fine-grained active learning, and the other supports flexible recognition through multi-class prediction and rejection [2309.07403].

The scope of discrepancy-confusion uncertainty is therefore narrow but technically precise. It is a sample-selection criterion for active fine-grained classification, built from local feature fusion with class anchors, category-wise discrepancy and confusion terms, dynamic thresholding, and downstream diversity calibration. A plausible implication is that it is especially suited to regimes in which subtle inter-class differences, rather than coarse class separation or out-of-distribution rejection, dominate the informativeness of unlabeled data.

Source: https://www.emergentmind.com/topics/discrepancy-confusion-uncertainty