Papers
Topics
Authors
Recent
Search
2000 character limit reached

Accuracy Paradox Overview

Updated 10 July 2026
  • Accuracy Paradox is the phenomenon where a high measured accuracy fails to capture true performance due to task misalignment, proxy optimization, and aggregation effects.
  • It arises in diverse applications such as machine translation, reinforcement learning, and screening, where aggregated metrics obscure critical subgroup or cumulative errors.
  • The topic underscores the need for task-specific metrics—like conditional correlations and total percentage forecast error—to better align measured performance with real-world outcomes.

Searching arXiv for the cited "accuracy paradox" papers to ground the article in current literature. Accuracy paradox denotes a family of phenomena in which higher measured, optimized, or reported “accuracy” ceases to track the property that actually matters, and can even degrade it. Across recent work, the paradox appears in at least five distinct forms: aggregation effects, where corpus-level correlations reverse segment-level tradeoffs; proxy optimization effects, where a more accurate intermediate signal or reward worsens downstream performance; strategic response effects, where better measurement changes behavior in ways that lower screening quality; metric insufficiency effects, where scalar accuracy obscures subgroup, epistemic, or cumulative harms; and estimation effects, where variance-based precision improves while bias-inclusive accuracy deteriorates (Lim et al., 2024, Chen et al., 2024, Si et al., 13 May 2026).

1. Conceptual scope and metric structure

In its classical machine-learning form, the accuracy paradox refers to the fact that overall classification accuracy can be misleading under class imbalance, because a model can predict the majority class and still appear strong. Several of the cited works explicitly use this classical case as a point of departure, then generalize it to settings in which “accuracy” is either the wrong objective, an incomplete proxy, or a statistic whose interpretation changes under aggregation, strategic adaptation, or prevalence shift (Li et al., 12 Sep 2025, Moreira, 5 Jul 2026, Zhang et al., 2020).

A recurring formal pattern is that single-number accuracy suppresses dimensions that remain decision-relevant. In the LLM hallucination literature, standard definitions are stated as

Acc=TP+TNTP+TN+FP+FN,Prec=TPTP+FP,Rec=TPTP+FN,\text{Acc} = \frac{TP + TN}{TP + TN + FP + FN}, \quad \text{Prec} = \frac{TP}{TP + FP}, \quad \text{Rec} = \frac{TP}{TP + FN},

with related quantities such as F1, Brier score, expected calibration error, and coverage–risk used to expose confidence, calibration, and abstention behavior that raw accuracy omits (Li et al., 12 Sep 2025). In medical screening, positive predictive value is explicitly prevalence-dependent:

ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},

so unchanged sensitivity and specificity do not imply unchanged practical accuracy when prevalence changes (Balayla, 2020). In forecasting, pointwise RMSE, MAE, and R2R^2 can improve while cumulative planning error worsens, motivating total percentage forecast error:

TPFE=tTy^ttTyttTyt×100%.TPFE = \frac{\left| \sum_{t \in T} \hat{y}_t - \sum_{t \in T} y_t \right|}{\sum_{t \in T} y_t} \times 100\%.

This is an explicit redefinition of what “accurate” means for a planning task (Moreira, 5 Jul 2026).

The shared lesson is not that accuracy is useless, but that it is task-conditional. Accuracy is reliable only when the metric, the decision unit, the sampling regime, and the behavioral environment align with the actual objective. When any of those conditions fails, paradoxical reversals become possible.

2. Simpson’s paradox and the translation accuracy–fluency tradeoff

In machine translation, the paradox is formalized most explicitly as a Simpson’s paradox. Accuracy, also called fidelity or adequacy, is defined as faithfulness to the source text; fluency is conformity to target-language norms and ease of processing for the recipient. The paper shows that these dimensions trade off within source segments but are positively correlated when aggregated over a corpus, because segment identity, difficulty, and genre act as confounders (Lim et al., 2024).

The formal statement uses accuracy AA, fluency FF, and stratum SS. Within a segment SiS_i,

Corr(A,FSi)<0,\mathrm{Corr}(A,F\mid S_i)<0,

but after aggregation,

Corr(A,F)>0.\mathrm{Corr}(A,F)>0.

The mechanism is made explicit by the law of total covariance:

ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},0

When the first term is negative and the second term is sufficiently positive, the aggregate correlation flips sign. Under the probability-based operationalization, the segment-level statistic is

ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},1

computed across candidate translations ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},2 of a fixed source segment ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},3; ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},4 indicates tradeoff and ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},5 alignment (Lim et al., 2024).

The empirical evidence spans CRITT TPR-DB, RLTC, and MTMQM. Under the probability-based operationalization, corpus-level correlations are positive in all three datasets: CRITT ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},6, RLTC ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},7, and MTMQM ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},8, all with ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},9; the M2M100 replication gives .689, .703, and .801, again with R2R^20. By contrast, segment-level human-rating correlations are mostly negative and differ significantly from permutations with R2R^21. For human ratings at corpus level, MTMQM yields R2R^22, whereas RLTC yields R2R^23, a small negative result. The segment-level English→German case study around “I issued you a refund of the book” illustrates the mechanism qualitatively: renderings using ausstellen are more faithful but less natural, whereas more idiomatic alternatives move away from the exact source sense (Lim et al., 2024).

The evaluation consequence is direct. Translation choices are made per segment, so segment-level analysis is the recommended unit. The paper therefore recommends reporting R2R^24 alongside R2R^25, stratifying by segment properties, and using partial correlation R2R^26 or R2R^27. This suggests that many claims of “alignment” between adequacy and fluency are artifacts of aggregation rather than properties of the decision problem itself (Lim et al., 2024).

3. Proxy optimization, reward models, and strategic signaling

In RLHF, the accuracy paradox appears as a non-monotonic relationship between reward-model accuracy and downstream language-model quality. On QA-FEEDBACK, Longformer-base-4096 reward models are trained separately for relevance, factuality, and completeness, and then used to train T5-small, T5-base, and T5-large with PPO, a separate T5-base value model, and KL regularization. The central finding is that LLMs trained with moderately accurate reward models outperform those trained with the most accurate reward models when evaluated by independent high-accuracy evaluators. The RLHF objective is written as

R2R^28

with KL coefficient R2R^29, KL threshold TPFE=tTy^ttTyttTyt×100%.TPFE = \frac{\left| \sum_{t \in T} \hat{y}_t - \sum_{t \in T} y_t \right|}{\sum_{t \in T} y_t} \times 100\%.0, total episodes TPFE=tTy^ttTyttTyt×100%.TPFE = \frac{\left| \sum_{t \in T} \hat{y}_t - \sum_{t \in T} y_t \right|}{\sum_{t \in T} y_t} \times 100\%.1, learning rate TPFE=tTy^ttTyttTyt×100%.TPFE = \frac{\left| \sum_{t \in T} \hat{y}_t - \sum_{t \in T} y_t \right|}{\sum_{t \in T} y_t} \times 100\%.2, and reward shaping settings of TPFE=tTy^ttTyttTyt×100%.TPFE = \frac{\left| \sum_{t \in T} \hat{y}_t - \sum_{t \in T} y_t \right|}{\sum_{t \in T} y_t} \times 100\%.3 for relevance, TPFE=tTy^ttTyttTyt×100%.TPFE = \frac{\left| \sum_{t \in T} \hat{y}_t - \sum_{t \in T} y_t \right|}{\sum_{t \in T} y_t} \times 100\%.4 for factuality, and mean TPFE=tTy^ttTyttTyt×100%.TPFE = \frac{\left| \sum_{t \in T} \hat{y}_t - \sum_{t \in T} y_t \right|}{\sum_{t \in T} y_t} \times 100\%.5, std TPFE=tTy^ttTyttTyt×100%.TPFE = \frac{\left| \sum_{t \in T} \hat{y}_t - \sum_{t \in T} y_t \right|}{\sum_{t \in T} y_t} \times 100\%.6, bias TPFE=tTy^ttTyttTyt×100%.TPFE = \frac{\left| \sum_{t \in T} \hat{y}_t - \sum_{t \in T} y_t \right|}{\sum_{t \in T} y_t} \times 100\%.7, scale TPFE=tTy^ttTyttTyt×100%.TPFE = \frac{\left| \sum_{t \in T} \hat{y}_t - \sum_{t \in T} y_t \right|}{\sum_{t \in T} y_t} \times 100\%.8 for completeness (Chen et al., 2024).

The non-monotonicity is reported across all three tasks and all three T5 sizes. Reward-model accuracy ranges are task-specific: factuality TPFE=tTy^ttTyttTyt×100%.TPFE = \frac{\left| \sum_{t \in T} \hat{y}_t - \sum_{t \in T} y_t \right|}{\sum_{t \in T} y_t} \times 100\%.9–AA0, relevance AA1–AA2, and completeness AA3–AA4. Independent evaluator reward models attain offline accuracies AA5, AA6, and AA7 for relevance, factuality, and completeness, respectively. Surface plots show an inverted-U pattern: too little reward accuracy underconstrains PPO, while too much accuracy exacerbates overoptimization of proxy-specific features and brittleness. The paper does not report correlation coefficients or significance tests for this relationship, but interprets the phenomenon through Goodhart’s law, reward hacking, distribution shift, overfitting, and calibration–discrimination mismatches (Chen et al., 2024).

A structurally related paradox appears in screening with strategic signaling. There, a principal observes a noisy signal

AA8

where AA9 is costly effort and FF0 is signal precision. Approval follows a cutoff rule FF1. Although larger FF2 means more accurate signals in the accuracy order, the paper proves a “pitfall of precision”: when precision is already high, further improvements reduce screening accuracy and lower the principal’s welfare because marginally bad types are newly induced to exert effort and mimic good types (Si et al., 13 May 2026).

The welfare derivative is decomposed as

FF3

where FF4 and FF5 are direct informational effects and FF6 is the indirect strategic effect via the cutoff type. The main theorem states that there exists FF7 such that precision helps near FF8, but there also exists FF9 such that SS0 for SS1. Type I error SS2 decreases in SS3, but Type II error SS4 increases once precision is sufficiently large. The paper also reports a reversal of discrimination: groups with noisier technologies face lower approval rates yet may be preferred ex ante, and shows that commitment to an approval standard restores monotonicity, with SS5 increasing in SS6 (Si et al., 13 May 2026).

Taken together, these results suggest that “better proxy” and “more precise signal” are not behaviorally innocent interventions. Once optimization or signaling responds endogenously to the proxy, the proxy’s nominal accuracy can diverge sharply from the quality of the final outcome.

4. Reasoning reliability beyond answer correctness

In mathematical reasoning, the paradox takes the form of a mismatch between final-answer correctness and the quality of the underlying computation. On a 500-problem GSM8K subset, Qwen2.5-Math-7B achieves SS7 accuracy, but only SS8 cases, or SS9 of all predictions and SiS_i0 of correct predictions, are classified as faithful and stable. By contrast, SiS_i1 cases, or SiS_i2 of all predictions and SiS_i3 of correct predictions, are “lucky guesses,” and SiS_i4 cases, or SiS_i5, are silent failures: incorrect answers with high stability SiS_i6 (Sahoo et al., 3 Mar 2026).

The paper defines a composite faithfulness score

SiS_i7

where SiS_i8 is activation stability, SiS_i9 reasoning-hop alignment, and Corr(A,FSi)<0,\mathrm{Corr}(A,F\mid S_i)<0,0 depth efficiency. Faithfulness is thresholded by Corr(A,FSi)<0,\mathrm{Corr}(A,F\mid S_i)<0,1, Corr(A,FSi)<0,\mathrm{Corr}(A,F\mid S_i)<0,2, and Corr(A,FSi)<0,\mathrm{Corr}(A,F\mid S_i)<0,3. Despite continuous fidelity being predictive with Corr(A,FSi)<0,\mathrm{Corr}(A,F\mid S_i)<0,4, the observed correlation between latent fidelity and correctness is weakly negative: Pearson Corr(A,FSi)<0,\mathrm{Corr}(A,F\mid S_i)<0,5, Spearman Corr(A,FSi)<0,\mathrm{Corr}(A,F\mid S_i)<0,6, Corr(A,FSi)<0,\mathrm{Corr}(A,F\mid S_i)<0,7. Reasoning steps also correlate negatively with correctness (Corr(A,FSi)<0,\mathrm{Corr}(A,F\mid S_i)<0,8, Corr(A,FSi)<0,\mathrm{Corr}(A,F\mid S_i)<0,9), while reasoning depth Corr(A,F)>0.\mathrm{Corr}(A,F)>0.0 is not significantly correlated with correctness (Corr(A,F)>0.\mathrm{Corr}(A,F)>0.1, Corr(A,F)>0.\mathrm{Corr}(A,F)>0.2). The interpretation offered is a binary-threshold artifact combined with a shallow-win phenomenon: correct answers often arise from surface heuristics rather than faithful multi-hop computation (Sahoo et al., 3 Mar 2026).

Self-correction work identifies another reversal. On GSM8K-Complex, DeepSeek-Chat has Corr(A,F)>0.\mathrm{Corr}(A,F)>0.3 baseline accuracy but an intrinsic correction rate of only Corr(A,F)>0.\mathrm{Corr}(A,F)>0.4 (Corr(A,F)>0.\mathrm{Corr}(A,F)>0.5), whereas GPT-3.5-Turbo has Corr(A,F)>0.\mathrm{Corr}(A,F)>0.6 baseline accuracy and Corr(A,F)>0.\mathrm{Corr}(A,F)>0.7 intrinsic correction (Corr(A,F)>0.\mathrm{Corr}(A,F)>0.8), and Claude-3-Haiku has Corr(A,F)>0.\mathrm{Corr}(A,F)>0.9 baseline accuracy and ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},00 intrinsic correction (ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},01). Detection rates vary widely—GPT-3.5 ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},02, DeepSeek ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},03, Claude ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},04—yet detection capability does not predict correction success. Model-generated localization hints reduce correction for GPT-3.5 from ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},05 to ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},06 and for Claude from ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},07 to ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},08, though DeepSeek increases from ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},09 to ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},10 on its smaller error set (Li, 24 Dec 2025).

The proposed Error Depth Hypothesis explains the reversal by the composition of errors rather than answer accuracy alone. DeepSeek’s errors are ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},11 setup/interpretation, ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},12 logic, and ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},13 calculation, whereas GPT-3.5’s are ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},14, ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},15, and ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},16, respectively. Iterative reflection therefore helps weaker models more: cumulative correction over three rounds reaches ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},17 for GPT-3.5 and ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},18 for Claude, but only ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},19 for DeepSeek. This suggests that stronger models may fail less often, but when they fail, they fail in ways that are structurally harder to repair (Li, 24 Dec 2025).

5. Fairness, hallucination, and screening

In fairness research, the paradox is that optimizing overall accuracy on imbalanced or spuriously correlated data can increase unfairness by concentrating errors on protected groups. The debiasing paper formalizes bias as an equal-opportunity-style TPR gap:

ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},20

with overall model bias given by ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},21, and evaluates balanced average accuracy across target-by-bias subgroups. The proposed adversarial example–based data augmentation generates ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},22 by solving

ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},23

thereby flipping the bias attribute while preserving the target label. On C-MNIST, AEDAρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},24 reaches bACC ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},25 and model bias ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},26, compared with Original ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},27 and ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},28; on CelebA, AEDAρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},29 reaches bACC ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},30 and bias ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},31, compared with Original ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},32 and ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},33 (Zhang et al., 2020).

A conceptually broader LLM governance literature argues that overreliance on accuracy misdiagnoses hallucination risk. It distinguishes factuality hallucination, consistency hallucination, reference hallucination, sycophancy hallucination, consensus illusion, oversimplified hallucination, and prompt-sensitivity hallucination. The central claim is that optimizing for surface correctness and fluency fosters passive user trust in “accurate-looking” outputs that are epistemically ungrounded, manipulative, or socially distorting. Accuracy is therefore presented as a superficial proxy for reliability, because it does not guarantee epistemic validity, uncertainty communication, or interpretability. The paper extends the critique from outputs to individuals and society, emphasizing over-trust, rhetorical illusion, social sorting, privacy harms, equity harms, epistemic convergence, and social deskilling, and argues that the EU AI Act, GDPR, and DSA are not structurally equipped to address these harms when governance remains accuracy-centric (Li et al., 12 Sep 2025).

In medical screening, the paradox is formalized through Bayes’ theorem. With sensitivity ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},34, specificity ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},35, and prevalence ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},36, positive predictive value is

ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},37

and

ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},38

Successful screening followed by treatment lowers prevalence, which therefore lowers PPV even if sensitivity and specificity remain unchanged. The ratio of later to initial PPV is

ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},39

The paper also defines the number of positive test iterations needed to reverse the paradox:

ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},40

where ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},41. The result is a prevalence-dependent limit on practical screening accuracy that intensifies as false positives dominate at low prevalence (Balayla, 2020).

These three literatures make a common point from different directions. Accuracy can hide subgroup error concentration, can overstate epistemic trustworthiness, and can decline dynamically even when the underlying test is unchanged. This suggests that fairness, calibration, provenance, and prevalence are not secondary auditing variables; they are constitutive of what counts as accurate performance in the first place.

6. Forecasting, tournaments, and metrology

In time-series forecasting, temporal disaggregation creates a granularity paradox. Finer grains increase sample size ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},42 but also increase the recursive horizon ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},43 needed to cover a fixed planning interval. Under recursive forecasting, small errors compound over the longer horizon. The paper formalizes this with, for example, an AR(1) recursion

ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},44

so that with parameter bias ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},45,

ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},46

Empirically, on a 13-year public procurement series resampled to six grains, Holt–Winters collapses at the Daily level with Test ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},47 and ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},48, while Linear Regression remains stable, with TPFE ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},49 at Monthly, ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},50 at Annual, and ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},51 at Daily. The LSTM exhibits a U-shaped curve: TPFE worsens from Monthly ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},52 to Bi-Weekly ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},53, then improves sharply at Daily to ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},54 with Test ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},55. The proposed consensus–dissensus diagnostic compares the direction of change in pointwise metrics against TPFE to detect cases where standard diagnostics mask recursive error propagation (Moreira, 5 Jul 2026).

In prediction tournaments, the paradox is an extreme-value phenomenon rather than a proxy-metric failure. With Brier score

ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},56

contestant ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},57’s expected total score is

ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},58

so lower RMS error ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},59 implies better expected performance. In one-on-one play, this translates into strong win rates: a forecaster who is ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},60 more accurate wins about ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},61 of the time, and one who is ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},62 more accurate wins about ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},63 of the time. Yet in tournaments with ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},64 contestants and ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},65 questions, when ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},66, the winner is most likely to be around the 100th most accurate, and the top-ranked contestants never win in the reported simulations. The mechanism is a mean–variance tradeoff plus extreme-value selection: less accurate forecasters have worse expected scores but more variable scores, so one of them can realize an unusually favorable outcome trajectory and win the field (Aldous, 2019).

Quantum metrology identifies an even sharper distinction between precision and accuracy. The paper defines accuracy as distributional separability,

ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},67

and precision as the smallest parameter shift that achieves a preset ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},68. Using state distinguishability and the quantum Fisher information, it derives a corrected precision bound

ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},69

which is a factor of ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},70 larger than the traditional ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},71 resolution at ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},72. The paper attributes the correction to the quadratic curvature of the probability–parameter relation near the working point. It further shows an inherent precision limit

ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},73

with ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},74 at ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},75, achieving Heisenberg-like scaling even without entanglement. The cost is reduced accuracy, with ρ(ϕ)=aϕaϕ+(1b)(1ϕ),\rho(\phi)=\frac{a\phi}{a\phi+(1-b)(1-\phi)},76 under that strategy. The paper therefore concludes that accuracy may actually decrease with increasing sampling when one pursues excessive precision (Song et al., 29 Jan 2025).

Across these domains, the paradox does not denote a single theorem but a recurring structural warning. Accuracy fails when it is aggregated over the wrong unit, optimized as a proxy, interpreted without strategic feedback, detached from subgroup or cumulative costs, or equated with variance while ignoring bias. The cited literature therefore replaces generic accuracy with task-aligned objects: segment-level conditional correlation in translation, independent evaluator performance and KL dynamics in RLHF, faithfulness and correction rates in reasoning, balanced subgroup metrics and provenance in LLM governance, PPV under changing prevalence in screening, TPFE under fixed planning horizons in forecasting, latent skill rather than winner-take-all rank in tournaments, and bias-inclusive distinguishability in metrology. This suggests that the central scientific question is not whether a system is accurate in the abstract, but which operational notion of accuracy remains invariant under the data-generating, optimization, and decision process of interest.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Accuracy Paradox.