Papers
Topics
Authors
Recent
Search
2000 character limit reached

No Evidence, No Score

Updated 4 July 2026
  • No Evidence, No Score is a framework that defines numerical scores as valid only when their evidential conditions, including measurement scales and zero points, are rigorously validated.
  • It critiques the use of common metrics like P-values, Bayes factors, and AUROC by highlighting issues such as contaminated evidence, construction artifacts, and baseline misinterpretations.
  • The approach drives updates in various fields—from AI agent evaluation to cosmology and credit scoring—emphasizing that only outputs with a verifiable evidence pathway can be considered scientifically justified.

“No Evidence, No Score” denotes a methodological position according to which a numerical score, significance estimate, or benchmark outcome should not be treated as scientific evidence unless the evidential conditions that justify that number are themselves validated. In the works collected under this theme, the issue appears in several forms: evidence statistics that lack a legitimate measurement scale, benchmark scores that cannot show the evidence path that produced them, significance claims contaminated by construction artifacts or covariance mismatch, and empirical null-result studies in which improved instrumentation or stricter tests remove earlier signals. This suggests a common norm: a score is not self-authenticating merely because it is numeric (Vieland, 2018, Gao et al., 11 May 2026).

1. Measurement theory and the problem of a zero point

Veronica Vieland’s “Absolutely Zero Evidence” treats the routine interpretation of PP-values, maximum likelihood ratios, and Bayes factors as a measurement problem rather than merely a statistical one (Vieland, 2018). The paper reviews the standard scale types of representational measurement theory—ordinal, interval, ratio, and “absolute” in a stronger thermodynamic sense—and argues that familiar evidence statistics do not conform to any legitimate scale type. Scientists often use PP, logP-\log P, MLR\mathrm{MLR}, logMLR\log \mathrm{MLR}, BF\mathrm{BF}, and logBF\log \mathrm{BF} as if they preserved evidential meaning. Under measurement theory, that practice is already diagnostic: if logarithmic transformation is freely allowed, then the quantity is at best ordinal, because interval or ratio scales do not permit meaning-preserving nonlinear transformations. On that view, claims such as “twice as much evidence” or “the same evidential increment” are unjustified (Vieland, 2018).

The paper’s central conceptual test is the existence of an “absolute 0 evidence.” Vieland argues that a genuine zero point for evidence cannot mean neutrality between hypotheses. Instead, it must correspond to the absence of relevant information, captured by the principle that evidence should approach its minimum as n0n \to 0, or more generally as the amount of relevant information in the data approaches $0$ (Vieland, 2018). This relocates the meaning of zero from “transition point” to “informational emptiness.”

That distinction is what invalidates the usual candidate evidence scores. In coin-toss examples, logP-\log P, PP0, and PP1 can all remain fixed at PP2 while PP3 increases and the evidential situation changes. Data at a Bayes-factor transition point may be highly informative and yet equally incompatible with both compared hypotheses. The score therefore conflates no relevant information with informative but hypothesis-balanced data. Vieland’s conclusion is accordingly stronger than a complaint about misuse: the usual minimum values “cannot be pressed into service as 0-points for a proper evidence measurement scale,” and without a defensible zero there is no scientifically validated evidence score in the strict representational sense (Vieland, 2018).

2. Evidence-conditioned scoring in AI and agent evaluation

Recent work on agent evaluation makes the slogan operational by treating the evidence path as part of the object being scored. “GroundEval” defines a judge-free framework for stateful agents in which a plausible final answer does not receive credit unless the agent searched, fetched, cited, and was permitted to use the relevant artifacts (Flynt, 22 Jun 2026). The framework formalizes four inputs—event log, artifact corpus, access policy, and evaluation config—and evaluates both final answer and trajectory under grounded, time-bounded, and access-controlled constraints. In context mode, citation validity is defined by

PP4

so a cited artifact counts only if it was injected into context, visible to actor PP5, and available by the as-of time PP6 (Flynt, 22 Jun 2026). The motivating Silence-track example is deliberately stark: two frontier LLM judges scored a plausible answer PP7 and PP8, but the agent had never fetched the decisive artifact, so GroundEval assigned an answer score of PP9. Its compliance-adjusted score is

logP-\log P0

so repeated access, horizon, or subsystem violations cannot be washed out by a superficially correct answer (Flynt, 22 Jun 2026).

A related diagnostic protocol for long-context and retrieval-augmented models introduces four matched evidence-availability conditions: no evidence, full context, retrieved evidence, and oracle-evidence reference (Xia, 4 Jun 2026). Its central estimator, ONCU, is

logP-\log P1

and it is declared valid only when

logP-\log P2

That denominator-validity requirement is the formal version of “no evidence, no score”: if oracle evidence does not improve over the no-evidence baseline, then there is no positive evidence-derived advantage to normalize, so a utilization ratio is uninterpretable (Xia, 4 Jun 2026).

The same logic appears in outcome verification for interactive agents. The outcome-evidence reporting layer assigns each completed record one of three labels—Evidence Pass, Evidence Fail, or Unknown—and refuses to collapse Unknown into a resolved success or failure (Gao et al., 11 May 2026). With logP-\log P3, logP-\log P4, and logP-\log P5 denoting those counts,

logP-\log P6

and the all-record performance is only partially identified: logP-\log P7 These are explicitly partial-identification bounds rather than confidence intervals. When logP-\log P8, any point estimate resolves records without evidence (Gao et al., 11 May 2026).

Even in the absence of ground-truth labels, the same rule reappears in comparative safety scoring. “When No Benchmark Exists” argues that a score is deployment-relevant only under a fixed scenario pack, rubric, auditor, judge, sampling configuration, and rerun budget, and only after an instrumental-validity chain has been established: responsiveness to a safe-versus-abliterated contrast, dominance of target-driven variance, and rerun stability (Gautam et al., 7 May 2026). In the Norwegian validation of SimpleAudit, safe and abliterated targets separate with AUROC values between logP-\log P9 and MLR\mathrm{MLR}0, target identity is the dominant variance component with MLR\mathrm{MLR}1, and severity profiles stabilize by ten reruns. The paper’s claim is narrow but exact: without that validation evidence, the score is merely output, not deployment evidence (Gautam et al., 7 May 2026).

3. Contaminated scores and construction-dependent significance

A score may also fail because it is not measuring the intended object. The BOSS parity-violation analysis is a direct case in which the reported significance statistic was shown to be structurally contaminated (Krolewski et al., 2024). Earlier work compressed the parity-odd four-point correlation function MLR\mathrm{MLR}2 into

MLR\mathrm{MLR}3

but MLR\mathrm{MLR}4 is parity-even. Its expectation decomposes into a genuine parity-violation contribution and an additive contamination term,

MLR\mathrm{MLR}5

The second term is an 8PCF mismatch term, so a large score can arise from data–mock covariance mismatch even when the parity-odd mean is zero (Krolewski et al., 2024). The paper introduces MLR\mathrm{MLR}6 to isolate the signal and MLR\mathrm{MLR}7 to isolate the mismatch. Applied to BOSS, the clean parity-violation signal ranges from MLR\mathrm{MLR}8 to MLR\mathrm{MLR}9 depending on analysis choices, whereas the 8PCF bias term is logMLR\log \mathrm{MLR}0; hence the conclusion that there is no compelling evidence for parity violation in BOSS (Krolewski et al., 2024).

An analogous problem appears in fact verification under the NEI (“Not Enough Information”) label. “Evidence Absence Is Not Evidence Insufficiency” argues that NEI is not construction-free: placeholder evidence, random irrelevant evidence, position-biased non-rationales, BM25 near-misses, cited non-rationales, same-document non-rationales, fixed-claim substitutions, and missing-hop constructions all instantiate different evidence conditions (Qiu et al., 26 May 2026). The paper’s decisive finding is that competence does not transfer reliably across those constructions. On SciFact, a DeBERTa-v3-base model trained on placeholder NEI achieves matched placeholder NEI-F1 of logMLR\log \mathrm{MLR}1 but logMLR\log \mathrm{MLR}2 on BM25 near-miss and cited hard NEI; on the held-out human-adjudicated hard-NEI set, placeholder and position-biased training both yield NEI recall logMLR\log \mathrm{MLR}3, whereas BM25 near-miss and cited non-rationale training reach logMLR\log \mathrm{MLR}4 and logMLR\log \mathrm{MLR}5, respectively (Qiu et al., 26 May 2026). Fixed-claim diagnostics define a reference-label probability drop

logMLR\log \mathrm{MLR}6

showing that changing only the evidence condition shifts confidence in the original Support/Refute label, not merely NEI recall (Qiu et al., 26 May 2026). The implication is precise: an aggregate NEI score can hide which evidential problem the model has actually solved.

4. Null tests in cosmology and galaxy evolution

In cosmology, “no evidence” often appears through explicit null-test parameterizations. A study of dynamical dark energy constructed two one-parameter deformations of flat late-time logMLR\log \mathrm{MLR}7CDM,

logMLR\log \mathrm{MLR}8

with the null conditions logMLR\log \mathrm{MLR}9 and BF\mathrm{BF}0 corresponding exactly to constant dark energy (Wang et al., 2017). Using the combined “CBSLC” dataset—CMB, BAO, SNIa, lensing, and cosmic chronometers—the fitted values are BF\mathrm{BF}1 and BF\mathrm{BF}2. The latter is only about BF\mathrm{BF}3 from zero, so the paper concludes there is no evidence of dynamical dark energy at the BF\mathrm{BF}4 confidence level. The same analysis notes only slight alleviation of the BF\mathrm{BF}5 and BF\mathrm{BF}6-related tensions and a small one-parameter fit improvement of BF\mathrm{BF}7, which it does not interpret as strong support for dynamics (Wang et al., 2017).

A related Early Dark Energy analysis asks whether known Planck anomalies might be anti-correlated with EDE and therefore hide it in full Planck data (Fondi et al., 2022). The model uses the standard axion-like scalar field and the EDE fraction

BF\mathrm{BF}8

then enlarges the parameter space with BF\mathrm{BF}9, logBF\log \mathrm{BF}0, and logBF\log \mathrm{BF}1. Across all full-Planck-based fits, the posterior remains consistent with zero and yields only upper limits, typically logBF\log \mathrm{BF}2–logBF\log \mathrm{BF}3. Representative CMB-only bounds include logBF\log \mathrm{BF}4 for EDE+logBF\log \mathrm{BF}5 and logBF\log \mathrm{BF}6 for EDE+logBF\log \mathrm{BF}7, with negligible correlation between logBF\log \mathrm{BF}8 and the anomaly parameters (Fondi et al., 2022). The paper’s conclusion is therefore not that EDE is impossible, but that full Planck contributes no positive evidence for it.

The same null-result logic extends to environmental effects in galaxy evolution. Using UNIONS logBF\log \mathrm{BF}9-band imaging as a resolved tracer of recent star formation, one study compared 5277 local satellites to 8360 matched field galaxies and quantified asymmetry with n0n \to 00, n0n \to 01, n0n \to 02, n0n \to 03, and n0n \to 04 (Foster et al., 18 Feb 2025). The full satellite and field distributions are described as “extremely similar” by eye; where formal AD-test differences appear, they often go in the opposite direction from the ram-pressure-enhancement picture, with slightly higher asymmetry in the field sample. Even the “RPS-likely” subset of 347 satellites in low-stellar-mass, high-halo-mass, early-infall conditions is indistinguishable from the low-mass field control. The conclusion is therefore that there is no strong statistical evidence for asymmetrically enhanced star formation in infalling galaxies, and any enhancement must be small, uncommon, or short-lived (Foster et al., 18 Feb 2025).

5. Experimental and observational null results in the physical sciences

A large class of “No Evidence, No Score” studies proceeds by remeasurement, contamination control, or higher-resolution follow-up. In helioseismology, a GONG-based reanalysis of 31 flares tested whether solar flares drive high-frequency global oscillations above the acoustic cutoff at n0n \to 05 mHz (Richardson et al., 2012). The result is explicitly null: among the 31 flares, a decrease in acoustic power after the flare is just as likely as an increase; the Spearman rank correlation gives less than n0n \to 06 confidence, and the Pearson correlation strongly indicates no correlation. The paper therefore finds no evidence that consistently supports flare-driven high-frequency waves (Richardson et al., 2012).

In nuclear spectroscopy, a targeted remeasurement of the n0n \to 07 reaction at n0n \to 08 MeV revisited the long-cited n0n \to 09 MeV $0$0 state in $0$1 (Smit et al., 2012). Modern low-background spectra at $0$2, $0$3, and $0$4 show “a deep valley where the 11.16 MeV state is expected,” and line-shape fitting reproduces the region with the known neighboring structures and background, without any additional resonance. The paper concludes that there is no evidence for the previously reported state and that the relevant $0$5 strength lies instead in the broad $0$6–$0$7 MeV structure (Smit et al., 2012).

In star formation, higher-resolution $0$8 mm mapping of Barnard 59’s nuclear clump confirms the earlier extinction-based impression of a monolithic object (Román-Zúñiga et al., 2012). After subtraction of known YSO contributions, the central clump remains smooth, with no significant evidence for prestellar fragmentation on scales below about $0$9 AU. The system is not inert—the paper quotes a virial parameter logP-\log P0—but it is not breaking into multiple dense subcores within the observed resolution and sensitivity (Román-Zúñiga et al., 2012).

In high-pressure hydrogen physics, a rebuttal to the claim of a new phase above logP-\log P1 GPa at logP-\log P2 K argues that the reported evidence does not meet ordinary phase-transition criteria (Dias et al., 2016). The key points are all evidential. The logP-\log P3 mode remains visible to at least logP-\log P4 GPa; the logP-\log P5 mode moves under the logP-\log P6 first-order diamond phonon near logP-\log P7 GPa and is therefore masked rather than shown to disappear; and the linewidth change in logP-\log P8 begins around logP-\log P9 GPa rather than PP00 GPa. The purported high-frequency vibron anomalies also overlap the second-order diamond Raman band between PP01 and PP02. The conclusion is that there is no evidence for a phase transition at PP03 GPa (Dias et al., 2016).

In debris-disk astronomy, V488 Per provides a case in which the strongest results are again absences (Sankar et al., 2021). Herschel photometry confirms an outer dust population with a blackbody-fit temperature of PP04 K, while Subaru/COMICS spectroscopy of the PP05 K inner dust does not detect any obvious solid-state emission features. The combined radial-velocity and adaptive-optics campaign also finds no evidence for stellar or substellar companions within several hundred AU, with companions in the warm/cool belt gap constrained to PP06 under the adopted two-belt architecture (Sankar et al., 2021). The paper’s interpretation remains cautious: metallic iron or amorphous carbon are allowed because they do not produce strong PP07–PP08 features, but they are not directly detected (Sankar et al., 2021).

6. Statistical, institutional, and practical consequences

The slogan also appears in classical significance testing and institutional scoring systems. In the critique of alleged planetary influence on solar activity, Cameron and Schüssler redo the significance calculations with corrected white- and red-noise generation, matched preprocessing, and unbiased frequency bins of width PP09 (Cameron et al., 2013). The resulting chance-coincidence probabilities rise to PP10 for white noise and PP11 for red noise, far above the values claimed in the original planetary-torque analysis. The conclusion is not that no planetary mechanism is possible in principle, but that the apparent period matches are statistically insignificant and provide no evidence for planetary influence on solar activity (Cameron et al., 2013).

The same institutional lesson appears in consumer credit scoring. Albanesi and Vamossy argue that credit scores are central to U.S. debt allocation despite little public evidence on their performance (Albanesi et al., 2024). Benchmarking a widely used score against a machine-learning default model built from legally permissible credit-report features, they find average AUC PP12 for the score and PP13 for the model, along with PP14 misclassification across broad risk categories. The misclassification is especially severe among low-score borrowers: PP15 for Deep Subprime and PP16 for Near Prime (Albanesi et al., 2024). The paper’s equity argument is performance-based rather than rhetorical: the alternative model improves predictive accuracy most for young, low-income, and minority groups because it performs better on thin-file and otherwise low-quality-data cases. This suggests that heavily relied-upon score categories can outrun the publicly available empirical case for their validity (Albanesi et al., 2024).

Taken together, these works suggest that “No Evidence, No Score” is not a single doctrine but a family of evidential constraints on quantification. A PP17-value, Bayes factor, AUROC, benchmark win rate, safety score, NEI-F1, or credit category may be computationally well defined and still fail as evidence if its zero point is equivocal, its denominator is invalid, its construction is shortcut-prone, its covariance is contaminated, its retained artifacts do not verify the claimed outcome, or its subgroup performance is unknown (Vieland, 2018, Gao et al., 11 May 2026). In that sense, the principle is not anti-measurement. It is a demand that measurement claims inherit the same rigor as the hypotheses they are used to support.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to No Evidence, No Score.