Papers
Topics
Authors
Recent
Search
2000 character limit reached

Forecasting Scientific Progress with Artificial Intelligence

Published 21 May 2026 in cs.AI | (2605.22681v1)

Abstract: AI is increasingly embedded in scientific discovery, yet whether it can anticipate scientific progress remains unclear. To study this question, we introduce a temporally grounded evaluation framework for forecasting scientific progress under controlled knowledge constraints. We present CUSP (Cutoff-conditioned Unseen Scientific Progress), a multi-disciplinary and event-level benchmark that evaluates scientific forecasting in AI systems through feasibility assessment, mechanistic reasoning, generative solution design, and temporal prediction. Across 4,760 scientific events, we observe systematic and domain-dependent limitations in current frontier models. While models can identify plausible research directions from competing candidates, they fail to reliably predict whether scientific advances will be realized and systematically misestimate when they will occur. Performance is highly heterogeneous across domains, with the timing of AI progress more predictable than advances in biology, chemistry, and physics. Performance is largely insensitive to whether events occur before or after the training cutoff, suggesting these limitations cannot be explained solely by knowledge exposure in training data. Under controlled information access, additional pre-cutoff knowledge improves performance but does not close the gap to full-information settings, which becomes more pronounced for high-citation advances. Models also exhibit systematic overconfidence and strong response biases, indicating unreliable uncertainty estimation. Taken together, current AI systems fall short as predictive tools for scientific progress. Access to prior knowledge does not translate into reliable forecasting, and performance benefits more from post-event information than from forward-looking prediction.

Summary

  • The paper introduces the CUSP benchmark for evaluating AI's performance in forecasting scientific progress, highlighting limitations in feasibility and generative solution predictions.
  • It reveals marked variations across domains and model architectures, exposing systematic biases and calibration failures in temporal and binary predictions.
  • The study underscores a critical epistemic gap, advocating for advanced uncertainty quantification and counterfactual reasoning to improve AI-driven scientific foresight.

Evaluating AI as a Predictor of Scientific Progress: Insights from the CUSP Benchmark

Introduction

The increasing integration of AI systems into scientific discovery workflows has prompted foundational questions regarding their capability as epistemic forecasters, not just assistants. While LLMs and associated agentic architectures have demonstrated strong performance in hypothesis generation, mechanistic reasoning, and retrospective problem-solving, a rigorous evaluation of forward-looking scientific forecasting remains absent. "Forecasting Scientific Progress with Artificial Intelligence" (2605.22681) addresses this gap by introducing CUSP (Cutoff-conditioned Unseen Scientific Progress), a temporally grounded, event-level benchmark systematically designed to probe the forecasting competence of contemporary AI systems across the empirical sciences and engineering.

Benchmark Construction and Methodology

CUSP operationalizes scientific forecasting through a dataset of 4,760 verifiable scientific milestones, extracted from high-impact peer-reviewed publications and authoritative, community-driven repositories spanning nine scientific domains (notably biology and AI, but also chemistry, physics, materials science, neuroscience, environmental science, medicine, and more). Each event is temporally anchored, allowing for strict knowledge cutoffs to disentangle knowledge retrieval from true forecasting ability. Key to the benchmark design is the multidimensional evaluation across:

  • Feasibility Assessment (binary prediction): Can a model distinguish realizable advances from plausible, yet unrealized, alternatives?
  • Mechanistic Reasoning (MCQ): Can the model identify prospectively the technical approach that will enable a future breakthrough, given expert-level distractors?
  • Generative Solution Design (FRQ): Can the model produce concrete, technically specific solutions to open research problems, gated to prevent information leakage from post-cutoff discoveries?
  • Temporal Prediction (date): Can a model accurately forecast the timing of milestone achievements?

A rigorous filtering and validation pipeline—combining independent LLM adjudication and human expert review—ensures that each task in CUSP is based on unambiguous, post-hoc verifiable outcomes and that prompt phrasing is strictly disentangled from the reward signal inherent in LLM pretraining.

Empirical Findings on Model Forecasting Competence

General Performance Patterns

Comprehensive benchmarking of proprietary (GPT-5.4, Claude S4.5, GPT-4o) and open-source (LLaMA-3.3, GPT-OSS-20B, DeepSeek R1) LLMs reveal systematic and domain-dependent limitations in AI scientific forecasting. While models consistently exceed chance on mechanistic identification tasks (e.g., MCQ accuracy for GPT-5.4: 0.819), they remain near chance for feasibility prediction and exhibit much lower performance on open-ended generative solution design (highest FRQ pass rate: 60.3% for GPT-5.4, with all others at or below 20%). Date prediction performance is weak: across all models, the median absolute error is in the 4–26 month range, and models routinely overpredict how far into the future scientific advances occur.

Two strong and somewhat contradictory findings emerge:

  • Model performance is largely insensitive to training data cutoff: models do not perform markedly better on pre-cutoff events than on post-cutoff events, counter to the expectation that direct exposure to the correct answer via training should boost accuracy.
  • Increasing access to explicit pre-cutoff knowledge (via targeted retrieval or web augmentation) yields only minor improvements in forecasting performance. The residual performance gap relative to a full-information, hindsight analysis persists and is particularly pronounced for high-citation advances.

Domain- and Capability-Dependent Variation

Performance heterogeneity is primarily capability-dependent rather than purely domain-dependent:

  • Mechanistic reasoning (MCQ): Highest in physics, neuroscience, and environmental science; lower in chemistry and materials science.
  • Date prediction: Most accurate in AI and digital domains, far less reliable in the experimental sciences.
  • Feasibility assessment: Uniformly poor across all domains, implying an inability to distinguish which plausible-sounding advances will genuinely materialize.

Systematic Biases and Calibration Failures

AI models display systematic overconfidence, particularly in open-ended or extrapolative forecasting settings. Confidence calibration is robust for MCQs but collapses on binary and temporal forecasting, with persistent response biases (e.g., recency or delay bias in temporal prediction; strongly affirmative or negative prior in binary settings) dominating empirical accuracy. These calibration failures are stable, even with controlled knowledge access, indicating that models lack a coherent uncertainty quantification framework when reasoning out-of-distribution.

Theoretical and Pragmatic Implications

CUSP’s central finding is that current frontier AI models, even with full access to relevant scientific priors, do not operationalize these priors into robust forecasting. Instead, they benefit disproportionately from retrospective exposure: models can recapitulate discoveries once revealed but fail to anticipate them prospectively, particularly for high-impact or outlier events.

This exposes a fundamental epistemic gap—the inability to translate knowledge into predictive inference—that is not bridgeable by scale, web augmentation, or continued pretraining alone. This gap is more acute in domains characterized by emergent, discontinuous, or cross-disciplinary advances (e.g., biology, experimental physics), and less so in areas such as AI itself, where progress is more incremental and benchmark-driven.

Prospective and Future Directions

The introduction of the CUSP Time Capsule mechanism, which contains currently unresolved scientific event queries, establishes a prospective evaluation pipeline for tracking model prediction consistency over time and monitoring for emerging meta-learned scientific priors or implicit forecasting patterns. These mechanisms will be critical for studying how future AI architectures, potentially equipped with explicit counterfactual reasoning, uncertainty-aware inference, or agentic exploration, may begin to bridge the knowledge-to-forecasting divide.

From a pragmatic standpoint, the study implies that reliance on current LLMs for foresight-driven research prioritization, roadmap setting, or funding allocation would be unjustified. Overcoming the forecasting gap will require fundamental advances in epistemic modeling, uncertainty quantification, and possibly meta-scientific reasoning architectures.

Conclusion

"Forecasting Scientific Progress with Artificial Intelligence" (2605.22681) presents the first event-level, temporally grounded benchmark systematically quantifying the gap between knowledge access and actual forecasting in AI. The evidence demonstrates that LLMs can recognize plausible directions and backfit solutions once realized, but remain fundamentally unreliable as epistemic forecasters of novel scientific progress, particularly for high-impact or discontinuous advances. These findings provide both a methodological framework and a call to arms for more rigorous integration of epistemic uncertainty, counterfactual modeling, and prospective evaluation in the development of future AI scientific agents. Closing this epistemic gap is not an incremental engineering problem but a key open scientific challenge in the path to AI-accelerated discovery.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 23 tweets with 43 likes about this paper.