---
title: 'Jeffreys–Lindley Paradox: Bayesian vs Frequentist'
url: https://www.emergentmind.com/topics/jeffreys-lindley-paradox
type: topic
---

# Jeffreys–Lindley Paradox: Bayesian vs Frequentist

The Jeffreys–Lindley paradox is a central result in statistical theory illustrating a fundamental asymptotic divergence between frequentist hypothesis test conclusions and Bayesian posterior inference, specifically in the context of point null versus composite alternative hypothesis testing. Emerging from the contrasting behaviors of $p$-values and Bayes factors as the sample size increases while the significance level and prior structure are held fixed, the paradox raises critical questions about practical and philosophical interpretations of "evidence" in statistical inference frameworks. Its implications span theoretical statistics, experimental design, and the foundational debate between Bayesian and frequentist methodologies.

## 1. Precise Statement and Mathematical Formulation

Consider the testing of a simple point null hypothesis against a composite alternative under a normal location model:
\[
H_0: \theta = \theta_0 \quad \text{vs.} \quad H_1: \theta \neq \theta_0,
\]
with observations $X_1,\dots,X_n$ independently drawn from $N(\theta,\sigma^2)$, $\sigma^2$ known. The frequentist test utilizes the statistic
\[
\bar X = \frac{1}{n}\sum_{i=1}^{n} X_i, \qquad Z = \frac{\bar X - \theta_0}{\sigma/\sqrt n},
\]
and rejects $H_0$ at level $\alpha$ if $|Z| > z_{\alpha/2}$. The two-sided $p$-value is given by $p = 2[1 - \Phi(|Z|)]$. In a Bayesian framework, prior mass $\pi_0$ is placed on $\theta_0$ (Dirac delta), while under $H_1$, a diffuse prior such as $N(\theta_0, \tau^2)$ is employed:
\[
\pi(\theta) = \pi_0\,\delta_{\theta_0} + (1-\pi_0) N(\theta \mid \theta_0, \tau^2).
\]
The Bayes factor for $H_0$ versus $H_1$ is then
\[
B_{01} = \frac{m_0(\bar X)}{m_1(\bar X)},
\]
where $m_0(\bar X)$, $m_1(\bar X)$ denote the marginal likelihoods under $H_0$ and $H_1$ respectively.

The paradox manifests when, as $n \to \infty$ at fixed $\alpha$ and fixed prior parameters, the $p$-value remains at the threshold $\alpha$ given "just significant" data, while the Bayes factor $B_{01} \to \infty$ and thus the Bayesian posterior probability of $H_0$ tends to 1. Explicitly, for data with $|\bar X - \theta_0| = z_{\alpha/2} \sigma/\sqrt n$,
\[
B_{01} \to \infty \quad \text{as} \quad n \to \infty,
\]
indicating ever-increasing Bayesian support for $H_0$ despite the frequentist criterion continuously rejecting $H_0$ [2511.22816, 2503.14650, 1310.3791].

## 2. Distinction from Bartlett’s Anomaly and Conceptual Clarifications

A persistent misconception has conflated the Jeffreys–Lindley paradox with what is properly termed Bartlett’s anomaly, wherein the prior variance $\tau^2$ under $H_1$ diverges ($\tau^2 \to \infty$) at fixed sample size. Both phenomena result in $B_{01} \to \infty$ under different asymptotic regimes: the Jeffreys–Lindley paradox is driven by $n \to \infty$ at fixed $\tau^2$, while Bartlett’s anomaly is driven by $\tau^2 \to \infty$ at fixed $n$. These situations possess distinct mathematical structures and implications, and require separate resolutions [2511.22816].

## 3. Mechanistic Origins and Statistical versus Practical Significance

At its core, the paradox is a consequence of tension between statistical and practical significance. The frequentist method assesses the observed gap $|\bar X - \theta_0|$ relative to the rapidly decreasing standard error, leading to "statistical significance" for arbitrarily small deviations as $n$ increases. In contrast, the Bayesian framework, penalizing the alternative for spreading prior mass over a large parameter space, increasingly favors the point null as data accumulates near $\theta_0$—a property termed the "Ockham’s razor" effect [2503.14650, 1310.3791]. This is further compounded under large $n$ by the fact that even negligible differences become significant under the frequentist protocol, whereas the Bayesian Bayes factor continues to reward parsimony unless the observed effect is substantial relative to region covered by the alternative prior.

## 4. Extensions and Implications in Testing and Estimation

The paradox critically impacts both hypothesis testing and interval estimation. With positive prior mass allocated to a point null, the Bayesian posterior can concentrate so strongly on that point as $n \to \infty$ (for fixed Bayes factor or posterior odds target), that credible intervals constructed from the posterior mixture distribution may become undefined for certain credibility levels. This "incredibility gap" means that for some values of $\alpha$, no central credible interval exists—a phenomenon exclusive to Bayesian procedures with point-mass mixture posteriors, not mirrored in frequentist confidence intervals [2210.00029].

The table illustrates credible interval definability:

| Posterior Model | Mixture Posterior with Point Mass | Purely Continuous Posterior      |
|-----------------|-----------------------------------|----------------------------------|
| Interval Issue  | Credibility gap may arise         | Credible intervals always exist  |

Frequentist confidence intervals, by contrast, retain well-defined coverage properties for all $\alpha$, emphasizing fundamental inferential discrepancies in the presence of point-mass priors.

## 5. Resolutions: Interval Nulls and Alternative Bayesian Calibrations

A central theme in current research is that the only principled resolution to the Jeffreys–Lindley paradox is the reformulation of the hypothesis from a point null $H_0: \theta = \theta_0$ to an interval (or "practical equivalence") null $H_0: |\theta - \theta_0| \leq \delta$ where $\delta > 0$ captures the minimum effect size of scientific interest [2511.22816, 2503.14650]. With interval nulls, both frequentist and Bayesian evidence accumulation are commensurate: frequentist equivalence testing uses confidence interval overlap with $[\theta_0 - \delta, \theta_0 + \delta]$, and the Bayesian approach compares continuous prior probabilities over the interval null and its complement. In this setting, the paradox disappears; both approaches cohere and reflect practical significance rather than a measure-zero point null.

Alternative calibrations have been proposed:
- Use of finite, scientifically motivated priors for $\tau^2$ to control the size of Bayes factor penalties [1503.04098],
- Cake priors that diffuse at rates matched to the number of parameters, leading to automatic BIC-like penalties and Chernoff consistency (asymptotically zero type I and II errors) [1710.09146],
- Predictive model selection (AIC- or cross-validation-based criteria) in place of postdictive Bayes factors to maintain detection resolution and avoid the paradox for large $n$ [1610.09433].

## 6. Broader Impact, Domain-Specific Manifestations, and Remaining Issues

The paradox has significant practical implications in fields where large samples are common and sharp nulls are tested, including high energy physics and precision metrology. For example, in particle physics, established practice often requires $5\sigma$ significance for discovery declarations, but as the paradox demonstrates, fixed thresholds on the $p$-value or $z$-score can be at odds with Bayesian conclusions as sample sizes become enormous and systematic uncertainty dominates inference [1310.3791]. Similar discordance has been documented in phase estimation with optical interferometry: Bayesian conclusions may depend strongly on prior width, while the frequentist test signals almost certain "discovery," revealing the extent to which experimental context and scientific prior knowledge must be incorporated to avert misleading inference [1510.07149].

Even with "objective" or diffuse priors justified by lack of knowledge, the paradox reveals a mathematical impossibility: truly $n$-indifferent inference requires improper (scale-invariant) priors that cannot be normalized, so any proper prior with truncation inevitably introduces $n$-dependence and can only delay, not remove, the paradox [2012.04879].

## 7. Summary of Recommendations and Theoretical Insights

Established recommendations for practitioners seeking to avoid the Jeffreys–Lindley paradox include:

1. Replace point nulls with scientifically meaningful interval nulls whenever possible, aligning statistical testing with practical relevance [2511.22816, 2503.14650].
2. Employ finite, problem-specific priors for alternatives to prevent automatic dominance by $H_0$, calibrating $\tau^2$ or prior mass to practical effect sizes [1503.04098, 1510.07149].
3. Use predictive or cross-validation criteria rather than pure marginal likelihoods or postdictive Bayes factors in scenarios where maximizing detection resolution and minimizing paradoxical inconsistencies is paramount [1610.09433].
4. Exercise caution in interpreting model-averaged credible intervals with point-mass priors, as standard interval procedures may become undefined for large $n$ [2210.00029].
5. Conduct sensitivity analyses with respect to prior distribution, width, and truncation points, especially when the goal is to align statistical with substantive scientific significance.

The Jeffreys–Lindley paradox highlights the necessity of integrating practical effect sizes into hypothesis testing, the limitations of uncritical use of $p$-values or Bayes factors for point nulls in high-dimensional or large-sample regimes, and the conceptual need for careful prior specification in Bayesian model comparison. These findings reinforce the need for scientific context and problem-specific calibration in modern statistical inference [2511.22816, 2503.14650, 1310.3791, 2210.00029, 1510.07149, 1610.09433, 1710.09146, 1503.04098, 2012.04879].

Source: https://www.emergentmind.com/topics/jeffreys-lindley-paradox