---
title: Test-based Bayes Factors
url: https://www.emergentmind.com/topics/test-based-bayes-factors-tbfs
type: topic
---

# Test-based Bayes Factors

Test-based Bayes factors (TBFs) constitute a class of Bayesian hypothesis testing methodologies in which the Bayes factor is computed directly from the sampling distribution of a test statistic (such as a $z$, $t$, $F$, $\chi^2$ value, or a suitably standardized nonparametric statistic) and a prior placed on its noncentrality parameter or other effect-indexing quantity. This paradigm provides closed-form or numerically tractable expressions for Bayes factors in a broad range of testing problems, bypassing the need for full-likelihood models or specification of high-dimensional priors on nuisance parameters. TBFs have become a prominent approach in meta-analytic settings, scientific replication studies, robust evidence calibration, and situations where only summary statistics are available rather than raw data. Their foundational structure allows for alternative prior specifications—such as local (e.g., Gaussian) or non-local (e.g., inverse-moment or moment) priors—whose choice has substantial impact on the evidential properties and frequentist error control of the resulting Bayes factor.

## 1. Theoretical Foundations of TBFs

Let $T$ be a scalar or low-dimensional test statistic with known sampling distribution $f_0(t)$ under the null hypothesis $H_0$ and alternative distribution $f_1(t)$ under $H_1$ (possibly parameterized by a noncentrality parameter $\lambda$ or standardized effect size $\Delta$). The generic TBF is defined as
\[
\text{BF}_{01}(T) = \frac{f_0(T)}{m_1(T)}
\]
where $m_1(T) = \int f_1(T \mid \lambda)\,\pi(\lambda)\,d\lambda$ is the marginal predictive distribution of the test statistic under $H_1$ with prior $\pi$ on the effect size parameter. When priors are chosen as normals, Cauchy, moment, or inverse-moment types centered at scientifically meaningful effect sizes, one obtains a "Bayes factor function" (BFF) mapping each candidate $\Delta$ or $\omega$ to the value of the Bayes factor [2506.16674, 2310.16213, 2210.00049].

Formally, when $H_0$ corresponds to $\lambda = 0$ and the alternative is indexed by $\lambda$ (e.g., $\lambda = \sqrt{n} \Delta$ for one-sample $z$), typical BFF constructions take the form
\[
\text{BF}_{10}(T \mid \tau^2, r) = (1+\tau^2)^{-a} \cdot G(\text{statistic, } \tau^2, r)
\]
where $a$ is a function of the prior order $r$ and statistic, and $G$ is a (confluent or hypergeometric) function characterizing the marginal [2310.16213].

Alternative approaches use a likelihood-based predictive distribution for $T$ under a mixing prior on $\lambda$ (e.g., normal, Cauchy, gamma), leading to test-calibrated closed formulas for many classical test situations [1808.08491, 2210.00049]. For nonparametric statistics, such as Kendall's $\tau$ or partial correlation coefficients, recent work leverages the asymptotic distribution of standardized statistics and places priors on the noncentrality parameter, again yielding TBFs in closed form [2105.00364, 2503.10787].

## 2. Comparative Approaches: Local and Non-Local Priors

A salient feature distinguishing TBF methodologies is the nature of the prior assigned to the effect parameter under $H_1$. Local priors—such as the normal or Cauchy—assign nonzero mass in any neighborhood of the null. These yield Bayes factors that are less aggressive in accumulating evidence for $H_0$, particularly for small effect sizes or moderate $T$ values. Non-local priors—especially the inverse-moment priors (iMOM) and normal moment priors—enforce $\pi(0)=0$ and accumulate evidence for the null much more rapidly when the observed statistic is small. The iMOM prior of order $\nu$ is
\[
i(\lambda \mid \tau, \nu) = \frac{\tau^{\nu/2}}{\Gamma(\nu/2)} |\lambda|^{-(\nu+1)} \exp\left( -\frac{\tau}{\lambda^2} \right)
\]
which, when centered on $\lambda_0 = \sqrt{n} \Delta$, can be tailored so that the mode is at the hypothesized effect size [2506.16674, 2310.16213].

This distinction has substantial operating characteristics. Non-local TBFs provide polynomial rates of evidence accumulation toward $H_0$ under the null, contrasting with the slower rates of local prior-based Bayes factors, thereby offering substantially better control of Type I error while retaining exponential evidence under the alternative [2310.16213].

## 3. Practical Computation and Closed-form Results

For the most frequently encountered test statistics—$z$, $t$, $\chi^2$, $F$—TBFs admit closed-form or one-dimensional integral expressions for the Bayes factor. For example, with a normal moment prior (order $r$) on the noncentrality parameter in the $z$-test, one obtains [2310.16213, 2210.00049]:
\[
\text{BF}_{10}(z \mid \tau^2, r) = (1+\tau^2)^{-(r+1/2)} \, _1F_1(r+1/2, 1/2, \frac{\tau^2 z^2}{2(1+\tau^2)})
\]
and, for a $t$-test,
\[
\text{BF}_{10}(t \mid \tau^2, r) = (1+\tau^2)^{-(r+1/2)} \left[ \, _2F_1( (\nu+1)/2, r+1/2; 1/2; y^2 ) + c y \, _2F_1( \nu/2 + 1, r+1; 3/2; y^2 ) \right]
\]
with $y$ and $c$ as defined above, and $\nu$ the degrees of freedom.

For the Bayesian $t$-test with an arbitrary $t$-prior $\pi(\delta)$ on the standardized effect, the Bayes factor reduces to a single one-dimensional integral:
\[
\text{BF}_{10}(t) = \frac{ \int_{-\infty}^{\infty} T_\nu(t \mid \sqrt{n_\delta} \delta) \pi(\delta) d\delta }{ T_\nu(t) }
\]
facilitating numerical evaluation even in subjective or "informed" prior settings [1704.02479].

Test-based BIC approximations are further available when only summary statistics (e.g., $F$, $df$, $n$) are reported, with the standard formula for ANOVA:
\[
BF_{01} \approx \sqrt{ n^{df_1}(1 + F \cdot df_1/df_2)^{-n} }
\]
which is widely adopted for meta-analysis or reanalysis of published results [1803.00360].

## 4. Interpretation, Calibration, and Evidence Scales

TBFs yield a direct, ratio-scale measure of evidential support for $H_1$ versus $H_0$, rendering them fundamentally different from $p$-values which do not quantify support for $H_0$. The interpretive framework for TBFs is based on established Bayes factor scales (e.g., $1$–$3$: weak, $3$–$20$: positive, $>150$: very strong) or, alternatively, via log-scales such as the base-$3.73$ units advocated in empirical Bayes settings [2301.11057]. The continuous mapping $\Delta \mapsto \text{BF}(\Delta)$ provided by BFFs supplies a full weight-of-evidence curve, permitting scientific interpretation of what effect sizes are supported or disfavored by the data [2506.16674, 2210.00049]. This approach also rigorously exposes Lindley’s paradox, in which Bayes factors may support $H_0$ even when the corresponding test is “significant” at a given $\alpha$.

TBFs indexed by prior scale (e.g., $\tau^2$ matching a standardized effect size) allow practitioners to plot $\log$BF as a function of hypothesized alternative magnitude, replacing dichotomous hypothesis testing with an evidential continuum.

## 5. Applications to Meta-analysis, Replication, and Nonparametric Tests

Because TBFs can be computed solely from summary statistics, they enable evidence synthesis and meta-analytic aggregation across studies. The BFF formalism is especially conducive to replication science, where independent studies’ BFFs are multiplicatively combined:
\[
\text{BF}_{10}^{(\text{meta})}(\delta) = \prod_{s=1}^S \text{BF}_{10}^{(s)}(\delta)
\]
This property holds for $z$, $t$, $F$, $\chi^2$ statistics, as well as for generalized statistics such as partial correlation $t$-values [2503.10787], and for Fisher- or Wilcoxon-type statistics under rank tests [2105.00364].

The extension to nonparametric settings (e.g., Kendall’s $\tau$), leverages asymptotic normality of standardized test statistics, specifying working likelihoods and priors for the noncentrality parameter, yielding closed-form Bayes factors interpretable under large-sample limits [2105.00364]. Consistency and frequentist error control are preserved under mild regularity and appropriate prior scaling.

## 6. Simulation Performance and Frequentist Properties

Large-scale simulation studies of TBFs with both local and non-local priors demonstrate that non-local moment priors (e.g., iMOM, normal-moment priors) yield Type I error rates near or below nominal $\alpha$ thresholds and display superior power curves in moderate to large effect size regimes, especially compared to default $g$-prior or JZS Bayes factors [2506.16674, 2310.16213]. Under the null, TBF/BFF log-evidence is strongly negative, favoring $H_0$ even at moderate samples, and rapidly achieves “strong evidence” thresholds. Under the alternative, the log-BF growth is exponential in $n$.

TBF approximations closely track exact Bayes factors produced by software such as the R BayesFactor package, achieving >98% agreement in model decision across a range of designs and sample sizes [1803.00360].

## 7. Limitations, Extensions, and Practical Considerations

TBFs, while robust and computationally efficient, depend on correct specification of the null and alternative distributions of the test statistic. When the test statistic’s distribution under the alternative is uncertain or involves substantial nuisance structure, care must be taken with prior selection and interpretability. For small sample sizes or in highly unbalanced designs, approximate closed-form or BIC-based TBFs can slightly underestimate evidence for the null or diverge from full Bayesian computations [1803.00360].

Alternative priors, including data-driven or unit-information forms, may be substituted for the standard normal, Cauchy, or moment priors, although closed-form curves may be lost. Empirical Bayes and multiple testing extensions further leverage ensembles of test statistics to calibrate and regularize TBFs across large-scale studies [2301.11057].

Reporting conventions developed in this literature emphasize clear specification of (i) the formula used, (ii) the prior and its calibration, (iii) the precise test statistic, degrees of freedom, and sample size, and (iv) interpretive context using an absolute evidence scale [1803.00360, 2210.00049].

---

### References
- "Computing Bayes factors to measure evidence from experiments: An extension of the BIC approximation" [1803.00360]
- "Empirical Bayes factors for common hypothesis tests" [2301.11057]
- "Bayesian Hypothesis Testing: Redux" [1808.08491]
- "Bayes factor functions for reporting outcomes of hypothesis tests" [2210.00049]
- "Informed Bayesian T-Tests" [1704.02479]
- "On Bayes factor functions" [2506.16674]
- "A simple consistent Bayes factor for testing the Kendall rank correlation coefficient" [2105.00364]
- "Bayes Factors Based on Test Statistics and Non-Local Moment Prior Densities" [2310.16213]
- "Bayes factor functions for testing partial correlation coefficients" [2503.10787]

Source: https://www.emergentmind.com/topics/test-based-bayes-factors-tbfs