---
title: Empirical Bayes Factor (EBF) Methods
url: https://www.emergentmind.com/topics/empirical-bayes-factor-ebf
type: topic
---

# Empirical Bayes Factor (EBF) Methods

to=arxiv_search anasiyana  微信公众号天天中彩票json
{"query":"Empirical Bayes factor variance components Dudbridge common hypothesis tests", "max_results": 10}
to=arxiv_search 
Empirical Bayes Factor (EBF) denotes a Bayes-factor construction in which a prior-like distribution is estimated from the data rather than fixed entirely a priori. In the recent literature, the term has two closely related uses. One use defines an adjusted posterior Bayes factor for common hypothesis tests, correcting the bias created when the posterior from the data at hand is reused in the Bayes factor [2301.11057]. Another use defines a flexible Bayes factor for variance-component testing by replacing the boundary null $D=0$ with the equivalent point-null $b=0$ on random effects and estimating their lower-level distribution empirically from the fitted mixed model [2410.14459]. A related formulation emphasizes a Savage–Dickey density ratio computed from a single full-model fit and recommends plug-in posterior means for variance components in the empirical prior [2508.01403].

## 1. Conceptual scope and notation

In the cited literature, EBF is not a single universally standardized object. For composite hypothesis tests, it is defined as a bias-corrected posterior Bayes factor built from posterior marginal likelihoods under the competing hypotheses. For variance-component testing, it is defined through an empirical lower-level distribution for random effects and typically evaluated by a Savage–Dickey density ratio. Both constructions are empirical Bayes in the sense that the data are used to estimate a distribution that plays the role of a prior or prior-like ingredient in the Bayes factor [2301.11057].

A recurrent source of confusion is orientation. In the mixed-effects formulation, one paper defines
\[
\operatorname{EBF}=\frac{m_1(y)}{m_0(y)},
\]
so values greater than $1$ support the presence of random effects, while its Savage–Dickey quantity is written as $\mathrm{BF}_{01}$ and is the reciprocal of that EBF. A related formulation instead writes $EBF_{0,1}$ directly for the Savage–Dickey ratio
\[
\frac{p(b=0\mid y)}{p(b=0\mid M_1)},
\]
so positive $\log EBF$ supports exclusion of the tested random effect [2410.14459]. This suggests that empirical Bayes factor results must always be read together with their stated orientation, rather than inferred from the label “EBF” alone [2508.01403].

The methodological motivations also differ. In common hypothesis tests, the central issue is how to obtain a Bayes-factor-like quantity without committing to subjective proper priors for composite hypotheses. In variance-component testing, the central issue is the boundary problem created by testing nonnegative variance parameters at zero. The two strands are therefore linked by empirical-Bayes calibration, but they address different inferential bottlenecks.

## 2. Bias-corrected posterior Bayes factors for common tests

For composite hypotheses $H_0$ and $H_1$, the proper Bayes factor is
\[
BF_{10}=\frac{p(y\mid H_1)}{p(y\mid H_0)},
\qquad
p(y\mid H_j)=\int f(y\mid \theta)\,\pi_{H_j}(\theta)\,d\theta.
\]
The difficulty is that marginal likelihoods require proper priors, whereas improper priors cannot be used and objective priors may be subjectively unreasonable. Dudbridge revisits the posterior Bayes factor by truncating a baseline posterior to the hypothesis space and then evaluating the posterior predictive density of the same data:
\[
M_H(x)=\int f(x\mid \theta)\,\pi_H(\theta\mid x)\,d\theta,
\qquad
PBF_{01}(x)=\frac{M_{H_0}(x)}{M_{H_1}(x)}.
\]
Because the same data are used both to form the posterior and to evaluate its predictive density, the resulting quantity is biased relative to a Bayes factor that would use a prior learned from independent replicate data [2301.11057].

The key calibration result is an expected log-bias term $E_Y b_H(Y)$. In the regular normal model $X\sim N_d(\mu,\Sigma)$ with known full-rank $\Sigma$ and a flat prior on $\mu$, the expected bias is $d/2$ for an unrestricted mean. For one-sided components the bias is halved, and for finite interval or point hypotheses the expected bias is zero. This yields the adjusted empirical Bayes factor
\[
EBF_{01}(x)=
\frac{M_{H_0}(x)\exp\{-E_Y b_{H_0}(Y)\}}
{M_{H_1}(x)\exp\{-E_Y b_{H_1}(Y)\}},
\]
with the practical approximation
\[
\log EBF_{01}\approx \log PBF_{01}-\frac{k_0-k_1}{2},
\]
where $k_H$ is an effective dimension: $0$ for point or finite interval hypotheses, $0.5$ per one-sided parameter, and $1$ per two-sided parameter.

This framework yields closed-form or test-based formulas for standard procedures. For a two-sided scalar normal test,
\[
EBF_{01}=\sqrt{2}\,\exp\!\left\{-\tfrac{1}{2}(z^2-1)\right\}.
\]
For a multivariate normal or $\chi^2$-type test with dimension $d$,
\[
EBF_{01}=2^{d/2}\,\exp\!\left\{-\tfrac{1}{2}(z^2-d)\right\}.
\]
The same paper develops corresponding constructions for $t$-tests and $F$-tests, with bias terms depending on the degrees of freedom, maps likelihood-ratio tests to the $\chi^2$ formula, and gives the rule of thumb $BF_{10}\approx 10p$ when only a $P$-value is available for small-to-moderate $p$ [2301.11057].

A multiple-testing extension replaces single-test posteriors with a mixture involving the ensemble of tests,
\[
\pi(\theta\mid x;po;i)\propto \pi(\theta\mid x_i;n_i)+po;i\sum_{j\neq i}\pi(\theta\mid x_j;n_j),
\]
and constructs adjusted posterior marginal likelihoods per test. The paper relates this extension to the Optimal Discovery Procedure by replacing unknown densities with posterior densities and bias-correcting only the self-referential term.

## 3. Variance-component testing via random effects

In mixed-effects models,
\[
y\mid b,\theta \sim f\big(y\mid \eta=X\beta+Zb,\theta\big),
\qquad
b\sim \mathcal{N}(0,D),
\]
testing the presence of a random effect is difficult because a variance component must be nonnegative. A null such as $H_0:D=0$ is therefore a boundary hypothesis. The cited discussion notes that the likelihood-ratio statistic then does not have the standard chi-square distribution; asymptotic results involve mixture chi-square distributions, score tests face similar complications, and parametric bootstrapping is computationally intensive because it requires refitting models many times [2410.14459].

The proposed remedy is to test the equivalent point-null on the random effects themselves:
\[
H_0:b=0
\qquad \text{versus}\qquad
H_1:b\sim G(\cdot;\hat\psi),
\]
where $G$ is a parametric lower-level distribution whose hyperparameters $\hat\psi$ are estimated from the data. A common choice is $G=\mathcal{N}(0,\hat D)$. In marginal-likelihood form,
\[
\operatorname{EBF}\equiv \frac{m_1(y)}{m_0(y)},
\]
with
\[
m_1(y)=\int f\big(y\mid X\beta,Zb,\hat\theta\big)\,p(b\mid \hat\psi)\,db,
\qquad
m_0(y)=f\big(y\mid X\beta,Zb=0,\tilde\theta\big).
\]
The quantity is empirical because the lower-level distribution of the random effects is estimated from the fitted model rather than chosen externally [2410.14459].

Operationally, the method is implemented through a Savage–Dickey density ratio. Under $H_1$, let
\[
b\sim \mathcal{N}(0,\Psi(\tilde\gamma)),
\]
where $\tilde\gamma$ are empirical estimates of the variance components, and approximate the posterior of $b$ under the full model by
\[
b\mid y \approx \mathcal{N}(\tilde\theta,\tilde\Omega_\theta).
\]
Then
\[
\mathrm{BF}_{01}
=
\frac{\pi(b=0\mid y,M_1)}{\pi(b=0\mid M_1)}
=
|\Psi(\tilde\gamma)|^{1/2}\,|\tilde\Omega_\theta|^{-1/2}
\exp\!\Big\{-\tfrac{1}{2}\tilde\theta^\top \tilde\Omega_\theta^{-1}\tilde\theta\Big\}.
\]
In the notation of the 2024 paper, $\operatorname{EBF}=1/\mathrm{BF}_{01}$; in the related 2025 formulation, the same Savage–Dickey quantity is itself written as $EBF_{0,1}$ and interpreted directly as evidence for exclusion [2508.01403].

The later formulation makes the empirical-prior choice explicit. If $\Sigma=\Psi(\tau)$ parameterizes the covariance of $b$, one may either average over the posterior of $\tau$ or use a plug-in estimate $\bar\tau$. The recommended form is
\[
EBF_{0,1}\approx |V_b|^{-1/2}|\Psi(\bar\tau)|^{1/2}
\exp\!\left(-\tfrac{1}{2}\hat b^\top V_b^{-1}\hat b\right),
\]
where $\hat b$ and $V_b$ are the posterior mean and covariance of the tested random effects. The paper states that using the full posterior over $\tau$ in the denominator can bias the EBF toward the full model when the posterior of $\tau$ is spiked near zero, whereas the posterior mean avoids $\bar\tau=0$ and yields better calibration [2508.01403].

## 4. Computation and model classes

The variance-component EBF admits three computational routes. In an MLE/REML route, one fits the full mixed model, computes $m_1(y)$ by Laplace approximation, adaptive Gauss–Hermite quadrature, or importance sampling, fits the corresponding fixed-effects-only model to obtain $m_0(y)$, and forms $\log \operatorname{EBF}=\log m_1(y)-\log m_0(y)$. In an MCMC route, one estimates
\[
\hat m_1(y)=\frac{1}{T}\sum_{t=1}^T f\big(y\mid X\hat\beta,Zb^{(t)},\hat\theta\big),
\qquad b^{(t)}\sim p(\cdot\mid \hat\psi),
\]
and combines this with $m_0(y)$ from the restricted fit. The fastest route is the Savage–Dickey shortcut, which requires only the full model fit and standard outputs such as posterior means, BLUP-like estimates, and covariance matrices [2410.14459].

The random-effects distribution $G$ need not be a simple i.i.d. Gaussian. The cited formulations allow Gaussian random effects with correlated or block-diagonal covariance, spatial CAR/ICAR effects with structured precision or covariance, state-space priors for latent dynamic states, and Gaussian process priors in nonlinear regression. For large random-effect dimension $q$, log-determinants are computed via Cholesky decompositions, and when software does not supply the full covariance $\tilde\Omega_\theta$, a diagonal approximation using squared standard errors is described as conservative [2410.14459].

| Model class | Tested random effects | Computation note |
|---|---|---|
| Logistic crossed mixed-effects models | crossed random intercepts and slopes | Laplace approximation, adaptive Gauss–Hermite quadrature, or Savage–Dickey |
| Spatial random effects models (CAR/ICAR) | exchangeable and spatial effects | structured Gaussian covariance or precision in the determinant |
| Dynamic structural equation models / state-space | latent states or time-level random effects | Kalman filtering/smoothing in the Gaussian case |
| Random intercept cross-lagged panel models | subject-specific random intercepts | joint or separate tests via posterior covariance blocks |
| Nonlinear regression and Gaussian processes | nonlinear random effects or GP components | GP priors treated as structured random effects |

Specific model formulations appear throughout the cited work. For logistic crossed mixed-effects models,
\[
y_i\sim \mathrm{Bernoulli}(\pi_i),
\qquad
\mathrm{logit}(\pi_i)=X_i\beta+Z_i b.
\]
For spatial random effects,
\[
\theta_{j2}\mid \theta_{-j,2}\sim 
\mathcal{N}\!\left(\frac{1}{L_j}\sum_{\ell\in\mathcal N(j)}\theta_{\ell,2},\frac{\tau_2^2}{L_j}\right),
\]
with the corresponding joint Gaussian covariance implied by the neighborhood matrix. For state-space and dynamic SEM models,
\[
y_t=Hx_t+\varepsilon_t,\qquad x_t=Fx_{t-1}+\eta_t.
\]
For Gaussian processes,
\[
k_p(x,x')=\tau_p^2\exp\!\left(-\frac{\|x-x'\|^2}{2\lambda_p^2}\right).
\]
The method is therefore presented as a general random-effects testing device rather than a procedure tied to a single likelihood family [2410.14459].

Recommended software workflows in the cited material include lme4, glmmTMB, mgcv, spaMM, INLA, Stan/brms, JAGS, TMB, blavaan, and lavaan; the later paper also mentions an R package “EBF” for automating computations [2508.01403].

## 5. Calibration, interpretation, and methodological relations

In Dudbridge’s formulation, the EBF is closely related to the widely applicable information criterion. In the regular normal model,
\[
-2\log\!\left[M_H(x)\exp\{-E_Y b_H(Y)\}\right]
=
-2\log \phi_d(x;x,\Sigma)+d(1+\log 2),
\]
which equals WAIC under a vague prior. Consequently,
\[
\log EBF_{01}=-\tfrac{1}{2}\big[WAIC(H_0)-WAIC(H_1)\big],
\qquad
EBF_{01}=\exp\{-\tfrac{1}{2}\Delta WAIC\}.
\]
The stated penalty per parameter is $1+\log 2\approx 1.69$, smaller than the AIC penalty of $2$, while the method does not impose the $\log n$ penalty characteristic of BIC [2301.11057].

The same paper proposes interpreting Bayes factors on a logarithmic scale with base $3.73$. One unit of evidence is a Bayes factor of $3.73$, with approximate landmarks of $14$ for two units, $52$ for three units, and $194$ for four units. This gives an evidence scale explicitly tied to Bayes factors rather than $P$-values, even though the same paper also provides the pragmatic approximation $BF_{10}\approx 10p$ when only a $P$-value is available [2301.11057].

For variance-component EBFs, the cited guidance is Jeffreys/Kass–Raftery style. One formulation states that $\operatorname{EBF}\in (1,3)$ gives weak evidence for random effects, $(3,10)$ moderate evidence, $(10,30)$ strong evidence, and values above $30$ very strong evidence. The same source recommends reporting $\log \operatorname{EBF}$ for interpretability and numerical stability. The related formulation writes the evidence in the opposite orientation, with $BF_{0,1}\approx 1$ indicating no evidence, $3$–$10$ moderate evidence for exclusion, $10$–$30$ strong evidence, and values below $1$ supporting inclusion. A plausible implication is that interpretation is straightforward only after the direction of the ratio has been specified [2410.14459].

The comparison with competing methods is explicit. Likelihood-ratio tests, restricted likelihood-ratio tests, and score tests still face the boundary hypothesis; mixture chi-square calibrations can be inaccurate in finite samples, and parametric bootstrap is costly. Fully Bayesian Bayes factors with proper priors are principled but can be highly sensitive to prior choices and expensive to compute. Information criteria and cross-validation may require fitting many model combinations. The EBF is presented as attractive because it tests $b=0$ rather than $D=0$, removes the need to hand-specify priors for difficult variance components, and often requires only the full model fit [2410.14459].

The limitations are equally explicit. The variance-component EBF relies on a Gaussian posterior approximation for the tested random effects; accuracy may degrade in small samples, highly non-Gaussian posteriors, or multimodal settings. Its value depends on how $\hat\psi$, $\tilde\Omega_\theta$, $V_b$, or $\Sigma$ are estimated; classical fits may be slightly liberal; misspecification of the likelihood or lower-level distribution can bias conclusions; and high-dimensional determinant calculations may dominate the evidence. The papers also note the “double use of data” critique of empirical Bayes constructions, though they argue that the empirical plug-in substantially reduces prior sensitivity relative to subjective variance-component priors [2508.01403].

## 6. Empirical behavior, applications, and reporting practice

The synthetic studies summarized in the variance-component papers vary the number of clusters, cluster sizes, and the magnitude of true heterogeneity. The 2024 paper reports that Bayesian fits produced positive $\log \mathrm{BF}_{01}$ more clearly when the tested variance was essentially zero, while classical fits often yielded near-zero evidence; when other random effects truly varied, the EBFs decisively supported their inclusion. The 2025 formulation, using a cross-classified random-effects design with $2{,}000$ replications per design cell, reports that the posterior-mean plug-in $\bar\tau$ yields $\log(EBF_{0,1})>0$ near $\tau_{11}=0$ and $\log(EBF_{0,1})<0$ for larger $\tau_{11}$, with evidence strengthening as $J$ and $n$ increase [2410.14459].

The later paper also provides detailed empirical applications computed from a single full-model fit. In a crossed GLMM for basketball foul calls, random slopes for foul differential had log EBFs $13.63$, $5.22$, and $4.65$, and random intercepts had log EBFs $86.12$, $9.06$, and $7.92$, all in the orientation where positive values support exclusion; the joint test “only random intercepts vs full model” gave $\log EBF=24.39$. In a spatial Poisson model for Scottish lip cancer, the exchangeable random intercept had log EBF $9.55$ and the spatial random effect had log EBF $-1.69$, leading to inclusion of the spatial effect only. In a DSEM for binge eating disorder, person-level and time-level intercept random effects and person-level loading random effects were strongly supported, whereas time-level loading random effects had log EBFs $28.80$, $30.50$, and $31.10$, supporting exclusion. In an RI-CLPM with two constructs across five days, the joint inclusion of both random intercepts gave $\log EBF=-761.59$, and separate tests also strongly supported both intercepts. In a nonlinear mixed-effects model for Loblolly trees, the three independent random effects ‘Asym’, ‘R0’, and ‘lrc’ had log EBFs $4.37$, $3.27$, and $4.12$, and the joint test excluding ‘R0’ and ‘lrc’ versus the full model gave $\log EBF=7.19$ [2508.01403].

Reporting guidance is correspondingly technical. The recommended elements are the fitted model specification, the tested variance component or random-effect block, the plug-in estimates $(\hat\psi,\hat\theta)$ or $(\bar\tau,\hat b,V_b)$, the method used to obtain them (MLE/REML versus MCMC), convergence and posterior-approximation diagnostics, and sensitivity checks such as alternative $G$, diagonal versus full covariance approximations, or Laplace versus MCMC computation. For multiple random-effect terms, the papers distinguish per-block testing from joint testing by stacking blocks into a single vector and using the corresponding joint covariance matrix [2410.14459].

A common misconception is that empirical Bayes factors are simply generic Bayes factors with estimated hyperparameters. The cited literature is narrower and more structured. In one strand, the EBF is a bias-corrected posterior Bayes factor calibrated to the scale of a proper Bayes factor; in the other, it is a variance-component testing device that replaces a boundary null on a variance by a point-null on the corresponding random effects and uses the model’s lower-level distribution as an empirical prior. Their shared theme is empirical calibration, but their inferential targets, notation, and computational formulas differ materially [2301.11057].

Source: https://www.emergentmind.com/topics/empirical-bayes-factor-ebf