---
title: Recursive Marginal Likelihood Estimators
url: https://www.emergentmind.com/topics/recursive-marginal-likelihood-estimators
type: topic
---

# Recursive Marginal Likelihood Estimators

Recursive marginal likelihood estimators comprise a class of algorithms designed to estimate the marginal likelihood (evidence) in Bayesian models via iterative, sequential, or recursive procedures. These estimators are central to Bayesian model selection, serve in high-dimensional latent variable models, semiparametric mixture models, and enable practical evidence computation where direct integration is infeasible. The recursive approach leverages filtering, sequential Monte Carlo, or stochastic approximation techniques to exploit the structure of the model or data and to update estimates efficiently as data or parameters change.

## 1. Theoretical Foundations and Model Setup

Marginal likelihood estimation is required to compute $Z = \int_\Omega L(y|\theta)\,\pi(\theta)d\theta$, the normalizing constant of the product of the likelihood and prior in Bayesian inference. In scenarios where the likelihood is intractable or the model is high-dimensional, naïve numerical quadrature is prohibitive. Recursive marginal likelihood estimators address this by constructing a sequence of intermediate measures or densities that bridge prior and posterior measures.

Common model structures targeted by recursive estimators include:
- Mixture models: $m_{f,\theta}(y) = \int_{\mathcal{U}} p(y|\theta,u) f(u)d\mu(u)$ with structural parameter $\theta$ and nonparametric mixing density $f$ [1106.3352].
- Latent variable models: $p(y,x|\theta)$ with integration over latent variables $x\in\mathbb{R}^d$ [1906.12281].
- Sequential data models: i.i.d. or conditionally independent $y_{1:N}$, amenable to product rule factorization of the evidence [1911.07337].

## 2. Major Recursive Marginal Likelihood Estimation Methods

### 2.1 Predictive Recursion Marginal Likelihood (PRML)

PRML refines the estimation of the structural parameter in semiparametric mixture models. For fixed $\theta$, the predictive recursion (PR) updates the unknown mixing density $f$ sequentially:

For $i=1,\ldots,n$:
1. Compute the predictive mixture at $Y_i$: $m_{i-1,\theta}(Y_i) = \int p(Y_i|\theta,u) f_{i-1}(u)d\mu(u)$.
2. Update: $f_i(u) = (1-w_i)f_{i-1}(u) + w_i \frac{p(Y_i|\theta,u)f_{i-1}(u)}{m_{i-1,\theta}(Y_i)}$.

The PR marginal likelihood is then built as $L_n(\theta) = \prod_{i=1}^n m_{i-1,\theta}(Y_i)$ [1106.3352].

### 2.2 Sequential Recursive Importance and Annealing

Marginal likelihood is factorized as $p(y_{1:n})=\prod_{i=1}^n p(y_i|y_{<i})$, with each predictive $p(y_i|y_{<i}) = \int p(y_i|\theta)p(\theta|y_{<i})d\theta$ approximated recursively. Stochastic Gradient Annealed Importance Sampling (SGAIS) interleaves annealed importance sampling (AIS) with stochastic gradient MCMC for online, chunk-wise estimation, using unbiased mini-batch approximations and adaptive temperature scheduling [1911.07337].

### 2.3 Recursive Bridge Sampling and Biased Sampling 

Recursive estimation of normalization constants $Z_j$ for intermediate "bridging" densities $F_j(\theta)\propto w_j(\theta)\pi(\theta)$, spanning from prior to posterior, is governed by the core identity:
$$
\hat{Z}_k \leftarrow \sum_{j=1}^m \sum_{i=1}^{n_j} \frac{w_k(\theta_i^{(j)})}{\sum_{s=1}^m n_s\, w_s(\theta_i^{(j)})/\hat{Z}_s},
$$
where $\theta_i^{(j)}\sim F_j$ [1301.6450]. This covers the "biased sampling," "reverse logistic regression," and "density of states" methodologies.

### 2.4 Stochastic Approximation via Unadjusted Langevin Monte Carlo (ULMC)

Intractable expectations in the evidence gradient are replaced by Monte Carlo averages using ULMC chains targeting the posterior of latent variables $x$ given $y,\theta$, iteratively updating $\theta$ by Robbins–Monro stochastic approximation:
$$
\theta_{n+1} = \Pi_\Theta\left[\theta_n + \gamma_{n+1}(\hat{a}_n(\theta_n) - \nabla g(\theta_n))\right],
$$
where $\hat{a}_n(\theta_n)$ is the Monte Carlo estimate of the gradient [1906.12281].

## 3. Convergence and Theoretical Guarantees

Table: Convergence Properties of Key Recursive Marginal Likelihood Estimators

| Method                      | Main Convergence Guarantee                                             | Reference      |
|-----------------------------|-----------------------------------------------------------------------|----------------|
| Predictive recursion (PRML) | Pointwise: $(1/n)\log L_n(\theta) \to -K^*(\theta)$ a.s.; $\hat\theta_n\to\theta^*$ | [1106.3352]    |
| Biased/reverse LR recursion | Asymptotic normality, all $Z_j$ converge jointly                      | [1301.6450]    |
| SGAIS                       | Unbiasedness, variance decays $O(M^{-1})$ with $M$ particles          | [1911.07337]   |
| Stochastic Approx. (ULMC)   | a.s. convergence of $(\theta_n)$ to maximizer $\theta^*$, explicit rate | [1906.12281]   |

For predictive recursion, under conditions on the kernel $p$, compactness of $\mathcal{U}$, decay of weights $w_i$, and a second-moment condition, one obtains almost sure pointwise convergence and, under uniqueness, Wald consistency and explicit rates. The stochastic gradient estimators provide non-asymptotic convergence bounds, with rates matching standard stochastic gradient theory given suitable step-size sequences and kernels.

## 4. Algorithmic Realizations and Practical Considerations

Recursive estimators achieve favorable computational complexity:

- PRML: $O(n)$ per candidate $\theta$ in mixture models, with weight decay parameter (commonly $w_i=(i+1)^{-\gamma}$, $\gamma\approx2/3$).
- Biased sampling/RLR: cost $O(m\sum_j n_j)$ for $m$ bridging densities and $n_j$ samples per density; draws must be i.i.d.
- SGAIS: cost per data chunk scales as $O(K_nM|B|)$ for $K_n$ annealing steps, $M$ particles, and mini-batch size $|B|$, but does not grow with $n$ [1911.07337].
- Stochastic approximation with ULMC: $O(m_n C_\text{grad})$ per iteration, where $m_n$ is the number of inner-loop ULMC steps.

Key steps in algorithmic implementation include:
- Choice of weight or step-size sequences to control convergence and stability.
- Ensuring sufficient overlap of bridging densities (e.g., power posteriors or partial-data posteriors) [1301.6450].
- Adaptive annealing schedules to maintain effective sample size in SGAIS.
- Warm-starting in high-dimensional latent variable models for computational efficiency.

## 5. Comparative Performance and Methodological Distinctions

Recursive estimators are compared against:
- Profile likelihood, which plugs in the mixing density estimate at the final observation and fails to account for uncertainty in $f$ [1106.3352].
- Dirichlet process mixture marginal likelihoods, which are Bayesian but computationally demanding due to MCMC or importance sampling requirements.
- Nested sampling, which operates via live-point constrained prior sequences and does not admit a straightforward central limit theorem for its normalization constant [1301.6450].

Recursive estimator benefits include unbiasedness (SGAIS), low computational cost per data update (PRML and SGAIS), and flexibility for online, streaming, and empirical Bayes applications. Simulation studies indicate marginal likelihood estimates from PRML track closely with fully Bayesian methods in density estimation and are more stable than profile likelihood [1106.3352]. SGAIS achieves accuracy within 0.1–0.6% of nested sampling/AIS and orders-of-magnitude speedups [1911.07337].

## 6. Extensions, Applications, and Sensitivity Analysis

Recursive marginal likelihood estimators are extensible to:
- Mixed-effects and regression models via nonparametric mixing over random effects or coefficients [1106.3352].
- Empirical Bayes multiple testing in time series, exploiting mixtures over AR parameters and learning the degree of sparsity [1106.3352].
- Prior-sensitivity analysis by constructing pseudo-mixture distributions over pooled draws, facilitating importance reweighting and effective sample size monitoring [1301.6450].
- Fully Bayesian hybrids, augmenting PRML with curvature-based sampling to propagate uncertainty [1106.3352].
- Dynamic data assimilation and streaming Bayesian model selection, enabled by SGAIS [1911.07337].

Applied examples include finite and infinite normal mixture models for astronomical data, sparse logistic regression with random effects, and high-dimensional statistical audio analysis [1301.6450, 1906.12281]. Sensitivity analyses reveal marked shifts in model selection posteriors under alternative priors, corroborating the need for routine robustness assessment via recursive estimators.

## 7. Recommendations and Practitioner Guidance

For effective deployment of recursive marginal likelihood estimators:
- Select bridging sequences to minimize divergence and ensure adequate overlap (e.g., power/posterior partial-data paths with tailored spacing parameters).
- Include the prior as a bridging density to stabilize recursion.
- Refine bridging steps where thermodynamic integration via importance sampling indicates rapid integrand variation [1301.6450].
- Monitor effective sample size and variance of the estimator; leverage bootstrap or asymptotic covariance formulas for error bars.
- Combine with nested sampling draws when likelihood evaluation is costly, exploiting the ability to reuse samples and reduce estimator variance.

Reporting both model selection metrics and prior-sensitivity results is considered best practice to assess the robustness of inferential conclusions.

---

**References**:  
- "Semiparametric inference in mixture models with predictive recursion marginal likelihood" [1106.3352]  
- "Stochastic Gradient Annealed Importance Sampling for Efficient Online Marginal Likelihood Estimation" [1911.07337]  
- "Recursive Pathways to Marginal Likelihood Estimation with Prior-Sensitivity Analysis" [1301.6450]  
- "Efficient stochastic optimisation by unadjusted Langevin Monte Carlo. Application to maximum marginal likelihood and empirical Bayesian estimation" [1906.12281]

Source: https://www.emergentmind.com/topics/recursive-marginal-likelihood-estimators