---
title: Turnbull NPMLE for Interval-Censored Data
url: https://www.emergentmind.com/topics/turnbull-nonparametric-maximum-likelihood-estimator-npmle
type: topic
---

# Turnbull NPMLE for Interval-Censored Data

Searching arXiv for recent and foundational papers relevant to Turnbull NPMLE and its modern extensions.
arxiv_search(query="Turnbull NPMLE interval-censored data nonparametric maximum likelihood estimator", max_results=10, sort_by="relevance")
Turnbull’s nonparametric maximum likelihood estimator (NPMLE) is the canonical likelihood-based estimator of an unknown distribution function from interval-censored data. In its classical form, one observes, for each subject, only an interval known to contain an unobserved event time, and estimates the distribution function by maximizing the interval-censoring likelihood over all cumulative distribution functions. The resulting estimator is nonparametric, likelihood-based, and discrete, with mass concentrated on intervals determined by the observed censoring structure. In contemporary statistical research, Turnbull’s estimator also serves as a template for broader NPMLE constructions in semiparametric and shape-constrained models, including generalized linear models with interval-censored covariates, censored log-concave density estimation, and interval-censored multi-state regression [2601.08996] [1311.6403] [2209.07708].

## 1. Definition and basic likelihood structure

In the classical interval-censoring setting, one observes for subject \(i\) an interval \(\lfloor L_i, R_i \rfloor\) such that an unobserved event time \(T_i\) satisfies
\[
T_i \in \lfloor L_i, R_i \rfloor.
\]
The inferential target is the distribution function
\[
F(t) = \Pr(T \le t).
\]
Under independent interval censoring, the likelihood is
\[
L(F) = \prod_{i=1}^n \Pr(T_i \in \lfloor L_i, R_i \rfloor)
    = \prod_{i=1}^n \{ F(R_i) - F(L_i)\},
\]
with the obvious modifications for left-, right-, or exactly observed times [2601.08996].

Turnbull’s NPMLE \(\widehat F^{\rm Tb}\) is the maximizer of this likelihood over all cdfs. In general NPMLE terminology, it is a maximizer of likelihood over an infinite-dimensional model \(\mathcal P\) of probability measures. A general formulation is
\[
\hat P_n \in \arg\max_{P \in \mathcal{P}} \prod_{i=1}^n p(Z_i),
\]
where \(p=dP/d\mu\) is a density with respect to a reference measure \(\mu\) [2401.12482]. Turnbull’s estimator is a specific instance in which \(\mathcal P\) is the set of all distribution functions on \(\mathbb R\), restricted only by monotonicity and total mass constraints.

A defining property is that the estimator is discrete and places mass only on a finite set induced by the observed censoring intervals. In one modern exposition, this is stated as follows: the classical Turnbull NPMLE for interval-censored data is of this form, and “the estimator is a discrete distribution function with jumps at a subset of the observed interval endpoints” [2401.12482]. In a more refined interval-based description, the NPMLE places mass on the so-called Turnbull intervals, which are the maximal intersections of the observed censoring intervals [2601.08996].

## 2. Turnbull intervals, self-consistency, and EM representation

Turnbull’s central structural insight is that the likelihood can be reduced to a finite-dimensional optimization over masses assigned to data-determined support intervals. If \(\{[p_j,q_j]\}_{j=1}^M\) denotes the Turnbull intervals, then the estimator is characterized by masses
\[
w^{\rm Tb}_j = \Pr(T \in [p_j,q_j]).
\]
Let
\[
\alpha_j^i = \mathbf 1\{[p_j,q_j]\subseteq\lfloor L_i,R_i\rfloor\}.
\]
The self-consistent equations are
\[
\hat w_j^{\rm Tb} = \frac{1}{n} \sum_{i=1}^n
\alpha_j^i \frac{\hat w_j^{\rm Tb}}
{\sum_{k=1}^M \alpha_k^i \hat w_k^{\rm Tb}},\quad j=1,\dots,M.
\]
These equations can be interpreted as EM updates, with the unobserved event times treated as latent data [2601.08996].

The corresponding EM algorithm alternates between conditional allocation of each observation across the support intervals and normalization of the resulting expected counts. The E-step computes
\[
p_{ij}^{(old)} =
\Pr(T_i\in [p_j,q_j] \mid T_i\in \lfloor L_i,R_i\rfloor; \bm w^{(old)})
=
\frac{\alpha_j^i w_j^{(old)}}
{\sum_{k=1}^M \alpha_k^i w_k^{(old)}},
\]
and the M-step updates
\[
w_j^{(new)} = \frac{1}{n} \sum_{i=1}^n p_{ij}^{(old)}.
\]
This is equivalent to the self-consistent equations above [2601.08996].

This EM interpretation is important beyond the original problem. Later work repeatedly generalizes Turnbull’s architecture—discrete support on a data-dependent partition, latent allocation, and mass updates—to more complex semiparametric likelihoods. A plausible implication is that Turnbull’s enduring influence lies less in a single estimator than in a reusable computational grammar for interval-censored likelihoods.

## 3. Relation to general NPMLE theory

Turnbull’s estimator is a paradigmatic example of NPMLE in an infinite-dimensional model. Modern NPMLE theory emphasizes several common ingredients: an infinite-dimensional model \(\mathcal P\), likelihood or log-likelihood as objective, approximation error, estimation error, empirical process methods such as bracketing entropy and covering numbers, and convergence metrics including Hellinger distance, total variation, \(L^2\), and sometimes KL divergence [2401.12482].

A recent general treatment states that Turnbull’s estimator is “precisely of this form” and explicitly identifies it as a member of the same NPMLE family as deep-network-based logistic estimators [2401.12482]. In that framework, the parameter need not be a cdf; it may be any infinite-dimensional conditional distribution model. What remains invariant is likelihood maximization over a nonparametric class.

This perspective is particularly relevant for convergence analysis. In nonparametric logistic regression, direct KL analysis can fail because the estimator may assign zero probability where the truth is positive, making KL divergence infinite. To avoid this, recent work studies Hellinger risk instead and derives oracle inequalities using empirical process arguments [2401.12482]. That work explicitly notes an analogy with Turnbull-type problems: if one can control the relevant bracketing entropy for the feasible class, an oracle inequality of the same flavor can be obtained.

This suggests a conceptual placement of Turnbull’s estimator within a larger theory of likelihood-based estimation under incomplete observation. The classical estimator is not merely a survival-analysis artifact; it is a prototype of a broad NPMLE principle in which inference is driven by likelihood geometry and complexity control rather than finite-dimensional parametrization.

## 4. Extensions to semiparametric regression with interval-censored covariates

A major recent extension uses Turnbull’s estimator as the nonparametric component of semiparametric generalized linear models with one interval-censored covariate \(Z\) [2601.08996]. There, the outcome \(Y\) and fully observed covariates \(\bm X\) are observed, while
\[
Z_i \in \lfloor Z_{L_i}, Z_{R_i} \rfloor.
\]
The GLM has linear predictor
\[
\eta = \alpha + \bm\beta^\top \bm X + \gamma Z,
\]
with conditional density
\[
f_{Y\mid \bm X,Z}(y\mid \bm x,z;\bm\theta)
= h(y;\phi)\,\exp\left(\frac{y\cdot\psi(\mu) - a(\psi(\mu))}{\phi}\right),
\]
where \(\mu = g^{-1}(\alpha+\bm\beta^\top\bm x+\gamma z)\) and \(\bm\theta=(\alpha,\bm\beta^\top,\gamma,\phi)^\top\) [2601.08996].

The observed-data likelihood is
\[
L(\bm\theta,W \mid \{ y_i,\bm x_i,z_{l_i},z_{r_i}\}_{i=1}^n )
=
\prod_{i=1}^n \int_{z_{l_i}}^{z_{r_i}}
f_{Y\mid \bm X,Z}(y_i\mid \bm x_i,z;\bm\theta)\, dW(z),
\]
where \(W(z)=\Pr(Z\le z)\) is estimated nonparametrically [2601.08996].

The key innovation is the **augmented Turnbull estimator**. Instead of the classical Turnbull intervals, the support \(\Omega\) is partitioned using all unique left and right endpoints of the observed intervals, producing augmented Turnbull intervals \(\{I_j\}_{j=1}^m\). Defining
\[
w_j = \Pr(Z\in I_j), \quad j=1,\dots,m,
\]
the estimator is characterized by \(\bm\theta\)-dependent self-consistent equations,
\[
\hat w_j
=
\frac{1}{n}\sum_{i=1}^n \kappa_j^i\,
\frac{\hat w_j\, C_{ij}(\bm\theta)}
{\sum_{k=1}^m \kappa_k^i \hat w_k\, C_{ik}(\bm\theta)},
\quad j=1,\dots,m,
\]
under a piecewise-uniform assumption within each interval \(I_j\) [2601.08996].

The paper proves that, for fixed \(\bm\theta\), any cdf \(H\) whose interval masses solve the self-consistent equations is an NPMLE of \(W\) for the joint likelihood. It further establishes consistency of \(\widehat W_n\), consistency of \(\hat{\bm\theta}_n\), and asymptotic normality of \(\hat{\bm\theta}_n\) under regularity conditions, with covariance estimated by observed information [2601.08996].

The structural relation to classical Turnbull estimation is direct.

| Feature | Classical Turnbull | Augmented Turnbull in GLMs |
|---|---|---|
| Latent variable | Event time \(T\) | Covariate \(Z\) |
| Likelihood contribution | \(F(R_i)-F(L_i)\) | \(\int_{z_{l_i}}^{z_{r_i}} f_{Y\mid \bm X,Z}\, dW\) |
| Support partition | Turnbull intervals | Augmented Turnbull intervals |
| Update mechanism | Self-consistency / EM | Weighted self-consistency / EM-like |

A central methodological point is that ignoring the dependence of \(W\) on the outcome model can lead to inconsistent estimation of the regression parameter \(\gamma\) [2601.08996]. Thus the augmented estimator is not a cosmetic variation; it changes the inferential target from the censoring-only distribution of \(Z\) to a nonparametric distribution estimate that is joint-likelihood compatible with the regression model.

## 5. Shape-constrained and censored-density variants

Turnbull’s framework has also been extended to shape-restricted density estimation under interval-censoring, right-censoring, and binned observation [1311.6403]. In that setting, the unknown distribution \(P\) on \((-\infty,\infty]\) may have mass
\[
q := P(\{\infty\}) \in [0,1),
\]
and an absolutely continuous part with subdensity
\[
f(x)=e^{\phi(x)},
\]
where \(\phi\) is concave and
\[
\int e^{\phi(x)}dx = 1-q.
\]
The observed-data log-likelihood is
\[
\ell(\phi, q)
=
\frac{1}{n} \sum_{i=1}^n \Bigl(
1_{[L_i = R_i]} \phi(X_i)
+
1_{[L_i < R_i]} \log P_{\phi,q}((L_i,R_i])
\Bigr),
\]
where
\[
P_{\phi,q}((L_i,R_i])
=
\int_{(L_i,R_i]\cap\mathbb{R}} e^{\phi(x)}\,dx + 1_{[R_i=\infty]}q
\]
[1311.6403].

If one removes the log-concavity restriction and allows arbitrary distributions, this recovers the classical Turnbull-type censored likelihood. The difference is the feasible set: Turnbull maximizes over all cdfs, whereas the shape-restricted estimator maximizes over the smaller class of distributions with log-concave density. The resulting estimator is continuous with piecewise-exponential density, rather than discrete with arbitrary jumps [1311.6403].

An EM algorithm is developed for approximate computation. The E-step constructs a pseudo-sample measure \(M_{\phi,q}\), representing the expected distribution of latent finite event times under the current fit. The M-step then replaces Turnbull’s unrestricted mass allocation by a log-concave density MLE step, together with an update for the cure parameter \(q\) [1311.6403]. This is a constrained analogue of Turnbull’s EM: the latent allocation logic remains, but the optimization is projected onto a shape-restricted function class.

The paper proves existence of the estimator under mild conditions, describes its shape properties, and establishes consistency results. In simulation comparisons, the log-concave estimator yields smoother survival estimates and lower sup-norm error than Turnbull’s step-function estimator when log-concavity is appropriate [1311.6403]. This does not refute Turnbull’s estimator; rather, it shows how shape restrictions trade robustness of model class for efficiency and smoothness under structural assumptions.

## 6. Multi-state and semiparametric process generalizations

Another broad generalization treats interval-censored multi-state data using semiparametric proportional intensity models with random effects [2209.07708]. Here the event history is a finite-state process with feasible transitions \((j,k)\in\mathcal D\), and the transition intensities are
\[
\lambda_{ijk}(t; X_i, b_i)=\lambda_{jk}(t)\exp\{\beta_{jk}^T X_i(t)+b_i^TZ_i(t)\},
\]
where the baseline intensities \(\lambda_{jk}(t)\) are modeled nonparametrically [2209.07708].

Turnbull’s influence appears in the representation of each baseline cumulative intensity as a step function over the grid of unique examination times:
\[
\Lambda_{jk}(t)=\sum_{s: u_s\le t}\lambda_{jks},
\]
with nonnegative jump sizes \(\lambda_{jks}\) [2209.07708]. This is the direct analogue of assigning mass to support intervals in classical interval-censored survival.

The observed-data likelihood integrates over random effects and uses product integrals of transition probability matrices. To maximize it, the paper develops a stable EM algorithm based on latent Poisson variables \(W_{ijks}\), which encode transition counts at grid points. The M-step updates the nonparametric jumps explicitly as
\[
\widehat{\lambda}_{jks}
=
\frac{\sum_{i=1}^n I(u_s\le \tau_{i,n_i})\widetilde E(W_{ijks})}
{\sum_{i=1}^n I(u_s\le \tau_{i,n_i})
\widetilde E\{\exp(\beta_{jk}^TX_{is}+b_i^TZ_{is})\}},
\]
a count-over-exposure form that is structurally analogous to Turnbull’s expected-count update [2209.07708].

The paper states that it uses Turnbull’s method to pre-estimate jump sizes and remove time points with estimates smaller than a threshold of order \(1/m\), thereby reducing the computational grid [2209.07708]. It proves strong consistency of the NPMLE and asymptotic normality of the finite-dimensional components, with covariance attaining the semiparametric efficiency bound and estimated by profile likelihood [2209.07708].

In a special case—two states, one absorbing transition, no covariates, no random effects—the model reduces to a Turnbull-type interval-censored event-time problem [2209.07708]. This reduction clarifies that multi-state semiparametric NPMLEs are not separate constructions but layered extensions of the same underlying likelihood principle.

## 7. Metrics, misconceptions, and modern perspective

A common misconception is that Turnbull’s estimator is only a survival-analysis tool for a narrow censoring setup. Recent work contradicts this restricted view. Turnbull’s NPMLE is used as a building block in GLMs with interval-censored covariates [2601.08996], as an unconstrained benchmark for censored log-concave density estimation [1311.6403], and as a conceptual and computational precursor for multi-state semiparametric intensity models [2209.07708]. A further modern perspective places it inside the general NPMLE framework that also includes neural-network-based likelihood estimators [2401.12482].

A second misconception is that the natural metric for analyzing NPMLEs is always KL divergence. In nonparametric settings, KL may diverge easily because the estimator can assign zero probability where the truth is positive. Recent work therefore advocates direct analysis in Hellinger distance and derives risk bounds in that metric under mild assumptions [2401.12482]. The same work explicitly notes that this style of oracle inequality is conceptually parallel to what one would seek for Turnbull’s estimator, with appropriate entropy calculations [2401.12482]. This suggests that the most stable theoretical language for Turnbull-type estimators may often be Hellinger-based rather than KL-based.

A third misconception is that Turnbull’s discreteness is an incidental computational artifact. In fact, discreteness is an intrinsic consequence of likelihood maximization over all cdfs under interval censoring. Shape-constrained variants modify that property only by shrinking the feasible model class, not by altering the underlying likelihood logic [1311.6403].

From a contemporary viewpoint, Turnbull’s NPMLE occupies a central place in the theory of incomplete-data likelihood. It combines three features that remain methodologically active: exact likelihood under censoring, nonparametric flexibility, and an EM-compatible finite-support representation. Modern extensions differ in target parameter, structural constraints, and asymptotic theory, but they continue to inherit the core Turnbull architecture.

Source: https://www.emergentmind.com/topics/turnbull-nonparametric-maximum-likelihood-estimator-npmle