Papers
Topics
Authors
Recent
Search
2000 character limit reached

Non-Homogeneous Poisson Process (NHPP) Framework

Updated 16 June 2026
  • Non-Homogeneous Poisson Process (NHPP) framework is a probabilistic model for recurrent events that captures time-varying and covariate-dependent intensity.
  • It employs Soft Bayesian Additive Regression Trees (SBART) to nonparametrically model smooth, nonlinear, and high-dimensional interactions between time and covariates.
  • Bayesian computation via data augmentation and hierarchical priors ensures efficient inference with strong empirical validation in both simulations and real-world applications.

A non-homogeneous Poisson process (NHPP) framework provides a flexible, fully probabilistic paradigm for modeling and inference on recurrent event data where the conditional intensity function can vary with both time and covariates, capturing non-proportional, nonlinear, and potentially high-dimensional effects beyond the scope of classical survival analysis methods. Bayesian machine learning approaches, particularly Soft Bayesian Additive Regression Trees (SBART), have recently been developed to nonparametrically learn the NHPP intensity function in the presence of complex functional forms, subject-specific heterogeneity, and nonlinear covariate/time interactions (Chen et al., 10 Jun 2026).

1. NHPP Model Structure and Conditional Intensity Specification

The standard NHPP for recurrent events assumes that the counting process Ni(t)N_i(t) for each subject i∈{1,…,n}i\in\{1,\dots,n\} has conditional intensity

λi(t∣Xi,ui)=λ0⋅ui⋅g(Xi,t)\lambda_i(t \mid X_i, u_i) = \lambda_0 \cdot u_i \cdot g(X_i, t)

where:

  • λ0\lambda_0 is a constant baseline hazard,
  • uiu_i is a latent subject-specific frailty (ui>0u_i > 0; typically Gamma-distributed for multiplicative random effects),
  • g(Xi,t)g(X_i, t) is an unknown function of covariates XiX_i and time tt satisfying g(Xi,t)>0g(X_i, t)>0.

This formulation decouples baseline, subject-level, and time-varying/random effects, allowing i∈{1,…,n}i\in\{1,\dots,n\}0 to model arbitrary smooth or complex interactions between the covariates and time. A common SBART representation is

i∈{1,…,n}i\in\{1,\dots,n\}1

with i∈{1,…,n}i\in\{1,\dots,n\}2 a latent regression function modeled by a sum-of-trees prior, and i∈{1,…,n}i\in\{1,\dots,n\}3 the standard normal CDF so i∈{1,…,n}i\in\{1,\dots,n\}4 (Chen et al., 10 Jun 2026).

2. Nonparametric Modeling of NHPP Intensity via SBART

Instead of imposing a fixed functional form for i∈{1,…,n}i\in\{1,\dots,n\}5, SBART places an additive regression-tree prior on i∈{1,…,n}i\in\{1,\dots,n\}6. Each tree i∈{1,…,n}i\in\{1,\dots,n\}7 partitions the input i∈{1,…,n}i\in\{1,\dots,n\}8 space via soft, probabilistic splits: i∈{1,…,n}i\in\{1,\dots,n\}9 where λi(t∣Xi,ui)=λ0⋅ui⋅g(Xi,t)\lambda_i(t \mid X_i, u_i) = \lambda_0 \cdot u_i \cdot g(X_i, t)0 encodes the tree structure as a sequence of branch/leaf splits on joint time-covariate dimensions, and the soft path weights λi(t∣Xi,ui)=λ0⋅ui⋅g(Xi,t)\lambda_i(t \mid X_i, u_i) = \lambda_0 \cdot u_i \cdot g(X_i, t)1 are products of logistic (inverse-logit) gating functions. The full regression function is

λi(t∣Xi,ui)=λ0⋅ui⋅g(Xi,t)\lambda_i(t \mid X_i, u_i) = \lambda_0 \cdot u_i \cdot g(X_i, t)2

and the transformed intensity is λi(t∣Xi,ui)=λ0⋅ui⋅g(Xi,t)\lambda_i(t \mid X_i, u_i) = \lambda_0 \cdot u_i \cdot g(X_i, t)3 (Chen et al., 10 Jun 2026).

Key attributes of the SBART construction in this context:

  • Supports high-dimensional, nonlinear, and potentially nonstationary intensity surfaces.
  • Each branch node’s softness parameter λi(t∣Xi,ui)=λ0â‹…uiâ‹…g(Xi,t)\lambda_i(t \mid X_i, u_i) = \lambda_0 \cdot u_i \cdot g(X_i, t)4 controls the transition sharpness; as λi(t∣Xi,ui)=λ0â‹…uiâ‹…g(Xi,t)\lambda_i(t \mid X_i, u_i) = \lambda_0 \cdot u_i \cdot g(X_i, t)5, the model recovers hard partitioning.
  • The prior over trees follows a Galton–Watson process with depth-dependent split probabilities, split variable/uniform cut allocations, and Gamma priors for bandwidth.

3. Hierarchical Priors and Latent Structure

The NHPP-SBART framework utilizes several hierarchically structured priors:

  • Frailty effects: λi(t∣Xi,ui)=λ0â‹…uiâ‹…g(Xi,t)\lambda_i(t \mid X_i, u_i) = \lambda_0 \cdot u_i \cdot g(X_i, t)6 with hyper-prior λi(t∣Xi,ui)=λ0â‹…uiâ‹…g(Xi,t)\lambda_i(t \mid X_i, u_i) = \lambda_0 \cdot u_i \cdot g(X_i, t)7, enforcing λi(t∣Xi,ui)=λ0â‹…uiâ‹…g(Xi,t)\lambda_i(t \mid X_i, u_i) = \lambda_0 \cdot u_i \cdot g(X_i, t)8 for identifiability.
  • Baseline hazard: λi(t∣Xi,ui)=λ0â‹…uiâ‹…g(Xi,t)\lambda_i(t \mid X_i, u_i) = \lambda_0 \cdot u_i \cdot g(X_i, t)9.
  • Tree structure: per-node split with probability λ0\lambda_00 (standard choices: λ0\lambda_01, λ0\lambda_02) (Chen et al., 10 Jun 2026).
  • Leaf parameters: λ0\lambda_03, typically with λ0\lambda_04 for λ0\lambda_05 trees.
  • Bandwidths λ0\lambda_06: shared per tree as λ0\lambda_07 with λ0\lambda_08 user-chosen.

4. Bayesian Computation: Data Augmentation and Posterior Inference

Direct likelihood evaluation in the NHPP framework involves terms of the form λ0\lambda_09, which is analytically intractable with nonparametric uiu_i0. SBART employs a two-layer data augmentation:

Layer 1 (Poisson Thinning): For each individual, simulate pseudo-events uiu_i1 from an independent NHPP with intensity

uiu_i2

over uiu_i3. The likelihood, conditioned on observed events uiu_i4 and pseudo-events uiu_i5, factorizes into products over uiu_i6 and uiu_i7 (Chen et al., 10 Jun 2026).

Layer 2 (Latent Gaussian Variables): An Albert–Chib (probit) construction introduces latent uiu_i8: for each event uiu_i9, ui>0u_i > 00 truncated above ui>0u_i > 01 (event), for each pseudo-event ui>0u_i > 02, ui>0u_i > 03 truncated below ui>0u_i > 04 (no event). This converts the backfitting update for ui>0u_i > 05 into a Gaussian regression problem, directly compatible with standard SBART Metropolis–Hastings moves (Chen et al., 10 Jun 2026).

Conditional posterior updates for frailties, baseline, and tree parameters are all available in closed form or via standard Gibbs/slice/MH steps.

5. Theoretical and Empirical Properties

The SBART-based NHPP approach provides the following properties:

  • Smoothness Adaptivity: SBART can adapt to arbitrary (unknown) levels of smoothness in ui>0u_i > 06, with posterior contraction rates matching minimax optimality for Hölder classes (Linero et al., 2017).
  • High-dimensional/Interaction Recovery: The additive sum-of-trees and Dirichlet splits induce automatic adaptation to sparsity, variable selection, and nonlinear interactions (Linero et al., 2017, Linero, 2022).
  • Robustness under Misspecification: Simulation studies confirm that SBART-based NHPP estimation yields lower mean squared error for cumulative intensity estimation and better goodness-of-fit via Martingale residuals even when frailty or intensity model assumptions are violated. For instance, in scenarios with ui>0u_i > 07 subjects and ui>0u_i > 08 covariates, RecSBART yielded average MSEs of ui>0u_i > 09–g(Xi,t)g(X_i, t)0 across a range of simulated settings, outperforming both random forest and proportional-frailty models (random forest, g(Xi,t)g(X_i, t)1–g(Xi,t)g(X_i, t)2; proportional-frailty, g(Xi,t)g(X_i, t)3–g(Xi,t)g(X_i, t)4) (Chen et al., 10 Jun 2026).
  • Real-world validation: Applied to colorectal-cancer recurrent hospitalization data (g(Xi,t)g(X_i, t)5), RecSBART achieved lowest mean squared Martingale residual (MSMR: g(Xi,t)g(X_i, t)6) versus RecForest (g(Xi,t)g(X_i, t)7) and a standard Bayesian proportional frailty model (g(Xi,t)g(X_i, t)8). Subject-level cross-validation showed RecSBART generalization gap g(Xi,t)g(X_i, t)9 vs. XiX_i0 for RecForest (Chen et al., 10 Jun 2026).

6. Implementation, Scalability, and Practical Recommendations

The NHPP-SBART framework is implemented in compiled C++ code, enabling practical computation for moderate sample sizes (e.g., XiX_i1 takes XiX_i2s per MCMC iteration). No additional computational accelerations beyond the two-layer augmentation are required for fit or mixing. Default choices for SBART hyperparameters (e.g., XiX_i3, XiX_i4, XiX_i5, XiX_i6) are empirically robust. Posterior diagnostics rely on traceplots and effective-sample-size measures.

Empirical guidance for practitioners:

  • Run sufficient MCMC iterations (e.g., XiX_i7 burn-inXiX_i8 posterior draws).
  • Sensitivity analyses on frailty priors exhibit <7\% effect on MSMR.
  • Bayesian marginal effects (BMEs) can be quantified by integrating over covariate subspaces, and the proportional-intensity assumption is testable via examination of time-varying BME estimates; time-constancy in log-BME suggests proportionality (Chen et al., 10 Jun 2026).

7. Extensions and Applications

The NHPP framework with SBART generalizes to handle interval- and right-censored survival data, spatial clustering, and unobserved covariates by integrating further latent-variable schemes (e.g., spatial CAR priors for cluster frailties) and multi-stage data augmentation (Ghosh et al., 2024). Smooth intensity estimation, uncertainty quantification, and predictive analysis are well supported. This approach is particularly suitable for biomedical and epidemiological recurrent event data, where subject-level heterogeneity and nonlinear dynamics cannot be parsimoniously specified in classical parametric or semiparametric survival models.

Summary Table: NHPP–SBART Framework Components

Component Specification/Role Reference
Intensity XiX_i9 tt0 (Chen et al., 10 Jun 2026)
tt1 SBART: tt2 sum-of-soft-trees (Chen et al., 10 Jun 2026)
Frailty tt3 tt4, hyperprior on tt5 (Chen et al., 10 Jun 2026)
Data augmentation Poisson thinning + latent Gaussian variables (Chen et al., 10 Jun 2026)
Computation Tree-wise MCMC, conjugate updates, C++ impl. (Chen et al., 10 Jun 2026)
Empirical validation Simulation, real-world hospitalizations (Chen et al., 10 Jun 2026)

The NHPP framework with SBART establishes a scalable, nonparametric statistical model for recurrent events. Each modeling and inferential step, including data augmentation, hierarchical prior specification, and adaptation to nonlinearity, is formally documented in the cited literature (Chen et al., 10 Jun 2026).

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Non-Homogeneous Poisson Process (NHPP) Framework.