Non-Homogeneous Poisson Process (NHPP) Framework
- Non-Homogeneous Poisson Process (NHPP) framework is a probabilistic model for recurrent events that captures time-varying and covariate-dependent intensity.
- It employs Soft Bayesian Additive Regression Trees (SBART) to nonparametrically model smooth, nonlinear, and high-dimensional interactions between time and covariates.
- Bayesian computation via data augmentation and hierarchical priors ensures efficient inference with strong empirical validation in both simulations and real-world applications.
A non-homogeneous Poisson process (NHPP) framework provides a flexible, fully probabilistic paradigm for modeling and inference on recurrent event data where the conditional intensity function can vary with both time and covariates, capturing non-proportional, nonlinear, and potentially high-dimensional effects beyond the scope of classical survival analysis methods. Bayesian machine learning approaches, particularly Soft Bayesian Additive Regression Trees (SBART), have recently been developed to nonparametrically learn the NHPP intensity function in the presence of complex functional forms, subject-specific heterogeneity, and nonlinear covariate/time interactions (Chen et al., 10 Jun 2026).
1. NHPP Model Structure and Conditional Intensity Specification
The standard NHPP for recurrent events assumes that the counting process for each subject has conditional intensity
where:
- is a constant baseline hazard,
- is a latent subject-specific frailty (; typically Gamma-distributed for multiplicative random effects),
- is an unknown function of covariates and time satisfying .
This formulation decouples baseline, subject-level, and time-varying/random effects, allowing 0 to model arbitrary smooth or complex interactions between the covariates and time. A common SBART representation is
1
with 2 a latent regression function modeled by a sum-of-trees prior, and 3 the standard normal CDF so 4 (Chen et al., 10 Jun 2026).
2. Nonparametric Modeling of NHPP Intensity via SBART
Instead of imposing a fixed functional form for 5, SBART places an additive regression-tree prior on 6. Each tree 7 partitions the input 8 space via soft, probabilistic splits: 9 where 0 encodes the tree structure as a sequence of branch/leaf splits on joint time-covariate dimensions, and the soft path weights 1 are products of logistic (inverse-logit) gating functions. The full regression function is
2
and the transformed intensity is 3 (Chen et al., 10 Jun 2026).
Key attributes of the SBART construction in this context:
- Supports high-dimensional, nonlinear, and potentially nonstationary intensity surfaces.
- Each branch node’s softness parameter 4 controls the transition sharpness; as 5, the model recovers hard partitioning.
- The prior over trees follows a Galton–Watson process with depth-dependent split probabilities, split variable/uniform cut allocations, and Gamma priors for bandwidth.
3. Hierarchical Priors and Latent Structure
The NHPP-SBART framework utilizes several hierarchically structured priors:
- Frailty effects: 6 with hyper-prior 7, enforcing 8 for identifiability.
- Baseline hazard: 9.
- Tree structure: per-node split with probability 0 (standard choices: 1, 2) (Chen et al., 10 Jun 2026).
- Leaf parameters: 3, typically with 4 for 5 trees.
- Bandwidths 6: shared per tree as 7 with 8 user-chosen.
4. Bayesian Computation: Data Augmentation and Posterior Inference
Direct likelihood evaluation in the NHPP framework involves terms of the form 9, which is analytically intractable with nonparametric 0. SBART employs a two-layer data augmentation:
Layer 1 (Poisson Thinning): For each individual, simulate pseudo-events 1 from an independent NHPP with intensity
2
over 3. The likelihood, conditioned on observed events 4 and pseudo-events 5, factorizes into products over 6 and 7 (Chen et al., 10 Jun 2026).
Layer 2 (Latent Gaussian Variables): An Albert–Chib (probit) construction introduces latent 8: for each event 9, 0 truncated above 1 (event), for each pseudo-event 2, 3 truncated below 4 (no event). This converts the backfitting update for 5 into a Gaussian regression problem, directly compatible with standard SBART Metropolis–Hastings moves (Chen et al., 10 Jun 2026).
Conditional posterior updates for frailties, baseline, and tree parameters are all available in closed form or via standard Gibbs/slice/MH steps.
5. Theoretical and Empirical Properties
The SBART-based NHPP approach provides the following properties:
- Smoothness Adaptivity: SBART can adapt to arbitrary (unknown) levels of smoothness in 6, with posterior contraction rates matching minimax optimality for Hölder classes (Linero et al., 2017).
- High-dimensional/Interaction Recovery: The additive sum-of-trees and Dirichlet splits induce automatic adaptation to sparsity, variable selection, and nonlinear interactions (Linero et al., 2017, Linero, 2022).
- Robustness under Misspecification: Simulation studies confirm that SBART-based NHPP estimation yields lower mean squared error for cumulative intensity estimation and better goodness-of-fit via Martingale residuals even when frailty or intensity model assumptions are violated. For instance, in scenarios with 7 subjects and 8 covariates, RecSBART yielded average MSEs of 9–0 across a range of simulated settings, outperforming both random forest and proportional-frailty models (random forest, 1–2; proportional-frailty, 3–4) (Chen et al., 10 Jun 2026).
- Real-world validation: Applied to colorectal-cancer recurrent hospitalization data (5), RecSBART achieved lowest mean squared Martingale residual (MSMR: 6) versus RecForest (7) and a standard Bayesian proportional frailty model (8). Subject-level cross-validation showed RecSBART generalization gap 9 vs. 0 for RecForest (Chen et al., 10 Jun 2026).
6. Implementation, Scalability, and Practical Recommendations
The NHPP-SBART framework is implemented in compiled C++ code, enabling practical computation for moderate sample sizes (e.g., 1 takes 2s per MCMC iteration). No additional computational accelerations beyond the two-layer augmentation are required for fit or mixing. Default choices for SBART hyperparameters (e.g., 3, 4, 5, 6) are empirically robust. Posterior diagnostics rely on traceplots and effective-sample-size measures.
Empirical guidance for practitioners:
- Run sufficient MCMC iterations (e.g., 7 burn-in8 posterior draws).
- Sensitivity analyses on frailty priors exhibit <7\% effect on MSMR.
- Bayesian marginal effects (BMEs) can be quantified by integrating over covariate subspaces, and the proportional-intensity assumption is testable via examination of time-varying BME estimates; time-constancy in log-BME suggests proportionality (Chen et al., 10 Jun 2026).
7. Extensions and Applications
The NHPP framework with SBART generalizes to handle interval- and right-censored survival data, spatial clustering, and unobserved covariates by integrating further latent-variable schemes (e.g., spatial CAR priors for cluster frailties) and multi-stage data augmentation (Ghosh et al., 2024). Smooth intensity estimation, uncertainty quantification, and predictive analysis are well supported. This approach is particularly suitable for biomedical and epidemiological recurrent event data, where subject-level heterogeneity and nonlinear dynamics cannot be parsimoniously specified in classical parametric or semiparametric survival models.
Summary Table: NHPP–SBART Framework Components
| Component | Specification/Role | Reference |
|---|---|---|
| Intensity 9 | 0 | (Chen et al., 10 Jun 2026) |
| 1 | SBART: 2 sum-of-soft-trees | (Chen et al., 10 Jun 2026) |
| Frailty 3 | 4, hyperprior on 5 | (Chen et al., 10 Jun 2026) |
| Data augmentation | Poisson thinning + latent Gaussian variables | (Chen et al., 10 Jun 2026) |
| Computation | Tree-wise MCMC, conjugate updates, C++ impl. | (Chen et al., 10 Jun 2026) |
| Empirical validation | Simulation, real-world hospitalizations | (Chen et al., 10 Jun 2026) |
The NHPP framework with SBART establishes a scalable, nonparametric statistical model for recurrent events. Each modeling and inferential step, including data augmentation, hierarchical prior specification, and adaptation to nonlinearity, is formally documented in the cited literature (Chen et al., 10 Jun 2026).