---
title: Neural Diffusion Intensity Models
url: https://www.emergentmind.com/topics/neural-diffusion-intensity-models
type: topic
---

# Neural Diffusion Intensity Models

Searching arXiv for recent papers on neural diffusion intensity models and closely related diffusion-based intensity/density modeling.
Neural Diffusion Intensity Models are diffusion-based latent-variable models for point process data in which the event-rate process itself is stochastic and evolves according to a neural SDE. In the formulation introduced for Cox processes, observed event times are generated by a latent stochastic intensity \(Z_t\), while learning and posterior inference are performed with a variational family whose paths retain diffusion structure after conditioning on observations [2602.24083]. Within the broader diffusion literature, the phrase “intensity” is used in several distinct senses: as a point-process rate in Cox-process modeling, as total image intensity in conservation-constrained generative modeling, and as arithmetic intensity in systems work on diffusion language models. The point-process meaning is the technically specific sense associated with Neural Diffusion Intensity Models proper [2602.24083].

## 1. Definition and scope

In the point-process setting, Neural Diffusion Intensity Models address Cox processes, also called doubly stochastic Poisson processes, where observed event times are driven by a latent stochastic intensity process \(Z_t\) [2602.24083]. This formulation targets overdispersed point process data, meaning count variability exceeds what a standard Poisson model explains, and it treats inference over the latent intensity path as the central computational problem [2602.24083].

The model class is diffusion-driven in a literal sense: the latent intensity is a diffusion solving an SDE with neural-network-parameterized drift. The corresponding marginal likelihood
\[
P_\theta(X)=\int P(X\mid Z)\,dP_\theta(Z)
\]
is intractable because the integral ranges over an entire path space of trajectories \(Z\) [2602.24083]. The proposed framework replaces repeated MCMC-based posterior sampling with amortized variational inference built around a drift-corrected posterior SDE [2602.24083].

The broader literature contains adjacent but non-identical uses of related terminology. “Discrete Spatial Diffusion” models exact conservation of total image intensity in discrete spatial domains, but its object is not an event intensity \(\lambda(t\mid \mathcal H_t)\) or a Cox-process latent rate [2505.01917]. “Diffusion Density Estimators” studies diffusion models as neural density estimators that compute log densities without solving a Probability Flow ODE; its target is likelihood evaluation for data samples rather than latent point-process intensity paths [2410.06986]. “Diffusion-Augmented Neural Processes” explicitly states that it is not an intensity model in the usual point-process sense [2311.09848]. This terminological separation is important because the word “intensity” is overloaded across diffusion-model research.

## 2. Probabilistic formulation for Cox processes

The latent intensity \(Z_t\) is modeled as a diffusion
\[
dZ_t = b_\theta(Z_t,t)\,dt + \sigma(Z_t,t)\,dB_t,\qquad Z_0=z.
\]
Here \(b_\theta\) is the drift parameterized by a neural network, while \(\sigma\) is the diffusion coefficient, typically fixed or chosen from a parametric form such as CIR [2602.24083].

Conditional on the intensity path \(Z\), the observed process \(X=\{\tau_i\}\) is an inhomogeneous Poisson process with rate \(Z_t\). On \([0,T]\), the event likelihood is
\[
P(X\mid Z)\propto \exp\!\left(\int_0^T \log Z_t\,dN_t - \int_0^T Z_t\,dt\right),
\]
so the joint model is
\[
P_\theta(X,Z)=P(X\mid Z)\,P_\theta(Z).
\]
The resulting model can therefore be viewed as an infinite mixture of Poisson processes whose mixing distribution is induced by the SDE prior over intensities [2602.24083].

This construction is aimed at nonparametric maximum likelihood over the marginal point-process distribution. The stated learning target is
\[
\sup_{\theta}\ \mathbb{E}_{\mu_{\mathrm{gt}}}\big[\log P_\theta(X)\big]
=
\sup_{\theta}\ \mathbb{E}_{\mu_{\mathrm{gt}}}\!\left[\log\int P(X\mid Z)\,dP_\theta(Z)\right],
\]
but the path integral is not tractable in closed form [2602.24083]. That intractability motivates the variational diffusion formulation that gives the model class its name.

A plausible implication is that the model occupies the same conceptual niche for continuous-time event data that latent neural SDEs occupy for continuous observations, except that the observation model is Poissonian and the latent path is interpreted explicitly as an intensity.

## 3. Posterior diffusion structure via enlargement of filtrations

The central theoretical contribution is a posterior-structure theorem based on enlargement of filtrations. Conditioning on observed event times does not destroy the diffusion form of the latent intensity process; instead, the posterior remains a diffusion with the same diffusion coefficient and an additional drift correction [2602.24083].

The variational or posterior family is written as
\[
dZ_t= \Big[b_\theta(Z_t,t)+\mathbf{1}_{\{t\le T'\}}\sigma(Z_t,t)u_\beta(Z_t,t,T',N_{0:T'})\Big]dt +\sigma(Z_t,t)\,dB_t.
\]
Theorem 2.1 gives the exact posterior SDE structure
\[
dZ_t= \Big[b(Z_t,t)+\mathbf{1}_{\{t\le T'\}\sigma(Z_t,t)^2\,h(Z_t,t,T',X)\Big]dt +\sigma(Z_t,t)\,d\tilde B_t,
\]
with
\[
h(z,t,T',X) = \frac{\partial}{\partial z} \log \mathbb{E}\!\left[ \exp\!\left(-\int_t^{T'} Z_s\,ds\right) \prod_{t<\tau_i\le T'} Z_{\tau_i} \Bigg| Z_t=z \right].
\]
The paper interprets this additional term as a score-like drift correction [2602.24083].

Three structural consequences are explicit. The posterior remains a diffusion, the diffusion coefficient does not change, and the effect of conditioning is entirely absorbed into the drift through a conditional log-derivative term [2602.24083]. The paper notes that this is analogous in spirit to classifier guidance in diffusion models, where a prior trajectory is steered by a gradient of a log conditional density [2602.24083].

This result matters because it makes the variational family exact in principle: the family used for inference is not merely heuristic but is structured to contain the true posterior under sufficient model capacity [2602.24083]. That alignment is the basis for the model’s maximum-likelihood interpretation.

## 4. Variational objective and amortized inference

Using the SDE-induced variational family \(Q_\phi(Z\mid X)\), the framework optimizes the usual ELBO
\[
\log P_\theta(X)\ge \mathbb{E}_{Q(Z)}[\log P(X\mid Z)] -\mathrm{KL}(Q(Z)\|P_\theta(Z)).
\]
For the drift-corrected posterior-SDE family, the KL term has a closed form, yielding
\[
\mathcal{L}(\theta,\beta;X) = \mathbb{E}_{Q_\phi}\left[ \log P(X\mid Z) -\frac12\int_0^{T'} u_\beta(Z_t,t,T',X)^2\,dt \right].
\]
The empirical objective is
\[
\frac{1}{n}\sum_{i=1}^n \mathcal{L}(\theta,\beta;X^i).
\]
Because the true posterior lies in the same SDE family in principle, the paper argues that with sufficient model capacity the variational gap vanishes and ELBO maximization coincides with maximum likelihood estimation [2602.24083].

Posterior inference is amortized through an encoder that maps a variable-length sequence of event times into a drift correction. The encoder uses a Deep Sets-style permutation-invariant architecture,
\[
u_\beta(Z_t,t,T',N_{0:T'}) = \sigma(Z_t,t)\, \rho\!\left( t,T', \sum_{t<\tau_i\le T'} \psi(Z_t,\Delta_i,T'-\tau_i) \right),
\]
where \(\Delta_i=\tau_i-\tau_{i-1}\) and \(\psi,\rho\) are MLPs [2602.24083]. In the terminology used there, \(\psi\) encodes per-event contributions, the sum aggregates event information after time \(t\), and \(\rho\) maps the aggregate together with current state and time to the drift correction [2602.24083].

The practical significance is that posterior sample paths are obtained by directly simulating the corrected SDE in a single forward pass, rather than running fresh MCMC for every observation sequence [2602.24083]. This suggests an inference pipeline better suited to repeated or real-time posterior estimation than classical EM-plus-MCMC procedures.

## 5. Empirical behavior and reported performance

The synthetic experiments use a CIR latent intensity
\[
dZ_t = 0.3(80-Z_t)\,dt + \sqrt{Z_t}\,dB_t,\qquad Z_0=5,
\]
with \(256\) simulated Cox-process sequences on \([0,4]\), Euler–Maruyama discretization with \(100\) steps, \(10\) Brownian samples per observation for Monte Carlo gradients, and training for \(100\) epochs with batch size \(32\) and learning rate \(0.005\) [2602.24083]. A time-inhomogeneous variant,
\[
dZ_t = \big(0.3(80-Z_t)-5t\big)\,dt + \sqrt{Z_t}\,dB_t,
\]
is also studied [2602.24083].

On prior recovery, the learned drift \(b_\theta\) qualitatively matches the true drift and reproduces sample statistics well [2602.24083]. Under an equal \(5\)-hour compute budget, the reported \(L^2\) path deviations are summarized below.

| True drift | EM loss | VI loss |
|---|---:|---:|
| \(0.3(80-Z_t)\) | 6.159 | 5.792 |
| \(0.3(80-Z_t)-5t\) | 6.721 | 4.989 |

Posterior inference quality is evaluated against high-fidelity MCMC. The amortized posterior tracks MCMC posterior sample paths closely for both complete data \(N_{0:T}\) and partial observation \(N_{0:T/2}\) [2602.24083]. The paper also studies amortization overfitting using a Wasserstein distance between amortized and MCMC posterior path measures, reporting that a train/test gap appears for small training sets and vanishes once training size exceeds about \(16\) [2602.24083].

The main computational claim concerns speed. For synthetic experiments, the variational method is typically \(1\)–\(2\) orders of magnitude faster than MCMC-based posterior sampling while achieving similar predictive likelihoods [2602.24083]. Representative timings include full-horizon posterior inference on \([0,T]\): MCMC \(17\)m \(38.5\)s versus VI \(39.9\)s [2602.24083]. On a large U.S. bank call-center dataset with minute-level arrivals, \(128\) Mondays for training, and observations heavily thinned with probability \(0.001\) for stability, the learned mean intensity captures the main daily pattern, though the learned variance is less accurate [2602.24083].

The weaker variance fit is attributed in the paper to fixing \(\sigma\) as \(\sqrt{Z_t}\), and learning \(\sigma\) as another neural network \(\sigma_\alpha\) is presented as a natural extension [2602.24083].

## 6. Conceptual relations to adjacent diffusion research

Neural Diffusion Intensity Models for point processes belong to a wider family of diffusion-based probabilistic modeling methods, but neighboring approaches target different objects.

“Diffusion Density Estimators” examines diffusion models as neural density estimators and introduces a Monte Carlo path-integral estimator for log density that avoids the Probability Flow ODE [2410.06986]. Its central transferable idea is to replace sequential ODE likelihood computation with a highly parallelizable Monte Carlo path integral built from analytic transition kernels [2410.06986]. This is adjacent to NDIM in that both works seek tractable likelihood-related computation from diffusion machinery, but one addresses sample densities while the other addresses posterior inference over latent intensity paths.

“Discrete Spatial Diffusion: Intensity-Preserving Diffusion Modeling” uses the term “intensity” in an image-generation sense: pixel values are interpreted as discrete particles moving on a lattice under a continuous-time Markov jump process that preserves total intensity exactly in both forward and reverse processes [2505.01917]. It therefore concerns conservation of mass or particle count, not a point-process event rate. The distinction is technical rather than terminological: its forward and reverse dynamics are particle-conserving jump processes on images, whereas NDIM models stochastic event intensities for Cox processes [2505.01917].

“Diffusion-Augmented Neural Processes” is diffusion-inspired conditional regression, but it explicitly states that there is no explicit point-process intensity function, event arrival rate, or temporal intensity modeling in the paper [2311.09848]. “Optical Diffusion Models for Image Generation” realizes a denoising diffusion model in passive optics and uses “output intensity” to refer to optical field intensity corresponding to the predicted noise term [2407.10897]. “Orchestrating Dual-Boundaries” uses “arithmetic intensity” to denote a hardware-performance quantity in diffusion language model inference [2511.21759]. These are all valid diffusion-related uses of the word, but they are separate from the point-process meaning formalized by NDIM.

A plausible implication is that the specific contribution of NDIM is not merely “using diffusion models for point processes,” but identifying a posterior family whose structure matches the exact conditioned path law of a diffusion-driven Cox process.

## 7. Limitations, extensions, and interpretation

The stated limitations are concrete. The diffusion coefficient \(\sigma\) is fixed, which may limit fit on real data; the encoder must approximate a complicated functional of future event times; training relies on Monte Carlo simulation and Euler discretization, introducing discretization bias; and experiments are mainly on one-dimensional point processes [2602.24083].

The proposed extensions are likewise explicit: learning the diffusion coefficient \(\sigma_\alpha\) with a neural network, extending to multivariate point processes, applying the method to marked or spatiotemporal point processes, using richer observation models beyond simple Cox or Poisson likelihoods, and extending the enlargement-of-filtrations approach to other continuous-time latent-variable models [2602.24083].

The main interpretive claim is that posterior inference for diffusion-driven Cox processes can be reformulated as simulation of a drift-corrected SDE with unchanged diffusion coefficient [2602.24083]. In that sense, Neural Diffusion Intensity Models convert a path-space Bayesian inference problem into amortized simulation under a learned correction field. This suggests a synthesis of Cox-process statistics, neural SDE priors, and diffusion-style posterior guidance that is theoretically tied to maximum likelihood when the model family is sufficiently expressive [2602.24083].

Source: https://www.emergentmind.com/topics/neural-diffusion-intensity-models