---
title: Next Event Prediction (NEP) Overview
url: https://www.emergentmind.com/topics/next-event-prediction-nep
type: topic
---

# Next Event Prediction (NEP) Overview

Next Event Prediction (NEP) denotes a family of forecasting tasks that estimate what happens next from an observed history. Across current literature, the “next event” may be a diagnosis, procedure, medication, or lab in a patient trajectory; the next activity in a business-process trace; the more plausible future event given a video clip and dialogue; a missing entity in a future temporal knowledge-graph fact; a timestamp-label pair in a marked temporal point process; or a future interaction inside a continuous-time dynamic graph. Accordingly, NEP appears both as single-step classification and as joint prediction of event type, timestamp, existence, or multiple future events within a horizon [2509.25591][2401.15621][2010.07999][2408.07840][2408.13131][2205.10624].

## 1. Formal scope of the task

A defining feature of NEP is that the prediction target is always conditioned on a prefix, but the formal object being predicted varies substantially by domain. In clinical foundation modeling, an electronic health record is written as a chronological chain of timestamped events, \(\mathcal{P}=\{e_1,e_2,\ldots,e_n\}\), and the core objective is
$$
p(e_{t+1}\mid e_1,e_2,\ldots,e_t)=\mathrm{LLM}_\theta(e_1,e_2,\ldots,e_t),
$$
with each event containing an event type, an event value, and a timestamp [2509.25591].

In predictive business process monitoring, the standard formulation is a prefix-to-next-activity map. If a trace prefix is \(p_k=\langle e_1,e_2,\dots,e_k\rangle\), the target is the next activity \(a_{k+1}\), written as \(f(p_k)=a_{k+1}\). Related business-process formulations define an event as a tuple with activity, timestamp, and optional attributes, and train on prefix-label pairs generated from sliding windows or from all prefixes of a trace [2401.15621][2004.01376][2008.10748].

Marked temporal point process work makes the distinction between next-event prediction and long-horizon forecasting explicit. There the history is a sequence of timestamp-label pairs \((t_i,l_i)\), and standard evaluation predicts the next event’s label and time, whereas long-horizon settings predict \(K\) future candidates inside a horizon \((t,t+\mathrm{H})\) [2408.13131]. Temporal knowledge graph forecasting further shifts the target from event labels to future entities in quadruples \((s,r,o,t)\), typically predicting \((s,r,?,t+k)\) or \((?,r,o,t+k)\) from past graph snapshots [2408.07840]. In multimodal video-language work, NEP can also be cast as binary multiple-choice forecasting: given a premise clip with aligned dialogue and two candidate future events, choose which one is more likely to happen next [2010.07999].

This suggests that NEP is best understood as a task family rather than a single canonical problem specification.

## 2. Representing history and temporal context

A major axis of variation in NEP research is how the observed past is represented before prediction. One line of work argues that compressing a sequence into a current-state summary obscures order and timing. In the EHR setting, the proposed shift is from visit-level modeling to timestamped event chains, preserving the order and timing of individual diagnoses, procedures, medications, labs, and vital signs [2509.25591].

Other domains build richer semantic or structural state descriptions from the same prefix.

| Setting | History representation | Preserved signal |
|---|---|---|
| EHR foundation modeling | Chronological chain of timestamped events | Order and timing of individual clinical events |
| Business-process NAP | Coherent natural-language story from a prefix trace | Semantic content, temporal attributes, free text |
| Petri-net-based NEP | \(S(\tau)=F(\tau)\oplus C(\tau)\oplus M(\tau)\oplus R(\tau)\) | Decay response, token counters, marking, resource counts |
| Time-series event prediction | Evolutionary state graph \(\mathbf{G}^{(t)}\) | Changing relations among states |

In semantic business-process modeling, SNAP converts each trace prefix into a coherent natural-language story and fine-tunes a language foundation model for multiclass next-activity prediction. The story may include the current activity, turn number, temporal features, role or resource attributes, prior activity sequence, and free-text fields such as user utterances and bot responses [2401.15621]. In contrast, DREAM-NAP begins from a discovered Petri net, augments each place with a time decay function, replays the log, and concatenates decay response, token movement counters, markings, and optional resource counts into a timed state sample \(S(\tau)\) [1903.05084].

Irregular timing has motivated dedicated time representations. Rather than concatenating raw time, one approach contextualizes event embeddings with duration via Time Mask or combines event embeddings with a learned soft categorical time embedding via Event-Time Joint Embedding. The same work adds next-event-duration regularization to encourage hidden states to retain temporal structure useful for event prediction [1708.00065]. In time-series event prediction, the representation becomes explicitly graph-structured: segments are mapped to representative states, transitions between state mixtures define edge weights, and the resulting evolutionary state graph is updated over time [1905.05006].

The recurring theme is that NEP performance is tightly coupled to what counts as “history”: raw sequence, structured state, semantic narrative, or evolving graph.

## 3. Learning objectives and model families

Autoregressive prediction is one prominent paradigm, but not the only one. In clinical NEP, the objective is framed as causal autoregressive language modeling under a causal mask, explicitly contrasted with bidirectional masked modeling because allowing the model to “peek” at future events would violate the temporal logic of clinical forecasting. Implementation uses decoder-only LLMs, structured instruction-response pairs, and cross-entropy over the target tokens of the next event [2509.25591].

Classification-style objectives remain common elsewhere. VLEP uses a transformer-based multimodal classifier over video, dialogue, and commonsense knowledge, with cross-entropy loss to select the correct future event candidate [2010.07999]. SNAP, classical business-process next-activity prediction, and several benchmark studies also formulate NEP as multiclass classification over activity labels, often with softmax outputs and cross-entropy loss [2401.15621][2005.01194][2008.10748].

A different family replaces positional supervision with set prediction. DeTPP predicts \(K\) future event candidates in parallel, each with a presence probability \(\hat{o}\), a predicted time shift \(\hat{t}\), and a label distribution \(\hat{p}(l)\). Ground truth events within a horizon are matched to predictions with the Hungarian algorithm, and optimization uses a matching-based loss that combines time error, label likelihood, and a binary cross-entropy presence term. This design is meant to avoid error accumulation, repetitive outputs, and incorrect fixed-position alignment [2408.13131].

Adversarial training has also been used to improve generalization. One business-process framework defines a generator \(G\) and discriminator \(D\), both implemented as LSTMs, and combines adversarial feedback with the conventional supervised next-step loss \(J(\theta_g)\). A related encoder-decoder model for suffix and remaining-time prediction uses open-loop training, Gumbel-Softmax for differentiable discrete generation, and a discriminator over generated versus real suffixes [2003.11268][2102.07298].

Several recent methods target failure modes beyond ordinary supervised training. CaseQ argues that maximum likelihood estimation fails under temporal distribution shift because of a latent context confounder, and approximates \(P_\theta(Y\mid do(S))\) through backdoor adjustment and variational inference with hierarchical branching structures [2210.13005]. WGP-LN and FD-Dir move from point predictions to time-dependent distributions on the simplex, capturing how the entire next-event distribution evolves with future time and how uncertainty grows in poorly supported regions [1911.05503]. CET separates event occurrence from event timing with a binary stochastic layer \(c_i\in\{0,1\}\), learning whether an event will ever occur and, if so, when [2004.01376].

## 4. Major application domains

Healthcare has recently treated NEP as a foundation-modeling strategy rather than only a downstream task. In oncology-heavy EHR modeling, records are reformulated as timestamped event chains, the model is fine-tuned to predict the next clinical event, and patient embeddings extracted from final hidden states are then used for survival prediction and diagnosis tasks. The paper explicitly positions this as learning the next step in a patient’s medical journey rather than a static representation of current state [2509.25591].

Business process monitoring provides an older and more heterogeneous NEP tradition. Here the next event is usually the next activity label, though some systems also predict timestamps or full suffixes. Methods range from semantic stories with BERT, DeBERTa, and GPT-3; to GAN-like training for next activity and next timestamp; to Petri-net-guided state encoding; to broad empirical comparisons of classifiers, encoding windows, and ensembles [2401.15621][2003.11268][1903.05084][2005.01194][2008.10748].

Video and multimodal reasoning have produced two distinct formulations. VLEP asks which of two future events is more likely after a short video clip with dialogue, emphasizing commonsense, intention, reaction, and causal reasoning [2010.07999]. A later line treats NEP as a self-supervised objective for multimodal large language models: the model sees only past video frames and generates a summary of future events derived from future frames, with V1-33K as training data and FutureBench as an evaluation set [2505.22457]. A further extension, Video-Next-Event Prediction, shifts the answer modality itself from text to generated video by coupling a vision-language model and a video diffusion model through Joint-GRPO on VANS-Data-100K [2511.16669].

Graph-structured forecasting supplies several additional variants. ONSEP performs temporal knowledge graph forecasting by combining Dynamic Causal Rule Mining with Dual History Augmented Generation, using short-term history and long-term causal history at test time [2408.07840]. CEP3 models community event forecasting on continuous-time dynamic graphs, jointly predicting timestamp, source node, and destination node through a hierarchical factorization and autoregressive graph updates [2205.10624]. EvoNet represents segmented time series as evolutionary state graphs and predicts binary future events from node-level and graph-level propagation [1905.05006]. DeTPP addresses transactional, medical, social, and financial event streams within marked temporal point processes, emphasizing robust long-horizon event forecasting with next-event extensions [2408.13131].

## 5. Benchmarks, metrics, and empirical behavior

Empirical evaluation in NEP is highly domain-specific, and metrics vary accordingly. In clinical foundation modeling, training used more than 1.2 million patients and about 200 million clinical events, with public evaluation on MSK-CHORD, which has 24,950 patients, and on EHRSHOT, where the authors focus on the new-diagnosis task. Reported headline gains state that NEP improves temporal reasoning tasks by 7.2% C-index over general-purpose LLMs and surpasses specialized EHR models by 4.6% AUROC; in oncology survival, NEP-8B improves 7 of 10 cancer-stage subgroups and shows particularly strong gains in Stage IV metastatic settings [2509.25591].

VLEP established a benchmark of 28,726 future event prediction examples from 10,234 video clips, split into 20,142 train, 4,392 dev, and 4,192 test examples. On the test set, chance is 50.00%, the full video + dialogue + future baseline reaches 67.46%, humans achieve 76.25% with dialogue and future candidates only, and 90.50% with full video plus dialogue. The resulting model-human gap is a central empirical finding [2010.07999]. In the later video-NEP line, FutureBench contains 1056 QA pairs, and even a strong text-only reasoning model gets only 32.0% accuracy, which is presented as evidence that the benchmark requires visual and temporal understanding [2505.22457].

For point-process forecasting, DeTPP is evaluated on HoTPP across StackOverflow, Amazon, Retweet, MIMIC-IV, and Transactions. The paper reports state-of-the-art results on 9 out of 10 comparisons, up to a 77% relative improvement on long-horizon forecasting, and up to a 2.7% relative improvement on the large Transactions dataset for next-event prediction with DeTPP+ [2408.13131]. ONSEP reports Hit@1 improvements over ICL of 9.63% on ICEWS14, 9.35% on ICEWS05-15, and 16.28% on ICEWS18 with InternLM2-7B and history length \(L=100\) [2408.07840].

Business-process NEP remains benchmark-driven. SNAP is evaluated on six datasets and is reported to significantly outperform prior state of the art on all datasets by Wilcoxon signed-rank test, with especially notable gains on the semantically rich MIP dataset [2401.15621]. The GAN-based predictive monitoring framework reports weighted average next-activity accuracies of 0.9518 on Helpdesk, 0.9158 on BPI12(W), 0.9401 on BPI12, and 0.9256 on BPI17, with at least 98% accuracy at the longest prefix lengths for all logs [2003.11268]. DREAM-NAPr reports statistically significant gains with \(p<0.00001\) under a sign test with Dunn-Sidak correction [1903.05084].

## 6. Interpretability, uncertainty, generalization, and recurring methodological issues

Interpretability is an explicit design goal in several NEP lines. In EHR modeling, improved interpretability is attributed to attention weights that align with clinical pathways [2509.25591]. DREAM-NAP retains an explicit Petri net process model with markings, decay functions, and token movement counters [1903.05084]. EvoNet exposes representative states, state transitions, and temporal attention scores, allowing case studies that relate anomalous predictions to specific state paths [1905.05006]. ONSEP stores an explicit causal rule base \(\mathcal{CRB}\), making its neural-symbolic memory more inspectable than static retrieval alone [2408.07840].

Uncertainty enters NEP in at least two distinct senses: uncertainty about which event is next, and uncertainty about whether the event occurs at all. WGP-LN and FD-Dir model a distribution over class-probability vectors \(\mathbf{p}(\tau)\) that evolves with future time, rather than a single categorical output, and use uncertainty-aware objectives to discourage overconfident extrapolation [1911.05503]. CET separates \(P(\mathcal{F}_i<\infty\mid \mathbf{x}_i)\) from the distribution of event time conditioned on occurrence, which is critical when “no event” cannot be represented adequately as merely “very late event” [2004.01376].

Generalization under shift is another recurrent concern. CaseQ attributes out-of-distribution sequential event prediction failure to a latent context confounder and targets an interventional estimand \(P_\theta(Y\mid do(S))\) [2210.13005]. ONSEP emphasizes online adaptation by mining and updating causal rules during testing, and reports that dynamic updating beats relying on stale preloaded rules [2408.07840].

Several recurring methodological issues are treated explicitly in benchmark papers. Choosing an optimal number of events for feature encoding is described as challenging, and larger windows can sharply reduce the number of available training samples [2008.10748]. Ensemble schemes improve the performance of low performing classifiers such as SVM, whereas high performing classifiers such as tree-based classifiers are not better off when ensemble schemes are considered [2008.10748]. In context-enriched DNN benchmarks, encoding strategy is reported to matter more than architecture on average, with hash encoding strongest overall and ordinal encoding consistently worst [2005.01194]. In video NEP, increasing dataset size does not always improve performance, and GRPO reinforcement learning can improve FutureBench while also hurting general benchmark performance and encouraging reward hacking or shortcut behavior [2505.22457]. A plausible implication is that NEP remains methodologically plural: gains often come not from a universal backbone, but from aligning representation, objective, and evaluation with the causal and temporal structure of the underlying event stream.

Source: https://www.emergentmind.com/topics/next-event-prediction-nep