Warped Linear Prediction for Count Time Series

• Warped Linear Prediction is a semiparametric approach that extends Gaussian DLMs by applying a transformation and rounding mechanism to generate count-valued observations.
• It achieves analytic conjugate inference through a selection-normal framework, supporting both batch and online estimation with efficient recursive updates.
• The method rigorously handles exact count support, including zero-inflation and multivariate counts, while offering flexibility via nonparametric transformation options.

Warped Linear Prediction (WLP) is a semiparametric methodology that extends Gaussian Dynamic Linear Models (DLMs) to time series of counts by introducing a two-step warping mechanism—a flexible transformation followed by a rounding operator. This approach enables analytic conjugate inference for count-valued time series, supporting both batch and online algorithms, and yields a framework that unifies and extends a variety of discrete time series models while retaining probabilistic and recursive updating properties (King et al., 2021).

1. Gaussian Dynamic Linear Model Foundation

The backbone of WLP is the Gaussian DLM, specified in state-space form for a latent continuous process $\{z_t\}$:

• State Evolution: $x_t = G_t\, x_{t-1} + \omega_t$, with $\omega_t \sim N_p(0, W_t)$
• Observation Model: $z_t = F_t^\top x_t + \nu_t$, with $\nu_t \sim N_n(0, V_t)$
• Prior Distribution: $x_0 \sim N_p(a_0, R_0)$

Here, $x_t \in \mathbb{R}^p$ is the latent state, $z_t \in \mathbb{R}^n$ is the latent "observation," $F_t$ and $G_t$ are known design matrices, and $x_t = G_t\, x_{t-1} + \omega_t$0, $x_t = G_t\, x_{t-1} + \omega_t$1 are known or estimated covariance matrices. In standard form, the Kalman filter and smoother yield closed-form recursive updates for the filtered and smoothed posterior moments of $x_t = G_t\, x_{t-1} + \omega_t$2.

2. Warping Procedure: Transformation and Rounding

WLP introduces a two-step warping of the latent Gaussian sequence $x_t = G_t\, x_{t-1} + \omega_t$3 to generate count-valued observations $x_t = G_t\, x_{t-1} + \omega_t$4:

1. Transformation $x_t = G_t\, x_{t-1} + \omega_t$5: A continuous, strictly monotonic operator $x_t = G_t\, x_{t-1} + \omega_t$6. Options include parametric forms (e.g., log, sqrt, identity) or a nonparametric construction via the empirical CDF of $x_t = G_t\, x_{t-1} + \omega_t$7:

$x_t = G_t\, x_{t-1} + \omega_t$8

with smooth interpolation to ensure monotonicity.

1. Rounding $x_t = G_t\, x_{t-1} + \omega_t$9: A discrete operator $\omega_t \sim N_p(0, W_t)$0, typically the component-wise floor with a zero-modification:
   • $\omega_t \sim N_p(0, W_t)$1 if $\omega_t \sim N_p(0, W_t)$2,
   • $\omega_t \sim N_p(0, W_t)$3 otherwise.

The observed count is then:

$\omega_t \sim N_p(0, W_t)$4

The design admits exact count support, easily accommodating zero-inflation, upper bounds, and various marginal distributions.

3. Conjugate Analytic Inference via Selection-Normal Family

Conditioning on a count $\omega_t \sim N_p(0, W_t)$5 is equivalent to conditioning on a truncation event in latent space: $\omega_t \sim N_p(0, W_t)$6. Under this construction, all marginal and joint posteriors over latent states, such as $\omega_t \sim N_p(0, W_t)$7 and $\omega_t \sim N_p(0, W_t)$8, fall within the Selection-Normal (SLCT-N) family:

$\omega_t \sim N_p(0, W_t)$9

The SLCT-N density is proportional to

$z_t = F_t^\top x_t + \nu_t$0

where $z_t = F_t^\top x_t + \nu_t$1 is the $z_t = F_t^\top x_t + \nu_t$2-dimensional normal density and $z_t = F_t^\top x_t + \nu_t$3 is the truncated cumulative normal. The filtering and smoothing recursions for state prediction, filtering update, and joint smoothing maintain SLCT-N conjugacy with closed-form parameter updates.

4. Batch and Online Computational Algorithms

Algorithmic inference in WLP leverages the SLCT-N structure for both batch (offline) and online (streaming) settings:

• Direct Monte Carlo (MC) Sampling: For batch analysis, draws are generated from SLCT-N by:
  1. Sampling $z_t = F_t^\top x_t + \nu_t$4, truncated to $z_t = F_t^\top x_t + \nu_t$5,
  2. Sampling $z_t = F_t^\top x_t + \nu_t$6,
  3. Setting $z_t = F_t^\top x_t + \nu_t$7, which yields exact draws from the desired selection-normal distribution.

• Optimal Particle Filter: For online inference, at each time $z_t = F_t^\top x_t + \nu_t$8 and for each particle $z_t = F_t^\top x_t + \nu_t$9, a new particle is drawn from

$\nu_t \sim N_n(0, V_t)$0

with weights proportional to $\nu_t \sim N_n(0, V_t)$1. This choice of proposal minimizes weight variance, enhancing online filter efficiency.

5. Forecasting and Predictive Distribution

WLP supports both analytic and simulation-based forecasting for count time series:

• Analytic One-Step Forecast: The one-step predictive likelihood is given by the ratio of model marginal probabilities:

$\nu_t \sim N_n(0, V_t)$2

where parameters come from joint smoothing up to $\nu_t \sim N_n(0, V_t)$3. This is evaluated over a local grid of $\nu_t \sim N_n(0, V_t)$4 values.

• Simulation-Based Forecast: Posterior samples $\nu_t \sim N_n(0, V_t)$5 are propagated forward:
  1. $\nu_t \sim N_n(0, V_t)$6,
  2. $\nu_t \sim N_n(0, V_t)$7,
  3. $\nu_t \sim N_n(0, V_t)$8, constructing an empirical forecast distribution.

6. Strengths and Practical Limitations

WLP offers several key advantages:

• Data Coherency: $\nu_t \sim N_n(0, V_t)$9 has exact count support, with direct handling of zero-inflation, discrete bounds, and heaping.
• Flexible Marginals: The transformation $x_0 \sim N_p(a_0, R_0)$0 can be nonparametric, supporting semiparametric modeling.
• Analytic Recursions: Selection-Normal conjugacy allows closed-form updating for filtering, smoothing, and likelihood.
• Multivariate and Missing Data Handling: Direct support for multivariate counts ($x_0 \sim N_p(a_0, R_0)$1), missingness, and mixed-frequency data.
• Computation: Algorithms are suitable for both offline (MC, batch Gibbs) and online (optimal particle filter) settings with minimal reliance on traditional MCMC.

Limitations include:

• High-Dimensionality: Sampling from large-dimensional truncated normals may become a computational bottleneck.
• Growing Filter Dimension: Naive filtering leads to latent block dimension growth as $x_0 \sim N_p(a_0, R_0)$2 increases, requiring attention to algorithm scalability (e.g., marginal or particle implementations).
• Transformation Estimation: Nonparametric $x_0 \sim N_p(a_0, R_0)$3 requires (possibly repeated) estimation—especially challenging in streaming contexts.
• Variance Estimation: Covariances $x_0 \sim N_p(a_0, R_0)$4, $x_0 \sim N_p(a_0, R_0)$5 are typically estimated via marginal likelihood maximization or modeled as hyperpriors, adding a layer of inference.

In sum, Warped Linear Prediction applies a semiparametric warping to the Gaussian DLM, yielding a coherent, conjugate, and flexible framework for count time series modeling that preserves the structural and computational benefits of Kalman-type models while ensuring respect for the discreteness of observed data (King et al., 2021).