Mixed-Effects Hurdle Model

• Mixed-effects hurdle models are statistical frameworks that split the analysis into a binary zero-part and a positive-part for count/continuous data, accommodating excess zeros.
• They integrate logistic regression for structural zeros and zero-truncated distributions for positive outcomes, while incorporating random effects to capture hierarchical variability.
• Applications span medical statistics, health economics, and industrial quality control, providing robust inference and dynamic predictions in complex, zero-inflated settings.

A mixed-effects hurdle model is a statistical framework combining hurdle model architecture for zero-inflated (semi-continuous or count) data with random-effects structure to capture dependence among subjects or clusters. Mixed-effects hurdle models are widely used for longitudinal and hierarchical data in medical statistics, health economics, infectious disease epidemiology, industrial quality control, and many other fields where the outcome variable exhibits both a substantial proportion of zeros and inter-unit heterogeneity. This article delineates the theory, formulation, and practical implications of mixed-effects hurdle models as represented in the arXiv literature.

1. Structural Overview and Mathematical Formulation

The canonical mixed-effects hurdle model divides the modeling task into two distinct components:

A. Zero-Part (Hurdle Component):

The zero-generation process is typically modeled using a Bernoulli or binary logistic/probit regression. For individual $i$ measured at time $s$ (or observation $j$), an indicator variable $d_{is}$ is defined: $$d_{is} = \begin{cases} 1,& \text{if the outcome is zero (structural zero)}\ 0,& \text{if the outcome is positive} \end{cases}$$ The probability $\pi_{is}$ of a structural zero is modeled: $\logit(\pi_{is}) = \mathbf{x}_{2,is}^\top \beta_2 + \mathbf{z}_{2,is}^\top b_i$ where $\mathbf{x}_{2,is}$ are fixed-effects covariates, $\beta_2$ are regression coefficients, and $\mathbf{z}_{2,is}^\top b_i$ denotes the random effects (e.g., subject-specific intercepts and/or slopes), enabling inter-individual variability.

B. Positive-Part (Count/Continuous Component):

Conditional on a positive outcome, the observed value is modeled using a zero-truncated distribution $f_\mathrm{ZT}(y|\lambda_{is})$: $$\log(\lambda_{is}) = \mathbf{x}_{1,is}^\top \beta_1 + \mathbf{z}_{1,is}^\top u_i$$ For count data, $f_\mathrm{ZT}$ may be a zero-truncated Poisson, negative binomial, or distributions that accommodate overdispersion (e.g., Conway-Maxwell-Poisson with parameter $\nu$ (Yin et al., 2020)). For cost data, gamma or log-normal models may be used with structural zeros handled via "degenerate" parameter specification (Baio, 2013).

The complete probability mass/density for $Y_{is}$ is: $$P(Y_{is}=y) = \begin{cases} \pi_{is}, & y=0 \ (1-\pi_{is})\, f_\mathrm{ZT}(y|\lambda_{is}), & y > 0 \end{cases}$$

The utility of the mixed-effects structure is that both $\pi_{is}$ and $\lambda_{is}$ can include random effects, allowing for subject-specific variation in both the likelihood of zeros and the mean/count of positive outcomes (Baghfalaki et al., 26 Aug 2025, Crowther, 2017).

2. Specification of Random Effects

Mixed-effects in the hurdle model framework address hierarchical or correlated data typical in longitudinal and clustered settings. The random-effects vectors $b_i$ and $u_i$ are typically modeled as multivariate normal, though more flexible distributions (e.g., multivariate t) are supported in modern frameworks (Crowther, 2017). The modeling system can accommodate random intercepts and slopes, cross-level interaction effects, and level-specific effects for complex hierarchies.

Modeling strategies may include:

• Linking random effects between the zero-part and positive-part, allowing dependence between the processes governing structural zeros and positive outcomes (e.g., shared random intercepts).
• Including time-dependent and nonlinear effects via splines or fractional polynomials in the linear predictor (Crowther, 2017).
• Multivariate and joint modeling with survival data or multiple outcomes, enabling flexible sharing and propagation of random effects or expected values among submodels (Baghfalaki et al., 26 Aug 2025, Crowther, 2017).

3. Extensions: Distributional Choices and Computational Methods

Mixed-effects hurdle models are highly extensible:

• Distributional flexibility: For count data, zero-truncated Poisson, negative binomial, or further generalizations (Conway-Maxwell-Poisson, shifted negative binomial) are available to handle overdispersion and skewness (Yin et al., 2020, Franzolini et al., 2022). For continuous or cost data, gamma or log-normal models are commonly employed (Baio, 2013, Linero et al., 2018).
• Flexible link functions: Particularly for highly imbalanced zeros, skewed link functions such as the Weibull link provide improved modeling of the binary part compared to canonical logit/probit links (Yin et al., 2020).
• Bayesian estimation: Bayesian frameworks are preferred for incorporating prior information, propagating parameter uncertainty, and facilitating full posterior inference for all parameters and latent variables. Advanced MCMC (e.g., Hamiltonian Monte Carlo, exchange algorithms for intractable normalizing constants) and variational techniques are deployed for computational feasibility (Baghfalaki et al., 26 Aug 2025, Yin et al., 2020).
• Joint and dynamic modeling: In survival analysis, mixed-effects hurdle models can be joined with Cox models incorporating cure fractions and using longitudinal biomarker trajectories as time-dependent covariates in the hazard function (Baghfalaki et al., 26 Aug 2025).

4. Applications and Case Studies

Health Economics and Medical Trials

Bayesian hurdle models have been developed for cost-effectiveness analyses where structural zeros often occur in cost variables, and skewed distributions are typical (Baio, 2013). A working example from an acupuncture trial shows that such models accurately represent the mixture of zero and positive costs and allow joint modeling of cost-effectiveness with uncertainty propagation.

Longitudinal and Joint Models in Clinical Research

In HIV/AIDS data, mixed-effects hurdle models allow dynamic prediction and real-time risk assessment by connecting longitudinal zero-inflated biomarker measurements with time-to-event outcomes, with additional cure fractions in the survival submodel (Baghfalaki et al., 26 Aug 2025).

Spatio-temporal Infectious Disease Surveillance

Markov-switching mixed-effects hurdle models partition the spatio-temporal process into latent presence/absence states and observed zero-truncated counts, with transition probabilities regression-linked to covariates and neighboring areas (Xu et al., 2023). This enables modeling of both disease persistence and reemergence as distinct phenomena and supports forecasting in high-resolution epidemiological datasets.

Industrial and Manufacturing Data

Low-rank and PCA-like hurdle models perform dimension reduction and missing value imputation in zero-inflated count matrices from manufacturing defect logs (Dienes, 2017). Unlike classical mixed-effects models, these are designed for latent structure extraction and imputation, not hierarchical parameter inference.

Bayesian Clustering of Multivariate Processes

Mixture models leveraging hurdle structure and shifted negative binomial distributions achieve hierarchical clustering of subjects both by zero/nonzero patterns and by magnitude among nonzeros, using enriched finite mixture priors and tailored MCMC estimation (Franzolini et al., 2022).

5. Comparison to Alternative Models and Contemporary Issues

Mixed-effects hurdle models contrast with several alternatives:

• Zero-inflated models: Zero-inflated models mix a count distribution (which can generate zeros) with a separate point mass at zero. Hurdle models, by contrast, only allow zeros in the binary component, and model positive values with a zero-truncated distribution. Choice between models depends on problem-specific assumptions about zero-generation (structural absence vs. undetected presence) (Xu et al., 2023).
• Adding constants to zeros: Pre-processing strategies that shift zeros by small constants can impart bias and sensitivity. Hurdle models directly address the occurrence of excess zeros without arbitrary data adjustment (Baio, 2013).
• Low-rank/composite loss frameworks: When the modeling goal is dimension reduction (rather than inference on hierarchical parameters), low-rank hurdle models provide a different approach, integrating binary (zero-probability) and positive outcome modeling via composite loss functions (Dienes, 2017).
• Semiparametric and nonparametric expansions: Shared forests and Bayesian tree models allow component-wise sharing of basis functions for high-dimensional variable selection and advanced nonparametric regression (Linero et al., 2018).

6. Inference, Prediction, and Implementation

Estimation and prediction in mixed-effects hurdle models are performed via:

• Bayesian MCMC or HMC for parameters and latent variables, with exchange algorithms specifically for models involving intractable normalizing constants (Yin et al., 2020, Baghfalaki et al., 26 Aug 2025).
• Numerical integration and adaptive quadrature for model likelihoods with complex random-effects structures or non-standard distributions (Crowther, 2017).
• Software implementations: Dedicated packages (e.g., megenreg for Stata and R (Crowther, 2017), bespoke Bayesian modeling code) enable specification of complex linear predictors, flexible random-effects structures, and multivariate joint outcome models.

Predictions from these models support both static inference (e.g., estimands of average treatment effect, clustering structure) and dynamic updating for personalized prognosis, as in real-time clinical settings.

7. Theoretical and Practical Implications

Mixed-effects hurdle models resolve the challenge of modeling data with excess zeros and hierarchical/homogeneous structure. Their partitioned architecture, flexible modeling extensions, and capacity to propagate uncertainty through hierarchical levels render them robust for a wide array of modern applications. Bayesian frameworks provide strong support for sensitivity analyses and decision modeling. The choice between hurdle and alternative models should be based on substantive domain knowledge about the mechanism generating zeros, detection probabilities, and the type of inter-individual variability encountered.

Their widespread adoption in fields ranging from health economics to infectious disease modeling and industrial engineering attests to their efficacy, flexibility, and interpretability in modern data science.

---

Key Literature Referenced: (Baio, 2013, Franzolini et al., 2022, Xu et al., 2023, Baghfalaki et al., 26 Aug 2025, Crowther, 2017, Dienes, 2017, Linero et al., 2018, Yin et al., 2020).