- This paper presents a new hierarchical copula-based framework for multivariate zero-inflated mixed Poisson models, enhancing flexibility, scalability, and separability of dependence layers (for 10 - 34000 + demonstrations).
- For empirically provided examples: MEPS datasets in the healthcare sector, terror-related data in actuarial settings, and scRNA data in genomics, the framework's method outshines traditional methods, offering superior log-likelihood results and computational efficiency, making it valuable across insurance, healthcare, and genomics fields.
- The framework utilizes standard parametric copulas for structural-zero indicators and checkerboard copulas for latent-intensity variables, supports both IFM estimation and full maximum likelihood.
Motivation and contribution
Multivariate count data in insurance, healthcare, and genomics frequently exhibit overdispersion, excess zeros, and dependence among the response components simultaneously. Existing multivariate zero-inflated count models typically introduce dependence through a single mechanism—a copula, shared random effect, or latent factor—applied jointly to structural zeros and count outcomes. This conflates two substantively distinct sources of dependence: correlation in whether units enter the count-generating process at all, and correlation in latent intensities among those that do. In actuarial settings these sources carry different implications for risk classification, portfolio segmentation, and premium calculation. A second obstacle is computational: copula models for discrete responses require evaluating high-dimensional rectangle probabilities, which becomes expensive or infeasible as dimension grows.
This paper proposes a hierarchical framework that separates the two dependence layers explicitly while retaining a unified likelihood-based formulation (2608.12732). The framework accommodates a broad class of mixed Poisson marginals (Gamma, Lognormal, Pareto, Weibull, Inverse Gaussian), uses standard parametric copulas for the structural-zero indicators and checkerboard copulas for the latent-intensity variables, and supports both inference-functions-for-margins (IFM) estimation and full maximum likelihood when feasible.
Model structure
For each margin j=1,…,k, an observation is generated through three layers: a Bernoulli indicator Bj​ determining membership in the structural-zero state, a latent intensity Λj​ drawn from a positive continuous mixing distribution Fj​(μj​,ϕj​) with mean μj​ and variance function ϕj​V(μj​), and a conditional Poisson layer with Yj​=Bj​Nj​, where Nj​∣Λj​∼Poisson(Λj​). Regression structures are specified via logistic links for the zero-state probabilities πij​ and log links for the conditional means μij​. The indicators Bj​0 and intensities Bj​1 are assumed mutually independent; dependence within each layer is induced by separate copulas.
The key methodological device concerns the latent-intensity layer. The exact joint probability mass function of the latent counts involves a Bj​2-dimensional integral of the product of Poisson kernels against an arbitrary copula density—tractable only at prohibitive cost. Replacing the copula density by a checkerboard copula (piecewise constant on an equal-width partition of the unit cube with resolution Bj​3) converts this integral into a finite weighted sum: the joint pmf becomes Bj​4, where the cell probabilities Bj​5 depend only on the marginal mixing distributions and are computable by one-dimensional integration or closed form.
Gaussian factor construction for scalability
Direct checkerboard weight computation requires evaluating Bj​6 cell probabilities, which is impractical beyond small Bj​7. The paper parameterizes the checkerboard weights through a Bj​8-factor Gaussian copula, reducing dependence parameters from Bj​9 to Λj​0. Under this representation, the joint pmf of either the latent counts alone or the full zero-inflated response vector reduces to a Λj​1-dimensional Gaussian integral over the factor vectors of the two dependence layers, evaluated by Gauss–Hermite quadrature. Crucially, quadrature dimension depends on the number of factors rather than the number of responses Λj​2.
Estimation proceeds by IFM: marginals are estimated first per margin, then checkerboard cell probabilities are fixed and dependence parameters optimized in a second stage. Closed-form marginal probabilities exist for Gamma (via negative binomial) and Inverse Gaussian (via half-integer Bessel expansions); the remaining mixtures use Gauss–Hermite, Gauss–Legendre, or Gauss–Laguerre quadrature. The appendixes provide semi-analytical score functions throughout.
Simulation results
Three experiment blocks support the methodology. First, with Λj​3 per scenario, the correctly specified mixing distribution achieved the highest log-likelihood in every scenario across five candidate mixtures, under both mixed Poisson and zero-inflated specifications and two heterogeneity levels (Λj​4 and Λj​5). Regression coefficients were recovered accurately (e.g., true Λj​6 estimated within roughly 0.05 across mixtures). One notable exception: under Pareto mixing with higher heterogeneity, the dispersion estimate was substantially biased (Λj​7 versus true 1.500), which the authors attribute to weak identifiability of the Lomax shape rather than estimation failure—an assumption stated but not formally established.
Second, bivariate copula recovery experiments spanning Gaussian, Student-Λj​8, Clayton, Gumbel, Frank, and rotated families at Λj​9 showed correct identification in nearly all cases, with dependence parameters closely recovered. Under zero inflation, recovery remained accurate except that Gumbel-generated data were occasionally better fit by the survival Clayton copula, with negligible log-likelihood differences—the authors acknowledge these two families produce near-equivalent dependence here. Third, Gaussian factor loadings were recovered accurately for Fj​(μj​,ϕj​)0 margins under both one-factor and two-factor structures.
Four applications benchmark the framework against established software:
- MEPS (bivariate healthcare utilization): fit comparable to GJRM despite dependence modeled through latent intensities rather than observed responses; the Gamma–Lognormal marginal combination outperformed homogeneous specifications, and the survival Gumbel copula was selected.
- Terror data: the proposed model achieved a higher log-likelihood than bizicount (Fj​(μj​,ϕj​)1 vs.\ Fj​(μj​,ϕj​)2) while separating countermonotone structural-zero dependence from weakly positive latent-intensity dependence—an interpretable decomposition unavailable under single-copula alternatives.
- VHLSS (>34,000 observations): the best specification (IG/LN margins, survival Clayton checkerboard) improved log-likelihood from Fj​(μj​,ϕj​)3 (bizicount Frank) to Fj​(μj​,ϕj​)4, and complete model selection took minutes versus several hours for bizicount. This computational advantage follows directly from replacing discrete rectangle probabilities with continuous copula densities plus univariate mixed-Poisson likelihoods.
- scRNA data (Fj​(μj​,ϕj​)5 and Fj​(μj​,ϕj​)6): the proposed framework dominated PLNmodels on AIC and BIC. At Fj​(μj​,ϕj​)7, the optimal specification used 450 dependence parameters under three factors versus 1,525 in PLN's unrestricted covariance matrix. For ten highly zero-inflated genes, modeling both dependence layers jointly yielded the best fit (log-likelihood Fj​(μj​,ϕj​)8).
A caveat applies to the scRNA comparison: because PLNmodels optimizes an evidence lower bound rather than the observed-data log-likelihood, cross-method log-likelihood comparisons are not strictly like-for-like; the information criteria comparisons partially mitigate this but inherit the same caveat.
Limitations and open questions
Several restrictions bound the applicability of the results. The mutual independence assumption between Fj​(μj​,ϕj​)9 and μj​0 enables interpretability but precludes models in which zero-propensity and intensity correlate—for example, individuals systematically less likely to claim who would also claim less often if they did. The framework's efficiency rests on equally spaced checkerboard partitions; more general partitions are acknowledged possible but undeveloped. Only the Gaussian factor copula is implemented for weight construction, although the likelihood formulation admits arbitrary factor copulas whose conditional probabilities can be evaluated. Quadrature cost grows with the number of latent factors, so very high dimensions with complex dependence remain challenging. Finally, identifiability of the Pareto dispersion parameter under strong heterogeneity is empirically weak, and no theoretical identifiability analysis of the checkerboard weights themselves is provided.
Conclusion
The paper delivers a modular, likelihood-based framework in which excess zeros, overdispersion, and multivariate dependence are addressed by separately specified components: flexible mixing distributions for marginals, parametric copulas for structural-zero dependence, and checkerboard copulas—factor-parameterized for scalability—for latent-intensity dependence. Simulations demonstrate consistent recovery of mixing distributions, regression parameters, copula families, and factor loadings; applications show competitive or superior fit relative to GJRM, bizicount, and PLNmodels with substantial computational savings in large datasets. The principal open questions concern relaxing the independence assumption between the two latent layers, developing non-Gaussian or semiparametric factor constructions within the same likelihood machinery, and establishing formal identifiability conditions for the checkerboard representation.