Papers
Topics
Authors
Recent
Search
2000 character limit reached

DPComb: Count Modeling & p-value Adjustment

Updated 7 July 2026
  • DPComb is a label for two unrelated methodologies: one for Bayesian adaptive COM-Poisson regression to model count data and one for optimal discrete p-value combination in multiple testing.
  • In count-data modeling, DPComb employs a Dirichlet process mixture of COM-Poisson regressions to flexibly capture conditional distributions and extract noncrossing quantiles without relying on jittering.
  • For discrete p-value combination, DPComb uses an optimal-transport framework to adjust independent p-values under classical additive rules, ensuring accurate Type I error calibration.

DPComb is used in the cited literature for two distinct statistical constructions. In Bayesian count-data modeling, it denotes a Dirichlet process-based COM-Poisson density regression approach for estimating conditional distributions and deriving noncrossing conditional quantiles without jittering (Chanialidis et al., 2014). In multiple-testing methodology, it denotes an optimal-transport framework, and an R package of the same name, for adjusting and combining independent discrete pp-values under classical additive combination rules such as Fisher, Pearson, George, Stouffer, and Edgington (Contador et al., 4 Aug 2025). A separate diffusion-model paper explicitly notes that divide-and-conquer posterior sampling is canonically named DCPS rather than DPComb, even if the latter is used informally as an alias (Janati et al., 2024).

1. Terminological scope and disambiguation

The shared label covers unrelated methodological objects in count-data Bayesian nonparametrics and in discrete pp-value combination. The overlap is nominal rather than conceptual.

Source Meaning of DPComb Domain
(Chanialidis et al., 2014) Adaptive DP mixture of COM-Poisson regressions for density regression and count quantiles Bayesian count-data modeling
(Contador et al., 4 Aug 2025) Optimal adjustment and combination of independent discrete pp-values; also the R package DPComb Multiple testing and meta-analysis
(Janati et al., 2024) Not the canonical name; the diffusion method is called DCPS Bayesian inverse problems with diffusion priors

This naming collision matters because the two principal usages solve different problems. The count-data DPComb models an entire conditional pmf f(yx)f(y \mid x) and obtains quantiles by cdf inversion. The discrete-testing DPComb starts from already computed discrete pp-values and adjusts transformed test statistics so that classical global null calibrations remain accurate despite discreteness. A plausible implication is that database and software searches for “DPComb” require domain-specific disambiguation.

2. DPComb as Bayesian density regression for count data

In the count-data setting, DPComb was proposed to address the fact that for YN0Y \in \mathbb{N}_0 the conditional cdf F(yx)F(y \mid x) is a step function and the conditional quantile

Qτ(x)=inf{yN0:F(yx)τ}Q_\tau(x) = \inf\{y \in \mathbb{N}_0 : F(y \mid x) \ge \tau\}

is piecewise-constant and not a continuous function of the model parameters (Chanialidis et al., 2014). The paper identifies three difficulties in direct count quantile regression: discreteness, instability induced by the discontinuity of the quantile map in the parameters, and the limitations of jittering, where UUnif[0,1)U \sim \mathrm{Unif}[0,1) is added to form Z=Y+UZ = Y + U. For small counts, especially pp0 or pp1, the added noise can dominate the estimated quantiles, and fitting each pp2 separately can produce crossing quantiles.

The proposed solution is density regression with an adaptive DP mixture of COM-Poisson regressions. The COM-Poisson pmf is written as

pp3

with pp4 reducing to Poisson, pp5 corresponding to under-dispersion, and pp6 to over-dispersion. The centered reparameterization pp7 yields

pp8

Under the approximation reported in the paper,

pp9

and pp0 is the mode. This reparameterization improves interpretability relative to pp1 when pp2.

Regression enters through log links for both centering and dispersion:

pp3

Hence, under the same approximation,

pp4

The hierarchical structure places a Dirichlet process prior on component-specific regression parameters pp5, so that

pp6

with a convenient base measure given as pp7. The paper further uses a predictor-dependent construction following Dunson, Pillai, and Park (2007), with kernel-based proximity weights between observed predictors. The resulting conditional pmf at a fixed pp8 is

pp9

which allows flexible, covariate-dependent multimodality and dispersion patterns. The paper states that mixtures of COM-Poisson components can approximate any discrete distribution on f(yx)f(y \mid x)0 arbitrarily well.

3. Inference, quantile extraction, and behavior of the count-data method

Quantiles in the count-data DPComb are not modeled directly; they are extracted from the fitted cdf (Chanialidis et al., 2014). For each component,

f(yx)f(y \mid x)1

and the mixture cdf is

f(yx)f(y \mid x)2

The conditional f(yx)f(y \mid x)3-quantile is then

f(yx)f(y \mid x)4

Because f(yx)f(y \mid x)5 is monotone nondecreasing in f(yx)f(y \mid x)6, the map f(yx)f(y \mid x)7 is nondecreasing for each fixed f(yx)f(y \mid x)8, so crossing quantiles are prevented by construction.

A central computational issue is that the COM-Poisson likelihood is doubly intractable because of the normalizing constant f(yx)f(y \mid x)9. The paper therefore combines three ingredients: Neal’s MCMC for nonconjugate DP mixtures, adaptive predictor-dependent mixture ideas of Dunson et al. (2007), and the exchange algorithm. For a generic move pp0 with proposal pp1 and auxiliary draw pp2, the acceptance ratio is

pp3

so the normalizing constants cancel. For COM-Poisson with pp4, the unnormalized kernel is

pp5

The allocation step uses predictor-dependent prior weights

pp6

where pp7 may be chosen as a Gaussian kernel. Auxiliary samples from COM-Poisson are obtained by rejection sampling, and posterior predictive evaluation of pp8 uses truncated series, asymptotics or bounds, and log-scale numerical stabilization.

The paper’s practical guidance includes weakly informative Gaussian priors for pp9 and YN0Y \in \mathbb{N}_00, a Gamma prior for the concentration parameter, initialization from Poisson regression, and posterior checks based on trace plots, deviance, observed versus predicted histograms, and empirical versus fitted quantiles. Per sweep computational cost is reported as YN0Y \in \mathbb{N}_01 for allocation updates plus the cost of exchange steps. The paper also notes extensions such as zero-inflated COM-Poisson mixtures, alternative links for YN0Y \in \mathbb{N}_02, alternative predictor-dependent DPs, and alternative count kernels.

Empirically, the paper summarizes two simulation designs with YN0Y \in \mathbb{N}_03: a binomial regression model YN0Y \in \mathbb{N}_04 and a heterogeneous mixture YN0Y \in \mathbb{N}_05. Using mean absolute error of estimated conditional quantiles averaged across YN0Y \in \mathbb{N}_06 and YN0Y \in \mathbb{N}_07, the discrete Bayesian density regression outperforms jittering, and jittering frequently produces crossing quantiles except, in that study, when YN0Y \in \mathbb{N}_08. On housebreakings versus deprivation in Greater Glasgow, the method is reported to capture overdispersion and skewness that standard Poisson regression misses, with estimated YN0Y \in \mathbb{N}_09, F(yx)F(y \mid x)0, and F(yx)F(y \mid x)1 quantiles that better reflect the empirical distribution of counts.

4. DPComb as optimal adjustment and combination of independent discrete F(yx)F(y \mid x)2-values

In the multiple-testing setting, DPComb addresses the problem of combining independent discrete F(yx)F(y \mid x)3-values F(yx)F(y \mid x)4 under the global null

F(yx)F(y \mid x)5

when classical continuous calibrations become conservative or miscalibrated because the null support is a grid with jumps (Contador et al., 4 Aug 2025). The framework assumes that each discrete F(yx)F(y \mid x)6-value satisfies

F(yx)F(y \mid x)7

with cdf F(yx)F(y \mid x)8 for F(yx)F(y \mid x)9. It considers additive combination statistics of the form

Qτ(x)=inf{yN0:F(yx)τ}Q_\tau(x) = \inf\{y \in \mathbb{N}_0 : F(y \mid x) \ge \tau\}0

where Qτ(x)=inf{yN0:F(yx)τ}Q_\tau(x) = \inf\{y \in \mathbb{N}_0 : F(y \mid x) \ge \tau\}1 is a strictly increasing continuous cdf with finite first two moments.

The method replaces the discrete transformed component Qτ(x)=inf{yN0:F(yx)τ}Q_\tau(x) = \inf\{y \in \mathbb{N}_0 : F(y \mid x) \ge \tau\}2 or Qτ(x)=inf{yN0:F(yx)τ}Q_\tau(x) = \inf\{y \in \mathbb{N}_0 : F(y \mid x) \ge \tau\}3 by a surrogate Qτ(x)=inf{yN0:F(yx)τ}Q_\tau(x) = \inf\{y \in \mathbb{N}_0 : F(y \mid x) \ge \tau\}4 that is closest in Qτ(x)=inf{yN0:F(yx)τ}Q_\tau(x) = \inf\{y \in \mathbb{N}_0 : F(y \mid x) \ge \tau\}5 to the continuous ideal Qτ(x)=inf{yN0:F(yx)τ}Q_\tau(x) = \inf\{y \in \mathbb{N}_0 : F(y \mid x) \ge \tau\}6, Qτ(x)=inf{yN0:F(yx)τ}Q_\tau(x) = \inf\{y \in \mathbb{N}_0 : F(y \mid x) \ge \tau\}7. Theorem 1 in the paper states that on the event Qτ(x)=inf{yN0:F(yx)τ}Q_\tau(x) = \inf\{y \in \mathbb{N}_0 : F(y \mid x) \ge \tau\}8 the Qτ(x)=inf{yN0:F(yx)τ}Q_\tau(x) = \inf\{y \in \mathbb{N}_0 : F(y \mid x) \ge \tau\}9-optimal modification is the conditional mean on the corresponding interval:

UUnif[0,1)U \sim \mathrm{Unif}[0,1)0

for the UUnif[0,1)U \sim \mathrm{Unif}[0,1)1 form, and

UUnif[0,1)U \sim \mathrm{Unif}[0,1)2

for the UUnif[0,1)U \sim \mathrm{Unif}[0,1)3 form. The adjusted global statistic is

UUnif[0,1)U \sim \mathrm{Unif}[0,1)4

For the five classical combiners treated in the paper, the continuous statistics and surrogate calibrations are as follows.

Method Continuous statistic Surrogate calibration
Fisher UUnif[0,1)U \sim \mathrm{Unif}[0,1)5 UUnif[0,1)U \sim \mathrm{Unif}[0,1)6
Pearson UUnif[0,1)U \sim \mathrm{Unif}[0,1)7 UUnif[0,1)U \sim \mathrm{Unif}[0,1)8
George UUnif[0,1)U \sim \mathrm{Unif}[0,1)9 Z=Y+UZ = Y + U0
Stouffer Z=Y+UZ = Y + U1 Z=Y+UZ = Y + U2
Edgington Z=Y+UZ = Y + U3 Z=Y+UZ = Y + U4

The paper gives explicit adjusted values for each interval Z=Y+UZ = Y + U5. Writing Z=Y+UZ = Y + U6 and Z=Y+UZ = Y + U7, the formulas are

Z=Y+UZ = Y + U8

Z=Y+UZ = Y + U9

pp00

pp01

and

pp02

The framework therefore gives a unified discrete adjustment for Fisher, Pearson, George, Stouffer, and Edgington without adding randomness.

5. Variance matching, asymptotics, and reported empirical behavior

A key result for the discrete-pp03-value DPComb is the variance decomposition

pp04

reported as Lemma 1 (Contador et al., 4 Aug 2025). This explains why direct calibration by the continuous null is conservative: the adjusted discrete statistic pp05 preserves the mean of the continuous ideal pp06 but has smaller variance. DPComb therefore matches both mean and variance through a surrogate family. For Fisher and Pearson this is a Gamma family containing the usual pp07 null as a special case; for Stouffer the Normal family remains exact under continuity; for George and Edgington the sums are approximated by Normal laws.

The paper reports closed-form expressions for the per-component variances pp08:

pp09

pp10

pp11

pp12

and

pp13

with pp14. Lemmas 2 and 3 state asymptotic Type I validity in the i.i.d. and independent non-identical cases, respectively:

pp15

Finite-sample accuracy is linked to the scaled Wasserstein distance pp16 and the variance ratio pp17, and Lemma 4 gives the upper bound

pp18

The paper’s simulations evaluate four stylized null cdfs: PL, PR, PC, and PS. The reported findings are that Fisher performs best when mass is concentrated at the right tail (PR) and worst when mass is concentrated at the left tail (PL), Pearson behaves oppositely, all methods are similar and well-calibrated when mass is central (PC), and normal-based surrogates have advantages when mass is at both ends (PS). Empirical Type I error at pp19 or pp20 converges to nominal for all methods as pp21 increases.

Two benchmark power studies connect DPComb to uniformly most powerful behavior when the likelihood ratio test is monotone in a classical combiner. In the geometric example, Fisher is UMP for the right-sided alternative and Pearson is UMP for the left-sided alternative; the paper reports that DPComb’s Fisher and Pearson procedures match the UMP LRT power curves, with small discrepancies attributable to discrete conservativeness when exact pp22-quantiles are unattainable. In the circular example, the LRT is monotone in pp23, so Edgington is UMP; the adjusted Edgington procedure exhibits the highest power in simulations. A rare-variant case-control study with 2000 subjects and 15 SNPs shows Gene 1 significant for right-sided and two-sided alternatives across multiple combiners, Gene 2 significant for the right-sided alternative only, and Edgington yielding the smallest gene-level pp24-value among the five methods.

6. Software implementation, practical use, and the DCPS naming issue

The R package DPComb implements the discrete-pp25-value methodology end to end (Contador et al., 4 Aug 2025). The paper states that it computes the pp26-optimal adjusted statistics for Fisher, Pearson, George, Stouffer, and Edgington; constructs matched surrogates; and returns global pp27-values. It supports left-, right-, and two-sided pp28-values, provides utilities to compute the null pp29-value distribution for binomial, Poisson, negative binomial, (noncentral) hypergeometric, and geometric models as well as user-specified discrete cdfs, and reports pp30, pp31, and Wald-type diagnostics for method selection. The reported computational profile is pp32 precomputation for pp33 distinct support points, followed by pp34 conversion of observed pp35 to pp36 and pp37 calibration by Gamma or Normal quantiles. The paper recommends the method when pp38-values are discrete, independent, and small-pp39 calibration matters, and it cautions that the theory assumes independence.

The count-data DPComb has a different practical niche. It is designed for conditional count distributions with complex covariate effects, over- or under-dispersion, and the need for noncrossing conditional quantiles. Its main limitations, as stated in the paper, are computational cost from exchange steps, potentially slow mixing for high-dimensional pp40, and sensitivity to the kernel choice and bandwidth pp41.

The diffusion-model paper “Divide-and-Conquer Posterior Sampling for Denoising Diffusion Priors” explicitly states that the method introduced there is called DCPS, not DPComb (Janati et al., 2024). It further notes that if a query uses “DPComb” for this divide-and-conquer posterior sampling approach, that should be understood only as an alias, with DCPS remaining the canonical name. This suggests that the statistically established meanings of DPComb are the count-data density-regression method and the discrete-pp42-value combination method, whereas diffusion-based posterior sampling belongs under the separate heading DCPS.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (3)

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to DPComb.