Sub-uniformity of harmonic mean p-values (2405.01368v2)
Abstract: We obtain several inequalities on the generalized means of dependent p-values. In particular, the weighted harmonic mean of p-values is strictly sub-uniform under several dependence assumptions of p-values, including independence, negative upper orthant dependence, the class of extremal mixture copulas, and some Clayton copulas. Sub-uniformity of the harmonic mean of p-values has an important implication in multiple hypothesis testing: It is statistically invalid (anti-conservative) to merge p-values using the harmonic mean unless a proper threshold or multiplier adjustment is used, and this applies across all significance levels. The required multiplier adjustment on the harmonic mean p-value grows sub-linearly to infinity as the number of p-values increases, and hence there does not exist a constant multiplier that works for any number of p-values, even under independence.
- The p-filter: Multilayer false discovery rate control for grouped hypotheses. Journal of the Royal Statistical Society Series B (Statistical Methodology), 79(4), 1247–1268.
- Annals of Statistics, 51(1), 149–178.
- Some concepts of negative dependence. Annals of Probability, 10(3), 765–772.
- A concept of negative dependence using stochastic ordering. Statistics and Probability Letters, 3(2), 81–86.
- On Benjamini–Hochberg procedure applied to mid p-values. Journal of Statistical Planning and Inference, 205, 34–45.
- Multiple testing under negative dependence. arXiv: 2212.09706.
- Dubey, S. D. (1970). Compound Gamma, Beta and F distributions. Metrika, 16(1), 27–31.
- On the Benjamini–Hochberg method. Annals of Statistics, 34(4), 1827–1849.
- Multivariate distributions for the life lengths of components of a system sharing a common environment. Journal of Applied Probability, 23(2), 418–431.
- Meta-analysis of mid-p-values: Some new results based on the convex order. Journal of the American Statistical Association, 114(527), 1105–1112.
- Stable Non-Gaussian Random Processes: Stochastic Models with Infinite Variance. Routledge.
- Samuel-Cahn, E. (1996). Is the Simes improved Bonferroni procedure conservative? Biometrika, 83(4), 928–933.
- Risk aggregation in multivariate dependent pareto distributions. Insurance: Mathematics and Economics, 71, 154–163.
- Sarkar, S. K. (1998). Some probability inequalities for ordered MTP2 random variables: a proof of the Simes conjecture. Annals of Statistics, 26(2), 494–504.
- On Samuel’s p-value model and the Simes test under dependence. Statistics and Probability Letters, 187, 109509.
Collections
Sign up for free to add this paper to one or more collections.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.