---
title: 'TFisher: Unified P-Value Combination Method'
url: https://www.emergentmind.com/topics/tfisher
type: topic
---

# TFisher: Unified P-Value Combination Method

TFisher denotes a unifying family of p-value combination statistics that incorporates general truncation and weighting schemes, subsuming classical methods such as Fisher's method and the Truncated Product Method (TPM) as special cases. TFisher provides analytic null distributions and power calculations, achieves optimality under flexible alternatives, and features adaptive methods for unknown signal configurations [1801.04309].

## 1. Definition and General Formulation

TFisher combines $n$ independent one-sided p-values $P_1,\dots,P_n$ using two parameters: a truncation threshold $\tau_1 \in (0,1]$ and a scaling (weight) parameter $\tau_2 > 0$. The general TFisher statistic is

\[
T_n(\tau_1,\tau_2) = \prod_{i=1}^{n} \left(P_i / \tau_2\right)^{I\{P_i \le \tau_1\}}
\]
or, equivalently,
\[
W_n(\tau_1,\tau_2) = -2\log T_n = \sum_{i=1}^n [-2\log P_i + 2\log\tau_2] \cdot I\{P_i \le \tau_1\}.
\]

Special cases include:
- **Fisher’s product**: $\tau_1 = \tau_2 = 1$
- **TPM**: $\tau_1 < 1, \; \tau_2=1$
- **Soft-thresholding**: $\tau_1 = \tau_2 = \tau$, yielding $W_s(\tau) = \sum_{i=1}^n [-2\log P_i + 2\log\tau]_+$
- **RTP and power-weighting**: Other instances

TFisher thus unifies and extends classical p-value combination methodologies via a two-parameter family.

## 2. Null Distribution and Exact Calculations

Under the global null hypothesis, $P_i \overset{\rm i.i.d.}{\sim} \mathrm{Uniform}(0, 1)$. Define $N = \#\{i: P_i \le \tau_1\} \sim \mathrm{Binomial}(n, \tau_1)$. Conditional on $N=k$, the sum

\[
W_n = \sum_{i=1}^N [-2\log(P_i/\tau_2)],
\]
is distributed as a shifted chi-square with $2k$ degrees of freedom, shifted by $2k\ln(\tau_1/\tau_2)$. The exact null tail probability is

\[
\Pr\{W_n \ge w\}
= (1-\tau_1)^n\, I_{\{w \le 0\}}
+ e^{-w/2} \sum_{k=1}^n \sum_{j=0}^{k-1}
\binom{n}{k} \tau_2^k (1-\tau_1)^{n-k}
\frac{[w+2k\ln(\tau_1/\tau_2)]^j}{(2j)!!}.
\]

This closed-form allows analytic computation of p-values, eliminating the need for permutation or simulation under $H_0$.

## 3. Analytical Power and Efficiency Measures

Consider a signal-detection model: $H_0\!: X_i \sim N(0,1)$, $H_1\!: X_i \sim (1-\epsilon)N(0,1) + \epsilon N(\mu,1)$. Using $P_i = \Pr(N(0,1) > X_i)$, power and efficiency are expressed via one-dimensional integrals involving the discrepancy function $\delta(x) = D(x) - x$, where $D(x) = 1 - F_1(F_0^{-1}(1-x))$ with $F_0$, $F_1$ cumulative distributions of $X_i$ under $H_0$, $H_1$.

Key efficiency metrics:
- **Bahadur Efficiency (BE)**: $c(\epsilon, \mu; \tau_1, \tau_2) = \frac{(E_1 - E_0)^2}{V_0}$. $E_j, V_j$ are mean and variance of $W_n/n$ under $H_j$. BE ignores alternative variance.
- **Asymptotic Power Efficiency (APE)**: Uses both $V_0$ and $V_1$; power at asymptotic significance level $\alpha$ is $\mathrm{Power} \approx 1 - \Phi \left( \frac{w_\alpha-nE_1}{\sqrt{nV_1}} \right)$.
- **Asymptotic Power Rate (APR)**: $b(\epsilon, \mu; \tau_1, \tau_2) = \frac{E_1 - E_0}{\sqrt{V_1}}$ becomes dominant for large $n$.

A 3-parameter skew-normal central limit theorem provides accurate power calculations under alternatives. The exact null matches Monte Carlo for $n$ as small as 10; skew-normal CLT accurately predicts power for realistic $n$ and $\tau$.

## 4. Parameter Optimization and Soft-Thresholding

Optimization of $(\tau_1, \tau_2)$ can be performed with respect to BE or APE. Under general alternatives, the BE maximizer is independent of signal proportion $\epsilon$. For a Gaussian mixture, critical $\mu \gtrsim 0.85$ yields $\tau_1^* = \tau_2^* = \tau^*$; otherwise, mixtures of truncation schemes arise.

For sparse signals and moderate-to-large $\mu$, $\tau_1 = \tau_2$ is often globally optimal for both APE and APR. The optimal cutoff $\tau^*(\epsilon, \mu)$ decreases as $\epsilon$ decreases or $\mu$ increases. Neither a universal fixed threshold (e.g., $0.05$) nor $\epsilon$ alone is optimal across all alternatives.

Soft-thresholding ($W_s(\tau)$), with $w(p) = 2\max\{-\ln p + \ln\tau, 0\}$, continuously down-weights moderately small $p$-values and strongly favors very small ones. Across a broad range of $(\epsilon, \mu)$, soft-thresholding at $\tau_1 = \tau_2$ is stationary and practically optimal in theory and simulations.

## 5. Adaptive Omnibus Test: oTFisher

When $(\epsilon, \mu)$ are unknown, the omnibus test oTFisher adaptively aggregates across a grid of thresholds. For $\{\tau_{1j}, \tau_{2j}\}_{j=1}^m$, compute

\[
W_j = W_n(\tau_{1j}, \tau_{2j}), \quad
G_j(w) = \Pr_{H_0}\{W_j \ge w\}.
\]
oTFisher takes
\[
W_o = \min_{1\le j\le m} G_j(W_j).
\]
The omnibus p-value is analytically computed by evaluating the joint null distribution, which is approximately multivariate normal for large $n$, using standard MVN software. Analytic calculation of the omnibus p-value is computationally efficient ($\sim$milliseconds), with accurate coverage.

In power comparisons, oTFisher uniformly matches or outperforms adaptive TPM or adaptive RTP across signal settings. The selected $\hat{\tau}$ can be interpreted to infer the relative sparsity or density of signals present.

## 6. Simulation Validation and Empirical Guidance

Simulation results indicate:
- The exact null distribution (binomial plus chi-square mixture) aligns with Monte Carlo simulations at $n\ge10$.
- Skew-normal CLT for alternatives yields power curves almost indistinguishable from $10^4$ simulation replicates; usual normal CLT underestimates accuracy for small $\tau$ or $n$.
- Over $\epsilon \in (0, 0.25)$, $\mu \in (0.5,3)$, the global optimum $(\tau_1^*, \tau_2^*)$ always achieves maximal power, with soft-thresholding virtually identical.
- Fixed soft-threshold $\tau = 0.05$ outperforms Fisher ($\tau=1$) for sparse signals, inferior for dense signals; hard thresholding (TPM) never surpasses soft-thresholding.

Practical guidance:
- Use small $\tau$ (e.g., $0.01$–$0.05$) for sparse signals.
- Use Fisher ($\tau=1$) or larger $\tau$ for dense signals.
- When in doubt, deploy oTFisher over a small grid. Analytic $p$-value is efficient and accurate.

## 7. Implementation and Usage in Statistical Practice

TFisher is implemented as the R package `TFisher` (CRAN). Major functionalities:

| Function            | Description                                                       | Output                       |
|---------------------|-------------------------------------------------------------------|------------------------------|
| `TFisher(p, tau1, tau2)` | Computes $W_n$ and its exact null p-value.                        | Statistic and p-value        |
| `oTFisher(p, taus)` | Omnibus test over $\tau_1 = \tau_2$ in prescribed grid.           | Minimal null-cdf and p-value |

Basic usage in R:

```r
install.packages("TFisher")
library(TFisher)
set.seed(123)
pvals <- runif(50)
res1 <- TFisher(p = pvals, tau1 = 0.05, tau2 = 0.05)
res1$stat     # W_s(0.05)
res1$p.value  # exact p-value under H0
resO <- oTFisher(p = pvals, taus = c(0.01, 0.05, 0.5, 1))
resO$stat     # minimal null–cdf
resO$p.value
```

TFisher has been applied to, for example, exome sequencing data analysis for amyotrophic lateral sclerosis testing $p$-values across thousands of loci [1801.04309].

In summary, TFisher generalizes classic $p$-value combination methods to a flexible two-parameter family, offers analytic null and power calculations, and deploys adaptive soft-thresholding and omnibus procedures to maximize performance in both sparse and dense regimes [1801.04309].

Source: https://www.emergentmind.com/topics/tfisher