Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
GPT-4o
Gemini 2.5 Pro Pro
o3 Pro
GPT-4.1 Pro
DeepSeek R1 via Azure Pro
2000 character limit reached

Federated Epidemic Surveillance (2307.02616v2)

Published 5 Jul 2023 in stat.AP, cs.AI, cs.CY, and stat.ME

Abstract: Epidemic surveillance is a challenging task, especially when crucial data is fragmented across institutions and data custodians are unable or unwilling to share it. This study aims to explore the feasibility of a simple federated surveillance approach. The idea is to conduct hypothesis tests for a rise in counts behind each custodian's firewall and then combine p-values from these tests using techniques from meta-analysis. We propose a hypothesis testing framework to identify surges in epidemic-related data streams and conduct experiments on real and semi-synthetic data to assess the power of different p-value combination methods to detect surges without needing to combine the underlying counts. Our findings show that relatively simple combination methods achieve a high degree of fidelity and suggest that infectious disease outbreaks can be detected without needing to share even aggregate data across institutions.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (22)
  1. Testing statistical hypotheses, volume 3. Springer, 2005.
  2. Michael P Fay. Testing the ratio of two poisson rates, 2014.
  3. Choosing between methods of combining-values. Biometrika, 105(1):239–246, 2018.
  4. Delphi epidata api. The Lancet Infectious Diseases. https://github.com/cmu-delphi/delphi-epidata, 2015.
  5. Distribution of weighted lancaster’s statistic for combining independent or dependent p-values, with applications to human genetic studies. Communications in Statistics-Theory and Methods, pages 1–13, 2022.
  6. The generalized fisher’s combination and accurate p-value calculation under dependence. Biometrics, 2022.
  7. Combining p-values via averaging. Biometrika, 107(4):791–808, 2020.
  8. Michael C Whitlock. Combining probability from independent tests: the weighted z-method is superior to fisher’s approach. Journal of evolutionary biology, 18(5):1368–1373, 2005.
  9. Powerful p-value combination methods to detect incomplete association. Scientific reports, 11(1):6980, 2021.
  10. David R Cox. Some statistical methods connected with series of events. Journal of the Royal Statistical Society: Series B (Methodological), 17(2):129–157, 1955.
  11. J Przyborowski and H Wilenski. Homogeneity of results in testing samples from poisson series: With an application to testing clover seed for dodder. Biometrika, 31(3/4):313–323, 1940.
  12. Testing the ratio of two poisson rates. Biometrical Journal: Journal of Mathematical Methods in Biosciences, 50(2):283–298, 2008.
  13. RC Elston. On fisher’s method of combining p-values. Biometrical journal, 33(3):339–345, 1991.
  14. William R Rice. A consensus combined p-value test and the family-wide significance of component tests. Biometrics, pages 303–308, 1990.
  15. Confidence intervals for a binomial proportion and asymptotic expansions. The Annals of Statistics, 30(1):160–201, 2002.
  16. Normal approximation and asymptotic expansions. SIAM, 2010.
  17. Carl-Gustav Esseen. Fourier analysis of distribution functions. a mathematical study of the laplace-gaussian law. 1945.
  18. Interval estimation for a binomial proportion. Statistical science, 16(2):101–133, 2001.
  19. Choosing an optimal method to combine p-values. Statistics in medicine, 28(11):1537–1553, 2009.
  20. IJ Good. On the weighted combination of significance tests. Journal of the Royal Statistical Society: Series B (Methodological), 17(2):264–265, 1955.
  21. HO Lancaster. The combination of probabilities: an application of orthonormal functions. Australian Journal of Statistics, 3(1):20–33, 1961.
  22. An adaptively weighted statistic for detecting differential gene expression when combining multiple transcriptomic studies. The Annals of Applied Statistics, 5(2A):994–1019, 2011.

Summary

We haven't generated a summary for this paper yet.

Dice Question Streamline Icon: https://streamlinehq.com

Follow-up Questions

We haven't generated follow-up questions for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com