Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
120 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Information divergences and likelihood ratios of Poisson processes and point patterns (2404.00294v2)

Published 30 Mar 2024 in math.ST, cs.IT, math.IT, math.PR, and stat.TH

Abstract: This article develops an analytical framework for studying information divergences and likelihood ratios associated with Poisson processes and point patterns on general measurable spaces. The main results include explicit analytical formulas for Kullback-Leibler divergences, R\'enyi divergences, Hellinger distances, and likelihood ratios of the laws of Poisson point patterns in terms of their intensity measures. The general results yield similar formulas for inhomogeneous Poisson processes, compound Poisson processes, as well as spatial and marked Poisson point patterns. Additional results include simple characterisations of absolute continuity, mutual singularity, and the existence of common dominating measures. The analytical toolbox is based on Tsallis divergences of sigma-finite measures on abstract measurable spaces. The treatment is purely information-theoretic and free of topological assumptions.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (49)
  1. Robust bounds and optimization at the large deviations scale for queueing models via Rényi divergence. Annals of Applied Probability, 31(3):1061–1099, 2021.
  2. Community detection on Euclidean random graphs. Information and Inference: A Journal of the IMA, 10(1):109–160, 2021.
  3. Community detection on block models with geometric kernels, 2024. https://arxiv.org/abs/2403.02802.
  4. Venkat Anantharam. A variational characterization of Rényi divergences. IEEE Transactions on Information Theory, 64(11):6979–6989, 2018.
  5. Community detection in general stochastic block models: Fundamental limits and efficient algorithms for recovery. In IEEE 56th Annual Symposium on Foundations of Computer Science (FOCS), 2015.
  6. Variational representations and neural network estimation of Rényi divergences. SIAM Journal on Mathematics of Data Science, 3(4):1093–1116, 2021.
  7. Andrew Bevan. Spatial point patterns and processes. In Mark Gillings, Piraye Hacıgüzeller, and Gary Lock, editors, Archaeological Spatial Analysis, pages 60–76. Routledge, 2020.
  8. Lucien Birgé. Model selection for Poisson processes. In Asymptotics: particles, processes and inverse problems. Festschrift for Piet Groeneboom, pages 32–64. Beachwood, OH: IMS, Institute of Mathematical Statistics, 2007.
  9. Mark Brown. Discrimination of Poisson processes. Annals of Mathematical Statistics, 42(2):773–776, 1971.
  10. Herman Chernoff. A measure of asymptotic efficiency for tests of a hypothesis based on the sum of observations. Annals of Mathematical Statistics, 23(4):493–507, 1952.
  11. Peter J. Diggle. Statistical Analysis of Spatial and Spatio-Temporal Point Patterns. Chapman and Hall/CRC, third edition, 2013.
  12. Probabilities and Potential B. North-Holland Publishing Company, 1982.
  13. An Introduction to the Theory of Point Processes. Springer, second edition, 2003.
  14. On choosing and bounding probability metrics. Int. Stat. Rev., 70(3):419–435, 2002.
  15. Statistical Analysis and Modelling of Spatial Point Patterns. Wiley, 2008.
  16. Shizuo Kakutani. On equivalence of infinite product measures. Annals of Mathematics, 49(1):214–224, 1948.
  17. Olav Kallenberg. Foundations of Modern Probability. Springer, second edition, 2002.
  18. Alan F. Karr. State estimation for Cox processes on general spaces. Stochastic Processes and their Applications, 14(3):209–232, 1983.
  19. Alan F. Karr. Point Processes and Their Statistical Inference. Marcel Dekker, second edition, 1991.
  20. John Frank Charles Kingman. Completely random measures. Pacific Journal of Mathematics, 21(1):59–78, 1967.
  21. John Frank Charles Kingman. Poisson Processes. Oxford University Press, 1993.
  22. Hard-core thinnings of germ–grain models with power-law grain sizes. Advances in Applied Probability, 45(3):595–625, 2013.
  23. Scaling limits for random fields with long-range dependence. Annals of Probability, 35(2):528–550, 2007.
  24. Lasse Leskelä. Stochastic relations of random variables and processes. Journal of Theoretical Probability, 23(2):523–546, 2010.
  25. Lasse Leskelä. Ross’s second conjecture and supermodular stochastic ordering. Queueing Systems, 2022.
  26. Friedrich Liese. Eine informationstheoretische Bedingung fur die Äquivalenz unbegrenzt teilbarer Punktprozesse. Mathematische Nachrichten, 70(1):183–196, 1975.
  27. Lectures on the Poisson Process. Cambridge University Press, 2018.
  28. Statistics of Random Processes II. Springer, 1978.
  29. On divergences and informations in statistics and information theory. IEEE Transactions on Information Theory, 52(10):4394–4412, 2006.
  30. Stochastic order characterization of uniform integrability and tightness. Statistics & Probability Letters, 83(1):382–389, 2013.
  31. Conditional convex orders and measurable martingale couplings. Bernoulli, 23(4A):2784–2807, 2017.
  32. Simulation-based inference with the generalized Kullback-Leibler divergence, 2023. ICML 2023 workshop on Synergy of Scientific and Machine Learning Modeling.
  33. From Blackwell dominance in large samples to Rényi divergences and back again. Econometrica, 89(1):475–506, 2021.
  34. Frank Nielsen. An information-geometric characterization of Chernoff information. IEEE Signal Processing Letters, 20(3):269–272, 2013.
  35. A closed-form expression for the Sharma–Mittal entropy of exponential families. Journal of Physics A: Mathematical and Theoretical, 45(3):032003, 2011.
  36. Continuous testing for Poisson process intensities: a new perspective on scanning statistics. Biometrika, 105(4):931–944, 09 2018.
  37. Information Theory. Cambridge University Press, 2024.
  38. Basic models and questions in statistical network analysis. Statistics Surveys, 11:1–47, 2017.
  39. Adaptive estimation for Hawkes processes; application to genome analysis. Annals of Statistics, 38(5):2781–2822, 2010.
  40. Rolf-Dieter Reiss. A Course on Point Processes. Springer, 1993.
  41. Alfréd Rényi. On measures of entropy and information. In 4th Berkeley Symposium on Mathematics, Statistics and Probability, 1961.
  42. Albert N. Shiryaev. Probability. Springer, second edition, 1996.
  43. Anatoliy Volodymyrovych Skorohod. On the differentiability of measures which correspond to stochastic processes. I. Processes with independent increments. Teor. Veroyatnost. i Primenen., 2:417–443, 1957.
  44. Point field models for the galaxy point pattern. Astronomy & Astrophysics, 388(3):758–765, 2002.
  45. Recent applications of point process methods in forestry statistics. Statistical Science, 15(1):61–78, 2000.
  46. Yoichiro Takahashi. Absolute continuity of Poisson random fields. Publications of the Research Institute for Mathematical Sciences, Kyoto University, 26(4):629–647, 1990.
  47. Constantino Tsallis. Generalized entropy-based criterion for consistent testing. Physical Review E, 58:1442–1445, 1998.
  48. Tim van Erven and Peter Harremoës. Rényi divergence and Kullback–Leibler divergence. IEEE Transactions on Information Theory, 60(7):3797–3820, July 2014.
  49. Qiaosheng Zhang and Vincent Y. F. Tan. Exact recovery in the general hypergraph stochastic block model. IEEE Transactions on Information Theory, 69(1):453–471, 2023.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now