Papers
Topics
Authors
Recent
Search
2000 character limit reached

Information-Theoretic Thresholds for Planted Dense Cycles

Published 1 Feb 2024 in math.ST, cs.IT, cs.SI, math.IT, stat.ML, and stat.TH | (2402.00305v1)

Abstract: We study a random graph model for small-world networks which are ubiquitous in social and biological sciences. In this model, a dense cycle of expected bandwidth $n \tau$, representing the hidden one-dimensional geometry of vertices, is planted in an ambient random graph on $n$ vertices. For both detection and recovery of the planted dense cycle, we characterize the information-theoretic thresholds in terms of $n$, $\tau$, and an edge-wise signal-to-noise ratio $\lambda$. In particular, the information-theoretic thresholds differ from the computational thresholds established in a recent work for low-degree polynomial algorithms, thereby justifying the existence of statistical-to-computational gaps for this problem.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (44)
  1. Radosław Adamczak. Moment inequalities for U-statistics. The Annals of Probability, 34(6):2288 – 2314, 2006.
  2. Brendan PW Ames. Guaranteed recovery of planted cliques and dense subgraphs by convex relaxation. Journal of Optimization Theory and Applications, 167:653–675, 2015.
  3. Latent distance estimation for random geometric graphs. Advances in Neural Information Processing Systems, 32, 2019.
  4. Phase transitions for detecting latent geometry in random graphs. Probability Theory and Related Fields, 178(3-4):1215–1289, 2020.
  5. Testing for high-dimensional geometry in random graphs. Random Structures & Algorithms, 49(3):503–532, 2016.
  6. Hidden hamiltonian cycle recovery via linear programming. Operations research, 68(1):53–70, 2020.
  7. On detection and structural reconstruction of small-world random networks. IEEE Transactions on Network Science and Engineering, 4(3):165–176, 2017.
  8. Asymptotic mutual information for the balanced binary stochastic block model. Information and Inference, December 2016.
  9. Random geometric graph: Some recent developments and perspectives. arXiv preprint arXiv:2203.15351, 2022.
  10. Decoupling: from dependence to independence. Probability and Its Applications. Springer New York, New York, NY, 1999.
  11. Victor H de la Pena and Stephen J Montgomery-Smith. Decoupling inequalities for the tail probabilities of multivariate U-statistics. The Annals of Probability, pages 806–816, 1995.
  12. Consistent recovery threshold of hidden nearest neighbor graphs. In Conference on Learning Theory, pages 1540–1553. PMLR, 2020.
  13. Community detection and percolation of information in a geometric setting. Combinatorics, Probability and Computing, 31(6):1048–1069, 2022.
  14. P. Erdős and A. Rényi. On random graphs I. Publ. math. debrecen, 6(290-297):18, 1959.
  15. Localization in 1d non-parametric latent space models from pairwise affinities. Electronic Journal of Statistics, 17(1):1587–1662, 2023.
  16. Exponential and moment inequalities for U-statistics. In High Dimensional Probability II, pages 13–38. Springer, 2000.
  17. Mutual information and minimum mean-square error in gaussian channels. IEEE transactions on information theory, 51(4):1261–1282, 2005.
  18. The power of sum-of-squares for detecting hidden structures. In 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS), pages 720–731. IEEE, 2017.
  19. Samuel Hopkins. Statistical Inference and the Sum of Squares Method. PhD thesis, Cornell University, 2018.
  20. Exponential Inequalities, with Constants, for U-statistics of Order Two. In Stochastic Inequalities and Applications, pages 55–69. Birkhäuser Basel, 2003.
  21. Efficient bayesian estimation from few samples: community detection and related problems. In 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS), pages 379–390. IEEE, 2017.
  22. Computational lower bounds for community detection on random graphs. In Conference on Learning Theory, pages 899–928. PMLR, 2015.
  23. Svante Janson. Large deviations for sums of partly dependent random variables. Random Structures & Algorithms, 24(3):234–248, 2004.
  24. Mark Jerrum. Large cliques elude the metropolis process. Random Structures & Algorithms, 3(4):347–359, 1992.
  25. Reconstruction of line-embeddings of graphons. Electronic Journal of Statistics, 16(1):331–407, 2022.
  26. Luděk Kučera. Expected complexity of graph partitioning problems. Discrete Applied Mathematics, 57(2-3):193–212, 1995.
  27. Notes on computational hardness of hypothesis testing: Predictions using the low-degree likelihood ratio. ISAAC Congress (International Society for Analysis, its Applications and Computation), pages 1–50, 2019.
  28. Theory of point estimation. Springer Science & Business Media, 2006.
  29. Testing thresholds for high-dimensional sparse random geometric graphs. In Proceedings of the 54th Annual ACM SIGACT Symposium on Theory of Computing, pages 672–677, 2022.
  30. Phase transition in noisy high-dimensional random geometric graphs. Electronic Journal of Statistics, 17(2):3512–3574, 2023.
  31. A probabilistic view of latent space graphs and phase transitions. Bernoulli, 29(3):2417–2441, 2023.
  32. Spectral clustering in the gaussian mixture block model. arXiv preprint arXiv:2305.00979, 2023.
  33. Life above threshold: From list decoding to area theorem and MSE. Proceedings of the IEEE Information Theory Workshop, October 2004.
  34. The generalized area theorem and some of its consequences. IEEE Transactions on Information Theory, 55(11):4793–4821, 2009.
  35. Detection-recovery gap for planted dense cycles. In Proceedings of Thirty Sixth Conference on Learning Theory, volume 195 of Proceedings of Machine Learning Research, pages 2440–2481, 12–15 Jul 2023.
  36. Consistency of spectral seriation. arXiv preprint arXiv:2112.04408, 2021.
  37. Mathew Penrose. Random geometric graphs, volume 5. OUP Oxford, 2003.
  38. Computational barriers to estimation from low-degree polynomials. The Annals of Statistics, 50(3):1833–1858, 2022.
  39. Alexandre B. Tsybakov. Introduction to Nonparametric Estimation. Springer Series in Statistics. Springer, New York ; London, 2009.
  40. Lutz Warnke. On the method of typical bounded differences. Combinatorics, Probability and Computing, 25(2):269–299, March 2016.
  41. Duncan J Watts. Small worlds: the dynamics of networks between order and randomness, volume 36. Princeton university press, 2004.
  42. Collective dynamics of ‘small-world’ networks. Nature, 393(6684):440–442, 1998.
  43. Settling the sharp reconstruction thresholds of random graph matching. IEEE Transactions on Information Theory, 68(8):5391–5417, 2022.
  44. Testing correlation of unlabeled random graphs. The Annals of Applied Probability, 33(4):2519–2558, 2023.
Citations (3)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 4 likes about this paper.