Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
139 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Almost Tight Bounds for Differentially Private Densest Subgraph (2308.10316v3)

Published 20 Aug 2023 in cs.DS

Abstract: We study the Densest Subgraph (DSG) problem under the additional constraint of differential privacy. DSG is a fundamental theoretical question which plays a central role in graph analytics, and so privacy is a natural requirement. All known private algorithms for Densest Subgraph lose constant multiplicative factors, despite the existence of non-private exact algorithms. We show that, perhaps surprisingly, this loss is not necessary: in both the classic differential privacy model and the LEDP model (local edge differential privacy, introduced recently by Dhulipala et al. [FOCS 2022]), we give $(\epsilon, \delta)$-differentially private algorithms with no multiplicative loss whatsoever. In other words, the loss is \emph{purely additive}. Moreover, our additive losses match or improve the best-known previous additive loss (in any version of differential privacy) when $1/\delta$ is polynomial in $n$, and are almost tight: in the centralized setting, our additive loss is $O(\log n /\epsilon)$ while there is a known lower bound of $\Omega(\sqrt{\log n / \epsilon})$. We also give a number of extensions. First, we show how to extend our techniques to both the node-weighted and the directed versions of the problem. Second, we give a separate algorithm with pure differential privacy (as opposed to approximate DP) but with worse approximation bounds. And third, we give a new algorithm for privately computing the optimal density which implies a separation between the structural problem of privately computing the densest subgraph and the numeric problem of privately computing the density of the densest subgraph.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (64)
  1. Fast exact shortest-path distance queries on large networks by pruned landmark labeling. In Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data, pages 349–360, 2013.
  2. Dense subgraph maintenance under streaming edge weight updates for real-time story identification. The VLDB journal, 23:175–199, 2014.
  3. R. Arora and J. Upadhyay. On differentially private graph sparsification and applications. Advances in neural information processing systems, 32, 2019.
  4. The multiplicative weights update method: a meta-algorithm and applications. Theory of Computing, 8(6):121–164, 2012.
  5. Densest subgraph in streaming and mapreduce. Proc. VLDB Endow., 5(5):454–465, jan 2012.
  6. V. Balcer and S. Vadhan. Differential Privacy on Finite Computers. In A. R. Karlin, editor, 9th Innovations in Theoretical Computer Science Conference (ITCS 2018), volume 94 of Leibniz International Proceedings in Informatics (LIPIcs), pages 43:1–43:21, Dagstuhl, Germany, 2018. Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik.
  7. Space-and time-efficient algorithm for maintaining dense subgraphs on one-pass dynamic streams. In Proceedings of the forty-seventh annual ACM symposium on Theory of computing, pages 173–182, 2015.
  8. Flowless: Extracting densest subgraphs without flow computations. In Proceedings of The Web Conference 2020, WWW ’20, page 573–583, New York, NY, USA, 2020. Association for Computing Machinery.
  9. Differentially private correlation clustering. In International Conference on Machine Learning, pages 1136–1146. PMLR, 2021.
  10. M. Bun and T. Steinke. Concentrated differential privacy: Simplifications, extensions, and lower bounds. In Theory of Cryptography Conference, pages 635–658. Springer, 2016.
  11. Graph anomaly detection based on steiner connectivity and density. Proceedings of the IEEE, 106(5):829–845, 2018.
  12. On dense subgraphs in signed network streams. In 2016 IEEE 16th International Conference on Data Mining (ICDM), pages 51–60. IEEE, 2016.
  13. M. Charikar. Greedy approximation algorithms for finding dense components in a graph. In K. Jansen and S. Khuller, editors, Approximation Algorithms for Combinatorial Optimization, Third International Workshop, APPROX 2000, Saarbrücken, Germany, September 5-8, 2000, Proceedings, volume 1913 of Lecture Notes in Computer Science, pages 84–95. Springer, 2000.
  14. Densest subgraph: Supermodularity, iterative peeling, and flow. In J. S. Naor and N. Buchbinder, editors, Proceedings of the 2022 ACM-SIAM Symposium on Discrete Algorithms, SODA 2022, Virtual Conference / Alexandria, VA, USA, January 9 - 12, 2022, pages 1531–1555. SIAM, 2022.
  15. Private estimation algorithms for stochastic block models and mixture models. Advances in Neural Information Processing Systems, 36:68134–68183, 2023.
  16. J. Chen and Y. Saad. Dense subgraph extraction with application to community detection. IEEE Transactions on knowledge and data engineering, 24(7):1216–1230, 2010.
  17. Near-optimal correlation clustering with privacy. Advances in Neural Information Processing Systems, 35:33702–33715, 2022.
  18. Privacy at scale: Local differential privacy in practice. In Proceedings of the 2018 International Conference on Management of Data, SIGMOD ’18, page 1655–1658, New York, NY, USA, 2018. Association for Computing Machinery.
  19. Nearly tight bounds for differentially private multiway cut. In A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine, editors, Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023, 2023.
  20. Near-optimal differentially private k-core decomposition. CoRR, abs/2312.07706, 2023.
  21. Differential privacy from locally adjustable graph algorithms: k-core decomposition, low out-degree ordering, and densest subgraphs. In 2022 IEEE 63rd Annual Symposium on Foundations of Computer Science (FOCS), pages 754–765. IEEE, 2022.
  22. Extraction and classification of dense communities in the web. In Proceedings of the 16th international conference on World Wide Web, pages 461–470, 2007.
  23. C. Dwork and J. Lei. Differential privacy and robust statistics. In Proceedings of the Forty-First Annual ACM Symposium on Theory of Computing, STOC ’09, page 371–380, New York, NY, USA, 2009. Association for Computing Machinery.
  24. Calibrating noise to sensitivity in private data analysis. In TCC, volume 3876 of Lecture Notes in Computer Science, pages 265–284. Springer, 2006.
  25. C. Dwork and A. Roth. The algorithmic foundations of differential privacy. Found. Trends Theor. Comput. Sci., 9(3–4):211–407, aug 2014.
  26. Differentially private release of synthetic graphs. In Proceedings of the Fourteenth Annual ACM-SIAM Symposium on Discrete Algorithms, pages 560–578. SIAM, 2020.
  27. Efficient densest subgraph computation in evolving graphs. In Proceedings of the 24th international conference on world wide web, pages 300–310, 2015.
  28. Brief announcement: Applications of uniform sampling: Densest subgraph and beyond. In Proceedings of the 28th ACM Symposium on Parallelism in Algorithms and Architectures, pages 397–399, 2016.
  29. Private graph all-pairwise-shortest-path distance release with improved error rate. Advances in Neural Information Processing Systems, 35:17844–17856, 2022.
  30. Differentially private densest subgraph. In International Conference on Artificial Intelligence and Statistics, pages 11581–11597. PMLR, 2022.
  31. Differentially private densest subgraph. In G. Camps-Valls, F. J. R. Ruiz, and I. Valera, editors, International Conference on Artificial Intelligence and Statistics, AISTATS 2022, 28-30 March 2022, Virtual Event, volume 151 of Proceedings of Machine Learning Research, pages 11581–11597. PMLR, 2022.
  32. Y. Freund and R. E. Schapire. A decision-theoretic generalization of on-line learning and an application to boosting. J. Comput. Syst. Sci., 55(1):119–139, 1997.
  33. Improved parallel algorithms for density-based network clustering. In International Conference on Machine Learning, pages 2201–2210. PMLR, 2019.
  34. Universally utility-maximizing privacy mechanisms. In Proceedings of the Forty-First Annual ACM Symposium on Theory of Computing, STOC ’09, page 351–360, New York, NY, USA, 2009. Association for Computing Machinery.
  35. Discovering large dense subgraphs in massive graphs. In Proceedings of the 31st international conference on Very large data bases, pages 721–732, 2005.
  36. A. V. Goldberg. Finding a maximum density subgraph. 1984.
  37. Differentially private combinatorial optimization. In M. Charikar, editor, Proceedings of the Twenty-First Annual ACM-SIAM Symposium on Discrete Algorithms, SODA 2010, Austin, Texas, USA, January 17-19, 2010, pages 1106–1125. SIAM, 2010.
  38. Differentially private combinatorial optimization. In Proceedings of the twenty-first annual ACM-SIAM symposium on Discrete Algorithms, pages 1106–1125. SIAM, 2010.
  39. Iterative constructions and private data release. In Theory of Cryptography: 9th Theory of Cryptography Conference, TCC 2012, Taormina, Sicily, Italy, March 19-21, 2012. Proceedings 9, pages 339–356. Springer, 2012.
  40. A simple and practical algorithm for differentially private data release. Advances in neural information processing systems, 25, 2012.
  41. M. Hardt and G. N. Rothblum. A multiplicative weights mechanism for privacy-preserving data analysis. In Proceedings of the 2010 IEEE 51st Annual Symposium on Foundations of Computer Science, FOCS ’10, page 61–70, USA, 2010. IEEE Computer Society.
  42. Tighter bounds for local differentially private core decomposition and densest subgraph, 2024.
  43. Fraudar: Bounding graph fraud in the face of camouflage. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pages 895–904, 2016.
  44. Privately solving linear programs. In J. Esparza, P. Fraigniaud, T. Husfeldt, and E. Koutsoupias, editors, Automata, Languages, and Programming, pages 612–624, Berlin, Heidelberg, 2014. Springer Berlin Heidelberg.
  45. G. Kamath. Lecture 4 — Intro to Differential Privacy, Part 2. CS 860: Algorithms for Private Data Analysis. Available at http://www.gautamkamath.com/CS860notes/lec4.pdf, 2020.
  46. R. Kannan and V. Vinay. Analyzing the structure of large graphs. Unpublished manuscript, 1999.
  47. What can we learn privately? SIAM Journal on Computing, 40(3):793–826, 2011.
  48. Structure and evolution of online social networks. In Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 611–617, 2006.
  49. D. Liu. Better private algorithms for correlation clustering. In Conference on Learning Theory, pages 5391–5412. PMLR, 2022.
  50. J. Liu and K. Talwar. Private selection from private candidates. In 51st Annual ACM SIGACT Symposium on Theory of Computing, pages 298–309, 2019.
  51. Densest subgraph in dynamic graph streams. In International Symposium on Mathematical Foundations of Computer Science, pages 472–482. Springer, 2015.
  52. F. McSherry. Privacy integrated queries. In Proceedings of the 2009 ACM SIGMOD International Conference on Management of Data (SIGMOD). Association for Computing Machinery, Inc., June 2009. For more information, visit the project page: http://research.microsoft.com/PINQ.
  53. I. Mironov. Rényi differential privacy. In 30th IEEE Computer Security Foundations Symposium, CSF 2017, Santa Barbara, CA, USA, August 21-25, 2017, pages 263–275. IEEE Computer Society, 2017.
  54. Differentially private community detection for stochastic block models. In International Conference on Machine Learning, pages 15858–15894. PMLR, 2022.
  55. D. Nguyen and A. Vullikanti. Differentially private densest subgraph detection. In M. Meila and T. Zhang, editors, Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event, volume 139 of Proceedings of Machine Learning Research, pages 8140–8151. PMLR, 2021.
  56. Smooth sensitivity and sampling in private data analysis. In Proceedings of the Thirty-Ninth Annual ACM Symposium on Theory of Computing, STOC ’07, page 75–84, New York, NY, USA, 2007. Association for Computing Machinery.
  57. N. Papernot and T. Steinke. Hyperparameter tuning with renyi differential privacy. In The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022. OpenReview.net, 2022.
  58. Fast approximation algorithms for fractional packing and covering problems. Mathematics of Operations Research, 20(2):257–301, 1995.
  59. Event detection in activity networks. In Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 1176–1185, 2014.
  60. Dense subgraphs with restrictions and applications to gene annotation graphs. In Research in Computational Molecular Biology: 14th Annual International Conference, RECOMB 2010, Lisbon, Portugal, April 25-28, 2010. Proceedings 14, pages 456–472. Springer, 2010.
  61. S. Sawlani and J. Wang. Near-optimal fully dynamic densest subgraph. In Proceedings of the 52nd Annual ACM SIGACT Symposium on Theory of Computing, pages 181–193, 2020.
  62. S. Sawlani and J. Wang. Near-optimal fully dynamic densest subgraph. In Proceedings of the 52nd Annual ACM SIGACT Symposium on Theory of Computing, STOC 2020, page 181–193, New York, NY, USA, 2020. Association for Computing Machinery.
  63. S. P. Vadhan. The complexity of differential privacy. In Y. Lindell, editor, Tutorials on the Foundations of Cryptography, pages 347–450. Springer International Publishing, 2017.
  64. R. Vershynin. High-Dimensional Probability: An Introduction with Applications in Data Science. Cambridge Series in Statistical and Probabilistic Mathematics. Cambridge University Press, 2018.
Citations (3)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com