Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
153 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Kairos: Efficient Temporal Graph Analytics on a Single Machine (2401.02563v1)

Published 4 Jan 2024 in cs.DB, cs.DC, and cs.PF

Abstract: Many important societal problems are naturally modeled as algorithms over temporal graphs. To date, however, most graph processing systems remain inefficient as they rely on distributed processing even for graphs that fit well within a commodity server's available storage. In this paper, we introduce Kairos, a temporal graph analytics system that provides application developers a framework for efficiently implementing and executing algorithms over temporal graphs on a single machine. Specifically, Kairos relies on fork-join parallelism and a highly optimized parallel data structure as core primitives to maximize performance of graph processing tasks needed for temporal graph analytics. Furthermore, we introduce the notion of selective indexing and show how it can be used with an efficient index to speedup temporal queries. Our experiments on a 24-core server show that our algorithms obtain good parallel speedups, and are significantly faster than equivalent algorithms in existing temporal graph processing systems: up to 60x against a shared-memory approach, and several orders of magnitude when compared with distributed processing of graphs that fit within a single server.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (49)
  1. “Temporal networks” In Physics Reports 519, 2012, pp. 97–125 URL: http://arxiv.org/abs/1108.1780
  2. “Use of temporal contact graphs to understand the evolution of COVID-19 through contact tracing data” In Nature Commun. Phys 5, 2022
  3. Renaud Lambiotte, Martin Rosvall and Ingo Scholtes “From networks to optimal higher-order models of complex systems” In Nature Phys. 15.4, 2019, pp. 313–320
  4. “Temporal Graph Benchmark for Machine Learning on Temporal Graphs”, 2023 arXiv:2307.01026 [cs.LG]
  5. “An interval-centric model for distributed computing over temporal graphs” In ICDE, 2020, pp. 1129–1140
  6. “Tink: A Temporal Graph Analytics Library for Apache Flink” In WWW, 2018, pp. 71–72
  7. “Distributed temporal graph analytics with GRADOOP” In PVDLB, 2022, pp. 375–401
  8. “TeGraph: A Novel General-Purpose Temporal Graph Computing Engine” In ICDE, 2022, pp. 578–592
  9. Jure Leskovec, Jon Kleinberg and Christos Faloutsos “Graphs over time: densification laws, shrinking diameters and possible explanations” In KDD, KDD, 2005, pp. 177–187
  10. “Chronograph: A Distributed Processing Platform for Online and Batch Computations on Event-Sourced Graphs” In DEBS, 2017, pp. 78–87
  11. “You Are What You Do: Hunting Stealthy Malware via Data Provenance Analysis.” In NDSS, 2020
  12. “ASTRO: Reducing COVID-19 Exposure through Contact Prediction and Avoidance” In ACM Trans. Spatial Algorithms Syst. 8.2, 2022, pp. 1–31
  13. “Towards Crowd-Aware Indoor Path Planning” In PVLDB, 2021, pp. 1365–1377
  14. Lei Li, Sibo Wang and Xiaofang Zhou “Time-Dependent Hop Labeling on Road Network” In ICDE, 2019, pp. 902–913
  15. “Mining Bursting Core in Large Temporal Graphs” In PVLDB, 2022, pp. 3911–3923
  16. “Scalable Time-Range k-Core Query on Temporal Graphs (Full Version)” In PVLDB, 2023, pp. 1168–1180
  17. “On querying historical k-cores” In PVLDB, 2021, pp. 2033–2045
  18. “Persistent community search in temporal networks” In ICDE, 2018, pp. 797–808
  19. “Relevance of temporal cores for epidemic spread in temporal networks” In Scientific reports 10.1 Nature Publishing Group UK London, 2020, pp. 12529
  20. “Uncovering the structure and temporal dynamics of information propagation” In Network Science 2.1 Cambridge University Press, 2014, pp. 26–65
  21. “Universality, criticality and complexity of information propagation in social media” In Nature communications 13.1 Nature Publishing Group UK London, 2022, pp. 1308
  22. “Efficient distributed reachability querying of massive temporal graphs” In PVLDB, 2019, pp. 871–896
  23. Ashwin Paranjape, Austin R Benson and Jure Leskovec “Motifs in Temporal Networks” In WSDM, 2017, pp. 601–610
  24. James F Allen “Maintaining knowledge about temporal intervals” In Commun. ACM 26.11, 1983, pp. 832–843
  25. “Path Problems in Temporal Graphs” In PVLDB, 2014, pp. 721–732
  26. “Efficient Algorithms for Temporal Path Computation” In TKDE 28.11, 2016, pp. 2927–2942
  27. “Packed Compressed Sparse Row: A Dynamic Graph Representation” In HPEC, 2018, pp. 1–7
  28. Julian Shun and Guy E. Blelloch “Ligra: A Lightweight Graph Processing Framework for Shared Memory” In PPoPP, 2013, pp. 135–146
  29. “Computational Geometry: Algorithms and Applications” Springer-Verlag TELOS, 2008
  30. “Towards Event Prediction in Temporal Graphs” In PVLDB, 2022, pp. 1861–1874
  31. “TREND: TempoRal Event and Node Dynamics for Graph Representation Learning” In WWW, 2022, pp. 1159–1169
  32. “Adapting to Skew: Imputing Spatiotemporal Urban Data with 3D Partial Convolutions and Biased Masking”, 2023 arXiv:2301.04233 [cs.CV]
  33. “TGL: A General Framework for Temporal GNN Training on Billion-Scale Graphs” In PVLDB, 2022, pp. 1572–1580
  34. “Temporal Ligra” URL: https://github.com/jshun/ligra/tree/temporal
  35. Charles E Leiserson “The Cilk++ concurrency platform” In DAC, 2009, pp. 522–527
  36. Tao B Schardl and I-Ting Angelina Lee “OpenCilk: A Modular and Extensible Software Infrastructure for Fast Task-Parallel Code” In PPoPP, 2023, pp. 189–203
  37. Paul Liu, Austin R. Benson and Moses Charikar “Sampling methods for counting temporal motifs” In WSDM, 2019
  38. Melissa J.M. Turcotte, Alexander D. Kent and Curtis Hash “Unified Host and Network Data Set” In Data Science for Cyber-Security, 2018, pp. 1–22
  39. “SNAP StackOverflow dataset” URL: https://snap.stanford.edu/data/sx-stackoverflow.html
  40. “A collection of public transport network data sets for 25 cities” In Nature Sci. Data 5, 2018
  41. Juncheng Yang, Yao Yue and K.V. Rashmi “A large scale analysis of hundreds of in-memory cache clusters at Twitter” In OSDI, 2020, pp. 191–208
  42. Shriram Ramesh, Animesh Baranawal and Yogesh Simmhan “A Distributed Path Query Engine for Temporal Property Graphs” Preprint, https://arxiv.org/abs/2002.03274 In CoRR 2020 abs/2002.03274
  43. “Chronos: A Graph Engine for Temporal Graph Analysis” In EuroSys, 2014, pp. 1:1–1:14
  44. “ImmortalGraph: A System for Storage and Analysis of Temporal Graphs” In TOS 11.3, 2015, pp. 14:1–14:34
  45. “Kineograph: taking the pulse of a fast-changing and connected world” In EuroSys, 2012, pp. 85–98
  46. Aapo Kyrola, Guy E Blelloch and Carlos Guestrin “GraphChi: Large-scale graph computation on just a PC” In OSDI, 2012, pp. 31–46
  47. “Time-evolving Graph Processing at Scale” In GRADES, 2016, pp. 5:1–5:6
  48. Minjie Yu Wang “Deep Graph Library: towards efficient and scalable deep learning on graphs” In ICLR, 2019
  49. “Graph Neural Networks for Temporal Graphs: State of the Art, Open Challenges, and Opportunities” In Transactions on Machine Learning Research, 2023 URL: https://openreview.net/forum?id=pHCdMat0gI

Summary

We haven't generated a summary for this paper yet.