Kairos: Efficient Temporal Graph Analytics on a Single Machine (2401.02563v1)
Abstract: Many important societal problems are naturally modeled as algorithms over temporal graphs. To date, however, most graph processing systems remain inefficient as they rely on distributed processing even for graphs that fit well within a commodity server's available storage. In this paper, we introduce Kairos, a temporal graph analytics system that provides application developers a framework for efficiently implementing and executing algorithms over temporal graphs on a single machine. Specifically, Kairos relies on fork-join parallelism and a highly optimized parallel data structure as core primitives to maximize performance of graph processing tasks needed for temporal graph analytics. Furthermore, we introduce the notion of selective indexing and show how it can be used with an efficient index to speedup temporal queries. Our experiments on a 24-core server show that our algorithms obtain good parallel speedups, and are significantly faster than equivalent algorithms in existing temporal graph processing systems: up to 60x against a shared-memory approach, and several orders of magnitude when compared with distributed processing of graphs that fit within a single server.
- “Temporal networks” In Physics Reports 519, 2012, pp. 97–125 URL: http://arxiv.org/abs/1108.1780
- “Use of temporal contact graphs to understand the evolution of COVID-19 through contact tracing data” In Nature Commun. Phys 5, 2022
- Renaud Lambiotte, Martin Rosvall and Ingo Scholtes “From networks to optimal higher-order models of complex systems” In Nature Phys. 15.4, 2019, pp. 313–320
- “Temporal Graph Benchmark for Machine Learning on Temporal Graphs”, 2023 arXiv:2307.01026 [cs.LG]
- “An interval-centric model for distributed computing over temporal graphs” In ICDE, 2020, pp. 1129–1140
- “Tink: A Temporal Graph Analytics Library for Apache Flink” In WWW, 2018, pp. 71–72
- “Distributed temporal graph analytics with GRADOOP” In PVDLB, 2022, pp. 375–401
- “TeGraph: A Novel General-Purpose Temporal Graph Computing Engine” In ICDE, 2022, pp. 578–592
- Jure Leskovec, Jon Kleinberg and Christos Faloutsos “Graphs over time: densification laws, shrinking diameters and possible explanations” In KDD, KDD, 2005, pp. 177–187
- “Chronograph: A Distributed Processing Platform for Online and Batch Computations on Event-Sourced Graphs” In DEBS, 2017, pp. 78–87
- “You Are What You Do: Hunting Stealthy Malware via Data Provenance Analysis.” In NDSS, 2020
- “ASTRO: Reducing COVID-19 Exposure through Contact Prediction and Avoidance” In ACM Trans. Spatial Algorithms Syst. 8.2, 2022, pp. 1–31
- “Towards Crowd-Aware Indoor Path Planning” In PVLDB, 2021, pp. 1365–1377
- Lei Li, Sibo Wang and Xiaofang Zhou “Time-Dependent Hop Labeling on Road Network” In ICDE, 2019, pp. 902–913
- “Mining Bursting Core in Large Temporal Graphs” In PVLDB, 2022, pp. 3911–3923
- “Scalable Time-Range k-Core Query on Temporal Graphs (Full Version)” In PVLDB, 2023, pp. 1168–1180
- “On querying historical k-cores” In PVLDB, 2021, pp. 2033–2045
- “Persistent community search in temporal networks” In ICDE, 2018, pp. 797–808
- “Relevance of temporal cores for epidemic spread in temporal networks” In Scientific reports 10.1 Nature Publishing Group UK London, 2020, pp. 12529
- “Uncovering the structure and temporal dynamics of information propagation” In Network Science 2.1 Cambridge University Press, 2014, pp. 26–65
- “Universality, criticality and complexity of information propagation in social media” In Nature communications 13.1 Nature Publishing Group UK London, 2022, pp. 1308
- “Efficient distributed reachability querying of massive temporal graphs” In PVLDB, 2019, pp. 871–896
- Ashwin Paranjape, Austin R Benson and Jure Leskovec “Motifs in Temporal Networks” In WSDM, 2017, pp. 601–610
- James F Allen “Maintaining knowledge about temporal intervals” In Commun. ACM 26.11, 1983, pp. 832–843
- “Path Problems in Temporal Graphs” In PVLDB, 2014, pp. 721–732
- “Efficient Algorithms for Temporal Path Computation” In TKDE 28.11, 2016, pp. 2927–2942
- “Packed Compressed Sparse Row: A Dynamic Graph Representation” In HPEC, 2018, pp. 1–7
- Julian Shun and Guy E. Blelloch “Ligra: A Lightweight Graph Processing Framework for Shared Memory” In PPoPP, 2013, pp. 135–146
- “Computational Geometry: Algorithms and Applications” Springer-Verlag TELOS, 2008
- “Towards Event Prediction in Temporal Graphs” In PVLDB, 2022, pp. 1861–1874
- “TREND: TempoRal Event and Node Dynamics for Graph Representation Learning” In WWW, 2022, pp. 1159–1169
- “Adapting to Skew: Imputing Spatiotemporal Urban Data with 3D Partial Convolutions and Biased Masking”, 2023 arXiv:2301.04233 [cs.CV]
- “TGL: A General Framework for Temporal GNN Training on Billion-Scale Graphs” In PVLDB, 2022, pp. 1572–1580
- “Temporal Ligra” URL: https://github.com/jshun/ligra/tree/temporal
- Charles E Leiserson “The Cilk++ concurrency platform” In DAC, 2009, pp. 522–527
- Tao B Schardl and I-Ting Angelina Lee “OpenCilk: A Modular and Extensible Software Infrastructure for Fast Task-Parallel Code” In PPoPP, 2023, pp. 189–203
- Paul Liu, Austin R. Benson and Moses Charikar “Sampling methods for counting temporal motifs” In WSDM, 2019
- Melissa J.M. Turcotte, Alexander D. Kent and Curtis Hash “Unified Host and Network Data Set” In Data Science for Cyber-Security, 2018, pp. 1–22
- “SNAP StackOverflow dataset” URL: https://snap.stanford.edu/data/sx-stackoverflow.html
- “A collection of public transport network data sets for 25 cities” In Nature Sci. Data 5, 2018
- Juncheng Yang, Yao Yue and K.V. Rashmi “A large scale analysis of hundreds of in-memory cache clusters at Twitter” In OSDI, 2020, pp. 191–208
- Shriram Ramesh, Animesh Baranawal and Yogesh Simmhan “A Distributed Path Query Engine for Temporal Property Graphs” Preprint, https://arxiv.org/abs/2002.03274 In CoRR 2020 abs/2002.03274
- “Chronos: A Graph Engine for Temporal Graph Analysis” In EuroSys, 2014, pp. 1:1–1:14
- “ImmortalGraph: A System for Storage and Analysis of Temporal Graphs” In TOS 11.3, 2015, pp. 14:1–14:34
- “Kineograph: taking the pulse of a fast-changing and connected world” In EuroSys, 2012, pp. 85–98
- Aapo Kyrola, Guy E Blelloch and Carlos Guestrin “GraphChi: Large-scale graph computation on just a PC” In OSDI, 2012, pp. 31–46
- “Time-evolving Graph Processing at Scale” In GRADES, 2016, pp. 5:1–5:6
- Minjie Yu Wang “Deep Graph Library: towards efficient and scalable deep learning on graphs” In ICLR, 2019
- “Graph Neural Networks for Temporal Graphs: State of the Art, Open Challenges, and Opportunities” In Transactions on Machine Learning Research, 2023 URL: https://openreview.net/forum?id=pHCdMat0gI