Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
167 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Temporal Graph Benchmark for Machine Learning on Temporal Graphs (2307.01026v2)

Published 3 Jul 2023 in cs.LG and cs.AI

Abstract: We present the Temporal Graph Benchmark (TGB), a collection of challenging and diverse benchmark datasets for realistic, reproducible, and robust evaluation of machine learning models on temporal graphs. TGB datasets are of large scale, spanning years in duration, incorporate both node and edge-level prediction tasks and cover a diverse set of domains including social, trade, transaction, and transportation networks. For both tasks, we design evaluation protocols based on realistic use-cases. We extensively benchmark each dataset and find that the performance of common models can vary drastically across datasets. In addition, on dynamic node property prediction tasks, we show that simple methods often achieve superior performance compared to existing temporal graph models. We believe that these findings open up opportunities for future research on temporal graphs. Finally, TGB provides an automated machine learning pipeline for reproducible and accessible temporal graph research, including data loading, experiment setup and performance evaluation. TGB will be maintained and updated on a regular basis and welcomes community feedback. TGB datasets, data loaders, example codes, evaluation setup, and leaderboards are publicly available at https://tgb.complexdatalab.com/.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (53)
  1. A.-L. Barabási. Network science. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 371(1987):20120375, 2013.
  2. The million song dataset. 2011.
  3. Potential for global spread of a novel coronavirus from china. Journal of travel medicine, 27(2):taaa011, 2020.
  4. A. D. Broido and A. Clauset. Scale-free networks are rare. Nature communications, 10(1):1017, 2019.
  5. Graph neural networks for link prediction with subgraph sketching. In The Eleventh International Conference on Learning Representations, 2022.
  6. Direct embedding of temporal network edges via time-decayed line graphs. arXiv preprint arXiv:2210.00032, 2022.
  7. On the equivalence between graph isomorphism testing and function approximation with gnns. Advances in neural information processing systems, 32, 2019.
  8. Scalable spatiotemporal graph neural networks. arXiv preprint arXiv:2209.06520, 2022.
  9. Do we really need complicated model architectures for temporal networks? arXiv preprint arXiv:2302.11636, 2023.
  10. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition, pages 248–255. Ieee, 2009.
  11. Incorporating dynamic flight network in seir to model mobility between populations. Applied Network Science, 6(1):1–24, 2021.
  12. V. P. Dwivedi and X. Bresson. A generalization of transformer networks to graphs. arXiv preprint arXiv:2012.09699, 2020.
  13. J. Gao and B. Ribeiro. On the equivalence between temporal and static equivariant graph representations. In International Conference on Machine Learning, pages 7052–7076. PMLR, 2022.
  14. Variational graph recurrent neural networks. Advances in neural information processing systems, 32, 2019.
  15. B. Hidasi and D. Tikk. Fast als-based tensor factorization for context-aware recommendation from implicit feedback. In Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2012, Bristol, UK, September 24-28, 2012. Proceedings, Part II 23, pages 67–82. Springer, 2012.
  16. Ogb-lsc: A large-scale challenge for machine learning on graphs. arXiv preprint arXiv:2103.09430, 2021.
  17. Open graph benchmark: Datasets for machine learning on graphs. Advances in neural information processing systems, 33:22118–22133, 2020.
  18. DGraph: A large-scale financial dataset for graph anomaly detection. In Thirty-sixth Conference on Neural Information Processing Systems Datasets and Benchmarks Track, 2022.
  19. K. Järvelin and J. Kekäläinen. Cumulated gain-based evaluation of ir techniques. ACM Transactions on Information Systems (TOIS), 20(4):422–446, 2002.
  20. Neural temporal walks: Motif-aware representation learning on continuous-time dynamic graphs. In Advances in Neural Information Processing Systems, 2022.
  21. Representation learning for dynamic graphs: A survey. The Journal of Machine Learning Research, 21(1):2648–2720, 2020.
  22. T. N. Kipf and M. Welling. Semi-supervised classification with graph convolutional networks. In International Conference on Learning Representations, 2016.
  23. Rethinking graph transformers with spectral attention. Advances in Neural Information Processing Systems, 34:21618–21629, 2021.
  24. Predicting dynamic embedding trajectory in temporal interaction networks. In Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, pages 1269–1278, 2019.
  25. Y. Luo and P. Li. Neighborhood-aware scalable temporal network representation learning. In Learning on Graphs Conference, pages 1–1. PMLR, 2022.
  26. Rethinking agricultural trade relationships in an era of globalization. BioScience, 65(3):275–289, 2015.
  27. Network motifs: simple building blocks of complex networks. Science, 298(5594):824–827, 2002.
  28. A. Nadiri and F. W. Takes. A large-scale temporal analysis of user lifespan durability on the reddit social media platform. In Companion Proceedings of the Web Conference 2022, pages 677–685, 2022.
  29. Justifying recommendations using distantly-labeled reviews and fine-grained aspects. In Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP), pages 188–197, 2019.
  30. Taxonomies of networks from community structure. Physical Review E, 86(3):036104, 2012.
  31. Artificial intelligence, machine learning and health systems. Journal of global health, 8(2), 2018.
  32. Evolvegcn: Evolving graph convolutional networks for dynamic graphs. In Proceedings of the AAAI conference on artificial intelligence, volume 34: 04, pages 5363–5370, 2020.
  33. Towards better evaluation for dynamic link prediction. Advances in Neural Information Processing Systems, 35:32928–32941, 2022.
  34. Recipe for a general, powerful, scalable graph transformer. Advances in Neural Information Processing Systems, 35:14501–14515, 2022.
  35. Temporal graph networks for deep learning on dynamic graphs. arXiv preprint arXiv:2006.10637, 2020.
  36. Persistence in complex systems. Physics Reports, 957:1–73, 2022.
  37. Chartalist: Labeled graph datasets for utxo and account-based blockchains. In Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2022, NeurIPS 2022, November 29-December 1, 2022, New Orleans, LA, USA, pages 1–14, 2022.
  38. Chartalist: Labeled graph datasets for utxo and account-based blockchains. Advances in Neural Information Processing Systems, 35:34926–34939, 2022.
  39. A robust comparative analysis of graph neural networks on dynamic link prediction. IEEE Access, 10:64146–64160, 2022.
  40. Provably expressive temporal graph networks. Advances in Neural Information Processing Systems, 35:32257–32269, 2022.
  41. Crowdsourced air traffic data from the opensky network 2019–2020. Earth System Science Data, 13(2):357–366, 2021.
  42. Dyrep: Learning representations over dynamic graphs. In International conference on learning representations, 2019.
  43. Graph attention networks. arXiv preprint arXiv:1710.10903, 2017.
  44. Interht: Knowledge graph embeddings by interaction between head and tail entities. arXiv preprint arXiv:2202.04897, 2022.
  45. Tcl: Transformer-based dynamic graph modelling via contrastive learning. arXiv preprint arXiv:2105.07944, 2021.
  46. Inductive representation learning in temporal networks via causal anonymous walks. In International Conference on Learning Representations, 2021.
  47. Graph neural networks in recommender systems: a survey. ACM Computing Surveys, 55(5):1–37, 2022.
  48. Inductive representation learning on temporal graphs. In International Conference on Learning Representations, 2020.
  49. Discrete-time temporal network embedding via implicit hierarchical learning in hyperbolic space. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, pages 1975–1985, 2021.
  50. Algorithm and system co-design for efficient subgraph-based graph representation learning. Proceedings of the VLDB Endowment, 15(11):2788–2796, 2022.
  51. Roland: graph learning framework for dynamic graphs. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 2358–2366, 2022.
  52. Towards better dynamic graph learning: New architecture and unified library. arXiv preprint arXiv:2303.13047, 2023.
  53. Tgl: A general framework for temporal gnn training on billion-scale graphs. arXiv preprint arXiv:2203.14883, 2022.
Citations (61)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now