Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Learning-Based Link Anomaly Detection in Continuous-Time Dynamic Graphs (2405.18050v2)

Published 28 May 2024 in cs.LG, cs.AI, and cs.CR

Abstract: Anomaly detection in continuous-time dynamic graphs is an emerging field yet under-explored in the context of learning algorithms. In this paper, we pioneer structured analyses of link-level anomalies and graph representation learning for identifying categorically anomalous graph links. First, we introduce a fine-grained taxonomy for edge-level anomalies leveraging structural, temporal, and contextual graph properties. Based on these properties, we introduce a method for generating and injecting typed anomalies into graphs. Next, we introduce a novel method to generate continuous-time dynamic graphs featuring consistencies across either or combinations of time, structure, and context. To enable temporal graph learning methods to detect specific types of anomalous links rather than the bare existence of a link, we extend the generic link prediction setting by: (1) conditioning link existence on contextual edge attributes; and (2) refining the training regime to accommodate diverse perturbations in the negative edge sampler. Comprehensive benchmarks on synthetic and real-world datasets -- featuring synthetic and labeled organic anomalies and employing six state-of-the-art link prediction methods -- validate our taxonomy and generation processes for anomalies and benign graphs, as well as our approach to adapting methods for anomaly detection. Our results reveal that different learning methods excel in capturing different aspects of graph normality and detecting different types of anomalies. We conclude with a comprehensive list of findings highlighting opportunities for future research.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (55)
  1. Emmanuel Abbe. Community detection and stochastic block models: recent developments. Journal of Machine Learning Research, 18(177):1–86, 2018.
  2. A survey of anomaly detection techniques in financial domain. Future Generation Computer Systems, 55:278–288, 2016.
  3. Outlier aware network embedding for attributed networks. In Proceedings of the AAAI conference on artificial intelligence, volume 33, pp.  12–19, 2019.
  4. Midas: Microcluster-based detector of anomalies in edge streams. In Proceedings of the AAAI conference on artificial intelligence, volume 34, pp.  3242–3249, 2020.
  5. Real-time anomaly detection in edge streams. ACM Transactions on Knowledge Discovery from Data (TKDD), 16(4):1–22, 2022.
  6. Anomaly detection in autonomous driving: A survey. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.  4488–4499, 2022.
  7. Structural temporal graph neural networks for anomaly detection in dynamic graphs. In Proceedings of the 30th ACM international conference on Information & Knowledge Management, pp.  3747–3756, 2021.
  8. On the properties of neural machine translation: Encoder–decoder approaches. In Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation, pp.  103–111, 2014.
  9. Do we really need complicated model architectures for temporal networks? In The Eleventh International Conference on Learning Representations, 2022.
  10. DARPA. Transparent computing engagement 3 data release. https://github.com/darpa-i2o/Transparent-Computing/blob/master/README-E3.md, 2020.
  11. Deep anomaly detection on attributed networks. In Proceedings of the 2019 SIAM International Conference on Data Mining, pp.  594–602. SIAM, 2019.
  12. Enhancing graph neural network-based fraud detectors against camouflaged fraudsters. In Proceedings of the 29th ACM international conference on information & knowledge management, pp.  315–324, 2020.
  13. Spotlight: Detecting anomalies in streaming graphs. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp.  1378–1386, 2018.
  14. Anomalydae: Dual autoencoder for anomaly detection on attributed networks. In ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.  5685–5689. IEEE, 2020.
  15. Detecting sensor faults, anomalies and outliers in the internet of things: A survey on the challenges and solutions. Electronics, 9(3):511, 2020.
  16. Dyngem: Deep embedding method for dynamic graphs. arXiv preprint arXiv:1805.11273, 2018.
  17. Adbench: Anomaly detection benchmark. In S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh (eds.), Advances in Neural Information Processing Systems, volume 35, pp.  32142–32159. Curran Associates, Inc., 2022. URL https://proceedings.neurips.cc/paper_files/paper/2022/file/cf93972b116ca5268827d575f2cc226b-Paper-Datasets_and_Benchmarks.pdf.
  18. An explainer for temporal graph neural networks. In GLOBECOM 2022-2022 IEEE Global Communications Conference, pp.  6384–6389. IEEE, 2022.
  19. Temporal graph benchmark for machine learning on temporal graphs. In Thirty-seventh Conference on Neural Information Processing Systems Datasets and Benchmarks Track, 2023a.
  20. Unsupervised graph outlier detection: Problem revisit, new insight, and superior method. In 2023 IEEE 39th International Conference on Data Engineering (ICDE), pp.  2565–2578. IEEE, 2023b.
  21. Neural temporal walks: Motif-aware representation learning on continuous-time dynamic graphs. Advances in Neural Information Processing Systems, 35:19874–19886, 2022.
  22. Alexander D. Kent. Cyber security data sources for dynamic network research, chapter Chapter 2, pp.  37–65. 2016. doi: 10.1142/9781786340757_0002. URL https://www.worldscientific.com/doi/abs/10.1142/9781786340757_0002.
  23. Euler: Detecting network lateral movement via scalable temporal link prediction. ACM Transactions on Privacy and Security, 2023.
  24. Adam: A method for stochastic optimization. In International Conference on Learning Representations (ICLR), San Diega, CA, USA, 2015.
  25. Predicting dynamic embedding trajectory in temporal interaction networks. In Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, pp.  1269–1278, 2019.
  26. Deep learning for community detection: Progress, challenges and opportunities. In Christian Bessiere (ed.), Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, IJCAI-20, pp.  4981–4987. International Joint Conferences on Artificial Intelligence Organization, 7 2020. doi: 10.24963/ijcai.2020/693. URL https://doi.org/10.24963/ijcai.2020/693. Survey track.
  27. Bond: Benchmarking unsupervised outlier node detection on static attributed graphs. Advances in Neural Information Processing Systems, 35:27021–27035, 2022.
  28. Graph neural networks for temporal graphs: State of the art, open challenges, and opportunities. Transactions on Machine Learning Research, 2023. ISSN 2835-8856. URL https://openreview.net/forum?id=pHCdMat0gI.
  29. A comprehensive survey on graph anomaly detection with deep learning. IEEE Transactions on Knowledge and Data Engineering, 2021.
  30. Addag-ae: Anomaly detection in dynamic attributed graph based on graph attention network and lstm autoencoder. Electronics, 12(13):2763, 2023.
  31. A large-scale temporal analysis of user lifespan durability on the reddit social media platform. In Companion Proceedings of the Web Conference 2022, pp.  677–685, 2022.
  32. Continuous-time dynamic network embeddings. In Companion proceedings of the the web conference 2018, pp.  969–976, 2018.
  33. A survey on outlier explanations. The VLDB Journal, 31(5):977–1008, 2022.
  34. Patterns and dynamics of users’ behavior and interaction: Network analysis of an online community. Journal of the American Society for Information Science and Technology, 60(5):911–932, 2009.
  35. Anomalous: A joint modeling approach for anomaly detection on attributed networks. In IJCAI, pp.  3513–3519, 2018.
  36. Linguistic inquiry and word count: Liwc 2001. Mahway: Lawrence Erlbaum Associates, 71(2001):2001, 2001.
  37. Towards better evaluation for dynamic link prediction. volume 35, pp.  32928–32941, 2022.
  38. Anomaly detection in continuous-time temporal provenance graphs. In Temporal Graph Learning Workshop @ NeurIPS 2023, 2023. URL https://openreview.net/forum?id=88tGIxxhsf.
  39. Temporal graph networks for deep learning on dynamic graphs. arXiv preprint arXiv:2006.10637, 2020.
  40. The enron email dataset database schema and brief statistical report. Information sciences institute technical report, University of Southern California, 4(1):120–128, 2004.
  41. Provably expressive temporal graph networks. Advances in Neural Information Processing Systems, 35:32257–32269, 2022.
  42. Benchmarking unsupervised outlier detection with realistic synthetic data. ACM Transactions on Knowledge Discovery from Data (TKDD), 15(4):1–20, 2021.
  43. Iot healthcare analytics: The importance of anomaly detection. In 2016 IEEE 30th international conference on advanced information networking and applications (AINA), pp.  994–997. IEEE, 2016.
  44. Attention is all you need. Advances in neural information processing systems, 30, 2017.
  45. On the limit of explaining black-box temporal graph neural networks. arXiv preprint arXiv:2212.00952, 2022.
  46. Tcl: Transformer-based dynamic graph modelling via contrastive learning. arXiv preprint arXiv:2105.07944, 2021.
  47. Inductive representation learning in temporal networks via causal anonymous walks. In International Conference on Learning Representations, 2020.
  48. Explaining temporal graph models through an explorer-navigator framework. In The Eleventh International Conference on Learning Representations, 2022.
  49. Contrastive attributed network anomaly detection with data augmentation. In Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp.  444–457. Springer, 2022.
  50. Discovering opinion spammer groups by network footprints. In Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2015, Porto, Portugal, September 7-11, 2015, Proceedings, Part I 15, pp.  267–282. Springer, 2015.
  51. Towards better dynamic graph learning: New architecture and unified library. In Thirty-seventh Conference on Neural Information Processing Systems, 2023. URL https://openreview.net/forum?id=xHNzWHbklj.
  52. Higher-order structure based anomaly detection on attributed networks. In 2021 IEEE International Conference on Big Data (Big Data), pp.  2691–2700. IEEE, 2021.
  53. Pyod: A python toolbox for scalable outlier detection. Journal of Machine Learning Research, 20(96):1–7, 2019. URL http://jmlr.org/papers/v20/19-011.html.
  54. Addgraph: Anomaly detection in dynamic graph using attention-based temporal gcn. In IJCAI, volume 3, pp.  7, 2019.
  55. Provenance-based intrusion detection systems: A survey. ACM Computing Surveys, 55(7):1–36, 2022.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (4)
  1. Tim Poštuvan (5 papers)
  2. Claas Grohnfeldt (6 papers)
  3. Michele Russo (5 papers)
  4. Giulio Lovisotto (15 papers)

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets