Spatial-Temporal Graph Learning with Adversarial Contrastive Adaptation (2306.10683v1)
Abstract: Spatial-temporal graph learning has emerged as a promising solution for modeling structured spatial-temporal data and learning region representations for various urban sensing tasks such as crime forecasting and traffic flow prediction. However, most existing models are vulnerable to the quality of the generated region graph due to the inaccurate graph-structured information aggregation schema. The ubiquitous spatial-temporal data noise and incompleteness in real-life scenarios pose challenges in generating high-quality region representations. To address this challenge, we propose a new spatial-temporal graph learning model (GraphST) for enabling effective self-supervised learning. Our proposed model is an adversarial contrastive learning paradigm that automates the distillation of crucial multi-view self-supervised information for robust spatial-temporal graph augmentation. We empower GraphST to adaptively identify hard samples for better self-supervision, enhancing the representation discrimination ability and robustness. In addition, we introduce a cross-view contrastive learning paradigm to model the inter-dependencies across view-specific region representations and preserve underlying relation heterogeneity. We demonstrate the superiority of our proposed GraphST method in various spatial-temporal prediction tasks on real-life datasets. We release our model implementation via the link: \url{https://github.com/HKUDS/GraphST}.
- Convex optimization. Cambridge university press, 2004.
- Ftpg: A fine-grained traffic prediction method with graph attention network using big trace data. Transactions on Intelligent Transportation Systems (TITS), 2021.
- Dplink: User identity linkage via deep neural network from heterogeneous mobility data. In The Web Conference (WWW), pp. 459–469, 2019.
- Adversarial graph contrastive learning with information regularization. In The Web Conference (WWW), pp. 1362–1371, 2022.
- Efficient region embedding with multi-view spatial networks: A perspective of locality-constrained spatial autocorrelations. In International Conference on Artificial Intelligence (AAAI), volume 33, pp. 906–913, 2019.
- node2vec: Scalable feature learning for networks. In International Conference on Knowledge Discovery and Data Mining (KDD), pp. 855–864, 2016.
- Inductive representation learning on large graphs. In International Conference on Neural Information Processing Systems (NeurIPS), volume 30, 2017.
- Graph structure learning for robust graph neural networks. In International Conference on Knowledge Discovery and Data Mining (KDD), pp. 66–74, 2020.
- Variational graph auto-encoders. arXiv preprint arXiv:1611.07308, 2016.
- Semi-supervised classification with graph convolutional networks. In International Conference on Learning Representations (ICLR), 2017.
- Disentangled contrastive learning on graphs. In International Conference on Neural Information Processing Systems (NeurIPS), volume 34, pp. 21872–21884, 2021.
- Spatial-temporal fusion graph neural networks for traffic flow forecasting. In International Conference on Artificial Intelligence (AAAI), pp. 4189–4196, 2021.
- Let invariant rationale discovery inspire graph contrastive learning. In International Conference on Machine Learning (ICML), pp. 13052–13065. PMLR, 2022a.
- Diffusion convolutional recurrent neural network: Data-driven traffic forecasting. In International Conference on Learning Representations (ICLR), 2018.
- Spatial-temporal hypergraph self-supervised learning for crime prediction. In International Conference on Data Engineering (ICDE), pp. 2984–2996. IEEE, 2022b.
- Hierarchical multi-task graph recurrent network for next poi recommendation. In International Conference on Research and Development in Information Retrieval (SIGIR), 2022.
- Prototypical graph contrastive learning. Transactions on Neural Networks and Learning Systems (TNNLS), 2022.
- Urban traffic prediction from spatio-temporal data using deep meta learning. In International Conference on Knowledge Discovery and Data Mining (KDD), pp. 1720–1730, 2019.
- Category-aware location embedding for point-of-interest recommendation. In International Conference on Research and Development in Information Retrieval (SIGIR), pp. 173–176, 2019.
- A simple way to make neural networks robust against diverse image corruptions. In European Conference on Computer Vision (ECCV), pp. 53–69. Springer, 2020.
- What makes for good views for contrastive learning? In International Conference on Neural Information Processing Systems (NeurIPS), pp. 6827–6839, 2020.
- Graph attention networks. In International Conference on Learning Representations (ICLR), 2018.
- Hagen: Homophily-aware graph convolutional recurrent network for crime forecasting. In International Conference on Artificial Intelligence (AAAI), volume 36, pp. 4193–4200, 2022.
- Region representation learning via mobility flow. In Conference on Information and Knowledge Management (CIKM), pp. 237–246, 2017.
- Towards a unified min-max framework for adversarial exploration and robustness. In Conference on Neural Information Processing Systems (NeurIPS), 2019.
- Multi-graph fusion networks for urban region embedding. In International Joint Conference on Artificial Intelligence (IJCAI), 2022.
- Spatial-temporal sequential hypergraph network for crime prediction with dynamic multiplex relation learning. In International Joint Conference on Artificial Intelligence (IJCAI), pp. 1631–1637.
- Graph-less collaborative filtering. In The Web Conference (WWW), pp. 17–27, 2023.
- Infogcl: Information-aware graph contrastive learning. International Conference on Neural Information Processing Systems (NeurIPS), 34:30414–30425, 2021.
- Topology attack and defense for graph neural networks: An optimization perspective. arXiv preprint arXiv:1906.04214, 2019.
- Getnext: trajectory flow map enhanced transformer for next poi recommendation. In International Conference on Research and Development in Information Retrieval (SIGIR), pp. 1144–1153, 2022.
- Representing urban functions through zone embedding with human mobility patterns. In International Joint Conference on Artificial Intelligence (IJCAI), 2018.
- St-mvl: filling missing values in geo-sensory time series data. In International Joint Conference on Artificial Intelligence (IJCAI), 2016.
- Autogcl: Automated graph contrastive learning via learnable view generators. In International Conference on Artificial Intelligence (AAAI), volume 36, pp. 8892–8900, 2022.
- Graph contrastive learning with augmentations. International Conference on Neural Information Processing Systems (NeurIPS), 33:5812–5823, 2020.
- Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting. In International Joint Conference on Artificial Intelligence (IJCAI), 2018.
- Multi-view joint graph representation learning for urban region embedding. In International Joint Conference on Artificial Intelligence (IJCAI), pp. 4431–4437, 2021a.
- Spatio-temporal graph structure learning for traffic forecasting. In International Conference on Artificial Intelligence (AAAI), volume 34, pp. 1177–1185, 2020.
- Automated spatio-temporal graph contrastive learning. In Proceedings of the ACM Web Conference 2023, pp. 295–305, 2023.
- Traffic flow forecasting with spatial-temporal graph diffusion network. In AAAI Conference on Artificial Intelligence (AAAI), pp. 15008–15015, 2021b.
- Unifying inter-region autocorrelation and intra-region structures for spatial embedding via collective adversarial learning. In International Conference on Knowledge Discovery and Data Mining (KDD), pp. 1700–1708, 2019.
- Gman: A graph multi-attention network for traffic prediction. In International Conference on Artificial Intelligence (AAAI), volume 34, pp. 1234–1241, 2020.
- Topic-enhanced memory networks for personalised point-of-interest recommendation. In Conference on Knowledge Discovery and Data Mining (KDD), pp. 3018–3028, 2019.
- Riskoracle: a minute-level citywide traffic accident forecasting framework. In AAAI Conference on Artificial Intelligence (AAAI), volume 34, pp. 1258–1265, 2020.
- Greto: Remedying dynamic graph topology-task discordance via target homophily. In International Conference on Learning Representations (ICLR), 2023.
- Graph contrastive learning with adaptive augmentation. In The Web Conference (WWW), pp. 2069–2080, 2021.
- Qianru Zhang (25 papers)
- Chao Huang (244 papers)
- Lianghao Xia (65 papers)
- Zheng Wang (400 papers)
- Siuming Yiu (4 papers)
- Ruihua Han (17 papers)