Dynamic Hypergraph Structure Learning for Traffic Flow Forecasting (2309.12028v1)
Abstract: This paper studies the problem of traffic flow forecasting, which aims to predict future traffic conditions on the basis of road networks and traffic conditions in the past. The problem is typically solved by modeling complex spatio-temporal correlations in traffic data using spatio-temporal graph neural networks (GNNs). However, the performance of these methods is still far from satisfactory since GNNs usually have limited representation capacity when it comes to complex traffic networks. Graphs, by nature, fall short in capturing non-pairwise relations. Even worse, existing methods follow the paradigm of message passing that aggregates neighborhood information linearly, which fails to capture complicated spatio-temporal high-order interactions. To tackle these issues, in this paper, we propose a novel model named Dynamic Hypergraph Structure Learning (DyHSL) for traffic flow prediction. To learn non-pairwise relationships, our DyHSL extracts hypergraph structural information to model dynamics in the traffic networks, and updates each node representation by aggregating messages from its associated hyperedges. Additionally, to capture high-order spatio-temporal relations in the road network, we introduce an interactive graph convolution block, which further models the neighborhood interaction for each node. Finally, we integrate these two views into a holistic multi-scale correlation extraction module, which conducts temporal pooling with different scales to model different temporal patterns. Extensive experiments on four popular traffic benchmark datasets demonstrate the effectiveness of our proposed DyHSL compared with a broad range of competing baselines.
- X. Wu, D. Zhang, C. Guo, C. He, B. Yang, and C. S. Jensen, “Autocts: Automated correlated time series forecasting,” Proceedings of the VLDB Endowment, vol. 15, no. 4, pp. 971–983, 2021.
- J. Ji, J. Wang, Z. Jiang, J. Jiang, and H. Zhang, “Stden: Towards physics-guided neural networks for traffic flow prediction,” in Proceedings of the AAAI Conference on Artificial Intelligence, 2022.
- R. Wang, R. Walters, and R. Yu, “Physics-guided deep learning for spatiotemporal forecasting,” in Proceedings of the Conference on Knowledge-Guided Machine Learning. Chapman and Hall/CRC, 2022, pp. 179–210.
- Z. Huang, Y. Sun, and W. Wang, “Coupled Graph ODE for Learning Interacting System Dynamics,” in Proceedings of the International ACM SIGKDD Conference on Knowledge Discovery & Data Mining, 2021.
- S. Zheng, Z. Gao, W. Cao, J. Bian, and T.-Y. Liu, “Hierst: A unified hierarchical spatial-temporal framework for covid-19 trend forecasting,” in Proceedings of the International Conference on Information and Knowledge Management, 2021, pp. 4383–4392.
- F. Li, J. Feng, H. Yan, G. Jin, F. Yang, F. Sun, D. Jin, and Y. Li, “Dynamic graph convolutional recurrent network for traffic prediction: Benchmark and solution,” ACM Transactions on Knowledge Discovery from Data, 2022.
- X. Di and R. Shi, “A survey on autonomous vehicle control in the era of mixed-autonomy: From physics-based to ai-guided driving policy learning,” Transportation Research Part C: Emerging Technologies, vol. 125, p. 103008, 2021.
- Z. Mo, R. Shi, and X. Di, “A physics-informed deep learning paradigm for car-following models,” Transportation research part C: emerging technologies, vol. 130, p. 103240, 2021.
- B. M. Williams and L. A. Hoel, “Modeling and forecasting vehicular traffic flow as a seasonal arima process: Theoretical basis and empirical results,” Journal of Transportation Engineering, vol. 129, no. 6, pp. 664–672, 2003.
- Z. Sun and G. Fox, “Traffic flow forecasting based on combination of multidimensional scaling and svm,” International Journal of Intelligent Transportation Systems Research, vol. 12, no. 1, pp. 20–25, 2014.
- T. N. Kipf and M. Welling, “Semi-supervised classification with graph convolutional networks,” in arXiv, 2016.
- Y. Li, R. Yu, C. Shahabi, and Y. Liu, “Diffusion convolutional recurrent neural network: Data-driven traffic forecasting,” in Proceedings of the International Conference on Learning Representations, 2018.
- Z. Wu, S. Pan, G. Long, J. Jiang, and C. Zhang, “Graph wavenet for deep spatial-temporal graph modeling,” in Proceedings of the International Joint Conference on Artificial Intelligence, 2019.
- C. Zheng, X. Fan, C. Wang, and J. Qi, “Gman: A graph multi-attention network for traffic prediction,” in Proceedings of the AAAI Conference on Artificial Intelligence, 2020, pp. 1234–1241.
- Z. Wu, S. Pan, G. Long, J. Jiang, X. Chang, and C. Zhang, “Connecting the dots: Multivariate time series forecasting with graph neural networks,” in Proceedings of the International ACM SIGKDD Conference on Knowledge Discovery & Data Mining, 2020, pp. 753–763.
- P. Veličković, G. Cucurull, A. Casanova, A. Romero, P. Lio, and Y. Bengio, “Graph attention networks,” in Proceedings of the International Conference on Learning Representations, 2017.
- Z. Fang, L. Xu, G. Song, Q. Long, and Y. Zhang, “Polarized graph neural networks,” in Proceedings of the Web Conference, 2022, pp. 1404–1413.
- X. Luo, W. Ju, M. Qu, C. Chen, M. Deng, X.-S. Hua, and M. Zhang, “Dualgraph: Improving semi-supervised graph classification via dual contrastive learning,” in Proceedings of the IEEE Conference on Data Engineering, 2022, pp. 699–712.
- F. Hu, Y. Zhu, S. Wu, W. Huang, L. Wang, and T. Tan, “Graphair: Graph representation learning with neighborhood aggregation and interaction,” Pattern Recognition, vol. 112, p. 107745, 2021.
- W. Ju, Y. Qin, Z. Qiao, X. Luo, Y. Wang, Y. Fu, and M. Zhang, “Kernel-based substructure exploration for next poi recommendation,” arXiv preprint arXiv:2210.03969, 2022.
- X. Luo, W. Ju, M. Qu, Y. Gu, C. Chen, M. Deng, X.-S. Hua, and M. Zhang, “Clear: Cluster-enhanced contrast for self-supervised graph representation learning,” IEEE Transactions on Neural Networks and Learning Systems, 2022.
- W. Ju, X. Luo, Z. Ma, J. Yang, M. Deng, and M. Zhang, “Ghnn: Graph harmonic neural networks for semi-supervised graph-level classification,” Neural Networks, vol. 151, pp. 70–79, 2022.
- H. Zhu, F. Feng, X. He, X. Wang, Y. Li, K. Zheng, and Y. Zhang, “Bilinear graph neural network with neighbor interactions,” in Proceedings of the International Joint Conference on Artificial Intelligence, 2020.
- M. Zhang and Y. Chen, “Link prediction based on graph neural networks,” in Proceedings of the Conference on Neural Information Processing Systems, 2018.
- J. Gilmer, S. S. Schoenholz, P. F. Riley, O. Vinyals, and G. E. Dahl, “Neural message passing for quantum chemistry,” in Proceedings of the International Conference on Machine Learning, 2017.
- W. Jin, T. Derr, Y. Wang, Y. Ma, Z. Liu, and J. Tang, “Node similarity preserving graph convolutional networks,” in Proceedings of the International ACM Conference on Web Search & Data Mining, 2021, pp. 148–156.
- J. Yang, P. Zhao, Y. Rong, C. Yan, C. Li, H. Ma, and J. Huang, “Hierarchical graph capsule network,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 12, 2021, pp. 10 603–10 611.
- Y. Gao, Z. Zhang, H. Lin, X. Zhao, S. Du, and C. Zou, “Hypergraph learning: Methods and practices,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020.
- Y. Yang, C. Huang, L. Xia, Y. Liang, Y. Yu, and C. Li, “Multi-behavior hypergraph-enhanced transformer for sequential recommendation,” in arXiv, 2022.
- L. Xia, C. Huang, Y. Xu, J. Zhao, D. Yin, and J. Huang, “Hypergraph contrastive collaborative filtering,” in Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval, 2022.
- D. Li, Z. Xu, S. Li, and X. Sun, “Link prediction in social networks based on hypergraph,” in Proceedings of the Web Conference, 2013.
- I. Chien, C.-Y. Lin, and I.-H. Wang, “Community detection in hypergraphs: Optimal statistical limit and efficient algorithms,” 2018.
- P. Li and O. Milenkovic, “Submodular hypergraphs: p-laplacians, cheeger inequalities and spectral clustering,” in Proceedings of the International Conference on Machine Learning, 2018.
- Y. Feng, H. You, Z. Zhang, R. Ji, and Y. Gao, “Hypergraph neural networks,” in Proceedings of the AAAI conference on artificial intelligence, vol. 33, no. 01, 2019, pp. 3558–3565.
- J. Jiang, Y. Wei, Y. Feng, J. Cao, and Y. Gao, “Dynamic hypergraph neural networks.” in Proceedings of the International Joint Conference on Artificial Intelligence, 2019, pp. 2635–2641.
- N. Yin, F. Feng, Z. Luo, X. Zhang, W. Wang, X. Luo, C. Chen, and X.-S. Hua, “Dynamic hypergraph convolutional network,” in Proceedings of the IEEE Conference on Data Engineering, 2022.
- W. Zhao, Y. Gao, T. Ji, X. Wan, F. Ye, and G. Bai, “Deep temporal convolutional networks for short-term traffic flow forecasting,” IEEE Access, vol. 7, pp. 114 496–114 507, 2019.
- R.-G. Cirstea, B. Yang, C. Guo, T. Kieu, and S. Pan, “Towards spatio-temporal aware traffic time series forecasting,” in Proceedings of the IEEE Conference on Data Engineering, 2022, pp. 2900–2913.
- R.-G. Cirstea, C. Guo, B. Yang, T. Kieu, X. Dong, and S. Pan, “Triformer: Triangular, variable-specific attentions for long sequence multivariate time series forecasting,” in Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, 2022, pp. 1994–2001.
- Z. Li, C. Huang, L. Xia, Y. Xu, and J. Pei, “Spatial-temporal hypergraph self-supervised learning for crime prediction,” arXiv preprint arXiv:2204.08587, 2022.
- Y. Liang, Z. Cui, Y. Tian, H. Chen, and Y. Wang, “A deep generative adversarial architecture for network-wide spatial-temporal traffic-state estimation,” Transportation Research Record, vol. 2672, no. 45, pp. 87–105, 2018.
- X. Luo, D. Li, Y. Yang, and S. Zhang, “Spatiotemporal traffic flow prediction with knn and lstm,” Journal of Advanced Transportation, vol. 2019, 2019.
- C. Song, Y. Lin, S. Guo, and H. Wan, “Spatial-temporal synchronous graph convolutional networks: A new framework for spatial-temporal network data forecasting,” in Proceedings of the AAAI Conference on Artificial Intelligence, 2020, pp. 914–921.
- S. Guo, Y. Lin, N. Feng, C. Song, and H. Wan, “Attention based spatial-temporal graph convolutional networks for traffic flow forecasting,” in Proceedings of the AAAI Conference on Artificial Intelligence, 2019, pp. 922–929.
- J. Li, Z. Han, H. Cheng, J. Su, P. Wang, J. Zhang, and L. Pan, “Predicting path failure in time-evolving graphs,” in Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2019, pp. 1279–1289.
- J. Yi and J. Park, “Hypergraph convolutional recurrent neural network,” in Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2020, pp. 3366–3376.
- J. Wang, Y. Zhang, Y. Wei, Y. Hu, X. Piao, and B. Yin, “Metro passenger flow prediction via dynamic hypergraph convolution networks,” IEEE Transactions on Intelligent Transportation Systems, vol. 22, no. 12, pp. 7891–7903, 2021.
- Z. Fang, Q. Long, G. Song, and K. Xie, “Spatial-temporal graph ode networks for traffic flow forecasting,” in Proceedings of the International ACM SIGKDD Conference on Knowledge Discovery & Data Mining, 2021.
- I. Sutskever, O. Vinyals, and Q. V. Le, “Sequence to sequence learning with neural networks,” in Proceedings of the Conference on Neural Information Processing Systems, 2014, pp. 3104–3112.
- S. Hochreiter and J. Schmidhuber, “Long short-term memory,” Neural Computation, vol. 9, no. 8, pp. 1735–1780, 1997.
- S. Bai, J. Z. Kolter, and V. Koltun, “An empirical evaluation of generic convolutional and recurrent networks for sequence modeling,” arXiv:1803.01271, 2018.
- K. Cho, B. van Merrienboer, D. Bahdanau, and Y. Bengio, “On the properties of neural machine translation: Encoder-decoder approaches,” in SSST@EMNLP, 2014.
- S. Huang, D. Wang, X. Wu, and A. Tang, “Dsanet: Dual self-attention network for multivariate time series forecasting,” in CIKM, November 2019.
- B. Yu, H. Yin, and Z. Zhu, “Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting,” in IJCAI, 7 2018. [Online]. Available: https://doi.org/10.24963/ijcai.2018/505
- L. Bai, L. Yao, S. S. Kanhere, X. Wang, and Q. Z. Sheng, “Stg2seq: Spatial-temporal graph to sequence model for multi-step passenger demand forecasting,” in IJCAI, 7 2019. [Online]. Available: https://doi.org/10.24963/ijcai.2019/274
- R. Huang, C. Huang, Y. Liu, G. Dai, and W. Kong, “Lsgcn: Long short-term traffic prediction with graph convolutional networks.” in IJCAI, 2020, pp. 2355–2361.
- L. Bai, L. Yao, C. Li, X. Wang, and C. Wang, “Adaptive graph convolutional recurrent network for traffic forecasting,” Advances in neural information processing systems, vol. 33, pp. 17 804–17 815, 2020.
- M. Li and Z. Zhu, “Spatial-temporal fusion graph neural networks for traffic flow forecasting,” in AAAI, May 2021.
- Z. Fang, Q. Long, G. Song, and K. Xie, “Spatial-temporal graph ode networks for traffic flow forecasting,” in KDD, 2021.
- Y. Chen, I. Segovia-Dominguez, and Y. R. Gel, “Z-gcnets: Time zigzags at graph convolutional networks for time series forecasting,” in ICML, 2021.
- J. Choi, H. Choi, J. Hwang, and N. Park, “Graph neural controlled differential equations for traffic forecasting,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 36, no. 6, 2022, pp. 6367–6374.
- S. Lan, Y. Ma, W. Huang, W. Wang, H. Yang, and P. Li, “Dstagnn: Dynamic spatial-temporal aware graph neural network for traffic flow forecasting,” in International Conference on Machine Learning. PMLR, 2022, pp. 11 906–11 917.
- D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” in arXiv, 2014.