HierCas: Hierarchical Temporal Graph Attention Networks for Popularity Prediction in Information Cascades (2310.13219v2)
Abstract: Information cascade popularity prediction is critical for many applications, including but not limited to identifying fake news and accurate recommendations. Traditional feature-based methods heavily rely on handcrafted features, which are domain-specific and lack generalizability to new domains. To address this problem, researchers have turned to neural network-based approaches. However, most existing methods follow a sampling-based modeling approach, potentially losing continuous dynamic information that emerges during the information diffusion process. In this paper, we propose Hierarchical Temporal Graph Attention Networks for cascade popularity prediction (HierCas), which operates on the entire cascade graph by a dynamic graph modeling approach. By leveraging time-aware node embedding, graph attention mechanisms, and hierarchical pooling structures, HierCas effectively captures the popularity trend implicit in the complex cascade. Extensive experiments conducted on two real-world datasets in different scenarios demonstrate that our HierCas significantly outperforms the state-of-the-art approaches. We have released our code at https://github.com/Daisy-zzz/HierCas.
- P. A. Dow, L. Adamic, and A. Friggeri, “The anatomy of large facebook cascades,” in Proceedings of the International AAAI Conference on Web and Social Media, 2013, pp. 145–154.
- K. AlFalahi, Y. Atif, and A. Abraham, “Models of influence in online social networks,” International Journal of Intelligent Systems, pp. 161–183, 2014.
- D. M. J. Lazer, M. A. Baum, Y. Benkler, A. J. Berinsky, K. M. Greenhill, F. Menczer, M. J. Metzger, B. Nyhan, G. Pennycook, D. Rothschild, M. Schudson, S. A. Sloman, C. R. Sunstein, E. A. Thorson, D. J. Watts, and J. L. Zittrain, “The science of fake news,” Science, pp. 1094–1096, 2018.
- N. Ta, K. Li, Y. Yang, F. Jiao, Z. Tang, and G. Li, “Evaluating public anxiety for topic-based communities in social networks,” IEEE Transactions on Knowledge and Data Engineering, pp. 1191–1205, 2022.
- J. Qiu, J. Tang, H. Ma, Y. Dong, K. Wang, and J. Tang, “Deepinf: Social influence prediction with deep learning,” in Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2018, p. 2110–2119.
- C. Yang, J. Tang, M. Sun, G. Cui, and Z. Liu, “Multi-scale information diffusion prediction with reinforced recurrent networks,” in Proceedings of the 28th International Joint Conference on Artificial Intelligence, 2019, p. 4033–4039.
- C. Li, J. Ma, X. Guo, and Q. Mei, “Deepcas: An end-to-end predictor of information cascades,” in Proceedings of the 26th International Conference on World Wide Web, 2017, p. 577–586.
- Q. Cao, H. Shen, K. Cen, W. Ouyang, and X. Cheng, “Deephawkes: Bridging the gap between prediction and understanding of information cascades,” in Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, 2017, p. 1149–1158.
- X. Chen, F. Zhou, K. Zhang, G. Trajcevski, T. Zhong, and F. Zhang, “Information diffusion prediction via recurrent cascades convolution,” in 2019 IEEE 35th international conference on data engineering (ICDE). IEEE, 2019, pp. 770–781.
- G. Szabo and B. A. Huberman, “Predicting the popularity of online content,” Commun. ACM, p. 80–88, 2010.
- H. Pinto, J. M. Almeida, and M. A. Gonçalves, “Using early view patterns to predict the popularity of youtube videos,” in Proceedings of the Sixth ACM International Conference on Web Search and Data Mining, 2013, p. 365–374.
- J. Cheng, L. Adamic, P. A. Dow, J. M. Kleinberg, and J. Leskovec, “Can cascades be predicted?” in Proceedings of the 23rd International Conference on World Wide Web, 2014, p. 925–936.
- B. Shulman, A. Sharma, and D. Cosley, “Predictability of popularity: Gaps between prediction and understanding,” in International Conference on Web and Social Media, 2016.
- W. Ding, Y. Shang, L. Guo, X. Hu, R. Yan, and T. He, “Video popularity prediction by sentiment propagation via implicit network,” in Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, 2015, p. 1621–1630.
- B. Chang, H. Zhu, Y. Ge, E. Chen, H. Xiong, and C. Tan, “Predicting the popularity of online serials with autoregressive models,” in Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, 2014, p. 1339–1348.
- B. Perozzi, R. Al-Rfou, and S. Skiena, “Deepwalk: Online learning of social representations,” in Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2014, p. 701–710.
- J. Wang, V. W. Zheng, Z. Liu, and K. C.-C. Chang, “Topological recurrent neural network for diffusion prediction,” in 2017 IEEE international conference on data mining (ICDM), 2017, pp. 475–484.
- Y. Wang, H. Shen, S. Liu, J. Gao, and X. Cheng, “Cascade dynamics modeling with attention-based recurrent neural network,” in Proceedings of the 26th International Joint Conference on Artificial Intelligence, 2017, p. 2985–2991.
- X. Tang, D. Liao, W. Huang, J. Xu, L. Zhu, and M. Shen, “Fully exploiting cascade graphs for real-time forwarding prediction,” in Proceedings of the AAAI Conference on Artificial Intelligence, 2021.
- C. Zhong, F. Xiong, S. Pan, L. Wang, and X. Xiong, “Hierarchical attention neural network for information cascade prediction,” Information Sciences, pp. 1109–1127, 2023.
- M. Wang and K. Li, “Predicting information diffusion cascades using graph attention networks,” in Neural Information Processing: 27th International Conference, ICONIP 2020, Bangkok, Thailand, November 18–22, 2020, Proceedings, Part IV 27, 2020, pp. 104–112.
- Y. Wang, X. Wang, Y. Ran, R. Michalski, and T. Jia, “Casseqgcn: Combining network structure and temporal sequence to predict information cascades,” Expert Systems with Applications, 2022.
- X. Chen, F. Zhang, F. Zhou, and M. Bonsangue, “Multi‐scale graph capsule with influence attention for information cascades prediction,” Int. J. Intell. Syst., p. 2584–2611, 2022.
- X. Xu, F. Zhou, K. Zhang, S. Liu, and G. Trajcevski, “Casflow: Exploring hierarchical structures and propagation uncertainty for cascade prediction,” IEEE Transactions on Knowledge and Data Engineering, pp. 3484–3499, 2023.
- Z. Huang, Z. Wang, and R. Zhang, “Cascade2vec: Learning dynamic cascade representation by recurrent graph neural networks,” IEEE Access, pp. 144 800–144 812, 2019.
- F. Zhou, X. Xu, K. Zhang, G. Trajcevski, and T. Zhong, “Variational information diffusion for probabilistic cascades prediction,” in IEEE INFOCOM 2020-IEEE Conference on Computer Communications. IEEE, 2020, pp. 1618–1627.
- Z. Xu, M. Qian, X. Huang, and J. Meng, “Casgcn: Predicting future cascade growth based on information diffusion graph,” 2020.
- X. Lu, S. Ji, L. Yu, L. Sun, B. Du, and T. Zhu, “Continuous-time graph learning for cascade popularity prediction,” 2023.
- S. Ji, X. Lu, M. Liu, L. Sun, C. Liu, B. Du, and H. Xiong, “Community-based dynamic graph learning for popularity prediction,” in Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2023, p. 930–940.
- D. Xu, C. Ruan, E. Korpeoglu, S. Kumar, and K. Achan, “Inductive representation learning on temporal graphs,” in International Conference on Learning Representations (ICLR), 2020.
- S. Mishra, M.-A. Rizoiu, and L. Xie, “Feature driven and point process approaches for popularity prediction,” in Proceedings of the 25th ACM International on Conference on Information and Knowledge Management, 2016, p. 1069–1078.