Muti-scale Graph Neural Network with Signed-attention for Social Bot Detection: A Frequency Perspective (2307.01968v1)
Abstract: The presence of a large number of bots on social media has adverse effects. The graph neural network (GNN) can effectively leverage the social relationships between users and achieve excellent results in detecting bots. Recently, more and more GNN-based methods have been proposed for bot detection. However, the existing GNN-based bot detection methods only focus on low-frequency information and seldom consider high-frequency information, which limits the representation ability of the model. To address this issue, this paper proposes a Multi-scale with Signed-attention Graph Filter for social bot detection called MSGS. MSGS could effectively utilize both high and low-frequency information in the social graph. Specifically, MSGS utilizes a multi-scale structure to produce representation vectors at different scales. These representations are then combined using a signed-attention mechanism. Finally, multi-scale representations via MLP after polymerization to produce the final result. We analyze the frequency response and demonstrate that MSGS is a more flexible and expressive adaptive graph filter. MSGS can effectively utilize high-frequency information to alleviate the over-smoothing problem of deep GNNs. Experimental results on real-world datasets demonstrate that our method achieves better performance compared with several state-of-the-art social bot detection methods.
- S. Cresci, R. D. Pietro, M. Petrocchi, A. Spognardi, and M. Tesconi, “The paradigm-shift of social spambots: Evidence, theories, and tools for the arms race,” Proceedings of the 26th International Conference on World Wide Web Companion, 2017.
- E. Ferrara, O. Varol, C. A. Davis, F. Menczer, and A. Flammini, “The rise of social bots,” Communications of the ACM, vol. 59, pp. 96 – 104, 2014.
- S. Cresci, R. D. Pietro, M. Petrocchi, A. Spognardi, and M. Tesconi, “Fame for sale: Efficient detection of fake twitter followers,” Decis. Support Syst., vol. 80, pp. 56–71, 2015.
- S. Feng, H. Wan, N. Wang, and M. Luo, “Botrgcn: Twitter bot detection with relational graph convolutional networks,” Proceedings of the 2021 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, 2021.
- S. Shi, K. Qiao, J. Yang, B. Song, J. Chen, and B. Yan, “Over-sampling strategy in feature space for graphs based class-imbalanced bot detection,” ArXiv, vol. abs/2302.06900, 2023.
- ——, “Rf-gnn: Random forest boosted graph neural network for social bot detection,” ArXiv, vol. abs/2304.08239, 2023.
- S. A. Alhosseini, R. B. Tareaf, P. Najafi, and C. Meinel, “Detect me if you can: Spam bot detection using inductive representation learning,” Companion Proceedings of The 2019 World Wide Web Conference, 2019.
- T. Kipf and M. Welling, “Semi-supervised classification with graph convolutional networks,” ArXiv, vol. abs/1609.02907, 2016.
- M. Schlichtkrull, T. Kipf, P. Bloem, R. van den Berg, I. Titov, and M. Welling, “Modeling relational data with graph convolutional networks,” in Extended Semantic Web Conference, 2017.
- D. Bo, X. Wang, C. Shi, and H. Shen, “Beyond low-frequency information in graph convolutional networks,” in AAAI Conference on Artificial Intelligence, 2021.
- L. Wu, H. Lin, B. Hu, C. Tan, Z. Gao, Z. Liu, and S. Z. Li, “Beyond homophily and homogeneity assumption: Relation-based frequency adaptive graph neural networks.” IEEE transactions on neural networks and learning systems, vol. PP, 2023.
- Y. Dong, K. Ding, B. Jalaeian, S. Ji, and J. Li, “Adagnn: Graph neural networks with adaptive frequency response filter,” Proceedings of the 30th ACM International Conference on Information & Knowledge Management, 2021.
- Z. Chai, S. You, Y. Yang, S. Pu, J. Xu, H. Cai, and W. Jiang, “Can abnormality be detected by graph neural networks?” in International Joint Conference on Artificial Intelligence, 2022.
- S. Ye, Z. Tan, Z. Lei, R. He, H. Wang, Q. Zheng, and M. Luo, “Hofa: Twitter bot detection with homophily-oriented augmentation and frequency adaptive attention,” ArXiv, vol. abs/2306.12870, 2023.
- S. Feng, H. Wan, N. Wang, J. Li, and M. Luo, “Twibot-20: A comprehensive twitter bot detection benchmark,” Proceedings of the 30th ACM International Conference on Information & Knowledge Management, 2021.
- S. Shi, K. Qiao, J. Chen, S. Yang, J. Yang, B. Song, L. Wang, and B. Yan, “Mgtab: A multi-relational graph-based twitter account detection benchmark,” ArXiv, vol. abs/2301.01123, 2023.
- A. Grover and J. Leskovec, “node2vec: Scalable feature learning for networks,” Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2016.
- J. Klicpera, A. Bojchevski, and S. Günnemann, “Predict then propagate: Graph neural networks meet personalized pagerank,” in International Conference on Learning Representations, 2018.
- F. Wu, T. Zhang, A. H. de Souza, C. Fifty, T. Yu, and K. Q. Weinberger, “Simplifying graph convolutional networks,” ArXiv, vol. abs/1902.07153, 2019.
- P. Velickovic, G. Cucurull, A. Casanova, A. Romero, P. Lio’, and Y. Bengio, “Graph attention networks,” ArXiv, vol. abs/1710.10903, 2017.
- S. Shi, K. Qiao, S. Yang, L. Wang, J. Chen, and B. Yan, “Boosting-gnn: Boosting algorithm for graph networks on imbalanced node classification,” Frontiers in Neurorobotics, vol. 15, 2021.
- S. Liu, H. Dong, L. Li, T. Xu, Y. Rong, P. Zhao, J. Huang, and D. Wu, “Local augmentation for graph neural networks,” in International Conference on Machine Learning, 2021.
- K. Xu, C. Li, Y. Tian, T. Sonobe, K. ichi Kawarabayashi, and S. Jegelka, “Representation learning on graphs with jumping knowledge networks,” in International Conference on Machine Learning, 2018.
- Z. Xiong and J. Cai, “Multi-scale graph convolutional networks with self-attention,” ArXiv, vol. abs/2112.03262, 2021.
- M. Fey and J. E. Lenssen, “Fast graph representation learning with pytorch geometric,” ArXiv, vol. abs/1903.02428, 2019.
- C. A. Davis, O. Varol, E. Ferrara, A. Flammini, and F. Menczer, “Botornot: A system to evaluate social bots,” Proceedings of the 25th International Conference Companion on World Wide Web, 2016.
- G. Stringhini, C. Krügel, and G. Vigna, “Detecting spammers on social networks,” in Asia-Pacific Computer Systems Architecture Conference, 2010.
- M. Hazim, N. B. Anuar, M. F. A. Razak, and N. A. B. Abdullah, “Detecting opinion spams through supervised boosting approach,” PLoS ONE, vol. 13, 2018.
- H. Shukla, N. Jagtap, and B. Patil, “Enhanced twitter bot detection using ensemble machine learning,” 2021 6th International Conference on Inventive Computation Technologies (ICICT), pp. 930–936, 2021.
- H. Ping and S. Qin, “A social bots detection model based on deep learning algorithm,” 2018 IEEE 18th International Conference on Communication Technology (ICCT), pp. 1435–1439, 2018.
- J. Wu, X. Ye, and Y. Man, “Bottrinet: A unified and efficient embedding for social bots detection via metric learning,” 2023 11th International Symposium on Digital Forensics and Security (ISDFS), pp. 1–6, 2023.
- L. Breiman, “Random forests,” Machine Learning, vol. 45, pp. 5–32, 2001.
- B. Perozzi, R. Al-Rfou, and S. Skiena, “Deepwalk: online learning of social representations,” Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, 2014.
- J. Bruna, W. Zaremba, A. D. Szlam, and Y. LeCun, “Spectral networks and locally connected networks on graphs,” CoRR, vol. abs/1312.6203, 2013.
- L. Page, S. Brin, R. Motwani, and T. Winograd, “The pagerank citation ranking : Bringing order to the web,” in The Web Conference, 1999.
- Shuhao Shi (7 papers)
- Kai Qiao (23 papers)
- Zhengyan Wang (1 paper)
- Jie Yang (516 papers)
- Baojie Song (4 papers)
- Jian Chen (257 papers)
- Bin Yan (138 papers)