SeBot: Structural Entropy Guided Multi-View Contrastive Learning for Social Bot Detection (2405.11225v1)
Abstract: Recent advancements in social bot detection have been driven by the adoption of Graph Neural Networks. The social graph, constructed from social network interactions, contains benign and bot accounts that influence each other. However, previous graph-based detection methods that follow the transductive message-passing paradigm may not fully utilize hidden graph information and are vulnerable to adversarial bot behavior. The indiscriminate message passing between nodes from different categories and communities results in excessively homogeneous node representations, ultimately reducing the effectiveness of social bot detectors. In this paper, we propose SEBot, a novel multi-view graph-based contrastive learning-enabled social bot detector. In particular, we use structural entropy as an uncertainty metric to optimize the entire graph's structure and subgraph-level granularity, revealing the implicitly existing hierarchical community structure. And we design an encoder to enable message passing beyond the homophily assumption, enhancing robustness to adversarial behaviors of social bots. Finally, we employ multi-view contrastive learning to maximize mutual information between different views and enhance the detection performance through multi-task learning. Experimental results demonstrate that our approach significantly improves the performance of social bot detection compared with SOTA methods.
- Detect me if you can: Spam bot detection using inductive representation learning. In WWW. 148–153.
- David M Beskow and Kathleen M Carley. 2020. You are known by your friends: Leveraging network metrics for bot detection in twitter. SMA (2020).
- Graph Barlow Twins: A self-supervised representation learning framework for graphs. KBS 256 (2022), 109631.
- Beyond low-frequency information in graph convolutional networks. In AAAI. 3950–3957.
- Targetvue: Visual analysis of anomalous user behaviors in online communication systems. TVCG 22, 1 (2015), 280–289.
- Multi-Relational Structural Entropy. In UAI.
- Temporal patterns in bot activities. In WWW. 1601–1606.
- Adaptive Universal Generalized PageRank Graph Neural Network. In ICLR. OpenReview.net.
- Stefano Cresci. 2020. A decade of social bot detection. Commun ACM (2020).
- Perils and challenges of social media and election manipulation analysis: The 2018 us midterms. In WWW. 237–247.
- Detecting bots and assessing their impact in social networks. Operations Research 70, 1 (2022), 1–22.
- TwiBot-22: Towards Graph-Based Twitter Bot Detection. In NeurIPS.
- Heterogeneity-aware twitter bot detection with relational graph transformers. In AAAI.
- Twibot-20: A comprehensive twitter bot detection benchmark. In CIKM.
- BotRGCN: Twitter bot detection with relational graph convolutional networks. In SNAM.
- Emilio Ferrara. 2017. Disinformation and social bot operations in the run up to the 2017 French presidential election. First Monday 22, 8 (2017).
- Matthias Fey and Jan Eric Lenssen. 2019. Fast graph representation learning with PyTorch Geometric. arXiv (2019).
- Sami Abdullah Hamdi. 2022. Mining ideological discourse on Twitter: The case of extremism in Arabic. Discourse & Communication 16, 1 (2022), 76–92.
- Inductive representation learning on large graphs. NIPS 30 (2017).
- Dynamicity-aware Social Bot Detection with Dynamic Graph Transformers. In IJCAI.
- Deep contextualized word embedding for text-based online user profiling to detect social bots on twitter. In ICDMW. IEEE, 480–487.
- Categorical Reparameterization with Gumbel-Softmax. In ICLR (Poster). OpenReview.net.
- Edwin T Jaynes. 1980. The minimum entropy production principle. ARPC 31, 1 (1980), 579–601.
- Minguk Kang and Jaesik Park. 2020. Contragan: Contrastive learning for conditional image generation. NIPS 33 (2020), 21357–21369.
- Thomas N. Kipf and Max Welling. 2017. Semi-Supervised Classification with Graph Convolutional Networks. In ICLR (Poster). OpenReview.net.
- Socialbots on Fire: Modeling Adversarial Behaviors of Socialbots via Multi-Agent Hierarchical Reinforcement Learning. In WWW. 545–554.
- Angsheng Li and Yicheng Pan. 2016. Structural information and dynamical complexity of networks. TOIT 62, 6 (2016), 3290–3339.
- Is heterophily a real nightmare for graph neural networks to do node classification? arXiv (2021).
- Red bots do it better: Comparative analysis of social bot partisan behavior. In WWW. 1007–1012.
- Abbe Mowshowitz and Matthias Dehmer. 2012. Entropy and the complexity of graphs revisited. Entropy 14, 3 (2012), 559–570.
- Representation learning with contrastive predictive coding. arXiv (2018).
- Pytorch: An imperative style, high-performance deep learning library. NIPS 32 (2019).
- Unsupervised Social Bot Detection via Structural Information Theory. TOIS (2024).
- Nicolas Rashevsky. 1955. Life, information theory, and topology. Bull. Math. Biol. 17 (1955), 229–235.
- Modeling relational data with graph convolutional networks. In ESWC. Springer, 593–607.
- Claude Elwood Shannon. 1948. A mathematical theory of communication. BSTJ 27, 3 (1948), 379–423.
- Mgtab: A multi-relational graph-based twitter account detection benchmark. arXiv (2023).
- Ernesto Trucco. 1956. A note on the information content of graphs. Bull. Math. Biol. 18 (1956), 129–135.
- Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. JMLR 9, 11 (2008).
- Graph Attention Networks. In ICLR (Poster). OpenReview.net.
- Deep graph infomax. ICLR 2, 3 (2019), 4.
- Is this the era of misinformation yet: combining social bots and fake news to deceive the masses. In WWW. 1557–1561.
- Zixuan Weng and Aijun Lin. 2022. Public opinion manipulation on social media: Social network analysis of twitter bots during the covid-19 pandemic. JERPH 19, 24 (2022), 16376.
- SEGA: Structural Entropy Guided Anchor View for Graph Contrastive Learning. In ICML (Proceedings of Machine Learning Research, Vol. 202). PMLR, 37293–37312.
- Structural entropy guided graph hierarchical pooling. In ICML. PMLR, 24017–24030.
- Heterophily-aware Social Bot Detection with Supervised Contrastive Learning. arXiv (2023).
- Graph information bottleneck. NIPS 33 (2020), 20437–20448.
- A novel framework for detecting social bots with deep neural networks and active learning. KBS 211 (2021), 106525.
- ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer. In ACL/IJCNLP (1).
- Rosgas: Adaptive social bot detection with reinforced self-supervised gnn architecture search. TWEB (2023).
- FedACK: Federated Adversarial Contrastive Knowledge Distillation for Cross-Lingual and Cross-Model Social Bot Detection. In WWW. 1314–1323.
- Graph contrastive learning with augmentations. NIPS 33 (2020), 5812–5823.
- Unsupervised Skin Lesion Segmentation via Structural Entropy Minimization on Multi-Scale Superpixel Graphs. In ICDM.
- Effective and stable role-based multi-agent collaboration by structural information principles. In AAAI.
- Adversarial socialbots modeling based on structural information principles. In AAAI.
- Hierarchical state abstraction based on structural information principles. In IJCAI.
- Weakly supervised contrastive learning. In ICCV. 10042–10051.
- Beyond homophily in graph neural networks: Current limitations and effective designs. NIPS 33 (2020), 7793–7804.
- Deep graph contrastive representation learning. arXiv (2020).
- Graph contrastive learning with adaptive augmentation. In WWW. 2069–2080.
- SE-GSL: A General and Effective Graph Structure Learning Framework through Structural Entropy Optimization. In WWW. 499––510.
- Yingguang Yang (9 papers)
- Qi Wu (323 papers)
- Buyun He (5 papers)
- Hao Peng (291 papers)
- Renyu Yang (17 papers)
- Zhifeng Hao (65 papers)
- Yong Liao (38 papers)