Harnessing Network Effect for Fake News Mitigation: Selecting Debunkers via Self-Imitation Learning (2402.03357v1)
Abstract: This study aims to minimize the influence of fake news on social networks by deploying debunkers to propagate true news. This is framed as a reinforcement learning problem, where, at each stage, one user is selected to propagate true news. A challenging issue is episodic reward where the "net" effect of selecting individual debunkers cannot be discerned from the interleaving information propagation on social networks, and only the collective effect from mitigation efforts can be observed. Existing Self-Imitation Learning (SIL) methods have shown promise in learning from episodic rewards, but are ill-suited to the real-world application of fake news mitigation because of their poor sample efficiency. To learn a more effective debunker selection policy for fake news mitigation, this study proposes NAGASIL - Negative sampling and state Augmented Generative Adversarial Self-Imitation Learning, which consists of two improvements geared towards fake news mitigation: learning from negative samples, and an augmented state representation to capture the "real" environment state by integrating the current observed state with the previous state-action pairs from the same campaign. Experiments on two social networks show that NAGASIL yields superior performance to standard GASIL and state-of-the-art fake news mitigation models.
- Tensorflow: A system for large-scale machine learning. In 12th USENIX𝑈𝑆𝐸𝑁𝐼𝑋USENIXitalic_U italic_S italic_E italic_N italic_I italic_X symposium on operating systems design and implementation (OSDI𝑂𝑆𝐷𝐼OSDIitalic_O italic_S italic_D italic_I 16), pages 265–283, 2016.
- Modeling fake news in social networks with deep multi-agent reinforcement learning, 2020. URL https://openreview.net/forum?id=B1xhpa4FvS.
- Semi-supervised learning and graph neural networks for fake news detection. In 2019 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), pages 568–569. IEEE, 2019.
- End to end learning for self-driving cars. CoRR, abs/1604.07316, 2016. URL http://arxiv.org/abs/1604.07316.
- Directed scale-free graphs. In SODA, volume 3, pages 132–139, 2003.
- F. Brauer. Compartmental models in epidemiology. In Mathematical epidemiology, pages 19–79. Springer, 2008.
- Multistage campaigning in social networks. In Proceedings of the 30th International Conference on Neural Information Processing Systems, pages 4725–4733, 2016.
- Fake news mitigation via point process based intervention. In International Conference on Machine Learning, pages 1097–1106. PMLR, 2017.
- Learning self-imitating diverse policies. arXiv preprint arXiv:1805.10309, 2018.
- M. Goindani and J. Neville. Cluster-based social reinforcement learning. arXiv preprint arXiv:2003.00627, 2020a.
- M. Goindani and J. Neville. Social reinforcement learning to combat fake news spread. In Uncertainty in Artificial Intelligence, pages 1006–1016. PMLR, 2020b.
- Modelling strategies for controlling sars outbreaks. Proceedings of the Royal Society of London. Series B: Biological Sciences, 271(1554):2223–2232, 2004.
- Generative adversarial self-imitation learning. arXiv preprint arXiv:1812.00950, 2018.
- A survey on automated fact-checking. Transactions of the Association for Computational Linguistics, 10:178–206, 2022.
- Exploring network structure, dynamics, and function using networkx. Technical report, Los Alamos National Lab.(LANL), Los Alamos, NM (United States), 2008.
- Reinforcement learning-based counter-misinformation response generation: a case study of covid-19 vaccine misinformation. In Proceedings of the ACM Web Conference 2023, pages 2698–2709, 2023.
- Learning from demonstrations for real world reinforcement learning. CoRR, abs/1704.03732, 2017. URL http://arxiv.org/abs/1704.03732.
- J. Ho and S. Ermon. Generative adversarial imitation learning. Advances in neural information processing systems, 29:4565–4573, 2016.
- R. Lacombe. Fake news mitigation in social networks, 2018.
- J. Leskovec and A. Krevl. SNAP Datasets: Stanford large network dataset collection. http://snap.stanford.edu/data, June 2014.
- J. Leskovec and J. Mcauley. Learning to discover social circles in ego networks. Advances in neural information processing systems, 25, 2012.
- J. C. Miller and T. Ting. Eon (epidemics on networks): a fast, flexible python package for simulation, analytic approximation, and analysis of epidemics on networks. arXiv preprint arXiv:2001.02436, 2020.
- Modeling the spread of fake news on twitter. Plos one, 16(4):e0250419, 2021.
- Information network or social network? the structure of the twitter follow graph. In Proceedings of the 23rd International Conference on World Wide Web, pages 493–498, 2014.
- Self-imitation learning. In International Conference on Machine Learning, pages 3878–3887. PMLR, 2018.
- Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems, 35:27730–27744, 2022.
- Minimum budget for misinformation blocking in online social networks. Journal of Combinatorial Optimization, 38(4):1101–1127, 2019.
- Learning monocular reactive uav control in cluttered natural environments. In 2013 IEEE international conference on robotics and automation, pages 1765–1772. IEEE, 2013.
- Mitigating misinformation in online social network with top-k debunkers and evolving user opinions. In Companion Proceedings of the Web Conference 2020, pages 363–370, 2020a.
- k-truthscore: Fake news mitigation in the presence of strong user bias. In International Conference on Computational Data and Social Networks, pages 113–126. Springer, 2020b.
- Detecting fake news spreaders in social networks via linguistic and personality features. In CLEF, 2020.
- Fake news detection on social media: A data mining perspective. ACM SIGKDD explorations newsletter, 19(1):22–36, 2017.
- Studying fake news via network analysis: detection and mitigation. In Emerging Research Challenges and Opportunities in Computational Social Network Analysis and Mining, pages 43–65. Springer, 2019.
- Motivating social influencers to engage in health behavior interventions. Frontiers in Psychology, 13:885688, 2022.
- Aim: Activation increment minimization strategy for preventing bad information diffusion in osns. Future Generation Computer Systems, 94:293–301, 2019.
- Early detection of rumours on twitter via stance transfer learning. In European Conference on Information Retrieval, pages 575–588. Springer, 2020.
- Duck: Rumour detection by modelling user and comment propagation networks. In NAACL, 2022.
- Leveraging demonstrations for deep reinforcement learning on robotics problems with sparse rewards. CoRR, abs/1707.08817, 2017. URL http://arxiv.org/abs/1707.08817.
- N. Vo and K. Lee. The rise of guardians: Fact-checking url recommendation to combat fake news. In The 41st international ACM SIGIR conference on research & development in information retrieval, pages 275–284, 2018.
- N. Vo and K. Lee. Where are the facts? searching for fact-checked information to alleviate the spread of fake news. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 7717–7731, 2020.
- Veracity-aware and event-driven personalized news recommendation for fake news mitigation. In Proceedings of the ACM Web Conference 2022, pages 3673–3684, 2022.
- Eann: Event adversarial neural networks for multi-modal fake news detection. In Proceedings of the 24th acm sigkdd international conference on knowledge discovery & data mining, pages 849–857, 2018.
- A sword with two edges: Propagation studies on both positive and negative information in online social networks. IEEE Transactions on Computers, 64(3):640–653, 2014a.
- To shut them up or to clarify: Restraining the spread of rumors in online social networks. IEEE Transactions on Parallel and Distributed Systems, 25(12):3306–3316, 2014b.
- Identifying cost-effective debunkers for multi-stage fake news mitigation campaigns. In International Conference on Web Search and Data Mining, 2022.
- Sir rumor spreading model in the new media age. Physica A: Statistical Mechanics and its Applications, 392(4):995–1003, 2013.
- Analysing how people orient to and spread rumours in social media by looking at conversational threads. PloS one, 11(3):e0150989, 2016.