Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
166 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Let Silence Speak: Enhancing Fake News Detection with Generated Comments from Large Language Models (2405.16631v1)

Published 26 May 2024 in cs.CL, cs.CY, and cs.SI

Abstract: Fake news detection plays a crucial role in protecting social media users and maintaining a healthy news ecosystem. Among existing works, comment-based fake news detection methods are empirically shown as promising because comments could reflect users' opinions, stances, and emotions and deepen models' understanding of fake news. Unfortunately, due to exposure bias and users' different willingness to comment, it is not easy to obtain diverse comments in reality, especially for early detection scenarios. Without obtaining the comments from the ``silent'' users, the perceived opinions may be incomplete, subsequently affecting news veracity judgment. In this paper, we explore the possibility of finding an alternative source of comments to guarantee the availability of diverse comments, especially those from silent users. Specifically, we propose to adopt LLMs as a user simulator and comment generator, and design GenFEND, a generated feedback-enhanced detection framework, which generates comments by prompting LLMs with diverse user profiles and aggregating generated comments from multiple subpopulation groups. Experiments demonstrate the effectiveness of GenFEND and further analysis shows that the generated comments cover more diverse users and could even be more effective than actual comments.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (76)
  1. Sentiment Aware Fake News Detection on Online Social Networks. In 2019 IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE, 2507–2511. https://doi.org/10.1109/ICASSP.2019.8683170
  2. Gender Differences in Tackling Fake News: Different Degrees of Concern, but Same Problems. Media and Communication 9, 1 (2021), 229–238. https://doi.org/10.17645/mac.v9i1.3523
  3. The Dark Side of Language Models: Exploring the Potential of LLMs in Multimedia Disinformation Generation and Dissemination. Machine Learning with Applications (2024), 100545.
  4. Information Credibility on Twitter. In Proceedings of the 20th International Conference on World Wide Web. Association for Computing Machinery, 675–684. https://doi.org/10.1145/1963405.1963500
  5. Canyu Chen and Kai Shu. 2023. Can LLM-Generated Misinformation Be Detected?. In The Twelfth International Conference on Learning Representations.
  6. Causal Intervention and Counterfactual Reasoning for Multi-modal Fake News Detection. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, 627–638. https://doi.org/10.18653/v1/2023.acl-long.37
  7. Google DeepMind. 2024. Gemma: Open Models Based on Gemini Research and Technology. arXiv preprint arXiv:2403.08295 (2024).
  8. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, 4171–4186. https://doi.org/10.18653/v1/N19-1423
  9. Patti Domm. 2013. False Rumor of Explosion at White House Causes Stocks to Briefly Plunge; AP Confirms Its Twitter Feed Was Hacked. https://www.cnbc.com/id/100646197. Accessed: 2024-05-20.
  10. Countering the Cognitive, Linguistic, and Psychological Underpinnings Behind Susceptibility to Fake News: A Review of Current Literature With Special Focus on the Role of Age and Digital Literacy. Frontiers in Communication 6 (2021). https://doi.org/10.3389/fcomm.2021.661801
  11. Axel Gelfert. 2018. Fake News: A Definition. Informal Logic 38, 1 (2018), 84–117. https://doi.org/10.22329/il.v38i1.5068
  12. Integrating Large Language Models with Graphical Session-Based Recommendation. arXiv preprint arXiv:2402.16539 (2024).
  13. Bad Actor, Good Advisor: Exploring the Role of Large Language Models in Fake News Detection. Proceedings of the AAAI Conference on Artificial Intelligence 38, 20 (2024), 22105–22113.
  14. Learn over Past, Evolve for Future: Forecasting Temporal Trends for Fake News Detection. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 5: Industry Track). Association for Computational Linguistics, 116–125. https://doi.org/10.18653/v1/2023.acl-industry.13
  15. Deep learning for fake news detection: A comprehensive survey. AI Open 3 (2022), 133–155. https://doi.org/10.1016/j.aiopen.2022.09.001
  16. Large Language Model Interaction Simulator for Cold-Start Item Recommendation. arXiv preprint arXiv:2402.09176 (2024).
  17. Disinformation Detection: An Evolving Challenge in the Age of LLMs. In Proceedings of the 2024 SIAM International Conference on Data Mining (SDM). SIAM, 427–435.
  18. News Verification by Exploiting Conflicting Social Viewpoints in Microblogs. Proceedings of the AAAI Conference on Artificial Intelligence 30 (2016). https://doi.org/10.1609/aaai.v30i1.10382
  19. FakeBERT: Fake News Detection in Social Media with a BERT-based Deep Learning Approach. Multimedia Tools and Applications 80, 8 (2021), 11765–11788.
  20. HC-COVID: A Hierarchical Crowdsource Knowledge Graph Approach to Explainable COVID-19 Misinformation Detection. Proceedings of the ACM on Human-Computer Interaction 6, GROUP, Article 36 (2022). https://doi.org/10.1145/3492855
  21. MALCOM: Generating Malicious Comments to Attack Neural Fake News Detection Models. In 2020 IEEE International Conference on Data Mining. IEEE, 282–291. https://doi.org/10.1109/ICDM50108.2020.00037
  22. Your Large Language Model is Secretly a Fairness Proponent and You Should Prompt it Like One. arXiv preprint arXiv:2402.12150 (2024).
  23. Clean-label Poisoning Attack against Fake News Detection Models. In 2023 IEEE International Conference on Big Data (BigData). 3614–3623. https://doi.org/10.1109/BigData59044.2023.10386777
  24. TELLER: A Trustworthy Framework for Explainable, Generalizable and Controllable Fake News Detection. arXiv preprint arXiv:2402.07776 (2024).
  25. Can Large Language Models Detect Rumors on Social Media? arXiv preprint arXiv:2402.03916 (2024).
  26. From Skepticism to Acceptance: Simulating the Attitude Dynamics Toward Fake News. arXiv preprint arXiv:2403.09498 (2024).
  27. Yang Liu and Yi-Fang Brook Wu. 2020. FNED: A Deep Network for Fake News Early Detection on Social Media. ACM Transactions on Information Systems 38, 3, Article 25 (2020), 33 pages. https://doi.org/10.1145/3386253
  28. Fighting Fire with Fire: The Dual Role of LLMs in Crafting and Detecting Elusive Disinformation. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 14279–14305. https://doi.org/10.18653/v1/2023.emnlp-main.883
  29. Detect Rumor and Stance Jointly by Neural Multi-task Learning. In Companion Proceedings of the The Web Conference 2018. International World Wide Web Conferences Steering Committee, 585–593. https://doi.org/10.1145/3184558.3188729
  30. MDFEND: Multi-domain Fake News Detection. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management. Association for Computing Machinery, 3343–3347. https://doi.org/10.1145/3459637.3482139
  31. Exploiting User Comments for Early Detection of Fake News Prior to Users’ Commenting. arXiv preprint arXiv:2310.10429 (2023).
  32. OpenAI. 2022. ChatGPT: Optimizing Language Models for Dialogue. https://openai.com/blog/chatgpt/. Accessed: 2024-03-05.
  33. Piotr Przybyla. 2020. Capturing the Style of Fake News. Proceedings of the AAAI Conference on Artificial Intelligence 34, 01 (2020), 490–497. https://doi.org/10.1609/aaai.v34i01.5386
  34. FakeSV: A Multimodal Benchmark with Rich Social Context for Fake News Detection on Short Video Platforms. Proceedings of the AAAI Conference on Artificial Intelligence 37, 12 (2023), 14444–14452. https://doi.org/10.1609/aaai.v37i12.26689
  35. Improving Fake News Detection by Using an Entity-enhanced Framework to Fuse Diverse Multimodal Clues. In Proceedings of the 29th ACM International Conference on Multimedia. Association for Computing Machinery, 1212–1220. https://doi.org/10.1145/3474085.3481548
  36. Reliable LLM-based User Simulator for Task-Oriented Dialogue Systems. arXiv preprint arXiv:2402.13374 (2024).
  37. Characterizing Multi-Domain False News and Underlying User Effects on Chinese Weibo. Information Processing & Management 59, 4 (2022), 102959.
  38. Zoom Out and Observe: News Environment Perception for Fake News Detection. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, 4543–4556. https://doi.org/10.18653/v1/2022.acl-long.311
  39. dEFEND: Explainable Fake News Detection. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. Association for Computing Machinery, 395–405. https://doi.org/10.1145/3292500.3330935
  40. FakeNewsNet: A Data Repository with News Content, Social Context, and Spatiotemporal Information for Studying Fake News on Social Media. Big Data 8, 3 (2020), 171–188. https://doi.org/10.1089/big.2020.0062
  41. Fake News Detection on Social Media: A Data Mining Perspective. ACM SIGKDD Explorations Newsletter 19 (2017), 22–36. https://doi.org/10.1145/3137597.3137600
  42. Leveraging multi-source weak social supervision for early detection of fake news. arXiv preprint arXiv:2004.01732 (2020).
  43. SpotFake: A Multi-modal Framework for Fake News Detection. In 2019 IEEE Fifth International Conference on Multimedia Big Data (BigMM). 39–47. https://doi.org/10.1109/BigMM.2019.00-44
  44. Decoding the Silent Majority: Inducing Belief Augmented Social Graph with Large Language Model for Response Forecasting. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 43–57. https://doi.org/10.18653/v1/2023.emnlp-main.4
  45. Impact of rumors and misinformation on COVID-19 in social media. Journal of Preventive Medicine and Public Health 53, 3 (2020), 171–174.
  46. Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288 (2023).
  47. Exploring the Impact of Large Language Models on Recommender Systems: An Extensive Review. arXiv preprint arXiv:2402.18590 (2024).
  48. The spread of true and false news online. Science 359, 6380 (2018), 1146–1151. https://doi.org/10.1126/science.aap9559
  49. Fact-checking: A meta-analysis of what works and for whom. Political communication 37, 3 (2020), 350–375.
  50. DELL: Generating Reactions and Explanations for LLM-Based Misinformation Detection. arXiv preprint arXiv:2402.10426 (2024).
  51. Explainable Fake News Detection with Large Language Model via Defense Among Competing Wisdom. In Proceedings of the ACM on Web Conference 2024. Association for Computing Machinery, New York, NY, USA, 2452–2463. https://doi.org/10.1145/3589334.3645471
  52. MMIDR: Teaching Large Language Model to Interpret Multimodal Misinformation via Knowledge Distillation. arXiv preprint arXiv:2403.14171 (2024).
  53. Generating Diversified Comments via Reader-Aware Topic Modeling and Saliency Detection. Proceedings of the AAAI Conference on Artificial Intelligence 35 (2021), 13988–13996. https://doi.org/10.1609/aaai.v35i16.17647
  54. DEEM: Dynamic Experienced Expert Modeling for Stance Detection. arXiv preprint arXiv:2402.15264 (2024).
  55. EANN: Event Adversarial Neural Networks for Multi-Modal Fake News Detection. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. Association for Computing Machinery, 849–857. https://doi.org/10.1145/3219819.3219903
  56. Understanding News Creation Intents: Frame, Dataset, and Method. arXiv preprint arXiv:2312.16490 (2023).
  57. Emergent abilities of large language models. arXiv preprint arXiv:2206.07682 (2022).
  58. Weibo. 2021. Weibo Community Convention (Trial). https://service.account.weibo.com/roles/gongyue. Accessed: 2024-05-13.
  59. World Economic Forum. 2024. Global Risks Report 2024. https://www3.weforum.org/docs/WEF_The_Global_Risks_Report_2024.pdf. Accessed: 2024-05-13.
  60. Jiaying Wu and Bryan Hooi. 2023. Fake News in Sheep’s Clothing: Robust Fake News Detection Against LLM-Empowered Style Attacks. arXiv preprint arXiv:2310.10830 (2023).
  61. Lianwei Wu and Yuan Rao. 2020. Adaptive Interaction Fusion Networks for Fake News Detection. In Proceedings of the 24th European Conference on Artificial Intelligence. https://doi.org/10.3233/FAIA200348
  62. Can Large Language Model Agents Simulate Human Trust Behaviors? arXiv preprint arXiv:2402.04559 (2024).
  63. The Earth is Flat because…: Investigating LLMs’ Belief towards Misinformation via Persuasive Conversation. arXiv preprint arXiv:2312.09085 (2023).
  64. LEMMA: Towards LVLM-Enhanced Multimodal Misinformation Detection with External Knowledge Augmentation. arXiv preprint arXiv:2402.11943 (2024).
  65. Fake News Detection with Generated Comments for News Articles. In 2020 IEEE 24th International Conference on Intelligent Engineering Systems. 85–90. https://doi.org/10.1109/INES49302.2020.9147195
  66. Unsupervised Fake News Detection on Social Media: A Generative Approach. Proceedings of the AAAI Conference on Artificial Intelligence 33 (2019), 5644–5651. https://doi.org/10.1609/aaai.v33i01.33015644
  67. A Coarse-to-fine Cascaded Evidence-Distillation Neural Network for Explainable Fake News Detection. In Proceedings of the 29th International Conference on Computational Linguistics. International Committee on Computational Linguistics, Gyeongju, Republic of Korea, 2608–2621. https://aclanthology.org/2022.coling-1.230
  68. Read, Attend and Comment: A Deep Architecture for Automatic News Comment Generation. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics, 5077–5089. https://doi.org/10.18653/v1/D19-1512
  69. PopALM: Popularity-Aligned Language Models for Social Media Trendy Response Prediction. arXiv preprint arXiv:2402.18950 (2024).
  70. A Convolutional Approach for Misinformation Identification. In Proceedings of the 26th International Joint Conference on Artificial Intelligence. AAAI Press, 3901–3907. https://doi.org/10.24963/ijcai.2017/545
  71. Mining Dual Emotion for Fake News Detection. In Proceedings of the Web Conference 2021. Association for Computing Machinery, 3465–3476. https://doi.org/10.1145/3442381.3450004
  72. Heterogeneous Subgraph Transformer for Fake News Detection. In Proceedings of the ACM on Web Conference 2024. Association for Computing Machinery, 1272–1282. https://doi.org/10.1145/3589334.3645680
  73. Zhipu AI. 2024. GLM-4. https://open.bigmodel.cn/dev/howuse/glm4. Accessed: 2024-03-05.
  74. Generalizing to the Future: Mitigating Entity Bias in Fake News Detection. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. Association for Computing Machinery, 2120–2125. https://doi.org/10.1145/3477495.3531816
  75. Memory-Guided Multi-View Multi-Domain Fake News Detection. IEEE Transactions on Knowledge and Data Engineering 35, 7 (2023), 7178–7191. https://doi.org/10.1109/TKDE.2022.3185151
  76. Controllable News Comment Generation based on Attribute Level Contrastive Learning. In 2023 IEEE International Conference on Intelligence and Security Informatics. 1–6. https://doi.org/10.1109/ISI58743.2023.10297146
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now