Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
80 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
7 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

SocialPET: Socially Informed Pattern Exploiting Training for Few-Shot Stance Detection in Social Media (2403.05216v1)

Published 8 Mar 2024 in cs.CL and cs.SI

Abstract: Stance detection, as the task of determining the viewpoint of a social media post towards a target as 'favor' or 'against', has been understudied in the challenging yet realistic scenario where there is limited labeled data for a certain target. Our work advances research in few-shot stance detection by introducing SocialPET, a socially informed approach to leveraging LLMs for the task. Our proposed approach builds on the Pattern Exploiting Training (PET) technique, which addresses classification tasks as cloze questions through the use of LLMs. To enhance the approach with social awareness, we exploit the social network structure surrounding social media posts. We prove the effectiveness of SocialPET on two stance datasets, Multi-target and P-Stance, outperforming competitive stance detection models as well as the base model, PET, where the labeled instances for the target under study is as few as 100. When we delve into the results, we observe that SocialPET is comparatively strong in identifying instances of the `against' class, where baseline models underperform.

PDF HTML Abstract
Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Bookmark Chat Bubble Oval Streamline Icon: https://streamlinehq.com Chat (Pro)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (44)
  1. Stance detection on social media: State of the art and trends. Information Processing & Management 58, 102597.
  2. Opinions are made to be changed: Temporally adaptive stance classification, in: Proceedings of the 2021 workshop on open challenges in online social networks, pp. 27–32.
  3. Capturing stance dynamics in social media: open challenges and research directions. International Journal of Digital Humanities 3, 115–135.
  4. Enhancing stance detection through sequential weighted multi-task learning. Social Network Analysis and Mining 14, 7.
  5. A systematic review of machine learning techniques for stance detection and its applications. Neural Computing and Applications 35, 5113–5144.
  6. Correction: Enhancing stance detection through sequential weighted multi-task learning. Social Network Analysis and Mining 14, 25.
  7. Stance detection with bidirectional conditional encoding. arXiv preprint arXiv:1606.05464 .
  8. Stander: an expert-annotated dataset for news stance detection and evidence retrieval, Association for Computational Linguistics.
  9. Stance classification with target-specific neural attention networks, International Joint Conferences on Artificial Intelligence.
  10. Community detection for access-control decisions: Analysing the role of homophily and information diffusion in online social networks. Online Social Networks and Media 29, 100203.
  11. Graph embedding techniques, applications, and performance: A survey. Knowledge-Based Systems 151, 78–94.
  12. A retrospective analysis of the fake news challenge stance detection task. arXiv preprint arXiv:1806.05180 .
  13. Stance classification of ideological debates: Data, models, features, and constraints, in: Proceedings of the sixth international joint conference on natural language processing, pp. 1348–1356.
  14. Infusing knowledge from wikipedia to enhance stance detection. arXiv preprint arXiv:2204.03839 .
  15. Few-shot stance detection via target-aware prompt distillation, in: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 837–847.
  16. Few-shot learning for cross-target stance detection by aggregating multimodal embeddings. IEEE Transactions on Computational Social Systems .
  17. Evaluating the generalisability of neural rumour verification models. Information Processing & Management 60, 103116.
  18. Stance detection: A survey. ACM Computing Surveys (CSUR) 53, 1–37.
  19. Mitigating biases of large language models in stance detection with calibration. arXiv preprint arXiv:2402.14296 .
  20. A new direction in stance detection: Target-stance extraction in the wild, in: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 10071–10085.
  21. Improved target-specific stance detection on social media platforms by delving into conversation threads. IEEE Transactions on Computational Social Systems .
  22. P-stance: A large dataset for stance detection in political domain, in: Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pp. 2355–2365.
  23. Jointcl: a joint contrastive learning framework for zero-shot stance detection, in: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Association for Computational Linguistics. pp. 81–91.
  24. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692 .
  25. Birds of a feather: Homophily in social networks. Annual review of sociology 27, 415–444.
  26. Sentiment analysis algorithms and applications: A survey. Ain Shams engineering journal 5, 1093–1113.
  27. Semeval-2016 task 6: Detecting stance in tweets, in: Proceedings of the 10th international workshop on semantic evaluation (SemEval-2016), pp. 31–41.
  28. Automatic stance detection using end-to-end memory networks. arXiv preprint arXiv:1804.07581 .
  29. Enriching bert with knowledge graph embeddings for document classification. arXiv preprint arXiv:1909.08402 .
  30. A simple but tough-to-beat baseline for the fake news challenge stance detection task. arXiv preprint arXiv:1707.03264 .
  31. Interpreting bert-based stance classification: a case study about the brazilian covid vaccination, in: Anais do XXXVI Simpósio Brasileiro de Bancos de Dados, SBC. pp. 73–84.
  32. Exploiting cloze questions for few shot text classification and natural language inference. arXiv preprint arXiv:2001.07676 .
  33. Fake news detection on social media: A data mining perspective. ACM SIGKDD explorations newsletter 19, 22–36.
  34. A dataset for multi-target stance detection, in: Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers, pp. 551–557.
  35. Joint models of disagreement and stance in online debate, in: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 116–125.
  36. Stance detection with hierarchical attention network, in: Proceedings of the 27th international conference on computational linguistics, pp. 2399–2409.
  37. A review of natural language processing techniques for opinion mining systems. Information fusion 36, 10–25.
  38. Zero-shot and few-shot stance detection on varied topics via conditional generation, in: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pp. 1491–1499.
  39. Cross-target stance classification with self-attention networks. arXiv preprint arXiv:1805.06593 .
  40. C-stance: A large dataset for chinese zero-shot stance detection, in: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 13369–13385.
  41. A longitudinal assessment of the persistence of twitter datasets. Journal of the Association for Information Science and Technology 69, 974–984.
  42. Natural language processing in the era of large language models. Frontiers in Artificial Intelligence 6, 1350306.
  43. Stance classification in rumours as a sequential task exploiting the tree structure of social media conversations. arXiv preprint arXiv:1609.09028 .
  44. Political homophily in independence movements: analyzing and classifying social media users by national identity. IEEE Intelligent Systems 34, 34–42.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (2)
  1. Parisa Jamadi Khiabani (4 papers)
  2. Arkaitz Zubiaga (88 papers)
Citations (1)
View on Semantic Scholar