Clickbait Classification and Spoiling Using Natural Language Processing (2306.14907v1)
Abstract: Clickbait is the practice of engineering titles to incentivize readers to click through to articles. Such titles with sensationalized language reveal as little information as possible. Occasionally, clickbait will be intentionally misleading, so NLP can scan the article and answer the question posed by the clickbait title, or spoil it. We tackle two tasks: classifying the clickbait into one of 3 types (Task 1), and spoiling the clickbait (Task 2). For Task 1, we propose two binary classifiers to determine the final spoiler type. For Task 2, we experiment with two approaches: using a question-answering model to identify the span of text of the spoiler, and using a LLM to generate the spoiler. Because the spoiler is contained in the article, we frame the second task as a question-answering approach for identifying the starting and ending positions of the spoiler. We created models for Task 1 that were better than the baselines proposed by the dataset authors and engineered prompts for Task 2 that did not perform as well as the baselines proposed by the dataset authors due to the evaluation metric performing worse when the output text is from a generative model as opposed to an extractive model.
- Language models are few-shot learners. CoRR, abs/2005.14165, 2020.
- Clickbait spoiling via question answering and passage retrieval. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022.
- Deberta: Decoding-enhanced BERT with disentangled attention. CoRR, abs/2006.03654, 2020.
- Bleu. Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL ’02, 2001.
- Pytorch: An imperative style, high-performance deep learning library. CoRR, abs/1912.01703, 2019.
- Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12:2825–2830, 2011.
- A. Pujahari and D. S. Sisodia. Clickbait detection using multiple categorisation techniques. Journal of Information Science, 47(1):118–128, 2019.
- Huggingface’s transformers: State-of-the-art natural language processing. CoRR, abs/1910.03771, 2019.
- Clickbait? sensational headline generation with auto-tuned reinforcement learning.