A diverse Multilingual News Headlines Dataset from around the World
Abstract: Babel Briefings is a novel dataset featuring 4.7 million news headlines from August 2020 to November 2021, across 30 languages and 54 locations worldwide with English translations of all articles included. Designed for natural language processing and media studies, it serves as a high-quality dataset for training or evaluating LLMs as well as offering a simple, accessible collection of articles, for example, to analyze global news coverage and cultural narratives. As a simple demonstration of the analyses facilitated by this dataset, we use a basic procedure using a TF-IDF weighted similarity metric to group articles into clusters about the same event. We then visualize the \emph{event signatures} of the event showing articles of which languages appear over time, revealing intuitive features based on the proximity of the event and unexpectedness of the event. The dataset is available on \href{https://www.kaggle.com/datasets/felixludos/babel-briefings}{Kaggle} and \href{https://huggingface.co/datasets/felixludos/babel-briefings}{HuggingFace} with accompanying \href{https://github.com/felixludos/babel-briefings}{GitHub} code.
- Bias and fairness in large language models: A survey. arXiv preprint arXiv:2309.00770.
- Detecting political bias in news articles using headline attention. In Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, pages 77–84, Florence, Italy. Association for Computational Linguistics.
- Google. 2023. Google translate. https://translate.google.com. Accessed: 30 October 2023.
- Derek Greene and Pádraig Cunningham. 2006. Practical solutions to the problem of diagonal dominance in kernel document clustering. In Proceedings of the 23rd international conference on Machine learning, pages 377–384.
- news-please: A generic news crawler and extractor. In Proceedings of the 15th International Symposium of Information Science, pages 218–223.
- Quality at a glance: An audit of web-crawled multilingual datasets. Transactions of the Association for Computational Linguistics, 10:50–72.
- Kalev Leetaru and Philip A Schrodt. 2013. Gdelt: Global data on events, location, and tone, 1979–2012. In ISA annual convention, volume 2, pages 1–49. Citeseer.
- Meme-tracking and the dynamics of the news cycle. In Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 497–506.
- News headlines: What they can tell us? In Proceedings of the 6th IBM Collaborative Academia Research Exchange Conference (I-CARE) on I-CARE 2014, pages 1–4.
- Rishabh Misra. 2022. News category dataset. arXiv preprint arXiv:2209.11429.
- News-API. 2023. News api. https://newsapi.org/. Accessed: 8 August 2020.
- On detecting business event from the headlines and leads of massive online news articles. Information Processing & Management, 56(6):102086.
- News classification based on their headlines: A review. In 17th IEEE International Multi Topic Conference 2014, pages 211–216. IEEE.
- A vector space model for automatic indexing. Communications of the ACM, 18(11):613–620.
- Character-level convolutional networks for text classification. In NIPS.
Paper Prompts
Sign up for free to create and run prompts on this paper.