Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
156 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

PopBERT. Detecting populism and its host ideologies in the German Bundestag (2309.14355v1)

Published 22 Sep 2023 in cs.CL, cs.CY, and cs.LG

Abstract: The rise of populism concerns many political scientists and practitioners, yet the detection of its underlying language remains fragmentary. This paper aims to provide a reliable, valid, and scalable approach to measure populist stances. For that purpose, we created an annotated dataset based on parliamentary speeches of the German Bundestag (2013 to 2021). Following the ideational definition of populism, we label moralizing references to the virtuous people or the corrupt elite as core dimensions of populist language. To identify, in addition, how the thin ideology of populism is thickened, we annotate how populist statements are attached to left-wing or right-wing host ideologies. We then train a transformer-based model (PopBERT) as a multilabel classifier to detect and quantify each dimension. A battery of validation checks reveals that the model has a strong predictive accuracy, provides high qualitative face validity, matches party rankings of expert surveys, and detects out-of-sample text snippets correctly. PopBERT enables dynamic analyses of how German-speaking politicians and parties use populist language as a strategic device. Furthermore, the annotator-level data may also be applied in cross-domain applications or to develop related classifiers.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (52)
  1. “Twenty-First Century Populism: The Spectre of Western European Democracy” London: Palgrave Macmillan, 2008
  2. Paris Aslanidis “Is Populism an Ideology? A Refutation and a New Perspective” In Political Studies 64, 2016, pp. 88–104 DOI: 10/f8jcrw
  3. Paris Aslanidis “Measuring Populist Discourse with Semantic Text Analysis: An Application on Grassroots Populist Mobilization” In Quality & Quantity 52.3, 2018, pp. 1241–1263 DOI: 10/gdfv8t
  4. “When Do Women Speak? A Comparative Analysis of the Role of Gender in Legislative Debates” In Political Studies 67.3 SAGE Publications Ltd, 2019, pp. 576–596 DOI: 10.1177/0032321718789358
  5. “The Populist Style in American Politics: Presidential Campaign Discourse, 1952–1996” In Social Forces 94.4, 2016, pp. 1593–1621 DOI: 10/f8q5n5
  6. Bart Bonikowski, Yuchen Luo and Oscar Stuhler “Politics as Usual? Measuring Populism, Nationalism, and Authoritarianism in U.S. Presidential Campaigns (1952–2020) with Neural Language Models” In Sociological Methods & Research 51.4, 2022, pp. 1721–1787 DOI: 10/grzg7s
  7. Margaret Canovan “Taking Politics to the People:Populism as the Ideology of Democracy” In Democracies and the Populist Challenge London: Palgrave Macmillan, 2002, pp. 25–44 DOI: 10.1057/9781403920072˙2
  8. Branden Chan, Stefan Schweter and Timo Möller “German’s Next Language Model”, 2020 arXiv:2010.10906 [cs]
  9. “When Do Politicians Use Populist Rhetoric? Populism as a Campaign Gamble” In Political Communication 39.3, 2022, pp. 383–404 DOI: 10/gn7m4k
  10. “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding”, 2019 arXiv:1810.04805 [cs]
  11. “Populism as an Expression of Political Communication Content and Style: A New Perspective” In The International Journal of Press/Politics 23.4, 2018, pp. 423–438 DOI: 10/gf3gnj
  12. Jessica Di Cocco and Bernardo Monechi “How Populist Are Parties? Measuring Degrees of Populism in Party Manifestos Using Supervised Machine Learning” In Political Analysis 30.3, 2022, pp. 311–327 DOI: 10/grhwg8
  13. “Extreme Parties and Populism: An Analysis of Facebook and Twitter across Six Countries” In Information, Communication & Society 20.9, 2017, pp. 1347–1364 DOI: 10/gc7mvt
  14. Nicole Ernst, Sven Engesser and Frank Esser “Bipolar Populism? The Use of Anti-Elitism and People-Centrism by Swiss Parties on Social Media” In Swiss Political Science Review 23.3, 2017, pp. 253–261 DOI: 10/ggb59v
  15. Johann Gründl “Populist Ideas on Social Media: A Dictionary-Based Measurement of Populist Communication” In New Media & Society 24.6, 2022, pp. 1481–1499 DOI: 10/ghqg64
  16. Kirk A. Hawkins “Is Chávez Populist?: Measuring Populist Discourse in Comparative Perspective” In Comparative Political Studies 42.8, 2009, pp. 1040–1067 DOI: 10/d9dzw6
  17. Kirk A. Hawkins and Cristóbal Rovira Kaltwasser “Introduction: The Ideational Approach” In The Ideational Approach to Populism: Concept, Theory, and Analysis, Routledge Studies in Extremism and Democracy London: Routledge, 2019
  18. “The Ideational Approach to Populism: Concept, Theory, and Analysis”, Routledge Studies in Extremism and Democracy London: Routledge, 2019
  19. “The Importance of Modeling Social Factors of Language: Theory and Practice” In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies Online: Association for Computational Linguistics, 2021, pp. 588–602 DOI: 10.18653/v1/2021.naacl-main.49
  20. “What’s in a Buzzword? A Systematic Review of the State of Populism Research in Political Science” In Political Science Research and Methods 10.3, 2022, pp. 617–633 DOI: 10/gngvpg
  21. “Populism as Political Communication Style: An Empirical Study of Political Parties’ Discourse in Belgium”, 2006, pp. 27 DOI: 10/cwnwq9
  22. Michael Jankowski and Robert A. Huber “When Correlation Is Not Enough: Validating Populism Scores from Supervised Machine-Learning Models” In Political Analysis, 2023, pp. 1–15 DOI: 10/gsdbdd
  23. “Chapel Hill Expert Survey Trend File, 1999–2019” In Electoral Studies 75, 2022, pp. 102420 DOI: 10/gnhpq2
  24. Christopher Klamm, Ines Rehbein and Simone Paolo Ponzetto “Our Kind of People? Detecting Populist References in Political Debates” In Findings of the Association for Computational Linguistics: EACL 2023 Dubrovnik: Association for Computational Linguistics, 2023, pp. 1227–1243
  25. “Exploring Morality in Argumentation” In Proceedings of the 7th Workshop on Argument Mining Online: Association for Computational Linguistics, 2020, pp. 30–40
  26. Hanspeter Kriesi “The Populist Challenge” In West European Politics 37.2, 2014, pp. 361–378 DOI: 10/ggb6fj
  27. Luke March “Radical Left Parties in Europe” Routledge, 2012 DOI: 10.4324/9780203154878
  28. Luke March “Left and Right Populism Compared: The British Case” In The British Journal of Politics and International Relations 19.2, 2017, pp. 282–303 DOI: 10/f96mfq
  29. Blake Miller, Fridolin Linder and Walter R. Mebane “Active Learning Approaches for Labeling Text: Review and Assessment of the Performance of Active Learning Approaches” In Political Analysis 28.4 Cambridge University Press, 2020, pp. 532–551 DOI: 10/gjjstj
  30. Cas Mudde “The Populist Zeitgeist” In Government and Opposition 39.4, 2004, pp. 541–563 DOI: 10/fj8jzb
  31. Cas Mudde “Populist Radical Right Parties in Europe” Cambridge: Cambridge University Press, 2007
  32. Cas Mudde “Populism: An Ideational Approach” In The Oxford Handbook of Populism, Oxford Handbooks Oxford: Oxford University Press, 2017, pp. 27–47
  33. Cas Mudde and Cristóbal Rovira Kaltwasser “Exclusionary vs. Inclusionary Populism: Comparing Contemporary Europe and Latin America” In Government and Opposition 48.2, 2013, pp. 147–174 DOI: 10/ggb6mt
  34. Cas Mudde and Cristóbal Rovira Kaltwasser “Studying Populism in Comparative Perspective: Reflections on the Contemporary and Future Research Agenda” In Comparative Political Studies 51.13, 2018, pp. 1667–1693 DOI: 10/gfhhb4
  35. Teun Pauwels “Measuring Populism: A Review of Current Approaches” In Political Populism Nomos Verlag, 2017, pp. 123–136 DOI: 10.5771/9783845271491-123
  36. Barbara Plank “The “Problem” of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation” In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing Abu Dhabi: Association for Computational Linguistics, 2022, pp. 10671–10682
  37. “Open Discourse” Harvard Dataverse, 2020 DOI: 10.7910/DVN/FIKIBO
  38. Kenneth M. Roberts “Populism and Polarization in Comparative Perspective: Constitutive, Spatial and Institutional Dimensions” In Government and Opposition 57.4, 2022, pp. 680–702 DOI: 10/gkf5fk
  39. Matthijs Rooduijn, Sarah L Lange and Wouter Brug “A Populist Zeitgeist ? Programmatic Contagion by Populist Parties in Western Europe” In Party Politics 20.4, 2014, pp. 563–575 DOI: 10/ggb6kq
  40. “Measuring Populism: Comparing Two Methods of Content Analysis” In West European Politics 34.6, 2011, pp. 1272–1283 DOI: 10/drxgt6
  41. “The Oxford Handbook of Populism”, Oxford Handbooks Oxford: Oxford University Press, 2017
  42. Stefan Rummens “Populism as a Threat to Liberal Democracy” In The Oxford Handbook of Populism 1 Oxford University Press, 2017, pp. 554–570 DOI: 10.1093/oxfordhb/9780198803560.013.27
  43. “Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detection” In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies Seattle: Association for Computational Linguistics, 2022, pp. 5884–5906 DOI: 10/gsgptq
  44. “Yelling from the Sidelines? How German Parties Employ Populist and Crisis-Related Messages on Facebook” In Political Research Exchange 4.1, 2022 DOI: 10/gpz5rm
  45. “Accomplishments and Limitations of the ‘New’ Mainstream in Contemporary Populism Studies” In European Journal of Social Theory 21.4, 2018, pp. 547–565 DOI: 10/gmqpgd
  46. Paul A. Taggart “Populism”, Concepts in the Social Sciences Philadelphia: Open University Press, 2000
  47. “A Case for Soft Loss Functions” In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing 8, 2020, pp. 173–177 DOI: 10/gsgptv
  48. “Learning from Disagreement: A Survey” In Journal of Artificial Intelligence Research 72, 2021, pp. 1385–1470 DOI: 10/gsgptt
  49. “Attention Is All You Need” In Advances in Neural Information Processing Systems 30 Curran Associates, Inc., 2017
  50. Sandra Wankmüller “Introduction to Neural Transfer Learning With Transformers for Social Science Text Analysis” In Sociological Methods & Research SAGE Publications Inc, 2022 DOI: 10/gr3vx8
  51. “The Appeal of Populist Ideas, Strategies, and Styles: A Theoretical Model and Research Design for Analyzing Populist Political Communication” University of Zurich, 2016 DOI: 10/gsdbc8
  52. “A Comparison of Emotion Annotation Schemes and A New Annotated Data Set” In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018) Miyazaki, Japan: European Language Resources Association (ELRA), 2018

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now