What is the disinformation problem? Reviewing the dominant paradigm and motivating an alternative sociopolitical view
Abstract: Disinformation research has proliferated in reaction to widespread false, problematic beliefs purported to explain major social phenomena. Yet while the effects of disinformation are well-known, there is less consensus about its causes; the research spans several disciplines, each focusing on different pieces. This article contributes to this growing field by reviewing prevalent U.S. disinformation discourse (academic writing, media, and corporate and government narrative) and outlining the dominant understanding, or paradigm, of the disinformation problem by analyzing cross-disciplinary discourse about the content, individual, group, and institutional layers of the problem. The result is an individualistic explanation largely blaming social media, malicious individuals or nations, and irrational people. Yet this understanding has shortcomings: notably, that its limited, individualistic views of truth and rationality obscures the influence of oppressive ideologies and media or domestic actors in creating flawed worldviews and spreading disinformation. The article then concludes by putting forth an alternative, sociopolitical paradigm that allows subjective models of the world to govern rationality and information processing -- largely informed by social and group identity -- which are being formed and catered to by institutional actors (corporations, media, political parties, and the government) to maintain or gain legitimacy for their actions.
- Opinion dynamics optimization by varying susceptibility to persuasion via non-convex local search. ACM Transactions on Knowledge Discovery from Data (TKDD), 16(2):1–34, 2021.
- The great hack, 2019.
- C. Anderson. Propaganda, misinformation, and histories of media techniques. Harvard Kennedy School Misinformation Review, 2, 2021.
- Selective exposure and news media brands: Implicit and explicit attitudes as predictors of news choice. Media Psychology, 22(3):526–543, 2019.
- Fake news, fast and slow: Deliberation reduces belief in false (but not true) news headlines. Journal of experimental psychology: general, 2020.
- Exposure to ideologically diverse news and opinion on facebook. Science, 348(6239):1130–1132, 2015.
- D. Baldassarri and P. Bearman. Dynamics of political polarization. American sociological review, 72(5):784–811, 2007.
- S. Benen. As homeland security tackles disinformation, the right balks. Technical report, MSNBC, 4 2022. URL https://www.msnbc.com/rachel-maddow-show/maddowblog/homeland-security-tackles-disinformation-right-balks-rcna26633.
- Y. Benkler. Cautionary notes on disinformation and the origins of distrust. MediaWell, October 2019. URL https://mediawell.ssrc.org/expert-reflections/cautionary-notes-on-disinformation-benkler/.
- Network propaganda: Manipulation, disinformation, and radicalization in American politics. Oxford University Press, 2018.
- A crisis of civility?: political discourse and its discontents. Routledge, 2019.
- J. Bolton. Remarks by national security advisor ambassador john r. bolton on the administration’s policies in latin america. Remarks by the National Security Council, November 2018. URL https://trumpwhitehouse.archives.gov/briefings-statements/remarks-national-security-advisor-ambassador-john-r-bolton-administrations-policies-latin-america/.
- An ideological asymmetry in the diffusion of moralized content on social media among political leaders. Journal of Experimental Psychology: General, 148(10):1802, 2019.
- The mad model of moral contagion: The role of motivation, attention, and design in the spread of moralized content online. Perspectives on Psychological Science, 15(4):978–1010, 2020.
- Belief in fake news is associated with delusionality, dogmatism, religious fundamentalism, and reduced analytic thinking. Journal of applied research in memory and cognition, 8(1):108–117, 2019.
- Digital technologies and selective exposure: How choice and filter bubbles shape news media exposure. The international journal of press/politics, 24(4):465–486, 2019.
- A. Carey. Taking the risk out of democracy: Corporate propaganda versus freedom and liberty. University of Illinois Press, 1997.
- T. Carlson. Tucker carlson reacts to roe v. wade protests: This is a coordinated attack on the family and on children. Technical report, Fox News, 6 2022. URL https://www.foxnews.com/opinion/tucker-carlson-reacts-roe-wade-protests-coordinated-attack.
- N. Chomsky and E. S. Herman. Manufacturing consent: The political economy of the mass media. Vintage Books London, 1994.
- Us and them: Intergroup failures of empathy. Current Directions in Psychological Science, 20(3):149–153, 2011.
- C. Cillizza. The nba is back! unfortunately, so are its covid-19 skeptics. Technical report, CNN, 9 2021. URL https://www.cnn.com/2021/09/28/politics/nba-covid-19-vaccinations-skepticism/index.html.
- P. H. Collins. Black feminist thought: Knowledge, consciousness, and the politics of empowerment. routledge, 2002.
- America misled: How the fossil fuel industry deliberately misled americans about climate change. George Mason University Center for Climate Change Communication. https://www. climatechangecommunication. org/america-misled, 2019.
- Biased assimilation, homophily, and the dynamics of polarization. Proceedings of the National Academy of Sciences, 110(15):5791–5796, 2013.
- The spreading of misinformation online. Proceedings of the National Academy of Sciences, 113(3):554–559, 2016.
- C. D’ignazio and L. F. Klein. Data feminism. MIT press, 2020.
- J. Dower. War without mercy: Race and power in the Pacific War. Pantheon, 2012.
- R. Dunbar-Ortiz. An indigenous peoples’ history of the United States, volume 3. Beacon Press, 2014.
- Are misinformation, antiscientific claims, and conspiracy theories for political extremists? Group Processes & Intergroup Relations, 24(4):583–605, 2021.
- The relationship between social media use and beliefs in conspiracy theories and misinformation. Political behavior, pages 1–24, 2021.
- Concepts, causes and consequences of trust in news media–a literature review and framework. Annals of the International Communication Association, 45(2):154–174, 2021.
- S. Frenkel. The most influential spreader of coronavirus misinformation online. The New York Times, July 2021. URL https://www.nytimes.com/2021/07/24/technology/joseph-mercola-coronavirus-misinformation-online.html.
- How the ‘plandemic’ movie and its falsehoods spread widely online. The New York Times, May 2020. URL https://www.nytimes.com/2020/05/20/technology/plandemic-movie-youtube-facebook-coronavirus.html.
- V. Gadde and Y. Roth. Enabling further research of information operations on twitter. Twitter Blog, October 2018.
- R. K. Garrett. The “echo chamber” distraction: Disinformation campaigns are the problem, not audience fragmentation. Journal of Applied Research in Memory and Cognition, 2017.
- The structural virality of online diffusion. Management Science, 62(1):180–196, 2016.
- A. Goldberg and S. K. Stein. Beyond social contagion: Associative diffusion and the emergence of cultural variation. American Sociological Review, 83(5):897–932, 2018.
- A. Graan. The fake news mills of macedonia and other liberal panics. Hot Spots, Cultural Anthropology website, 2018. URL https://culanth.org/fieldsights/1419-the-fake-news-mills-ofmacedonia-and-other-liberal-panics.
- Fake news and anthropology: A conversation on technology, trust, and publics in an age of mass disinformation. Political and legal anthropology review, 2020.
- J. Gramlich. 20 striking findings from 2020. Technical report, Pew Research Center, December 2020. URL https://www.pewresearch.org/fact-tank/2020/12/11/20-striking-findings-from-2020/.
- Avoiding the echo chamber about echo chambers. Knight Foundation, 2:1–25, 2018.
- A digital media literacy intervention increases discernment between mainstream and false news in the united states and india. Proceedings of the National Academy of Sciences, 117(27):15536–15545, 2020.
- K. Hagey and J. Horowitz. Facebook tried to make its platform a healthier place. it got angrier instead. The Wall Street Journal, September 2021. URL https://www.wsj.com/articles/facebook-algorithm-change-zuckerberg-11631654215.
- D. Hawkins. The cybersecurity 202: The facebook ad dump shows the true sophistication of russia’s influence operation. The Washington Post, May 2018. URL https://www.washingtonpost.com/news/powerpost/paloma/the-cybersecurity-202/2018/05/11/the-cybersecurity-202-the-facebook-ad-dump-shows-the-true-sophistication-of-russia-s-influence-operation/5af4733a30fb04258879944e/.
- S. Iyengar and K. S. Hahn. Red media, blue media: Evidence of ideological selectivity in media use. Journal of communication, 59(1):19–39, 2009.
- Political conservatism as motivated social cognition. Psychological bulletin, 129(3):339, 2003.
- Political ideology: Its structure, functions, and elective affinities. Annual review of psychology, 60:307–337, 2009.
- Ideological asymmetries in conformity, desire for shared reality, and the spread of misinformation. Current opinion in psychology, 23:77–83, 2018.
- M. Jurkowitz and A. Mitchell. Fewer americans now say media exaggerated covid-19 risks, but big partisan gaps persist. Technical report, Pew Research Center, May 2020. URL https://www.journalism.org/2020/05/06/fewer-americans-now-say-media-exaggerated-covid-19-risks-but-big-partisan-gaps-persist/.
- Do high-choice media environments facilitate news avoidance? a longitudinal study 1997–2016. Journal of Broadcasting & Electronic Media, 64(5):794–814, 2020.
- Y. Katz. Artificial whiteness. In Artificial Whiteness. Columbia University Press, 2020.
- Americans’ trust in scientists, other groups declines. Technical report, Pew Research Center, February 2022. URL https://www.pewresearch.org/science/2022/02/15/americans-trust-in-scientists-other-groups-declines/.
- S. Knobloch-Westerwick. Choice and preference in media use: Advances in selective exposure theory and research. Routledge, 2014.
- Addressing the root of vaccine hesitancy during the covid-19 pandemic. XRDS: Crossroads, The ACM Magazine for Students, 28(2):34–38, 2022.
- T. S. Kuhn. The structure of scientific revolutions, volume 111. Chicago University of Chicago Press, 1970.
- R. Kuo and A. Marwick. Critical disinformation studies: History, power, and politics. Harvard Kennedy School Misinformation Review, 2(4):1–11, 2021.
- G. Lakey. Viking economics: How the Scandinavians got it right-and how we can, too. Melville House, 2016.
- A. Marwick and W. Partin. Qanon shows that the age of alternative facts will not end with trump. Columbia Journalism Review. https://www. cjr. org/opinion/qanon-trumpalternative-facts. php, 2020.
- Critical disinformation studies: A syllabus. Technical report, Center for Information, Technology, & Public Life (CITAP), University of North Carolina at Chapel Hill, 2021. URL https://citap.unc.edu/critical-disinfo.
- A. E. Marwick. Why do people share fake news? a sociotechnical model of media effects. Georgetown Law Technology Review, 2(2):474–512, 2018.
- Psychological targeting as an effective approach to digital mass persuasion. Proceedings of the national academy of sciences, 114(48):12714–12719, 2017.
- A. Melber. Transcript: The beat with ari melber, 10/8/21. Technical report, MSNBC, 10 2021. URL https://www.msnbc.com/transcripts/transcript-beat-ari-melber-10-8-21-n1281209.
- S. Messing and S. J. Westwood. Selective exposure in the age of social media: Endorsements trump partisan source affiliation when selecting news online. Communication research, 41(8):1042–1063, 2014.
- Cognitive dissonance or credibility? a comparison of two theoretical explanations for selective exposure to partisan news. Communication Research, 47(1):3–28, 2020.
- W. Meyer. The abuses of objectivity: Why the ideal of neutrality in journalism pushes discourse to the right. The New Republic, 2 2020. URL https://newrepublic.com/article/156486/abuses-objectivity.
- R. E. Moran. Trust and authenticity as tools for journalism and partisan disinformation. Beyond Disinformation, 2021.
- Being digital. Computers in Physics, 11(3):261–262, 1997.
- S. U. Noble. Algorithms of oppression. In Algorithms of Oppression. New York University Press, 2018.
- U. D. of Defense. Summary of the 2018 national defense strategy of the united states of america: Sharpening the american military’s competitive edge. Technical report, U.S. Department of Defense, 2018. URL https://dod.defense.gov/Portals/1/Documents/pubs/2018-National-Defense-Strategy-Summary.pdf.
- K. Ognyanova. Network approaches to misinformation evaluation and correction. In Networks, knowledge brokers, and the public policymaking process, pages 351–373. Springer, 2021.
- D. O’Sullivan. Sidney powell is a beacon of hope to sad qanon supporters. Technical report, CNN, 11 2020. URL https://www.cnn.com/2020/11/24/business/sidney-powell-qanon/index.html.
- D. O’Sullivan. Qanon believers gathered to see something physically impossible. Technical report, CNN, 11 2021. URL https://www.cnn.com/videos/business/2021/11/03/qanon-jfk-jr-dallas-trump-osullivan-newday-ldn-vpx.cnn/video/playlists/business-misinformation/.
- D. O’Sullivan. Cnn reporter on return of ’q’: ’as dumb as it is dangerous’. Technical report, CNN, 6 2022. URL https://www.cnn.com/videos/business/2022/06/27/qanon-q-online-posts-osullivan-avlon-new-day-vpx.cnnbusiness.
- G. Pennycook and D. G. Rand. Lazy, not biased: Susceptibility to partisan fake news is better explained by lack of reasoning than by motivated reasoning. Cognition, 188:39–50, 2019.
- G. Pennycook and D. G. Rand. Who falls for fake news? the roles of bullshit receptivity, overclaiming, familiarity, and analytic thinking. Journal of personality, 88(2):185–200, 2020.
- G. Pennycook and D. G. Rand. The psychology of fake news. Trends in cognitive sciences, 25(5):388–402, 2021.
- Fighting covid-19 misinformation on social media: Experimental evidence for a scalable accuracy-nudge intervention. Psychological science, 31(7):770–780, 2020.
- D. Pilgrim. Jim crow museum. Technical report, Jim Crow Museum, 2002.
- A. Polyakova. What the mueller report tells us about russian influence operations. Brookings Institute, April 2019. URL https://www.brookings.edu/blog/order-from-chaos/2019/04/18/what-the-mueller-report-tells-us-about-russian-influence-operations/.
- N. Porot and E. Mandelbaum. The science of belief: A progress report. Wiley Interdisciplinary Reviews: Cognitive Science, page e1539, 2020.
- R. D. Putnam. Bowling alone: The collapse and revival of American community. Simon and schuster, 2000.
- S. Rampton and J. Stauber. Weapons of mass deception: The uses of propaganda in Bush’s war on Iraq. Penguin, 2003.
- L. Rhodes. The social dilemma, 2020.
- E. Robinson. How dumb can a nation get and still survive? Technical report, Washington Post, 10 2021. URL https://www.washingtonpost.com/opinions/2021/10/07/reconciliation-vaccines-election-america-dumb/.
- G. Rosen. How we’re tackling misinformation across our apps. Facebook Newsroom, March 2021. URL https://about.fb.com/news/2021/03/how-were-tackling-misinformation-across-our-apps/.
- Evaluating expectations from social and behavioral science about covid-19 and lessons for the next pandemic. Technical report, Duke University, 2022.
- One-third of asian americans fear threats, physical attacks and most say violence against them is rising. Technical report, Pew Research Center, April 2021. URL https://www.pewresearch.org/fact-tank/2021/04/21/one-third-of-asian-americans-fear-threats-physical-attacks-and-most-say-violence-against-them-is-rising/.
- How facebook hobbled mark zuckerberg’s bid to get america vaccinated. The Wall Street Journal, September 2021. URL https://www.wsj.com/articles/facebook-mark-zuckerberg-vaccinated-11631880296.
- H. Silverman. The next phase in fighting misinformation. Facebook Newsroom, April 2019. URL https://about.fb.com/news/2019/04/tackling-more-false-news-more-quickly/.
- S. Sobieraj. Credible threat: Attacks against women online and the future of democracy. Oxford University Press, 2020.
- J. Stanley. How propaganda works. In How Propaganda Works. Princeton University Press, 2015.
- J. Stanley. How fascism works: The politics of us and them. Random House Trade Paperbacks, 2020.
- News media trust and its impact on media use: Toward a framework for future research. Annals of the International Communication Association, 44(2):139–156, 2020.
- C. Sunstein. Republic.com. Princeton University Press, 2001.
- B. Swire-Thompson and D. Lazer. Public health and online misinformation: challenges and recommendations. Annual Review of Public Health, 41:433–451, 2020.
- Z. Tufekci. Twitter and tear gas: The power and fragility of networked protest. Yale University Press, 2017.
- A. Tyson and C. Funk. Increasing public criticism, confusion over covid-19 response in u.s. Technical report, Pew Research Center, February 2022. URL https://www.pewresearch.org/science/2022/02/09/increasing-public-criticism-confusion-over-covid-19-response-in-u-s/.
- J. E. Uscinski. Getting qanon wrong and right. Social Research: An International Quarterly, 89(3):551–578, 2022.
- J. E. Uscinski and M. Atkinson. Why do people believe in conspiracy theories? the role of informational cues and predispositions. The Role of Informational Cues and Predispositions (May 22, 2013), 2013.
- Why do people believe covid-19 conspiracy theories? Harvard Kennedy School Misinformation Review, 1(3), 2020.
- J. J. Van Bavel and A. Pereira. The partisan brain: An identity-based model of political belief. Trends in cognitive sciences, 22(3):213–224, 2018.
- Using social and behavioural science to support covid-19 pandemic response. Nature Human Behaviour, pages 1–12, 2020.
- P. Van Kessel and D. Quinn. Both republicans and democrats cite masks as a negative effect of covid-19, but for very different reasons. Technical report, Pew Research Center, October 2020. URL https://www.pewresearch.org/short-reads/2020/10/29/both-republicans-and-democrats-cite-masks-as-a-negative-effect-of-covid-19-but-for-very-different-reasons/.
- A systematic survey on deep learning and machine learning approaches of fake news detection in the pre-and post-covid-19 pandemic. International Journal of Intelligent Computing and Cybernetics, 2021.
- The dynamics of audience fragmentation: Public attention in an age of digital media. Journal of communication, 62(1):39–56, 2012.
- E. Woo. How covid misinformation created a run on animal medicine. The New York Times, September 2021. URL https://www.nytimes.com/2021/09/28/technology/ivermectin-animal-medicine-shortage.html.
- J. Zarocostas. How to fight an infodemic. The lancet, 395(10225):676, 2020.
- S. Zuboff. The age of surveillance capitalism: The fight for a human future at the new frontier of power. Profile Books, 2019.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.