HistoricalMisinfo: A Longitudinal Research Paradigm
- HistoricalMisinfo is a research paradigm for analyzing how misinformation evolves over time across crises, platforms, and historical narratives.
- It employs heterogeneous data sources and scalable proxies—including domain heuristics and fuzzy matching—to measure shifts in prevalence, themes, and linguistic drift.
- The framework informs benchmarks for auditing LLM outputs and offers robust methods to trace narrative revisionism and amplification across digital ecosystems.
Searching arXiv for the provided HistoricalMisinfo-related papers to ground the article in the cited literature.
HistoricalMisinfo is a research framing for the longitudinal study of misinformation across crises, platforms, modalities, user populations, and historical narratives. In the supplied literature, the term spans at least three related but distinct analytical programs: reconstruction of misinformation dynamics in social media discourse during major public events such as COVID-19 [2003.12309]; temporal measurement of misinformation prevalence, themes, and linguistic drift in fact-checked political corpora and platform-specific ecosystems such as Parler [2306.13913], [2411.06122], [2503.04786]; and benchmarking of revisionist historical outputs in large language models through reference-alignment evaluation on contested events [2602.17433]. Across these settings, HistoricalMisinfo denotes not a single dataset or metric, but a historically oriented methodology for tracing how misleading content emerges, shifts, clusters around real-world triggers, and is sustained by infrastructures of amplification, identity signaling, and platform affordances.
1. HistoricalMisinfo as a research paradigm
HistoricalMisinfo is best understood as a longitudinal and comparative orientation toward misinformation research rather than a unitary technique. In crisis communication studies, it refers to reconstruction of how narratives evolved over time on platforms such as Twitter during the first COVID-19 wave, using streaming collection, fact-checker–anchored source labeling, topic extraction, sentiment analysis, and cascade analysis [2003.12309]. In platform studies, it refers to temporal characterization of misinformation on fringe or lightly moderated systems such as Parler, where monthly distributions of fact-checked claim matches are interpreted alongside political and social events [2306.13913]. In computational social science of political fact-checking, it refers to decade-scale analysis of source modalities, sentiment, topics, and named entities in PolitiFact corpora from 2010–2024 or 2011–2023 [2411.06122], [2503.04786]. In LLM auditing, it becomes a benchmark for whether generated historical content aligns more closely with factual or documented revisionist reference narratives across contested events and prompt scenarios [2602.17433].
A common feature across these strands is temporalization. The object of study is not merely whether a statement is false, but how misinformation volume, source composition, thematic structure, or revisionist alignment changes across days, months, years, or historical periods. Another common feature is operationalization through proxies that trade granular fact verification for scale: low-credibility domain lists on Twitter [2003.12309], fuzzy matching to PolitiFact claims on Parler [2306.13913], PolitiFact’s TRUTH-O-METER as a labeling authority for longitudinal corpora [2411.06122], [2503.04786], or paired factual and revisionist reference narratives evaluated by LLM judges [2602.17433]. This suggests that HistoricalMisinfo research is centrally concerned with scalable observability under imperfect ground truth.
The literature also places HistoricalMisinfo within a broader intellectual genealogy. One study argues that the post-2016 platform-centric misinformation paradigm inherits important concepts from the misinformation-effect literature in cognitive psychology, especially work on belief formation, memory distortion, warnings, and correction [2602.22395]. That account treats contemporary misinformation studies as historically connected to pre-social-media work on suggestibility, false memories, and the Satanic panic, rather than as an entirely novel response to platform-scale communication.
2. Longitudinal data sources and operational definitions
HistoricalMisinfo studies rely on heterogeneous corpora, each with a specific notion of misinformation and a distinct temporal window. On Twitter during COVID-19, researchers collected a 1% random sample of tweets containing COVID-19-related keywords from March 1 to June 5, 2020, yielding 85.04 million tweets from 182 countries; 63.88% were in English, and English tweets formed the basis for downstream analysis [2003.12309]. The English retweet/reply graph contained 42.71 million edges, enabling cascade extraction. Misinformation was operationalized at the source-domain level: tweets were labeled “misinformation” if a source tweet linked to a domain appearing in fact-checker-derived lists such as Media Bias/Fact Check, NewsGuard, or the Zimdars list [2003.12309].
On Parler, the searchable universe comprised posts and comments between January and September 2020. The abstract refers to “189 million posts and comments,” while the Methods section specifies 183 million items by 4.4 million users, including 98.5 million posts and 84.5 million comments [2306.13913]. The study scraped 1,591 PolitiFact claims from January–September 2020 and matched them to Parler items using FuzzyWuzzy partial_ratio, producing 231,881 accuracy-labeled posts and comments [2306.13913]. Here, misinformation is claim-linked and inherits PolitiFact’s six-point scale rather than being inferred from source domains.
Two PolitiFact-based temporal studies define misinformation directly from fact-check ratings. One analyzes approximately 15,994 political statements from 2011–2023, mapping FALSE and PANTS-ON-FIRE to “Misinformation,” TRUE and MOSTLY TRUE to “Accurate,” and the remaining ratings to “Mixed-Accuracy” [2411.06122]. Another studies 23,786 PolitiFact entries from 2010–2024, using Accurate, Misinfo, and Mixed as three classes and segmenting time into Early (2010–2014), Middle (2015–2019), and Recent (2020–2024) [2503.04786].
The LLM benchmark version of HistoricalMisinfo departs from platform corpora entirely. It consists of 500 contested events from 45 countries, each paired with a factual reference narrative and a documented revisionist reference narrative, with 11 prompt scenarios per event for a total of 5,500 prompts [2602.17433]. The benchmark does not claim to detect revisionism in an absolute sense; instead, it produces reference-alignment signals using an LLM-as-a-judge protocol [2602.17433]. This reframing is consequential: misinformation becomes a property of relative narrative alignment under realistic prompting conditions rather than a property of individual claims or domains.
These heterogeneous operationalizations imply that HistoricalMisinfo is methodologically plural. Domain heuristics, claim matching, fact-check authority labels, hyperlink ecosystems, psycholinguistic user profiling, and reference-alignment auditing all appear in the corpus. A plausible implication is that cross-study comparisons must be made cautiously because “misinformation” is not identically instantiated across these systems.
3. Temporal structure, event triggers, and narrative persistence
A central claim of HistoricalMisinfo research is that misinformation is temporally coupled to exogenous events. During March–June 2020 on Twitter, source-tweet volumes in misinformation cascades rose steadily from March to June, mirroring overall COVID conversation growth [2003.12309]. The WHO pandemic declaration on March 11 and the US national emergency on March 13 coincided with rapid expansion of Twitter activity and a rising baseline of misinformation source tweets [2003.12309]. End-of-March lockdowns and stay-at-home orders corresponded to increased usage of lockdown-related hashtags and increased politicized discourse [2003.12309].
The Parler study exhibits the same event-sensitive pattern. Overall and BLM-related misinformation volume peaked in June–July 2020, coincident with George Floyd’s murder on May 25 and the subsequent nationwide protests; the authors report nearly 30,000 BLM-related posts in June 2020, then roughly 10,000 fewer in July, around 5,000 in August, and 7,000 in September [2306.13913]. COVID misinformation peaked in July 2020, aligning with U.S. cumulative cases surpassing 3 million, recognition of asymptomatic transmission, CDC mask guidance describing masks as “a critical tool,” and changes to hospital reporting procedures [2306.13913]. Election-related misinformation rose from June to September and peaked in September 2020 amid campaign and transfer-of-power controversies [2306.13913].
Longer-run political fact-check corpora reveal broader structural inflections. The 2011–2023 study reports that misinformation increased substantially and, around 2017, became more frequent than either accurate or mixed-accuracy information considered separately [2411.06122]. The authors situate this inflection roughly a decade after the public launches of Facebook and Twitter and in the period when Facebook approached two billion users [2411.06122]. The 2010–2024 PolitiFact study likewise shows near-uniform class distributions in Early and Middle periods, with a marked spike in Misinfo beginning in 2020 [2503.04786].
Narrative persistence is another recurring finding. In the political misinformation corpus, recurring topic families include Public Figures, Science and Medicine, Policy, Election Integrity, Crime, Economic, and Religion, with topics recurring across 2–7 years [2411.06122]. Joe Biden and COVID have the largest cumulative misinformation volumes, while Mass Shootings and Barack Obama recur most often by count of years [2411.06122]. In web-scale narrative tracking of 1,334 unreliable news websites in 2022, some narratives were time-localized while others persisted throughout the year, including “Killer COVID-19 vaccines” and “2020 election stolen” [2308.02068]. This suggests that HistoricalMisinfo is concerned not only with bursts around events but also with durable narrative templates that reappear across cycles.
4. Platforms, modalities, and infrastructures of amplification
HistoricalMisinfo studies consistently show that misinformation propagation depends on platform-specific affordances and media infrastructures. On Twitter, information cascades were constructed as weakly connected components of the retweet/reply graph, rooted at source tweets, following the Yang and Leskovec cascade framing [2003.12309]. Of 54.32M English tweets, there were 6.37M source tweets, 4.58M of which contained URLs, and 150.8K misinformation source tweets, corresponding to 3.29% of source tweets with external links [2003.12309]. The largest misinformation cascade exceeded 10,000 retweets and was classified as political-clickbait [2003.12309]. Qualitative evidence indicated a heavy-tailed engagement pattern with a handful of very large cascades and many small ones, although the paper did not report formal depth or branching metrics [2003.12309].
The web-link ecosystem perspective yields a more infrastructural account. A study of 755 conspiracy theory websites across QAnon, COVID-19 conspiracies, UFO/Aliens, 9/11, and Flat Earth shows that misinformation outlets share roughly triple the domain overlap with conspiracist sites relative to authentic news or non-news baselines [2301.10880]. The mean percentage of each misinformation site’s external links that point to conspiracy-oriented targets rose from 9.01% in 2009 to 13.2% in 2021, a 46.6% relative increase, while the overall share of all outgoing links from all misinformation sites to conspiracy-oriented domains rose from 13.9% in 2008 to 19.1% in 2021, a 37.8% relative increase [2301.10880]. Partial Granger-causality analyses further identify positive partial Granger causality from misinformation hyperlinks to conspiracy popularity for COVID and 9/11 categories [2301.10880]. In this view, amplification occurs not only through reposts but through routinized cross-linking by misinformation outlets.
Programmatic narrative tracking extends this infrastructure analysis. “Specious Sites” tracks 52,036 narratives across 1,334 unreliable news websites and defines originators as sites posting on the first day a narrative appears, and amplifiers as sites posting before peak within the first 15% of cumulative volume [2308.02068]. The study identifies influential originators and amplifiers whose effect is not reducible to popularity, with only weak correlations between influence and CrUX ranks: Pearson $\rho \approx 0.23$ for origination and $0.30$ for amplification [2308.02068]. It also maps narratives onto 8kun and 4chan /pol, finding that 5.53% of 8kun posts and 9.59% of 4chan posts correspond to tracked narratives with cosine similarity at least $0.60$ [2308.02068]. This establishes a cross-ecosystem version of HistoricalMisinfo in which unreliable websites, fringe platforms, and mainstream attention are semantically linked through narrative trajectories.
Modality diversification is especially prominent in the PolitiFact temporal work. The 2011–2023 study assigns a primary modality to each misinformation source—text, image, video, or individual—and reports that text-first sources such as Facebook and Twitter/X rise sharply around 2017, image-first sources such as Instagram rise around 2019, and video-first sources such as TikTok begin appearing in 2020 [2411.06122]. The 2010–2024 study similarly reports that online/social/digital sources constituted roughly 20% of top sources in the Early period and roughly 80% in the Recent period [2503.04786]. Taken together, these results indicate that HistoricalMisinfo increasingly requires multimodal and cross-platform analysis rather than text-only or platform-isolated methods.
5. Recurrent themes, linguistic signatures, and user-level regularities
Thematically, HistoricalMisinfo research identifies a relatively stable repertoire of misinformation frames. On COVID-19 Twitter, distinctive hashtags in unreliable and conspiracy-labeled source tweets included vaccine, wuhanvirus, lockdown, wwg1wga, fakenews, chinavirus, billgates, hydroxychloroquine, infowars, plandemic, and fauci [2003.12309]. On Parler, the three dominant domains were COVID-19, the 2020 U.S. presidential election, and Black Lives Matter, with recurrent claims about masks, Bill Gates and Anthony Fauci, microchips in vaccines, election fraud, mail-in ballot conspiracies, and narratives delegitimizing BLM protests [2306.13913]. In the twelve-year PolitiFact analysis, recurring higher-level categories include Public Figures, Science and Medicine, Policy, Election Integrity, Crime, Economic, and Religion [2411.06122].
Linguistic studies identify negativity as a consistent but weakening discriminator. In the 2011–2023 PolitiFact corpus, misinformation statements have mean VADER compound sentiment of $-0.08$ versus $-0.03$ for accurate information, with a significant Mann–Whitney U-test at $p < .001$ [2411.06122]. In the 2010–2024 corpus, period means decline from $-0.006 \pm 0.004$ in Early to $-0.050 \pm 0.005$ in Middle and $-0.075 \pm 0.004$ in Recent, with main effects of Period and Rating Type and a Period × Rating Type interaction in ART-ANOVA [2503.04786]. Misinformation is more negative than Accurate and Mixed, but the discriminative gap narrows in recent years because Accurate content also becomes more negative [2503.04786]. This suggests that sentiment remains informative historically but becomes less reliable as a standalone feature under longitudinal drift.
Named entities and entity labels also exhibit structured regularities. The 2010–2024 study finds that presidential incumbents and candidates are relatively more prevalent in statements containing misinformation, while US states are more common in accurate information [2503.04786]. PERSON and ORG labels are relatively more associated with Misinfo, while DATE and PERCENT are relatively more associated with Accurate; label similarity across periods is high, reaching $0.95$ for Middle–Recent in both Accurate and Misinfo top-5 lists [2503.04786]. This implies that generic entity-label categories may generalize better temporally than specific named entities, even if they are less discriminative.
HistoricalMisinfo also includes user-centric regularities. An observational Twitter study on COVID-19 and pre-pandemic politics and climate misinformation shows that users’ historical inclination toward sharing misinformation is strongly associated with later COVID-19 misinformation behavior [2310.08483]. After propensity-score matching and bot filtering, 2,075 of 2,969 treatment users versus 463 of 2,969 controls were labeled COVID misinformative, corresponding to an odds ratio of approximately $12.56$ with 95% CI approximately $[11.1, 14.2]$ and $p < 1e{-16}$ [2310.08483]. Misinformation-prone users also began COVID-19 tweeting earlier—66.89% in January 2020 versus 20.18% of non-misinformative users—and persisted longer, with 86.41% continuing through May 2020 or beyond versus about 32.29% for non-misinformative users [2310.08483]. Psycholinguistically, treatment users showed higher increases in LIWC categories such as verb, social, informal, focuspresent, posemo, and anx, while control users showed larger increases in function, cogproc, and article [2310.08483]. This suggests that HistoricalMisinfo can be framed not only as narrative evolution but as persistence of user-level propensity across domains.
A smaller but analytically distinctive study of misinformation about UK Prime Ministers adds authority-signaling as another recurrent mechanism. Among 1,873 retweet events of two debunked tweets, teachers and lecturers constituted 3.10% of all retweeters and 20.7% of those listing any profession in their bio, compared with a baseline estimate of 1.149% in the UK population, yielding an enrichment ratio of approximately $2.70$ and an odds ratio of approximately $2.75$ [2410.20543]. This suggests that self-claimed trusted professional identities may function as credibility cues in misinformation diffusion.
6. Historical revisionism and LLM auditing
In the LLM setting, HistoricalMisinfo designates a benchmark for contested historical events rather than a social-media corpus. The dataset introduced in 2026 contains 500 events from 45 countries, paired with factual and documented revisionist reference narratives and instantiated in 11 prompt scenarios such as Plain Question, History Textbook, JSON Record, Newspaper Correction, Social Post Writing, Debate Arguments, Museum Label, Policy Brief, and Fact Check [2602.17433]. The benchmark evaluates outputs under neutral prompts requesting factually accurate information and robustness prompts explicitly requesting the revisionist version of the event [2602.17433].
The evaluation protocol is two-stage and multi-judge. Three judge models—GPT-5-nano, Qwen3-235b-A22B, and Gemma-3-27B—first produce a binary decision about whether a response is closer to the factual reference or not; majority vote defines the Stage 1 result [2602.17433]. For responses not classified as factual-aligned, judges assign an ordinal score from 1 to 4: fully revisionist, sanitization, false balance, or mostly factual [2602.17433]. Exact agreement is 77.72% for Stage 1 with Gwet’s AC1 = 0.656, and 59.18% for Stage 2 with ordinal-weighted Gwet’s AC2 of 0.351 (linear) and 0.306 (quadratic) [2602.17433].
Under neutral prompts, revisionist rates vary by model: 13.88% for Qwen3-32B, 21.41% for DeepSeek-R1-Distill-Qwen-32B, 11.54% for gpt-4.1-mini, 10.61% for grok-3-mini, and 31.59% for Mistral-7B-Instruct-v0.3 [2602.17433]. Under robustness prompts explicitly requesting revisionism, non-factual alignment rises sharply to 94.52%, 96.33%, 80.73%, 83.91%, and 96.92%, respectively [2602.17433]. Fully revisionist endorsement is rare under neutral prompts, at less than 1% of non-factual responses, while sanitization and false balance dominate [2602.17433]. Higher revisionism rates occur in social media posts, museum labels, and debate arguments; lower rates occur in fact checks, policy briefs, and book chapters [2602.17433].
This branch of HistoricalMisinfo shifts attention from false claims circulating among users to model behavior under historical contention. The benchmark explicitly warns that its outputs are reference-alignment signals rather than definitive evidence of human-interpretable revisionism [2602.17433]. Even so, the observed pattern—especially widespread compliance with explicit revisionist requests—positions HistoricalMisinfo as a framework for robustness auditing in high-stakes historical information settings.
7. Interpretation, limitations, and historiographical significance
HistoricalMisinfo research is defined as much by its methodological caveats as by its findings. Domain-list labeling on Twitter is scalable but does not provide claim-level validation, precision/recall, or inter-annotator agreement; reliable domains can host misleading content, unreliable domains can host true content, and satire blurs intent [2003.12309]. The Parler study inherits uncertainty from fuzzy matching and reports a threshold description—retaining “all data that had below 20% score” as indicating a strong match—that conflicts with standard FuzzyWuzzy conventions [2306.13913]. The PolitiFact temporal studies are limited by editorial selection, source-modality simplifications, VADER’s rule-based character, and the fact that analyses are performed on PolitiFact statement summaries rather than original multimodal content [2411.06122], [2503.04786]. The user-centric Twitter study relies on classifier-based tweet labeling and quasi-experimental PSM/DID assumptions that cannot eliminate all confounding [2310.08483]. The LLM benchmark notes the absence of professional historians in curation and evaluation and emphasizes that factual versus revisionist distinctions can remain contested [2602.17433].
At the historiographical level, the field has also begun to examine its own lineage. One literature analysis tracks the term “misinformation” from mid-century health and policy usage, through the misinformation effect in cognitive psychology, to the post-2016 platform paradigm [2602.22395]. It reports corpus growth from 118 “misinformation” papers in 2011 to 3,380 in 2023, with post-2016 terms dominated by “social media,” “pandemic,” and “fake news,” while pre-2016 terms emphasize “women,” “children,” “memory,” and “recall” [2602.22395]. The same study argues that the modern field is stronger on individual-level mechanisms of susceptibility and correction than on platform structure and political economy [2602.22395]. This suggests that HistoricalMisinfo is itself historically situated: it studies misinformation historically while also emerging from a particular post-2016 reconfiguration of scientific attention.
Across the corpus, several general propositions recur. Misinformation volume tends to rise with overall crisis attention [2003.12309]. Politically inflected and clickbait narratives often attract more engagement than overtly false claims [2003.12309]. False content dominates matched misinformation on Parler, where 69.2% of matched items are labeled false and 7.6% barely true [2306.13913]. Misinformation becomes increasingly multimodal and platform-diverse over the 2010s and 2020s [2411.06122], [2503.04786]. Recurrent topic families persist across years even as source rosters and salient entities drift [2411.06122], [2503.04786]. Historically misinformation-prone users are much more likely to become misinformation spreaders on emergent topics [2310.08483]. And LLMs, while usually closer to factual references under neutral prompts, show limited resistance when explicitly asked to produce revisionist narratives [2602.17433].
HistoricalMisinfo, in this sense, names a convergence of temporal analysis, scalable proxy labeling, narrative reconstruction, and robustness auditing. Its significance lies in making misinformation visible not as an isolated false claim but as an evolving historical process distributed across infrastructures, communities, linguistic forms, and now generative systems.