- The paper compares 2,160 LLM-generated posts with 1,250 authentic disability-related Reddit posts, using sentiment, emotion, depression, and lexical analyses to audit representation.
- The paper finds that LLM disability portrayals are overwhelmingly positive—96.39% to 99.72%—while 53.06% of real posts are negative, and models largely erase depression, pain, economic hardship, and unredeemed struggle.
- The paper shows a double distortion: models idealize disability through inspirational narratives while associating disabled personas with more anger and sadness and excluding ordinary themes such as careers, entertainment, and leisure.
This paper investigates how LLMs represent people with disabilities, comparing AI-generated social media self-portrayals with authentic posts written by individuals with disabilities. The authors—Bombieri, Ponzetto, and Rospocher—frame the study around two research questions: (RQ1) how LLM-generated portrayals of disability compare with real self-descriptions, and (RQ2) whether LLMs alter their language when simulating disabled versus generic personas. The central finding is a double distortion: LLMs simultaneously over-idealize disability relative to real accounts (toxic positivity, inspiration-porn-like narratives) and differentially mark disability with more negative emotional tones relative to generic personas, while excluding themes such as career and entertainment from disabled portrayals (2605.20191).
The study is situated in the literature on representational harms in LLMs, which inherit and amplify societal stereotypes from web-scale training data. The authors emphasize that prior work has concentrated on age, race/ethnicity, and gender, while disability—despite affecting roughly 1.3 billion people according to the WHO—remains underexamined, partly because existing bias benchmarks (BBQ, HolisticBias, PANDA) cover only a narrow range of impairments. A key conceptual contribution of the related-work section is the distinction between three harmful mechanisms of "positive" bias: positive idealization (representing marginalized identities exclusively through flattering traits), toxic positivity (using positive language to deny or downplay marginalization), and overcompensation (debiasing-driven amplification of positive descriptors to unrealistic degrees). The paper also draws on disability studies—social vs. medical models of disability, ableism, and the concept of "inspiration porn"—to argue that bias audits must go beyond detecting negative stereotypes, since seemingly benevolent portrayals can also reproduce harm.
Prior empirical findings reviewed include perturbation-sensitivity studies showing implicit bias against disability terms in BERT and GPT-2, GPT-4's discrimination in resume screening, the AccessEval finding that disability-aware queries elicit more negative, stereotyped, and error-prone responses, and survey-impersonation work showing that LLM-generated profiles of people with disabilities systematically reflect stereotypical associations (lower education, income, and life satisfaction). The paper extends this line by combining sentiment, emotion, depression detection, z-score-based lexical analysis, and thematic clustering.
Datasets and methodology
Three datasets were constructed. First, LLM-generated portrayals: three models (GPT-4o-mini, Gemini-1.5 Flash, and Mixtral-8x7B Instruct quantized to 4 bits) were prompted with an open-ended template ("Imagine you are [PERSON]. Write a post on social media introducing yourself and [ACTIVITY]") at temperature 1.0. Six disability variants (disability generally, autism, blindness, deafness, cerebral palsy, depression) crossed with six activities yielded 360 disability-focused posts per model (LLM_d), and six generic-person variants yielded 360 non-disability posts per model (LLM_nd). Second, a human dataset (REDd) of 1,250 first-person self-descriptive posts collected from six disability-related subreddits (r/disability, r/blind, r/autism, r/depression, r/deaf, r/cerebralpalsy), filtered with Mixtral-8B (78% accuracy, purely functional) and manually validated by three annotators with very high inter-annotator agreement (Fleiss' Kappa = 0.875). Both datasets and code are publicly released.
Comparison metrics comprise: VADER sentiment classification; emotion distributions via the NRC EmoLex lexicon (with the acknowledged limitation that word-level counting ignores negation and context); depression labels from the best LT-EDI-ACL2022 shared-task model (no / moderate / severe); and "Fightin' Words" analysis (Monroe et al.) to extract statistically distinctive vocabulary (z-score > 1.96), which GPT-4o-mini then clustered into up to ten human-interpretable themes, with manual correction.
RQ1: LLM portrayals versus real self-descriptions
The quantitative gap is stark. LLM-generated disability posts are almost uniformly positive in sentiment—ranging from 96.39% (Gemini-1.5F) to 99.72% (GPT-4o-mini)—whereas 53.06% of real Reddit posts are negative. The depression analysis is the most striking contrast: GPT-4o-mini produced zero posts flagged for depression even when simulating a person with depression; Mixtral-8B produced one; Gemini-1.5F flagged 4.17% as moderate. In REDd, by contrast, 20.42% of posts show signs of severe depression and 26.26% moderate depression. Emotion distributions follow the same pattern, with real posts richer in anger, disgust, fear, and sadness, and LLM posts richer in joy, trust, surprise, and anticipation.
Lexical analysis reinforces this. Words distinctive of LLM output cluster around advocacy, community, inspiration, joy, and resilience ("inclusion," "share," "grateful," "excited," "inspire," "victory," "strength," "journey"), with distinctive words associated with positive emotions at a high rate. Words distinctive of real posts cluster around medical experience ("pain," "doctor," "surgery," "diagnosis"), economic hardship ("job," "money," "unemployed," "homeless"), negative affect ("hate," "tired," "anxiety," "crying," "suicidal"), and self-harm ("suicide," "kill," "cutting"); 68.82% of these distinctive words carry negative EmoLex associations versus 31.18% positive. Qualitatively, the authors identify a recurring "challenge–growth–acceptance" narrative arc in LLM output that is largely absent from real posts, which frequently express unredeemed, chronic struggle.
The implication the authors draw is that LLMs sanitize disability into an inspirational narrative, producing toxic positivity that marginalizes people whose actual experiences involve pain, financial precarity, and mental-health crises. They attribute the over-idealization plausibly to RLHF and safety guardrails that penalize negative or ambivalent output—an explanation they present as a hypothesis rather than a demonstrated mechanism.
RQ2: Disabled versus generic personas
When comparing LLM_d against LLM_nd within each model, sentiment and depression outputs remain almost entirely positive in both settings, but emotion profiles differ significantly (t-test, p < 0.05): disability-conditioned posts exhibit higher anger and sadness and lower joy across models, with model-specific variations (e.g., higher trust for Gemini-1.5F and GPT-4o-mini, lower surprise for Gemini-1.5F and Mixtral-8B). Distinctive vocabulary for disabled personas centers on disability/advocacy, inclusion/accessibility, resilience, and isolation; distinctive vocabulary for generic personas centers on entertainment, adventure, food, career ("profession," "productivity," "career"), and personal growth. Notably, 39.05% of the distinctive words for disabled personas carry negative emotion associations versus 20.76% for generic ones.
This yields the paper's second, somewhat contradictory finding: even while idealizing disability, models implicitly associate it with more negative emotional tone and systematically exclude ordinary life domains—work and leisure—from disabled portrayals. The authors argue this reinforces a monolithic identity of disability as struggle and exceptionalism, echoing the "supercrip" critique from disability studies. The generic-persona narratives, by contrast, are static day-in-the-life snapshots without the redemption arc imposed on disabled personas.
Limitations and open questions
The paper is explicit about several constraints. The analysis covers only a subset of impairments, chosen for comparability with prior work. Lexicon-based emotion and sentiment tools (VADER, EmoLex) may miss contextual nuance, though they were chosen for explainability and reproducibility. There is no human-in-the-loop evaluation by people with disabilities—a significant omission the authors acknowledge, noting that community-informed, participatory evaluation is needed to assess how such portrayals are actually experienced. The comparison lacks a Reddit corpus of non-disabled self-descriptions, because unmarked disability status is hard to retrieve reliably; this asymmetry means the RQ2 comparison is entirely within LLM-generated content. Findings are also tied to specific model versions and guardrail configurations at test time. Finally, the causal attribution of over-positivity to RLHF and safety filters is conjectural; the opaque, undisclosed moderation thresholds of commercial models prevent direct verification.
Conclusion
The paper contributes a public dataset of 1,250 annotated real self-descriptions and 2,160 LLM-generated persona posts, and demonstrates with converging quantitative and qualitative evidence that LLM representations of disability are doubly distorted: over-idealized relative to lived experience, and thematically impoverished relative to generic personas. The authors argue that group-level debiasing is insufficient—since preferences over representation are individual and sometimes subjective—and call for personalized, user-centric approaches, extended multilingual and multimodal analysis, and deeper study of narrative structures. The open question the paper most directly poses is how alignment techniques can be designed to represent the full spectrum of human emotion, including suffering, without reverting to the negative stereotypes debiasing was meant to remove.