Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
134 tokens/sec
GPT-4o
9 tokens/sec
Gemini 2.5 Pro Pro
47 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Detecting Effects of AI-Mediated Communication on Language Complexity and Sentiment (2504.19556v1)

Published 28 Apr 2025 in cs.CL and cs.HC

Abstract: Given the subtle human-like effects of LLMs on linguistic patterns, this study examines shifts in language over time to detect the impact of AI-mediated communication (AI- MC) on social media. We compare a replicated dataset of 970,919 tweets from 2020 (pre-ChatGPT) with 20,000 tweets from the same period in 2024, all of which mention Donald Trump during election periods. Using a combination of Flesch-Kincaid readability and polarity scores, we analyze changes in text complexity and sentiment. Our findings reveal a significant increase in mean sentiment polarity (0.12 vs. 0.04) and a shift from predominantly neutral content (54.8% in 2020 to 39.8% in 2024) to more positive expressions (28.6% to 45.9%). These findings suggest not only an increasing presence of AI in social media communication but also its impact on language and emotional expression patterns.

Summary

Analyzing AI-Mediated Communication: Shifts in Language Complexity and Sentiment on Social Media

The exploration conducted by Kristen Sussman and Daniel Carter provides insight into the impact of AI-mediated communication (AI-MC) on linguistic patterns and emotional expression in social media. Their paper focuses on discerning shifts in language complexity and sentiment polarity within tweets mentioning Donald Trump, comparing data from pre-ChatGPT (2020) with the same timeframe post-ChatGPT (2024).

In terms of language complexity, the researchers employed the Flesch-Kincaid readability test to assess textual variations. The 2020 dataset exhibited a broader range of readability scores compared to the 2024 dataset, which showed constrained maximum values and reduced variability, characteristic of AI-generated text. Despite the modest practical difference in mean grade levels, the confinement of extreme values presents evidence consistent with the influence of AI systems leading to standardized text production.

The sentiment analysis component of the paper reveals more pronounced changes. Utilizing TextBlob and VADER tools, the polarity scores indicated a significant increase in positive expression from 2020 to 2024, reflected by a notable rise in mean sentiment polarity (0.12 vs. 0.04). Additionally, there was a marked shift from predominantly neutral content in 2020 to more positive expressions by 2024. This transition, together with a nearly doubled presence of strongly positive sentiment and slight decreases in strongly negative sentiment, reinforces the notion of AI-mediation perceptibly altering the emotional tone of social media discourse.

The implications of this research are manifold. Firstly, the inclination towards more positive sentiment and standardized language complexity in AI-influenced communication proposes a shift towards greater emotional engagement, potentially increasing content shareability and user interaction on social networks. This evolution in linguistics and sentiment may gradually normalize AI-mediated styles, influencing the dynamics of online discourse.

From an ethical standpoint, the paper raises pertinent questions regarding the neutrality of AI systems and their potential capacity to guide or manipulate political narratives through seemingly benign communication improvements. Although the AI declined tasks involving politically sensitive content, the propensity for subtle influence remains a critical consideration.

This research invites further investigation into elucidating AI-MC's role within rapidly evolving digital communication and user interaction paradigms. Future developments in AI-mediated communication could deepen understandings of how AI systems not only participate in but also shape social engagement, necessitating rigorous ethical frameworks and structural scrutiny.

Looking forward, further research, focusing on broader datasets and varied sociopolitical contexts, could enrich comprehension of AI's nuanced effects on communication and emotional expression. As AI integration into human communication accelerates, untangling the subtleties of its impacts and defining responsible practices will remain an imperative of scholarly discourse in human-computer interaction and social network analysis.