Effect of generative AI on coordinated online behavior

Determine the effects of generative artificial intelligence techniques (including large language models and AI-generated multimedia content) on the landscape of coordinated online behavior, specifically how the use of these techniques by coordinated actors impacts the detectability of coordination and the assessment of account authenticity.

Background

The survey discusses emerging challenges posed by generative AI, noting that coordinated actors may leverage AI to produce human-like text, images, audio, and video and to simulate authentic online behaviors that evade existing detection systems. This raises concerns about the increasing difficulty of identifying coordination and evaluating the authenticity of accounts.

While generative AI may also enable realistic simulations useful for training and evaluating detection methods, the overall impact of such technologies on online coordination dynamics is presently unknown. Clarifying these effects is essential to adapt detection and characterization methodologies and to inform platform policies and research agendas.