From "um" to "yeah": Producing, predicting, and regulating information flow in human conversation

Abstract: Conversation demands attention. Speakers must call words to mind, listeners must make sense of them, and both together must negotiate this flow of information, all in fractions of a second. We used LLMs to study how this works in a large-scale dataset of English-language conversation, the CANDOR corpus. We provide a new estimate of the information density of unstructured conversation, of approximately 13 bits/second, and find significant effects associated with the cognitive load of both retrieving, and presenting, that information. We also reveal a role for backchannels -- the brief yeahs, uh-huhs, and mhmms that listeners provide -- in regulating the production of novelty: the lead-up to a backchannel is associated with declining information rate, while speech downstream rebounds to previous rates. Our results provide new insights into long-standing theories of how we respond to fluctuating demands on cognitive resources, and how we negotiate those demands in partnership with others.

• The paper reveals that conversational English exhibits an information rate of about 13 bits/second, challenging previous estimates.
• The paper demonstrates that higher-surprise words correlate with longer articulation times, indicating efficient speech production.
• The paper highlights how listener backchannels regulate dialogue, synchronizing cognitive models in real-time conversation.

Quantitative Analysis of Conversational Dynamics through LLMs

Introduction

The intricate dance of human conversation balances on the razor's edge of cognitive processing, where every word chosen and every pause taken is both a result of and a contributor to this dynamic interplay. Recent research by Claire Augusta Bergey and Simon DeDeo leverages the power of LLMs to explore the underlying mechanics of information exchange in English conversations, using the CANDOR corpus as a reflective lens. This analysis illuminates the nuanced ways in which speakers manage cognitive load through speech rate, word selection, and listener feedback mechanisms.

The Information Density of Conversation

Bergey and DeDeo's utilization of LLMs to estimate the information rate of conversational English yields an intriguing result: a rate of approximately 13 bits/second. This figure is markedly lower than the previously suggested "universal" rate of 39 bits/second. The research attributes this disparity to the capacity of humans in conversation to leverage contextual cues, thus reducing the element of surprise in word selection and potentially setting an upper bound on our estimates when using LLMs not specially trained on conversational texts. These findings offer a compelling recalibration of our understanding of linguistic information density within spontaneous discourse.

Efficient Coding in Speech Production

The investigation further explores the hypothesis that higher-surprise words—those less predictable within context—necessitate longer articulation times. Confirming this hypothesis, the study identifies a direct correlation between word surprise and speech duration. This relationship persists even when evaluating the same word across varying contexts, underscoring the fluid dynamics by which speakers communicate complex thoughts under tight cognitive constraints. These results reinforce the critical interplay between information theory and articulatory effort in the optimization of human speech.

Computational Constraints on Speech Retrieval

The act of choosing the next word to utter is as significant as its eventual articulation. Bergey and DeDeo pinpoint several strategic pauses and disfluencies (e.g., "uh", "um") that speakers employ to buffer the cognitive load of retrieving high-surprise words. This aspect of their research elucidates the pre-articulatory phase of speech production, contributing a nuanced understanding of how speakers navigate the limitations of real-time cognitive processing during conversation.

Backchannels as Regulatory Feedback

Perhaps the most socially interactive component of Bergey and DeDeo's findings is the role of backchannels—minimalist verbal cues provided by listeners ("yeah", "mhmm")—in regulating conversational flow. The research evidences a reciprocal adjustment between speaker and listener, governed by the predictability of information being exchanged. This insight into listener feedback mechanisms opens new avenues for examining how conversational partners synchronizes their cognitive models to achieve mutual comprehension and maintain the pace of dialogue.

Future Implications and Theoretical Integration

Bergey and DeDeo's research provides a foundationally rich perspective on the cognitive and communicative mechanisms orchestrating human conversation. By leveraging advanced LLMs, the study breathes new life into longstanding theories of language production and comprehension, reframing these processes as deeply interactive and dynamically regulated activities.

The implications of this work stretch beyond the confines of linguistics and cognitive science. They beckon a cross-disciplinary synthesis that could illuminate the paths toward more sophisticated AI conversational models and enhance our grasp of human cognitive architecture. Moreover, the study's nuanced approach invites future research to explore the multi-layered complexity of communication, perhaps extending beyond verbal language to include the gestural and contextual nuances that enrich human interaction.

In sum, Bergey and DeDeo's exploration into the ebb and flow of conversational dynamics through the lens of information theory and LLM predictions marks a significant stride in the quest to decode the underpinnings of human discourse. By revealing the delicate balance of cognitive load management, signal processing, and mutual adaptivity inherent in conversation, this research sketches a more comprehensive map of the linguistic territory our minds navigate every day.