Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
5 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Probing Brain Context-Sensitivity with Masked-Attention Generation (2305.13863v1)

Published 23 May 2023 in cs.CL

Abstract: Two fundamental questions in neurolinguistics concerns the brain regions that integrate information beyond the lexical level, and the size of their window of integration. To address these questions we introduce a new approach named masked-attention generation. It uses GPT-2 transformers to generate word embeddings that capture a fixed amount of contextual information. We then tested whether these embeddings could predict fMRI brain activity in humans listening to naturalistic text. The results showed that most of the cortex within the language network is sensitive to contextual information, and that the right hemisphere is more sensitive to longer contexts than the left. Masked-attention generation supports previous analyses of context-sensitivity in the brain, and complements them by quantifying the window size of context integration per voxel.

User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (4)
  1. Alexandre Pasquiou (3 papers)
  2. Yair Lakretz (17 papers)
  3. Bertrand Thirion (71 papers)
  4. Christophe Pallier (10 papers)

Summary

We haven't generated a summary for this paper yet.