2000 character limit reached
Reformulating NLP tasks to Capture Longitudinal Manifestation of Language Disorders in People with Dementia (2310.09897v1)
Published 15 Oct 2023 in cs.CL
Abstract: Dementia is associated with language disorders which impede communication. Here, we automatically learn linguistic disorder patterns by making use of a moderately-sized pre-trained LLM and forcing it to focus on reformulated NLP tasks and associated linguistic patterns. Our experiments show that NLP tasks that encapsulate contextual information and enhance the gradient signal with linguistic patterns benefit performance. We then use the probability estimates from the best model to construct digital linguistic markers measuring the overall quality in communication and the intensity of a variety of language disorders. We investigate how the digital markers characterize dementia speech from a longitudinal perspective. We find that our proposed communication marker is able to robustly and reliably characterize the language of people with dementia, outperforming existing linguistic approaches; and shows external validity via significant correlation with clinical markers of behaviour. Finally, our proposed linguistic disorder markers provide useful insights into gradual language impairment associated with disease progression.
- Connected speech as a marker of disease progression in autopsy-proven Alzheimer’s disease. Brain, 136(12):3727–3737.
- To BERT or not to BERT: comparing speech and language-based approaches for Alzheimer’s disease detection. arXiv preprint arXiv:2008.01551.
- The natural history of Alzheimer’s disease: description of study cohort and accuracy of diagnosis. Archives of neurology, 51(6):585–594.
- Speech analysis by natural language processing techniques: a possible tool for very early detection of cognitive decline? Frontiers in aging neuroscience, 10:369.
- Hugo Botha and Keith A Josephs. 2019. Primary progressive aphasias and apraxia of speech. Continuum: Lifelong Learning in Neurology, 25(1):101.
- Nikolas Coupland. 2007. Style: Language variation and identity. Cambridge University Press.
- BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805.
- Towards diagnostic conversational profiles of patients presenting with dementia or functional memory disorders to memory clinics. Patient Education and Counseling, 98(9):1071–1077.
- Fernanda Ferreira and Karl GD Bailey. 2004. Disfluencies and human language comprehension. Trends in cognitive sciences, 8(5):231–237.
- Katrina E Forbes-McKay and Annalena Venneri. 2005. Detecting subtle spontaneous language decline in early Alzheimer’s disease with a picture description task. Neurological sciences, 26:243–254.
- Linguistic features identify Alzheimer’s disease in narrative speech. Journal of Alzheimer’s Disease, 49(2):407–422.
- Making pre-trained language models better few-shot learners. arXiv preprint arXiv:2012.15723.
- Josep Garre-Olmo. 2018. Epidemiology of Alzheimer’s disease and other dementias. Revista de neurologia, 66(11):377–386.
- Syntactic and lexical context of pauses and hesitations in the discourse of Alzheimer patients and healthy elderly subjects. Clinical linguistics & phonetics, 25(3):198–209.
- Practice effects due to serial cognitive assessment: implications for preclinical Alzheimer’s disease randomized controlled trials. Alzheimer’s & Dementia: Diagnosis, Assessment & Disease Monitoring, 1(1):103–111.
- The Boston diagnostic aphasia examination. Philadelphia, PA: Lippincott, Williams & Wilkins.
- Automatic detection of incoherent speech for diagnosing schizophrenia. In Proceedings of the Fifth Workshop on Computational Linguistics and Clinical Psychology: From Keyboard to Clinic, pages 136–146.
- Detecting linguistic characteristics of Alzheimer’s dementia by interpreting neural models. arXiv preprint arXiv:1804.06440.
- Gitit Kavé and Ayelet Dassa. 2018. Severity of Alzheimer’s disease and language features in picture descriptions. Aphasiology, 32(1):27–40.
- Daniel Kempler and Mira Goral. 2008. Language and dementia: Neuropsychological aspects. Annual review of applied linguistics, 28:73–90.
- Alzheimer’s disease and language impairments: social intervention and medical treatment. Clinical interventions in aging, pages 1401–1408.
- W. J. Levelt. 1983. Monitoring and self-repair in speech. Cognition, 14(1):41–104.
- Pre-trained token-replaced detection model as few-shot learner. arXiv preprint arXiv:2203.03235.
- Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing. ACM Computing Surveys, 55(9):1–35.
- RoBERTa: A robustly optimized BERT pretraining approach. arXiv preprint arXiv:1907.11692.
- On the selection of non-invasive methods based on speech analysis oriented to automatic Alzheimer disease diagnosis. Sensors, 13(5):6730–6745.
- Alzheimer’s dementia recognition through spontaneous speech: The adress challenge. arXiv preprint arXiv:2004.06833.
- Detecting cognitive decline using speech only: The adresso challenge. arXiv preprint arXiv:2104.09356.
- Brian MacWhinney. 2017. Tools for analyzing talk part 1: The CHAT transcription format. Carnegie.[Google Scholar], 16.
- John C Morris. 1997. Clinical dementia rating: a reliable and valid diagnostic and staging measure for dementia of the Alzheimer type. International psychogeriatrics, 9(S1):173–176.
- Detecting Alzheimer’s Disease using Interactional and Acoustic features from Spontaneous Speech. Interspeech.
- Alzheimer’s dementia recognition from spontaneous speech using disfluency and interactional features. Frontiers in Computer Science, page 49.
- Advances in the early detection of Alzheimer’s disease. Nature medicine, 10(Suppl 7):S34–S41.
- Empty speech in Alzheimer’s disease and fluent aphasia. Journal of Speech, Language, and Hearing Research, 28(3):405–410.
- Predicting probable Alzheimer’s disease using linguistic deficits and biomarkers. BMC bioinformatics, 18(1):1–13.
- Using the outputs of different automatic speech recognition paradigms for acoustic-and bert-based Alzheimer’s dementia detection through spontaneous speech. In Interspeech, pages 3810–3814.
- The generalizability of longitudinal changes in speech before Alzheimer’s disease diagnosis. Journal of Alzheimer’s Disease, 92(2):547–564.
- What happens when nothing happens? an investigation of pauses as a compensatory mechanism in early Alzheimer’s disease. Neuropsychologia, 124:133–143.
- Charlene Pope and Boyd H Davis. 2011. Finding a balance: The carolinas conversation collection.
- Nils Reimers and Iryna Gurevych. 2019. Sentence-BERT: Sentence embeddings using siamese BERT-networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics.
- Morteza Rohanian and Julian Hough. 2021. Best of both worlds: Making high accuracy non-incremental transformer-based disfluency detection incremental. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 3693–3703.
- Alzheimer’s dementia recognition using acoustic, lexical, disfluency and speech pause features robust to noisy inputs. arXiv preprint arXiv:2106.15684.
- Timo Schick and Hinrich Schütze. 2020a. Exploiting cloze questions for few shot text classification and natural language inference. arXiv preprint arXiv:2001.07676.
- Timo Schick and Hinrich Schütze. 2020b. It’s not just size that matters: Small language models are also few-shot learners. arXiv preprint arXiv:2009.07118.
- Towards learning a universal non-semantic representation of speech. arXiv preprint arXiv:2002.12764.
- Naming ability in patients with mild to moderate Alzheimer’s disease: what changes occur with the evolution of the disease? Clinics, 70:423–428.
- Improving and simplifying pattern exploiting training. arXiv preprint arXiv:2103.11955.
- David F Tang-Wai and Naida L Graham. 2008. Assessment of language function in dementia-Alzheimer. Geriatrics, 11(2):103–110.
- Wilson L Taylor. 1953. “cloze procedure”: A new tool for measuring readability. Journalism quarterly, 30(4):415–433.
- A review of automated speech and language features for assessment of cognitive and thought disorders. IEEE journal of selected topics in signal processing, 14(2):282–298.
- Entailment as few-shot learner. arXiv preprint arXiv:2104.14690.
- Learning better masking for better language model pre-training. arXiv preprint arXiv:2208.10806.
- Correlating natural language processing and automated speech analysis with clinician assessment to quantify speech-language changes in mild cognitive impairment and Alzheimer’s dementia. Alzheimer’s research & therapy, 13(1):109.
- Disfluencies and fine-tuning pre-trained language models for detection of Alzheimer’s disease. In INTERSPEECH, volume 2020, pages 2162–6.
- Wavbert: Exploiting semantic and non-semantic speech using wav2vec and bert for dementia detection. In Interspeech, pages 3790–3794.
Collections
Sign up for free to add this paper to one or more collections.
