Predicting dementia from spontaneous speech using large language models

被引:72
作者
Agbavor, Felix [1 ]
Liang, Hualou [1 ]
机构
[1] Drexel Univ, Sch Biomed Engn Sci & Hlth Syst, Philadelphia, PA 19104 USA
来源
PLOS DIGITAL HEALTH | 2022年 / 1卷 / 12期
关键词
ALZHEIMERS-DISEASE;
D O I
10.1371/journal.pdig.0000168
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
Language impairment is an important biomarker of neurodegenerative disorders such as Alzheimer's disease (AD). Artificial intelligence (AI), particularly natural language processing (NLP), has recently been increasingly used for early prediction of AD through speech. Yet, relatively few studies exist on using large language models, especially GPT-3, to aid in the early diagnosis of dementia. In this work, we show for the first time that GPT-3 can be utilized to predict dementia from spontaneous speech. Specifically, we leverage the vast semantic knowledge encoded in the GPT-3 model to generate text embedding, a vector representation of the transcribed text from speech, that captures the semantic meaning of the input. We demonstrate that the text embedding can be reliably used to (1) distinguish individuals with AD from healthy controls, and (2) infer the subject's cognitive testing score, both solely based on speech data. We further show that text embedding considerably outperforms the conventional acoustic feature-based approach and even performs competitively with prevailing fine-tuned models. Together, our results suggest that GPT-3 based text embedding is a viable approach for AD assessment directly from speech and has the potential to improve early diagnosis of dementia.
引用
收藏
页数:14
相关论文
共 41 条
[1]   Automated detection of mild cognitive impairment and dementia from voice recordings: A natural language processing approach [J].
Amini, Samad ;
Hao, Boran ;
Zhang, Lifu ;
Song, Mengting ;
Gupta, Aman ;
Karjadi, Cody ;
Kolachalama, Vijaya B. ;
Au, Rhoda ;
Paschalidis, Ioannis Ch .
ALZHEIMERS & DEMENTIA, 2023, 19 (03) :946-955
[2]   2021 Alzheimer's disease facts and figures [J].
不详 .
ALZHEIMERS & DEMENTIA, 2021, 17 (03) :327-406
[3]  
Aytar Y, 2016, ADV NEUR IN, V29
[4]  
Baevski A., 2020, Proc. Advances in neural information processing systems, V33, P12449
[5]  
Balagopalan A, 2021, Arxiv, DOI arXiv:2106.01555
[6]  
Balagopalan A, 2020, Arxiv, DOI arXiv:2008.01551
[7]   THE NATURAL-HISTORY OF ALZHEIMERS-DISEASE - DESCRIPTION OF STUDY COHORT AND ACCURACY OF DIAGNOSIS [J].
BECKER, JT ;
BOLLER, F ;
LOPEZ, OL ;
SAXTON, J ;
MCGONIGLE, KL ;
MOOSSY, J ;
HANIN, I ;
WOLFSON, SK ;
DETRE, K ;
HOLLAND, A ;
GUR, D ;
LATCHAW, R ;
BRENNER, R .
ARCHIVES OF NEUROLOGY, 1994, 51 (06) :585-594
[8]  
Brown TB, 2020, ADV NEUR IN, V33
[9]  
Devlin J, 2019, Arxiv, DOI [arXiv:1810.04805, 10.48550/arXiv.1810.04805]
[10]  
Peters ME, 2018, Arxiv, DOI [arXiv:1802.05365, DOI 10.48550/ARXIV.1802.05365, DOI 10.18653/V1/N18-1202, 10.48550/arXiv.1802.05365]