Abstract
Dementia with Lewy bodies (DLB) and Alzheimer's disease (AD), the two most common neurodegenerative dementias, both exhibit altered emotional processing. However, how vocal emotional expressions alter in and differ between DLB and AD remains uninvestigated. We collected voice data during story reading from 152 older adults comprising DLB, AD, and cognitively unimpaired (CU) groups and compared their emotional prosody in terms of valence and arousal dimensions. Compared with matched AD and CU participants, DLB patients showed reduced overall emotional expressiveness, as well as lower valence (more negative) and lower arousal (calmer), the extent of which was associated with cognitive impairment and insular atrophy. Classification models using vocal features discriminated DLB from AD and CU with an AUC of 0.83 and 0.78, respectively. Our findings may aid in discriminating DLB patients from AD and CU individuals, serving as a surrogate marker for clinical and neuropathological changes in DLB.
Highlights
DLB showed distinctive reduction in vocal expression of emotions.
Cognitive impairment was associated with reduced vocal emotional expression in DLB.
Insular atrophy was associated with reduced vocal emotional expression in DLB.
Emotional expression measures successfully differentiated DLB from AD or controls.
Keywords: affective prosody, arousal, digital health, emotional processing, Lewy body dementia, machine learning, valence
1. INTRODUCTION
Dementia with Lewy bodies (DLB) is the second most prevalent neurodegenerative dementia after Alzheimer's disease (AD), estimated to affect up to 22.8% of people with dementia. 1 DLB is characterized by four core clinical features including fluctuating cognition and parkinsonism. 2 Compared with AD, it progresses faster and has a wider range of symptoms, resulting in lower quality of life and shorter life expectancy for patients, as well as an increased burden on caregivers. 3 , 4 However, despite its importance, DLB is often misdiagnosed with other conditions such as AD. 5 A study reported that 78% of DLB patients received an initial diagnosis other than DLB, 4 leading to delays in receiving appropriate care that includes community services and pharmacologic therapy, with different needs from AD care. 4 One reason hindering proper diagnosis is the limited awareness and knowledge of DLB among primary care physicians, thus failing to make appropriate referrals to specialists. 4 , 5 , 6 Additionally, the limited availability of established biomarkers for DLB, 7 coupled with invasive and expensive standard biomarkers for AD, 8 further hinders proper identification. Therefore, a screening tool capable of suggesting the possibility of DLB, even in nonspecialist settings, would facilitate timely referrals to specialists and enable early differential diagnosis of DLB.
Alterations in emotional processing, particularly in recognition of emotions, have been reported for several types of dementia. 9 , 10 In particular, it is commonly found in patients with behavioral and semantic variants of frontotemporal dementia. 10 , 11 For AD patients, although it is less prominent, studies have reported their difficulty in recognizing emotional expressions across different types of emotions, where it was most pronounced in recognizing “fear” and the least for “surprised.” 12 For DLB, a few studies have suggested deficits in recognizing emotional expressions depending on the type of emotion, for example, diminished recognition of “surprised” faces 13 note that investigations into emotional processing alterations in DLB are still limited. 14 Moreover, studies on the neural correlates of impaired emotional recognition have also suggested disease‐specific patterns. 10 For example, in AD, deficits in emotion recognition were associated with brain regions such as the anterior cingulate, 15 , 16 while in DLB, they were associated with regions including the middle frontal gyrus. 13 In summary, previous studies suggest the existence of distinct profiles of emotional processing across different types of dementia, both in terms of perception and neural correlates. Therefore, although emotional processing alterations may not be a representative feature of DLB, they may serve as a surrogate marker for the differentiation of DLB from other types of dementia exemplified by AD.
Contrary to emotional recognition, emotional expression in dementia patients, which is also crucial for social interactions, 9 , 14 , 17 affecting individuals' mental health and quality of life, 9 remains largely uninvestigated. To the best of our knowledge, no study has explored alterations in emotional expressions in DLB or compared with those in AD. In AD, a few studies reported reduced expression of emotions, 18 , 19 and this reduction correlated with cognitive impairment across multiple domains, including memory and attention. 18 While no study exists for DLB, reports on emotional expression alterations in Parkinson's disease (PD), another form of the Lewy body spectrum disorder, are abundant. 9 Alterations in vocal and facial expressions of emotions in PD are likely attributed to parkinsonian motor impairments, specifically hypokinetic dysarthria and facial bradykinesia, 9 although several studies have also suggested associations with executive dysfunction and alterations in the affective process. 9 , 20 Taken together, emotional expression may be affected by multiple cognitive and motor functions. DLB patients exhibit a combination of multiple cognitive and parkinsonian motor impairments. Therefore, DLB patients may experience more pronounced alterations in emotional expression than AD patients.
Research in Context
Systematic Review: The authors reviewed the literature using medical and academic databases (e.g., PubMed, Google Scholar) and cited work. Alterations in vocal expression of emotions have been investigated for various neurological conditions including Alzheimer's disease (AD). However, its alterations in dementia with Lewy bodies (DLB), or differences between the two dementia types, remain uninvestigated.
Interpretation: Our results provide initial evidence of (a) DLB‐specific reduction in vocal expression of emotions during story reading and its associations with cognitive impairment and insular atrophy, and (b) the feasibility of machine‐learning models based on the characteristics of vocal expression of emotions to discriminate DLB from AD or controls as an easy‐to‐perform screening tool.
Future Directions: Our findings need cross‐cultural and cross‐linguistic validation with larger multicenter samples. Future studies may also address the applicability of our findings to emotional expression in everyday conversational speech.
Among the modalities of emotional expression, vocal expression, or emotional prosody, is particularly promising for applications in clinical practice, given readily available continuous scales in terms of high‐level emotional dimensions, 21 facilitating the capture of continuous changes in patients. In emotion theories, the commonly utilized two‐dimensional valence‐arousal model represents the negative‐to‐positive and calm‐to‐excited aspects of emotional expressions, respectively. 22 This model is increasingly in the assessment of patients with AD, depression, and other conditions, 23 , 24 owing to emerging digital technologies that enable automated measurement of valence and arousal scales, even in nonspecialist settings. 21 Therefore, by using the valence‐arousal model to analyze voice data obtained from older adults comprising DLB and AD patients as well as cognitively unimpaired (CU) controls, the present study aimed to examine the following hypothesis: DLB patients exhibit more pronounced alterations in emotional prosody across high‐level emotional dimensions, thereby making objective measurement useful for discriminating DLB from other conditions.
2. METHODS
2.1. Study participants and assessments
We recruited community‐dwelling older adults in Ibaraki, Japan, including outpatients from the Department of Psychiatry at the University of Tsukuba Hospital. All participants underwent cognitive and clinical assessments, as well as structural MRI to assess structural brain changes (Table 1 and Supplementary Method 1 for details). The patients met the standard research diagnostic criteria for prodromal/clinical AD 25 , 26 or DLB. 2 , 27 (Supplementary Method 2 for details). CU participants did not meet any of these criteria and were matched to the patients for age, sex, and years of education. Regarding the disease stage, patients in the AD and DLB groups ranged from mild cognitive impairment (MCI; hereafter MCI‐AD and MCI‐LB, respectively) to moderate dementia. 26 , 27 , 28 All participants were native Japanese speakers and had no serious hearing, vision, and speech impairments that would interfere with the voice data collection.
TABLE 1.
Participant demographics and cognitive/clinical measures
| CU (n = 49) | AD (n = 76) | DLB (n = 27) | p‐Value | |||||
|---|---|---|---|---|---|---|---|---|
| Disease stage, MCI | n/a | 42 | (55.3%) | 19 | (70.4%) | 0.253 | ||
| Age, yr | 72.4 | (4.1) | 74.2 | (6.0) | 75.1 | (5.0) | 0.075 | |
| Sex, female | 28 | (57.1%) | 33 | (43.4%) | 12 | (44.4%) | 0.299 | |
| Education, yr | 13.3 | (2.1) | 13.2 | (2.7) | 12.7 | (2.8) | 0.624 | |
| Antipsychotic medication d | 0 | (0.0%) | 3 | (3.9%) | 6 | (22.2%) | <0.001 | a,b |
| Mini‐Mental State Examination (MMSE) | 27.8 | (1.9) | 23.4 | (4.5) | 26.5 | (3.6) | <0.001 | a,c |
| Logical Memory–immediate recall | 11.2 | (3.1) | 4.5 | (3.4) | 7.9 | (3.9) | <0.001 | a,b,c |
| Logical Memory–delayed recall | 9.5 | (3.0) | 2.1 | (2.6) | 5.9 | (4.1) | <0.001 | a,b,c |
| Frontal Assessment Battery | 13.5 | (2.5) | 11.0 | (3.7) | 11.1 | (4.1) | <0.001 | b,c |
| Trail Making Test part A e | 35.8 | (11.3) | 58.4 | (47.2) | 68.5 | (54.0) | 0.001 | b,c |
| Trail Making Test part B f | 89.7 | (41.3) | 177.3 | (100.8) | 180.8 | (87.9) | <0.001 | b,c |
| Clock Drawing Test g | 6.8 | (0.8) | 5.9 | (1.9) | 6.6 | (1.1) | 0.007 | c |
| Clinical Dementia Rating g | 0.0 | (0.0) | 0.7 | (0.3) | 0.6 | (0.4) | <0.001 | b,c |
| Clinical Dementia Rating–Sum of Boxes g | 0.0 | (0.1) | 2.7 | (2.4) | 2.6 | (2.7) | <0.001 | b,c |
| Geriatric Depression Scale (GDS) e | 3.3 | (2.9) | 3.3 | (3.0) | 4.1 | (3.9) | 0.495 | |
| 5‐Item Unified Parkinson's Disease Rating Scale (UPDRS) | n/a | n/a | 2.1 | (2.1) | ||||
Notes: Values are displayed as mean (SD) and n (%) for continuous and binary measures, respectively. Bold values highlight statistically significant differences examined by one‐way analysis of variance for continuous measurements and by chi‐squared test for binary measurements.
Abbreviations: AD, Alzheimer's disease; CU, cognitively unimpaired; DLB, dementia with Lewy bodies; MCI, mild cognitive impairment.
Significant differences between individual diagnostic groups (Tukey–Kramer or chi‐squared test, p < 0.05) are marked with a, b, or c (a: significant for DLB vs. AD; b: significant for DLB vs. CU; c: significant for AD vs. CU).
Data missing for six participants.
Data missing for two participants.
Data missing for 10 participants.
Data missing for one participant.
The study was conducted with the approval of the Ethics Committee, University of Tsukuba Hospital (H29‐065), and it followed the ethical code for research with humans as stated in the Declaration of Helsinki. All participants provided written informed consent.
2.2. Voice data collection and analysis
The participants were instructed to read aloud part of the picture book “Hanasaka Jiisan,” a well‐known Japanese folktale. This story includes a multitude of positive and negative words expected to elicit emotional responses (Supplementary Method 3 for details). Participants sat in front of an iPad Air 2 tablet, and voice data were recorded using the tablet's internal microphone (44.1 kHz, 16 bits). The experiment was conducted in the same room for all participants.
To compare emotional prosody across the diagnostic groups, voice data were characterized by emotional dimensions of valence and arousal (Figure 1A). To predict valence/arousal values from audio data without the use of linguistic information, we used the transformer‐based speech emotion recognition model developed by Wagner et al. 21 (Supplementary Method 4 for details). The model was applied to voice segments with a 3‐second window and 1.5‐second stride, resulting in a series of valence and arousal values. We then used the mean values of valence and arousal, as well as emotional expressiveness (i.e., variability in the valence‐arousal space) as affective features. The variability in the valence‐arousal space was measured using Shannon entropy, where a higher entropy indicates a larger variation in vocal emotional states (Supplementary Method 5 for details). Additionally, to further investigate alternation in low‐level acoustic characteristics, we characterized the voice data using seven acoustic features shown to be a robust representation of vocal prosody across the most common languages and countries. These features comprise voice quality, loudness, pitch and formants, rhythm and tempo, shimmer, pitch variation, and mel‐frequency cepstral coefficient 3 29 (Supplementary Method 6 for details).
FIGURE 1.

Overview of affective feature extraction (A) and analysis results (B–D). (A) (i) Voice data were split into 3‐second segments with a 1.5‐second stride (1.5‐second overlap); (ii) valence and arousal values were obtained for each segment through a deep neural network model developed by Wagner et al.21; and (iii) a series of valence/arousal values were used to calculate vocal affective features. (B) Group differences in vocal affective features. Horizontal bars indicate significant differences (Tukey–Kramer test, ∗p < 0.05, ∗∗p < 0.01, ∗∗∗p < 0.001). Boxes indicate the 25th (Q1) and 75th (Q3) percentiles; whiskers indicate the upper and lower adjacent values that are most extreme within Q3+1.5(Q3‐Q1) and Q1‐1.5(Q3‐Q1), respectively; the line and notch in each box represent the median and its 95% confidence interval, respectively; the diamond represents the mean; and dots denote outliers. (C and D) Receiver operating characteristics (ROC) curves for DLB versus AD and DLB versus CU. Shades represent 95% confidence intervals. (E and F) Emotional expressiveness associated with MMSE and insular thickness in the DLB group. Lines and shades represent the fixed effect of MMSE or insular thickness and its 95% confidence intervals; and each data point corresponds to the utterance of one sentence by one participant. DLB, dementia with Lewy bodies; AD, Alzheimer's disease; CU, cognitively unimpaired; MMSE, Mini‐Mental State Examination
Next, to evaluate the feasibility of using voice data to differentiate DLB from AD and CU, we used supervised machine‐learning models for binary classification (Supplementary Method 7 and Supplementary Table 1 for details of the model algorithms and hyperparameters, respectively). The input variables for the model using vocal data were the aforementioned three affective and seven acoustic features (total 10 variables). The model performance was evaluated by the area under the receiver operating characteristic curve (AUC) obtained from 10 iterations of a leave‐two‐subjects‐out cross‐validation procedure. 30 We also compared performance against a baseline model using clinico‐demographic variables (i.e., Mini‐Mental State Examination [MMSE] score, age, sex, and years of education).
2.3. Statistical analysis
Group differences in affective and acoustic features were examined using one‐way analysis of covariance (ANCOVA) tests adjusted for age, sex, years of education, and the use of antipsychotic medication as covariates, with post hoc Tukey–Kramer pairwise comparisons. We also elaborated on the results in terms of the difference in the linguistic content of reading (e.g., emotional vs. neutral, conversational vs. ground). Then, we conducted exploratory analyses on clinical and neural correlates of alterations in these features observed in the DLB group, using linear mixed‐effect regression models with the same covariates (i.e., age, sex, years of education, and the use of antipsychotic medication). First, we examined associations between the affective features and clinical measures representing cognitive, motor, and mental aspects of the participants. For the clinical measures, we used MMSE 31 for the cognitive aspect, the five‐item Unified Parkinson's Disease Rating Scale (UPDRS) 32 for the motor aspect, and the Geriatric Depression Scale (GDS) 33 for the mental aspect. Second, we examined associations between the affective features and structural brain changes. To exclude brain regions irrelevant to structural changes in DLB, we only included the cortical and subcortical regions of interest (ROIs) showing statistical atrophy in the DLB group relative to CU. We carried out the mixed‐model analyses that modeled sentences as well as participants as random intercepts to address differences in linguistic and affective content per sentence. In all statistical analyses, the alpha value was set to 0.05, and Benjamini–Hochberg correction was applied for multiple testing.
3. RESULTS
We first investigated how vocal affective features differ across the DLB, AD, and CU groups. Consequently, compared with both AD and CU participants, DLB participants showed lower emotional expressiveness, even after correcting for multiple testing (one‐way ANCOVA, corrected p = 0.008; Figure 1B). In addition, the utterances of DLB participants were characterized by lower valence and arousal values, indicating more negative and calmer states (valence: corrected p = 0.008, arousal: corrected p < 0.001). These tendencies persisted when the DLB and AD groups were subdivided in accordance with disease stage (i.e., MCI or dementia), with dementia stage‐wise reductions in each patient group (Supplementary Figure 1). To further investigate the sex differences, we performed two‐way ANOVAs (diagnostic group × sex), showing that these affective features had significant interaction effects between diagnostic group and sex (p = 0.004 to 0.039), and the effect sizes across the diagnostic groups were larger in males (male: η 2 = 0.150 to 0.243, female: η 2 = 0.001 to 0.008). Regarding the low‐level acoustic features, the voice quality was lower in the DLB group than in the AD group, but this difference did not remain significant after correcting for multiple testing (uncorrected p = 0.012, corrected p = 0.083; see Supplementary Figure 2 for the full results). We compared phoneme rate as a measure indicating reading performance and found no statistical difference between the diagnostic groups (one‐way ANOVA, p = 0.257), suggesting that altered vocal expression of emotions could not be explained by the difference in reading performance.
To deepen our understanding of altered vocal expression of emotions in the DLB group, we further investigated the association of group differences in vocal affective features with the nature of linguistic content. Specifically, we investigated whether the following two factors were important to elicit emotional responses with discernable differences between the DLB and other groups: (i) positive and negative sentences and (ii) conversational sentences. When we compared the degree of group differences in affective features between conditions with and without positive/negative sentences, the results showed that the discriminative power of emotional expressiveness for differentiating DLB from AD or CU was reduced for utterances without positive/negative sentences (Δη 2: −0.049, ΔAUC for vs. AD: −0.017, ΔAUC for vs. CU: −0.053). Similarly, the discriminative power was reduced in ground sentences compared with conversational sentences (Δη 2: −0.012, ΔAUC for vs. AD: −0.094, ΔAUC for vs. CU: −0.008). Taken together, these results suggest that the reduction in vocal expressivity in the DLB group could be evident, particularly in emotion‐eliciting conversations such as those containing positive or negative words.
Next, we examined whether vocal affective/acoustic features could discriminate participants in the DLB group from those in the AD and CU groups. Through the cross‐validation procedure, the baseline models using clinico‐demographic variables (i.e., MMSE score, age, sex, and years of education) classified DLB and AD with an AUC of 0.75 (95% confidence interval [CI]: 0.75–0.76) and classified DLB and CU with an AUC of 0.65 (95% CI: 0.65–0.66). On the other hand, the models using vocal features could improve the AUC by +0.08 for DLB versus AD (AUC of 0.83; 95% CI: 0.83–0.83; Figure 1C) and +0.13 for DLB versus CU (AUC of 0.78; 95% CI: 0.77–0.78; Figure 1D). Furthermore, the performance was mostly preserved even for discriminating patients in the MCI stage: an AUC of 0.86 (95% CI: 0.86–0.87) for MCI‐LB versus MCI‐AD and 0.75 (95% CI: 0.75–0.75) for MCI‐LB versus CU.
The exploratory analyses to examine whether the vocal affective features could capture clinical and neuropathological changes in the DLB group revealed the following associations. For the clinical measures, the mixed‐model analysis showed significant positive associations of the MMSE score with emotional expressiveness (corrected p = 0.001; Figure 1E). No significant associations were found for the UPDRS or GDS scores (Supplementary Table 2 for the full results). The inclusion of the MMSE score increased the marginal R 2 by up to +0.16 from a model not including MMSE. For the neuropathological measures, the following ROIs exhibited significant atrophies in the DLB group compared with CU: fusiform, insula, and accumbens area (Supplementary Table 3 for details). Among them, only the insular thickness showed significant positive associations with emotional expressiveness (corrected p = 0.021; Figure 1F) and valence (corrected p = 0.013), while there were no significant associations for the other ROIs (Supplementary Table 4 for the full results). The inclusion of the insular thickness increased the marginal R 2 by up to +0.10. Although these associations should be considered exploratory due to the limited sample size, these results may suggest that alterations in vocal affective features could reflect certain aspects of the disease progression of DLB.
4. DISCUSSION
We investigated characteristics of vocal expression of emotions in story‐reading voices collected from older adults comprising DLB and AD patients as well as CU controls. As a result, three main findings emerged. First, the DLB group had different characteristics of vocal expression in comparison to AD and CU; specifically, the degree of emotional expressiveness based on high‐level emotional dimensions was statistically lower in the DLB group than in the other two groups. Second, in discriminating DLB from both AD and CU, machine learning‐based classification models using quantitative measures of emotional prosody outperformed baseline models using clinico‐demographic measures. Furthermore, exploratory mixed‐model analysis showed that reduced emotional expressiveness in the DLB group was associated with a lower cognitive score, as measured by MMSE, and with reduced insular thickness. These results suggest the potential of quantitative measures of emotional prosody as a digital marker for dementia, as well as its usefulness as a screening tool for DLB, a frequently overlooked form of dementia with common symptoms with AD. 4 , 5
Our statistical analysis found a DLB‐specific reduction in vocal expression of emotions. This alteration in the DLB group aligns with the clinical findings that DLB patients are frequently disrupted in vocal/facial expressivity. 9 , 34 Our results elaborated on the finding with quantitative measures by showing multifaceted changes in the characteristics of vocal emotional expression in terms of both valence (positive to negative) and arousal (excited to calm) scales and their overall variability. In addition, with respect to speech during neuropsychological tasks, DLB patients' utterances have been reported to show distinct alterations compared with AD in terms of both linguistic and acoustic aspects. 35 Our results extended the findings by showing that DLB patients also exhibited specific alterations in emotional prosody with respect to speech during non‐neuropsychological tasks, which would involve voices in a context closer to everyday social interactions. On the other hand, the AD group exhibited preserved emotional expressiveness in our analysis. This result, contradictory to several previous studies reporting a reduction in vocal expressivity in AD, 18 , 19 might be explained by differences in the task for collecting voices. For example, emotional expressiveness in directed production or imitation of emotional prosody was impaired in AD, 19 , 36 , 37 while it was preserved in spontaneous speech. 19 , 37 , 38 Also, Han and colleagues found that emotional expressiveness in an interview speech for recent events was reduced in AD, while it was relatively preserved for events in their childhood. 18 Given these mixed results regarding AD, future research would further investigate whether the DLB‐specific alteration in emotional expressiveness found in this study occurs consistently across different types of speech, thereby addressing the possibility of DLB screening using everyday speech, as well as the impact of reduced emotional expressivity on everyday social interactions.
In the present study, a classification model based on the characteristics of emotional prosody during an approximately 2‐minute story reading could discriminate DLB from AD with reasonable performance (AUC of 0.83), outperforming the baseline model using clinico‐demographic measures in our dataset. This performance is competitive with another speech analysis model using five speech‐based neuropsychological tasks (AUC of 0.833) 35 and even with fluid biomarkers (AUC of 0.723–0.843). 39 Thus, our findings have the potential to aid DLB screening in clinical practice by providing a less time‐consuming, less invasive tool. In addition to its use in clinical practice, speech analysis is also of interest as a means of automated screening and longitudinal monitoring in large‐scale cohort studies and clinical trials, 40 which would benefit from our findings. For example, the AD Neuroimaging Initiative study uses speech analysis on story recall tasks for the initial screening of likely AD, MCI, or CU individuals from a large participant pool (N∼20000). 41 , 42 Adding a short story‐reading task may help conduct similar large‐scale studies for DLB or enable earlier exclusion of likely DLB cases from AD studies. Furthermore, our results showed that emotional expressiveness from conversational sentences better performed in discriminating DLB than using ground sentences, suggesting the promising nature of our approach to be applied to everyday conversations beyond controlled task settings.
This study showed that the reduction of emotional expressiveness in DLB was associated with the measure of cognitive impairment as well as with insular atrophy. The insula is typically affected in DLB 43 , 44 , 45 and has been associated with deficits in emotion recognition in DLB. 13 , 44 Our results extend these prior findings, suggesting that the insula can be a key component of the affective process in DLB, related to both recognition and expression aspects of emotional processing. Furthermore, our results, which revealed a DLB‐specific alteration compared with AD, suggest that the reduction in emotional expressiveness in DLB may arise through a different mechanism than in AD. Also, this alteration in DLB was not associated with motor impairment, suggesting that the reduction in emotional expressiveness in DLB may be more attributable to the affective process than to parkinsonism, as indicated by the work of Möbes et al. on PD patients without dysarthria. 20 Regarding the mechanism, the process of vocal expression of emotions has been explained in terms of affective and sensorimotor components, 46 where the former refers to access to abstract representations of emotional prosody and the latter to motor planning and implementation. According to a functional neuroimaging study, the basal ganglia were activated in both affective and sensorimotor components, while the insula was only involved in the former, and the hippocampus in the latter. 46 These cortical and subcortical regions involve those with typically observed neuropathological changes in DLB, AD, and PD, that is, insula in DLB, 43 , 44 , 45 hippocampus in AD, 47 and basal ganglia in PD. 48 Quantitative measures of multifaceted characteristics of emotional expression, therefore, may provide promising surrogate markers for disease‐specific patterns of neuropathological changes.
This study has several limitations. First, the small sample size resulted in the patient groups comprising both MCI and dementia patients. Although the majority of findings were preserved in the analysis restricting patients to MCI, the validity of our findings, particularly in the prodromal stage, needs to be confirmed with a larger sample. Second, our findings were derived from a single local community and the Japanese language. Hence, as culture and language affect emotional prosody, 17 , 49 , 50 cross‐cultural and cross‐linguistic validation is warranted. Third, the dataset was imbalanced in terms of diagnostic groups, which might also affect the generalizability of our findings. Finally, the diagnoses in our dataset were primarily based on clinical features, and thus the mixed DLB/AD pathology could not be evaluated, requiring further research with validated neuropathological biomarkers.
In conclusion, this study is the first to show a DLB‐specific alteration in the characteristics of vocal expression of emotions and its clinical and neural correlates. Our analyses revealed that (i) emotional expressiveness during story reading was specifically reduced in DLB, while this reduction was not observed in AD; (ii) models using these vocal affective features could discriminate DLB from AD or controls, with comparable or superior performance to neuropsychological testing; and (iii) the reduction in emotional expressiveness in DLB was associated with cognitive impairment and insular atrophy. These results suggest that emotion‐eliciting utterances can be useful not only for screening for DLB but also as a surrogate marker for disease progress and neuropathological changes in DLB.
CONFLICT OF INTEREST STATEMENT
M.K., Y.Y., and K.S. are employed by IBM Corporation. M.N. received funding from the Japan Society for the Promotion of Science, KAKENHI [grant number 19H01084]. M.O. has nothing to disclose. K.N. received funding from the Japan Society for the Promotion of Science, KAKENHI [grant numbers 19H01084 and 21K12153]. K.N. reports payment for lectures from Eli Lilly and Otsuka. T.A. received funding from the Japan Society for the Promotion of Science, KAKENHI [grant number 19H01084]. T.A. reports payment for lectures from Eisai and Sumitomo Pharma. Author disclosures are available in the supporting information.
CONSENT STATEMENT
The study was conducted with the approval of the Ethics Committee, University of Tsukuba Hospital (H29‐065), and it followed the ethical code for research with humans as stated in the Declaration of Helsinki. All participants provided written informed consent.
Supporting information
Supporting Information
Supporting Information
ACKNOWLEDGMENTS
This work was supported by the Japan Society for the Promotion of Science, KAKENHI [grant numbers 19H01084 and 21K12153]. The funders did not play any active role in the scientific investigation and reporting of the study.
Kobayashi M, Yamada Y, Shinkawa K, et al. Vocal expression of emotions discriminates dementia with Lewy bodies from Alzheimer's disease. Alzheimer's Dement. 2024;16:e12594. 10.1002/dad2.12594
Masatomo Kobayashi and Yasunori Yamada contributed equally to this work.
REFERENCES
- 1. Jones SAV, O'Brien JT. The prevalence and incidence of dementia with Lewy bodies: a systematic review of population and clinical studies. Psychol Med. 2014;44(4):673‐683. doi: 10.1017/S0033291713000494 [DOI] [PubMed] [Google Scholar]
- 2. McKeith IG, Boeve BF, Dickson DW, et al. Diagnosis and management of dementia with Lewy bodies: fourth consensus report of the DLB consortium. Neurology. 2017;89(1):88‐100. doi: 10.1212/WNL.0000000000004058 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Mueller C, Ballard C, Corbett A, Aarsland D. The prognosis of dementia with Lewy bodies. Lancet Neurol. 2017;16(5):390‐398. doi: 10.1016/S1474-4422(17)30074-1 [DOI] [PubMed] [Google Scholar]
- 4. Zweig YR, Galvin JE. Lewy body dementia: the impact on patients and caregivers. Alz Res Therapy. 2014;6(2):21. doi: 10.1186/alzrt251 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Walker Z, Possin KL, Boeve BF, Aarsland D. Lewy body dementias. Lancet. 2015;386(10004):1683‐1697. doi: 10.1016/S0140-6736(15)00462-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Galvin JE, Duda JE, Kaufer DI, Lippa CF, Taylor A, Zarit SH. Lewy body dementia: the caregiver experience of clinical care. Parkinsonism Relat Disord. 2010;16(6):388‐392. doi: 10.1016/j.parkreldis.2010.03.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. O'Shea DM, Arkhipenko A, Galasko D, et al. Practical use of DAT SPECT imaging in diagnosing dementia with Lewy bodies: a US perspective of current guidelines and future directions. Front Neurol. 2024;15:1395413. doi: 10.3389/fneur.2024.1395413 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Jack CR, Bennett DA, Blennow K, et al. A/T/N: an unbiased descriptive classification scheme for Alzheimer disease biomarkers. Neurology. 2016;87(5):539‐547. doi: 10.1212/WNL.0000000000002923 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Bono AD, Twaite JT, Krch D, et al. Mood and emotional disorders associated with parkinsonism, Huntington disease, and other movement disorders. Handb Clin Neurol. 2021;183:175‐196. doi: 10.1016/B978-0-12-822290-4.00015-3 [DOI] [PubMed] [Google Scholar]
- 10. Kumfor F, Piguet O. Emotion recognition in the dementias: brain correlates and patient implications. Neurodegener Dis Manag. 2013;3:277‐288. doi: 10.2217/nmt.13.16 [DOI] [Google Scholar]
- 11. Weder ND, Aziz R, Wilkins K, Tampi RR. Frontotemporal dementias: a review. Ann Gen Psychiatry. 2007;6:15. doi: 10.1186/1744-859X-6-15 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Klein‐Koerkamp Y, Beaudoin M, Baciu M, Hot P. Emotional decoding abilities in Alzheimer's disease: a meta‐analysis. J Alzheimers Dis. 2012;32:109‐125. doi: 10.3233/JAD-2012-120553 [DOI] [PubMed] [Google Scholar]
- 13. Heitz C, Noblet V, Phillipps C, et al. Cognitive and affective theory of mind in dementia with Lewy bodies and Alzheimer's disease. Alz Res Therapy. 2016;8(1):10. doi: 10.1186/s13195-016-0179-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Coulombe V, Joyal M, Martel‐Sauvageau V, Monetta L. Affective prosody disorders in adults with neurological conditions: a scoping review. Int J Lang Commun Disord. 2023;58(6):1939‐1954. doi: 10.1111/1460-6984.12909 [DOI] [PubMed] [Google Scholar]
- 15. Kumfor F, Sapey‐Triomphe LA, Leyton CE, Burrell JR, Hodges JR, Piguet O. Degradation of emotion processing ability in corticobasal syndrome and Alzheimer's disease. Brain. 2014;137(11):3061‐3072. doi: 10.1093/brain/awu246 [DOI] [PubMed] [Google Scholar]
- 16. Amlerova J, Laczó J, Nedelska Z, et al. Emotional prosody recognition is impaired in Alzheimer's disease. Alz Res Therapy. 2022;14(1):50. doi: 10.1186/s13195-022-00989-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Cowen AS, Laukka P, Elfenbein HA, Liu R, Keltner D. The primacy of categories in the recognition of 12 emotions in speech prosody across two cultures. Nat Hum Behav. 2019;3(4):369‐382. doi: 10.1038/s41562-019-0533-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Han KH, Zaytseva Y, Bao Y, et al. Impairment of vocal expression of negative emotions in patients with Alzheimer's disease. Front Aging Neurosci. 2014;6:101. doi: 10.3389/fnagi.2014.00101 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Misiewicz S, Brickman AM, Tosto G. Prosodic impairment in dementia: review of the literature. Curr Alzheimer Res. 2018;15(2):157‐163. doi: 10.2174/1567205014666171030115624 [DOI] [PubMed] [Google Scholar]
- 20. Möbes J, Joppich G, Stiebritz F, Dengler R, Schröder C. Emotional speech in Parkinson's disease. Mov Disord. 2008;23(6):824‐829. doi: 10.1002/mds.21940 [DOI] [PubMed] [Google Scholar]
- 21. Wagner J, Triantafyllopoulos A, Wierstorf H, et al. Dawn of the transformer era in speech emotion recognition: closing the valence gap. IEEE Trans Pattern Anal Mach Intell. 2023;45(9):10745‐10759. doi: 10.1109/TPAMI.2023.3263585 [DOI] [PubMed] [Google Scholar]
- 22. Bestelmeyer PEG, Kotz SA, Belin P. Effects of emotional valence and arousal on the voice perception network. Soc Cogn Affect Neurosci. 2017;12(8):1351‐1358. doi: 10.1093/scan/nsx059 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. Pérez‐Toro PA, Rodríguez‐Salas D, Arias‐Vergara T, et al. Interpreting acoustic features for the assessment of Alzheimer's disease using ForestNet. Smart Health. 2022;26:100347. doi: 10.1016/j.smhl.2022.100347 [DOI] [Google Scholar]
- 24. Othmani A, Kadoch D, Bentounes K, Rejaibi E, Alfred R, Hadid A. Towards robust deep neural networks for affect and depression recognition from speech. Pattern Recognition. ICPR International Workshops and Challenges. Springer International Publishing; 2021:5‐19. doi: 10.1007/978-3-030-68790-8_1 Lecture Notes in Computer Science [DOI] [Google Scholar]
- 25. McKhann GM, Knopman DS, Chertkow H, et al. The diagnosis of dementia due to Alzheimer's disease: recommendations from the National Institute on Aging‐Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement. 2011;7(3):263‐269. doi: 10.1016/j.jalz.2011.03.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Albert MS, DeKosky ST, Dickson D, et al. The diagnosis of mild cognitive impairment due to Alzheimer's disease: recommendations from the National Institute on Aging‐Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement. 2011;7(3):270‐279. doi: 10.1016/j.jalz.2011.03.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. McKeith IG, Ferman TJ, Thomas AJ, et al. Research criteria for the diagnosis of prodromal dementia with Lewy bodies. Neurology. 2020;94(17):743‐755. doi: 10.1212/WNL.0000000000009323 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Morris JC. The Clinical Dementia Rating (CDR): current version and scoring rules. Neurology. 1993;43(11):2412.2‐2412‐a. doi: 10.1212/WNL.43.11.2412-a [DOI] [PubMed] [Google Scholar]
- 29. van Rijn P, Larrouy‐Maestri P. Modelling individual and cross‐cultural variation in the mapping of emotions to speech prosody. Nat Hum Behav. 2023;7(3):386‐396. doi: 10.1038/s41562-022-01505-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Saeb S, Lonini L, Jayaraman A, Mohr DC, Kording KP. The need to approximate the use‐case in clinical machine learning. Gigascience. 2017;6(5):1‐9. doi: 10.1093/gigascience/gix019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Folstein MF, Folstein SE, McHugh PR. “Mini‐mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12(3):189‐198. doi: 10.1016/0022-3956(75)90026-6 [DOI] [PubMed] [Google Scholar]
- 32. Thomas AJ, Taylor JP, McKeith I, et al. Revision of assessment toolkits for improving the diagnosis of Lewy body dementia: the DIAMOND Lewy study. Int J Geriatr Psychiatry. 2018;33(10):1293‐1304. doi: 10.1002/gps.4948 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Montorio I, Izal M. The geriatric depression scale: a review of its development and utility. Int Psychogeriatr. 1996;8(1):103‐112. doi: 10.1017/S1041610296002505 [DOI] [PubMed] [Google Scholar]
- 34. Donaghy PC, Barnett N, Olsen K, et al. Symptoms associated with Lewy body disease in mild cognitive impairment. Int J Geriat Psychiatry. 2017;32(11):1163‐1171. doi: 10.1002/gps.4742 [DOI] [PubMed] [Google Scholar]
- 35. Yamada Y, Shinkawa K, Nemoto M, Ota M, Nemoto K, Arai T. Speech and language characteristics differentiate Alzheimer's disease and dementia with Lewy bodies. Alzheimers Dement (Amst). 2022;14(1):e12364. doi: 10.1002/dad2.12364 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Roberts VJ, Ingram SM, Lamar M, Green RC. Prosody impairment and associated affective and behavioral disturbances in Alzheimer's disease. Neurology. 1996;47(6):1482‐1488. doi: 10.1212/WNL.47.6.1482 [DOI] [PubMed] [Google Scholar]
- 37. Testa JA, Beatty WW, Gleason AC, Orbelo DM, Ross ED. Impaired affective prosody in AD: relationship to aphasic deficits and emotional behaviors. Neurology. 2001;57(8):1474‐1481. doi: 10.1212/wnl.57.8.1474 [DOI] [PubMed] [Google Scholar]
- 38. Ross ED, Thompson RD, Yenkosky J. Lateralization of affective prosody in brain and the callosal integration of hemispheric language functions. Brain Lang. 1997;56(1):27‐54. doi: 10.1006/brln.1997.1731 [DOI] [PubMed] [Google Scholar]
- 39. Chaudhry A, Houlden H, Rizig M. Novel fluid biomarkers to differentiate frontotemporal dementia and dementia with Lewy bodies from Alzheimer's disease: a systematic review. J Neurol Sci. 2020;415:116886. doi: 10.1016/j.jns.2020.116886 [DOI] [PubMed] [Google Scholar]
- 40. Masanneck L, Gieseler P, Gordon WJ, Meuth SG, Stern AD. Evidence from ClinicalTrials.gov on the growth of digital health technologies in neurology trials. npj Digit Med. 2023;6(1):1‐5. doi: 10.1038/s41746-023-00767-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41. Weiner MW, Veitch DP, Miller MJ, et al. Increasing participant diversity in AD research: plans for digital screening, blood testing, and a community‐engaged approach in the Alzheimer's Disease Neuroimaging Initiative 4. Alzheimers Dement. 2023;19(1):307‐317. doi: 10.1002/alz.12797 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Skirrow C, Meszaros M, Meepegama U, et al. Validation of a remote and fully automated story recall task to assess for early cognitive impairment in older adults: longitudinal case‐control observational study. JMIR Aging. 2022;5(3):e37090. doi: 10.2196/37090 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43. Blanc F, Colloby SJ, Cretin B, et al. Grey matter atrophy in prodromal stage of dementia with Lewy bodies and Alzheimer's disease. Alz Res Therapy. 2016;8(1):31. doi: 10.1186/s13195-016-0198-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44. Fathy YY, Hoogers SE, Berendse HW, et al. Differential insular cortex sub‐regional atrophy in neurodegenerative diseases: a systematic review and meta‐analysis. Brain Imaging Behav. 2020;14(6):2799‐2816. doi: 10.1007/s11682-019-00099-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45. Fathy YY, Jonkman LE, Bol JJ, et al. Axonal degeneration in the anterior insular cortex is associated with Alzheimer's co‐pathology in Parkinson's disease and dementia with Lewy bodies. Transl Neurodegener. 2022;11(1):52. doi: 10.1186/s40035-022-00325-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46. Pichon S, Kell CA. Affective and sensorimotor components of emotional prosody generation. J Neurosci. 2013;33(4):1640‐1650. doi: 10.1523/JNEUROSCI.3530-12.2013 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47. Gosche KM, Mortimer JA, Smith CD, Markesbery WR, Snowdon DA. Hippocampal volume as an index of Alzheimer neuropathology: findings from the Nun Study. Neurology. 2002;58(10):1476‐1482. doi: 10.1212/wnl.58.10.1476 [DOI] [PubMed] [Google Scholar]
- 48. Blandini F, Nappi G, Tassorelli C, Martignoni E. Functional changes of the basal ganglia circuitry in Parkinson's disease. Prog Neurobiol. 2000;62(1):63‐88. doi: 10.1016/S0301-0082(99)00067-2 [DOI] [PubMed] [Google Scholar]
- 49. Pell MD, Paulmann S, Dara C, Alasseri A, Kotz SA. Factors in the recognition of vocally expressed emotions: a comparison of four languages. J Phon. 2009;37(4):417‐435. doi: 10.1016/j.wocn.2009.07.005 [DOI] [Google Scholar]
- 50. Feraru SM, Schuller D, Schuller B, Cross‐language acoustic emotion recognition: an overview and some tendencies. In: 2015 International Conference on Affective Computing and Intelligent Interaction (ACII); 2015:125‐131. doi: 10.1109/ACII.2015.7344561 [DOI]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Supporting Information
Supporting Information
