Highlights
-
•
The facial movements under emotional stimuli were recorded using webcam.
-
•
Women with MDD showed the attenuated mouth movements compared to HC.
-
•
In MDD, the mouth movement score was associated with depressive symptom.
-
•
Mouth movement score was also associated with fMRI connectivity between NAc and pIns.
-
•
It can be a promising marker for assessing depressive symptoms and brain circuitry.
Keywords: Major depressive disorder, Facial movement, MRI, Functional connectivity, Nucleus accumbens, Insula
Abstract
It is assumed that mood can be inferred from one’s facial expression. While this association may prove to be an objective marker for mood disorders, few studies have explicitly evaluated this linkage.
The facial movement responses of women with major depressive disorder (n = 66) and healthy controls (n = 46) under emotional stimuli were recorded using webcam. To boost facial movements, the naturalistic audio-visual stimuli were presented. To assess consistent global patterns across facial movements, scores for facial action units were extracted and projected onto principal component using principal component analysis. The associations of component for facial movements with functional brain circuitry was also investigated.
Clusters of mouth movements, such as lip press and stretch, identified by principal component analysis, were attenuated in depressive patients compared to those in healthy controls. This component of facial movements was associated with depressive symptoms, and the strengths of resting brain functional connectivity between nucleus accumbens and both posterior insular cortex and thalamus.
The evaluation of facial movements may prove to be a promising quantitative marker for assessing depressive symptoms and their underlying brain circuitry.
1. Introduction
The core features of major depressive disorder (MDD) are depressed mood and loss of interest or pleasure (American Psychiatric Association, 2015). Deficits in neural systems involving attention, affective, and motivational processes may be linked to abnormalities in emotional regulation in MDD (Park et al., 2019), which, in turn, can cause impaired interpersonal functioning and social anhedonia (Kupferberg et al., 2016, Surguladze et al., 2005).
Such alterations in behavior may be reflected in facial expressions or movements, which can confer affective state and motivation. In fact, expressions can be evoked unconsciously in response to emotion-eliciting stimuli, such as seeing another’s emotional face (Dimberg et al., 2000, Ellingsen et al., 2022, Ellingsen et al., 2020). In rodents, facial movements (i.e., orofacial reactions) are elicited in response to stimuli with hedonic or aversive valence (Berridge, 2000, Dolensek et al., 2020). Furthermore, animal studies have demonstrated that activity in the insula, thalamus, and basal ganglia, particularly nucleus accumbens (NAc), might mediate facial movements via modulation of monoaminergic neurotransmitters, including acetylcholine, dopamine, and serotonin (Carvalho et al., 2003, Castro et al., 2016, Dolensek et al., 2020, Grill and Norgren, 1978, Salamone et al., 1986).
Human studies have shown that dysfunctions in emotional regulation might affect facial movement. For instance, patients with bipolar disorder exhibit stronger facial responses to neutral stimuli and less facial responses to negative emotional valence (Broch-Due et al., 2018). Patients with unipolar depression showed reduced facial movement for a facial expression imitation task (Trémeau et al., 2005). On the other hand, irregular facial movements can be induced without explicit emotional experiences. In some neurological conditions, such as Tourette syndrome or tardive dyskinesia, involuntary facial movements occur, independent of emotional stimuli, and are associated with aberrant neurotransmission and disrupted brain network topology (Klawans and Rubovits, 1974, Shulman et al., 1995, Worbe et al., 2015). Taken together, these findings suggest that facial movement could be used as behavioral biomarkers reflecting alterations in the monoaminergic system and dysfunction of brain circuitry.
Although facial movement patterns can be an intuitive and efficient tool for assessing symptoms in MDD, its underlying neurophysiological mechanisms have rarely been studied. Here, we investigated the abnormalities of facial movement in MDD based on prominent facial movement features extracted by principal component analysis (PCA) from facial action units, which were identified from facial video recordings of patients with MDD and of healthy controls (HC). Furthermore, we collected fMRI data during rest to assess functional brain connectivity which may underlie any alterations in stimulus-evoked facial movements in MDD.
2. Materials and methods
2.1. Participants
At baseline, 81 women satisfying the DSM-IV criteria for unipolar MDD, and 52 healthy women were enrolled via local bulletin boards and online advertisements (See Table 1 for demographic and clinical characteristics of participants). All participants were between 19 and 65 years old and had not used any psychotropic medications or herbal preparations with psychoactive properties within 4 weeks. Inclusion criteria for the MDD group were a current diagnosis of MDD, a minimum total score of 14 on the 17-item Hamilton Depression Rating Scale (HDRS). In the HC group, inclusion required a maximum total score of 7 on the 17-item HDRS. Exclusion criteria were attempted suicide in the past year or current suicide risk; lifetime diagnoses of bipolar disorder, schizophrenia, schizoaffective or other psychotic disorder, history of alcohol or other substance abuse, pregnancy, breastfeeding, clinically significant liver disease, evidence of untreated or unstable thyroid disorder, brains with structural abnormalities, clinically significant abnormal findings on physical examinations, routine laboratory tests, and electrocardiography. All participants completed the 21-item Beck’s Depression Inventory (BDI).
Table 1.
Demographic and clinical characteristics of participants.
| Women with MDD (Mean ± SD) |
Healthy women (Mean ± SD) |
p-value | |
|---|---|---|---|
| Age (years) | 29.8 ± 10.9 | 24.1 ± 5.3 | 0.04* |
| Education (years) | 13.4 ± 2.3 | 13.8 ± 2.1 | 0.30 |
| Hamilton depression rating scale | 18.5 ± 2.8 | 4.0 ± 1.6 | <0.001*** |
| Beck depression inventory score | 28.7 ± 7.8 | 3.5 ± 3.6 | <0.001*** |
| Age at onset (years) | 25.6 ± 12.0 | – | – |
* p < 0.05, *** p < 0.01 at Mann–Whitney U-tests.
All participants provided written informed consent in the study protocol. This study was approved by the Institutional Review Board of the Korea Institute of Oriental Medicine (I–1711/001–001–01), Daejeon Korean Medicine Hospital of Daejeon (DJDSKH–16–BM–17), and the Korea National Institute for Bioethics Policy (P01–201609–11–002), and conducted from October 2017 to May 2019. This study was registered in the Clinical Research Information Service, established by the Korea Centers for Disease Control and Prevention and embodied as a part of the Primary Registries in the World Health Organization International Clinical Trials Registry Platform (KCT0002532 and KCT0002747, https://cris.nih.go.kr).
2.2. Assessment of facial expression movements
For all participants, facial expression movements were recorded at 30 Hz using a webcam while watching the emotional stimuli. They were seated 50 cm in front of the laptop computer screen. The display size was 34.0 × 20.3 cm2, representing visual angles of 37.6° horizontally and 22.6° vertically. To boost facial movement changes, the naturalistic audio-visual stimuli were presented via a laptop computer screen and headphone. Stimuli were presented in a block design, which consisted of 30-s blocks of emotional stimuli followed by a 10-s fixation cross. Each 30-s block contained 2–3 clips obtained from comedy shows, newscasts, and YouTube. Two blocks of stimuli were included for each category of emotional or hedonic valence (i.e., joyful, sad, appetite-inducing, anxiety-inducing, and neutral; see Supplementary Figure S1). The five emotional contexts (30-s stimuli) were repeated twice in pseudo-randomized sequences. To avoid the carry-over effect, the first joyful block was presented before the blocks with a negative valence. Participants were left alone in facial expression recording, and asked to feel emotions freely on watching the clips. After watching clips, participants rated how much they feel joyful, sad, disgusted, fearful/anxious on a ten-point scale from zero to nine. Participants reported their rating watching the screenshot of each clip using E-Prime 3.0 software (Psychology Software Tools, PA, USA).
The iMotions 7.0 software (iMotions Inc., MA, USA) automatically extracted facial features from facial videos recorded during the task above. This software estimated probabilistic scores of 17 distinct facial action units based on the Facial Action Coding System (EKMAN and ROSENBERG, 1997). Scores for these 17 facial action units (Supplementary Table S1) were responded to emotional stimuli at sparse time-points (Supplementary Table S5), which enhanced variations of the action units within participant. Averaged coefficient of variations (ACV) of 17 action units to the stimuli within participants was 5.34, which was much higher than ACV of mean 17 action units between participants (MDD: 1.67; HC: 0.522). Based on these stimulus-associated variations of the action units, global patterns of facial expression in response to emotional stimuli were assessed using PCA (Joliffe, 1986). Because latency and frequency of the facial expression to emotional stimuli were varied between participants, PCA was performed using scores of 17 action units for whole time-points of the stimulus paradigms without temporal information. Two-dimensional matrix (observations scores of 17 action units) was decomposed by PCA using alternating least squares algorithm (MATLAB; The MathWorks Inc., Natick, USA). The scores for the 17 action units for every time-points were projected onto principal component (PC), which generated a time-series of PC scores from both MDD and HC participants. Among the 17 PCs, we used the first 3 PCs in further analysis, which explained 48.64% of all variability (PC1: 19.63%, PC2: 17.30%, PC3: 11.61%). The action unit for “inner brow raise” was not reliable and excluded from the PCA because of high baseline scores observed in 30.6% of the participants, without actual facial movements in the inner brow region, as determined from the facial recordings. Finally, a square root transform was performed on the averaged PC scores of facial movements, in order to reduce the skewness of the data distribution.
We carefully checked the facial movements and excluded 21 participants because of the low accuracy of detection (facial landmark detection error; covering participant’s face with hand; frequent bowing their head), or the low quality of data (being drowsy during the experiment). Thus, 66 patients with MDD and 46 HCs were included in the analysis (See Supplementary Figure S2 for participants flow diagram). As for the medication status, 65 patients out of 66 patients are medication-naïve. Only one patient had been treated with serotonin-norepinephrine reuptake inhibitor and benzodiazepine, 5 months before the facial movements recording.
2.3. Resting-state fMRI acquisition and preprocessing
Of the 112 women enrolled in this study, 80 participants (HC, n = 42; MDD, n = 38) agreed to participate in the MRI portion of this study, and were screened using MRI compatibility criteria. The resting state-fMRI acquisition was conducted on a 3.0-T Philips Achieva scanner (Philips Medical Systems, Best, The Netherlands) with a 32-channel head coil at the Korea Basic Science Institute. Whole brain blood oxygen level-dependent (BOLD) images were acquired with a T2*-weighted echo-planar sequence (TR/TE = 2000/35 , voxel size = 3 × 3 × 3.5 with a 0.5- slice gap, number of volumes = 300). Total scan time for fMRI was 10 min. T1-weighted anatomical images were acquired for spatial normalization of BOLD images using a three-dimensional TFE pulse sequence (TR/TE = 6.7/3.1 , flip angle = 9°, voxel size = 1 × 1 × 1 ).
For fMRI data, head motion was reduced by linear realignment of images to the first volume (FSL-MCFLIRT). Next, skull stripping was performed (FSL-BET). For T1-weighted anatomical images, cortical surface reconstruction was completed for co-registration (recon-all, FreeSurfer). BOLD fMRI images in native space were registered to the Montreal Neurological Institute (MNI) space following co-registration between subjects’ anatomical and functional volumes (bbregister, FreeSurfer). Preprocessing also included regressing out the six translation/rotation motion parameters (from FSL-MCFLIRT), motion-outlier confound matrices (FSL_motion-outliers), and the aCompCor regressors, containing four principle components and average of white matter and CSF, from the CONN toolbox (Behzadi et al., 2007, Whitfield-Gabrieli and Nieto-Castanon, 2012) using a generalized linear model (GLM). Spatial smoothing was then performed using a 5- full-width-at-half maximum Gaussian kernel, and temporal high-pass filtering was performed with a 0.008-Hz cut-off frequency.
2.4. Seed-based functional connectivity
For connectivity analyses, we used a NAc seed, which was defined by subdividing the NAc region of the Automated Anatomical Labelling atlas (Rolls et al., 2020) based on the parcellation of putative core and shell subdivisions in humans, using diffusion tractography (Baliki et al., 2013) (Fig. 3A). The time series of the NAc core was averaged across all voxels of this ROI, for each participant, which was then fed into the GLM analyses as a regressor of interest (FSL-FEAT). Estimated parameters and their variances from this single subject analysis were then used in a group-level GLM (FSL-FEAT, mixed-effect model).
Fig. 3.
Altered seed-based functional connectivity of the nucleus accumbens (NAc) core in major depressive disorder (MDD) patients as compared to healthy controls (HCs). Functional connectivity of the NAc core with the medical prefrontal cortex (mPFC) was decreased in MDD participants as compared to HCs, while the connectivity with the left posterior insula cortex (pIns) and dorsolateral prefrontal cortex were increased in MDD participants as compared to HCs (z > 2.58, FWE-corrected with p < 0.05). Estimates of the head motions were corrected in group-level analysis for functional connectivity.
A separate GLM was also performed to calculate the difference in NAc core functional connectivity between MDD and HC individuals. To investigate the association between resting NAc connectivity, facial movements, and depressive symptoms, a multivariable regression model was used. The root mean square of the head-motion parameters from FSL-MCFLIRT were calculated within the individuals and added to the group-level GLM as covariate to correct motion effect between subjects. The maps obtained from the group-level GLM analysis were thresholded at z > 2.58, and cluster corrected for multiple comparisons by converting sizes of clusters to p-values using gaussian random field (GRF) theory with significant level at p < 0.05 (thresholded at z > 2.58, family-wise error [FWE]-corrected with p < 0.05; FSL_Cluster). For subsequent analysis with functional connectivity metrics, z-statistics over a 4-mm diameter sphere, centered on the local maxima of the significant cluster, were used.
2.5. Statistical analysis
All tests were two-tailed except fMRI analyses (one-tailed). For parametric testing, all data were first tested for normal distribution, as assessed by the Kolmogorov–Smirnov test. Repeated-measures analyses of variance (ANOVAs) and post-hoc paired t-tests were used to investigate the differences in facial component scores across the category of emotional stimuli. Group differences were evaluated using independent t-tests or Mann–Whitney U-tests. To investigate the associations between variables, Pearson’s or Spearman’s correlations were used. The significance level was set to α = 0.05. All statistical tests, except the fMRI data analyses, were performed using the Statistical Package for Social Sciences 17.0.
3. Results
3.1. Affective ratings of the emotional stimuli
As for affective rating, participants rated they felt joyful more than other feelings for joyful and appetite-inducing stimuli (paired t-tests, p < 0.001 after Bonferroni correction, Supplementary Figure S3). For sad stimuli, participants felt sad more than others, and for anxiety-inducing stimuli, they felt fearful/anxious more than others (paired t-tests, p < 0.001 after Bonferroni correction, Supplementary Figure S3). Each category of video clips induced the proper affect (or feeling) more than other affect. Subsequently, we compared the affective ratings between MDD patients and HC under each emotional stimulus, which were shown in Supplementary Table S2. For joyful and appetite-inducing stimuli, HC rated more joyful than MDD patients (all p < 0.01 after Bonferroni correction at Mann–Whitney U-tests). For joyful and neutral stimuli, MDD patients rated more sad, disgusted, fearful or anxious than HC (all p < 0.01 after Bonferroni correction at Mann–Whitney U-tests). These findings indicated that MDD patients had some biases in emotional experience under the stimuli with positive valence. For sad and anxiety-inducing stimuli, no significant difference was shown in positive (joyful) or negative affect ratings (sad, disgusted, fearful or anxious) between MDD patients and HC.
3.2. Facial movements induced by emotional stimuli
From facial video recordings of participants under naturalistic emotional stimuli, scores for 17 facial action units were extracted and projected onto PCs using PCA, which yielded three PCs, clusters of prominent facial movement features. The first PC encompassed the facial action units of “mouth open”, ”lid tighten“, ”jaw drop“, and ”brow furrow“, overall representing mouth-opening movements, termed the ”AH component“ (Fig. 1A–B). The second PC encompassed ”lip press“, ”dimpler“, ”lip suck“, and ”lip stretch“, representing lip-pursing/stretching movements, termed the ”HM component“ (Fig. 1A–B). The third component was predominantly driven by ”eye closure.“ To evaluate the stability of feature selection using PCA, we repeated PCA for the MDD and HC groups separately, and found results similar to those for the merged (MDD + HC) group (Supplementary Figure S4).
Fig. 1.
Consistent global patterns of facial expression in response to emotional stimuli. (A) Principal components (PCs) of the 17 facial action units represented common facial expressions. Facial action units of “mouth open”, “lid tighten”, “jaw drop”, and “brow furrow” contributed most strongly to PC1 (“AH component”). Facial action units of “lip press”, “dimpler”, “lip suck”, and “lip stretch” contributed most to PC2 (“HM component”). (B) Visualization of PCs using Openface toolkit (Baltrušaitis et al., 2016) and MakeHuman software (http://www.makehumancommunity.org/, MakeHuman Team). Virtual facial expressions for PCs was rendered based on 17 weights of facial action units from PC analysis. The AH component represented mostly mouth-opening movements, whereas the HM component represented mostly lip-pursing/stretching movements. Averaged scores of PCs and major facial action units are shown in terms of their response to the diverse set of emotional stimuli presented to study participants. The AH component was mostly elicited during presentation of joyful emotional stimuli. The HM component was also elicited during the presentation of joyful stimuli as well as during fixation cross presentation.
Both the “AH component” and “HM component” were associated with the joyful stimuli (Fig. 1C). The AH component score for joyful stimuli was higher than for other stimuli (repeated-measures analysis of variance [ANOVA], F5,555 = 27.51, p < 0.0001, post-hoc paired t-tests, p < 0.0001 after Bonferroni correction, Supplementary Table S3), indicating the AH component was mostly elicited during joyful stimuli. The HM component was elicited during the presentation of fixation cross as well as the joyful stimuli. The HM component scores for responses to the fixation cross and joyful stimuli were higher than that for other stimuli (repeated-measures ANOVA, F5,555 = 18.30, p < 0.0001, post-hoc paired t-tests, p < 0.05 for others; no significant score difference between fixation cross and joyful stimuli, p > 0.9 after Bonferroni correction, Supplementary Table S3). We presented the individual time courses of the AH and HM components for the representative participants in Supplementary Figure S5, which showed the AH and HM components occurred in turn during presentation of joyful stimuli. In summary, the joyful stimuli were most evocative of facial movements in our participants.
3.3. The HM component is associated with depression
To assess possible depression-specific facial movements, we first compared the scores of AH and HM components between HC and MDD participants, and found a significant difference only for the HM component score (HM score [mean ± SD], 2.23 ± 1.20 in HC, 1.49 ± 1.52 in MDD, t = 2.75, p = 0.007; AH score, 2.91 ± 1.97 in HC, 2.55 ± 2.36 in MDD, t = 0.85, p = 0.40, respectively), indicating that participants with MDD elicited HM components less strongly than did HCs (Fig. 2A).
Fig. 2.
The stimulus-evoked HM component in MDD and HC participants, and its association with depressive symptoms. (A) The stimulus-evoked HM facial expression component score was significantly different between MDD and HC groups (p = 0.007, gray circle denotes mean; error bars, SD). (B) The HM component in MDD was inversely correlated with the Beck Depression Inventory (BDI) scores (r = −0.39, p = 0.001) at baseline. ** p < 0.01.
Moreover, the HM component in MDD participants was inversely correlated with depressive symptoms on the BDI (Fig. 2B, r = −0.39, p = 0.001), indicating that the HM component was less prominent for women with higher scores for depressive symptoms. On the other hand, the AH component did not show a significant correlation with baseline depressive symptoms score (r = −0.04, p = 0.75).
3.4. Alteration of nucleus accumbens functional connectivity in MDD patients
To elucidate the neural correlates associated with the decreased HM component in MDD, seed-based functional connectivity analysis was conducted using resting-state fMRI data of 38 MDD patients and 42 HCs. The HM component was composed of the mouth movements. Previous animal studies have shown that mouth movements, such as the hedonic orofacial reaction, could be modulated by neurotransmitter microinjection into the NAc (Castro et al., 2015, Castro et al., 2016). The NAc is a key region for the motivational process and reward circuitry. The NAc is implicated in the core symptoms of MDD, including anhedonia or loss of interest (Felger et al., 2016, Francis and Lobo, 2017, Russo and Nestler, 2013). Thus, we focused on the NAc circuitry to investigate the neurological basis related to the deficit in the HM component in depressive women.
Difference matrices of whole brain functional connectivity between MDD and HC individuals demonstrated that NAc core connectivity with the medial prefrontal cortex (mPFC) was significantly decreased in MDD patients as compared to HCs (thresholded at z > 2.58, FWE-corrected with p < 0.05, Fig. 3 and Supplementary Table S4). Moreover, we found a significant increase in NAc core connectivity with the left posterior insula cortex (pIns), left dorsolateral prefrontal cortex (dlPFC), left inferior prefrontal gyrus (IFG), and left middle insula cortex (mIns) in MDD patients as compared to HCs (Fig. 3 and Supplementary Table S4). Interestingly, this NAc–pIns connectivity showed a negative correlation with the HM component score (Fig. 4), indicating that increased connectivity between the NAc and the pIns was associated with a decrease in HM components in MDD. However, the NAc core–mPFC, NAc core–dlPFC, NAc core–IFG, or NAc core–mIns connectivity did not show any significant correlation with the HM component score (all p > 0.1).
Fig. 4.
The association between the HM component and nucleus accumbens (NAc) functional connectivity in major depressive disorder (MDD) patients (z > 2.58, FWE-corrected with p < 0.05). HM component score was inversely correlated with the connectivity of the NAc core with the left pIns. Moreover, connectivity of the NAc core with the medial thalamus was inversely correlated with the HM component in MDD participants. Estimates of the head motions were corrected in group-level analysis for functional connectivity.
3.5. NAc functional connectivity associated with the HM component
We then investigated the association between the whole-brain NAc core connectivity matrices and the HM component in MDD participants. The whole-brain correlation matrices showed that NAc core connectivity with the pIns and medial thalamus was significantly inversely correlated with the HM component in MDD patients (thresholded at z > 2.58, FWE-corrected with p < 0.05; Fig. 4 and Supplementary Table S5).
As there was a significant difference in age between the MDD and HC groups (MDD, n = 66; 29.8 ± 10.9 years [mean ± SD]; HC n = 46, 24.1 ± 5.3 years, Mann–Whitney U test, p = 0.04), we re-compared the PC scores and brain connectivity strengths using an age-matched group (MDD, n = 53, 25.8 ± 7.7 years [mean ± SD]; HC, n = 36, 25.2 ± 5.6; Mann–Whitney U test, p = 0.41) for confirmation purposes, which showed similar results (Supplementary Figures S6 and S7). Briefly, the HM component score was significantly different between MDD and HC (independent t-test, p = 0.004). The HM component score was significantly correlated with the depressive symptoms as assessed by BDI (r = −0.37, p = 0.006). The connectivity strengths of NAc with pIns and dlPFC, and with mPFC showed significant difference between the MDD and HC groups (thresholded at z > 2.58, FWE-corrected p < 0.05).
4. Discussion
We identified prominent clusters of facial movements in female participants using PCA: the “AH component (PC1)” and ”HM component (PC2)” (Fig. 1). The AH component was related to mouth-open, jaw-drop, and lid-tighten movements, which are action units known to occur in positive (joyful) or negative (sad, anger, fear) expressions, as well as in surprise (Kohler et al., 2004). In the current study, joyful stimuli elicited more of the AH component in participants than did other stimuli, although the anxiety-inducing and sad stimuli also evoked the AH component to a moderate extent (Fig. 1C). These results indicate that the AH component is primarily induced by joyful stimuli.
On the other hand, the HM component mainly comprised lip suck, lip press, lip stretch, and dimpler. These movements were evoked under joyful stimuli or during presentation of the fixation cross. Thus, joyful stimuli evoked both the AH and HM components. The facial movements of the AH and HM components sometimes occurred in turn during presentation of joyful stimuli (Supplementary Figure S5). Thus, the HM components may be related to a smile without mouth opening, or they may simply be a cluster of mouth movements preceding or followed by a smile (Messinger et al., 1999). In addition, the HM components were frequently observed during presentation of the fixation cross. It is unclear what aspect of the fixation cross elicited the HM components. Mind-wandering, irrespective of the stimuli, rumination on previous stimuli, or waiting for upcoming stimuli may have elicited the HM components and associated activities in brain regions at rest (Carlson et al., 2020, Gilbert et al., 2007, Mason et al., 2007).
We found a significant difference in the HM component score between HC and MDD participants, with mouth movements related to HM components markedly attenuated in patients with MDD. In addition, the higher scores of HM components were associated with a lower score of depressive symptoms. These findings verified the relationship between the HM component and depression, suggesting that the HM component score can be used as a feasible nonverbal tool for assessing depressive symptoms and detecting changes after treatment.
Whole-brain functional connectivity matrices for resting states shed light on the neural mechanism of attenuated HM component in depressed women. We found a significant difference in NAc connectivity between patients with MDD and HCs. The NAc core showed increased connectivity with the left pIns in MDD patients, while mPFC–NAc connectivity was decreased in patients with MDD. We also found that the strength of the connectivity between the NAc and the pIns was associated with the HM component score in MDD patients.
A previous meta-analysis of human fMRI connectivity studies demonstrated that the NAc, insula, and thalamus were consistently co-activated and had rich reciprocal connections (Cauda et al., 2011, Cho et al., 2013). These three brain regions are key components in the reward system (Cauda et al., 2011, Cho et al., 2013). NAc cells respond to appetitive or aversive stimuli (Roitman et al., 2005), and the NAc integrates the information of emotional valence and sends signals to the motor system (Mogenson et al., 1980). The NAc is implicated in orofacial movements, which are accompanied by feeding, drinking, and vocalization (Mogenson et al., 1980). Thus, the NAc and its connectivity with the insula and thalamus are important in elucidating the neural basis of human mouth movements.
Previous rodent studies have shown that rodent mouth movements can be modulated by pharmacological manipulation within the NAc (Castro et al., 2016, Richard and Berridge, 2011). Optogenetic or electrical stimulation of the pIns also contributes to inducing facial movement in mice (Dolensek et al., 2020), (Maeda et al., 2014, Tsutsumi et al., 2018, Zhang and Sasamoto, 1990). The insula sends afferents to the NAc, and the insula–NAc circuit is implicated in socioemotional behavior (Gehrlach et al., 2019, Rogers-Carter and Christianson, 2019). A recent study showed that the pIns–NAc core pathway transmitted information of the aversive state of malaise, and finally inhibited ongoing feeding behavior (Gehrlach et al., 2019). Feeding behavior includes mouth movements. These studies indicated that the pIns–NAc core pathway contributed to the inhibition of ongoing behavior, suggesting that its facilitation in MDD could reinforce behavioral suppression.
In addition, animal studies have shown that the paraventricular nuclei, midline nuclei located in the medial thalamus, to NAc projection mediated reward-seeking behavior (Cheng et al., 2018, Choi and McNally, 2017, Do-Monte et al., 2017, Otis et al., 2019). The inhibition of input from the paraventricular nuclei to the NAc increased unproductive reward-seeking (Lafferty et al., 2020), suggesting that this pathway suppresses compulsive behavior by regulating motivational inhibition. Interestingly, the pIns and medial thalamus to NAc connectivity showed an inverse correlation with the HM component in MDD participants. Thus, greater connectivity from the pIns and medial thalamus to the NAc were associated with HM component attenuation. These findings suggest that the suppressed HM component in MDD could be the result of behavioral inhibition modulated by the pathway from the pIns and medial thalamus to the NAc.
We also found that patients with MDD showed decreased functional connectivity between the NAc core and mPFC, indicating suppression of the mPFC–NAc pathway. Neuroimaging studies have shown that participants with depressive symptoms show blunted responses in the mPFC under both reward or aversive stimuli, and also demonstrate abnormalities in the frontal–striatal network (Rzepa et al., 2017, Zhang et al., 2016). These results were consistent with our study and supported the hypothesis that decreased mPFC–NAc connectivity might have some relevance to depressive symptoms, including anhedonia.
An important limitation of the study is the homogeneous sample. Participants were all Korean women, thereby limiting our ability to generalize results to depressed men.
In conclusion, we found attenuated facial movement (HM component) related to lip-stretching in MDD patients, which was associated with depressive symptoms, and with the strength of connectivity of the NAc core to the pIns and thalamus. Thus, we elucidated the mechanism underlying abnormal facial movement in patients with MDD. Evaluation of facial movement can be used as a quantitative marker for assessing depressive symptoms.
Author contributions.
SC, CC, VN, ICJ, and HK conceptualized the study design. SC, YKS, YC, SMC, YS, JoK, GC, ICJ, and HK collected the data. CJ, JiK, SC, and VN, HK analyzed and interpreted the data with contributions from YKS, KP, and OK; CJ and JiK wrote the first draft of the paper. All authors contributed to critically revising the manuscript and approved the final manuscript.
Funding
This work was supported by the Korea Institute of Oriental Medicine grant KSN2212010 (to HK) and C18210 (to HK and ICJ), and the National Research Foundation of Korea grant NRF-2017R1A2B4012546 (to CC).
Declaration of Competing Interests
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Footnotes
Supplementary data to this article can be found online at https://doi.org/10.1016/j.nicl.2023.103380.
Contributor Information
In Chul Jung, Email: npjeong@dju.kr.
Hyungjun Kim, Email: heyjoon73@kiom.re.kr.
Appendix A. Supplementary data
The following are the Supplementary data to this article:
Data availability
The authors do not have permission to share data.
References
- American Psychiatric Association, 2015. Depressive Disorders: DSM-5® Selections. American Psychiatric Pub.
- Baliki M.N., Mansour A., Baria A.T., Huang L., Berger S.E., Fields H.L., Apkarian A.V. Parceling human accumbens into putative core and shell dissociates encoding of values for reward and pain. J. Neurosci. 2013;33:16383–16393. doi: 10.1523/JNEUROSCI.1731-13.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baltrušaitis T., Robinson P., Morency L.-P. IEEE Workshop on Applications of Computer Vision (WACV) IEEE; 2016. OpenFace: An open source facial behavior analysis toolkit. [Google Scholar]
- Behzadi Y., Restom K., Liau J., Liu T.T. A component based noise correction method (CompCor) for BOLD and perfusion based fMRI. Neuroimage. 2007;37:90–101. doi: 10.1016/j.neuroimage.2007.04.042. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Berridge K.C. Measuring hedonic impact in animals and infants: microstructure of affective taste reactivity patterns. Neurosci. Biobehav. Rev. 2000;24:173–198. doi: 10.1016/s0149-7634(99)00072-x. [DOI] [PubMed] [Google Scholar]
- Broch-Due I., Kjærstad H.L., Kessing L.V., Miskowiak K. Subtle behavioural responses during negative emotion reactivity and down-regulation in bipolar disorder: A facial expression and eye-tracking study. Psychiatry Res. 2018;266:152–159. doi: 10.1016/j.psychres.2018.04.054. [DOI] [PubMed] [Google Scholar]
- Carlson H., Leitão J., Delplanque S., Cayeux I., Sander D., Vuilleumier P. Sustained effects of pleasant and unpleasant smells on resting state brain activity. Cortex. 2020;132:386–403. doi: 10.1016/j.cortex.2020.06.017. [DOI] [PubMed] [Google Scholar]
- Carvalho R.C., Silva R.H., Abílio V.C., Barbosa P.N., Frussa-Filho R. Antidyskinetic effects of risperidone on animal models of tardive dyskinesia in mice. Brain Res. Bull. 2003;60:115–124. doi: 10.1016/s0361-9230(03)00020-0. [DOI] [PubMed] [Google Scholar]
- Castro D.C., Cole S.L., Berridge K.C. Lateral hypothalamus, nucleus accumbens, and ventral pallidum roles in eating and hunger: interactions between homeostatic and reward circuitry. Front. Syst. Neurosci. 2015;9:90. doi: 10.3389/fnsys.2015.00090. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Castro D.C., Terry R.A., Berridge K.C. Orexin in rostral hotspot of nucleus accumbens enhances sucrose 'Liking' and Intake but Scopolamine in Caudal Shell Shifts 'Liking' Toward 'Disgust' and 'Fear'. Neuropsychopharmacology. 2016;41:2101–2111. doi: 10.1038/npp.2016.10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cauda F., Cavanna A.E., D'agata F., Sacco K., Duca S., Geminiani G.C. Functional connectivity and coactivation of the nucleus accumbens: a combined functional connectivity and structure-based meta-analysis. J. Cogn. Neurosci. 2011;23:2864–2877. doi: 10.1162/jocn.2011.21624. [DOI] [PubMed] [Google Scholar]
- Cheng J., Wang J., Ma X., Ullah R., Shen Y., Zhou Y.D. Anterior paraventricular thalamus to nucleus accumbens projection is involved in feeding behavior in a novel environment. Front. Mol. Neurosci. 2018;11:202. doi: 10.3389/fnmol.2018.00202. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cho Y.T., Fromm S., Guyer A.E., Detloff A., Pine D.S., Fudge J.L., Ernst M. Nucleus accumbens, thalamus and insula connectivity during incentive anticipation in typical adults and adolescents. Neuroimage. 2013;66:508–521. doi: 10.1016/j.neuroimage.2012.10.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Choi E.A., McNally G.P. Paraventricular thalamus balances danger and reward. J. Neurosci. 2017;37:3018–3029. doi: 10.1523/JNEUROSCI.3320-16.2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dimberg U., Thunberg M., Elmehed K. Unconscious facial reactions to emotional facial expressions. Psychol. Sci. 2000;11:86–89. doi: 10.1111/1467-9280.00221. [DOI] [PubMed] [Google Scholar]
- Dolensek N., Gehrlach D.A., Klein A.S., Gogolla N. Facial expressions of emotion states and their neuronal correlates in mice. Science. 2020;368:89–94. doi: 10.1126/science.aaz9468. [DOI] [PubMed] [Google Scholar]
- Do-Monte F.H., Minier-Toribio A., Quiñones-Laracuente K., Medina-Colón E.M., Quirk G.J. Thalamic regulation of sucrose seeking during unexpected reward omission. Neuron. 2017;94:388–400.e384. doi: 10.1016/j.neuron.2017.03.036. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ekman P., Rosenberg E.L. Oxford University Press; USA: 1997. What the face reveals: Basic and applied studies of spontaneous expression using the Facial Action Coding System (FACS) [Google Scholar]
- Ellingsen D.M., Isenburg K., Jung C., Lee J., Gerber J., Mawla I., Sclocco R., Jensen K.B., Edwards R.R., Kelley J.M., Kirsch I., Kaptchuk T.J., Napadow V. Dynamic brain-to-brain concordance and behavioral mirroring as a mechanism of the patient-clinician interaction. Sci. Adv. 2020;6 doi: 10.1126/sciadv.abc1304. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ellingsen D.M., Duggento A., Isenburg K., Jung C., Lee J., Gerber J., Mawla I., Sclocco R., Edwards R.R., Kelley J.M., Kirsch I., Kaptchuk T.J., Toschi N., Napadow V. Patient-clinician brain concordance underlies causal dynamics in nonverbal communication and negative affective expressivity. Transl. Psychiatry. 2022;12:44. doi: 10.1038/s41398-022-01810-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Felger J.C., Li Z., Haroon E., Woolwine B.J., Jung M.Y., Hu X., Miller A.H. Inflammation is associated with decreased functional connectivity within corticostriatal reward circuitry in depression. Mol. Psychiatry. 2016;21:1358–1365. doi: 10.1038/mp.2015.168. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Francis T.C., Lobo M.K. Emerging role for nucleus accumbens medium spiny neuron subtypes in depression. Biol. Psychiatry. 2017;81:645–653. doi: 10.1016/j.biopsych.2016.09.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gehrlach D.A., Dolensek N., Klein A.S., Roy Chowdhury R., Matthys A., Junghänel M., Gaitanos T.N., Podgornik A., Black T.D., Reddy Vaka N., Conzelmann K.K., Gogolla N. Aversive state processing in the posterior insular cortex. Nat. Neurosci. 2019;22:1424–1437. doi: 10.1038/s41593-019-0469-1. [DOI] [PubMed] [Google Scholar]
- Gilbert S.J., Dumontheil I., Simons J.S., Frith C.D., Burgess P.W. Comment on “Wandering minds: the default network and stimulus-independent thought”. Science. 2007;317:43. doi: 10.1126/science.317.5834.43. author reply 43. [DOI] [PubMed] [Google Scholar]
- Grill H.J., Norgren R. The taste reactivity test. II. Mimetic responses to gustatory stimuli in chronic thalamic and chronic decerebrate rats. Brain Res. 1978;143:281–297. doi: 10.1016/0006-8993(78)90569-3. [DOI] [PubMed] [Google Scholar]
- Joliffe I.T. Springer-Verlag; New York: 1986. Principal Component Analysis. [Google Scholar]
- Klawans H.L., Rubovits R. Effect of cholinergic and anticholinergic agents on tardive dyskinesia. J. Neurol. Neurosurg. Psychiatry. 1974;37:941–947. doi: 10.1136/jnnp.37.8.941. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kohler C.G., Turner T., Stolar N.M., Bilker W.B., Brensinger C.M., Gur R.E., Gur R.C. Differences in facial expressions of four universal emotions. Psychiatry Res. 2004;128:235–244. doi: 10.1016/j.psychres.2004.07.003. [DOI] [PubMed] [Google Scholar]
- Kupferberg A., Bicks L., Hasler G. Social functioning in major depressive disorder. Neurosci. Biobehav. Rev. 2016;69:313–332. doi: 10.1016/j.neubiorev.2016.07.002. [DOI] [PubMed] [Google Scholar]
- Lafferty C.K., Yang A.K., Mendoza J.A., Britt J.P. Nucleus Accumbens Cell Type- and Input-Specific Suppression of Unproductive Reward Seeking. Cell Rep. 2020;30:3729–3742.e3723. doi: 10.1016/j.celrep.2020.02.095. [DOI] [PubMed] [Google Scholar]
- Maeda N., Kobashi M., Mitoh Y., Fujita M., Minagi S., Matsuo R. Differential involvement of two cortical masticatory areas in submandibular salivary secretion in rats. Brain Res. 2014;1543:200–208. doi: 10.1016/j.brainres.2013.11.024. [DOI] [PubMed] [Google Scholar]
- Mason M.F., Norton M.I., Van Horn J.D., Wegner D.M., Grafton S.T., Macrae C.N. Wandering minds: the default network and stimulus-independent thought. Science. 2007;315:393–395. doi: 10.1126/science.1131295. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Messinger D.S., Fogel A., Dickson K.L. What's in a smile? Dev. Psychol. 1999;35:701–708. doi: 10.1037//0012-1649.35.3.701. [DOI] [PubMed] [Google Scholar]
- Mogenson G.J., Jones D.L., Yim C.Y. From motivation to action: functional interface between the limbic system and the motor system. Prog. Neurobiol. 1980;14:69–97. doi: 10.1016/0301-0082(80)90018-0. [DOI] [PubMed] [Google Scholar]
- Otis J.M., Zhu M., Namboodiri V.M.K., Cook C.A., Kosyk O., Matan A.M., Ying R., Hashikawa Y., Hashikawa K., Trujillo-Pisanty I., Guo J., Ung R.L., Rodriguez-Romaguera J., Anton E.S., Stuber G.D. Paraventricular Thalamus projection neurons integrate cortical and hypothalamic signals for cue-reward processing. Neuron. 2019;103:423–431.e424. doi: 10.1016/j.neuron.2019.05.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Park C., Rosenblat J.D., Lee Y., Pan Z., Cao B., Iacobucci M., McIntyre R.S. The neural systems of emotion regulation and abnormalities in major depressive disorder. Behav. Brain Res. 2019;367:181–188. doi: 10.1016/j.bbr.2019.04.002. [DOI] [PubMed] [Google Scholar]
- Richard J.M., Berridge K.C. Metabotropic glutamate receptor blockade in nucleus accumbens shell shifts affective valence towards fear and disgust. Eur. J. Neurosci. 2011;33:736–747. doi: 10.1111/j.1460-9568.2010.07553.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rogers-Carter M.M., Christianson J.P. An insular view of the social decision-making network. Neurosci. Biobehav. Rev. 2019;103:119–132. doi: 10.1016/j.neubiorev.2019.06.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Roitman M.F., Wheeler R.A., Carelli R.M. Nucleus accumbens neurons are innately tuned for rewarding and aversive taste stimuli, encode their predictors, and are linked to motor output. Neuron. 2005;45:587–597. doi: 10.1016/j.neuron.2004.12.055. [DOI] [PubMed] [Google Scholar]
- Rolls E.T., Huang C.C., Lin C.P., Feng J., Joliot M. Automated anatomical labelling atlas 3. Neuroimage. 2020;206 doi: 10.1016/j.neuroimage.2019.116189. [DOI] [PubMed] [Google Scholar]
- Russo S.J., Nestler E.J. The brain reward circuitry in mood disorders. Nat. Rev. Neurosci. 2013;14:609–625. doi: 10.1038/nrn3381. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rzepa E., Fisk J., McCabe C. Blunted neural response to anticipation, effort and consummation of reward and aversion in adolescents with depression symptomatology. J. Psychopharmacol. 2017;31:303–311. doi: 10.1177/0269881116681416. [DOI] [PubMed] [Google Scholar]
- Salamone J.D., Lalies M.D., Channell S.L., Iversen S.D. Behavioural and pharmacological characterization of the mouth movements induced by muscarinic agonists in the rat. Psychopharmacology (Berl) 1986;88:467–471. doi: 10.1007/BF00178508. [DOI] [PubMed] [Google Scholar]
- Shulman L.M., Singer C., Weiner W.J. Risperidone in Gilles de la Tourette syndrome. Neurology. 1995;45:1419. doi: 10.1212/wnl.45.7.1419. [DOI] [PubMed] [Google Scholar]
- Surguladze S., Brammer M.J., Keedwell P., Giampietro V., Young A.W., Travis M.J., Williams S.C., Phillips M.L. A differential pattern of neural response toward sad versus happy facial expressions in major depressive disorder. Biol. Psychiatry. 2005;57:201–209. doi: 10.1016/j.biopsych.2004.10.028. [DOI] [PubMed] [Google Scholar]
- Trémeau F., Malaspina D., Duval F., Corrêa H., Hager-Budny M., Coin-Bariou L., Macher J.P., Gorman J.M. Facial expressiveness in patients with schizophrenia compared to depressed patients and nonpatient comparison subjects. Am. J. Psychiatry. 2005;162:92–101. doi: 10.1176/appi.ajp.162.1.92. [DOI] [PubMed] [Google Scholar]
- Tsutsumi Y., Tachibana Y., Sato F., Furuta T., Ohara H., Tomita A., Fujita M., Moritani M., Yoshida A. Cortical and Subcortical Projections from Granular Insular Cortex Receiving Orofacial Proprioception. Neuroscience. 2018;388:317–329. doi: 10.1016/j.neuroscience.2018.07.047. [DOI] [PubMed] [Google Scholar]
- Whitfield-Gabrieli S., Nieto-Castanon A. Conn: a functional connectivity toolbox for correlated and anticorrelated brain networks. Brain Connect. 2012;2:125–141. doi: 10.1089/brain.2012.0073. [DOI] [PubMed] [Google Scholar]
- Worbe Y., Marrakchi-Kacem L., Lecomte S., Valabregue R., Poupon F., Guevara P., Tucholka A., Mangin J.F., Vidailhet M., Lehericy S., Hartmann A., Poupon C. Altered structural connectivity of cortico-striato-pallido-thalamic networks in Gilles de la Tourette syndrome. Brain. 2015;138:472–482. doi: 10.1093/brain/awu311. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhang B., Lin P., Shi H., Öngür D., Auerbach R.P., Wang X., Yao S. Mapping anhedonia-specific dysfunction in a transdiagnostic approach: an ALE meta-analysis. Brain Imaging Behav. 2016;10:920–939. doi: 10.1007/s11682-015-9457-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhang G.X., Sasamoto K. Projections of two separate cortical areas for rhythmical jaw movements in the rat. Brain Res. Bull. 1990;24:221–230. doi: 10.1016/0361-9230(90)90209-i. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The authors do not have permission to share data.




