Abstract
Schizophrenia is characterized by profound impairment in the motivation for social affiliation. Negative symptoms are associated with such impairment but the contribution of behavioral skill deficits is unclear. In this study we utilized a novel video paradigm to assess performance-based affiliative behavioral skills in individuals with schizophrenia (N = 48) and community controls (N = 29). Individuals with schizophrenia displayed significant impairment in behavioral affiliative skills compared to controls; however, in response to the affiliative interaction the groups did not differ on self-reported affective responding, appraisal of the interaction partner, or desire to interact with the partner in the future. Importantly, within the patient group more severe negative symptoms (particularly those related to motivation and pleasure) were associated with poorer affiliative social skills and this relationship was independent of instrumental (non-social) skills, depression or positive symptoms. More severe negative symptoms were also associated with less positive affect in response to the interaction and less positive appraisals of the interaction partner. Self-reported social anhedonia was related to patients’ diminished willingness to interact with the partner in the future. These results demonstrate that negative symptoms in schizophrenia are related to both affiliative skills deficits and less affiliative subjective responses to interaction partners.
Keywords: Negative symptoms, anhedonia, affiliation, social skill
Introduction
Negative symptoms, such as anhedonia, amotivation and asociality, are one of the most debilitating aspects of schizophrenia (Herbener and Harrow, 2004; Buchanan, 2007; Rabinowitz et al., 2012). Factor analytic studies have found that negative symptoms can be parsimoniously explained by two factors—diminished expression and diminished motivation and pleasure (Blanchard and Cohen, 2006; Horan et al., 2011; Strauss et al., 2012). Deficits in motivation and pleasure have particular implications for role functioning in the community (e.g., Green et al., 2012; Kring et al., 2013) and may manifest as disruptions in the engagement of positive social interactions with others (i.e., social affiliation).
The social affiliative deficits reflected in negative symptoms may in part arise from, or contribute to, impairments in social skill. Social skills involve verbal and nonverbal behavior that are essential for the initiation and success of affiliative interactions, and an accumulation of research has shown profound social skill deficits in schizophrenia (e.g., Liberman et al., 1986; Mueser et al., 1990; Mueser et al., 2010) leading to interventions to improve these skills (e.g., Granholm et al., 2007; Granholm et al., 2014; Kurtz et al., 2015). However, when assessing social skill within an interpersonal context, typically through the use of a role play, the association between these behavioral skill ratings and negative symptoms has been inconsistent. While some studies have found that greater negative symptoms are associated with poorer social skill (Mueser et al., 1990; Bellack et al., 1990; Addington and Addington, 1999; Couture et al., 2011; Robertson et al., 2014), other studies have failed to find an association between social skill and negative symptoms (Mueser et al., 1991; Blanchard et al., 1994; Bowie et al., 2010). For example, Bowie et al. (2010) observed that symptoms, including negative symptoms, do not appear to influence the ability to perform social skills but rather the likelihood of performing those skills in the community.
In considering the mixed findings regarding the association between social skill and negative symptoms, it may be informative to consider methodological issues relating to the assessment of both of these domains. Prior studies have utilized measures of negative symptoms that may have limitations in terms of their capacity to assess experiential deficits in interests, motivation, and pleasure that are central to the construct of affiliation (Blanchard et al., 2011). Further, prior studies have often utilized a single summary score of negative symptoms. As noted above, recent research has indicated that negative symptoms are best characterized by two major facets involving deficits in motivation and pleasure and a separate facet of expressive deficits reflecting blunted affect and alogia (Blanchard and Cohen, 2006; Horan et al., 2011; Strauss et al., 2012). It may be important to explore the potential differential contribution of experiential and expressive negative symptoms to behavioral skill deficits. For example, Rocca et al. (2014) found that avolition-related symptoms were more strongly associated with functional impairment than expressive deficits. To address these issues, the current study assessed negative symptoms using the Clinical Assessment Interview for Negative Symptoms (CAINS; Horan et al., 2011; Kring et al., 2013). The CAINS is a recently developed semi-structured interview that evaluates the two factors of negative symptoms while providing a more direct assessment of experiential deficits associated with motivation and pleasure (including consummatory and anticipatory pleasure) than is provided by other instruments (Blanchard et al., 2011).
Another consideration is that prior studies of social skill in schizophrenia typically involve behavioral interactions that may lack positive affective features that are central to affiliation. Role play assessments often include conflict-oriented or problem-solving scenes (Bellack et al., 1994) that are by their nature not affiliative. Further, when existing role-play assessments include affiliative goals (e.g., getting to know a new neighbor), the role plays often place the burden of maintaining the conversation on the participant (Bellack et al., 1994; Sayers et al., 1995; Patterson et al., 2001), discourage confederates from displaying positive affect (Patterson et al., 2001), and typically do not induce positive affect even in healthy participants in a manner that would be expected from an affiliative interaction (Horan and Blanchard, 2003). The use of affiliative skills assessments could be important to examine in schizophrenia. Affiliative deficits are by definition related to positive social interactions that involve different emotional experiences and behavioral displays than those involved in problem solving or conflictual interactions. We have previously noted (Blanchard et al., 1994; Llerena et al., 2012) that individuals high in social anhedonia may have skills deficits that are specific to affiliative interactions.
A final issue in the interpretation of existing findings centers on the subjective response to affiliative interactions in schizophrenia. As suggested by Bowie et al. (2010), negative symptoms may impact the probability of employing social skills in the community rather than the skills themselves. The choice to engage in affiliative behavior may in part be derived from the individual's expectation or experience of pleasure or reward from the social encounter. Laboratory evocative studies would suggest that hedonic responding is intact in schizophrenia (Cohen and Minor, 2010; Kring and Caponigro, 2010; Kring and Elis, 2013). However, caution is appropriate in extrapolating from these laboratory studies to affiliative interactions. When assessing deficits in emotional experience in schizophrenia, mood-induction laboratory studies have generally relied on stimuli that lack a social affiliative component, such as film clips, picture slides, or flavored drinks (Cohen and Minor, 2010). Beyond changes in positive affect, it would be informative to examine how negative symptoms are related to other subjective responses that relate to the likelihood of affiliation including positive appraisals of the interaction partner (e.g., trusting or liking the partner) or willingness to interact with the partner in the future. We are not aware of any studies that have directly examined subjective responses to standardized affiliative skill assessments in schizophrenia to determine if negative symptoms might contribute to deficits in affiliative subjective responding.
In order to better examine affiliative social skills, we recently developed a novel task that involves a highly affiliative interaction partner presented on video (Llerena et al., 2012). Participants are asked to respond to the video as they would in a real social interaction. Initial results indicate that this task is sensitive to individual differences in social anhedonia within a nonclinical sample (Llerena et al., 2012). Specifically, compared to controls, individuals with elevated social anhedonia were less skilled in this affiliative task, reported less change in positive affect, had less positive reactions to the interaction partner, and were less willing to engage in future hypothetical interactions with the partner (Llerena et al., 2012). These findings indicate that anhedonia may manifest in diminished social affiliative skill as well as in altered subjective affiliative reactions. It remains to be determined if these findings from a nonclinical sample can be replicated in individuals with schizophrenia with elevated negative symptoms.
The aims of the current study are three-fold. First, we sought to examine performance-based social affiliative skill in individuals with schizophrenia using a novel video task (Llerena et al., 2012). We hypothesized that individuals with schizophrenia would demonstrate poorer social affiliative skill as compared to controls. Second, we examined the association between deficits in affiliative skills and clinician-rated negative symptoms and self-reported social anhedonia in schizophrenia. We hypothesized that greater of negative symptoms would be associated with poorer affiliative social skills. We also explored whether the two domains of negative symptoms (motivation and pleasure, expression) would be differentially associated with social skill. Relatedly, we expected that this association between negative symptoms and affiliative skill would be independent of functional (non-social) skills impairment and depressive symptoms. Finally, we examined subjective affiliative responding related to the partner in the affiliation video task. We hypothesized that, given their focus on experiential deficits, greater negative symptoms of motivation and pleasure would be associated with less change in positive affect during the role play and less affiliative reactions to the interaction partner.
Methods
Participants
The sample consisted of 48 individuals with schizophrenia or schizoaffective disorder and 29 nonpsychiatric controls. Participants with schizophrenia were recruited from outpatient mental health clinics affiliated with a division of community psychiatry at a public university (92% of the sample) and a Veterans Administration Medical Center (8%). Participants with schizophrenia were identified by either chart review or referral by a mental health clinician and met the following inclusion criteria: (1) diagnosis of schizophrenia or schizoaffective disorder based on SCID interview; (2) 18-64 years of age; (3) ability to read; and (4) willingness to provide consent. Exclusion criteria for participants with schizophrenia were: (1) DSM-IV diagnosis of any Axis I psychiatric disorder other than schizophrenia or schizoaffective disorder; (2) DSM-IV diagnosis of alcohol or drug dependence in the last 6 months or DSM-IV diagnosis of alcohol or drug abuse in the last month; (3) history of significant head injury, defined as a head injury followed by loss of consciousness for more than 1 hour, recurring seizures, clear cognitive sequelae, and/or need for cognitive rehabilitation; (4) history of neurological disease such as Parkinson's, multiple sclerosis, seizure disorder, stroke; (5) intellectual disability as indicated by clinical chart review; (6) inability to provide informed consent; or (7) inability to participate due to intoxication or escalation of psychiatric symptoms at the time of assessment resulting in disruptive or aggressive behavior. Other than diagnosis, all inclusion and exclusion criteria were evaluated via a review of the individual's clinic record.
Control participants were recruited via flyers advertised in several buildings around the investigators’ research offices and via word of mouth from control participants once their participation was completed. Inclusion criteria for control participants were age 18-64 years and willingness to participate. Control participants were screened with the SCID and excluded if they met criteria for any DSM-IV Axis I psychiatric disorder, a DSM-IV diagnosis of alcohol or drug dependence in the last 6 months, or a DSM-IV diagnosis of alcohol or drug abuse in the last month. Additional exclusion criteria for control participants included history of significant head injury, neurological disease, and mental retardation as outlined above and determined via self-report. Personality disorders were not assessed.
Procedures
All study procedures were approved by the University of Maryland Institutional Review Board. All participants completed a standardized informed consent process with trained recruiters. Following consent, participants completed assessments during one four-hour appointment or two two-hour appointments with ample opportunity for breaks. Assessments were conducted by interviewers who completed extensive training for all measures (e.g., attended training workshops, rated training videos of clinical interviews to achieve a required reliability standard with gold standard ratings, were observed administering interviews prior to performing study assessments) and received regular supervision to review videotaped assessments to discuss administration and scoring. Assessors were not blind to condition (schizophrenia versus control).
All participants received study measures in the same order. Final eligibility was determined following administration of the SCID. Videotaped social affiliation tasks (see below for a complete description) were rated for indicators of social skills. These skill ratings were made by two raters who did not administer assessments to participants. This ensured that raters did not have any contact with the participants before rating their videotaped interactions and so were blind to participants’ diagnostic status and responses on the symptom, functioning, and emotional responding measures.
Measures
Diagnostic and Symptom Measures
The Structured Clinical Interview for DSM-IV (SCID-I; First et al., 2001) was used to establish diagnoses. Interviews were completed by master's level assessors who were extensively trained, had achieved reliable ratings, and completed bi-monthly supervision of study interview videotapes to prevent rater drift. The Clinical Assessment Interview for Negative Symptoms (CAINS; Horan et al., 2011; Kring et al., 2013) is a 13-item semi-structured interview that evaluates two factors of negative symptoms in schizophrenia, Expression (EXP; 4 items) and Motivation and Pleasure (MAP; 9 items). The two scales have good internal consistency, test-retest reliability, inter-rater reliability, convergent validity, and discriminant validity (Kring et al., 2013). Rater agreement was not directly assessed in the current study; however, the two clinical raters were trained and regularly supervised by one of the developers of the CAINS (JJB). To complement interview-assessed symptoms of motivation and pleasure, an abbreviated 17-item version of the social anhedonia scale was used to obtain self-reported levels of social anhedonia (Reiss et al., 2011). The Brief Psychiatric Rating Scale (BPRS; Overall and Gorham, 1962; Ventura et al., 1993) is a 24-item clinician-rated measure that assesses clinical psychiatric symptomatology experienced over the past week. Following the factor structure supported by Kopelowicz et al. (2008), four subscale scores (Positive Symptoms, Agitation/Mania, Negative Symptoms, Depression/Anxiety) were computed. The Calgary Depression Scale for Schizophrenia (CDSS; Addington et al., 1990) is a 9-item semi-structured interview designed to assess depressive symptoms in individuals with schizophrenia distinct from positive, negative, and extrapyramidal symptoms. The CDSS total score was used in all analyses.
Adaptive instrumental skills
The UCSD Performance-Based Skills Assessment—Brief Version (UPSA-B; Mausbach et al., 2007) is a brief assessment of functional capacity related to basic life skills in individuals with serious mental illness. In the UPSA-B, participants are instructed to role play tasks related to every day functioning, specifically in the domains of finances and communication. A total score for the UPSA-B (combining scores on communication and finances) was used in analyses.
Community functioning
The Role Functioning Scale (RFS; Goodman et al., 1993) assesses functioning in the real world in the domains of Working Productivity, Independent Living/Self-Care, Family Network Relationships, and Immediate Social Network Relationships. Each domain is rated from 1 (a very minimal level of role functioning) to 7 (an optimal level of role functioning).
Affiliative social skills
We utilized a video social affiliation interaction task to assess performance-based affiliative social skills (Llerena et al., 2012). In this simulated social affiliative interaction, participants viewed a video of a socially affiliative individual and were instructed to respond at the end of the video as they would if they were meeting the individual in person. In order to maximize the detection of individual differences in the desire to affiliate, there was no time limit imposed on the participant's response and the task was completed when the participant indicated that they were done responding (M = 97.69 seconds; SD = 88.78). This task has been shown to be sensitive to individual differences in affiliation such that compared to controls, individuals with elevated social anhedonia are rated as less skilled, report less change in positive affect, have less positive reactions to the interaction partner, and are less willing to engage in future hypothetical interactions with the partner (Llerena et al., 2012). The use of the affiliative video in the current study differed from Llerena et al. (2012) in that participants in the current study understood that this was a role play in response to a video (the Llerena et al. study utilized deception to lead individuals to believe that they were interacting with another person via video link when in actuality this was a video tape). The clip, which lasted 2 minutes 43 seconds, featured a friendly, attractive, and outgoing female who discussed her social relationships and activities she enjoyed with others. In order to enhance the relatability of the interaction across diverse samples, the script used in the video was designed to avoid gender or age specific topics and instead referred to broad social activities and reactions (visiting and talking with friends and family, meeting new people, and enjoyment and support derived from these relationships and interactions). As the video clip ended, the video confederate asked participants what they like to do with friends and family, at which point the video concluded and the participants were instructed to respond. Participants’ entire responses to the video were videotaped for later behavioral rating. Raters used the social skills manual developed by Llerena et al. (2012), which is similar to behavioral rating procedures used in previous social interaction studies (e.g., Penn et al., 1994). Please see Llerena et al. (2012) for more information on the specific skill domains assessed. Social skill was rated based on four components (verbal, nonverbal, affiliation, and overall social skill) in response to the social affiliation interaction task. Items were rated on a 5-point scale from 1 (“very poor”) to 5 (“very good”), with higher scores indicating greater skill. Ratings were made by graduate level raters who were blind to group status and participants’ scores on symptom, functioning, and self-report measures. Trained raters were used who previously (Llerena et al., 2012) demonstrated high rater agreement across the skill components assessed (range of intra-class correlations .87 to .93).
Subjective Responding
Before and after completing the social affiliation video task, participants self-reported on mood using 14 adjectives assess positive affect (happy, delighted, glad, cheerful, pleased, warmhearted, friendly) and negative affect (lonely, miserable, sad, grouchy, gloomy, blue, unhappy). The Willingness to Interact Scale (WILL; Coyne, 1976) is a 6-item assessment of willingness to engage in interactions with a specified target individual. In this study, participants were asked about their desire to have future contacts with the individual from the social affiliation video task (e.g., “How willing would you be to invite your partner to a social event?”). Items are rated on a 5-point scale from 1 (“definitely willing”) to 5 (“definitely unwilling”) and reverse-scored, with higher scores indicating more willingness to engage in future interactions with the target individual. Internal consistency, Cronbach's alpha, in the current study was high (α = .91)
The Positive Reactions to Partner (PRP) scale is an 8-item measure that assesses participants’ subjective responses to a specified target individual. The PRP was developed by Llerena et al. (2012) to assess affiliative reactions of participants in response to the video affiliation task. Items are rated on a 5-point scale from 1 (“completely agree”) to 5 (“completely disagree”) and include, “I liked talking to my partner” and “My partner seemed like a warm, caring person.” Items are reverse-coded, with higher scores reflecting more positive responses toward the target individual. Internal consistency in the current study was adequate (α = .70).
Cognitive Functioning
The Brief Cognitive Assessment Tool (BCAT; Mansbach et al., 2012) measures global cognitive function with the trail making test B, category fluency test, and digit symbol test.
Data Analysis
Characteristics of the sample and group differences in demographic characteristics were examined using chi-squared analyses and t-tests. Group comparisons in measures of community functioning, instrumental skills, and social affiliative skill were conducted with one-way analysis of variance (ANOVA), t-tests, and repeated measures ANOVA. Self-report differences in affective responding and reactions to the affiliative partner were then explored in between-group analyses. Finally, associations among negative symptoms, instrumental and social skill, and subjective responding to the video affiliative interaction were examined with correlations within the schizophrenia group.
Results
Characteristics of the Sample
Demographic and clinical characteristics of the sample are displayed in Table 1. Individuals with schizophrenia (n = 48) and controls (n = 29) did not differ in gender (X2 = 2.54, p = .11), race (X2 = 6.06, p = .10), or age, t(75) = 1.55, p = .13. However, compared to controls, patients did have fewer years of education, t(74) = 5.69, p < .05. The groups differed in cognitive ability with patients displaying poorer performance on Category Fluency, t(74) = −3.40, p < .01, Digit Symbol Coding, t(72) = −2.60, p < 0.05, and Trails B, t(70) = 6.78, p < 0.001 (note that ns for the schizophrenia group ranged from 43-47 as not all participants completed each cognitive task).
Table 1.
Schizophrenia (n = 48) | Control (n = 29) | |
---|---|---|
Percentage male | 67% | 48.3% |
Age | 47.98 (7.85) | 44.31 (12.99) |
Education | 11.04 (2.25) | 13.86 (3.00) |
Race, n (%) | ||
White | 4 (8. 3%) | 7 (24 .1%) |
African American | 43 (89.6%) | 21 (72.4%) |
American Indian or Alaskan Native | 1 (2.1%) | 0 (0%) |
Multiple racial backgrounds | 0 (0%) | 1 (3.4%) |
BCAT | ||
Digit Symbol Coding | 5.61 (6.00) | 8.82 (3.27) |
Category Fluency | 39.13 (8.66) | 46.59 (10.25) |
Trails B | 161.70 (61.56) | 76.55 (33.81) |
Social Anhedonia Scale | 6.10 (3.95) | 2.38 (2.13) |
Symptoms | ||
CAINS - MAP | 11.19 (6.21) | |
CAINS - EXP | 6.29 (4.03) | |
CDSS | 2.90 (3.27) | |
BPRS, Positive Symptoms | 11.73 (5.98) |
BCAT = Brief Cognitive Assessment Tool; CAINS = Clinical Assessment Interview for Negative Symptoms; MAP = Motivation and pleasure score; EXP = Expression score; CDSS = Calgary Depression Scale for Schizophrenia total score; BPRS = Brief Psychiatric Rating Scale
Community Functioning and Skill Assessments
Community functioning, instrumental skills, and affiliative skill measures are shown in Table 2. Compared to controls, individuals with schizophrenia demonstrated overall poorer community functioning as measured by the RFS subscores, F(4,72) = 25.04, p < .001, with significant group differences in each of the four domains (all ps < .01). Patients were rated as having lower instrumental skills on the UPSA, t(75) = −4.76, p < .001.
Table 2.
Schizophrenia | Control | |
---|---|---|
Community Functioning (RFS) | ||
Working Productivity | 2.85 (2.10) | 6.72 (1.13) |
Independent Living/Self-Care | 5.73 (1.50) | 7.00 (0.00) |
Family Network Relationships | 5.71 (1.86) | 6.69 (0.97) |
Immediate Social Network | 4.94 (2.28) | 6.72 (0.84) |
Functional Capacity | ||
UPSA-B | 65.63 (17.40) | 83.79 (14.03) |
Affiliative Role Play Behavioral Ratings | ||
Nonverbal skill | 2.88 (1.23) | 4.10 (0.98) |
Verbal Skill | 3.02 (1.11) | 4.03 (0.98) |
Affiliation | 2.38 (1.18) | 3.93 (0.99) |
Overall Social Skill | 2.73 (1.09) | 4.07 (0.88) |
Affiliative Role Play Self-Report | ||
Willingness to Interact | 24.23 (6.61) | 21.67 (6.07) |
Positive Reactions to Partner | 32.89 (6.30) | 31.21 (5.47) |
Positive Affect (Pre-Role Play) | 24.94 (6.48) | 26.07 (5.52) |
Positive Affect (Post-Role Play) | 26.62 (7.30) | 26.64 (6.00) |
Negative Affect (Pre-Role Play) | 10.44 (4.15) | 8.69 (4.35) |
Negative Affect (Post-Role Play) | 9.40 (3.81) | 8.31(3.42) |
RFS = The Role Functioning Scale; UPSA-B = UCSD Performance-Based Skills Assessment-Brief.
In terms of behavioral affiliative social skills, compared to controls, individuals with schizophrenia were rated as having poorer verbal and nonverbal skills, ts(75) = −4.57, −4.03, ps < .001, respectively; poorer affiliative skill, t(75) = −5.93, p < .001; and lower overall social skill, t(75) = −5.61, p < .001. With regard to subjective self-reported reactions to the affiliative video, there were no group differences in either willingness to interact, t(75) = 1.20, p > .05 or positive appraisals of the interaction partner, t(73) = 1.66, p >. 05.
Self-reported mood associated with the affiliative role play was examined with Group x Time (pre- and post-role play) repeated measure ANOVAs. For positive affect, there was a significant main effect of time, F(1,74) = 4.17, p = .045 with marginal means showing that participants reported higher positive affect after the social interaction (M = 26.33, SE = 0.81) compared to baseline (M = 25.474, SE = 0.73). There was no main effect of group, F(1,77) = 0.14, p = 0.71 and the Group × Time interaction was not significant, F(1,77) = 0.84, p = .36. Similarly, a two-way repeated measure ANOVA examining change in self-reported negative affect indicated that there was a significant main effect of time, F(1,75) = 4.78, p = 0.03, with marginal means showing that participants reported less negative affect after the social interaction (M = 8.85, SE = 0.43) compared to baseline (M = 9.56, SE = 0.50). There was no main effect of group, F(1,75) = 2.64, p = 0.11 and the Group × Time interaction was not significant, F(1,75) = 1.04, p = 0.31.
Symptom correlates of social skill and subjective responding in schizophrenia
Table 3 presents correlations between negative symptoms, self-reported social anhedonia, social skill, and subjective responding in individuals with schizophrenia. In order to minimize the number of correlations we focused on the overall rating of social skill as this behavioral rating was highly correlated with the other social skill ratings (range of rs in the full sample = .84 to .91, ps < .001). CAINS MAP symptoms were significantly correlated with instrumental skills on the UPSA-B (r = −.28, p < .05) but CAINS EXP symptoms were not (r = −.12). With regard to overall social skill both MAP (r = −.38, p < .01) and EXP (r = −.30, p < .01) negative symptoms were correlated with skill such that greater negative symptoms were related to poorer social skill ratings. Controlling for EXP, MAP negative symptoms remained significantly associated with social skills (pr = −.32, p = .03); however, when controlling for MAP symptoms, EXP was no longer associated with social skills (pr = −.19, p = .18). Given that CDSS depression was associated with poorer social skills (r = −.31, p = .033), we controlled for depression and found no impact on the association between e social skill and MAP (pr = −.33, p = .024) or EXP (pr = −.34, p = .021). Positive symptom severity was not related to social skill (r = −.01).
Table 3.
Measure | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 |
---|---|---|---|---|---|---|---|---|---|---|
1. CAINS-MAP | --- | |||||||||
2. CAINS-Expression | .32* | --- | ||||||||
3. SocAnh Scale | .43** | −.07 | --- | |||||||
4. UPSA-B | −.28* | −.12 | −.27† | --- | ||||||
5. Social Skill | −.38** | −.30* | −.06 | .03 | --- | |||||
6. Reactions to Partner | −.42** | .06 | −.40** | .01 | .32* | --- | ||||
7. Willing to Interact | −.24 | .13 | −.33* | .13 | .08 | .69** | --- | |||
8. PA pre-role play | −.42** | −.33* | −.26 | .26 | .41** | .36* | .23 | --- | ||
9. PA post-role play | −.40** | −.25 | −.22 | .18 | .40** | .49** | .41** | .69** | --- | |
10. NA pre-role play | .13 | −.16 | −.01 | −.05 | −.15 | −.19 | −.07 | −.11 | −.07 | --- |
11. NA post-role play | .22 | −.03 | .16 | −.01 | −.11 | −.13 | −.17 | −.01 | −.19 | .67** |
CAINS = Clinical Assessment Interview for Negative Symptoms; MAP = Motivation and pleasure score; EXP = Expression score; SocAnh = Social Anhedonia; UPSA-B = UCSD Performance-Based Skills Assessment-Brief; PA = positive affect; NA = Negative Affect.
p <.06
p < .05
p < .01
In order to determine if social affiliative deficits were uniquely associated with MAP negative symptoms, independent of other (instrumental) skills deficits, we computed partial correlations controlling for UPSA-B performance and found that social skills remained significantly associated with MAP symptoms and the magnitude of the association was unaltered (pr = −.39, p = .007). To examine the combined contribution of instrumental and social skills to experiential negative symptoms a regression analysis was conducted with these two skills measures predicting severity of MAP symptoms. The regression was significant, F(2,47) = 6.30, p = .004, with both instrumental (β = −.27, p = .048) and social skills (β = −.38, p = .007) contributing to the model that accounted for 22% of the variance in MAP severity.
In examining correlates of self-reported subjective responding to the affiliative role play, more severe MAP negative symptoms, but not EXP negative symptoms, were related to less positive appraisals of the interaction partner (r = −.42, p < .01). Neither negative symptom scale was correlated with self-reported willingness to interact with the partner. However, greater self-reported anhedonia on the Social Anhedonia Scale was significantly related to less positive appraisals of the partner (r = −.40, p < .01) and less willingness to interact with the partner (r = −.33, p < .05).
Looking at affective responding, more severe MAP negative symptoms were significantly associated with less positive affect both before (r = −0.42, p < .01) and after (r = −0.40, p < .01) the affiliative interaction. More severe EXP negative symptoms were related to lower positive affect before the role play (r = −.33, p < .05) but this association was weaker and nonsignificant for post-interaction positive affect (r = −.25). Neither MAP nor EXP negative symptoms were significantly correlated with reports of negative affect before or after the affiliative interaction.
Discussion
The present study sought to understand the nature of affiliative deficits in both behavior and subjective responding, and their association with negative symptoms in individuals with schizophrenia. We utilized a novel social affiliation video task (Llerena et al., 2012) and assessed the two major domains characterizing negative symptoms, namely motivation and pleasure (MAP) symptoms and expressive (EXP) negative symptoms (Kring et al., 2013). Compared to controls, individuals with schizophrenia were rated as having poorer verbal and nonverbal skills, poorer affiliative skill, and lower overall social skill. This supports our first hypothesis that individuals with schizophrenia would demonstrate impairments in behaviors necessary to successfully engage in affiliative social interactions with others and replicates prior findings (e.g., Liberman et al., 1986; Mueser et al., 1990; Mueser et al., 2010) of social skill impairments in schizophrenia.
Interestingly, while individuals with schizophrenia were rated as having poorer affiliative social skill compared to controls, they reported similar positive appraisals of their interaction partner and there were no group differences in the self-reported willingness to engage in future interactions. Further, in examining self-reported positive and negative affect, while there was a main effect of time (increased positive and decreased negative affect after the interaction), there was no main effect of group and no interaction. Individuals with schizophrenia were similar to controls in terms of their self-reported affective response to an affiliative interaction. These results extend prior findings showing that, at the group-level, affective responding to evocative stimuli in schizophrenia is largely intact (Cohen and Minor, 2010; Kring and Caponigro, 2010; Kring and Elis, 2013). Further, our results show that while individuals with schizophrenia may perform more poorly than controls, their positive appraisals of an interaction partner and their desire to interact are comparable to controls.
We hypothesized that individual differences in behavior and subjective responding within the schizophrenia group would be associated with the severity of clinician-rated negative symptoms and self-reported social anhedonia. Use of the CAINS (Horan et al., 2011; Kring et al., 2013) allowed us to examine the differential contribution of MAP and EXP negative symptoms to affiliative skills and instrumental skills deficits. Peformance-based affiliative skill was most strongly associated with experiential negative symptoms. Instrumental skill (assessed with the UPSA) was also related to motivation and pleasure symptoms. This latter correlation is not consistent with Kring et al.'s (2013) finding of no relation between the UPSA and CAINS-rated negative symptoms but the current result does converge with prior reports showing that UPSA performance is related to more severe negative symptoms (e.g., Cardenas et al., 2013; but see Green et al., 2012). The association between motivation and pleasure negative symptoms and and impairment in affiliative social skill, was largely independent of instrumental (UPSA-rated) skills and depressive or positive symptoms. Together, affiliative social skill and instrumental skill accounted for a combined 22% of the variance in MAP severity. Overall our findings extend prior results (Mueser et al., 1990; Bellack et al., 1990; Addington and Addington, 1999; Couture et al., 2011; Robertson et al., 2014) and indicate that negative symptoms can influence the ability to perform affiliative social skills (and not just the probability of using these skills in the community). This is inconsistent with other studies (Mueser et al., 1991; Blanchard et al., 1994; Bowie et al., 2010) that have failed to show such a link between negative symptoms and social skill in schizophrenia. The reasons for such variable findings are unclear and may relate to sample differences or characteristics of the skill assessments such as the current study's focus on an affiliative social interaction.
With regard to negative symptoms and positive affective responding to the affiliative interaction, our hypothesis was only partially confirmed. While more severe negative symptoms were associated with less positive affect this was evident across both baseline and following the affiliative interaction. Thus, MAP symptoms were related to a broad general diminution of positive affect and not just altered reactivity to the social encounter. This would appear consistent with prior findings that negative symptoms are associated with trait measures of positive affect (Horan and Blanchard, 2003; Blanchard et al., 1998). These results were specific to positive affect, as neither MAP nor EXP negative symptoms were related to self-reported negative affect within the affiliative role play.
Beyond affective responding, negative symptoms and self-reported anhedonia were associated with how individuals with schizophrenia appraised their interaction partner and their willingness to interact with the partner in the future. More severe MAP negative symptoms (but not EXP) and self-reported social anhedonia were associated with less positive appraisals of the interaction partner. Although clinician rated negative symptoms were not related to willingness to interact with the partner in the future, greater self-reported social anhedonia was associated with less willingness to interact. These results indicate that MAP negative symptoms are related to less positive appraisals of social partners and social anhedonia is related to less willingness to interact with potential social partners – both of which could presumably contribute to the diminished likelihood of actually engaging in social affiliative interactions. It would be informative to explore the factors that contribute to the relationship between negative symptoms and these social appraisals and willingness to interact. For example, behavioral skill impairments and lower positive affect in the interaction appear to, in part, contribute to the diminished positive appraisals as evident in our correlational findings. It may also be that other factors could play a role such as internalized-stigma (Corrigan et al., 2005; Park et al., 2013), dysfunctional attitudes (Couture et al., 2011; Grant and Beck, 2009; Rector et al., 2005), or the diminished anticipation of future pleasure (Gard et al., 2007) could play a role in how affiliative social partners and the potential for interaction are viewed.
This study had several limitations. The sample was comprised of mostly male African-Americans, and caution should be used in generalizing these results to women and individuals from other racial or ethnic groups. Relatedly, the affiliative interaction video featured a young adult, Caucasian female and it is unclear how age, gender or race of the interaction partner may contribute to the responding of participants (e.g., Shelton, 2003). Future studies may consider how behavioral skills and subjective responding differ in response to demographic characteristics of the affiliative partner. The current study did not include a social skills assessment using non-affiliative (e.g., problem-solving, conflict-oriented) social interactions. Thus we are not able to conclude that our current results show that affiliative assessments provide unique relations that might not be found in these other interactions. However, the current results using an affiliative skills assessment differ from recent studies that have failed to find an association between negative symptoms and other social skill assessments (Mueser et al., 1991; Blanchard et al., 1994; Bowie et al., 2010). Another limitation is that we utilized a video-based interaction to assess skill which does not require turn-taking and responding to ongoing and shifting reactions from an interaction partner. The advantage of the current approach is that it provides for a standardized social stimulus that is held constant across participants; however, this limits a full assessment of skills deficits that may be evident in live dyadic interactions. The current study is correlational and it is not possible to determine the direction of causal relations. For example, skill deficits may give rise to social avolition and anhedonia secondary to failed social interactions or the lack of pleasure and motivation for social interactions may lead to less skillful social affiliative behavior. Finally, this study conducted a number of correlational analyses to examine the proposed hypotheses – caution is warranted in the interpretation of the findings based on the number of correlations computed.
Despite these limitations, these results have several implications. These findings illustrate that individuals with schizophrenia and who have low negative symptoms may have a desire to interact and affiliate with others but many will lack the skills to do so successfully. Importantly, more severe negative symptoms are associated with both poorer affiliative skills and altered subjective responding to affiliative interactions that may discourage the initiation of affiliative social interactions. Such findings suggest that clinical interventions focused on improving social affiliative behavioral skills in this population may be indicated and that, for those with motivation and pleasure-related negative symptoms, additional intervention may be needed to target cognitive appraisals of social interaction partners. The fact that the impact of negative symptoms on affiliative social skill was found independent of functional skills or symptoms of depression suggests that skills training focusing on instrumental behavior or interventions that improve non-negative symptoms will not likely yield improvements in affiliative skill.
Acknowledgments
The authors wish to acknowledge Dr. Katiah Llerena and Ms. Asia Malik for their assistance in data collection and behavioral ratings
Role of funding sources.
This work was supported in part by the National Institutes of Health grant 1R01MH082839 (JJB); the VA Capitol Health Care Network (VISN 5) Mental Illness Research, Education, and Clinical Center (MEB); and the Department of Veterans Affairs, Office of Academic Affiliations, Advanced Fellowship Program in Mental Illness Research and Treatment (SGP). The contents do not necessarily represent the views of the VA or of the U.S. government. Funding sources had no role in study design or in the collection, analysis and interpretation of data, or in the writing of this report.
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
Contributors
Drs. Blanchard and Park contributed to the study design, data collection, data analysis, interpretation of data analysis, and writing of this report. Dr. Bennett and Ms. Catalano contributed to interpretation of data analysis and writing of this report.
Conflict of Interest
The authors report no conflicts of interest.
References
- Addington J, Addington D. Neurocognitive and social functioning in schizophrenia. Schizophr. Bull. 1999;25(1):173–182. doi: 10.1093/oxfordjournals.schbul.a033363. [DOI] [PubMed] [Google Scholar]
- Addington D, Addington J, Schissel B. A depression rating scale for schizophrenics. Schizophr. Res. 1990;3(4):247–251. doi: 10.1016/0920-9964(90)90005-r. [DOI] [PubMed] [Google Scholar]
- Bellack AS, Morrison RL, Wixted JT, Mueser KT. An analysis of social competence in schizophrenia. Br. J. Psychiatry. 1990;156:809–818. doi: 10.1192/bjp.156.6.809. [DOI] [PubMed] [Google Scholar]
- Bellack AS, Sayers M, Mueser KT, Bennett M. Evaluation of social problem solving in schizophrenia. J. Abnorm. Psychol. 1994;103(2):371–378. doi: 10.1037//0021-843x.103.2.371. [DOI] [PubMed] [Google Scholar]
- Blanchard JJ, Bellack AS, Mueser KT. Affective and social-behavioral correlates of physical and social anhedonia in schizophrenia. J. Abnorm. Psychol. 1994;103(4):719–728. doi: 10.1037//0021-843x.103.4.719. [DOI] [PubMed] [Google Scholar]
- Blanchard JJ, Cohen AS. The structure of negative symptoms within schizophrenia: implications for assessment. Schizophr. Bull. 2006;32(2):238–245. doi: 10.1093/schbul/sbj013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Blanchard JJ, Kring AM, Horan WP, Gur R. Toward the next generation of negative symptom assessments: the collaboration to advance negative symptom assessment in schizophrenia. Schizophr. Bull. 2011;37(2):291–299. doi: 10.1093/schbul/sbq104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Blanchard JJ, Mueser KT, Bellack AS. Anhedonia, positive and negative affect, and social functioning in schizophrenia. Schizophr. Bull. 1998;24(3):413–424. doi: 10.1093/oxfordjournals.schbul.a033336. [DOI] [PubMed] [Google Scholar]
- Bowie CR, Depp C, McGrath JA, Wolyniec P, Mausbach BT, Thornquist MH, Pulver AE. Prediction of real-world functional disability in chronic mental disorders: a comparison of schizophrenia and bipolar disorder. Am. J. Psychiatry. 2010;167(9):1116–1124. doi: 10.1176/appi.ajp.2010.09101406. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Buchanan RW. Persistent negative symptoms in schizophrenia: an overview. Schizophr. Bull. 2007;33(4):1013–1022. doi: 10.1093/schbul/sbl057. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cardenas V, Abel S, Bowie CR, Tiznado D, Depp CA, Patterson TL, Jeste DV, Mausbach BT. When functional capacity and real-world functioning converge: The role of self-efficacy. Schizophr. Bull. 2013;39(4):908–916. doi: 10.1093/schbul/sbs004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cohen AS, Minor KS. Emotional experience in patients with schizophrenia revisited: meta-analysis of laboratory studies. Schizophr. Bull. 2010;36(1):143–150. doi: 10.1093/schbul/sbn061. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Corrigan P, Kerr A, Knudsen L. The stigma of mental illness: explanatory models and methods for change. Appl. Prev. Psychol. 2005;11(3):179–190. [Google Scholar]
- Couture SM, Blanchard JJ, Bennett ME. Negative expectancy appraisals and defeatist performance beliefs and negative symptoms of schizophrenia. Psychiatry. Res. 2011;189(1):43–48. doi: 10.1016/j.psychres.2011.05.032. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Couture SM, Granholm EL, Fish SC. A path model investigation of neurocognition, theory of mind, social competence, negative symptoms and real-world functioning in schizophrenia. Schizophr. Res. 2011;125(2-3):152–160. doi: 10.1016/j.schres.2010.09.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Coyne JC. Depression and the response of others. J. Abnorm. Psychol. 1976;85(2):186–193. doi: 10.1037//0021-843x.85.2.186. [DOI] [PubMed] [Google Scholar]
- First MB, Spitzer RL, Gibbon M, Williams JBW. Structured Clinical Interview for DSM-IV-TR Axis I Disorders – Patient Edition – (SCID-I/P, February 2001 Revision) Biometrics Research Department; New York: 2001. [Google Scholar]
- Gard DE, Kring AM, Gard MG, Horan WP, Green MF. Anhedonia in schizophrenia: distinctions between anticipatory and consummatory pleasure. Schizophr. Res. 2007;93(1-3):253–260. doi: 10.1016/j.schres.2007.03.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Goodman SH, Sewell DR, Cooley EL, Leavitt N. Assessing levels of adaptive functioning: the Role Functioning Scale. Comm. Mental. Health. J. 1993;29(2):119–131. doi: 10.1007/BF00756338. [DOI] [PubMed] [Google Scholar]
- Granholm E, Holden J, Link P, McQuaid J. Randomized clinical trial of cognitive behavioral social skills training for schizophrenia: Improvement in functioning and experiential negative symptoms. J. Consulting and Clinical Psych. 2014;82(6):1173–1185. doi: 10.1037/a0037098. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grant PM, Beck AT. Defeatist beliefs as a mediator of cognitive impairment, negative symptoms, and functioning in schizophrenia. Schizophr. Bull. 2009;35(4):798–806. doi: 10.1093/schbul/sbn008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Green MF, Hellemann G, Horan WP, Lee J, Wynn JK. From perception to functional outcome in schizophrenia: Modeling the role of ability and motivation. Arch. Gen. Psych. 2012;69(12):1216–1224. doi: 10.1001/archgenpsychiatry.2012.652. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Herbener ES, Harrow M. Are negative symptoms associated with functioning deficits in both schizophrenia and nonschizophrenia patients? A 10-year longitudinal analysis. Schizophr. Bull. 2004;30(4):813–825. doi: 10.1093/oxfordjournals.schbul.a007134. [DOI] [PubMed] [Google Scholar]
- Horan WP, Blanchard JJ. Emotional responses to psychosocial stress in schizophrenia: the role of individual differences in affective traits and coping. Schizophr. Res. 2003;60(2-3):271–283. doi: 10.1016/s0920-9964(02)00227-x. [DOI] [PubMed] [Google Scholar]
- Horan WP, Kring AM, Gur RE, Reise SP, Blanchard JJ. Development and psychometric validation of the Clinical Assessment Interview for Negative Symptoms (CAINS). Schizophr. Res. 2011;132(2-3):140–145. doi: 10.1016/j.schres.2011.06.030. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kopelowicz A, Ventura J, Liberman RP, Mintz J. Consistency of Brief Psychiatric Rating Scale factor structure across a broad spectrum of schizophrenia patients. Psychopathology. 2008;41(2):77–84. doi: 10.1159/000111551. [DOI] [PubMed] [Google Scholar]
- Kring AM, Caponigro JM. Emotion in schizophrenia: where feeling meets thinking. Curr. Dir. Psychol. Sci. 2010;19(4):255–259. doi: 10.1177/0963721410377599. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kring AM, Elis O. Emotion deficits in people with schizophrenia. Annu. Rev. Clin. Psychol. 2013;9:409–433. doi: 10.1146/annurev-clinpsy-050212-185538. [DOI] [PubMed] [Google Scholar]
- Kring AM, Gur RE, Blanchard JJ, Horan WP, Reise SP. The Clinical Assessment Interview for Negative Symptoms (CAINS): final development and validation. Am. J. Psychiatry. 170(2):165–172. doi: 10.1176/appi.ajp.2012.12010109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Liberman RP, Mueser KT, Wallace CJ. Social skills training for schizophrenic individuals at risk for relapse. Am. J. Psychiatry. 1986;143(4):523–526. doi: 10.1176/ajp.143.4.523. [DOI] [PubMed] [Google Scholar]
- Llerena K, Park SG, Couture SM, Blanchard JJ. Social anhedonia and affiliation: examining behavior and subjective reactions within a social interaction. Psychiatry. Res. 2012;200(2-3):679–686. doi: 10.1016/j.psychres.2012.07.050. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kurtz M, Mueser K, Thime W, Corbera S, Wexler B. Social skills training and computer-assisted cognitive remediation in schizophrenia. Schizophr. Res. 2015;162(1-3):35–41. doi: 10.1016/j.schres.2015.01.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mansbach WE, MacDougall EE, Rosenzweig AS. The Brief Cognitive Assessment Tool (BCAT): a new test emphasizing contextual memory, executive functions, attentional capacity, and the prediction of instrumental activities of daily living. J. Clin. Exp. Neuropsychol. 2012;34(2):183–194. doi: 10.1080/13803395.2011.630649. [DOI] [PubMed] [Google Scholar]
- Mausbach BT, Harvey PD, Goldman SR, Jeste DV, Patterson TL. Development of a brief scale of everyday functioning in persons with serious mental illness. Schizophr. Bull. 2007;33(6):1364–1372. doi: 10.1093/schbul/sbm014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mueser KT, Bellack AS, Morrison RL, Wixted JT. Social competence in schizophrenia: premorbid adjustment, social skill, and domains of functioning. J. Psychiatr. Res. 1990;24(1):51–63. doi: 10.1016/0022-3956(90)90024-k. [DOI] [PubMed] [Google Scholar]
- Mueser KT, Douglas MS, Bellack AS, Morrison RL. Assessment of enduring deficit and negative symptom subtypes in schizophrenia. Schizophr. Bull. 1991;17(4):565–582. doi: 10.1093/schbul/17.4.565. [DOI] [PubMed] [Google Scholar]
- Mueser K, Pratt S, Bartels S, Forester B, Wolfe R, Cather C. Neurocognition and social skill in older persons with schizophrenia and major mood disorders: An analysis of gender and diagnosis effects. J. Neurolinguistics. 2010;23(3):297–317. doi: 10.1016/j.jneuroling.2009.08.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- NIMH Research Domain Criteria (RDoC) Social processes: workshop proceedings. Rockville, MD.: Feb 27-28, 2012. [Google Scholar]
- Overall JE, Gorham DR. The brief psychiatric rating scale. Psychol. Rep. 1962;10(3):799–812. [Google Scholar]
- Park SG, Bennett ME, Couture SM, Blanchard JJ. Internalized stigma in schizophrenia: relations with dysfunctional attitudes, symptoms, and quality of life. Psychiatry. Res. 2013;205(1-2):43–47. doi: 10.1016/j.psychres.2012.08.040. [DOI] [PubMed] [Google Scholar]
- Patterson TL, Moscona S, McKibbin CL, Davidson K, Jeste DV. Social skills performance assessment among older patients with schizophrenia. Schizophr. Res. 2001;48(2-3):351–360. doi: 10.1016/s0920-9964(00)00109-2. [DOI] [PubMed] [Google Scholar]
- Penn DL, Hope DA, Spaulding W, Kucera J. Social anxiety in schizophrenia. Schizophr. Res. 1994;11(3):277–284. doi: 10.1016/0920-9964(94)90022-1. [DOI] [PubMed] [Google Scholar]
- Rabinowitz J, Levine SZ, Garibaldi G, Bugarski-Kirola D, Berardo CG, Kapur S. Negative symptoms have greater impact on functioning than positive symptoms in schizophrenia: analysis of CATIE data. Schizophr. Res. 2012;137(1-3):147–150. doi: 10.1016/j.schres.2012.01.015. [DOI] [PubMed] [Google Scholar]
- Rector NA, Beck AT, Stolar N. The negative symptoms of schizophrenia: a cognitive perspective. Can. J. Psychiatry. 2005;50(5):247–257. doi: 10.1177/070674370505000503. [DOI] [PubMed] [Google Scholar]
- Reiss SP, Horan WP, Blanchard JJ. The challenges of fitting an Item Response Theory model to the Social Anhedonia Scale. J. Personal. Assess. 2011;93(3):213–224. doi: 10.1080/00223891.2011.558868. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rocca P, Montemagni C, Zappia S, Pitera R, Sigaudo M, Bogetto F. Negative symptoms and everyday functioning in schizophrenia: a cross-sectional study in a real world-setting. Psychiatry Res. 2014;218(3):284–289. doi: 10.1016/j.psychres.2014.04.018. [DOI] [PubMed] [Google Scholar]
- Robertson BR, Prestia D, Twamley EW, Patterson TL, Bowie CR, Harvey PD. Social competence versus negative symptoms as predictors of real world social functioning in schizophrenia. Schizophr. Res. 2014;160(1-3):136–141. doi: 10.1016/j.schres.2014.10.037. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sayers MD, Bellack AS, Wade JH, Bennett ME, Fong P. An empirical method for assessing social problem solving in schizophrenia. Behav. Modif. 1995;19(3):267–289. doi: 10.1177/01454455950193001. [DOI] [PubMed] [Google Scholar]
- Shelton JN. Interpersonal Concerns in Social Encounters between Majority and Minority Group Members. Group Processes & Intergroup Relations. 2003;6:171–185. [Google Scholar]
- Strauss GP, Hong LE, Gold JM, Buchanan RW, McMahon RP, Keller WR, Kirkpatrick B. Factor structure of the Brief Negative Symptom Scale. Schizophr. Res. 2012;142(1-3):96–98. doi: 10.1016/j.schres.2012.09.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ventura J, Lukoff D, Nuechterlein KH, Liberman RP, Green M, Shaner A. Appendix 1: Brief Psychiatric Rating Scale (BPRS) Expanded Version (4.0) scales, anchor points and administration manual. Int. J. Methods. Psychiatry. Res. 1993;3:227–243. [Google Scholar]