Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2010 Jun 1.
Published in final edited form as: Qual Life Res. 2009 Apr 25;18(5):585–595. doi: 10.1007/s11136-009-9475-1

Measuring Stigma Across Neurological Conditions: The Development of the Stigma Scale for Chronic Illness (SSCI)

Deepa Rao 1,2,3, Seung W Choi 1,3, David Victorson 1,2,3, Rita Bode 4, Amy Peterman 5, Allen Heinemann 3,4,6, David Cella 1,2,3
PMCID: PMC2875076  NIHMSID: NIHMS202563  PMID: 19396572

Abstract

Purpose

Most measures of stigma are illness-specific and do not allow for comparisons across conditions. As part of a study of health-related quality of life for people with neurological disorders, our team developed an instrument to assess the stigma for people with chronic illnesses.

Methods

We based item content on literature review, responses from focus groups, and cognitive interviews. We then administered the items to people with neurological disorders for psychometric testing.

Results

Five hundred and eleven participants completed items of the stigma scale. Exploratory factor analysis produced 2 factors that were highly correlated (r = 0.81). Confirmatory factor analysis produced high standardized loadings on an overall stigma factor (0.68 to 0.94), with poorer loadings on the two sub-domains (−0.12 to 0.53). These results demonstrated a sufficiently unidimensional scale that corresponded with the bifactor model. Item response theory modeling suggested good model fit, and differential item functioning analyses indicated that the 24-item scale showed potential for measurement equivalence across conditions.

Conclusions

Our efforts produced a stigma scale that had promising psychometric properties. Further study can provide additional information about the SSCI and its benefit in measuring the impact of stigma across conditions.

Keywords: Neurological Disorders, Measurement, Chronic Illness, Self Stigma, Enacted Stigma


In 1963, Erving Goffman defined stigma as “the situation of the individual who is disqualified from full social acceptance (Preface)” [1], and since his time, social scientists have studied stigma manifested as stereotypes, prejudice, and discrimination [2]. Public stigma, or a negative attitude held by a community member, has consequences for people with stigmatizing conditions, such as loss of employment or social isolation [3]. These consequences can be exacerbated by six factors: concealability, course, disruptiveness, aesthetic qualities, origin, and peril [4]. Concealability refers to whether the condition is obvious or can be hidden, course refers to the severity and pattern of the condition over time, and disruptiveness refers to the degree of interference with usual patterns of social interaction. The term ‘aesthetic qualities’ refers to how much the condition upsets others by way of the five senses, origin refers to the perceived cause and degree of responsibility a person has for contracting the illness, and finally, peril refers to the amount of fear and danger associated with a person’s illness.

Self stigma, or the internalized cognitive, emotional, and behavioral impact of others’ negative attitudes on a person who possesses a devalued characteristic [5], has been associated with lowered self esteem, depression, anxiety, and decreased service utilization [6, 7]. Corrigan and colleagues described a theoretical model of self stigma as a process by which public attitudes lead to personal responses and ultimately, self stigmatization (Figure 1) [8, 9, 10]. First, a person with a stigmatizing condition experiences discrimination and becomes aware of negative stereotypes around his or her illness. The awareness of the stereotype is sometimes called felt or perceived stigma, and the actual experience of a discriminatory behavior, such as social exclusion, is called enacted stigma [11]. In the final step of the process, the person concurs that negative stereotypes apply to them and then internalizes the stereotype. The internalization is termed self, or internalized stigma, which then has negative consequences for the self (e.g. lowered self esteem).

Figure 1.

Figure 1

The process by which stigma affects the person with an undesired condition.

Researchers have developed measures of stigma associated with a variety of medical and psychological conditions, including mental illness [12, 13], epilepsy [11], and HIV infection [14, 15]. Van Brakel (2006) identified similarities in the experience of health related stigma across conditions and pointed to a lack of psychometrically valid instruments designed to assess stigma across conditions. He recommended the development of a ‘generic’ measure of stigma in order to avoid duplication of effort across disciplines [16, 17].

As part of a larger study of health-related quality of life for people with neurological disorders, we developed an instrument that measures stigma for people across chronic illnesses. The study also developed item banks, scales, and short forms in areas such as cognition, social functioning, and fatigue. This report focuses on the development of the stigma instrument, its preliminary psychometric findings, and its use with a sample of people with neurological disorders. Neurological disorders are typically incurable and produce permanent disabilities that remain stable or progress unpredictably. In addition, individuals with neurological disorders can become dependent on others, need assistive devices to perform daily tasks, and have significant educational and occupational setbacks [18, 19, 20]. Thus, people with neurological disorders experience considerable stigma, and as such, we set out to examine the stigma scale with this population.

Methods

We used a multistep process to develop the stigma scale as part of the “Quality of Life in Neurological Disorders (NeuroQOL)” study. These methods were consistent with the National Institutes of Health Roadmap initiative, the Patient Reported Outcomes Measurement Information System (PROMIS), which prioritizes patient information to guide instrument development [21]. We first conducted focus groups, reviewed the literature, examined items from existing instruments, developed the instrument, conducted cognitive interviews, refined items, and sent the items for psychometric testing.

Focus Groups

Five separate focus groups were conducted with adults diagnosed with Alzheimer’s disease, ALS, Epilepsy, Parkinson’s disease, and Stroke, and two groups were conducted with adult patients with multiple sclerosis. Participants were recruited from medical clinics in Merced, California; Cleveland, Ohio; Columbia, Maryland; and Chicago, Illinois. These focus groups occurred between October 2005 and March 2006. Participants were included if they were 18 years of age or older, diagnosed with one of the six conditions, and per physician report, possessed the cognitive and physical ability to participate in a focus group.

The purpose of the focus groups was to query participants on salient aspects of health-related quality of life, not to ask about stigma specifically. Participants were asked open-ended questions about their quality of life and areas most affected by their illness and treatment. Recordings of discussions were transcribed and NVivo 2.0 (QSR International, 2002) was used to organize the qualitative data. The data were analyzed by coders trained in qualitative data analytic techniques, and coding disagreements were reconciled through discussion. A grounded theory approach guided the identification of themes, and incorporated the following techniques: coding, memo writing, and the constant comparative method [22].

Literature Review and Initial Item Pool

We conducted a literature review in order to examine the wording and content of existing illness-specific measures of stigma. We examined measures of stigma associated with a number of conditions including physical distinctions resulting from severe burns [23], mental illness [13], epilepsy [24, 25, 26], HIV/AIDS [14], amyotrophic lateral sclerosis (ALS) [27], multiple sclerosis [28, 29, 30], and Parkinson’s Disease [31] (measures are listed in Table 1). We created an item pool using ‘binning’ and ‘winnowing’ techniques [32]. We selected items from an existing library of Functional Assessment of Chronic Illness Therapy (FACIT) items and wrote additional items to correspond with patient-identified concerns. Each item was assigned to a primary ‘bin’, or area. For stigma, each bin corresponded with six dimensions of stigma: concealability, course, disruptiveness, aesthetic qualities, origin, and peril [4]. Once items were assigned to bins, we “winnowed”, or systematically removed, items because of redundancy, vague or confusing language, language translatability, or narrowness of coverage.

Table 1.

Instruments Examined Before Constructing Stigma Scale for Chronic Illness

Scale Target Illness [Reference]
Perceived Stigmatization Questionnaire (PSQ) Severe burns [22]
Self Stigma of Mental Illness Scale (SSMIS) Mental illness [12]
Quality of Life in Epilepsy Inventory for Adolescents
(QOLIE-AD-48)
Epilepsy [23]
Epilepsy Foundation Concerns Index Epilepsy [24]
Impact on Epilepsy Scale Epilepsy [25]
HIV Stigma Scale HIV/AIDS [13]
Amyotrophic Lateral Sclerosis Assessment Questionnaire
(ALSAQ-40)
Amyotrophic lateral sclerosis
(ALS) [25]
Functional Assessment of Multiple Sclerosis (FAMS) Multiple sclerosis [26]
Leeds Multiple Sclerosis Quality of Life (LMSQoL) Multiple sclerosis [27]
The RAYS- A Quality of Life Scale for Multiple Sclerosis
Patients
Multiple sclerosis [28]
Parkinson’s Disease Quality of Life Questionnaire (PDQL) Parkinson’s Disease [29]

Cognitive Interviews and Item Review

We conducted cognitive interviews with draft stigma items to help ensure that items would be understood as intended [33]. Research assistants received training in cognitive interviewing, and once trained, they queried participants on the language, comprehensibility, and relevance of the items. The interviews were audio-taped and transcribed verbatim.

We gathered a team of experts to analyze the content of responses [34] and revise items in a series of discussions. The expert reviewers were neurology professionals, chosen based on reputation via publications and presentations, and outcomes measurement specialists from the fields of health psychology, rehabilitation medicine, psychometrics, and cross-cultural translation. The neurology and outcomes measurement experts reviewed item content and wording independently. In addition, our team scrutinized response categories (1=Never, 2=Rarely, 3=Sometimes, 4=Often, 5=Always) and the context of the questionnaire ‘the past 7 days’ versus ‘lately’.

Psychometric analyses

We recruited patients with Stroke, Multiple Sclerosis, Parkinson’s Disease, Epilepsy, and ALS via an online internet panel. The participants completed a set of study measures, including a socio-demographic questionnaire and the stigma items. The participants provided online informed consent before completing study measures. We were concerned about recruiting adequate numbers of people with particular neurological disorders. Thus, we prioritized recruitment of people with specific neurological disorders, and stratified the sample by neurological disorders but not other characteristics, such as racial/ethnic background. Online data collection enabled us to recruit participants in adequate numbers from across the United States. The panel testing company used illness-stratified random sampling from their registered panel of over one million members. Participants were members of the online testing company who completed questionnaires regularly for incentives provided by the company.

We examined Cronbach’s alpha and item-total correlations of the stigma item bank. We used exploratory factor analysis (EFA) on the total item set, and then conducted single factor and bifactor confirmatory factor analysis (CFA) using Mplus 4.1 (Mplus, 2006) to assess dimensionality. The EFA and CFA used polychoric correlation coefficients, considered robust with ordinal item responses. CFA was conducted using data from participants who had complete data (no missing item responses). Goodness of fit was examined for each set of items using the comparative-fit index (CFI) and the root-mean-square error of approximation (RMSEA). The criteria for good (or acceptable) model fit were: CFI values greater than 0.95 (0.90) and RMSEA values less than 0.05 (0.08). We then fitted the items with the graded response model, which assumes ordinal item responses, using the MULTILOG software program [35]. All items were examined for satisfactory model fit statistics S-X2 [36]. Local dependence, or item redundancy, was identified using a standard cutoff supported by our previous work (i.e., residual correlation ≥ .20) [21].

To assess convergent and divergent validity, we conducted three ANOVA analyses to examine the relationship between total scores on finalized scale and a (1) self-rating of psychological distress (“Please indicate the statement that best describes your current level of anxiety/depression: 1= not anxious/depressed, 2=moderately anxious/depressed, 3= extremely anxious/depressed”), (2) patient rated performance status (“Please indicate which statement below best describes your current activity level: 0=normal activity, 1=some symptoms, but no bed rest during day, 2=bed rest for < 50% of day, 3= bed rest for > 50% of day, 4=unable to get out of bed”), and (3) a self-rating of pain (“Please indicate the statement that best describes your current level of pain/discomfort: 1=no pain/discomfort, 2=moderate pain/discomfort, 3=extreme pain/discomfort”).

Several studies have demonstrated that depression and anxiety are associated with stigma [37, 38], and thus we examined the relationship between stigma and the combined construct we called ‘psychological distress’ to demonstrate convergent validity. In addition, patient rated performance status has been used extensively in health-related quality of life studies as a measure of general functional status reflecting the course of illness [39], and thus, we set out to examine the relationship between stigma and performance status. Furthermore, pain has not been associated with stigma, and we examined the relationship between pain and stigma to demonstrate divergent validity. Cohen considered 0.40 to be a large effect size and 0.10 to be a small effect size for a one way ANOVA [40]. Given this information, we expected that an analysis of stigma and psychological distress would produce a large effect size (greater than 0.40) and performance status would be moderately related to stigma and produce an effect size less than 0.40. Although pain could theoretically be related to stigma, we expected an analysis of pain and stigma to produce a small effect size (less than 0.10).

Measurement Equivalence

In post-hoc analyses, we evaluated measurement equivalence (or differential item functioning: DIF) between responses from participants with epilepsy and stroke. These groups were chosen because numbers of participants in each group were large enough to allow for DIF analyses to be conducted. DIF was evaluated in order to examine the differing probabilities of item endorsement in selected groups of people [41]. A nonparametric DIF detection technique was used, using the Mantel-Haenszel and Liu-Agresti cumulative common log odds ratio statistics as implemented in the DIFAS software [42]. We examined the log odds ratio z statistic (z) in order to determine the magnitude and direction of DIF across item responses from people with epilepsy and stroke.

Results

Focus Groups

Results from the focus groups pertaining to stigma are summarized here, and full results are reported elsewhere [43]. Each group was comprised of 8 patients for a total of 56 participants (sample characteristics are reported in Table 2). The concept of stigma emerged spontaneously in the patient focus groups. For example, the adult epilepsy group mentioned stigma on two occasions (4.26% of all coded responses from this group), particularly as it related to having seizures in public. During the multiple sclerosis groups, comments pertaining to stigma were mentioned in relation to looking as though intoxicated when having difficulty walking in public (10 instances, 2.48%) and when others questioned their need for assistive devices (11 instances, 2.73%). In the Parkinson’s disease groups, participants reported stigma (11 instances, 9.91%) when family and friends avoided them and doubted the legitimacy of their status. Stroke participants endorsed their experiences with stigma (10 instances, 4.46%) in relation to slurred speech and difficulty walking.

Table 2.

Self reported socio-demographic and clinical characteristics of the focus group, cognitive interview, and online samples.

Variable Frequency (%2)
Focus Group Sample N = 56

Mean Age 52 years
Gender Male 28 (50)
Illness/Disease Alzheimer’s disease 8 (14)
Amyotrophic Lateral Sclerosis 8 (14)
Epilepsy 8 (14)
Parkinson’s disease 8 (14)
Stroke 8 (14)
Multiple sclerosis 16 (28)

Cognitive Interview Sample Total N = 17

Mean Age 55 years
Gender Male 7 (41)
Ethnicity Hispanic/Latino 0 (0)
Race European-American 16 (94)
Black/African-American 1 (6)
Native American, Asian-American, or Pacific
Islander
0 (0)
Illness/Disease Epilepsy 4 (23)
Amyotrophic Lateral Sclerosis 4 (23)
Multiple sclerosis 4 (23)
Parkinson’s disease 4 (23)
Stroke 1 (6)

Psychometric Sample Total N = 511

Mean Age 56 years
Gender Male 271 (53)
Ethnicity Hispanic/Latino 27 (5)
Race1 European-American 486 (95)
Black/African-American 15 (3)
Native American, Asian-American, or Pacific
Islander
29 (6)
Illness/Disease1 Stroke 209 (38)
Multiple Sclerosis 84 (15)
Parkinson’s Disease 59 (11)
Epilepsy 183 (33)
Amyotrophic Lateral Sclerosis 18 (3)
Psychological Distress Not anxious or depressed 263 (52)
Moderately anxious or depressed 215 (42)
Extremely anxious or depressed 30 (6)
Performance Status Normal activity, without symptoms 167 (33)
Some symptoms, do not require bed rest
during day
246 (48)
Bed rest for less than 50% of day 80 (16)
Bed rest for more than 50% of day 16 (3)
Unable to get out of bed 2 (0.4)
Pain No pain or discomfort 162 (32)
Moderate pain or discomfort 287 (57)
Extreme pain or discomfort 60 (12)
1

Participants endorsed multiple categories

2

Percentages may not add up to 100 due to rounding.

Cognitive Interviews and Item Review

We developed a 33 item pool, and 17 participants with epilepsy, multiple sclerosis, ALS, Parkinson’s disease, and stroke responded to these items in cognitive interviews (sample characteristics are provided in Table 2). Participants commented in cognitive interviews that the draft item “I am unpredictable” was inapplicable to their situation, and so the item was dropped. Item wordings were further revised based on participant feedback expert review. For example, the word ‘condition’ that appeared in the original item pool was changed to ‘illness’ based on its potential for easier translation to Spanish. The response categories were generally well understood by patients. However, the item context ‘the past 7 days’ was modified to ‘lately’, as many of the items appeared to be more stable over short periods of time. After the participant and expert item review, 26 items remained.

Psychometric analyses

Five hundred and eleven patients with neurological disorders completed the 26-item bank via the online internet panel. Fifty-three percent of the respondents were male. In terms of race and ethnicity, 5.3% self-reported as having Hispanic/Latino ethnicity and 95% reported that they were European-American on a separate question about race. Participants had a self-reported diagnosis of stroke, multiple sclerosis, Parkinson’s disease, epilepsy, or ALS. Details of the socio-demographic and clinical characteristics of the sample are in Table 2.

Cronbach’s alpha was 0.97 for the 26-item bank. All items had item-total correlations greater than 0.50, but item analyses showed the item distributions were skewed. Accordingly, polychoric correlations were used in our EFA and CFA, and this method is known to be more robust with non-normally distributed and ordinal data. In addition, the unweighted least squares (ULS) estimator was used for EFA, and weighted least squares with adjustment for means and variances (WLSMV) estimator was used for CFA.

When EFA results were interpreted using the Cattell (1966) method [44] (number of factors before a break in the scree plot) the analysis produced one factor, whereas using the Kaiser (1960) method [45] (number of factors with eigenvalues greater than 1), the EFA produced three factors with eigenvalues of 17.78, 1.44, and 1.12. We then used QUARTIMIN rotation to minimize the number of factors and allow the factors to be correlated. 13 items loaded onto a factor measuring ‘self/internalized stigma’, and 11 items loaded onto a second factor measuring ‘enacted stigma.’ Two items, “I was careful who I told that I have this illness” and “I worried that people who know I have this illness will tell others” loaded onto a third factor. We dropped items on this third factor because they were applicable only with conditions that are concealable, and our goal was to develop a ‘generic’ stigma scale. After the two items were dropped, we completed the EFA again and using the Kaiser (1960) method of interpretation, a 2 factor solution suggested by eigenvalues 16.90 and 1.12, accounting for 70% of the variance. Eleven items loaded onto the ‘enacted stigma’ factor and 13 items onto the ‘self stigma’ factor. The two factors were correlated considerably (r = .81).

Single factor and bifactor Confirmatory Factor Analyses were completed on the 24-item pool. For single factor CFA, RMSEA was 0.131 and CFI was 0.905. Two items had a tendency towards local dependence (r = 0.18): “People with my illness lost jobs when their employers found out about it” and “I lost friends by telling them that I have this illness,” and with the items “Because of my illness, people were unkind to me” and “Because of my illness, people made fun of me.” We retained these items because they did not meet the 0.20 cutoff, and because the items appeared to measure different facets of enacted stigma (i.e., employment and social relationships).

Then, a bifactor CFA was run because the two factors were highly correlated and we believed that an underlying general factor of stigma dominated. For this analysis, the RMSEA was 0.096 and CFI was 0.939. These fit statistics did not support good model fit. However, McDonald (1999) suggested that sufficient unidimensionality can be interpreted by examining standardized loadings for bifactor analyses [46]. Lai, Crane, and Cella (2006) demonstrated that even with poor CFA fit statistics, items of a fatigue scale fit a bifactor model by examining factor loadings [47]. Accordingly, the bifactor CFA indicated that standardized loadings on an overall stigma factor ranged from 0.68 to 0.94. Within the same model, items from the self and enacted stigma sub-domains had poorer standardized loadings; on the self stigma sub-domain, loadings ranged from −0.12 to 0.43 and on the enacted stigma sub-domain, loadings ranged from 0.17 to 0.53. The dominant general factor explained the residual correlations among the 2 subscales [48]. Furthermore, the examination of factor loadings suggested that a dominant general stigma factor was sufficiently unidimensional for analyses requiring that the underlying construct be unidimensional, such as item response theory (IRT) analyses.

The IRT analyses indicated that items of the stigma scale fit the latent unidimensional construct of stigma. Item parameters from this analysis are shown in Table 3. Figure 2 shows the information function and trait distribution for the stigma items. The bimodal trait distribution showed that two groups of people with different levels of stigma severity were sampled. The information function suggested that the items measured the construct at moderate to severe levels of stigma, implying that the items would lack precision if used with people experiencing less severe stigma. The instrument is best used with participants whose stigma severity levels are located where the vertical marks are placed at the bottom of the figure.

Table 3.

Item Response Theory Model Fit Parameters

Item Slope Threshold 1 Threshold 2 Threshold 3 Threshold 4
Because of my illness, I
felt emotionally distant
from other people
3.53 −0.05 0.38 0.99 1.67
Because of my illness, I
felt left out of things
4.00 −0.06 0.35 0.95 1.61
Because of my illness, I
felt embarrassed in
social situations
3.99 0.17 0.62 1.27 1.90
Because of my illness, I
worried about other
people’s attitudes
towards me
3.28 0.35 0.77 1.30 1.97
I was unhappy about
how my illness affected
my appearance
2.67 0.17 0.62 1.19 1.63
Because of my illness,
it was hard for me to
stay neat and clean
2.43 0.51 0.99 1.74 2.43
Because of my illness, I
worried that I was a
burden to others
3.28 −0.16 0.22 0.93 1.47
I felt embarrassed about
my illness
3.46 0.18 0.59 1.18 1.69
I felt embarrassed
because of my physical
limitations
3.39 −0.07 0.35 1.02 1.61
I felt embarrassed about
my speech
1.94 0.61 0.98 1.69 2.43
Because of my illness, I
felt different from
others
3.35 −0.11 0.42 0.96 1.45
I tended to blame
myself for my problems
1.66 −0.34 0.31 1.24 2.16
I avoided making new
friends to avoid telling
others about my illness
3.09 0.54 0.98 1.43 1.93
Because of my illness,
some people seemed
uncomfortable with me
3.44 0.10 0.75 1.43 2.40
Because of my illness,
some people avoided
me.
4.06 0.35 0.89 1.55 2.20
Because of my illness,
people were unkind to
me
3.31 0.65 1.26 2.10 3.09
Because of my illness,
people made fun of me
2.85 0.89 1.48 2.29 2.97
Because of my illness,
people avoided looking
at me
3.92 0.67 1.23 1.81 2.70
Because of my illness,
strangers tended to
stare at me
2.66 0.74 1.35 2.04 2.54
Because of my illness, I
was treated unfairly by
others
3.76 0.54 1.12 1.82 2.32
Because of my illness,
people tended to ignore
my good points
4.19 0.52 1.02 1.66 2.13
Some people acted as
though it was my fault I
have this illness
2.88 0.50 0.95 1.54 2.19
People with my illness
lost their jobs when
their employers found
out about it
1.49 0.01 0.62 1.81 2.89
I lost friends by telling
them that I have this
illness
2.52 0.88 1.39 1.96 2.69

Figure 2. Information function and trait distribution for the Stigma Scale for Chronic Illness items.

Figure 2

Note: The information function and standard error are shown as lines within the plot. The distribution of individual trait scores are depicted as a histogram. The hash marks are locations of the category threshold parameters that indicate that the test provides good measurement at moderate to severe levels of stigma.

Our analyses of convergent and divergent validity were conducted on the total score (sum of 24 items) of the scale we called the Stigma Scale for Chronic Illness (SSCI). The mean total score on the SSCI was 42.7 (standard deviation = 19.7). Details on the frequency of responses for psychological distress, performance status, and pain are listed in Table 2. The first ANOVA indicated a strong relationship between the total score on the SSCI (dependent variable) and psychological distress (independent variable), producing an effect size of 0.58. In the second ANOVA, which analyzed the relationship between the SSCI (dependent variable) and performance status (independent variable) produced a smaller effect size of 0.47. Lastly, the ANOVA with pain (independent variable) and the SSCI (dependent variable) produced an even smaller effect size of 0.36.

Measurement equivalence

We examined DIF on a subset of the responses obtained in order to understand the scale’s performance across conditions, in this case epilepsy (N = 165) and stroke (N = 190). Extreme categories (“Often” or “Always”) were rarely indicated in this sample, and so the response categories with fewer than five observations per group were collapsed with lower categories. A total of 16 items had one or more categories collapsed. Four items of the stigma scale demonstrated DIF: “Because of my illness, I felt embarrassed in social situations” (z = +2.00), “Because of my illness, people avoided looking at me” (z = +2.11), “Because of my illness, people tended to ignore my good points” (z = −2.35), and “Because of my illness, I felt different from others” (z = −2.11). The positive and negative z statistics indicated that the stroke sample tended to respond to the first two items (‘embarrassed in social situations’ and ‘avoided looking at me’) with more severe stigma than the epilepsy sample, and the epilepsy sample tended to respond with more severe stigma than the stroke sample on the last two items (‘good points’ and ‘different from others’), at the same levels of the underlying trait. Figure 3 depicts the expected item score as a function of the logit transformed total score, corrected for overlap, separately for people with epilepsy and stroke. Although DIF was observed on these 4 items, the overall impact is likely to be small because the magnitude of DIF, as shown graphically and by the Root Mean Square Deviation values in Figure 3, was small and the directions of DIF were balanced. The effects of the DIF would likely cancel out at the test level.

Figure 3. Probabilities of item endorsement for people with epilepsy and stroke.

Figure 3

Note: RMSD = Root Mean Square Deviation.

Discussion

Our multistep process for measurement development resulted in the 24-item Stigma Scale for Chronic Illness (SSCI). The SSCI demonstrated essential unidimensionality while measuring the theoretically-supported areas of self and enacted stigma. The scale had good internal consistency, convergent validity, and IRT model fit. In addition, DIF analyses provided preliminary evidence of measurement equivalence across the neurological conditions of epilepsy and stroke. Further psychometric testing will strengthen the validation of this instrument, and comparisons across other neurological and non-neurological conditions will help evaluate the generalizability of the SSCI to other chronic conditions.

Our approach was unique in that it began with input on stigma from people with chronic illnesses. Focus group participants underscored the impact of stigma on quality of life, and this input then guided item development. The items underwent rigorous psychometric analyses, and results showed that the SSCI conformed to the bifactor model, demonstrating sufficient unidimensionality. Although we built the scale informed by six dimensions of stigma, our factor analytic results supported the more parsimonious bifactor model. Therefore, our analyses suggested that the SSCI can be examined as one total or as two subscales of enacted and self/internalized stigma. The resulting enacted and self/internalized stigma subscales locate the SSCI within the theoretical model depicted in Figure 1. Corrigan and colleagues (2002) developed the theoretical model, but further study with the SSCI can provide more information about the relationships between enacted and self/internalized stigma.

The scale demonstrated stronger than expected associations with psychological distress, performance status, and pain. It is possible that an unmeasured factor, severity of illness may be driving the stronger than expected associations between these variables. Regardless, the SSCI did not demonstrate adequate divergent validity when compared to pain scores. Further study of the scale’s divergence with constructs unrelated to stigma should be undertaken.

The SSCI demonstrated high internal consistency, suggesting that items within the scale could be similar and the scale could be shortened without impacting its psychometric properties. Furthermore, our IRT analyses showed that people with two distinct stigma levels participated in our study, indicating that across neurological conditions, our participants reported varying severity of stigma. The results showed that the scale might not be well utilized as a screening measure to distinguish between those who do and do not experience stigma. Instead, the SSCI would be best used to measure stigma at moderate to severe levels.

Finally, results from the DIF analysis suggested that the measure has good potential to be used across conditions with minimal bias. However, the DIF analyses were conducted with small samples of people with epilepsy and stroke. Although response categories were collapsed in these analyses, requiring fewer location parameters to be estimated per item, DIF studies with larger samples can fully determine to the benefit of using the measure across conditions.

The study had some limitations. First, the participants from online panels lacked ethnic/racial diversity; 95% were of European-American racial background. Therefore, caution should be taken in generalizing these results to other ethnic/racial groups, where stigma may be compounded by social differences, disadvantages, or discrimination. In addition, the item distributions were skewed, and although our EFA and CFA analyses used polychoric correlations to account for this non-normality, the IRT parameter estimates could be less stable than their associated standard error estimates might indicate.

Overall, we developed the SSCI to be useful in better understanding the impact of stigma on people across chronic illnesses and the effectiveness of stigma reduction interventions. Future study of the SSCI can provide more information on the instrument’s psychometric properties and further evidence about its use in comparing stigma across conditions. More study is needed, but the SSCI demonstrated potential to measure important aspects of stigma.

Acknowledgements

This study was funded by the National Institute of Neurological Disorders and Stroke (NINDS) contract number HHSN265200423601C. Deepa Rao is supported by a career development award funded by the National Institute of Mental Health (NIMH: grant number K23 MH 084551). The authors would like to thank Claudia S. Moy assistance in making this study possible, Paul K. Crane for his psychometric guidance, and Patrick W. Corrigan and Nicolas Rüsch for providing comments on earlier drafts of this paper.

References

  • 1.Goffman E. Stigma: Notes on the Management of Spoiled Identity. Simon and Schuster Inc.; New York: 1963. [Google Scholar]
  • 2.Weiner B, Perry RP, Magnusson J. An Attributional Analysis of Reactions to Stigmas. Journal of Personality & Social Psychology. 1988;55(5):738–748. doi: 10.1037//0022-3514.55.5.738. [DOI] [PubMed] [Google Scholar]
  • 3.Corrigan PW, Penn DL. Lessons from social psychology on discrediting psychiatric stigma. American Psychologist. 1999 Sep;54(9):765–776. doi: 10.1037//0003-066x.54.9.765. American Psychologist. [DOI] [PubMed] [Google Scholar]
  • 4.Jones E, Farina A, Hastorf A, Markus H, Miller D, Scott R. Social Stigma The Psychology of Marked Relationships. W.H. Freeman and Company; New York: 1984. [Google Scholar]
  • 5.Rüsch N, Angermeyer M, Corrigan P. Mental illness stigma: Concepts, consequences, and initiative to reduce stigma. European Psychiatry. 2005;20(8):529–539. doi: 10.1016/j.eurpsy.2005.04.004. [DOI] [PubMed] [Google Scholar]
  • 6.Sikkema K, Kalichman S, Hoffmann R, Koob J, Kelly J, Heckman T. Coping strategies and emotional well-being among HIV-infected men and women experiencing AIDS-related bereavement. AIDS Care. 2000;12(5):613–624. doi: 10.1080/095401200750003798. [DOI] [PubMed] [Google Scholar]
  • 7.Sirey JA, Bruce ML, Alexopoulos GS, Perlick DA, Friedman SJ, Meyers BS. Stigma as a barrier to recovery: Perceived stigma and patient-rated severity of illness as predictors of antidepressant drug adherence. Psychiatric Services. 2001 Dec;52(12):1615–1620. doi: 10.1176/appi.ps.52.12.1615. [DOI] [PubMed] [Google Scholar]
  • 8.Corrigan P, Watson A, Barr L. The self-stigma of mental illness: Implications for self esteem and self efficacy. Journal of Social & Clinical Psychology. 2006;25(9):875–884. [Google Scholar]
  • 9.Corrigan PW, Watson AC. The paradox of self-stigma and mental illness. Clinical Psychology: Science and Practice. 2002 Feb;9(1) 2002, 35:53. [Google Scholar]
  • 10.Steward W, Herek GM, Ramakrishna J, Bharat S, Chandy S, Wrubel J, Ekstrand ML. HIV-related stigma: adapting a theoretical framework for use in India. Social Science & Medicine. 2008;67(8):1225–1235. doi: 10.1016/j.socscimed.2008.05.032. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Jacoby A. Felt versus enacted stigma: A concept revisited. Social Science & Medicine. 1994;38(2):269–274. doi: 10.1016/0277-9536(94)90396-4. [DOI] [PubMed] [Google Scholar]
  • 12.Link B, Yang L, Phelan J, Collins P. Measuring mental illness stigma. Schizophrenia Bulletin. 2004;30(3):511–541. doi: 10.1093/oxfordjournals.schbul.a007098. [DOI] [PubMed] [Google Scholar]
  • 13.Watson A, Corrigan P, Larson J, Sells M. Self-stigma in people with mental illness. Schizophrenia Bulletin. 2007 doi: 10.1093/schbul/sbl076. epub ahead of print. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Berger BE, Ferrans CE, Lashley FR. Measuring Stigma in People with HIV: Psychometric Assessment of the HIV Stigma Scale. Research in Nursing and Health. 2001;24:518–529. doi: 10.1002/nur.10011. [DOI] [PubMed] [Google Scholar]
  • 15.Sayles J, Hays R, Sarkisian C, Mahajan A, Spritzer K, Cunningham W. Development and psychometric assessment of a multidimensional measure of internalized HIV stigma in a sample of HIV-positive adults. AIDS & Behavior. 2008 doi: 10.1007/s10461-008-9375-3. epub ahead of print. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Van Brakel WH. Measuring health-related stigma: A literature review. Psychology, Health & Medicine. 2006 Aug;11(3):307–334. doi: 10.1080/13548500600595160. [DOI] [PubMed] [Google Scholar]
  • 17.Nyblade LC. Measuring HIV stigma: existing knowledge and gaps. Psychology, Health & Medicine. 2006 Aug;11(3):335–345. doi: 10.1080/13548500600595178. [DOI] [PubMed] [Google Scholar]
  • 18.Gagliardi BA. The impact of Duchenne muscular dystrophy on families. Othropedic Nursing. 1991;10:41–49. doi: 10.1097/00006416-199109000-00009. [DOI] [PubMed] [Google Scholar]
  • 19.Weaver FM, Giobbie-Hurder AG, Hughes SL, Smith G, Kubal JD, Ulasevich A. Home medical equipment receipt in a home care appropriate population. Journal of Aging and Health. 1999;11(4):494–516. doi: 10.1177/089826439901100402. [DOI] [PubMed] [Google Scholar]
  • 20.de Boer AG, Wijker W, Speelman JD, de Haes JC. Quality of life in patients with Parkinson’s disease: development of a questionnaire. Journal of Neurology, Neurosurgery, & Psychiatry. 1996;61(1):70–4. doi: 10.1136/jnnp.61.1.70. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Cella D, Yount S, Rothrock N, Gershon R, Cook K, Reeve B. The Patient Reported Outcomes Measurement Informational System (PROMIS) Overview and Developmental Work, 2004-2006. Medical Care. 2007;45(5):S3–S11. doi: 10.1097/01.mlr.0000258615.42478.55. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Corbin J, Strauss A. Basics of Qualitative Research. Sage; Los Angeles: 2008. [Google Scholar]
  • 23.Lawrence J, Fauerbach J, Heinberg L, Doctor M, Thombs D. The reliability and validity of the Perceived Stigmatization Questionnaire (PSQ) and the Social Comfort Questionnaire (SCQ) among an adult burn survivor sample. Psychological Assessment. 2006;18(1):106–111. doi: 10.1037/1040-3590.18.1.106. [DOI] [PubMed] [Google Scholar]
  • 24.Cramer J, Westbrook L, Devinsky O, Perrine K, Glassman M, Camfield C. Development of the Quality of Life in Epilepsy Inventory for Adolescents: The QOLIE-AD-48. Epilepsia. 1999;40:1114–1121. doi: 10.1111/j.1528-1157.1999.tb00828.x. [DOI] [PubMed] [Google Scholar]
  • 25.Jacoby A, Baker G, Smith D, Dewey M, Chadwick D, Jacoby A, Baker G, Smith D, Dewey M, Chadwick D. Measuring the impact of epilepsy: the development of a novel scale. Epilepsy Research. 1993;16(1):83–8. doi: 10.1016/0920-1211(93)90042-6. [DOI] [PubMed] [Google Scholar]
  • 26.Loring D, Larrabee G, Meador K, Lee G. Dimensions of the Epilepsy Foundation Concerns Index. Epilepsy and Behavior. 2005;6(3):348–352. doi: 10.1016/j.yebeh.2005.02.001. [DOI] [PubMed] [Google Scholar]
  • 27.Green C, Kiebert G, Murphy C, Mitchell J, O’Brien M, Burrell A. Patients’ health-related quality of life and health state values for motor neurone disease/amyotrophic lateral sclerosis. Quality of Life Research. 2003;12:565–574. doi: 10.1023/a:1025052609818. [DOI] [PubMed] [Google Scholar]
  • 28.Cella D, Dineen K, Arnason B, Reder A, Webster K, Karabatsos G. Validation of the functional assessment of multiple sclerosis quality of life instrument. Neurology. 1996;47:129–139. doi: 10.1212/wnl.47.1.129. [DOI] [PubMed] [Google Scholar]
  • 29.Ford H, Gerry E, Tennant A, Whalley D, Haigh R, Johnson M. Developing a disease-specific quality of life measure for people with multiple sclerosis. Clinical Rehabilitation. 2001;15:247–258. doi: 10.1191/026921501673658108. [DOI] [PubMed] [Google Scholar]
  • 30.Rotstein Z, Barak Y, Noy S, Achiron A. Quality of life in multiple sclerosis: development and validation of the ‘RAYS’ Scale and comparison with the SF-36. International Journal for Quality in Health Care. 2000;12(6):511–517. doi: 10.1093/intqhc/12.6.511. [DOI] [PubMed] [Google Scholar]
  • 31.deBoer A, Wijker W, Speelman J, Haes J. d. Quality of life in patients with Parkinson’s disease: development of a questionnaire. Journal of Neurology, Neurosurgery & Psychiatry. 1996;61(1):70–74. doi: 10.1136/jnnp.61.1.70. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.DeWalt DA, Rothrock N, Yount S, Stone AA. Evaluation of item candidates: the PROMIS qualitative item review. Medical Care. 2007 May;45(5 Supplement 1):S12–21. doi: 10.1097/01.mlr.0000254567.79743.e2. Med Care. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Willis GB. Cognitive Interviewing: A “How To” Guide, From the short course “Reducing Survey Error through Research on the Cognitive and Decision Processes in Survey”. Meeting of the American Statistical Association.1999. [Google Scholar]
  • 34.Ryan G, Bernard H. Data Management and Analysis Methods. In: Denzin N, Lincoln Y, editors. Handbook of Qualitative Research. Sage Publications; Thousand Oaks, CA: 2000. [Google Scholar]
  • 35.Samejima F. Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph, No. 17. 1969 [Google Scholar]
  • 36.Orlando M, Thissen D. Further investigation of the performance of S-X2: An item fit index for use with dichotomous item response theory models. Applied Psychological Measurement. 2003;27:289–298. [Google Scholar]
  • 37.LaFrance WC, Kanner AM, Hermann B. Psychiatric comorbidities in epilepsy. International Review of Neurobiology. 2008;83:347–83. doi: 10.1016/S0074-7742(08)00020-2. [DOI] [PubMed] [Google Scholar]
  • 38.Alonso J, Buron A, Bruffaerts R, He Y, Posada-Villa J, Lepine JP, Angermeyer MC, Levinson D, de Girolamo G, Tachimori H, Mneimneh ZN, Medina-Mora ME, Ormel J, Scott KM, Gureje O, Haro JM, Gluzman S, Lee S, Vilagut G, Kessler RC, Von Korff M. Association of perceived stigma and mood and anxiety disorders: results from the World Mental Health Surveys. Acta Psychiatrica Scandinavica. 2008;118(4):305–14. doi: 10.1111/j.1600-0447.2008.01241.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Zubrod C, Schneiderman M, Frei E. Appraisal of methods for the study of chemotherapy of cancer in man: Comparative therapeutic trial of nitrogen mustard and triethylene thiophosphoramide. Journal of Chronic Disease. 1960;11:7–33. [Google Scholar]
  • 40.Cohen J. A Power Primer. Psychological Bulletin. 1992;112:155–159. doi: 10.1037//0033-2909.112.1.155. [DOI] [PubMed] [Google Scholar]
  • 41.Hambleton RK, Swaminathan H, Rogers HJ. Fundamentals of Item Response Theory. Sage Publications, Inc.; Newbury Park, CA: 1992. [Google Scholar]
  • 42.Penfield R. DIFAS: Differential Item Functioning Analysis System. Applied Psychological Measurement. 2005;29:150. [Google Scholar]
  • 43.Perez L, Huang J, Jansky L, Nowinski C, Victorson D, Peterman A, et al. Using focus groups to inform the Neuro-QOL measurement tool: Exploring patient-centered, health-related quality of life concepts across neurological conditions. Journal of Neuroscience Nursing. 2007;39(6):342–353. doi: 10.1097/01376517-200712000-00005. [DOI] [PubMed] [Google Scholar]
  • 44.Cattell RB. The screen test for the number of factors. Multivariate Behavioral Research. 1966;1:245–276. doi: 10.1207/s15327906mbr0102_10. [DOI] [PubMed] [Google Scholar]
  • 45.Kaiser HF. The application of electronic computers to factor analysis. Educational and Psychological Measurement. 1960;20:141–151. [Google Scholar]
  • 46.McDonald RP. Test Theory: A Unified Treatment. Lawrence Erlbaum; Mahway, NJ: 1999. [Google Scholar]
  • 47.Lai JS, Crane PK, Cella D. Factor analysis techniques for assessing sufficient unidimensionality of cancer related fatigue. Quality of Life Research. 2006;15:1179–1190. doi: 10.1007/s11136-006-0060-6. [DOI] [PubMed] [Google Scholar]
  • 48.Reise S, Morizot J, Hays R. The role of the bifactor model in resolving dimensionality issues in health outcomes measures. Quality of Life Research. 2007;16:19–31. doi: 10.1007/s11136-007-9183-7. [DOI] [PubMed] [Google Scholar]

RESOURCES