Abstract
Objective:
Assessing global functioning in psychiatric emergency settings is important for clinicians to estimate severity of mental disorders, devise a treatment plan, and assess the evolution of their patients’ progression over time. The World Health Organization Disability Assessment Schedule-2.0 (WHODAS-2) measures psychological, social, and professional functioning and is recommended as a standardized instrument of choice for use in psychiatric settings. Yet, studies investigating disability profiles of mental disorders using the WHODAS-2 are scarce, and psychometric properties have not been evaluated in a psychiatric emergency context. We describe and compare WHODAS-2 (12-item version) scores across mental disorders (anxiety, mood, psychotic, personality, and substance abuse) in adults admitted to psychiatric emergency.
Methods:
Data from the Signature Bank were used. Participants admitted to psychiatric emergency completed the WHODAS-2 at admission (n = 1,125). Mental disorders were evaluated by psychiatrists, and WHODAS-2 scores were compared across groups. Psychometric properties were evaluated using confirmatory factor analysis (CFA).
Results:
Higher mean WHODAS-2 scores were reported by those with anxiety, mood, and personality disorders (P < 0.001) compared to other psychopathologies. The measure showed good internal consistency (global score α = 0.88; domain subscores α = 0.59 to 0.85) and acceptable goodness of fit indices in CFA confirming the original structure of WHODAS-2.
Conclusions:
Findings from this large-scale study could assist clinicians in interpreting WHODAS-2 scores in psychiatric populations and provide a more detailed portrait of disability profiles associated with different clinical diagnoses.
Keywords: global functioning, disability, psychopathology, reliability, validity, psychiatric emergency
Abstract
Objectif:
Évaluer le fonctionnement global en milieu d’urgence psychiatrique est important pour les cliniciens qui veulent estimer la gravité des troubles mentaux, élaborer un plan de traitement et voir l’évolution des progrès de leurs patients à travers le temps. Le World Organization Disability Assessment Schedule-2.0 (WHODAS-2) mesure le fonctionnement psychologique, social et professionnel et est recommandé comme instrument standardisé de choix pour une utilisation en milieu psychiatrique. Or, les études portant sur le degré d’incapacité associé aux troubles mentaux à l’aide du WHODAS-2 sont rares, et les propriétés psychométriques du questionnaire n’ont pas été évaluées en milieu d’urgence psychiatrique. Nous décrivons et comparons les scores du WHODAS-2 (version 12 items) à différents troubles mentaux (anxieux, de l’humeur, psychotique, de la personnalité et d’abus de subtances) chez des adultes admis à l’urgence psychiatrique.
Méthodes:
Des données de la Banque Signature ont été utilisées. Les participants admis à l’urgence psychiatrique ont rempli le WHODAS-2 à l’admission (n = 1 125). Les troubles mentaux ont été évalués par des psychiatres et les scores du WHODAS-2 ont été comparés entre les groupes. Les propriétés psychométriques ont été évaluées à l’aide d’une analyse factorielle confirmatoire (AFC).
Résultats:
Des scores moyens plus élevés au WHODAS-2 ont été obtenus par les patients présentant des troubles anxieux, de l’humeur, et de la personnalité (p < 0,001) comparé aux autres psychopathologies. Le WHODAS-2 indiquait une bonne cohérence interne (score global α = 0,88; sous-scores des domainres α = 0,59-0,85) et des indices d’ajustement acceptables à l’AFC, confirmant la structure d'origine du WHODAS-2.
Conclusions:
Les résultats de cette étude à grande échelle pourraient aider les cliniciens à interpréter les scores WHODAS-2 dans les populations psychiatriques et offrir un portrait plus détaillé du degré d’incapacité associé à différents diagnostics cliniques.
Introduction
Mental illness is associated with compromised health outcomes worldwide. The Global Burden of Disease Study 1 demonstrates that mental disorders account for 7.4% of disability-adjusted life years, with anxiety and depression ranking among the top two psychiatric causes of disability. Disability stemming from mental illness significantly contributes to the global burden of disease by hindering individuals’ daily activities and productivity, and significant healthcare resources are allocated to improving nonfatal sequelae of illness. 2,3
Disability measures inform on the overall health of populations. From a clinical standpoint, disability assessment predicts service needs and functional outcomes; information that diagnosis alone cannot provide. 4,5 A valid measure of disability based on a cross-culturally generalizable conceptual framework is important for developing comparable and efficient clinical practice and for optimal health management and planning. 4,6 To that effect, the World Health Organization (WHO) developed the International Classification of Functioning, Disability and Health (ICF) in the early 1990s, a framework for defining and classifying functioning and disability. 7 The ICF’s definition of disability is based on the biopsychosocial model and focuses on the relationship between health problems and affected contextual factors. 5 Based on the ICF’s model of disability, the World Health Organization Disability Assessment Schedule 2.0 (WHODAS-2) was created in 1998 to assess global functioning, such as an individual’s ability to perform in different domains of life. The WHODAS-2 was devised for use in healthy and clinical populations, including individuals with physical and psychological disorders.
Prior to the WHODAS-2, global functioning was commonly evaluated in psychiatric settings during a clinical interview using the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV 8 ) Global Assessment of Functioning (GAF) Scale. Functioning was estimated on a numerical scale ranging from 0 to 100. The GAF required a high degree of clinical judgement, substantially limiting its interrater reliability (r = 0.39 to 0.59). 9
In contrast, advantages of the WHODAS-2 include a clear conceptual framework based on the ICF’s biopsychosocial model of disability, the use of Likert scales that improve interrater reliability and a brief format. While the GAF only provides a general functioning score, the WHODAS-2 also includes subscales corresponding to different domains of functioning. Strong psychometric properties have been confirmed for the short 12-item 10,11 and long 36-item 12 WHODAS-2 versions. Across studies including mental and physical health problems, the WHODAS-2 shows good reliability, ability to discriminate among groups, good change sensitivity, adequate structure fit, and good convergent validity with other scales measuring disability, general health and quality of life. 10 –22 While the WHODAS-2 is neither diagnostic nor mental health specific, its qualities led the DSM-5 expert committee to recommend it as the standardized instrument of choice for evaluating global functioning in psychiatric settings. 23
Global functioning is altered in individuals suffering from psychopathology, and its evaluation helps mental health practitioners to assess disorder severity and elaborate rehabilitation strategies. 24 Lower functioning was reported in individuals with anxiety disorders, 25,26 mood disorders, 27,28 psychotic disorders, 13,14,29 personality disorders, 30 and substance abuse. 31 Consistent with findings from the Global Burden of Disease Study, those suffering from anxiety, depression, and schizophrenia seem to be most severely affected 1,14 ; however, further studies are needed to confirm these findings. In psychiatric emergency settings, priority is given to the assessment of global functioning and risk in the initial triage procedure. An individual’s level of functioning at hospital admission can help clinicians devise a personalized treatment plan and estimate progression over time.
For the WHODAS-2 to be useful to mental health practitioners, it needs to reflect the functional outcome of mental disorders and to maintain adequate psychometric properties across different clinical settings. To our knowledge, the psychometric properties of the WHODAS-2 have not been evaluated in a psychiatric emergency context where rapid and efficient disability assessment is required. Further, there is limited research regarding disability profiles of mental disorders using WHODAS-2 scores. Most studies assessing disability in psychiatric populations with the WHODAS-2 have focused on specific psychopathologies, 25,27,32,33 and studies comparing scores across psychiatric disorders are limited by few diagnoses. 19,25 A recent study based on the 2012 Canadian Community Health Survey-Mental Health Component compared mean WHODAS-2 scores (12-item version) across several psychiatric diagnoses, 14 providing some of the most comprehensive findings to date on the disability profiles of mental disorders. However, personality disorders were not included in the study, and diagnostic data were collected retrospectively, assessing the relationship between present global functioning and past diagnoses rather than current disorders. Further studies comparing WHODAS-2 scores across psychiatric diagnoses are warranted to better understand disability profiles of different psychopathologies, to eventually provide a benchmark for clinicians to interpret WHODAS-2 scores in psychiatric populations, and to better assess whether WHODAS-2 scores adequately reflect the impact of mental disorders on functioning.
We address these knowledge gaps by describing and comparing WHODAS-2 (12-item version) scores across psychiatric diagnoses including anxiety disorders, mood disorders, psychotic disorders, personality disorders, and substance abuse in 1,125 patients admitted to psychiatric emergency. A second objective was to evaluate the psychometric properties of the WHODAS-2 in this same population by (a) measuring internal consistency and (b) establishing construct validity using confirmatory factor analysis (CFA).
Methods
Population
We used data from the Signature Bank of the Institut Universitaire en Santé Mentale de Montréal (IUSMM), a large biological, psychosocial and clinical databank of individuals continuously recruited since 2012 at the psychiatric emergency of the IUSMM.
Participants were men and women in the Montreal metropolitan region, presenting to psychiatric emergency. Individuals were approached for recruitment by nurses from the research team within 48 hours of admission, written informed consent was obtained, and the data collection was conducted. Self-report data were collected using an iPad application.
In total, 1,125 participants of the Signature Bank completed the WHODAS-2. Most patients were francophone (97.9%). All participants gave informed consent, and ethical approval was obtained from the research ethics committee of the Integrated Center for Health and Social Services of the East end of Montreal.
Psychiatric Diagnoses
Psychiatric diagnoses were established following clinical interviews conducted by the attending psychiatrist using the 10th revision of the International Classification of Diseases (ICD-10). Participant groups were created based on their primary diagnosis: anxiety disorders (corresponding to diagnoses F40 to F48 of the ICD-10; n = 106), mood disorders (F30 to F39; n = 362), psychotic disorders (F20 to F29; n = 434), personality disorders (F60 to F69; n = 119), substance abuse (F10 to F19; n = 86), and “other disorders” (n = 18). The “other disorders” category included various psychiatric diagnoses of the F section of the ICD-10, such as eating disorders, dementia, and self-harming behavior.
Instruments
WHODAS-2
The 12 item self-administrated version of the WHODAS-2 was used. This measure evaluates global functioning across six domains: mobility, occupational activities, cognition, participation, hygiene, and social life. Individuals rate the difficulties they experienced in the past 30 days for a number of activities using a Likert scale ranging from 0 to 4 (“none,” “mild,” “moderate,” “severe,” or “extreme”). Each domain is measured by two items, yielding six domain scores (range 0 to 8) and 1 general global functioning score (range 0 to 48). Higher scores indicate greater disability.
Adequate psychometric properties of the 12-item version of the WHODAS-2 have been reported. Good internal consistency has been demonstrated by significantly higher scores (P < 0.002) in participants with mental and physical disorders compared to the general population in an Australian sample of 8,841 individuals, 10 and by Cronbach alphas of 0.94 for the total score and of 0.74 to 0.90 for the six domains, in a sample of adults with Huntington’s disease.11 These studies also validate the WHODAS-2 two-level factorial structure comprising a general global functioning factor and six secondary factors corresponding to the six domains of functioning.
Statistical Analyses
Analyses were performed in R version 3.3.0. 34 Psych package 35 was used for reliability analyses and Lavaan package 36 for confirmatory factor analyses (CFA).
WHODAS-2 scores by psychiatric profile
Mean WHODAS-2 scores were compared across psychiatric groups (anxiety disorders, mood disorders, psychotic disorders, personality disorders, substance abuse, and other disorders) using analyses of variance. Post hoc comparisons were performed using Tukey correction for multiple comparisons.
Psychometric properties
Distribution of WHODAS-2 scores was examined. To evaluate internal consistency, Cronbach alpha coefficients 37 were calculated for each of the six WHODAS-2 domains and for the total score. Internal consistency was first tested for all participants and then by sex and primary psychiatric diagnosis. Construct validity was established using a two-level CFA, with first-level factors corresponding to the six WHODAS-2 domain subscales and a second level general factor. Multigroup analyses were conducted by sex to test for measurement invariance across sex.
Results
Descriptive Data
Sample characteristics and sex differences in prevalence of disorders are presented in Table 1. Mean age of participants was 40.4 years (SD = 14.1). The majority of participants were single (79.2%), did not have any postsecondary education (72.5%), and were unemployed at recruitment (68.5%). The psychotic and personality disorder groups had the highest rates of unemployment (80.3% and 70.3%), were the least likely to be married or in a relationship (11.3% and 14.3%), or to have achieved postsecondary education (21.8% and 20.2%) together with the substance abuse group (16.9%).
Table 1.
Sociodemographic Characteristics of the Sample.
| All Patients (n = 1,125) | |||
|---|---|---|---|
| Characteristics | Total | Female | Male |
| Mean (SD)/Count (%) | Mean (SD)/Count (%) | Mean (SD)/Count (%) | |
| Participants | 1,125 | 449 (39.9%) | 676 (60.1%) |
| Age (years) | 40.4 (14.1) | 42.0 (14.8) | 39.4 (13.5) |
| Marital status | |||
| Married/in a relationship | 234 (20.8%) | 127 (28.3%) | 107 (15.9%) |
| Single/widowed/divorced | 890 (79.2%) | 322 (71.7%) | 568 (84.1%) |
| Education | |||
| No high school diploma | 374 (35.7%) | 128 (30.1%) | 246 (39.5%) |
| High school diploma | 385 (36.8%) | 162 (38.1%) | 223 (35.9%) |
| Postsecondary education | 288 (27.5%) | 135 (31.8%) | 153 (24.6%) |
| Employment | |||
| Employed | 352 (31.5%) | 149 (33.4%) | 203 (30.3%) |
| Unemployed | 765 (68.5%) | 297 (66.6%) | 468 (69.7%) |
| Diagnosis | |||
| Anxiety disorders | 106 (9.4%) | 45 (42.5%) | 61 (57.5%) |
| Mood disorders | 362 (32.2%) | 170 (47.0%) | 192 (53.0%) |
| Psychotic disorders | 434 (38.6%) | 133 (30.6%) | 301 (69.4%) |
| Personality disorders | 119 (10.6%) | 76 (63.9%) | 43 (36.1%) |
| Substance abuse | 86 (7.6%) | 18 (20.9%) | 68 (79.1%) |
| Other disorders | 18 (1.6%) | 7 (38.9%) | 11 (61.1%) |
Note. n = 1,125.
WHODAS-2 by Psychiatric Profile
The mood disorders, anxiety disorders, and personality disorders groups had significantly higher mean WHODAS-2 scores than the substance abuse, psychotic disorders, and other disorders groups (P < 0.001). While there was no significant difference between mean scores of the mood, anxiety, and personality disorders groups, participants with personality disorders obtained the highest mean score. See Table 2 for WHODAS-2 scores by diagnosis.
Table 2.
Distribution of WHODAS-2 Scores and Diagnosis.
| All Patients (n = 1,125) | ||||||
|---|---|---|---|---|---|---|
| WHODAS-2/Domains | Anxiety Disorder (n = 106) | Mood Disorder (n = 362) | Psychotic Disorder (n = 434) | Personality Disorder (n = 119) | Substance abuse (n = 86) | Other Disorder (n = 18) |
| Mean (SD) | Mean (SD)/Range | Mean (SD)/Range | Mean (SD)/Range | Mean (SD)/Range | Mean (SD)/Range | |
| Total: F(5, 1119) = 12.4, P < 0.001 | 17.28* (8.98) | 16.32* (10.70) | 12.66 (9.52) | 19.02* (10.34) | 15.42 (8.67) | 9.6 (7.20) |
| Mobility: F(5, 1119) = 4.9, P < 0.001 | 2.43 (2.27) | 2.33 (2.45) | 1.84 (2.21) | 2.79 (2.46) | 2.43 (2.22) | 1.22 (1.77) |
| Occupational activity F(5, 1119) = 11.3, P < 0.001 | 3.48 (2.05) | 3.36 (2.52) | 2.45 (2.24) | 3.82 (2.46) | 2.80 (2.06) | 2.00 (2.00) |
| Cognition F(5,1119) = 8.5, P < 0.001 | 2.61 (1.96) | 2.68 (2.28) | 1.99 (2.08) | 3.22 (2.31) | 2.29 (2.07) | 1.56 (1.89) |
| Participant F(5, 1119) = 11.7, P < 0.001 | 4.34 (2.12) | 4.04 (2.32) | 3.16 (2.35) | 4.45 (2.21) | 3.94 (2.09) | 2.61 (1.91) |
| Hygiene F(5,1119) = 2.4, P = 0.035 | 1.39 (1.87) | 1.37 (2.01) | 1.03 (1.85) | 1.45 (1.90) | 1.24 (1.77) | 0.44 (0.86) |
| Social life F(5, 1119) = 6.1, P < 0.001 | 3.01 (2.25) | 2.57 (2.35) | 2.17 (2.17) | 3.25 (2.48) | 2.71 (2.18) | 1.78 (1.63) |
Note. n = 1,125. Post hoc comparisons were made comparing mean in each category against the mean in all the other categories.
*P < 0.001.
Psychometric Properties of WHODAS-2
The global WHODAS-2 mean was 15.11 (SD = 10.11). Ceiling effects were minimal, ranging from 0.2% to 6.3% for the different domains. The floor effect was most pronounced for hygiene scores reaching 61.4%, suggesting little disability in this domain. Cronbach alpha coefficients ranged from 0.59 to 0.85 across domain subscores and was 0.88 for the global WHODAS-2 score. See Table 3 for distribution of WHODAS-2 scores and reliability coefficients.
Table 3.
Distribution of WHODAS-2 Scores and Reliability Coefficients.
| WHODAS-2/Domains | Mean | Standard Deviations | Observed Range | Floor (%) | Ceiling (%) | Cronbach’s Alpha (95% CI) |
|---|---|---|---|---|---|---|
| Total | 15.11 | 10.11 | 0 to 48 | 5.5 | 0.2 | 0.88 (0.87 to 0.89) |
| Mobility | 2.19 | 2.34 | 0 to 8 | 38.5 | 3.7 | 0.71 (0.68 to 0.74) |
| Occupational activity | 3 | 2.37 | 0 to 8 | 22.2 | 3.6 | 0.68 (0.64 to 0.72) |
| Cognition | 2.42 | 2.19 | 0 to 8 | 28.2 | 2 | 0.67 (0.64 to 0.71) |
| Participation | 3.74 | 2.34 | 0 to 8 | 12.3 | 6.3 | 0.59 (0.54 to 0.63) |
| Hygiene | 1.23 | 1.90 | 0 to 8 | 61.4 | 1.2 | 0.85 (0.83 to 0.87) |
| Social life | 2.53 | 2.29 | 0 to 8 | 28.6 | 2.6 | 0.68 (0.64 to 0.72) |
Note. n = 1,125.
Factor structure
CFA results presented acceptable goodness of fit indices (CFI was above 0.95 [0.956] and the upper part of the 90% confidence interval of the RMSEA was lower than 0.08), confirming that the two-level CFA fit the data well. When testing for metric invariance (equal loadings across sex), the scaled χ2 difference was not significant (χ2 = 16.926, df = 11, P = 0.11). However, when testing for scalar invariance (equal loadings and intercepts), the scaled χ2 difference was statistically significant (χ2 = 27.43, df = 5, P < 0.0001). Intercepts of the men were between 0.003 and 0.482 lower than intercepts of the women, suggesting that women reported higher disability scores for most items compared to men. CFA results are presented in Figure 1.
Figure 1.
Factor structure of the WHODAS-2 and confirmatory factor analysis.
Discussion
In this large-scale study of adults admitted to psychiatric emergency, we described and compared WHODAS-2 scores (12-item version) across psychiatric diagnoses and assessed psychometric properties. To our knowledge, this constitutes the first large-scale investigation to evaluate the WHODAS-2 in a psychiatric emergency setting. It is important to verify that the WHODAS-2 remains valid in psychiatric emergency contexts where efficient disability assessment must be performed for those presenting with severe psychopathology and heightened emotional states.
WHODAS-2 Scores by Psychiatric Profile
Individuals with anxiety, mood, and personality disorders reported significantly higher mean WHODAS-2 scores (P < 0.001) indicating worse functional disability compared to those with other psychopathologies.
Increasing evidence indicates that anxiety and mood disorders are associated with more severe functional impairment than other mental disorders. 26,38 In one study, anxiety and mood disorders ranked seventh of the top 10 disorders with the greatest impact on work loss days as assessed by WHODAS-2. 39 Recent studies using the WHODAS-2 suggest that depression is associated with more severe disability than other disorders including bipolar disorders, generalized anxiety disorders, and schizophrenia. 14,19 While Sjonnesen et al. reported less impairment for depressed participants diagnosed in the past 12 months than for other psychiatric groups, depressed individuals diagnosed in the past month had a higher WHODAS-2 mean score than any other group. 14 This is consistent with work indicating that functional impairments follow depressive symptomatology and subside as symptoms improve. 40
In our study, participants with personality disorders obtained the highest WHODAS-2 score although scores did not significantly differ from participants with anxiety and mood disorders. This is consistent with studies indicating more severe impairment in individuals with personality disorders. Adults suffering from comorbid axis I and II disorders tend to exhibit more impaired functioning than those with a single axis I disorder, 41 –43 and personality disorders have been associated with poorer quality of life and worse functional impairments than axis I disorders in individuals with no comorbid psychopathologies. 44 Schizotypal and borderline personality disorders have been associated with more severe impairments than major depressive disorder 30 although we were unable to examine functioning associated with specific personality disorders in our study.
Individuals recruited in a psychiatric emergency setting are likely to demonstrate more severe functional impairment than those recruited in non-emergency contexts given the heightened symptomatology experienced during a crisis. Our results support this hypothesis. Compared to previously reported WHODAS-2 scores for depressive disorder (mean score = 27.14/100 17 ) and bipolar disorder (mean score = 19.23/100 for subsyndromic patients and mean score = 12.69/100 for asymptomatic patients in a euthymic phase 27 ), our mood disorders score (mean score = 34/100; Table 2 mood disorders score rescaled on 100) falls at the higher end of the spectrum. Similarly, our study’s mood disorders group scored significantly higher than Sjonnesen et al.’s depression group (diagnosed in the past month; P < 0.0001) suggesting more severe disability within a psychiatric emergency context. 14 Furthermore, the anxiety disorders, mood disorders, and substance abuse groups all reported significantly more functional impairment than participants in the Sjonnesen et al.’s depression (past 12 months), general anxiety disorders, and bipolar disorders groups (P < 0.0001). 14 While these findings indicate that psychiatric emergency patients suffer more severe functional impairment than their non-emergency counterparts, results should be interpreted with caution given heterogeneity between studies and lack of sufficient comparative data.
Surprisingly, in our study, the psychotic disorders group did not score significantly higher than other groups nor did they exhibit more severe functional impairment than non-emergency patients with similar diagnoses in the literature. Psychosocial impairment is considered a core feature of psychotic disorders. 45 Individuals diagnosed with schizophrenia have difficulties with basic social roles, interpersonal relationships, and occupational activities, 46 and neurocognitive deficits are thought to be predictive of these impairments. 47 Schizophrenia has been associated with worse disability than bipolar disorder, 47,48 depression, 49 schizoaffective disorders, 49,50 anxiety disorders, substance abuse, and eating disorders. 38 Sjonnesen et al. also reported more severe disability associated with schizophrenia than depression (in the past 12 months, but not in the past month), generalized anxiety, and bipolar disorders. 14 In our study, those with psychotic disorders did not score higher than most other groups nor did they significantly differ from Sjonnesen et al.’s schizophrenia group (P = 0.56), 14 suggesting similar levels of impairment reported by emergency and non-emergency psychotic patients. A few explanations may account for these results. Individuals with psychotic disorders often experience a chronic course of illness where social and occupational impairments become more permanent states. 51 Thus, they may develop decreased awareness of their deficits and may underreport them. Reciprocally, previous studies suggest that individuals with depression experience increased awareness of their deficits and exaggerate their self-report. 52 The combination of these perceptual biases may explain why our mood disorders group is more functionally impaired than our psychotic disorders group. It is also possible that the WHODAS-2 items regarding occupational activities may not capture the long-term disability experienced by those with psychotic disorders since respondents evaluate difficulties over the past 30 days. Finally, psychotic patients admitted to emergency likely differ from their non-emergency counterparts on their level of insight. Participants in Sjonnesen et al.’s study may have greater insight since they self-reported their diagnoses, 14 while psychotic patients recruited in an emergency setting may have reduced insight and may have been admitted to the hospital by a third party. Previous studies report problems with self-reports of functioning in schizophrenia due to lack of insight, 53 and it has been suggested that the WHODAS-2 should be used alongside a clinician-rated measure for patients with psychotic disorders. 18
Psychometric Properties of WHODAS-2
This study confirms that the WHODAS-2 12-item version demonstrates good psychometric properties among psychiatric patients in an emergency context. Acceptable goodness of fit indices in a two-level CFA confirms the structure of the WHODAS-2 in six domains. The instrument presents high reliability for the global score and moderate to high reliability across domain subscores. Previous studies in individuals with physical and mental disorders have consistently supported good reliability of the 12- and 36-item versions of the WHODAS-2. 4,11,17,18,20,25,32 The reliability coefficients of the 12-item scale were previously found to be lower for the domain subscores than for the global score, likely explained by the few items per domain. 11
Consistent with previous literature, we found minimal ceiling effects, but floor effects were present in most domains suggesting that the 12-item scale may not differentiate among low levels of disability. 4,19 One may have anticipated higher disability scores in the cognitive and hygiene domains for the psychotic disorders group since those with schizophrenia often suffer from neurocognitive deficits and difficulties with basic life skills, 47,54 and self-care impairments tend to be associated with the most severe cases of mental illness. 13,19,27 However, in line with previous findings, we observed floor effects for hygiene, suggesting that this domain is largely reported to be unaffected in many individuals suffering from mental disorders. 4,19
Findings from our CFA are consistent with previous studies supporting the six-domain structure of the WHODAS-2 in both the 12-item and 36-item versions. 4,11,55 –57 Six first-order factors were found to best fit the data and to be most representative of the scale’s factorial structure. Our findings support the validity of the instrument’s theoretical framework 4 ; notably, the ICF’s biopsychosocial model of disability characterized by the interconnectedness of mental and physical health. The WHODAS-2’s robust construct validity may partly explain why a general measure of disability seems to align with the needs of mental health services.
Limitations of the Study
Our study did not include a control group representative of the general community. Based on normative data for the 12-item WHODAS-2 scale, however, all of our psychiatric groups except for the “other disorders” group scored in the top 10% of the population distribution of WHODAS-2 scores, suggesting clinically significant disability. 10 Further, all groups scored significantly higher on the WHODAS-2 than the community sample reported in the Sjonnesen et al. study (P < 0.0001). 14 Also, the specificity of our results is limited by the presence of comorbid disorders in psychiatric populations. Individuals with one mental disorder have increased odds of meeting the criteria of another disorder, and patients can sometimes be diagnosed with three or more psychopathologies. 58 Finally, our sample may not be entirely representative of all patients admitted to psychiatric emergency since it is likely that some of the most severely impaired individuals may have been unfit to participate.
Conclusion
Our findings could assist clinicians in interpreting WHODAS-2 scores in psychiatric populations and provide a more detailed portrait of disability profiles associated with common mental disorders. Findings may be particularly relevant for those working with more severe cases and at more acute stages of illness. Based on comparisons with previously reported normative data for the general population, the 12-item WHODAS-2 scale appears sensitive to functional disability associated with mental disorders, and psychometric properties remain adequate for use in psychiatric emergency settings. With its brief format and sensitivity to change in various psychopathologies, the 12-item WHODAS-2 offers promising clinical implications for the assessment of disability in urgent care. For those with psychotic disorders, given the potential self-report difficulties associated with reduced insight, global functioning would be likely best evaluated using a combination of the WHODAS-2 and other tools.
Acknowledgments
The authors thank the Signature Consortium of the IUSMM for making the Signature Bank data available to researchers and the psychiatric emergency patients of the IUSMM for participating in this study.
Footnotes
Declaration of Conflicting Interests: The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: The Signature Bank is supported by a donation from Bell Canada Enterprises to the Foundation of the IUSMM and by a research grant from the Fonds de Recherche du Québec-Santé (FRQ-S). The Research Center of the IUSMM is supported by a grant from the FRQ-S. This study was supported by the IUSMM project. A.H. holds a doctoral award and C.M.H a salary award from the FRQ-S.
ORCID iD: R. Labelle https://orcid.org/0000-0002-5661-9254
References
- 1. Whiteford HA, Degenhardt L, Rehm J, et al. Global burden of disease attributable to mental and substance use disorders: findings from the global burden of disease study 2010. Lancet. 2013;382(9904):1575–1586. [DOI] [PubMed] [Google Scholar]
- 2. Haveman R, Wolfe B. The economics of disability and disability policy. Handb Health Econ. 2000;1:995–1051. [Google Scholar]
- 3. Vos T, Flaxman AD, Naghavi M, et al. Years lived with disability (YLDs) for 1160 sequelae of 289 diseases and injuries 1990–2010: a systematic analysis for the global burden of disease study 2010. Lancet. 2012;380(9859):2163–2196. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Guilera G, Gómez-Benito J, Pino O, et al. Utility of the World Health Organization Disability Assessment Schedule II in schizophrenia. Schizophr Res. 2012;138(2-3):240–247. [DOI] [PubMed] [Google Scholar]
- 5. World Health Organization. International Classification of Functioning, Disability and Health: ICF. Geneva, Switzerland: World Health Organization; 2001. [Google Scholar]
- 6. Thomas CC, Rathod SD, De Silva MJ, Weiss HA, Patel V. The 12-item WHO Disability Assessment Schedule II as an outcome measure for treatment of common mental disorders. Glob Ment Health. 2016;3:e14. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Rosenbaum P, Stewart D. The World Health Organization International Classification of Functioning, Disability, and Health: a model to guide clinical thinking, practice and research in the field of cerebral palsy. Semin Pediatr Neurol. 2004;11(1):5–10. [DOI] [PubMed] [Google Scholar]
- 8. American Psychiatric Association. Diagnostic and Statistical Manual. 4th ed, Washington, (DC): American Psychiatric Publishing; 1994. [Google Scholar]
- 9. Vatnaland T, Vatnaland J, Friis S, Opjordsmoen S. Are GAF scores reliable in routine clinical use? Acta Psychiatr Scand. 2007;115(4):326–330. [DOI] [PubMed] [Google Scholar]
- 10. Andrews G, Kemp A, Sunderland M, Von Korff M, Ustun TB. Normative data for the 12 item WHO disability assessment schedule 2.0. PloS One. 2009;4(12):e8343. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Carlozzi NE, Kratz AL, Downing NR, et al. Validity of the 12-item World Health Organization Disability Assessment Schedule 2.0 (WHODAS 2.0) in individuals with Huntington disease (HD). Qual Life Res. 2015;24(8):1963–1971. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Üstün TB. Measuring Health and Disability: Manual for WHO Disability Assessment Schedule WHODAS 2.0. Geneva, Switzerland: World Health Organization; 2010. [Google Scholar]
- 13. McKibbin C, Patterson TL, Jeste DV. Assessing disability in older patients with schizophrenia: results from the WHODAS-II. J Nerv Ment Dis. 2004;192(6):405–413. [DOI] [PubMed] [Google Scholar]
- 14. Sjonnesen K, Bulloch AG, Williams J, Lavorato D, B Patten S. Characterization of disability in Canadians with mental disorders using an abbreviated version of a DSM-5 emerging measure: the 12-item WHO Disability Assessment Schedule (WHODAS) 2.0. Can J Psychiatry. 2016;61(4):227–235. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Baron M, Schieir O, Hudson M, et al. The clinimetric properties of the World Health Organization Disability Assessment Schedule II in early inflammatory arthritis. Arthritis Rheumatol. 2008;59(3):382–390. [DOI] [PubMed] [Google Scholar]
- 16. Chisolm TH, Abrams HB, McArdle R, Wilson RH, Doyle PJ. The WHODAS II: psychometric properties in the measurement of functional health status in adults with acquired hearing loss. Trends Amplif. 2005;9(3):111–126. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Chwastiak LA, Von Korff M. Disability in depression and back pain: evaluation of the World Health Organization Disability Assessment Schedule (WHODAS II) in a primary care setting. J Clin Epidemiol. 2003;56(6):507–514. [DOI] [PubMed] [Google Scholar]
- 18. Chopra PK, Couper JW, Herrman H. The assessment of patients with long-term psychotic disorders: application of the WHO Disability Assessment Schedule II. Aust N Z J Psychiatry. 2004;38(9):753–759. [DOI] [PubMed] [Google Scholar]
- 19. Garin O, Ayuso-Mateos JL, Almansa J, et al. Validation of the “World Health Organization Disability Assessment Schedule, WHODAS-2” in patients with chronic diseases. Health Qual Life Outcomes. 2010;8(1):1–15. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Hudson M, Steele R, Taillefer S, Baron M. Quality of life in systemic sclerosis: psychometric properties of the World Health Organization Disability Assessment Schedule II. Arthritis Rheumatol. 2008;59(2):270–278. [DOI] [PubMed] [Google Scholar]
- 21. Magistrale G, Pisani V, Argento O, et al. Validation of the World Health Organization Disability Assessment Schedule II (WHODAS-II) in patients with multiple sclerosis. Mult Scler J. 2015;21(4):448–456. [DOI] [PubMed] [Google Scholar]
- 22. Perini SJ, Slade T, Andrews G. Generic effectiveness measures: sensitivity to symptom change in anxiety disorders. J Affect Disord. 2006;90(2-3):123–130. [DOI] [PubMed] [Google Scholar]
- 23. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (DSM-5). Washington, (DC): American Psychiatric Publishing; 2013. [Google Scholar]
- 24. Bilsker D, Wiseman S, Gilbert M. Managing depression-related occupational disability: a pragmatic approach. Can J Psychiatry. 2006;51(2):76–83. [DOI] [PubMed] [Google Scholar]
- 25. Hendriks SM, Spijker J, Licht CM, et al. Disability in anxiety disorders. J Affect Disord. 2014;166:227–233. [DOI] [PubMed] [Google Scholar]
- 26. Ormel J, VonKorff M, Üstün TB, Pini S, Korten A. Common mental disorders and disability across cultures: results from the WHO collaborative study on psychological problems in general health care. JAMA. 1994;272(22):1741–1748. [DOI] [PubMed] [Google Scholar]
- 27. Bonnin CM, Sanchez-Moreno J, Martinez-Aran A, et al. Subthreshold symptoms in bipolar disorder: impact on neurocognition, quality of life and disability. J Affect Disord. 2012;136(3):650–659. [DOI] [PubMed] [Google Scholar]
- 28. Huxley N, Baldessarini RJ. Disability and its treatment in bipolar disorder patients. Bipolar Disord. 2007;9(1-2):183–196. [DOI] [PubMed] [Google Scholar]
- 29. Wiersma D, Wanderling J, Dragomirecka E, et al. Social disability in schizophrenia: its development and prediction over 15 years in incidence cohorts in six European centres. Psychol Med. 2000;30(5):1155–1167. [DOI] [PubMed] [Google Scholar]
- 30. Skodol AE, Gunderson JG, McGlashan TH, et al. Functional impairment in patients with schizotypal, borderline, avoidant, or obsessive-compulsive personality disorder. Am J Psychiatry. 2002;159(2):276–283. [DOI] [PubMed] [Google Scholar]
- 31. Compton WM, Thomas YF, Stinson FS, Grant BF. Prevalence, correlates, disability, and comorbidity of DSM-IV drug abuse and dependence in the United States: results from the national epidemiologic survey on alcohol and related conditions. Arch Gen Psychiatry. 2007;64(5):566–576. [DOI] [PubMed] [Google Scholar]
- 32. Verboom CE, Sentse M, Sijtsema JJ, Nolen WA, Ormel J, Penninx BW. Explaining heterogeneity in disability with major depressive disorder: effects of personal and environmental characteristics. J Affect Disord. 2011;132(1-2):71–81. [DOI] [PubMed] [Google Scholar]
- 33. Huang Y, Kotov R, De Girolamo G, et al. DSM–IV personality disorders in the WHO World Mental Health Surveys. Br J Psychiatry. 2009;195(1):46–53. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. R Core Team. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2018. [Google Scholar]
- 35. Revelle W. Procedures for personality and psychological research. R package version, 1. Northwestern University, Evanston; 2014. [Google Scholar]
- 36. Rosseel Y. Lavaan: an R package for structural equation modeling and more. Version 0.5–12 (BETA). Ghent University, Ghent, Belgium; 2012. [Google Scholar]
- 37. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16(3):297–334. [Google Scholar]
- 38. Bijl RV, Ravelli A. Current and residual functional disability associated with psychopathology: findings from the Netherlands Mental Health Survey and Incidence Study (NEMESIS). Psychol Med. 2000;30(3):657–668. [DOI] [PubMed] [Google Scholar]
- 39. Alonso J, Angermeyer MC, Bernert S, et al. Disability and quality of life impact of mental disorders in Europe: results from the European Study of the Epidemiology of Mental Disorders (ESEMeD) project. Acta Psychiatr Scand. 2004;109(420):38–46. [DOI] [PubMed] [Google Scholar]
- 40. Spijker JAN, De Graaf R, Bijl RV, Beekman AT, Ormel J, Nolen WA. Duration of major depressive episodes in the general population: results from The Netherlands Mental Health Survey and Incidence Study (NEMESIS). Br J Psychiatry. 2002;181(3):208–213. [DOI] [PubMed] [Google Scholar]
- 41. Klass ET, DiNardo PA, Barlow DH. DSM-III-R personality diagnoses in anxiety disorder patients. Compr Psychiat. 1989;30(3):251–258. [DOI] [PubMed] [Google Scholar]
- 42. Noyes R, Reich J, Christiansen J, Suelzer M, Pfohl B, Coryell WA. Outcome of panic disorder: relationship to diagnostic subtypes and comorbidity. Arch Gen Psychiatry. 1990;47(9):809–818. [DOI] [PubMed] [Google Scholar]
- 43. Skodol AE, Oldham JM, Gallaher PE. Axis II comorbidity of substance use disorders among patients referred for treatment of personality disorders. Am J Psychiatry. 1999;156(5):733–738. [DOI] [PubMed] [Google Scholar]
- 44. Cramer V, Torgersen S, Kringlen E. Personality disorders and quality of life. a population study. Compr Psychiatry. 2006;47(3):178–184. [DOI] [PubMed] [Google Scholar]
- 45. Brissos S, Palhava F, Marques JG, et al. The Portuguese version of the Personal and Social Performance Scale (PSP): reliability, validity, and relationship with cognitive measures in hospitalized and community schizophrenia patients. Soc Psychiatry Psychiatr Epidemiol. 2012;47(7):1077–1086. [DOI] [PubMed] [Google Scholar]
- 46. Bellack AS, Green MF, Cook JA, et al. Assessment of community functioning in people with schizophrenia and other severe mental illnesses: a white paper based on an NIMH-sponsored workshop. Schizophr Bull. 2006;33(3):805–822. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47. Bowie CR, Depp C, McGrath JA, et al. Prediction of real-world functional disability in chronic mental disorders: a comparison of schizophrenia and bipolar disorder. Am J Psychiatry. 2010;167(9):1116–1124. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48. Cannon M, Jones P, Gilvarry C, et al. Premorbid social functioning in schizophrenia and bipolar disorder: similarities and differences. Am J Psychiatry. 1997;154(11):1544–1550. [DOI] [PubMed] [Google Scholar]
- 49. Weiler MA, Fleisher MH, McArthur-Campbell D. Insight and symptom change in schizophrenia and other disorders. Schizophr Res. 2000;45(1-2):29–36. [DOI] [PubMed] [Google Scholar]
- 50. Bottlender R, Strauß A, Möller HJ. Social disability in schizophrenic, schizoaffective and affective disorders 15 years after first admission. Schizophr Res. 2010;116(1):9–15. [DOI] [PubMed] [Google Scholar]
- 51. Gómez P, Enders J, Cometto MC, Fernández AR. Evaluación del funcionamiento psicosocial de los pacientes con trastornos mental. Rev Fac Cien Med. 2016;72(4):243–249. [PubMed] [Google Scholar]
- 52. Rush AJ, Hiser W, Giles DE. A comparison of self-reported versus clinician-rated symptoms in depression. J Clin Psychiatry. 1987;48(6):246–248. [PubMed] [Google Scholar]
- 53. Bowie CR, Twamley EW, Anderson H, Halpern B, Patterson TL, Harvey PD. Self-assessment of functional status in schizophrenia. J Psychiatr Res. 2007;41(12):1012–1018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54. Hernández-Orduña O, Robles-García R, Martínez-López N, et al. WHODAS and the evaluation of disability among people with mental disorders with and without psychotic symptoms. Salud Ment. 2017;40(5):209–218. [Google Scholar]
- 55. Üstün TB, Chatterji S, Kostanjsek N, et al. Developing the World Health Organization Disability Assessment Schedule 2.0. Bull World Health Org. 2010;88(11):815–823. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56. Pösl M, Cieza A, Stucki G. Psychometric properties of the WHODASII in rehabilitation patients. Qual Life Res. 2007;16(9):1521–1531. [DOI] [PubMed] [Google Scholar]
- 57. Scorza P, Stevenson A, Canino G, et al. Validation of the “World Health Organization Disability Assessment Schedule for Children, WHODAS-Child” in Rwanda. PloS One. 2013;8(3):e57725. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58. Kessler RC. The national comorbidity survey of the United States. Int Rev Psychiatry. 1994;6(4):365–376. [Google Scholar]

