Abstract
The authors define measurement-based care (MBC) in psychiatry as the use of validated clinical measurement instruments to objectify the assessment, treatment, and clinical outcomes, including efficacy, safety, tolerability, functioning, and quality of life, in patients with psychiatric disorders. MBC includes two processes: routine assessments, such as measuring the severity of symptoms with rating scales, and the use of assessments in decision-making. MBC implementation was tested in the Texas Medication Algorithm Project and the German Algorithm Project and has been shown to improve patient outcomes. Even though more recent research has shown the many benefits of MBC compared to the usual care, MBC is still not the standard of care in psychiatric practice. This review article addresses the advantages of MBC, the barriers to implementing MBC in clinical practice, and the basic properties of MBC instruments. Recent developments in the 21st century that are expected to accelerate the adoption of MBC in clinical practice, including electronic health records, health information technology, and the development of the Standard for Clinicians’ lnterview in Psychiatry (SCIP) as an MBC tool, will be reviewed. The authors recommend including MBC in psychiatry residency training to promote its use in future generations.
Keywords: Measurement-based care (MBC), Standard for Clinicians’ lnterview in Psychiatry (SCIP), assessment, psychopathology, assessment tool, rating scale, reliability, validity, outcomes measures, clinical trial
In science, measurement is defined as “rules for assigning numbers to objects in such a way as to represent quantities of attributes.”1 Scientific measurements cannot be valid if they are not reliable. Attributes, reliability, and validity are all crucial to conducting any research. Once scientifically credible measurements are created, testing hypotheses and conducting meaningful clinical trials become possible, leading to advances in science and medicine.
Measurement in psychiatry can be traced back to 1825 when a royal commission was issued to enumerate and measure the “condition of the insane” in the kingdom of Norway. Professor Holst published the results of the survey, which was repeated in 1835 and 1845. The survey results are fascinating and described patients with “mania, melancholia, dementia, idiotia, blind in one eye or two eyes, deaf, dumb, and lepers,” classified by sex and by rural and urban districts.2 Major advances in science are preceded by breakthroughs in measurement methods. This was demonstrated in the field of psychology by the flood of research following the development of intelligence tests and the intelligence quotient (IQ) in 1912.1
The term measurement-based care (MBC) was coined by Trivedi in 2006 and was defined as “the routine measurement of symptoms and side effects at each treatment visit and the use of a treatment manual describing when and how to modify medication doses based on these measures.”3 Other authors had similar definitions: Harding defined MBC as “enhanced precision and consistency in disease assessment, tracking, and treatment to achieve optimal outcomes,”4 Arbuckle defined MBC as “a step-by-step approach for assessing, treating, reviewing outcomes and revising treatment in managing medical diseases,”5 and Fortney defined MBC as “the systematic administration of symptom rating scales and use of the results to drive clinical decision making at the level of the individual patient.”6 Our working definition of MBC in psychiatry is “the use of validated clinical measurement instruments to objectify the assessment, treatment and clinical outcomes, including efficacy, safety, tolerability, functioning, and quality of life, in patients with psychiatric disorders.”
MBC refers to two processes: routine assessments, such as measuring the severity of symptoms with rating scales, and the use of assessments in decision-making. The development of rating scales and diagnostic interview schedules during the second half of the 20th century, as well as their use in psychiatric research and clinical trials, was an important catalyst for the development and implementation of MBC. With the publications of Diagnostic and Statistical Manual of Mental Disorders, Third Edition (DSM-III) in 1980 and its widespread use worldwide, psychiatric research and clinical trials flourished as geneticists, pharmacologists, and neuroscientists became research partners with investigative psychiatrists.7 More clinical trials were conducted to assess the efficacy and safety of the new psychotropic medications all over the world.8–16 With the availability of rating scales and standardized diagnostic interviews, the Texas Medication Algorithm Project (TMAP) and the German Algorithm Project (GAP) tested the implementation of MBC in outpatient and inpatient clinical settings and have shown that MBC can positively impact patient outcomes.17–19 Even though the term measurement-based care is relatively new in psychiatric literature, it has been an integral component of randomized, clinical trials for decades.20
The other popular and common method of caring for patients is the “standard” or “usual” care that has been provided by clinicians daily for centuries. Usual standard care (USC) for patients involves the same two components of MBC: assessment and decision-making. Clinicians, by training, assess psychopathology and its severity and make decisions based on their assessment, without using rating scales or standardized diagnostic interviews. In 1933, Hardcastle et al studied the present condition of the first 100 patients (adults and children) who attended the Department of Psychological Medicine at Guy’s Hospital in London in 1931. Although clinicians in 1933 did not have or use the Hamilton Depression Rating Scale (HAM-D) or other scales we have today, they evaluated the patients and grouped them into four main groups: much improved, improved, unchanged, or worse. Based on their evaluations, they made decisions to admit or treat patients accordingly. The Hardcastle study was published in the Journal of Mental Science in 1934.21 In the same journal and during the same year, Lewis22 published a 102-page monograph describing in great detail the symptoms and signs of 61 cases of “depressive state,” all examined and treated by Lewis between the years 1928and 1929 in the Maudsley Hospital in London, England. One might make the case that psychiatrists at Guy’s and Maudsley’s hospitals in 1934 had more expertise in psychopathology assessment than today’s psychiatrists because one of the unintended consequences of the DSM era is the limitation of psychopathology training according to DSM and International Statistical Classification of Diseases and Related Health Problems (ICD) criteria.23
Recent research has shown the superiority of MBC compared to USC in improving patient outcomes.6,24–26 A recent, well-designed, blind-rater, randomized trial by Guo et al17 showed that MBC, per se, is more effective than USC in achieving response and remission and lowering the time to response and remission. Given the evidence of the benefits of MBC in improving patient outcomes, an important question arises: Why has MBC not yet been established as the standard of care in clinical practice?
This review article addresses the advantages of MBC, the barriers to implementing MBC in clinical practice, and important contemporary developments in the 21st century that are expected to accelerate the adoption of MBC in clinical practice.
ADVANTAGES OF MBC
Research over the past 20 years has shown that MBC improves the quality of patient care, and leaders in the mental health field have been calling for the integration of MBC into routine care.6 Compared to the usual care, MBC has been shown to do the following:
-
1.
Improve psychotherapy outcomes6
-
2.
Monitor symptom reduction in patients with psychiatric disorders, such as anxiety, depression, and bipolar27–29
-
3.
Identify patients who are improving and those who are deteriorating6,30,31
-
4.
Improve role functioning, satisfaction with care, quality of care, and quality of life24,29,32
-
5.
Enhance the therapeutic relationship and communication between providers and patients6
- 6.
- 7.
-
8.
Close the gap between research and practice, and move psychiatry into the mainstream of medicine4
- 9.
-
10.
Enhance individualized treatment34
-
11.
Be transdiagnostic and transtheoretical24
- 12.
BARRIERS TO MBC
Even though recent research has shown the many benefits of MBC compared to USC, MBC is still not the standard of care in clinical settings, and a small proportion of clinicians use outcome assessments.4,39 Many psychiatric measures with good psychometric properties have been developed and tested over the past decades (e.g., standardized diagnostic interviews, rating scales, and self-rating scales).40–54 However, most of these measures are used in research and clinical trials and not in clinical settings. A study by Hatfield26 reported that 37.1 percent of clinicians use some form of outcome assessments, and 62.9 percent do not use any outcome measures. Zimmerman55 reported that more than 80 percent of psychiatrists indicated they did not routinely use scales to monitor outcome when treating depression. In a survey of psychiatric practitioners, Nasrallah56 reported that 98 percent of psychiatrists indicated they do not use any of the four clinical rating scales routinely used in clinical trials and are required for the United States Food and Drug Administration (FDA) approval of psychiatric medications. These four scales are 1) Positive and Negative Syndrome Scale (PANSS), 2) Young Mania Rating Scale (YMRS), 3) HAM-D, and 4) Montgomery-Asberg Depression Rating Scale (MADRS). The vast majority of the surveyed participants attributed their avoidance of rating scales to “lack of time.” Many other authors have noted that clinicians do not use standardized scales in clinical practice.57–63 Barriers to implementing MBC are summarized in Table 1.
TABLE 1.
1. Measures are time consuming (most commonly cited reason by psychiatrists)55,56,61 |
2. Measures are designed for research use and not for clinician use56,63 |
3. Ratings produced by measures might not always be clinically relevant64,65 |
4. Administering rating scales might interfere with establishing rapport with patients66 |
5. The perception that measures are not more useful than clinical assessment55,66 |
6. The perception that MBC is over-systematizing and depersonalizing4 |
7. Some measures, such as standardized diagnostic interviews, can be cumbersome, unwieldy, and complicated64 |
8. Cost and lack of resources to implement MBC26 |
9. Limited formal training (included in top two barriers for residents and faculty)26,66 |
10. Lack of protocols and training manuals24 |
11. Lack of consensus as to which instrument to use for a given disorder66 |
12. Absence of a requirement to use MBC—few work settings require MBC26,66 |
13. Lack of incentives to use MBC |
14. Complexity of patients with multiple overlapping comorbidities |
15. The perception that measures “restrict the flexibility and creativity” of the interviewer |
Additionally, theoretical orientation was described as a potential barrier for insight-oriented therapists, who were less likely than cognitive or behavioral therapists to use outcome measures.39 However, a recent article by Scott24 demonstrated that clinicians can implement MBC regardless of their theoretical orientation or training background.
IMPLEMENTATION OF MBC
To encourage clinicians to use measures in clinical care decisions, measures should have the following basic properties:
-
1.
Efficient (Measures should be brief and not time-consuming to the clinician.4,67 A rating scale completed by the clinician should take no more than a few minutes to administer.)
-
2.
Established as reliable and valid4
-
3.
User-friendly and a reflection of what clinicians do in clinical settings67
-
4.
Brief (Self-rating scales completed by patients should take no more 2–3 minutes to complete) and simple (Directions should be easy to follow to improve patient willingness to take the test at each follow up visit.)68
-
5.
Clinically meaningful and useful, covering the criteria and symptom domains of the disorder67
-
6.
Clinically relevant to decision-making65
-
7.
Easily extractable and not embedded in progress notes6
-
8.
Sensitive to changes induced by medications or psychotherapy.69
DEVELOPMENT OF THE STANDARD FOR CLINICIANS’ INTERVIEW IN PSYCHIATRY (SCIP) AND THE SCIP SCALES AS AN MBC TOOL
After Ahmed Aboraya (first author) finished his master’s and doctoral degrees at Johns Hopkins University in 1991, he started his psychiatry residency training with a determination to use psychiatric measures in clinical settings. Disappointed after 10 years of trying to use almost all of the relevant existing scales and standardized diagnostic interviews for adult psychiatric disorders, Aboraya concluded that existing measures were not practical for use in the real world of psychiatric practice. Consequently, he embarked on developing the Standard for Clinicians’ Interview in Psychiatry (SCIP) as a tool for clinicians in real clinical settings for assessment and decisions-making. In other words, the SCIP was designed from the outset as an MBC tool. The SCIP was tested in an international, multisite study in three countries (United States, Canada, and Egypt) between the years 2000 and 2012. The total sample size, including all sites, was 1,004 subjects, making the SCIP project the largest validity and reliability study to be conducted on diagnostic interviews in psychiatry.47,48,64 The details of the design of the SCIP project were published in 2014.48 In addition to being the only tool designed from the outset for use in MBC, the SCIP has two unique advantages: the development of comprehensive and reliable items measuring psychopathology and the creation of reliable and validated SCIP scales for adult psychiatric disorders.
The development of reliable psychopathology items. Inter-rater reliability (Kappa) of the SCIP was measured on 150 items covering anxiety, panic, obsessive compulsive disorder (OCD), posttraumatic stress disorder (PTSD), depression, mania, psychosis, disorganized behavior, negative symptoms, alcohol, and drug psychopathology domains.48 To calculate stable Kappa for attention deficit hyperactivity disorder (ADHD) and eating disorders, an additional 40 young and predominantly female patients were interviewed at William R. Sharpe, Jr. Hospital and Chestnut Ridge Center by at least two interviewers at the same time (to establish inter-rater reliability). The mean patient age was 35, with 68 percent being female, 90 percent being white, and 73 percent completing at least 12 years of education. If the patient was interviewed by three interviewers (i.e., A, B, C), a comparison was made between interviewer A and B, A and C, and B and C. A total of 75 comparisons allowed the calculation of stable Kappa for ADHD and eating disorders. Table 2 shows inter-rater reliability agreement (Kappa) and the standard error for 206 psychopathology items based on the interviews of 322 patients from William R. Sharpe Jr. Hospital, Chestnut Ridge Center (inpatient and outpatient), Ain Shams University Hospital, and Mansoura University Hospital. The mean patient age was 33, with 45 percent being female, 97 percent being white, and 63 percent completing at least 12 years of education. Five items (Item Numbers 102, 104, 167, 184, and 186) had unstable Kappa, and 201 items had stable Kappa. Out of 201 items with stable Kappa, 165 items (82%) had satisfactory agreement (κ>0.7), 30 items (15%) had fair agreement (κ=0.5 to 0.7), and 6 items (3%) had poor agreement (κ<0.5).
TABLE 2.
ITEM # | SCIP ITEMS | TOTAL # OF POSITIVE CASES FOR A GIVEN ITEM | KAPPA (*) | SE | |
---|---|---|---|---|---|
1 | 1 | Generalized anxiety | 61 | 0.76 | 0.05 |
2 | 2 | Panic attacks | 54 | 0.81 | 0.05 |
3 | 3 | Agoraphobia | 26 | 0.52 | 0.05 |
4 | 4 | Social phobia | 22 | 0.51 | 0.05 |
5 | 5 | Screening for obsessions | 38 | 0.70 | 0.04 |
6 | 6 | Screening for compulsions | 31 | 0.58 | 0.05 |
7 | 7 | Witness or experience traumatic events | 69 | 0.75 | 0.05 |
8 | 8 | Re-experience traumatic events | 34 | 0.89 | 0.05 |
9 | 9 | Depressed mood | 158 | 0.86 | 0.04 |
10 | 10 | Anhedonia | 125 | 0.87 | 0.04 |
11 | 11 | Suicidal ideation, intention, plan | 79 | 0.61 | 0.04 |
12 | 12 | Elated mood | 76 | 0.72 | 0.05 |
13 | 13 | Irritable mood | 65 | 0.75 | 0.05 |
14 | 14 | Mixed mood (same day mood changes) | 44 | 0.50 | 0.05 |
15 | 15 | Paranoid delusions | 97 | 0.83 | 0.04 |
16 | 16 | Other delusions | 39 | 0.77 | 0.04 |
17 | 17 | Auditory hallucinations | 92 | 0.76 | 0.04 |
18 | 18 | Other hallucinations | 51 | 0.68 | 0.05 |
19 | 19 | Violence | 74 | 0.64 | 0.04 |
20 | 20 | Disorganized behavior | 32 | 0.54 | 0.04 |
21 | 21 | Disorganized thoughts | 39 | 0.65 | 0.04 |
22 | 22 | Alcohol problems | 53 | 0.89 | 0.06 |
23 | 23 | Drug problems | 17 | 0.78 | 0.06 |
24 | 24 | Somatic symptoms | 33 | 0.81 | 0.05 |
25 | 25 | Pain symptoms | 24 | 0.93 | 0.05 |
26 | 26 | Worry about weight and image | 12 | 0.73 | 0.05 |
27 | 27 | Binge eating | 27 | 0.97 | 0.12 |
28 | 28 | Poor attention | 11 | 0.73 | 0.05 |
29 | 29 | Hyperactivity | 14 | 0.58 | 0.05 |
30 | 1 | Panic attacks | 30 | 0.92 | 0.06 |
31 | 2 | Worry about having another panic attack | 25 | 0.81 | 0.04 |
32 | 3 | Action to prevent panic attacks | 26 | 0.87 | 0.04 |
33 | 4 | Generalized anxiety | 25 | 0.84 | 0.04 |
34 | 5 | Restlessness with anxiety | 26 | 0.74 | 0.04 |
35 | 6 | Tension with anxiety | 22 | 0.77 | 0.04 |
36 | 7 | Exhaustion with anxiety | 22 | 0.79 | 0.05 |
37 | 8 | Poor concentration with anxiety | 27 | 0.76 | 0.05 |
38 | 9 | Irritability with anxiety | 28 | 0.83 | 0.04 |
39 | 10 | Insomnia with anxiety | 25 | 0.82 | 0.05 |
40 | 11 | Obsessions | 26 | 0.85 | 0.04 |
41 | 12 | Compulsions | 18 | 0.77 | 0.04 |
42 | 1 | Experienced traumatic events | 10 | 0.83 | 0.05 |
43 | 2 | Distressing recollection of events | 30 | 0.88 | 0.05 |
44 | 3 | Bad dreams or nightmares | 26 | 0.94 | 0.05 |
45 | 4 | Flashback | 23 | 0.87 | 0.05 |
46 | 5 | Psychological distress due to events | 26 | 0.91 | 0.05 |
47 | 6 | Physical reactions due to events | 24 | 0.93 | 0.05 |
48 | 7 | Avoidance of thoughts and feelings | 27 | 0.94 | 0.05 |
49 | 8 | Avoidance of people, places | 27 | 0.94 | 0.05 |
50 | 9 | Amnesia | 15 | 0.70 | 0.06 |
51 | 10 | Diminished interest | 17 | 0.83 | 0.05 |
52 | 11 | Detachment and isolation | 22 | 0.87 | 0.05 |
53 | 12 | Diminished affect | 24 | 0.88 | 0.05 |
54 | 13 | Insomnia | 16 | 0.78 | 0.05 |
55 | 14 | Anger | 19 | 0.80 | 0.05 |
56 | 15 | Poor concentration | 14 | 0.78 | 0.05 |
57 | 16 | Hypervigilance | 17 | 0.87 | 0.05 |
58 | 17 | Startle response | 20 | 0.86 | 0.05 |
59 | 18 | Daze (feeling out of touch with surroundings) | 16 | 0.82 | 0.05 |
60 | 1 | Depressed mood | 128 | 0.91 | 0.04 |
61 | 2 | Anhedonia | 121 | 0.87 | 0.04 |
62 | 3 | Crying when depressed | 11 | 0.76 | 0.04 |
63 | 4 | Hopelessness | 11 | 0.82 | 0.04 |
64 | 5 | Fatigue and loss of energy | 97 | 0.72 | 0.04 |
65 | 6 | Poor concentration | 116 | 0.80 | 0.04 |
66 | 7 | Psychomotor retardation | 97 | 0.72 | 0.04 |
67 | 8 | Appetite changes when depressed | 93 | 0.79 | 0.04 |
68 | 9 | Weight loss | 62 | 0.71 | 0.04 |
69 | 10 | Weight gain | 15 | 0.76 | 0.05 |
70 | 11 | Initial insomnia | 103 | 0.79 | 0.04 |
71 | 12 | Middle insomnia | 79 | 0.65 | 0.04 |
72 | 13 | Late insomnia | 46 | 0.62 | 0.04 |
73 | 14 | Hypersomnia | 26 | 0.68 | 0.05 |
74 | 15 | Decreased libido | 74 | 0.80 | 0.04 |
75 | 16 | Worthlessness | 97 | 0.78 | 0.04 |
76 | 17 | Guilt | 86 | 0.80 | 0.04 |
77 | 18 | Suicide | 68 | 0.64 | 0.04 |
78 | 1 | Elated mood | 71 | 0.75 | 0.04 |
79 | 2 | Irritable mood | 70 | 0.76 | 0.04 |
80 | 3 | Mixed mood (same day mood changes) | 41 | 0.58 | 0.05 |
81 | 4 | Racing thoughts | 71 | 0.85 | 0.04 |
82 | 5 | Pressured speech | 53 | 0.72 | 0.04 |
83 | 6 | Flight of ideas | 15 | 0.62 | 0.06 |
84 | 7 | Clanging | 12 | 0.49 | 0.04 |
85 | 8 | Distraction | 63 | 0.79 | 0.04 |
86 | 9 | Increase in activities | 68 | 0.83 | 0.04 |
87 | 10 | Grandiosity | 40 | 0.81 | 0.04 |
88 | 11 | Impulsivity | 41 | 0.92 | 0.12 |
89 | 12 | Overspending | 49 | 0.74 | 0.04 |
90 | 13 | Decreased sleep | 56 | 0.78 | 0.04 |
91 | 14 | Hypersexuality | 24 | 0.69 | 0.04 |
92 | 1 | Auditory hallucinations | 54 | 0.90 | 0.04 |
93 | 2 | Hallucinations frequency | 54 | 0.93 | 0.05 |
94 | 3 | Internal hallucinations | 50 | 0.84 | 0.04 |
95 | 4 | Voices commenting | 40 | 0.77 | 0.04 |
96 | 5 | Second and third hallucinations | 45 | 0.78 | 0.04 |
97 | 6 | Visual hallucinations | 27 | 0.81 | 0.04 |
98 | 7 | Other hallucinations | 10 | 0.95 | 0.05 |
99 | 8 | Observed hallucinations | 12 | 0.55 | 0.04 |
100 | 9 | Reading thoughts | 17 | 0.83 | 0.04 |
101 | 10 | Thought insertion | 16 | 0.76 | 0.04 |
102 | 11 | Thought withdrawal | 6 | 0.8 (**) | 0.04 |
103 | 12 | Thought broadcasting | 16 | 0.71 | 0.04 |
104 | 13 | Somatic passivity | 7 | 0.58 (**) | 0.04 |
105 | 14 | Paranoid delusions | 50 | 0.86 | 0.04 |
106 | 15 | Conspiracy delusions | 49 | 0.84 | 0.04 |
107 | 16 | Delusions of reference | 31 | 0.81 | 0.05 |
108 | 17 | Religious delusions | 17 | 0.80 | 0.04 |
109 | 18 | Grandiose delusions | 16 | 0.77 | 0.05 |
110 | 19 | Other delusions | 12 | 0.40 | 0.05 |
111 | 20 | Bizarreness of delusions | 14 | 0.43 | 0.05 |
112 | 1 | Derailment | 37 | 0.65 | 0.06 |
113 | 2 | Flight of ideas | 15 | 0.62 | 0.06 |
114 | 3 | Tangentiality | 28 | 0.57 | 0.06 |
115 | 4 | Incoherent speech | 18 | 0.41 | 0.06 |
116 | 5 | Illogical speech | 13 | 0.25 | 0.05 |
117 | 1 | Agitation | 33 | 0.48 | 0.04 |
118 | 2 | Violence | 25 | 0.64 | 0.04 |
119 | 3 | Odd behavior | 19 | 0.67 | 0.06 |
120 | 4 | Inappropriate affect | 14 | 0.77 | 0.06 |
121 | 1 | Alogia | 29 | 0.62 | 0.05 |
122 | 2 | Anhedonia | 121 | 0.87 | 0.04 |
123 | 3 | Affective flattening or blunting | 42 | 0.68 | 0.05 |
124 | 4 | Avolition | 35 | 0.74 | 0.04 |
125 | 5 | Asociality | 35 | 0.74 | 0.04 |
126 | 6 | Attention impairment | 41 | 0.92 | 0.12 |
127 | 7 | Psychomotor slowing | 97 | 0.72 | 0.04 |
128 | 8 | Poor self care | 27 | 0.79 | 0.06 |
129 | 1 | Alcohol tolerance | 39 | 0.99 | 0.06 |
130 | 2 | Alcohol withdrawal | 33 | 0.93 | 0.06 |
131 | 3 | Drinking alcohol to avoid withdrawal | 29 | 0.96 | 0.06 |
132 | 4 | Unable to control alcohol | 51 | 0.96 | 0.06 |
133 | 5 | Unable to reduce or stop alcohol | 47 | 0.85 | 0.06 |
134 | 6 | Time spent to drink alcohol | 37 | 0.94 | 0.06 |
135 | 7 | Failure to fulfil major obligations | 36 | 0.92 | 0.06 |
136 | 8 | Giving up social or recreational activities | 36 | 0.92 | 0.06 |
137 | 9 | Fighting when intoxicated | 31 | 0.90 | 0.06 |
138 | 10 | Alcohol family problems | 51 | 0.82 | 0.06 |
139 | 11 | Alcohol legal problems | 29 | 0.92 | 0.06 |
140 | 12 | Alcohol medical problems | 11 | 0.70 | 0.06 |
141 | 13 | Continue alcohol with problems | 57 | 0.87 | 0.06 |
142 | 14 | Alcohol in hazardous situations | 42 | 0.77 | 0.06 |
143 | 15 | Alcohol binge | 37 | 0.88 | 0.06 |
144 | 16 | Alcohol blackout | 53 | 0.98 | 0.06 |
145 | 1 | Drug tolerance | 49 | 0.95 | 0.06 |
146 | 2 | Drug withdrawal | 46 | 0.97 | 0.06 |
147 | 3 | Using drug to avoid withdrawal | 40 | 0.94 | 0.06 |
148 | 4 | Unable to control drug use | 55 | 0.97 | 0.06 |
149 | 5 | Unable to reduce or stop drug use | 54 | 0.97 | 0.06 |
150 | 6 | Time spent to use drug | 56 | 0.88 | 0.06 |
151 | 7 | Failure to fulfil major obligations | 50 | 0.95 | 0.06 |
152 | 8 | Giving up social or recreational activities | 50 | 0.95 | 0.06 |
153 | 9 | Fighting when using drug | 22 | 0.80 | 0.06 |
154 | 10 | Drug family problems | 58 | 0.80 | 0.06 |
155 | 11 | Drug legal problems | 22 | 0.80 | 0.06 |
156 | 12 | Drug emotional problems | 19 | 0.76 | 0.06 |
157 | 13 | Drug use with problems | 64 | 0.91 | 0.06 |
158 | 14 | Drug use in hazardous situations | 57 | 0.90 | 0.06 |
159 | 1 | Being underweight | 32 | 0.83 | 0.11 |
160 | 2 | Weight affect feelings | 50 | 0.75 | 0.12 |
161 | 3 | Fear of weight gain | 20 | 1.00 | 0.12 |
162 | 4 | Losing weight by fasting | 32 | 0.95 | 0.12 |
163 | 5 | Losing weight by exercise | 22 | 0.86 | 0.12 |
164 | 6 | Losing weight by diet pills | 22 | 0.97 | 0.12 |
165 | 7 | Losing weight by vomiting | 27 | 0.94 | 0.12 |
166 | 8 | Losing weight by laxatives | 14 | 1.00 | 0.12 |
167 | 9 | Losing weight by other methods | 8 | 1.00 (**) | 0.12 |
168 | 10 | Binge eating | 27 | 0.97 | 0.12 |
169 | 11 | Binge eating frequency | 27 | 0.85 | 0.09 |
170 | 12 | Losing control with binge eating | 17 | 0.96 | 0.12 |
171 | 13 | Binge eating behavior | 27 | 1.00 | 0.12 |
172 | 14 | Eating fast during binge eating | 16 | 1.00 | 0.12 |
173 | 15 | Eating until uncomfortably full during binge eating | 25 | 0.94 | 0.12 |
174 | 16 | Eating when not hungry | 22 | 0.97 | 0.12 |
175 | 17 | Eating alone | 16 | 0.96 | 0.12 |
176 | 18 | Feeling disgusted and guilty | 22 | 0.86 | 0.12 |
177 | 19 | Distressed by overeating | 24 | 0.77 | 0.11 |
178 | 20 | Compensatory behavior after binge eating | 25 | 0.97 | 0.12 |
179 | 21 | Fasting after binge eating | 19 | 0.93 | 0.12 |
180 | 22 | Exercise after binge eating | 12 | 0.95 | 0.12 |
181 | 23 | Using diet pills after binge eating | 12 | 0.95 | 0.12 |
182 | 24 | Vomiting after binge eating | 17 | 1.00 | 0.12 |
183 | 25 | Taking laxatives after binge eating | 14 | 1.00 | 0.12 |
184 | 26 | Other losing weight methods after binge eating | 9 | 1.00 (**) | 0.12 |
185 | 27 | Binge eating compensatory behavior frequency | 25 | 0.87 | 0.09 |
186 | 28 | Other eating behaviors | 4 | 0.39 (**) | 0.09 |
187 | 1 | Attention difficulty | 41 | 0.92 | 0.12 |
188 | 2 | Long attention difficulty | 39 | 0.95 | 0.12 |
189 | 3 | Avoiding tasks | 34 | 0.97 | 0.12 |
190 | 4 | Attention when spoken to | 32 | 0.97 | 0.12 |
191 | 5 | Organization and meeting deadlines | 30 | 0.82 | 0.12 |
192 | 6 | Changing activities | 40 | 0.92 | 0.12 |
193 | 7 | Distraction | 43 | 0.97 | 0.12 |
194 | 8 | Misplacing things | 43 | 0.94 | 0.12 |
195 | 9 | Forgetting daily activities | 24 | 0.94 | 0.12 |
196 | 10 | Losing track | 40 | 0.92 | 0.12 |
197 | 11 | Fidgety | 41 | 0.81 | 0.12 |
198 | 12 | Leaving seats | 30 | 0.88 | 0.12 |
199 | 13 | Restlessness/moving | 49 | 0.61 | 0.12 |
200 | 14 | Hyperactivity | 22 | 0.97 | 0.12 |
201 | 15 | Waiting in line | 23 | 1.00 | 0.12 |
202 | 16 | Talking too much | 12 | 1.00 | 0.12 |
203 | 17 | Loud and noisy | 22 | 0.58 | 0.11 |
204 | 18 | Impulsivity | 41 | 0.92 | 0.12 |
205 | 19 | Disturbing others | 23 | 0.97 | 0.12 |
206 | 20 | Blurt out answers | 32 | 0.89 | 0.12 |
Kappa values were calculated based upon inter-rater interviews of 322 patients at William R. Sharpe Jr. Hospital, Chestnut Ridge Center (inpatient and outpatient), Ain Shams University Hospital and Mansoura University Hospital.
Kappa is unstable if the number of positive cases for a given item is <10.
In 1992, Nancy Andreasen, a renowned researcher, stressed the importance of establishing reliability at the level of individual symptoms and signs. Creating reliable psychological dimensions requires reliability of the items measuring individual symptoms and signs. The absence of valid and reliable symptoms was the main limiting factor in creating dimensional measures in the past.70 The SCIP study removed this major obstacle by creating reliable symptoms and signs for 206 psychopathology items, which paved the way for the creation of reliable and valid SCIP dimensions and scales.
The development of reliable and valid SCIP dimensions and scales for adult psychiatric disorders. The SCIP dimensions and scales were created based on the interviews of 700 patients, 670 of whom were from William R. Sharpe Jr. Hospital in Weston, West Virginia, and 30 of whom were from at Chestnut Ridge Center in Morgantown, West Virginia. Mean patient age was 34, with 59 percent being male, 95 percent being white, and 66 percent completing at least 12 years of education. Patients were evaluated and diagnosed by the attending psychiatrist. We evaluated and treated each patient from admission to discharge, using all available data, including information from previous hospitalizations and family members, labs, psychological testing, and diagnostic schedules, as needed, to reach the final diagnoses.
The initial items of the SCIP dimensions were formulated based upon the DSM and ICD criteria and expert opinions. The sensitivity and specificity of the initial dimensions were calculated against the psychiatric diagnosis, as described above. Rules for shortening the lengthy initial dimensions and creating the final SCIP dimensions included removing items with low prevalence, low sensitivity, or low item-rest correlation (<0.4). The reliability and validity of the remaining items were recalculated with repetitive iterations. The sensitivity and specificity of the final dimensions were approximately equal to the sensitivity and specificity of the initial dimensions. Appendix I shows the initial depression dimension, which has 15 symptoms and signs of depression. Three items not covered in DSM-5—crying when depressed, feeling hopeless, and reduced sexual desire—were included in the initial depression dimension based on the recommendations and use by experts and clinicians for decades, even before the existence of the DSM.23 The sensitivity and specificity of the initial depression scale were 93.24 percent and 74.15 percent, respectively. Following the rules of creating the SCIP scales, the final core depression scale had eight items with 93.24-percent sensitivity and 72.32-percent specificity.
Based upon reliable psychopathology items, the SCIP is the only diagnostic tool that has 18 inherent rating scales for the following domains: generalized anxiety, obsessions, compulsion, posttraumatic stress, depression, mania, delusions, hallucinations, disorganized thoughts, aggression, negative symptoms, alcohol use, drug use, attention deficit, hyperactivity, anorexia, binge-eating, and bulimia. Each of the SCIP rating scales takes 2 to 5 minutes to complete. The SCIP rating scales meet the criteria for MBC because they are efficient, reliable, valid, reflect how clinicians assess psychiatric disorders, and are relevant to decision-making. These unique properties make the SCIP ideal as an MBC tool. Table 3 to Table 15 show the items included in the SCIP scales, item rest correlation, mean interitem correlation, Cronbach’s alpha with one-sided 95-percent confidence interval (CI), sensitivity and specificity at the optimal cutpoint, and receiver operating characteristic (ROC) area with standard error. All of the SCIP scales have been validated with the exception of the OCD and eating disorders scales. Aboraya, Henry Nasrallah, and Daniel Elswick (the first three authors of this article) are currently writing a book that describes the advantages and disadvantages of the SCIP scales and other existing scales in the literature.
TABLE 15.
BULIMIA SCALE ITEMS | ITEM REST CORRELATION | MEAN INTERITEM CORRELATION | CRONBACH’S ALPHA (ONESIDED 95% CI) |
---|---|---|---|
1. Binge eating | 0.9187 | ||
2. Binge eating frequency | 0.9437 | ||
3. Losing control | 0.7330 | ||
4. Binge eating behavior | 0.9187 | ||
5. Eat fast | 0.7264 | ||
6. Eat until full | 0.9098 | ||
7. Eat when not hungry | 0.8223 | ||
8. Eat alone | 0.6721 | ||
9. Feel disgusted/guilty | 0.7574 | 0.6088 | 0.9655 (≥0.9511) |
10. Distressed by overeating | 0.8894 | ||
11. Compensatory behavior | 0.9190 | ||
12. Losing weight by fasting | 0.5864 | ||
13. Losing weight by exercise | 0.6744 | ||
14. Losing weight by diet pills | 0.6407 | ||
15. Losing weight by vomiting | 0.5884 | ||
16. Losing weight by laxatives | 0.5864 | ||
17. Other losing weight methods | 0.5817 | ||
18. Compensatory behavior frequency | 0.9418 |
TABLE 3.
GENERALIZED ANXIETY SCALE ITEMS | ITEM REST CORRELATION | MEAN INTERITEM CORRELATION | CRONBACH’S ALPHA (ONE-SIDED 95% CI) | VALIDITY AT CUTPOINT | SENSITIVITY | SPECIFICITY | ROC AREA (SE) |
---|---|---|---|---|---|---|---|
1. Anxiety | 0.2854 | ||||||
2. Restlessness with anxiety | 0.8957 | ||||||
3. Tension with anxiety | 0.9121 | 0.9889 (0.0036) | |||||
4. Exhaustion with anxiety | 0.8670 | 0.6774 | 0.9363 (≥0.9301) | ≥2 | 77.78% | 97.76% | |
5. Poor concentration with anxiety | 0.8926 | ||||||
6. Irritability with anxiety | 0.8485 | ||||||
7. Insomnia with anxiety | 0.9027 |
TABLE 4.
CORE PTSD SCALE ITEMS | ITEM REST CORRELATION | MEAN INTERITEM CORRELATION | CRONBACH’S ALPHA (ONESIDED 95% CI) | VALIDITY AT CUTPOINT | SENSITIVITY | SPECIFICITY | ROC AREA (SE) |
---|---|---|---|---|---|---|---|
1. Traumatic experience | 0.6695 | ||||||
2. Distressing memories | 0.8618 | ||||||
3. Nightmares/bad dreams | 0.8354 | ||||||
4. Flashback | 0.8222 | ||||||
5. Avoidance | 0.8599 | ||||||
6. Amnesia | 0.6080 | 0.9868 (0.0082) | |||||
7. Diminished interest | 0.7384 | 0.6403 | 0.9586 (≥0.9547) | ≥4 | 93.75% | 98.42% | |
8. Detached/distant | 0.8118 | ||||||
9. Diminished affect | 0.8313 | ||||||
10. Insomnia | 0.8001 | ||||||
11. Anger | 0.7598 | ||||||
12. Hypervigilance | 0.7623 | ||||||
13. Startle response | 0.8162 |
TABLE 5.
CORE DEPRESSION SCALE ITEMS | ITEM REST CORRELATION | MEAN INTERITEM CORRELATION | CRONBACH’S ALPHA (ONE-SIDED 95% CI) | VALIDITY AT CUTPOINT | SENSITIVITY | SPECIFICITY | ROC AREA (SE) |
---|---|---|---|---|---|---|---|
1. Depressed mood | 0.840 | ||||||
2. Anhedonia | 0.817 | ||||||
3. Hopelessness | 0.825 | ||||||
4. Diminished concentration | 0.780 | 0.563 | 0.912 (≥0.903) | ≥6 | 93.24% | 72.32% | 0.8481 (0.0151) |
5. Psychomotor retardation | 0.693 | ||||||
6. Worthlessness | 0.786 | ||||||
7. Guilt | 0.668 | ||||||
8. Suicide | 0.325 |
TABLE 6.
CORE MANIA SCALE ITEMS | ITEM REST CORRELATION | MEAN INTERITEM CORRELATION | CRONBACH’S ALPHA (ONE-SIDED 95% CI) | VALIDITY AT CUTPOINT | SENSITIVITY | SPECIFICITY | ROC AREA (SE) |
---|---|---|---|---|---|---|---|
1. Elated mood | 0.6063 | ||||||
2. Irritable mood | 0.6301 | ||||||
3. Mixed mood | 0.3557 | ||||||
4. Racing thoughts | 0.7698 | ||||||
5. Pressured speech | 0.7450 | 0.4855 | 0.9042 (≥0.8951) | ≥4 | 95.12% | 79.93% | 0.9160 (0.0110) |
6. Distraction | 0.7020 | ||||||
7. Over activities | 0.7982 | ||||||
8. Grandiosity | 0.5279 | ||||||
9. Over spending | 0.7661 | ||||||
10. Decreased sleep | 0.7125 |
TABLE 7.
CORE SCHIZOPHRENIA SCALE ITEMS | ITEM REST CORRELATION | MEAN INTERITEM CORRELATION | CRONBACH’S ALPHA (ONE-SIDED 95% CI) | VALIDITY AT CUTPOINT | SENSITIVITY | SPECIFICITY | ROC AREA (SE) |
---|---|---|---|---|---|---|---|
1. Hallucination quality | 0.6613 | ||||||
2. Hallucination frequency | 0.6689 | ||||||
3. Hallucination duration | 0.6567 | ||||||
4. Voices commenting | 0.5977 | ||||||
5. Visual hallucination | 0.5415 | ||||||
6. Other hallucinations | 0.1696 | ||||||
7. Thought insertion | 0.5702 | ||||||
8. Thought withdrawal | 0.3182 | ||||||
9. Thought broadcast | 0.4717 | 0.2154 | 0.8317 (≥0.8141) | ≥2 | 90.12% | 89.39% | 0.9265 (0.0150) |
10. Paranoid delusions | 0.5995 | ||||||
11. Conspiracy delusion | 0.4778 | ||||||
12. Delusion of reference | 0.3779 | ||||||
13. Other delusion | 0.1106 | ||||||
14. Bizarreness of delusion | 0.3817 | ||||||
15. Derailment | 0.2916 | ||||||
16. Tangentiality | 0.2820 | ||||||
17. Incoherent speech | 0.1908 | ||||||
18. Other disorganizations | 0.2579 |
TABLE 8.
CORE ALCOHOL SCALE ITEMS | ITEM REST CORRELATION | MEAN INTERITEM CORRELATION | CRONBACH’S ALPHA (ONESIDED 95% CI) | VALIDITY AT CUTPOINT | SENSITIVITY | SPECIFICITY | ROC AREA (SE) |
---|---|---|---|---|---|---|---|
1. Tolerance | 0.6932 | ||||||
2. Withdrawal | 0.7044 | ||||||
3. Failure of obligations | 0.7750 | 0.9391 (0.0111) | |||||
4. Social problems | 0.5997 | 0.5828 | 0.9072 (≥0.8981) | ≥2 | 79.31% | 97.10% | |
5. Alcohol with a problem | 0.8431 | ||||||
6. Alcohol with hazard | 0.6499 | ||||||
7. Blackout | 0.7776 |
TABLE 9.
CORE DRUG SCALE ITEMS | ITEM REST CORRELATION | MEAN INTERITEM CORRELATION | CRONBACH’S ALPHA (ONE-SIDED 95% CI) | VALIDITY AT CUTPOINT | SENSITIVITY | SPECIFICITY | ROC AREA (SE) |
---|---|---|---|---|---|---|---|
1. Tolerance | 0.7343 | ||||||
2. Withdrawal | 0.7095 | ||||||
3. Failure of obligations | 0.7384 | 0.5324 | 0.8723 (≥0.8596) | ≥2 | 59.65% | 91.54% | 0.8515 (0.0168) |
4. Social problems | 0.4353 | ||||||
5. Drug with a problem | 0.8030 | ||||||
6. Drug with hazard | 0.6279 |
TABLE 10.
CORE ADULT ADHD SCALE ITEMS | ITEM REST CORRELATION | MEAN INTERITEM CORRELATION | CRONBACH’S ALPHA (ONESIDED 95% CI) | VALIDITY AT CUTPOINT | SENSITIVITY | SPECIFICITY | ROC AREA (SE) |
---|---|---|---|---|---|---|---|
1. Attention difficulty | 0.3670 | ||||||
2. Long attention difficulty | 0.4167 | ||||||
3. Attention when spoken to | 0.5383 | ||||||
4. Changing activities | 0.4024 | ||||||
5. Distraction | 0.5029 | 0.2666 | 0.7843 (≥0.6864) | ≥5 | 94.74% | 83.33% | 0.9591 (0.0264) |
6. Fidgety | 0.4156 | ||||||
7. Leaving seats | 0.5507 | ||||||
8. Restless and moving | 0.4901 | ||||||
9. Over activities | 0.3889 | ||||||
10. Impulsivity | 0.4640 |
TABLE 11.
AGGRESSION SCALE ITEMS | ITEM REST CORRELATION | MEAN INTERITEM CORRELATION | CRONBACH’S ALPHA (ONESIDED 95% CI) |
---|---|---|---|
1. Agitation | 0.4046 | ||
2. Violence | 0.5073 | ||
3. Violence a day | 0.3810 | 0.2742 | 0.6939 (≥0.6635) |
4. Violence a period | 0.3818 | ||
5. Odd behavior | 0.5514 | ||
6. Inappropriate affect | 0.3251 |
TABLE 12.
NEGATIVE SYMPTOM SCALE ITEMS | ITEM REST CORRELATION | MEAN INTERITEM CORRELATION | CRONBACH’S ALPHA (ONESIDED 95% CI) |
---|---|---|---|
1. Blunted affect | 0.6847 | ||
2. Avolition | 0.5682 | ||
3. Alogia | 0.6744 | 0.4877 | 0.8264 (≥0.8087) |
4. Psychomotor slowing | 0.6096 | ||
5. Poor self-care | 0.5742 |
TABLE 13.
ANOREXIA SCALE ITEMS | ITEM REST CORRELATION | MEAN INTERITEM CORRELATION | CRONBACH’S ALPHA (ONESIDED 95% CI) |
---|---|---|---|
1. Very thin | 0.4009 | ||
2. Weight affect feeling | 0.3134 | ||
3. Fear of weight gain | 0.5464 | ||
4. Losing weight by fasting | 0.6139 | ||
5. Losing weight by exercise | 0.2711 | 0.2496 | 0.7496 (≥0.6398) |
6. Losing weight by diet pills | 0.3373 | ||
7. Losing weight by vomiting | 0.5962 | ||
8. Losing weight by laxatives | 0.4392 | ||
9. Other losing weight methods | 0.3417 |
TABLE 14.
BINGE EATING SCALE ITEMS | ITEM REST CORRELATION | MEAN INTERITEM CORRELATION | CRONBACH’S ALPHA (ONESIDED 95% CI) |
---|---|---|---|
1. Binge eating | 0.9585 | ||
2. Binge eating frequency | 0.9366 | ||
3. Losing control | 0.7628 | ||
4. Binge eating behavior | 0.9585 | ||
5. Eat fast | 0.7743 | 0.7434 | 0.9666 (≥0.9521) |
6. Eat until full | 0.9315 | ||
7. Eat when not hungry | 0.8544 | ||
8. Eat alone | 0.6485 | ||
9. Feel disgusted/guilty | 0.7765 | ||
10. Distressed by overeating | 0.8714 |
RECENT DEVELOPMENTS AFFECTING MBC
Electronic health records. Electronic health records (EHR) are being used across clinical settings, from big academic institutions to solo practices. The United States Federal government has given financial incentives to solo practitioners to use EHR, and most academic institutions use advanced EHR.71 Once MBC tools are identified, they can be uploaded to the EHR and be readily available for clinicians to use. The use of EHR should facilitate the implementation of MBC.4
Health information technology. Advances in health information technology, such as software programs, handheld devices, web-based training, and videos, should facilitate clinician training and use of MBC tools.6,71,72 Currently, psychiatrists record diagnosis, mental status, and other clinical aspects in a loose narrative outline, making it difficult to measure or compare outcomes of patients that have been assessed by different clinicians.67 This current practice will be outdated in the near future with the implementation of MBC. With the right software and integrated EHR, clinicians should be able to efficiently record a rating scale, calculate the scale score, compare scores on the same scale over time, draw graphs, and do analyses.
Training psychiatry residents and clinicians in MBC. Lack of training was listed among the top two barriers to using MBC by psychiatry residents and faculty.26,66 In addition, lack of consensus as to which instrument to use was another barrier due to the availability of many measures.66 One important place to promote the use of MBC is in psychiatry residency programs. Currently, no specific requirements exist to evaluate training on the use of MBC during residency.73 A new psychiatry subcompetency for MBC could be added to the existing 22 psychiatry subcompetencies included in the Psychiatry Milestone Project Initiative by the Accreditation Council for Graduate Medical Education (ACGME) and American Board of Psychiatry and Neurology (ABPN).74 Psychiatry residents could learn and progress using the new MBC subcompetency from Level 1 (basic knowledge of psychiatric measures) to Levels 4 and 5 (the ability to use the appropriate measures for making decisions). Arbuckle et al5 implemented a curriculum in MBC for depression in a psychiatric resident clinic and found that MBC was feasible and improved depression screening and monitoring. Aboraya is developing an MBC manual and a didactic seminar for psychiatry residents, using the SCIP scales and other scales for personality disorders and cognitive disorders. A pilot study for implementing MBC for adult psychiatric disorders at the West Virginia University residency program and other programs is underway. If psychiatry residents are trained in MBC, they might potentially practice MBC for the rest of their careers. There is also urgent need to train faculty and clinicians in MBC through continuing medical education (CME) workshops.4 Aboraya, Nasrallah, and Elswick are planning MBC workshops to train clinicians and psychiatry residents on how to choose the right scale or instrument for each individual patient.
DISCUSSION
In 1961, when Robert Spitzer developed the Mental Status Schedule, the first published structured interview in the United States,75 the New York Post published an article in 1963 that stated “a young doctor at Columbia University’s New York State Psychiatric Institute has developed a tool which may become the psychiatrist’s thermometer and microscope and X-ray machine rolled into one.”76 Five decades later, many might say this statement is still accurate—measures in psychiatry could be considered the equivalent of a thermometer and a stethoscope to a physician. No measure, scale, or diagnostic interview will ever replace a seasoned, experienced clinician who has been evaluating and treating real patients for years. MBC is not intended to replace clinical judgment and cannot substitute for an observant and caring clinician.4 Just as thermometers, stethoscopes, and lab tests help other types of physicians reach accurate diagnoses and provide appropriate management, the use of MBC by psychiatrists has the potential to improve the accuracy of diagnoses and improve the outcomes of care. In essence, MBC aims to get the diagnosis and management right as often and as quickly as possible.4
The use of scientific rules and expert input for the creation of efficient and validated SCIP scales does not minimize the importance of the psychopathology items not included in the final SCIP scales. The core depression scale of the SCIP does not include questions on reduced sexual drive, sleep, or appetite changes. Clinicians need to inquire about these important items because they can impact which medications will be most effective for individual patients. In teaching and implementing MBC, clinicians should stress the importance of comprehensive psychopathological assessment to avoid the trap of limiting psychopathology education to specific diagnostic criteria or certain scales.
CONCLUSION
Recent studies have shown that the cost of MBC implementation is minimal and the benefits are significant for patients, providers, and payers.6 The advantages of MBC outweigh the challenges to its implementation.77 Moreover, many payers and accreditation organizations are requiring the use of MBC in psychiatric practice. We believe it is better for healthcare providers to develop their own MBC tools than to have outcome measures imposed on them by payers and/or regulators.6 The three main ingredients for MBC implementation, namely measures, EHR, and health information technologies, already exist. We believe now is the time to employ MBC into standard practice, and published research supports this.20 The onus lies on mental health providers to implement MBC.
APPENDIX I. Standard for Clinicians’ Interview in Psychiatry (SCIP) depression dimension and scale
CODES.
Unless otherwise specified in the question, the rating of a symptom is as follows:
0=Absent or non-significant
1=Symptom present <50% of the time or <50% of times
2=Symptom present >50% of the time or >50% of times
A positive rating of 1 or 2 implies that the patient has the symptom more than most people, or has at least some distress, or seeks professional help.
Questions apply to the present episode, typically the past month, unless otherwise specified.
MB1. | Depressed mood: Have you been feeling sad, depressed, or in low spirits? | |
0 | Patient | |
1 | Patient has depressed mood less than half the time | |
2 | Patient has depressed mood more than half the time | |
MB2. | Anhedonia: Have you been unable to experience pleasure and enjoy things that you used to enjoy, such as exercising, enjoying your hobbies, or socializing with friends? | |
0 | Patient has no anhedonia | |
1 | Patient has anhedonia less than half the time | |
2 | Patient has anhedonia more than half the time | |
MB3. | Crying when depressed: Have you cried when depressed? | |
0 | Patient has no crying spells | |
1 | Patient has crying spells due to sadness less than half the time | |
2 | Patient has crying spells due to sadness more than half the time | |
MB4. | Hopelessness: Have you felt hopeless about your future? | |
0 | Patient is not hopeless | |
1 | Patient feels hopeless less than half the time | |
2 | Patient feels hopeless more than half the time | |
MB5. | Diminished concentration: Have you found that your concentration has decreased and you are unable to complete a task (e.g., at work, reading an article, reading a book, or watching a movie), even though you were able to do that before? | |
0 | Patient has no concentration problems | |
1 | Patient has difficulty concentrating less than half the time | |
2 | Patient has difficulty concentrating more than half the time | |
MB6. | Psychomotor slowing: Have you felt as though you were talking or moving more slowly than normal for you when depressed? | |
0 | Patient has normal energy and activity | |
1 | Patient has psychomotor retardation less than half the time | |
2 | Patient has psychomotor retardation more than half the time | |
MB7A: | Poor appetite: Have you lost your appetite recently? | |
0 | Patient has no loss of appetite | |
1 | Patient had marked loss of appetite for 2 weeks or less | |
2 | Patient had marked loss of appetite for more than 2 weeks | |
MB7B: | Increased appetite: Has your appetite increased recently? | |
0 | Patient had no increase of appetite | |
1 | Patient had marked increase of appetite for 2 weeks or less | |
2 | Patient had marked increase of appetite for more than 2 weeks | |
MB8: | Weight loss: Did you lose weight? | |
0 | Patient had no weight loss or minimal weight loss | |
1 | Patient lost more than 5% of body weight in a month | |
2 | Patient lost more than 15% of body weight in a year | |
MB9: | Weight gain: Did you gain weight? | |
0 | Patient had no weight gain or minimal weight gain | |
1 | Patient gained more than 5% of body weight in a month | |
2 | Patient gained more than 15% of body weight in a year | |
MB10. | Sleeping problems: Have you had sleeping problems when depressed? | |
0 | Patient has no sleeping problems | |
1 | Patient has difficulty falling asleep (one hour or more) more than half the time when depressed | |
2 | Patient has difficulty staying asleep (awakens and stays awake one hour or more) more than half the time when depressed | |
3 | Patient has both difficulty falling asleep and difficulty staying asleep more than half the time when depressed | |
MB11. | Hypersomnia: Have you been sleeping a lot more than usual when depressed? | |
0 | Patient has no hypersomnia | |
1 | Patient has excessive sleep (sleeps longer than 12 hours in a 24-hour period, including naps) more than half the time | |
MB12. | Loss of libido: Has your interest in sex or your sexual activity been less than usual when depressed? | |
0 | Patient has no change in sexual activities or interest in sex | |
1 | Patient has much lower or no interest in sex or sexual activities | |
MB13. | Feeling worthless: Have you felt that you are a worthless person in society or a failure? | |
0 | Patient has no feeling of worthlessness | |
1 | Patient feels worthless less than half the time | |
2 | Patient feels worthless more than half the time | |
MB14. | Excessive guilt: Have you felt guilty or ashamed of yourself for something you have done or thought? | |
0 | Patient has no feeling of guilt | |
1 | Patient feels guilty less than half the time | |
2 | Patient feels guilty more than half the time | |
MB15A. | Suicidal ideation: During the past month, have you had thoughts about harming yourself? | |
0 | Patient had no suicidal ideation | |
1 | Patient had suicidal ideation | |
MB15B. | Suicidal intention: Have you had the intention to carry out the suicidal thoughts? | |
0 | Patient had no suicidal intention | |
1 | Patient had suicidal intention | |
MB15C | Suicidal plan: Have you had plans to harm yourself? | |
0 | Patient had no suicidal plans | |
1 | Patient had suicidal plans | |
MB15D. | Suicidal attempt: Have you made a suicide attempt recently? | |
0 | Patient made no suicide attempt during the past month | |
1 | Patient made one recent suicide attempt during the past month | |
2 | Patient made two or more recent suicide attempts during the past month |
REFERENCES
- 1.Nunnally JC. New York McGraw-Hill: 1978. Psychometric Theory. [Google Scholar]
- 2.Holst P. On the statistics of the insane, blind, deaf and dumb, and lepers, of Norway. J Royal Stat Soc. 1852;15:250–256. [Google Scholar]
- 3.Trivedi MH, Rush AJ, Wisniewski SR, et al. Evaluation of outcomes with citalopram for depression using measurement-based care in STAR*D: implications for clinical practice. Am J Psychiatry. 2006;163:28–40. doi: 10.1176/appi.ajp.163.1.28. [DOI] [PubMed] [Google Scholar]
- 4.Harding KJ, Rush AJ, Arbuckle M, et al. Measurement-based care in psychiatric practice: a policy framework for implementation. J Clin Psychiatry. 2011;72:1136–1143. doi: 10.4088/JCP.10r06282whi. [DOI] [PubMed] [Google Scholar]
- 5.Arbuckle MR, Weinberg M, Kistler SC, et al. A curriculum in measurement-based care: screening and monitoring of depression in a psychiatric resident clinic. Acad Psychiatry. 2013;37:317–320. doi: 10.1176/appi.ap.12080152. [DOI] [PubMed] [Google Scholar]
- 6.Fortney JC, Unutzer J, Wrenn G, et al. A tipping point for measurement-based care. Psychiatr Serv. 2016:appips201500439. [DOI] [PubMed]
- 7.McHugh PR. Striving for coherence: psychiatry’s efforts over classification. JAMA. 2005;293:2526–2528. doi: 10.1001/jama.293.20.2526. [DOI] [PubMed] [Google Scholar]
- 8.Fleischhacker WW, Gopal S, Lane R, et al. A randomized trial of paliperidone palmitate and risperidone long-acting injectable in schizophrenia. Int J Neuropsychopharmacol. 2012;15:107–118. doi: 10.1017/S1461145711001076. [DOI] [PubMed] [Google Scholar]
- 9.Fleischhacker WW, McQuade RD, Marcus RN, et al. A double-blind, randomized comparative study of aripiprazole and olanzapine in patients with schizophrenia. Biol Psychiatry. 2009;65:510–517. doi: 10.1016/j.biopsych.2008.07.033. [DOI] [PubMed] [Google Scholar]
- 10.Kane JM, Eerdekens M, Lindenmayer JP, et al. Long-acting injectable risperidone: efficacy and safety of the first long-acting atypical antipsychotic. Am J Psychiatry. 2003;160:1125–1132. doi: 10.1176/appi.ajp.160.6.1125. [DOI] [PubMed] [Google Scholar]
- 11.Kane JM, Skuban A, Ouyang J, et al. A multicenter, randomized, double-blind, controlled phase 3 trial of fixed-dose brexpiprazole for the treatment of adults with acute schizophrenia. Schizophr Res. 2015;164:127–135. doi: 10.1016/j.schres.2015.01.038. [DOI] [PubMed] [Google Scholar]
- 12.Kane JM, Zukin S, Wang Y, et al. Efficacy and safety of cariprazine in acute exacerbation of schizophrenia: results from an international, Phase III clinical trial. J Clin Psychopharmacol. 2015;35:367–373. doi: 10.1097/JCP.0000000000000346. [DOI] [PubMed] [Google Scholar]
- 13.Nasrallah HA, Silva R, Phillips D, et al. Lurasidone for the treatment of acutely psychotic patients with schizophrenia: a 6-week, randomized, placebo-controlled study. J Psychiatr Res. 2013;47:670–677. doi: 10.1016/j.jpsychires.2013.01.020. [DOI] [PubMed] [Google Scholar]
- 14.Durgam S, Cutler AJ, Lu K, et al. Cariprazine in acute exacerbation of schizophrenia: a fixed-dose, phase 3, randomized, double-blind, placebo- and active-controlled trial. J Clin Psychiatry. 2015;76:e1574–1582. doi: 10.4088/JCP.15m09997. [DOI] [PubMed] [Google Scholar]
- 15.Durgam S, Starace A, Li D, et al. An evaluation of the safety and efficacy of cariprazine in patients with acute exacerbation of schizophrenia: a phase II, randomized clinical trial. Schizophr Res. 2014;152:450–457. doi: 10.1016/j.schres.2013.11.041. [DOI] [PubMed] [Google Scholar]
- 16.Meltzer HY, Risinger R, Nasrallah HA, et al. A randomized, double-blind, placebo-controlled trial of aripiprazole lauroxil in acute exacerbation of schizophrenia. J Clin Psychiatry. 2015;76:1085–1090. doi: 10.4088/JCP.14m09741. [DOI] [PubMed] [Google Scholar]
- 17.Guo T, Xiang YT, Xiao L, et al. Measurement-based care versus standard care for major depression: a randomized controlled trial with blind raters. Am J Psychiatry. 2015;172:1004–1013. doi: 10.1176/appi.ajp.2015.14050652. [DOI] [PubMed] [Google Scholar]
- 18.Crismon ML, Trivedi M, Pigott TA, et al. The Texas Medication Algorithm Project: report of the Texas Consensus Conference Panel on Medication Treatment of Major Depressive Disorder. J Clin Psychiatry. 1999;60:142–156. [PubMed] [Google Scholar]
- 19.Ricken R, Wiethoff K, Reinhold T, et al. Algorithm-guided treatment of depression reduces treatment costs--results from the randomized controlled German Algorithm Project (GAPII) J Affect Disord. 2011;134:249–256. doi: 10.1016/j.jad.2011.05.053. [DOI] [PubMed] [Google Scholar]
- 20.Rush AJ. Isn’t it about time to employ measurement-based care in practice? Am J Psychiatry. 2015;172:934–936. doi: 10.1176/appi.ajp.2015.15070928. [DOI] [PubMed] [Google Scholar]
- 21.Hardcastle D. A follow-up study of one hundred cases made for the department of psychological medicine, Guy’s hospital. Journal of Mental Science. 1934;80:536–549. [Google Scholar]
- 22.Lewis A. Melancholia: A clinical survey of depressive states. Journal of Mental Science. 1934;80:277–378. [Google Scholar]
- 23.Kendler KS. The phenomenology of major depression and the representativeness and nature of DSM criteria. Am J Psychiatry. 2016;173:771–780. doi: 10.1176/appi.ajp.2016.15121509. [DOI] [PubMed] [Google Scholar]
- 24.Scott K, Lewis CC. Using measurement-based care to enhance any treatment. Cogn Behav Pract. 2015;22:49–59. doi: 10.1016/j.cbpra.2014.01.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Lambert MJ. Psychotherapy outcome and quality improvement: introduction to the special section on patient-focused research. J Consult Clin Psychol. 2001;69:147–149. [PubMed] [Google Scholar]
- 26.Hatfield DR, Ogles BM. Why some clinicians use outcome measures and others do not. Adm Policy Ment Health. 2007;34:283–291. doi: 10.1007/s10488-006-0110-y. [DOI] [PubMed] [Google Scholar]
- 27.Roy-Byrne P, Craske MG, Sullivan G, et al. Delivery of evidence-based treatment for multiple anxiety disorders in primary care: a randomized controlled trial. JAMA. 2010;303:1921–1928. doi: 10.1001/jama.2010.608. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Simon GE, Ludman EJ, Bauer MS, et al. Longterm effectiveness and cost of a systematic care program for bipolar disorder. Arch Gen Psychiatry. 2006;63:500–508. doi: 10.1001/archpsyc.63.5.500. [DOI] [PubMed] [Google Scholar]
- 29.Bauer MS, McBride L, Williford WO, et al. Collaborative care for bipolar disorder: Part II. Impact on clinical outcome, function, and costs. Psychiatr Serv. 2006;57:937–945. doi: 10.1176/ps.2006.57.7.937. [DOI] [PubMed] [Google Scholar]
- 30.Hatfield D, McCullough L, Frantz SH, Krieger K. Do we know when our clients get worse? an investigation of therapists’ ability to detect negative client change. Clin Psychol Psychother. 2010;17:25–32. doi: 10.1002/cpp.656. [DOI] [PubMed] [Google Scholar]
- 31.Hannan C, Lambert MJ, Harmon C, et al. A lab test and algorithms for identifying clients at risk for treatment failure. J Clin Psychol. 2005;61:155–163. doi: 10.1002/jclp.20108. [DOI] [PubMed] [Google Scholar]
- 32.Katon WJ, Lin EH, Von Korff M, et al. Collaborative care for patients with depression and chronic illnesses. N Engl J Med. 2010;363:2611–2620. doi: 10.1056/NEJMoa1003955. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Sapyta J, Riemer M, Bickman L. Feedback to clinicians: theory, research, and practice. J Clin Psychol. 2005;61:145–153. doi: 10.1002/jclp.20107. [DOI] [PubMed] [Google Scholar]
- 34.Trivedi MH, Daly EJ. Measurement-based care for refractory depression: a clinical decision support model for clinical research and practice. Drug Alcohol Depend. 2007;88(Suppl 2):S61–71. doi: 10.1016/j.drugalcdep.2007.01.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Unutzer J, Chan YF, Hafer E, et al. Quality improvement with pay-for-performance incentives in integrated behavioral health care. American journal of public health and the nation’s health. 2012;102:e41–45. doi: 10.2105/AJPH.2011.300555. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Pomerantz AS, Kearney LK, Wray LO, et al. Mental health services in the medical home in the Department of Veterans Affairs: factors for successful integration. Psychol Serv. 2014;11:243–253. doi: 10.1037/a0036638. [DOI] [PubMed] [Google Scholar]
- 37.Johnson-Lawrence V, Zivin K, Szymanski BR, et al. VA primary care-mental health integration: patient characteristics and receipt of mental health services, 2008–2010. Psychiatr Serv. 2012;63:1137–1141. doi: 10.1176/appi.ps.201100365. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Sachs GS. Acta Psychiatr Scand Suppl. Strategies for improving treatment of bipolar disorder: integration of measurement and management. 2004. pp. 7–17. [DOI] [PubMed]
- 39.Hatfield DO. B. The use of outcome measures by psychologists in clinical practice. Professional Psychology: Research and Practice. 2004;35:485–491. [Google Scholar]
- 40.WHO. Geneva: World Health Organization; 1994. Schedules for Clinical Assessment in Neuropsychiatry Manual. [Google Scholar]
- 41.WHO. Geneva: World Health Organization; 1994. Schedules for Clinical Assessment in Neuropsychiatry Glossary. [Google Scholar]
- 42.WHO. Geneva: World Health Organization; 1990. Compsite International Diagnostic Interview (CIDI) [Google Scholar]
- 43.Wing JK, Babor T, Brugha T, et al. SCAN. Schedules for Clinical Assessment in Neuropsychiatry. Arch Gen Psychiatry. 1990;47:589–593. doi: 10.1001/archpsyc.1990.01810180089012. [DOI] [PubMed] [Google Scholar]
- 44.Sheehan DV, Lecrubier Y, Sheehan KH, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. quiz 34–57. J Clin Psychiatry. 1998;59(Suppl 20):22–33. [PubMed] [Google Scholar]
- 45.Spitzer RL, Williams JB, Gibbon M, First MB. The Structured Clinical Interview for DSM-III-R (SCID). I: History, rationale, and description. Arch Gen Psychiatry. 1992;49:624–629. doi: 10.1001/archpsyc.1992.01820080032005. [DOI] [PubMed] [Google Scholar]
- 46.Williams JB, Gibbon M, First MB, et al. The Structured Clinical Interview for DSM-III-R (SCID). II. Multisite test-retest reliability. Arch Gen Psychiatry. 1992;49:630–636. doi: 10.1001/archpsyc.1992.01820080038006. [DOI] [PubMed] [Google Scholar]
- 47.Aboraya A. The validity results of the Standard for Clinicians’ Interview in Psychiatry (SCIP) Schizophrenia Bull. 2015;41:S103–S104. [Google Scholar]
- 48.Aboraya A, El-Missiry A, Barlowe J, et al. The reliability of the standard for clinicians’ interview in psychiatry (SCIP): a clinician-administered tool with categorical, dimensional and numeric output. Schizophr Res. 2014;156:174–183. doi: 10.1016/j.schres.2014.04.025. [DOI] [PubMed] [Google Scholar]
- 49.Hamilton M. A rating scale for depression. J Neurol Neurosurg Psychiatry. 1960;23:56–62. doi: 10.1136/jnnp.23.1.56. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Kay SR, Fiszbein A, Opler LA. The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophr Bull. 1987;13:261–276. doi: 10.1093/schbul/13.2.261. [DOI] [PubMed] [Google Scholar]
- 51.Overall JE, Gorham DR. The Brief Psychiatric Rating Scale (BPRS): recent developments in ascertainment and scaling. Psychopharmacol Bull. 1988;24:97–99. [PubMed] [Google Scholar]
- 52.Goodman WK, Price LH, Rasmussen SA, et al. The Yale-Brown Obsessive Compulsive Scale. I. Development, use, and reliability. Arch Gen Psychiatry. 1989;46:1006–1011. doi: 10.1001/archpsyc.1989.01810110048007. [DOI] [PubMed] [Google Scholar]
- 53.Beck AT, Ward CH, Mendelson M, et al. An inventory for measuring depression. Arch Gen Psychiatry. 1961;4:561–571. doi: 10.1001/archpsyc.1961.01710120031004. [DOI] [PubMed] [Google Scholar]
- 54.Zimmerman M, Posternak MA, McGlinchey J, et al. Validity of a self-report depression symptom scale for identifying remission in depressed outpatients. Compr Psychiatry. 2006;47:185–188. doi: 10.1016/j.comppsych.2005.07.004. [DOI] [PubMed] [Google Scholar]
- 55.Zimmerman M, McGlinchey JB. Why don’t psychiatrists use scales to measure outcome when treating depressed patients? J Clin Psychiatry. 2008;69:1916–1919. doi: 10.4088/jcp.v69n1209. [DOI] [PubMed] [Google Scholar]
- 56.Nasrallah H. Long overdue: measurement-based psychiatric practice. Current Psychiatry. 2009;8:14–16. [Google Scholar]
- 57.Zimmerman M. Measuring outcome in clinical practice. Psychiatric Times. 2014;31:28. [Google Scholar]
- 58.Duffy FF, Chung H, Trivedi M, et al. Systematic use of patient-rated depression severity monitoring: is it helpful and feasible in clinical psychiatry? Psychiatr Serv. 2008;59:1148–1154. doi: 10.1176/ps.2008.59.10.1148. [DOI] [PubMed] [Google Scholar]
- 59.Gilbody SM, House AO, Sheldon TA. Psychiatrists in the UK do not use outcomes measures. National survey. Br J Psychiatry. 2002;180:101–103. doi: 10.1192/bjp.180.2.101. [DOI] [PubMed] [Google Scholar]
- 60.Bastiaens L. Poor practice, managed care, and magic pills: have we created a mental health monster? Psychiatric Times. 2011;28:1–4. [Google Scholar]
- 61.Aboraya A. Use of structured interviews by psychiatrists in real clinical settings: results of an open-question survey. Psychiatry (Edgmont). 2009;6:24–28. [PMC free article] [PubMed] [Google Scholar]
- 62.Rettew DC, Lynch AD, Achenbach TM, et al. Meta-analyses of agreement between diagnoses made from clinical evaluations and standardized diagnostic interviews. Int J Methods Psychiatr Res. 2009;18:169–184. doi: 10.1002/mpr.289. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Busner J, Kaplan SL, Greco NT, Sheehan DV. The use of research measures in adult clinical practice. Innov Clin Neurosci. 2011;8:19–23. [PMC free article] [PubMed] [Google Scholar]
- 64.Aboraya A, Nasrallah H, Muvvala S, et al. The Standard for Clinicians’ Interview in Psychiatry (SCIP): a clinician-administered tool with categorical, dimensional, and numeric output-conceptual development, design, and description of the SCIP. Innov Clin Neurosci. 2016;13:31–77. [PMC free article] [PubMed] [Google Scholar]
- 65.Aboraya A, Nasrallah HA. Perspectives on the Positive and Negative Syndrome Scale (PANSS): Use, misuse, drawbacks, and a new alternative for schizophrenia research. Ann Clin Psychiatry. 2016;28:125–131. [PubMed] [Google Scholar]
- 66.Arbuckle MR, Weinberg M, Harding KJ, et al. The feasibility of standardized patient assessments as a best practice in an academic training program. Psychiatr Serv. 2013;64:209–211. doi: 10.1176/appi.ps.002732012. [DOI] [PubMed] [Google Scholar]
- 67.Roy-Byrne P, Dagadakis C, Ries R, et al. A psychiatrist-rated battery of measures for assessing the clinical status of psychiatric inpatients. Psychiatr Serv. 1995;46:347–352. doi: 10.1176/ps.46.4.347. [DOI] [PubMed] [Google Scholar]
- 68.Zimmerman M, McGlinchey JB. Depressed patients’ acceptability of the use of self-administered scales to measure outcome in clinical practice. Ann Clin Psychiatry. 2008;20:125–129. doi: 10.1080/10401230802177680. [DOI] [PubMed] [Google Scholar]
- 69.Baer L. Boston: Humana Press; 2015. Handbook of Clinical Rating Scales and Assessment in Psychiatry and Mental Health. [Google Scholar]
- 70.Andreasen NC, Flaum M, Arndt S. The Comprehensive Assessment of Symptoms and History (CASH). An instrument for assessing diagnosis and psychopathology. Arch Gen Psychiatry. 1992;49:615–623. doi: 10.1001/archpsyc.1992.01820080023004. [DOI] [PubMed] [Google Scholar]
- 71.Blumenthal D. Stimulating the adoption of health information technology. N Engl J Med. 2009;360:1477–1479. doi: 10.1056/NEJMp0901592. [DOI] [PubMed] [Google Scholar]
- 72.Long N. Closing the gap between research and practice—the importance of practitioner training. Clin Child Psychol Psychiatry. 2008;13:187–190. doi: 10.1177/1359104507088341. [DOI] [PubMed] [Google Scholar]
- 73.Baker M. Measurement-based care and psychiatric education: are we doing enough? Psychiatric News. 2015:50. [Google Scholar]
- 74.The Psychiatry Milestone Project Initiative by the Accreditation Council for Graduate Medical Education and American Board of Psychiatry and Neurology. 2015. [Accessed 1 Dec 2018]. https://www.acgme.org/Portals/0/PDFs/Milestones/PsychiatryMilestones.pdf.
- 75.Spitzer RL, Fleiss JL, Burdock EI, Hardesty AS. The mental status schedule: rationale, reliability and validity. Compr Psychiatry. 1964;5:384–395. doi: 10.1016/s0010-440x(64)80048-1. [DOI] [PubMed] [Google Scholar]
- 76.Spitzer RL. Psychiatric diagnosis: are clinicians still necessary? Compr Psychiatry. 1983;24:399–411. doi: 10.1016/0010-440x(83)90032-9. [DOI] [PubMed] [Google Scholar]
- 77.Valenstein M, Adler DA, Berlant J, et al. Implementing standardized assessments in clinical care: now’s the time. Psychiatr Serv. 2009;60:1372–1375. doi: 10.1176/ps.2009.60.10.1372. [DOI] [PubMed] [Google Scholar]