Abstract
Background
Diagnostic criteria for DSM-5 posttraumatic stress disorder (PTSD) are in many ways similar to DSM-IV criteria, raising the possibility that it might be possible to closely approximate DSM-5 diagnoses using DSM-IV symptoms. If so, the resulting transformation rules could be used to pool research data based on the two criteria sets.
Methods
The Pre-Post Deployment Study (PPDS) of the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS) administered a blended 30-day DSM-IV and DSM-5 PTSD symptom assessment based on the civilian PTSD Checklist for DSM-IV (PCL-C) and the PTSD Checklist for DSM-5 (PCL-5). This assessment was completed by 9,193 soldiers from three US Army Brigade Combat Teams approximately three months after returning from Afghanistan. PCL-C items were used to operationalize conservative and broad approximations of DSM-5 PTSD diagnoses. The operating characteristics of these approximations were examined compared to diagnoses based on actual DSM-5 criteria.
Results
The estimated 30-day prevalence of DSM-5 PTSD based on conservative (4.3%) and broad (4.7%) approximations of DSM-5 criteria using DSM-IV symptom assessments were similar to estimates based on actual DSM-5 criteria (4.6%). Both approximations had excellent sensitivity (92.6-95.5%), specificity (99.6-99.9%), total classification accuracy (99.4-99.6%), and area under the receiver operating characteristic curve (0.96-0.98).
Conclusions
DSM-IV symptoms can be used to approximate DSM-5 diagnoses of PTSD among recently-deployed soldiers, making it possible to recode symptom-level data from earlier DSM-IV studies to draw inferences about DSM-5 PTSD. However, replication is needed in broader trauma-exposed samples to evaluate the external validity of this finding.
Keywords: PTSD/posttraumatic stress disorder, Assessment/Diagnosis, Anxiety/Anxiety disorders, measurement/psychometrics, trauma
INTRODUCTION
Posttraumatic stress disorder (PTSD) is a common[1] and seriously impairing[2] disorder that has undergone substantial changes in diagnostic criteria across DSM editions. In DSM-5,[3] several criterion-level changes from DSM-IV[4] broadened the definition of PTSD, while others narrowed the definition. Initial prevalence studies using DSM-5 draft criteria led to the belief that the net result of these changes was to increase PTSD prevalence,[5,6] but most subsequent studies of the final criteria found slightly lower prevalence of DSM-5 than DSM-IV PTSD when assessed using either self-report scales[7-9] or structured clinical interviews,[10,11] although this evidence is not entirely consist.[12] Studies agree, though, that substantial overlap exists in PTSD cased based on DSM-IV and DSM-5 criteria,[8,12] raising the possibility that diagnoses of DSM-5 PTSD might be approximated closely using DSM-IV criteria. This is an issue of considerable importance for purposes of preserving the value of previous research studies that were based on DSM-IV criteria, as evidence that DSM-5 diagnoses could be closely approximated using DSMIV criteria would allow the results of these previously-completed studies to be recoded and used to draw inferences about DSM-5 PTSD.
The present report investigates this issue using data from the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS).[13,14] We capitalize on the fact that one Army STARRS survey assessed PTSD in three Brigade Combat Teams of soldiers shortly after they returned from deployment to Afghanistan using an expanded self-report scale that included DSM-IV as well as all DSM-V symptoms of PTSD. This allowed us to make individual-level comparisons between approximated DSM-5 diagnoses based on DSM-IV symptoms and true DSM-5 diagnoses based on the actual DSM-5 criteria. The close correspondence of DSM-IV and DSM-5 prevalence estimates in previous studies and the fact that the new symptoms in DSM-5 appear to be much less common than those retained from DSM-IV[7-12] led us to hypothesize that DSM-5 diagnoses of PTSD could be closely approximated using DSM-IV symptoms.
METHODS AND MATERIALS
Sample
Data came from the Army STARRS Pre-Post Deployment Study (PPDS). The PPDS is a four-wave panel survey of three Army Brigade Combat Teams assessed shortly before deployment to Afghanistan in Quarter 1 2012 (baseline [T0]) and three times after returning from deployment (within one month of return [T1], two months after T1 [T2], and six months after T2 [T3]). The assessments included completion of a self-administered questionnaire (SAQ) at each time point. At T0-2, all personnel in each selected PPDS unit reported to a 30-minute group informed consent session that explained study purposes, procedures, confidentiality, and voluntary participation before requesting written informed consent. The SAQ was only administered after obtaining consent. The SAQ was administered on a laptop computer in group administration format. Consent was confidential despite the group format, as respondents recorded consent privately on their laptops and could go through the instrument either without entering responses or entering only non-informative responses. These recruitment, consent, and data protection procedures were approved by the Human Subjects Committees of the Uniformed Services University of the Health Sciences for the Henry M. Jackson Foundation (the primary grantee), the Institute for Social Research at the University of Michigan (the organization collecting the data), and all other collaborating organizations. Additional details on the PPDS design, sample, and consent procedures have been reported elsewhere.[13,15] The 9,193 PPDS respondents considered here represent all consenting soldiers who completed the SAQ at T2. We focus on T2 because the T2 SAQ included assessments of both DSM-IV and DSM-5 PTSD symptoms. Of the 9,613 soldiers present for duty at T2, virtually all attended the SAQ session (98.3%, n=9,453) and the vast majority completed the full SAQ (95.6%, n=9,193). As a result of this very high response rate, no nonresponse adjustment weight was used in analyzing the data.
Measures
The criterion-level changes in DSM-5 included a mix of broadening and narrowing of DSM-IV criteria. The definition of PTSD was broadened by deleting DSM-IV Criterion A2 (subjective reactions of intense fear, helplessness, or horror to the trauma) and adding one new symptom of hyper-arousal (DSM-5 Criterion E) to the 5 already in DSM-IV while still requiring 2 hyper-arousal symptoms. The definition of PTSD was narrowed, in comparison, by restricting the DSM-IV Criterion A1 definition to exclude non-violent indirect exposure (DSM-5 Criteria A1-A4; an important change in that it was found in one study to account for roughly half of all instances where a person meeting DSM-IV criteria failed to meet DSM-5 criteria[8]) and splitting DSM-IV Criterion C (which required 3 of 7 avoidance/emotional numbing symptoms) into two separate criteria in one of which (DSM-5 Criterion C) at least 1 of the 2 DSM-IV symptoms of avoidance is required (a requirement that did not exist in DSM-IV). The new DSM-5 Criterion D (negative alteration in cognitions/mood), which was created from the remaining DSM-IV Criterion C symptoms, finally, changed the definition of PTSD in a way that might either broaden or narrow the number of qualifying cases depending on symptom distributions in that the new criterion requires 2 of 7 symptoms that include 3 of the original 5 in DSM-IV Criterion C, a slightly modified version of 1 of the others in DSM-IV Criterion C, and 3 new symptoms. This would lead to a reduction in DSM-5 prevalence compared to DSM-IV prevalence among people who had both of the 2 symptoms of avoidance, only 1 other retained DSM-IV Criterion C avoidance/emotional numbing symptom, and none of the new DSM-5 Criterion D symptoms, as such people would meet DSM-IV Criterion C but not DSM-5 Criteria C and D. But the requirements of DSM-5 Criterion D would lead to an increase in DSM-5 prevalence compared to DSM-IV among people who had at least 1 symptom of avoidance, exactly 1 of the other DSMIV Criterion C symptoms, but at least 2 of the 3 new DSM-5 Criterion D symptoms, as such people meet DSM-5 Criteria C and D but not DSM-IV Criterion C. As a result, whether PTSD prevalence increases or decreases in DSM-5 compared to DSM-IV and the degree of overlap among case definitions will both depend on the relative distributions of the symptoms involved in these various changes.
The T2 PPDS began the assessment of the above criteria with separate checklists for traumatic events that occurred in the line of duty and those that did not occur in the line of duty. The events in these checklists were developed to operationalize DSM-IV Criterion A1 rather than DSM-5 Criteria A1-A4. As noted above, the latter are narrower than DSM-IV Criterion A1 because of the exclusion of non-violent indirect exposure. This narrowing is perhaps less relevant in the current sample than it might be in other samples, however, in that the vast majority of T2 PPDS respondents reported experiencing direct combat (i.e., violent) trauma in their most recent deployment.
Thirty-day DSM-IV Criteria B-D and DSM-5 Criteria B-E symptoms of PTSD were assessed in the T2 PPDS by using a blended version of the civilian PTSD Checklist for DSM-IV (PCL-C) [16] and the PTSD Checklist for DSM-5 (PCL-5).[17] The PCL-C, which asks about PTSD symptoms due to stressful experiences, was used instead of the military version, which asks about symptoms specific to military experiences, because of our interest in PTSD due to either military or non-military traumas. The PCL-C has been the most widely used and validated self-report measure of PTSD over the past two decades.[18,19] The PCL-C was also found to be a valid measure of DSM-IV PTSD in an independent Army STARRS clinical reappraisal study[20] that compared diagnoses based on the PCL-C with independent blinded diagnoses based on the Structured Clinical Interviews for DSM-IV.[21]
The PCL-C includes 17 questions to operationalize the 17 DSM-IV Criteria B-D symptoms of PTSD. The PCL-5 includes 20 questions to operationalize the 20 DSM-5 Criteria B-E symptoms of PTSD. A five-point response scale is used in both versions in which respondents rate the extent to which each symptom has been bothersome in the past 30 days (Not at all, A little bit, Moderately, Quite a bit, and Extremely). PCL-5 modifications correspond directly to differences between DSM-IV and DSM-5 criteria (Table 1).
Table 1.
DSM-5 PTSD Criteria B-E (Symptoms required) | DSM-IV PTSD Criteria B-D (Symptoms required) |
---|---|
B. Re-experiencing (1 of 5) | B. Re-experiencing (1 of 5) |
B1. Recurrent, involuntary, and intrusive distressing memories of the traumatic event(s). | B1. Recurrent and intrusive distressing recollections of the event, including images, thoughts, or perceptions. |
B2. Recurrent distressing dreams in which the content and/or affect of the dream are related to the traumatic event(s). | B2. Recurrent distressing dreams of the event. |
B3. Dissociative reactions (e.g., flashbacks) in which the individual feels or acts as if the traumatic event(s) were recurring. (Such reactions may occur on a continuum, with the most extreme expression being a complete loss of awareness of present surroundings). | B3. Acting or feeling as if the traumatic event were recurring (includes a sense of reliving the experience, illusions, hallucinations, and dissociative flashback episodes, including those that occur on awakening or when intoxicated). |
B4. Intense or prolonged psychological distress at exposure to internal or external cues that symbolize or resemble an aspect of the traumatic event(s). | B4. Intense psychological distress at exposure to internal or external cues that symbolize or resemble an aspect of the traumatic event. |
B5. Marked physiological reactions to internal or external cues that symbolize or resemble an aspect of the traumatic event(s). | B5. Physiological reactivity on exposure to internal or external cues that symbolize or resemble an aspect of the traumatic event. |
C. Avoidance (1 of 2) | C. Avoidance and Numbing (3 of 7) |
C1. Avoidance of or efforts to avoid distressing memories, thoughts, or feelings about or closely associated with the traumatic event(s). | C1. Efforts to avoid thoughts, feelings, or conversations associated with the trauma. |
C2. Avoidance of or efforts to avoid external reminders (people, places, conversations, activities, objects, situations) that arouse distressing memories, thoughts, or feelings about or closely associated with the traumatic event(s). | C2. Efforts to avoid activities, places, or people that arouse recollections of the trauma. |
D. Negative alterations in cognition and mood (2 of 7) | |
D1. Inability to remember an important aspect of the traumatic event(s) (typically due to dissociative amnesia and not to other factors such as head injury, alcohol, or drugs). | C3. Inability to recall an important aspect of the trauma. |
D2. Persistent and exaggerated negative beliefs or expectations about oneself, others, or the world (e.g., “I am bad,” “No one can be trusted,” “The world is completely dangerous,” “My whole nervous system is permanently ruined”). a | DSM-5 symptom is a substantive revision of DSM-IV: C7. Sense of a foreshortened future (e.g., does not expect to have a career, marriage, children, or a normal life span).a |
D3. Persistent, distorted cognitions about the cause or consequences of the traumatic event(s) that lead the individual to blame himself/herself or others.a | No equivalent DSM-IV symptom. a |
D4. Persistent negative emotional state (e.g., fear, horror, anger, guilt, or shame).a | No equivalent DSM-IV symptom. a |
D5. Markedly diminished interest or participation in significant activities. | C4. Markedly diminished interest or participation in significant activities. |
D6. Feelings of detachment or estrangement from others. | C5. Feeling of detachment or estrangement from others. |
D7. Persistent inability to experience positive emotions (e.g., inability to experience happiness, satisfaction, or loving feelings).a | DSM-5 symptom is a rewording of DSM-IV: C6. Restricted range of affect (e.g., unable to have loving feelings). b |
E. Hyper-arousal (2 of 6) | D. Hyper-arousal (2 of 5) |
E1. Irritable behavior and angry outbursts (with little or no provocation) typically expressed as verbal or physical aggression toward people or objects. | D2. Irritability or outbursts of anger. |
E2. Reckless or self-destructive behavior.a | No equivalent DSM-IV symptom. a |
E3. Hypervigilance. | D4. Hypervigilance. |
E4. Exaggerated startle response. | D5. Exaggerated startle response. |
E5. Problems with concentration. | D3. Difficulty concentrating. |
E6. Sleep disturbance (e.g., difficulty falling or staying asleep or restless sleep). | D1. Difficulty falling or staying asleep. |
Abbreviations: PTSD, posttraumatic stress disorder; PCL-C, civilian PTSD checklist for DSM-IV; PCL-5, PTSD checklist for DSM-5.
Italicized criteria reflect those that were reworded (D7), substantively revised (D2), or newly added (D3, D4, E2) in DSM-5. In our blended assessment, soldiers were administered only the first part of the double-barreled PCL-C item used to assess DSM-IV C6, but the full PCL-5 item used to assess DSM-5 D7. The full PCL-C item was used to assess DSM-IV C7 and the full PCL-5 items was used to assess DSM-5 D2. PCL-5 items were also used to assess new DSM-5 symptoms D3, D4, and E2. To avoid item redundancy, non-italicized criteria were assessed only using PCL-C items given the negligible substantive differences in DSM-IV versus DSM-5 criteria.
DSM-IV Criterion C6 was coded as being present if soldiers endorsed our condensed version of the double-barreled PCL-C item for this criterion (feeling emotionally numb) or if they endorsed the corresponding PCL-5 item (which captures the second part of the original double-barreled PCL-C item, trouble experiencing positive feelings [for example, being unable to feel happiness or have loving feelings for people close to you]).
Fifteen DSM-IV Criterion B-D symptoms are either unchanged or only modestly changed in DSM-5. The PCL-C measures of these symptoms were used to approximate DSM-5 criteria. Nine of the 15 measures were virtually unchanged in PCL-5 (DSM-5 Criteria B2, B4, D1, D5, D6, and E3-E6) and 6 others only changed slightly (DSM-5 B1, B3, B5, C1, C2, and E1). We used the PCL-C wording for the latter 6 questions. Another PCL-C question that was double-barreled in that it asked about both numbing and inability to have loving feelings (Feeling emotionally numb or being unable to have loving feelings for those close to you) was narrowed in PLC-5 to operationalize DSM-5 Criterion D7 (Trouble experiencing positive feelings [for example, being unable to feel happiness or have loving feelings for people close to you versus). Our blended version of the two instruments included a separate question for this modified criterion about numbing (Feeling emotionally numb) in addition to the new PCL-5 question that operationalized DSM-5 Criterion D7. Whereas only the PCL-5 question was used to operationalize DSM-5 Criterion D7, we combined responses to the two questions into a single symptom-level score to approximate the original PCL-C question (assigning the higher response to the two questions) to define DSM-IV Criterion C6, noting that this operationalization broadens the second part of the original characterization in DSM-IV. It is possible that this broader operationalization caused us to misclassify some observations as true cases of DSM-IV PTSD in addition to slightly inflating the estimated accuracy of our DSM-5 approximations (i.e., among soldiers who endorsed this item solely because of trouble experiencing positive feelings, a clause that is only found in DSM-5/PCL-5).
DSM-5 substantially changed DSM-IV Criterion C7, which required a “sense of a foreshortened future (e.g., does not expect to have a career, marriage, children, or a normal life span)” to require “persistent and exaggerated negative beliefs or expectations about oneself, others, or the world (e.g., ‘I am bad,’ ‘No one can be trusted,’ ‘The world is completely dangerous,’ ‘My whole nervous system is permanently ruined’ [DSM-5 Criterion D2]). We included in our blended assessment both the original PCL-C question to operationalize DSM-IV Criterion C7 and the new PCL-5 question to operationalize DSM-5 Criterion D2. Given this substantive revision, we did not attempt to approximate DSM-5 Criterion D2 using the PCL-C question for DSM-IV Criterion C7.
Finally, three PCL-5 questions were added to the T2 PPDS assessment to operationalize the new DSM-5 criteria D3, D4, and E2. In addition, as neither version of the PCL assesses the DSM-IV Criterion F/DSM-5 Criterion G requirement of clinically significant distress or impairment, our blended version of the instrument included two additional questions about the extent to which PTSD symptoms caused distress and impairment in the past 30 days.
We considered soldiers reporting at least one lifetime traumatic event as fulfilling DSMIV/DSM-5 Criterion A. Although we did not separately assess DSM-IV versus DSM-5 Criterion A, combat exposure qualifies for either definition. Consistent with other studies that used the PCL to diagnose PTSD,[7,22,23] all other symptoms were coded as present if reported as having been either Moderately, Quite a bit, or Extremely bothersome on the five-point PCL response scale. DSM-IV PTSD was operationalized using the 17 PCL-C items to assess DSM-IV Criteria B-D, while DSM-5 PTSD Criteria B-E were defined using the 15 PCL-IV items that are identical to or very minor rewordings in the PCL-5 plus the five additional PCL-5 items that were broadened (one item), substantively changed (one item), or unique to DSM-5 (three items). Both definitions also required endorsement of one of two of the items created to assess DSM-IV Criterion F/DSM-5 Criterion G (distress/impairment).
Analysis Methods
In total, sixteen DSM-IV PTSD symptoms were substantively unchanged in DSM-5. As mentioned in the introduction, however, DSM-IV Criterion C (avoidance/emotional numbing) was split in DSM-5 into Criteria C (avoidance) and D (negative alternations in cognitions and mood). We thus aimed to approximate DSM-5 PTSD by operationalizing the new DSM-5 criteria using only the 16 corresponding DSM-IV/PCL-C symptoms. Although the DSMIV/PCL-C items provided full coverage of all seven DSM-5 Criteria B-C symptoms, we could only operationalize four of seven DSM-5 Criteria D symptoms and five of six DSM-5 Criteria E symptoms. We consequently focused on the subsample of T2 PPDS respondents who met DSM-5 Criteria B and C and created in this subsample a 30-category variable made up of the five-bysix cross-classification between the count of PCL-C symptoms endorsed for DSM-5 Criterion D (0-4 PCL-C symptoms out of the seven symptoms in DSM-5) and DSM-5 Criterion E (0-5 PCL-C symptoms out of the six symptoms in DSM-5). This 30-cell variable was then cross-classified with the Yes-No DSM-5 diagnosis of PTSD based on the PCL-5 to examine the extent to which DSM-IV symptoms can be used to approximate DSM-5 diagnoses of PTSD.
Two coding schemes were developed from this cross-classification. The first was a conservative approximation of DSM-5 criteria that required DSM-5 Criteria A-C and G in addition to two or more of the four DSM-5 Criterion D symptoms included in the PCL-C plus two or more out of five of the six DSM-5 Criterion E symptoms included in the PCL-C. A 2-by-2 table was created that cross-classified this conservative approximation with actual DSM-5 diagnoses based on the PCL-5. The operating characteristics of this conservative approximation (i.e., sensitivity, specificity, positive and negative predictive value, total classification accuracy, Cohen's κ, and area under the ROC curve [AUC]) were then calculated and compared to actual DSM-5 diagnoses based on the PCL-5. The second broader coding scheme was then created to determine if allowing the inclusion of a small number of false positives would reduce the number of false negatives in the conservative approximation and increase total classification accuracy. Once a coding rule to achieve that aim was developed (see the below subsection on Defining a broad approximation of DSM-5 PTSD), a 2-by-2 table was created that cross-classified this broad approximation with DSM-5/PCL-5 PTSD and the same operating characteristics were calculated as for the conservative approximation.
RESULTS
Comparisons among DSM-IV, DSM-5, and conservatively approximated DSM-5 PTSD
The estimated 30-day prevalence of DSM-IV PTSD based on the PCL-C was 5.3%, while estimated prevalence of DSM-5 PTSD based on the PCL-5 was 4.6%. (Table 2) The 30-day prevalence of the conservative approximation of DSM-5 PTSD based on the PCL-C was 4.3%. The vast majority (96.7%) of soldiers with DSM-5/PCL-5 PTSD also met criteria for DSM-IV/PCL-C PTSD. A smaller proportion (82.9%) of those with DSM-IV/PCL-C PTSD also met criteria for DSM-5/PCL-5 PTSD. Nearly all soldiers with the conservative PCL-C approximation of DSM-5/PCL-5 PTSD met criteria for DSM-5/PCL-5 PTSD (97.7%), while this definition captured 92.6% of the soldiers who met DSM-5/PCL-5 PTSD criteria.
Table 2.
In subsamples of respondents with... |
||||||||
---|---|---|---|---|---|---|---|---|
Total Sample | True DSM-IV | True DSM-5 | Conservative approximation of DSM-5 | |||||
% | SE | % | SE | % | SE | % | SE | |
True DSM-IVb | 5.3 | 0.2 | -- | -- | 96.7 | 0.9 | 100.0 | 0.0 |
True DSM-5c | 4.6 | 0.2 | 82.9 | 1.7 | -- | -- | 97.7 | 0.8 |
Conservative approximation of DSM-5d | 4.3 | 0.2 | 81.2 | 1.8 | 92.6 | 1.3 | -- | -- |
(n) | (9,193) | (490) | (420) | (398) |
Abbreviations: PTSD, posttraumatic stress disorder; PPDS, Pre-Post Deployment Survey; se, standard error; PCL-C, civilian PTSD checklist for DSM-IV; PCL-5, PTSD checklist for DSM-5.
For the two true and one approximated PTSD diagnoses, Criterion A was considered met if the soldiers reported one or more traumatic experience during the Time 0 and Time 2 assessments of lifetime, during-deployment, and post-deployment traumatic events. DSM-IV Criterion F and DSM-5 Criterion G were considered met if the soldier reported significant interference or distress due to their PTSD symptoms.
True DSM-IV PTSD was defined using the 17 PCL-C as: (i) one or more Criterion B (re-experiencing) symptoms, (ii) three or more Criterion C (avoidance/numbing) symptoms, (iii) two or more Criterion D (hyperarousal) symptoms, and (iv) significant interference or distress due to PTSD symptoms (Criterion F).
True DSM-5 PTSD was defined using the 15 PCL-C items and five PCL-5 items as: (i) one or more Criterion B (re-experiencing) symptoms, (ii) one or two Criterion C (avoidance) symptoms, (iii) two or more Criterion D (negative alterations in cognition and mood) symptoms, (iv) two or more Criterion E (hyperarousal) symptoms, and (v) significant interference or distress due to PTSD symptoms (Criterion G).
The conservative approximation of DSM-5 PTSD was defined using DSM-IV symptoms as assessed by the PCL-C as: (i) one or more DSM-IV Criterion B (re-experiencing) symptoms, which are virtually identical to DSM-5 Criterion B symptoms, (ii) one or two of the two DSM-IV Criterion C (avoidance/numbing) symptoms that map onto DSM-5 Criterion C (avoidance) symptoms, (iii) two or more of the four DSM-IV Criterion C (avoidance/numbing) symptoms that map onto DSM-5 Criterion D (negative alterations in cognition and mood) symptoms, and (iv) two or more of the DSM-IV Criterion D symptoms that map onto DSM-5 Criterion E (hyperarousal symptoms).
Defining a broad approximation of DSM-5 PTSD
Inspection of the 30-by-2 table cross-classifying the PCL-C approximation of DSM-5 Criteria D-E with DSM-5/PCL-5 diagnoses showed that the majority of the 7.4% (100% minus the 92.6% true positive percentage in Table 2) of false negative DSM-5/PCL-5 cases endorsed one or more of the four DSM-5 Criterion D symptoms assessed in the PCL-C as well as at least four of the five DSM-5 Criterion E symptoms assessed in the PCL-C (i.e., 67.7% of the 31 conservative approximation false negatives), while this pattern of endorsement was less common among DSM-5/PCL-5 non-cases. (Table 3) Based on this observation, we defined a broad approximation of DSM-5 PTSD based on the PCL-C as meeting full Criteria A-C and G in addition to one or more of the four DSM-5 Criterion D symptoms assessed in the PCL-C and at least four of the five DSM-5 Criterion E symptoms assessed in the PCL-C.
Table 3.
Approximated number of DSM-5 symptoms | Number of DSM-5 PTSD Cases | ||
---|---|---|---|
Criterion D | Criterion E | True Non-Casea | True Caseb |
0 | 0 | 1 | 0 |
0 | 1 | 5 | 0 |
0 | 2 | 6 | 1FN |
0 | 3 | 9 | 2FN |
0 | 4 | 7 | 0 |
0 | 5 | 7 | 1FN |
1 | 0 | 0 | 0 |
1 | 1 | 1 | 1FN |
1 | 2 | 4 | 1FN |
1 | 3 | 6 | 3FN |
1 | 4 | 5 | 10FN |
1 | 5 | 13 | 11FN |
2 | 0 | 0 | 0 |
2 | 1 | 1 | 0 |
2 | 2 | 1FP | 6 |
2 | 3 | 0 | 10 |
2 | 4 | 5FP | 12 |
2 | 5 | 3FP | 18 |
3 | 0 | 0 | 0 |
3 | 1 | 2 | 1FN |
3 | 2 | 0 | 10 |
3 | 3 | 0 | 25 |
3 | 4 | 0 | 29 |
3 | 5 | 0 | 64 |
4 | 0 | 1 | 0 |
4 | 1 | 5 | 0 |
4 | 2 | 0 | 6 |
4 | 3 | 0 | 11 |
4 | 4 | 0 | 25 |
4 | 5 | 0 | 173 |
Abbreviations: PTSD, posttraumatic stress disorder; PCL-C, civilian PTSD checklist for DSM-IV; PCL-5, PTSD checklist for DSM-5.
The sum of the column equals 82, the total number of soldiers who met DSM-5 PTSD Criteria A, B, C, and G but not D and/or E.
The sum of the column equals 420, the total number of true cases of DSM-5 PTSD.
Conservative approximation false negatives (31 cases)
Conservative approximation false positives (9 cases)
Comparisons between DSM-5 and broadly approximated DSM-5 PTSD
The 30-day prevalence estimate of DSM-5 PTSD based on the broad PCL-C coding scheme was 4.7%, slightly higher but close to the estimate based on DSM-5/PCL-5 (i.e., 4.6%). (Table 4) This was achieved by increasing sensitivity (the proportion of DSM-5/PCL-5 cases that were correctly classified as cases by the approximation) from 92.6% in the conservative approximation to 95.5%. This was done at the expense of decreasing specificity (the proportion of DSM-5/PCL-5 non-cases that were correctly classified by the approximation as non-cases) from 99.9% in the conservative approximation to 99.6%. Given that the number of people in the population who are non-cases is much higher than the number who are cases, the small decrease in specificity decreased both total classification accuracy (from 99.6% to 99.4%) and κ (from 0.95 to 0.93) and increased AUC (from 0.96 to 0.98).
Table 4.
Aggregate concordance |
Individual-level concordance |
|||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
True prevalence | Estimated prevalence | McNemar | Positive operating characteristics | Negative operating characteristics | ||||||||||||||
% | SE | % | SE | χ 2 1 | Sens | SE | PPV | SE | Spec | SE | NPV | SE | TCA | SE | κ | SE | AUC | |
Conservative approximation (vs. true DSM-5) | 4.6 | 0.2 | 4.3 | 0.2 | 12.1* | 92.6 | 1.3 | 97.7 | 0.8 | 99.9 | 0.0 | 99.6 | 0.1 | 99.6 | 0.1 | 0.95 | 0.0 | 0.96 |
Broad approximation (vs. true DSM-5) | 4.6 | 0.2 | 4.7 | 0.2 | 4.7* | 95.5 | 1.0 | 92.0 | 1.3 | 99.6 | 0.1 | 99.8 | 0.1 | 99.4 | 0.1 | 0.93 | 0.0 | 0.98 |
Abbreviations: PTSD, posttraumatic stress disorder; se, standard error; Sens, sensitivity; PPV, positive predicted value; Spec, specificity; NPV, negative predicted value; TCA, total classification accuracy; κ = Cohen's κ; AUC, area under the curve.
Significant at the .05 level, two-sided test
The trade-off between reduction in total classification accuracy and increase in AUC
The symptom count distributions of DSM-5/PCL-5 Criteria D and E were compared between cases either detected or not detected by the two PCL-C approximations. (Table 5) The Criterion D symptom count distributions were significantly different for detected and undetected cases based on both the conservative (χ23=106.0, p<.001) and broad (χ23=61.0, p<.001) approximations, with 71.4-73.5% of detected cases endorsing five or more Criterion D symptoms compared to 3.2-5.3% of not detected cases. A similar pattern was found for Criterion E, with the symptom count distributions significantly different for detected and undetected cases based on both the conservative (χ24=12.7, p=.01) and broad (χ24=17.2, p=.002) approximations, with 42.4-42.9 of detected cases endorsing all six Criterion E symptoms compared to 10.5-16.1% of not detected cases.
Table 5.
Conservative approximation |
Broad approximation |
|||||||
---|---|---|---|---|---|---|---|---|
Detected | Not detected | Detected | Not detected | |||||
% | SE | % | SE | % | SE | % | SE | |
I. Criterion Da | ||||||||
2 | 6.2 | 1.2 | 58.1 | 9.0 | 7.7 | 1.3 | 57.9 | 11.6 |
3 | 7.5 | 1.3 | 22.6 | 7.6 | 8.0 | 1.4 | 21.1 | 9.6 |
4 | 12.9 | 1.7 | 16.1 | 6.7 | 13.0 | 1.7 | 15.8 | 8.6 |
5a | 16.5 | 1.9 | 0.0 | 0.0 | 16.0 | 1.8 | 0.0 | 0.0 |
6a | 17.7 | 1.9 | 3.2 | 3.2 | 17.2 | 1.9 | 5.3 | 5.3 |
7a | 39.3 | 2.5 | 0.0 | 0.0 | 38.2 | 2.4 | 0.0 | 0.0 |
Total | 100.0 | -- | 100.0 | -- | 100.0 | -- | 100.0 | -- |
χ23 | 106.0* | 61.0* | ||||||
II. Criterion E | ||||||||
2 | 5.1 | 1.1 | 12.9 | 6.1 | 5.0 | 1.1 | 21.1 | 9.6 |
3 | 9.8 | 1.5 | 12.9 | 6.1 | 9.5 | 1.5 | 21.1 | 9.6 |
4 | 13.9 | 1.8 | 29.0 | 8.3 | 14.5 | 1.8 | 26.3 | 10.4 |
5 | 28.3 | 2.3 | 29.0 | 8.3 | 28.7 | 2.3 | 21.1 | 9.6 |
6 | 42.9 | 2.5 | 16.1 | 6.7 | 42.4 | 2.5 | 10.5 | 7.2 |
Total | 100.0 | -- | 100.0 | -- | 100.0 | -- | 100.0 | -- |
χ24 | 12.7* | 17.2* | ||||||
(n) | (389) | (31) | (401) | (19) |
Abbreviations: PTSD, posttraumatic stress disorder.
Significant at the .05 level, two-sided test
A single collapsed category was created for 5-7 Criterion D symptoms because no soldiers in the not detected subgroup endorsed exactly 5 or exactly 7 Criterion D symptoms. A three degrees of freedom χ2 test was then used to test for significant differences in the distribution of Criterion D symptoms among those detected and not detected by the approximations.
DISCUSSION
Three study limitations are noteworthy. First, the diagnoses are based on self-report scales rather than clinical interviews. Second, the sample is based on a narrow segment of the population: US Army soldiers in Brigade Combat Teams recently returning from deployment in Afghanistan, during which time the vast majority of respondents were exposed to traumatic combat-related experiences. Third, our blended combination of the PCL-C and PCL-5 scales introduced more similarity between the two than exists in the originals. This harmonization was carried out to avoid redundancy in question wording, but might have led to an over-estimation of the similarity of case definitions of DSM-IV and DSM-5 PTSD. Based on these limitations, replication of our study is needed in broader samples using clinical interviews that operationalize both DSM-IV and DSM-5 criteria to determine the external validity of the results reported here.
Within the context of these limitations, the study results are useful in two ways. First, the finding of substantial overlap between diagnoses based on DSM-IV and DSM-5 criteria and the finding of slightly higher prevalence of DSM-IV/PCL-4 PTSD (5.3%) than DSM-5/PCL-5 PTSD (4.6%) are consistent with most, although not all,[12] smaller studies of the final published DSM-5 criteria among active duty soldiers,[7] veterans,[9,10] and civilians.[8,9,11] Although the exclusion of DSM-IV Criterion A2 and the addition of a new qualifying symptom in DSM-5 Criterion E broaden the DSM-5 definition of PTSD relative to the DSM-IV definition, the lower prevalence of DSM-5 than DSM-IV PTSD in previous studies was due to the tightening of Criterion A1 (i.e., non-violent indirect events no longer qualifying) in conjunction with the new requirement of experiencing at least one avoidance symptom (DSM-5 Criterion C) along with the fact that the new symptoms of DSM-5 Criterion D (negative alterations in cognition and mood) are relatively uncommon. While the changes to Criterion A1 were not relevant to the current sample of combat-exposed soldiers, inspection of the symptom-level cross-classification showed that the lower prevalence of DSM-5 than DSM-IV PTSD found here was caused by to the exclusion of DSM-IV cases from DSM-5 due to new requirement of experiencing at least one avoidance symptom and to the rarity of the new DSM-5 Criterion D symptoms.
Second, we showed that DSM-IV criteria can be used to closely approximate DSM-5 criteria in the context of the measures and sample considered. These approximations provide a principled basis for recoding DSM-IV diagnoses in previously-collected research samples to generate estimates of DSM-5 PTSD. The transformation rules suggested by our approximation should be considered only provisional because of the narrowness of the sample and the possibility that results might have been influenced by the particular measures we used. There is good reason to expect that similar results will be found in other samples using other measures due to the fact that the new DSM-5 PTSD symptoms are among the least frequently endorsed of the DSM-5 Criteria D and E symptoms both in our study and in previous studies.[9,12] This is especially true of DSM-5 symptoms D2 (negative expectations about self/others/world), D3 (distorted blame of self or others), and E2 (reckless or self-destructive behavior). As a result, only a small number of cases – and cases that for the most part only meet minimum DSM-5 criteria – are likely to be missed by applying the scoring rules we developed here for DSM-5 approximations based on DSM-IV symptoms.
ACKNOWLEDGEMENTS
Army STARRS was sponsored by the Department of the Army and funded under cooperative agreement number U01MH087981 with the U.S. Department of Health and Human Services, National Institutes of Health, National Institute of Mental Health (NIH/NIMH). The contents are solely the responsibility of the authors and do not necessarily represent the views of the Department of Health and Human Services, NIMH, the Department of the Army, or the Department of Defense.
The Army STARRS Team consists of Co-Principal Investigators: Robert J. Ursano, MD (Uniformed Services University of the Health Sciences) and Murray B. Stein, MD, MPH (University of California San Diego and VA San Diego Healthcare System) Site Principal Investigators: Steven Heeringa, PhD (University of Michigan) and Ronald C. Kessler, PhD (Harvard Medical School) National Institute of Mental Health (NIMH) collaborating scientists: Lisa J. Colpe, PhD, MPH and Michael Schoenbaum, PhD Army liaisons/consultants: COL Steven Cersovsky, MD, MPH (USAPHC) and Kenneth Cox, MD, MPH (USAPHC) Other team members: Pablo A. Aliaga, MA (Uniformed Services University of the Health Sciences); COL David M. Benedek, MD (Uniformed Services University of the Health Sciences); K. Nikki Benevides, MA (Uniformed Services University of the Health Sciences); Paul D. Bliese, PhD (University of South Carolina); Susan Borja, PhD (NIMH); Evelyn J. Bromet, PhD (Stony Brook University School of Medicine); Gregory G. Brown, PhD (University of California San Diego); Christina Buckley, BA (Uniformed Services University of the Health Sciences); Laura Campbell-Sills, PhD (University of California San Diego); Catherine L. Dempsey, PhD, MPH (Uniformed Services University of the Health Sciences); Carol S. Fullerton, PhD (Uniformed Services University of the Health Sciences); Nancy Gebler, MA (University of Michigan); Robert K. Gifford, PhD (Uniformed Services University of the Health Sciences); Stephen E. Gilman, ScD (Harvard School of Public Health); Marjan G. Holloway, PhD (Uniformed Services University of the Health Sciences); Paul E. Hurwitz, MPH (Uniformed Services University of the Health Sciences); Sonia Jain, PhD (University of California San Diego); Tzu-Cheg Kao, PhD (Uniformed Services University of the Health Sciences); Karestan C. Koenen, PhD (Columbia University); Lisa Lewandowski-Romps, PhD (University of Michigan); Holly Herberman Mash, PhD (Uniformed Services University of the Health Sciences); James E. McCarroll, PhD, MPH (Uniformed Services University of the Health Sciences); James A. Naifeh, PhD (Uniformed Services University of the Health Sciences); Tsz Hin Hinz Ng, MPH (Uniformed Services University of the Health Sciences); Matthew K. Nock, PhD (Harvard University); Rema Raman, PhD (University of California San Diego); Holly J. Ramsawh, PhD (Uniformed Services University of the Health Sciences); Anthony Joseph Rosellini, PhD (Harvard Medical School); Nancy A. Sampson, BA (Harvard Medical School); LCDR Patcho Santiago, MD, MPH (Uniformed Services University of the Health Sciences); Michaelle Scanlon, MBA (NIMH); Jordan W. Smoller, MD, ScD (Harvard Medical School); Amy Street, PhD (Boston University School of Medicine); Michael L. Thomas, PhD (University of California San Diego); Patti L. Vegella, MS, MA (Uniformed Services University of the Health Sciences); Leming Wang, MS (Uniformed Services University of the Health Sciences); Christina L. Wassel, PhD (University of Pittsburgh); Simon Wessely, FMedSci (King's College London); Hongyan Wu, MPH (Uniformed Services University of the Health Sciences); LTC Gary H. Wynn, MD (Uniformed Services University of the Health Sciences); Alan M. Zaslavsky, PhD (Harvard Medical School); and Bailey G. Zhang, MS (Uniformed Services University of the Health Sciences).
The authors thank Frank W. Weathers, PhD for providing Army STARRS with the PTSD Checklist for DSM-5 (PCL-5).
Footnotes
Disclosure: Dr. Kessler has been a consultant for Hoffman-La Roche, Inc., Johnson & Johnson Wellness and Prevention, and Sonofi-Aventis Groupe. Dr. Kessler has served on advisory boards for Mensante Corporation, Plus One Health Management, Lake Nona Institute, and U.S. Preventive Medicine. Dr. Kessler owns 25% share in DataStat, Inc. The remaining authors reported nothing to disclose. Dr. Stein has been a consultant for Care Management Technologies, received payment for his editorial work from UpToDate and Depression and Anxiety, and had research support for pharmacological imaging studies from Janssen. The remaining authors report nothing to disclose.
REFERENCES
- 1.Kessler RC, Berglund P, Demler O, et al. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62:593–602. doi: 10.1001/archpsyc.62.6.593. [DOI] [PubMed] [Google Scholar]
- 2.Kessler RC. Posttraumatic stress disorder: the burden to the individual and to society. J Clin Psychiat. 2000;61(Suppl 5):4–12. discussion 13-14. [PubMed] [Google Scholar]
- 3.American Psychiatric Association . Diagnostic and statistical manual of mental disorders. 5th ed. American Psychiatric Association; Washington, DC: 2013. [Google Scholar]
- 4.American Psychiatric Association . Diagnostic and statistical manual of mental disorders. 4th ed., text rev. American Psychiatric Association; Washington, DC: 2000. [Google Scholar]
- 5.Calhoun PS, Hertzberg JS, Kirby AC, et al. The effect of draft DSM-V criteria on posttraumatic stress disorder prevalence. Depress Anxiety. 2012;29:1032–1042. doi: 10.1002/da.22012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Elhai JD, Miller ME, Ford JD, et al. Posttraumatic stress disorder in DSM-5: estimates of prevalence and symptom structure in a nonclinical sample of college students. J Anxiety Disord. 2012;26:58–64. doi: 10.1016/j.janxdis.2011.08.013. [DOI] [PubMed] [Google Scholar]
- 7.Hoge CW, Riviere LA, Wilk JE, et al. The prevalence of post-traumatic stress disorder (PTSD) in US combat soldiers: a head-to-head comparison of DSM-5 versus DSM-IVTR symptom criteria with the PTSD checklist. Lancet Psychiatry. 2014;1:269–277. doi: 10.1016/S2215-0366(14)70235-4. [DOI] [PubMed] [Google Scholar]
- 8.Kilpatrick DG, Resnick HS, Milanak ME, et al. National estimates of exposure to traumatic events and PTSD prevalence using DSM-IV and DSM-5 criteria. J Trauma Stress. 2013;26:537–547. doi: 10.1002/jts.21848. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Miller MW, Wolf EJ, Kilpatrick D, et al. The prevalence and latent structure of proposed DSM-5 posttraumatic stress disorder symptoms in U.S. national and veteran samples. Psychol Trauma Theory Res Pract Policy. 2013;5:501–512. [Google Scholar]
- 10.Gentes EL, Dennis PA, Kimbrel NA, et al. DSM-5 posttraumatic stress disorder: factor structure and rates of diagnosis. Journal of psychiatric research. 2014;59:60–67. doi: 10.1016/j.jpsychires.2014.08.014. [DOI] [PubMed] [Google Scholar]
- 11.O'Donnell ML, Alkemade N, Nickerson A, et al. Impact of the diagnostic changes to post-traumatic stress disorder for DSM-5 and the proposed changes to ICD-11. The British journal of psychiatry : the journal of mental science. 2014;205:230–235. doi: 10.1192/bjp.bp.113.135285. [DOI] [PubMed] [Google Scholar]
- 12.Carmassi C, Akiskal HS, Yong SS, et al. Post-traumatic stress disorder in DSM-5: estimates of prevalence and criteria comparison versus DSM-IV-TR in a non-clinical sample of earthquake survivors. J Affect Disorders. 2013;151:843–848. doi: 10.1016/j.jad.2013.07.020. [DOI] [PubMed] [Google Scholar]
- 13.Kessler RC, Colpe LJ, Fullerton CS, et al. Design of the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). Int J Methods Psychiatr Res. 2013;22:267–275. doi: 10.1002/mpr.1401. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Ursano RJ, Colpe LJ, Heeringa SG, et al. The Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). Psychiatry. 2014;77:107–119. doi: 10.1521/psyc.2014.77.2.107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Kessler RC, Heeringa SG, Colpe LJ, et al. Response bias, weighting adjustments, and design effects in the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). Int J Methods Psychiatr Res. 2013;22:288–302. doi: 10.1002/mpr.1399. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Weathers F, Litz B, Herman D, et al. San Antonio, TX.: 1993. The PTSD Checklist (PCL): Reliability, Validity, and Diagnostic Utility.Annual Convention of the International Society for Traumatic Stress Studies. [Google Scholar]
- 17.Weathers FW, Litz B, Keane TM, et al. The PTSD Checklist for DSM-5 (PCL-5). Scale available from the National Center for PTSD. 2013 [Google Scholar]
- 18.McDonald SD, Calhoun PS. The diagnostic accuracy of the PTSD checklist: a critical review. Clin Psychol Rev. 2010;30:976–987. doi: 10.1016/j.cpr.2010.06.012. [DOI] [PubMed] [Google Scholar]
- 19.Ruggiero KJ, Rheingold AA, Resnick HS, et al. Comparison of two widely used PTSD-screening instruments: implications for public mental health planning. J Trauma Stress. 2006;19:699–707. doi: 10.1002/jts.20141. [DOI] [PubMed] [Google Scholar]
- 20.Kessler RC, Santiago PN, Colpe LJ, et al. Clinical reappraisal of the Composite International Diagnostic Interview Screening Scales (CIDI-SC) in the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). Int J Methods Psychiatr Res. 2013;22:303–321. doi: 10.1002/mpr.1398. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.First MB, Spitzer RL, Gibbon M, et al. Structured Clinical Interview for DSM-IV-TR Axis I Disorders, Research Version, Non-patient Edition (SCID-I/NP) Biometrics Research, New York State Psychiatric Institute; New York: 2002. [Google Scholar]
- 22.Kelley LP, Weathers FW, McDevitt-Murphy ME, et al. A comparison of PTSD symptom patterns in three types of civilian trauma. Journal of traumatic stress. 2009;22:227–235. doi: 10.1002/jts.20406. [DOI] [PubMed] [Google Scholar]
- 23.Zuromski KL, Davis MT, Witte TK, et al. PTSD symptom clusters are differentially associated with components of the acquired capability for suicide. Suicide & life-threatening behavior. 2014;44:682–697. doi: 10.1111/sltb.12098. [DOI] [PubMed] [Google Scholar]