Table 4.
Differences between test-retest reliability of DSM-5 substance use disorder and DSM-IV substance dependence, N = 565.
| DSM-5 binary diagnosis Mean Kappa (95 % CI)c | DSM-IV binary diagnosis | Mean difference, DSM-5 and DSM-IV kappa (95 % CI)d | DSM-5 dimensional severitya Mean ICC (95 % CI)e | DSM-IV dimensional severityb | Mean difference, DSM-5 and DSM-IV ICC (95 % CI)f | |
|---|---|---|---|---|---|---|
| Current | ||||||
| Alcohol | 0.68 (0.62, 0.74) | 0.70 (0.64, 0.76) | − 0.01 (−0.09, 0.04) | 0.89 (0.87, 0.92) | 0.88 (0.84, 0.90) | 0.02 (0.01, 0.03) |
| Tobacco | 0.79 (0.74, 0.83) | 0.67 (0.61, 0.73) | 0.12 (0.04, 0.19) | 0.91 (0.87, 0.93) | 0.89 (0.85, 0.91) | 0.02 (0.01, 0.03) |
| Cannabis | 0.74 (0.68, 0.81) | 0.62 (0.56, 0.70) | 0.12 (0.04, 0.22) | 0.90 (0.87, 0.92) | 0.87 (0.84, 0.89) | 0.03 (0.02, 0.04) |
| Cocaine | 0.82 (0.77, 0.87) | 0.79 (0.74, 0.83) | 0.04 (−0.01, 0.08) | 0.91 (0.88, 0.93) | 0.91 (0.88, 0.93) | 0.00 (−0.00, 0.01) |
| Heroin | 0.94 (0.90, 0.97) | 0.92 (0.87, 0.95) | 0.02 (−0.01, 0.05) | 0.97 (0.95, 0.98) | 0.97 (0.95, 0.98) | − 0.00 (−0.01, 0.01) |
| Opioids | 0.67 (0.58, 0.75) | 0.69 (0.60, 0.77) | −0.02 (−0.09, 0.04) | 0.87 (0.82, 0.92) | 0.86 (0.82, 0.91) | 0.00 (−0.01, 0.02) |
| Sedatives | 0.58 (0.47, 0.66) | 0.60 (0.48, 0.72) | − 0.02 (−0.10, 0.08) | 0.82 (0.73, 0.88) | 0.81 (0.72, 0.88) | 0.01 (−0.01, 0.02) |
| Hallucinogens | _g | _g | − | 0.73 (0.34, 0.90) | 0.67 (0.35, 0.84) | 0.06 (−0.00, 0.13) |
| Stimulants | 0.60 (0.38, 0.80) | 0.57 (0.32, 0.73) | 0.04 (−0.09, 0.20) | 0.87 (0.77, 0.97) | 0.85 (0.74, 0.95) | 0.02 (−0.02, 0.06) |
| Lifetime | ||||||
| Alcohol | 0.62 (0.53, 0.69) | 0.66 (0.62, 0.73) | − 0.04 (−0.11, 0.02) | 0.93 (0.91, 0.94) | 0.91 (0.89, 0.93) | 0.01 (0.00, 0.02) |
| Tobacco | 0.74 (0.69, 0.80) | 0.64 (0.57, 0.70) | 0.10 (0.03, 0.16) | 0.91 (0.88, 0.93) | 0.89 (0.86, 0.91) | 0.02 (0.01, 0.03) |
| Cannabis | 0.65 (0.58, 0.71) | 0.59 (0.52, 0.65) | 0.06 (−0.02, 0.14) | 0.89 (0.87, 0.91) | 0.86 (0.83, 0.89) | 0.03 (0.02, 0.04) |
| Cocaine | 0.72 (0.67, 0.78) | 0.74 (0.69, 0.78) | −0.02 (−0.06, 0.04) | 0.93 (0.91, 0.94) | 0.92 (0.90, 0.94) | 0.01 (0.00, 0.02) |
| Heroin | 0.92 (0.88, 0.95) | 0.92 (0.89, 0.96) | − 0.01 (−0.04, 0.02) | 0.99 (0.98, 0.99) | 0.98 (0.97, 0.99) | 0.00 (−0.00, 0.00) |
| Opioids | 0.65 (0.57, 0.72) | 0.67 (0.59, 0.75) | −0.03 (−0.06, 0.02) | 0.90 (0.87, 0.93) | 0.90 (0.87, 0.92) | 0.01 (−0.00, 0.02) |
| Sedatives | 0.62 (0.54, 0.69) | 0.66 (0.55, 0.75) | − 0.05 (−0.10, 0.02) | 0.88 (0.82, 0.91) | 0.86 (0.80, 0.90) | 0.01 (−0.00, 0.02) |
| Hallucinogens | 0.53 (0.40, 0.64) | 0.45 (0.30, 0.58) | 0.08 (−0.05, 0.20) | 0.81 (0.73, 0.88) | 0.75 (0.66, 0.84) | 0.06 (0.03, 0.09) |
| Stimulants | 0.54 (0.41, 0.67) | 0.59 (0.42, 0.70) | − 0.05 (−0.14, 0.06) | 0.84 (0.75, 0.91) | 0.83 (0.73, 0.90) | 0.01 (−0.02, 0.03) |
CI = Confidence interval; ICC = Intraclass Correlation Coefficient.
Total number of DSM-5 substance use disorder criteria endorsed (of possible 11, except hallucinogens, which do not include withdrawal).
Total number of DSM-IV substance dependence criteria endorsed (of possible 7, except cannabis and hallucinogens, which did not include withdrawal).
Mean kappa from 100 bootstrapped samples, with empirical CI
Mean difference calculated as the mean of ([DSM-5 κ] - [DSM-IV κ]) in each of the 100 bootstrapped samples, with empirical CI.
CI that do not include 0 indicate a significant greater κ for DSM-5 substance use disorder and are bolded.
Mean ICC from 100 bootstrapped samples, with empirical CI
Mean difference is calculated as the mean of ([DSM-5 severity ICC] – [DSM-IV severity ICC]) in each of the 100 bootstrapped samples, with empirical CI.
CI that do not include 0 indicate a significantly greater ICC for DSM-5 severity, and are bolded.
Current hallucinogens not included because prevalence of DSM-IV hallucinogen dependence was <2% in the test and retest interviews. Interpretation of reliability coefficients: Fair: 0.21–0.40; moderate: 0.41–0.60; substantial: 0.61–0.80; excellent: 0.81–1.00.