Table 3b.
Classification Statistics: TOMM Trial 2 Performance for Single and Two-variable Models Predicting Simulator (SIM) and Traumatic Brain Injury (TBI) Group Membership.
SnSp90 | Youden J |
PPP BR 40% |
NPP BR 40% |
PPP BR 10% |
NPP BR 10% |
AUC | AUC 95% CI |
Χ2 | Predictor p |
|
---|---|---|---|---|---|---|---|---|---|---|
One-Variable Models:
|
||||||||||
Trial 2 Accuracy | .65 | 0.57 | .84 | .80 | .50 | .95 | .85 | [.78, .93] | 50.66*** | |
Effort-Max | .59−.61 | 0.41 | .62 | .77 | .22 | .96 | .78 | [.69, .87] | 21.22*** | |
View-Familiar (Max) | .53 | 0.37 | .60 | .76 | .21 | .96 | .78 | [.69, .87] | 26.14*** | |
View-Unfamiliar (Max) | .51−.55 | 0.38 | .61 | .77 | .21 | .96 | .80 | [.71, .88] | 30.20*** | |
Response-Familiar (Max) | .57−.59 | 0.45 | .64 | .79 | .23 | .96 | .79 | [.70, .88] | 29.40*** | |
Response-Unfamiliar (Max) | .56−.65 | 0.24 | .49 | .77 | .14 | .96 | .78 | [.67, .90] | 15.83*** | |
Effort-Baseline | .35 | 0.39 | .61 | .76 | .21 | .96 | .75 | [.65, .84] | 21.49*** | |
View-Familiar (Baseline) | .45−.47 | 0.41 | .62 | .77 | .22 | .96 | .75 | [.66, .85] | 20.08*** | |
View-Unfamiliar (Baseline) | .43 | 0.42 | .64 | .79 | .23 | .96 | .77 | [.67, .86] | 24.31*** | |
Response-Familiar (Baseline) | .35 | 0.39 | .61 | .76 | .21 | .96 | .75 | [.66, .85] | 21.81*** | |
Response-Unfamiliar (Baseline) | .40 | 0.21 | .47 | .85 | .13 | .94 | .75 | [.63, .87] | 10.80** | |
Effort-Range | .33−.39 | 0.29 | .58 | .71 | .20 | .93 | .65 | [.54, .76] | 12.62*** | |
Familiarity-Difference | .12 | 0.05 | .41 | .62 | .11 | .92 | .55 | [.43, .66] | 0.87 | |
Two-Variable Models: Accuracy + |
||||||||||
Effort-Max | .69−.75 | 0.63 | .83 | .83 | .44 | .96 | .89 | [.83, .96] | 60.10*** | .006 |
View-Familiar (Max) | .67−.73 | 0.63 | .83 | .83 | .44 | .96 | .89 | [.83, .96] | 59.32*** | .008 |
View-Unfamiliar (Max) | .71−.75 | 0.63 | .83 | .83 | .44 | .96 | .89 | [.83, .95] | 60.41*** | .004 |
Response-Familiar (Max) | .69−.75 | 0.63 | .83 | .83 | .44 | .96 | .89 | [.83, .96] | 60.25*** | .006 |
Response-Unfamiliar (Max) | .74−.77 | 0.59 | .70 | .88 | .26 | .98 | .90 | [.83, .97] | 33.97*** | .041 |
Effort-Baseline | .75−.77 | 0.67 | .86 | .85 | .53 | .97 | .89 | [.83, .95] | 61.58*** | .004 |
View-Familiar (Baseline) | .65−.69 | 0.57 | .80 | .80 | .39 | .96 | .90 | [.83, .95] | 59.18*** | .009 |
View-Unfamiliar (Baseline) | .77 | 0.64 | .81 | .84 | .42 | .98 | .89 | [.83, .96] | 61.59*** | .003 |
Response-Familiar (Baseline) | .75−.77 | 0.67 | .86 | .85 | .53 | .97 | .89 | [.83, .95] | 61.66** | .004 |
Response-Unfamiliar (Baseline) | .70−.81 | 0.61 | .71 | .86 | .31 | .98 | .91 | [.84, .98] | 35.55*** | .041 |
Effort-Range | .65−.71 | 0.57 | .84 | .80 | .50 | .95 | .85 | [.77, .93] | 50.79*** | .719 |
Note. SnSp90 = Sensitivity (detection of simulated TBI) when Sp Specificity (bona fide TBI) is set at cut point ≥ .90 (range presented when cut point is associated with multiple Sn values); PPP = Positive Predictive Power, NPP = Negative Predictive Power (each presented for 40% and 10% base rate); AUC = ROC area under the curve. See Table 1 for pupil variable abbreviation key.