Table 3a.
Classification Statistics: TOMM Trial 1 Performance for Single and Two-variable Models Predicting Simulator (SIM) and Traumatic Brain Injury (TBI) Group Membership
SnSp90 | Youden J |
PPP BR 40% |
NPP BR 40% |
PPP BR 10% |
NPP BR 10% |
AUC | AUC 95% CI |
Χ2 | Predictor p |
|
---|---|---|---|---|---|---|---|---|---|---|
One-Variable Models:
|
||||||||||
Trial 1 Accuracy | .46−.54 | 0.40 | .63 | .76 | .23 | .95 | .78 | [.69, .87] | 29.83*** | |
Effort-Max | .58 | 0.48 | .69 | .79 | .26 | .96 | .80 | [.71, .88] | 33.23*** | |
View-Familiar (Max) | .56−.58 | 0.50 | .70 | .80 | .26 | .96 | .81 | [.72, .89] | 34.45*** | |
View-Unfamiliar (Max) | .56−.58 | 0.46 | .67 | .79 | .24 | .96 | .80 | [.72, .89] | 33.97*** | |
Response-Familiar (Max) | .58 | 0.48 | .69 | .79 | .26 | .96 | .80 | [.71, .88] | 33.74*** | |
Response-Unfamiliar (Max) | .60 | 0.50 | .68 | .80 | .27 | .96 | .83 | [.74, .91] | 36.94*** | |
Effort-Baseline | .44 | 0.39 | .61 | .76 | .21 | .96 | .77 | [.68, .86] | 25.50*** | |
View-Familiar (Baseline) | .44−.48 | 0.40 | .62 | .77 | .21 | .96 | .80 | [.70, .88] | 29.84*** | |
View-Unfamiliar (Baseline) | .40−.44 | 0.39 | .63 | .76 | .22 | .95 | .77 | [.68, .86] | 26.53*** | |
Response-Familiar (Baseline) | .44−.46 | 0.37 | .60 | .75 | .21 | .94 | .77 | [.68, .86] | 26.21*** | |
Response-Unfamiliar (Baseline) | .46−.48 | 0.43 | .61 | .80 | .21 | .97 | .79 | [.70, .88] | 27.78*** | |
Effort-Range | .33−.35 | 0.33 | .63 | .73 | .21 | .94 | .69 | [.58, .79] | 15.18*** | |
Familiarity-Difference | .19−.21 | 0.19 | .48 | .69 | .14 | .93 | .61 | [.50, .72] | 2.25 | |
Two-Variable Models: Accuracy + |
||||||||||
Effort-Max | .69 | 0.57 | .73 | .84 | .31 | .97 | .88 | [.82. .95] | 58.90*** | < .001 |
View-Familiar (Max) | .71−.73 | 0.61 | .74 | .85 | .33 | .97 | .89 | [.83, .95] | 60.49*** | < .001 |
View-Unfamiliar (Max) | .75−.77 | 0.59 | .73 | .85 | .31 | .97 | .89 | [.83, .95] | 60.63*** | < .001 |
Response-Familiar (Max) | .69 | 0.57 | .73 | .84 | .31 | .97 | .88 | [.82, .95] | 59.18*** | < .001 |
Response-Unfamiliar (Max) | .74 | 0.62 | .71 | .88 | .30 | .97 | .89 | [.83, .95] | 54.34*** | < .001 |
Effort-Baseline | .78 | 0.63 | .75 | .86 | .33 | .97 | .90 | [.83, .96] | 63.91*** | < .001 |
View-Familiar (Baseline) | .80 | 0.63 | .75 | .86 | .33 | .97 | .89 | [.83, .95] | 60.00*** | < .001 |
View-Unfamiliar (Baseline) | .78 | 0.63 | .75 | .87 | .33 | .98 | .89 | [.82, .95] | 58.92*** | < .001 |
Response-Familiar (Baseline) | .78 | 0.61 | .74 | .85 | .33 | .97 | .90 | [.84, .96] | 64.44*** | < .001 |
Response-Unfamiliar (Baseline) | .78−.80 | 0.62 | .74 | .87 | .32 | .97 | .90 | [.84, .96] | 56.03*** | < .001 |
Effort-Range | .50−.52 | 0.37 | .62 | .75 | .22 | .95 | .79 | [.71, .88] | 32.87*** | .092 |
Note. SnSp90 = Sensitivity (detection of simulated TBI) when Sp Specificity (bona fide TBI) is set at cut point ≥ .90 (range presented when cut point is associated with multiple Sn values); PPP = Positive Predictive Power, NPP = Negative Predictive Power (each presented for 40% and 10% base rate); AUC = ROC area under the curve. See Table 1 for variable abbreviation key.