Table 4a.
Classification Statistics: TOMM Trial 1 Performance for Single and Two-variable Models Predicting Simulator (SIM) and Healthy Comparison (HC) Group Membership.
SnSp90 | Youden J |
PPP BR 40% |
NPP BR 40% |
PPP BR 10% |
NPP BR 10% |
AUC | AUC 95% CI |
Χ2 | Predictor p |
|
---|---|---|---|---|---|---|---|---|---|---|
One-Variable Models:
|
||||||||||
Trial 1 Accuracy | .67 | 0.64 | .80 | .85 | .39 | .97 | .90 | [.84, .96] | 74.28*** | |
Effort-Max | .33−.35 | 0.25 | .59 | .69 | .21 | .93 | .67 | [.57, .77] | 13.29*** | |
View-Familiar (Max) | .31 | 0.24 | .58 | .69 | .19 | .93 | .66 | [.56, .76] | 11.40** | |
View-Unfamiliar (Max) | .33 | 0.24 | .58 | .69 | .19 | .93 | .66 | [.56, .76] | 12.33*** | |
Response-Familiar (Max) | .33−.35 | 0.24 | .58 | .69 | .20 | .92 | .66 | [.56, .76] | 12.81*** | |
Response-Unfamiliar (Max) | .32−.34 | 0.24 | .53 | .71 | .15 | .94 | .64 | [.53, .75] | 8.56** | |
Effort-Baseline | .17 | 0.04 | .46 | .61 | .17 | .90 | .55 | [.45, .65] | 2.12 | |
View-Familiar (Baseline) | .14−.15 | 0.05 | .47 | .61 | .12 | .90 | .59 | [.49, .69] | 4.37* | |
View-Unfamiliar (Baseline) | .15 | 0.04 | .44 | .61 | .13 | .91 | .58 | [.48, .69] | 3.74 | |
Response-Familiar (Baseline) | .15−.17 | 0.04 | .46 | .61 | .17 | .90 | .54 | [.44, .65] | 1.86 | |
Response-Unfamiliar (Baseline) | .12 | 0.08 | .45 | .63 | .13 | .90 | .58 | [.47, .70] | 3.25 | |
Effort-Range | .54 | 0.45 | .74 | .76 | .33 | .95 | .77 | [.68, .86] | 34.37*** | |
Familiarity-Difference | .19−.21 | 0.16 | .55 | .65 | .16 | .92 | .66 | [.56, .76] | 7.50** | |
Two-Variable Models: Accuracy + |
||||||||||
Effort-Max | .76−.82 | 0.68 | .84 | .86 | .45 | .97 | .94 | [.90, .98] | 90.76*** | .011 |
View-Familiar (Max) | .76−.80 | 0.66 | .84 | .85 | .45 | .97 | .94 | [.90, .98] | 90.49*** | .012 |
View-Unfamiliar (Max) | .76−.82 | 0.66 | .84 | .85 | .45 | .97 | .94 | [.90, .98] | 90.90*** | .010 |
Response-Familiar (Max) | .76−.82 | 0.68 | .84 | .86 | .45 | .97 | .94 | [.90, .98] | 90.90*** | .010 |
Response-Unfamiliar (Max) | .66−.76 | 0.63 | .79 | .84 | .40 | .98 | .92 | [.87, .97] | 72.19*** | .016 |
View-Familiar (Baseline) | .76−.78 | 0.66 | .84 | .85 | .45 | .97 | .94 | [.90, .98] | 88.14*** | .027 |
Effort-Range | .71−.75 | 0.62 | .80 | .84 | .39 | .97 | .93 | [.89, .97] | 83.76*** | .023 |
Familiarity-Difference | .69−.83 | 0.69 | .84 | .87 | .48 | .97 | .90 | [.84, .96] | 77.49*** | .081 |
Note. SnSp90 = Sensitivity (detection of simulated TBI) when Sp Specificity (bona fide TBI) is set at cut point ≥ .90 (range presented when cut point is associated with multiple Sn values); PPP = Positive Predictive Power, NPP = Negative Predictive Power (each presented for 40% and 10% base rate); AUC = ROC area under the curve. See Table 1 for pupil variable abbreviation key.