Table 2.
Statistical tests of performance improvements between models in this paper and standard baseline screening models. ΔAUC tells us the increase in AUC found in the screeners of this paper across bootstrapping experiments. ΔSpecificity tells us the increase in the specificity in the bootstrapping experiments at a threshold designed to achieve 90% sensitivity. Each Δ calculation shows the average value of the improvement along with the [0.05, 0.95] confidence interval.
| Age Group | Baseline Screener | Assessment Module | ΔAUC, [0.05, 0.95] C.I. | ΔSpecificity at 90% sensitivity, [0.05, 0.95] C.I. | n |
|---|---|---|---|---|---|
| All ages | CBCL | Parent | 0.17, [0.10, 0.23] | 0.21, [0.13, 0.30] | 370 |
| All ages | SRS-2 | Parent | 0.20, [0.12, 0.28] | 0.21, [0.12, 0.31] | 307 |
| All ages | CBCL | Parent, Video | 0.29, [0.22, 0.36] | 0.41, [0.30, 0.52] | 363 |
| All ages | SRS-2 | Parent, Video | 0.32, [0.24, 0.40] | 0.41, [0.30, 0.52] | 302 |
| All ages | CBCL | Parent, Video, and Clinician | 0.35, [0.26, 0.43] | 0.69, [0.58, 0.81] | 200 |
| All ages | SRS-2 | Parent, Video, and Clinician | 0.42, [0.33, 0.50] | 0.65, [0.52, 0.78] | 175 |
| 1.5 to 3 y.o. | M-CHAT-R | Parent | −0.01, [−0.10, 0.07] | 0.09, [−0.02, 0.21] | 209 |
| 1.5 to 3 y.o. | CBCL | Parent | 0.12, [0.03, 0.22] | 0.20, [0.07, 0.34] | 214 |
| 1.5 to 3 y.o. | SRS-2 | Parent | 0.15, [0.03, 0.27] | 0.24, [0.12, 0.38] | 161 |
| 1.5 to 3 y.o. | M-CHAT-R | Parent, Video | 0.14, [0.06, 0.22] | 0.20, [0.07, 0.34] | 204 |
| 1.5 to 3 y.o. | CBCL | Parent, Video | 0.28, [0.18, 0.38] | 0.33, [0.18, 0.49] | 209 |
| 1.5 to 3 y.o. | SRS-2 | Parent, Video | 0.31, [0.20, 0.42] | 0.37, [0.21, 0.55] | 157 |
| 1.5 to 3 y.o. | M-CHAT-R | Parent, Video, and Clinician | 0.18, [0.08, 0.29] | 0.30, [0.11, 0.50] | 107 |
| 1.5 to 3 y.o. | CBCL | Parent, Video, and Clinician | 0.34, [0.22, 0.45] | 0.46, [0.25, 0.67] | 111 |
| 1.5 to 3 y.o. | SRS-2 | Parent, Video, and Clinician | 0.40, [0.27, 0.53] | 0.50, [0.28, 0.73] | 91 |
| 1.5 to 3 y.o. | CBCL | Parent | 0.21, [0.11, 0.30] | 0.23, [0.11, 0.35] | 156 |
| 1.5 to 3 y.o. | SRS-2 | Parent | 0.25, [0.15, 0.36] | 0.18, [0.06, 0.31] | 146 |
| 4 to 6 y.o. | CBCL | Parent, Video | 0.30, [0.20, 0.39] | 0.49, [0.34, 0.64] | 154 |
| 4 to 6 y.o. | SRS-2 | Parent, Video | 0.33, [0.22, 0.44] | 0.44, [0.29, 0.59] | 145 |
| 4 to 6 y.o. | CBCL | Parent, Video, and Clinician | 0.35, [0.23, 0.47] | 0.93, [0.83, 1.00] | 89 |
| 4 to 6 y.o. | SRS-2 | Parent, Video, and Clinician | 0.43, [0.30, 0.55] | 0.79, [0.66, 0.91] | 84 |