Table 5.
Estimated accuracy summaries of a risk score for predicting 5-year survival from the Framingham Offspring Study. Shown below are estimates (Est) and standard errors (SE) of accuracy estimators (multiplied by 100) based on the CNA and DIPW methods under the -sampling with full cohort data and nested case-control samples using m = 1 or 3 matched controls. Here cp is the pth percentile of the observed risk score in the full cohort.
CNA | DIPW | |||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Cohort | 1 control | 3 controls | Cohort | 1 control | 3 controls | |||||||
Est | SE | Est | SE | Est | SE | Est | SE | Est | SE | Est | SE | |
FPR5(c.2) | 79.7 | 1.0 | 79.7 | 2.5 | 79.6 | 1.6 | 79.7 | 1.0 | 79.6 | 2.5 | 79.8 | 1.5 |
FPR5(c.4) | 59.4 | 1.2 | 59.3 | 3.1 | 59.4 | 2.0 | 59.2 | 1.2 | 59.0 | 3.0 | 59.3 | 1.9 |
FPR5(c.6) | 39.2 | 1.2 | 39.2 | 3.1 | 39.0 | 2.0 | 38.8 | 1.3 | 38.6 | 3.0 | 38.9 | 1.9 |
FPR5(c.8) | 19.1 | 1.0 | 19.1 | 2.6 | 19.1 | 1.7 | 18.8 | 0.9 | 18.8 | 2.4 | 18.8 | 1.5 |
| ||||||||||||
TPR5(c.2) | 92.8 | 4.5 | 93.4 | 4.6 | 93.2 | 4.6 | 91.9 | 4.3 | 91.9 | 4.5 | 91.9 | 4.5 |
TPR5(c.4) | 86.9 | 5.1 | 87.0 | 5.2 | 87.0 | 5.1 | 89.2 | 4.7 | 89.2 | 5.1 | 89.2 | 5.1 |
TPR5(c.6) | 78.5 | 6.8 | 78.3 | 6.9 | 78.4 | 6.8 | 78.4 | 6.5 | 78.4 | 6.8 | 78.4 | 6.8 |
TPR5(c.8) | 61.2 | 7.9 | 60.0 | 8.6 | 60.6 | 8.0 | 62.2 | 7.7 | 62.2 | 8.0 | 62.2 | 8.0 |
| ||||||||||||
NPV5(c.2) | 99.2 | 0.5 | 99.3 | 0.5 | 99.3 | 0.5 | 99.1 | 0.5 | 99.1 | 0.5 | 99.1 | 0.5 |
NPV5(c.4) | 99.3 | 0.3 | 99.3 | 0.3 | 99.3 | 0.3 | 99.4 | 0.3 | 99.4 | 0.3 | 99.4 | 0.3 |
NPV5(c.6) | 99.2 | 0.3 | 99.2 | 0.3 | 99.2 | 0.3 | 99.2 | 0.3 | 99.2 | 0.3 | 99.2 | 0.3 |
| ||||||||||||
NPV5(c.8) | 99.0 | 0.3 | 98.9 | 0.3 | 99.0 | 0.3 | 99.0 | 0.3 | 99.0 | 0.3 | 99.0 | 0.3 |
PPV5(c.2) | 2.5 | 0.4 | 2.5 | 0.4 | 2.5 | 0.4 | 2.5 | 0.4 | 2.5 | 0.4 | 2.5 | 0.4 |
PPV5(c.4) | 3.1 | 0.5 | 3.1 | 0.6 | 3.1 | 0.5 | 3.2 | 0.6 | 3.2 | 0.6 | 3.2 | 0.6 |
PPV5(c.6) | 4.2 | 0.7 | 4.2 | 0.9 | 4.2 | 0.8 | 4.2 | 0.8 | 4.3 | 0.9 | 4.2 | 0.8 |
PPV5(c.8) | 6.5 | 1.3 | 6.4 | 1.7 | 6.5 | 1.4 | 6.8 | 1.4 | 6.9 | 1.6 | 6.8 | 1.4 |
| ||||||||||||
AUC | 75.2 | 4.1 | 74.9 | 4.5 | 75.1 | 4.2 | 75.8 | 3.9 | 75.5 | 4.3 | 75.7 | 4.2 |
FPRTPR=.9 | 65.0 | 13.9 | 66.3 | 14.5 | 65.8 | 13.8 | 58.7 | 8.4 | 58.5 | 14.2 | 58.8 | 12.5 |
PPVTPR=.9 | 99.4 | 0.3 | 99.4 | 0.3 | 99.4 | 0.3 | 99.4 | 0.7 | 99.4 | 1.0 | 99.4 | 0.9 |
NPVTPR=.9 | 2.9 | 0.8 | 2.8 | 0.8 | 2.9 | 0.8 | 3.2 | 0.2 | 3.3 | 0.2 | 3.2 | 0.2 |