Table 2: Performance Characteristics: Logistic Model of Diagnostic Claim Count, Refined Claims-Based Definition (Model 7), Overall and by Age Group.
Model | Clinician Adjudicated Dementia |
Metric | Sensitivity (%) |
Specificity (%) |
PPV (%) |
NPV (%) |
CV AUC (0-1) |
CV CITL (0-1) |
CV Slope (0-1) |
---|---|---|---|---|---|---|---|---|---|
Overall | Freq: 2,854 Prev: 7.4% |
Mean | 68.0 | 93.5 | 77.1 | 90.1 | 0.94 | 0.00 | 0.97 |
SD | 1.8 | 0.7 | 2.0 | 0.5 | - | - | - | ||
Min | 60.8 | 91.3 | 70.7 | 88.1 | - | - | - | ||
Max | 73.7 | 95.6 | 83.4 | 91.6 | - | - | - | ||
Age 65-74 | Freq: 412 Prev: 1.9% |
Mean | 56.6 | 98.0 | 75.2 | 95.6 | 0.90 | 0.00 | 0.81 |
SD | 3.8 | 0.5 | 5.2 | 0.4 | - | - | - | ||
Min | 45.0 | 96.1 | 58.8 | 94.4 | - | - | - | ||
Max | 67.5 | 99.2 | 89.3 | 96.6 | - | - | - | ||
Age 75-79 | Freq: 477 Prev: 6.1% |
Mean | 60.9 | 93.6 | 73.1 | 89.4 | 0.88 | −0.02 | 0.71 |
SD | 4.0 | 1.6 | 5.0 | 1.0 | - | - | - | ||
Min | 51.1 | 88.1 | 57.1 | 86.9 | - | - | - | ||
Max | 75.6 | 98.1 | 90.3 | 93.0 | - | - | - | ||
Age 80-84 | Freq: 599 Prev: 11.1% |
Mean | 72.6 | 92.3 | 84.3 | 85.6 | 0.92 | 0.02 | 0.78 |
SD | 3.2 | 2.0 | 3.6 | 1.5 | - | - | - | ||
Min | 64.4 | 85.6 | 73.2 | 81.7 | - | - | - | ||
Max | 81.4 | 97.1 | 93.9 | 89.8 | - | - | - | ||
Age 85+ | Freq: 1,366 Prev: 32.7% |
Mean | 74.6 | 72.4 | 75.8 | 71.1 | 0.88 | 0.00 | 0.84 |
SD | 3.5 | 4.4 | 3.1 | 3.2 | - | - | - | ||
Min | 62.5 | 59.2 | 67.8 | 62.3 | - | - | - | ||
Max | 86.4 | 86.8 | 87.3 | 82.6 | - | - | - |
Abbreviations
SD: Standard Deviation; PPV: Positive Predictive Value; NPV: Negative Predictive Value; 95%CI: 95% Confidence Interval; CV: 10-fold cross validation; CV AUC: 95% CI is Asymptotic Normal; Freq: Frequency; Prev: Prevalence; CV CITL: Calibration-in-the-large