Skip to main content
. Author manuscript; available in PMC: 2022 Aug 1.
Published in final edited form as: J Am Geriatr Soc. 2021 Apr 26;69(8):2240–2251. doi: 10.1111/jgs.17183

Table 2: Performance Characteristics: Logistic Model of Diagnostic Claim Count, Refined Claims-Based Definition (Model 7), Overall and by Age Group.

The table is based primarily on the reconstructed sample, but Cross-Validation (CV) metrics are shown for the original (analytic) sample. Cross-validation was repeated with reconstructed sample for sensitivity analysis, which yielded similar results.

Mean: Mean value for performance characteristic from 1000 Monte Carlo resampling

Min: Minimum value for performance characteristic from 1000 Monte Carlo resampling

Max: Maximum value for performance characteristic from 1000 Monte Carlo resampling

Model Clinician
Adjudicated
Dementia
Metric Sensitivity
(%)
Specificity
(%)
PPV
(%)
NPV
(%)
CV
AUC
(0-1)
CV
CITL
(0-1)
CV
Slope
(0-1)
Overall Freq: 2,854
Prev: 7.4%
Mean 68.0 93.5 77.1 90.1 0.94 0.00 0.97
SD 1.8 0.7 2.0 0.5 - - -
Min 60.8 91.3 70.7 88.1 - - -
Max 73.7 95.6 83.4 91.6 - - -
Age 65-74 Freq: 412
Prev: 1.9%
Mean 56.6 98.0 75.2 95.6 0.90 0.00 0.81
SD 3.8 0.5 5.2 0.4 - - -
Min 45.0 96.1 58.8 94.4 - - -
Max 67.5 99.2 89.3 96.6 - - -
Age 75-79 Freq: 477
Prev: 6.1%
Mean 60.9 93.6 73.1 89.4 0.88 −0.02 0.71
SD 4.0 1.6 5.0 1.0 - - -
Min 51.1 88.1 57.1 86.9 - - -
Max 75.6 98.1 90.3 93.0 - - -
Age 80-84 Freq: 599
Prev: 11.1%
Mean 72.6 92.3 84.3 85.6 0.92 0.02 0.78
SD 3.2 2.0 3.6 1.5 - - -
Min 64.4 85.6 73.2 81.7 - - -
Max 81.4 97.1 93.9 89.8 - - -
Age 85+ Freq: 1,366
Prev: 32.7%
Mean 74.6 72.4 75.8 71.1 0.88 0.00 0.84
SD 3.5 4.4 3.1 3.2 - - -
Min 62.5 59.2 67.8 62.3 - - -
Max 86.4 86.8 87.3 82.6 - - -

Abbreviations

SD: Standard Deviation; PPV: Positive Predictive Value; NPV: Negative Predictive Value; 95%CI: 95% Confidence Interval; CV: 10-fold cross validation; CV AUC: 95% CI is Asymptotic Normal; Freq: Frequency; Prev: Prevalence; CV CITL: Calibration-in-the-large