Table 4 –
Calibration performance for competing prediction models using data available from either claims or electronic health records (EHRs) vs. only data typically available from insurance claims.
ALL MENTAL HEALTH ENCOUNTERS | ||||||
---|---|---|---|---|---|---|
# of Self-harm events | Predicted Risk | Observed Risk | ||||
EHR and Claims | Claims only | EHR and Claims | Claims only | EHR and Claims | Claims only | |
<50% | 2287 | 2389 | 0.001 | 0.001 | 0.001 | 0.001 |
50%−75% | 4091 | 3956 | 0.004 | 0.004 | 0.003 | 0.003 |
75%−90% | 6610 | 6606 | 0.009 | 0.009 | 0.010 | 0.010 |
90%−95% | 4295 | 4306 | 0.018 | 0.018 | 0.019 | 0.018 |
95%−99% | 7449 | 7652 | 0.039 | 0.039 | 0.039 | 0.040 |
99%−99.5% | 1736 | 1766 | 0.084 | 0.083 | 0.076 | 0.075 |
>99.5% | 3442 | 3235 | 0.133 | 0.136 | 0.144 | 0.139 |
LIMITED TO HEALTH SYSTEMS AND YEARS WITH >50% RECORDING OF PHQ-9 RESULTS | ||||||
# of Self-harm events | Predicted Risk | Observed Risk | ||||
EHR and Claims | Claims only | EHR and Claims | Claims only | EHR and Claims | Claims only | |
<50% | 156 | 297 | 0.001 | 0.001 | 0.001 | 0.002 |
50%−75% | 364 | 486 | 0.005 | 0.004 | 0.004 | 0.005 |
75%−90% | 812 | 792 | 0.010 | 0.010 | 0.012 | 0.014 |
90%−95% | 667 | 542 | 0.020 | 0.020 | 0.028 | 0.028 |
95%−99% | 921 | 851 | 0.046 | 0.047 | 0.046 | 0.054 |
99%−99.5% | 272 | 195 | 0.109 | 0.109 | 0.120 | 0.108 |
>99.5% | 350 | 379 | 0.173 | 0.169 | 0.195 | 0.190 |