Table 6.
The overall performance of the system at the risk indicator level on the i2b2 test data
Risk Factor | Indicator | #Expected | #Predicted | #Correct | Precision | Recall | F-measure |
---|---|---|---|---|---|---|---|
| |||||||
CAD | mention | 516 | 621 | 501 | 0.806 | 0.971 | 0.881 |
event | 139 | 90 | 76 | 0.844 | 0.546 | 0.664 | |
test | 59 | 85 | 43 | 0.505 | 0.728 | 0.597 | |
symptom | 70 | 21 | 10 | 0.476 | 0.143 | 0.219 | |
| |||||||
DIABETES | mention | 1,065 | 1,068 | 1,018 | 0.953 | 0.956 | 0.954 |
AlC | 82 | 87 | 68 | 0.781 | 0.829 | 0.804 | |
glucose | 33 | 36 | 8 | 0.222 | 0.242 | 0.231 | |
| |||||||
OBESE | mention | 245 | 285 | 239 | 0.838 | 0.975 | 0.902 |
BMI | 17 | 11 | 11 | 1.000 | 0.647 | 0.785 | |
| |||||||
HYPERLIMIDEMIA | mention | 711 | 717 | 687 | 0.958 | 0.966 | 0.962 |
high LDL | 29 | 39 | 20 | 0.512 | 0.689 | 0.588 | |
high chol. | 11 | 13 | 5 | 0.384 | 0.454 | 0.416 | |
| |||||||
HYPERTENSION | mention | 1,098 | 1,143 | 1,089 | 0.953 | 0.992 | 0.972 |
high bp | 195 | 204 | 159 | 0.779 | 0.815 | 0.797 | |
| |||||||
MEDICATION | ACE inhibitor | 612 | 674 | 583 | 0.865 | 0.952 | 0.906 |
ARB | 193 | 211 | 193 | 0.914 | 1.000 | 0.955 | |
aspirin | 798 | 871 | 789 | 0.906 | 0.988 | 0.945 | |
beta blocker | 835 | 905 | 817 | 0.903 | 0.978 | 0.939 | |
calcium channel | 385 | 414 | 368 | 0.889 | 0.955 | 0.921 | |
blocker | 222 | 310 | 218 | 0.703 | 0.982 | 0.819 | |
diuretic | 6 | 6 | 6 | 1.000 | 1.000 | 1.000 | |
DPP4 inhibitors | 36 | 59 | 35 | 0.593 | 0.972 | 0.736 | |
ezetimibe | 90 | 104 | 88 | 0.846 | 0.977 | 0.907 | |
fibrate | 395 | 383 | 351 | 0.916 | 0.888 | 0.903 | |
insulin | 356 | 418 | 356 | 0.852 | 1.000 | 0.920 | |
metformin | 25 | 41 | 22 | 0.536 | 0.880 | 0.666 | |
niacin | 271 | 369 | 268 | 0.726 | 0.989 | 0.837 | |
nitrate | 817 | 865 | 802 | 0.927 | 0.981 | 0.953 | |
statin | 288 | 309 | 282 | 0.912 | 0.979 | 0.944 | |
sulfonylureas | 61 | 69 | 58 | 0.841 | 0.951 | 0.892 | |
thiazolidinedione thienopyridine | 284 | 308 | 276 | 0.896 | 0.972 | 0.932 | |
| |||||||
SMOKER | current | 33 | 51 | 30 | 0.588 | 0.909 | 0.714 |
ever | 3 | 1 | 0 | 0.000 | 0.000 | 0.000 | |
never | 120 | 116 | 109 | 0.939 | 0.908 | 0.923 | |
past | 113 | 108 | 98 | 0.907 | 0.867 | 0.887 | |
unknown | 243 | 238 | 233 | 0.979 | 0.958 | 0.969 | |
| |||||||
FAMILY_HIST | not present | 495 | 489 | 481 | 0.983 | 0.956 | 0.954 |
present | 19 | 25 | 11 | 0.440 | 0.579 | 0.500 |