Table 4. Macro-Averaged F1 on I2B2 2008 Test Set.
Disease | Word | Imputed | Cui | Lin | superlin | Ambert |
---|---|---|---|---|---|---|
Asthma | 0.970 | 0.970 | 0.970 | 0.970 | 0.970 | 0.970 |
CAD | 0.631 | 0.624 | 0.621 | 0.618 | 0.618 | 0.630 |
CHF | 0.615 | 0.601 | 0.607 | 0.601 | 0.612 | 0.612 |
Depression | 0.963 | 0.976 | 0.979 | 0.982 | 0.979 | 0.935 |
Diabetes | 0.945 | 0.959 | 0.957 | 0.958 | 0.960 | 0.915 |
Gallstones | 0.954 | 0.950 | 0.950 | 0.942 | 0.950 | 0.961 |
GERD | 0.578 | 0.579 | 0.579 | 0.579 | 0.579 | 0.579 |
Gout | 0.982 | 0.982 | 0.982 | 0.982 | 0.982 | 0.981 |
Hypercholesterolemia | 0.901 | 0.903 | 0.901 | 0.896 | 0.908 | 0.912 |
Hypertension | 0.926 | 0.920 | 0.926 | 0.929 | 0.929 | 0.899 |
Hypertriglyceridemia | 0.902 | 0.939 | 0.913 | 0.913 | 0.928 | 0.876 |
Osteoarthritis | 0.613 | 0.608 | 0.617 | 0.604 | 0.604 | 0.631 |
Obesity | 0.972 | 0.972 | 0.972 | 0.972 | 0.972 | 0.973 |
OSA | 0.659 | 0.659 | 0.659 | 0.653 | 0.656 | 0.653 |
PVD | 0.586 | 0.603 | 0.606 | 0.587 | 0.606 | 0.623 |
Venous Insufficiency | 0.757 | 0.788 | 0.816 | 0.801 | 0.816 | 0.725 |
Macro-F1 | 0.6339 | 0.6345 | 0.6354 | 0.6330 | 0.6355 | 0.6344 |
Micro-F1 | 0.9573 | 0.9581 | 0.9593 | 0.9561 | 0.9594 | 0.9558 |
Best scores from our study indicated in bold.
Abbreviations: CAD-Coronary Artery Disease, CHF-Congestive Heart Failure, GERD-Gastroesophogeal Reflux Disease, OSA-Obstructive Sleep Apnea, PVD-Peripheral Vascular Disease.