Table 2.
Comparison of system results for the temporal relation track of the 2012 i2b2 challenge and Clinical TempEval
| F1 Score | Precision | Recall | Method Summary | Challenges | ||
|---|---|---|---|---|---|---|
| Overall evaluation for all components | ||||||
| cTAKES-Temporal System | 0.695 | 0.697 | 0.693 | SVM + rules for coreferent pairs | 2012 i2b2 | |
| Vanderbilt University | 0.693 | 0.714 | 0.673 | Heuristic candidate generation + CRF + SVM | ||
| National Research Council Canada | 0.692 | 0.750 | 0.643 | MaxEnt + SVM + rule based | ||
| DocTimeRel F1 score | Overall scores for both event-time and event-event | |||||
| THYME System | 0.807 | 0.321 | 0.526 | 0.231 | SVM | 2015 Clinical TempEval (CONTAINS only) |
| Best participating System | 0.791 | 0.181 | 0.140 | 0.254 | Will be described in an upcoming publication by the BluTeam | |
| Baseline | NA | 0.260 | 0.554 | 0.170 | TIMEX to closest Event | |
Abbreviations: cTAKES, clinical text analysis and knowledge extraction system; SVM, support vector machine; CRF, Conditional Random Fields; MaxEnt, Maximum Entropy classifier; DocTimeRel, document time relation; THYME, temporal histories of your medical events; NA, not available. The best scores are marked bold.