Table 11.
Micro measures for black box evaluation of the full system on both internal and official test sets. The CRF part of risk factor identification uses the Simple+PP+OAI setting. MED = evaluation restricted to medications only. MEDLex = with new medical lexicon method. Bold font highlights the best results in two compared experiments
Experiment | Evaluation | Internal test | Official test | |||||||
---|---|---|---|---|---|---|---|---|---|---|
P | R | F | P | R | F | |||||
+MEDLex | Black box, MED | .864 | .774 | .817 | .860 | .814 | .836 | |||
Black box, MED | .849 | .972 | .907 | .836 | .965 | .896 | ||||
+MEDLex | Black box, all | .875 | .809 | .841 | .881 | .833 | .857 | |||
Black box, all | .865 | .907 | .886 | .864 | .909 | .886 |