Skip to main content
. Author manuscript; available in PMC: 2023 Jun 26.
Published in final edited form as: J Biomed Inform. 2023 Feb 6;139:104302. doi: 10.1016/j.jbi.2023.104302

Table 8.

Event and attribute classification performance with predicted medication mentions on medications that co-occur. We used the Clinical BERT model to extract the medications.

Model Metric MedSingleTask
MedMultiTask
MedSpan
MedIdentifiers
MedIDTyped
Macro Micro Macro Micro Macro Micro Macro Micro Macro Micro
event P 0.729 0.862 0.754 0.876 0.820 0.899 0.836 0.911 0.768 0.886
R 0.643 0.862 0.704 0.876 0.795 0.899 0.813 0.911 0.810 0.886
F1 0.679 0.862 0.727 0.876 0.807 0.899 0.824 0.911 0.780 0.886

action P 0.577 0.676 0.684 0.680 0.830 0.787 0.774 0.780 0.879 0.800
R 0.326 0.391 0.437 0.531 0.608 0.714 0.590 0.703 0.623 0.729
F1 0.401 0.495 0.506 0.596 0.667 0.749 0.655 0.740 0.704 0.763

actor P 0.873 0.747 0.515 0.810 0.587 0.832 0.602 0.861 0.430 0.851
R 0.371 0.615 0.374 0.620 0.457 0.776 0.457 0.776 0.407 0.771
F1 0.436 0.674 0.431 0.702 0.490 0.803 0.497 0.816 0.418 0.809

temporality P 0.748 0.709 0.839 0.824 0.819 0.810 0.794 0.832 0.836 0.822
R 0.531 0.557 0.562 0.609 0.671 0.708 0.702 0.750 0.673 0.745
F1 0.617 0.624 0.667 0.701 0.735 0.756 0.745 0.789 0.736 0.781

certainty P 0.624 0.704 0.704 0.812 0.787 0.841 0.796 0.861 0.764 0.851
R 0.611 0.656 0.537 0.583 0.701 0.745 0.798 0.776 0.728 0.771
F1 0.605 0.679 0.597 0.679 0.710 0.790 0.792 0.816 0.737 0.809

Overall Avg P 0.710 0.739 0.699 0.800 0.769 0.834 0.761 0.849 0.735 0.842
R 0.497 0.616 0.523 0.644 0.646 0.768 0.672 0.783 0.648 0.780
F1 0.548 0.667 0.586 0.711 0.682 0.799 0.703 0.815 0.675 0.810