Table 4.
Training set | Precision | Recall | F1 | |
---|---|---|---|---|
Overall (Triggers+Args) | SHACM | 0.8213 | 0.8580 | 0.8392 |
SHACM+SHACW | 0.8417 | 0.8718 | 0.8565 | |
SHACM+In-House | 0.8280 | 0.8698 | 0.8484 | |
Alcohol (Trigger) | SHACM | 0.9830 | 0.9416 | 0.9619 |
SHACM+SHACW | 0.9831 | 0.9448 | 0.9636 | |
SHACM+In-House | 0.9796 | 0.9351 | 0.9568 | |
Drug (Trigger) | SHACM | 0.9722 | 0.9259 | 0.9485 |
SHACM+SHACW | 0.9832 | 0.9312 | 0.9565 | |
SHACM+In-House | 0.9776 | 0.9259 | 0.9511 | |
Tobacco (Trigger) | SHACM | 0.9804 | 0.9346 | 0.9569 |
SHACM+SHACW | 0.9805 | 0.9408 | 0.9602 | |
SHACM+In-House | 0.9772 | 0.9346 | 0.9554 | |
Employment (Trigger) | SHACM | 0.9273 | 0.9107 | 0.9189 |
SHACM+SHACW | 0.9167 | 0.9167 | 0.9167 | |
SHACM+In-House | 0.9231 | 0.9286 | 0.9258 | |
Living status (Trigger) | SHACM | 0.9620 | 0.9421 | 0.9520 |
SHACM+SHACW | 0.9784 | 0.9380 | 0.9578 | |
SHACM+In-House | 0.9588 | 0.9628 | 0.9608 |
SDOH: social determinants of health; SHAC: Social History Annotation Corpus. The highest scores are bolded.