Skip to main content
. 2023 May 18;30(8):1448–1455. doi: 10.1093/jamia/ocad071

Table 4.

Results of the SDOH classifier on the SHACM test set when trained on the SHACM, SHACM+SHACW, and SHACM+In-House datasets

Training set Precision Recall F1
Overall (Triggers+Args) SHACM 0.8213 0.8580 0.8392
SHACM+SHACW 0.8417 0.8718 0.8565
SHACM+In-House 0.8280 0.8698 0.8484
Alcohol (Trigger) SHACM 0.9830 0.9416 0.9619
SHACM+SHACW 0.9831 0.9448 0.9636
SHACM+In-House 0.9796 0.9351 0.9568
Drug (Trigger) SHACM 0.9722 0.9259 0.9485
SHACM+SHACW 0.9832 0.9312 0.9565
SHACM+In-House 0.9776 0.9259 0.9511
Tobacco (Trigger) SHACM 0.9804 0.9346 0.9569
SHACM+SHACW 0.9805 0.9408 0.9602
SHACM+In-House 0.9772 0.9346 0.9554
Employment (Trigger) SHACM 0.9273 0.9107 0.9189
SHACM+SHACW 0.9167 0.9167 0.9167
SHACM+In-House 0.9231 0.9286 0.9258
Living status (Trigger) SHACM 0.9620 0.9421 0.9520
SHACM+SHACW 0.9784 0.9380 0.9578
SHACM+In-House 0.9588 0.9628 0.9608

SDOH: social determinants of health; SHAC: Social History Annotation Corpus. The highest scores are bolded.