Table 4.
Evaluation measures in disease pathological syndrome identification.
| Model | Evaluation Measures | Excess Cold syndrome | Excess Heat syndrome | Deficiency Cold syndrome | Deficiency Heat syndrome | Qi Deficiency syndrome | Blood Deficiency syndrome | Qi Stagnation syndrome | Blood Stasis syndrome | Phlegm Fluid Retention syndrome | Critical syndrome |
|---|---|---|---|---|---|---|---|---|---|---|---|
| BERT | Precision | 0.8542 | 0.8402 | 0.8566 | 0.8933 | 0.8870 | 0.9029 | 0.8347 | 0.8562 | 0.8781 | 0.8576 |
| Recall | 0.9108 | 0.9282 | 0.9102 | 0.9257 | 0.9138 | 0.9164 | 0.8843 | 0.8863 | 0.9283 | 0.9256 | |
| F1 | 0.8816 | 0.8820 | 0.8826 | 0.9092 | 0.9002 | 0.9095 | 0.8588 | 0.8709 | 0.9025 | 0.8903 | |
| TEXTCNN | Precision | 0.8724 | 0.8584 | 0.8446 | 0.8310 | 0.8014 | 0.8036 | 0.7915 | 0.8746 | 0.8626 | 0.8207 |
| Recall | 0.7963 | 0.8735 | 0.8126 | 0.8323 | 0.8782 | 0.8088 | 0.8280 | 0.8243 | 0.8746 | 0.7838 | |
| F1 | 0.8326 | 0.8658 | 0.8283 | 0.8316 | 0.8381 | 0.8062 | 0.8093 | 0.8487 | 0.8685 | 0.8018 | |
| LSTM RNN | Precision | 0.8386 | 0.8681 | 0.8022 | 0.8401 | 0.7996 | 0.8199 | 0.8837 | 0.8621 | 0.8217 | 0.8163 |
| Recall | 0.8086 | 0.8677 | 0.8132 | 0.8699 | 0.8459 | 0.7890 | 0.7895 | 0.8839 | 0.8398 | 0.8848 | |
| F1 | 0.8233 | 0.8679 | 0.8076 | 0.8547 | 0.8221 | 0.8042 | 0.8339 | 0.8729 | 0.8306 | 0.8491 | |
| LSTM ATTENTION | Precision | 0.8945 | 0.8537 | 0.8865 | 0.8595 | 0.8720 | 0.8470 | 0.8181 | 0.8881 | 0.8047 | 0.8268 |
| Recall | 0.8445 | 0.8700 | 0.8901 | 0.8012 | 0.8406 | 0.8356 | 0.8296 | 0.8311 | 0.8796 | 0.8885 | |
| F1 | 0.8688 | 0.8618 | 0.8883 | 0.8293 | 0.8560 | 0.8413 | 0.8238 | 0.8586 | 0.8405 | 0.8565 | |
| TCM-BERT-CNN | Precision | 0.9486 | 0.9173 | 0.9513 | 0.9212 | 0.9329 | 0.9097 | 0.9416 | 0.9312 | 0.8840 | 0.9402 |
| Recall | 0.9594 | 0.8735 | 0.8978 | 0.8874 | 0.9266 | 0.9062 | 0.9336 | 0.9028 | 0.9355 | 0.9008 | |
| F1 | 0.9540 | 0.8949 | 0.9238 | 0.9039 | 0.9297 | 0.9079 | 0.9376 | 0.9168 | 0.9090 | 0.9201 |