Skip to main content
. 2023 Mar 29;36(4):1332–1347. doi: 10.1007/s10278-023-00801-4

Table 4.

Other performance evaluations among different models

CoAtNet-0-rw EfficientNet-b5 Baseline (ResNet50)
Labels LWBCE Lours LWBCE Lours LWBCE Lours
Accuracy Accuracy Accuracy Accuracy Accuracy Accuracy
  Atelectasis 0.689 0.772 0.731 0.714 0.650 0.740
  Cardiomegaly 0.812 0.840 0.745 0.839 0.875 0.855
  Consolidation 0.673 0.769 0.730 0.719 0.597 0.654
  Edema 0.797 0.824 0.820 0.822 0.761 0.738
  Effusion 0.746 0.753 0.768 0.810 0.724 0.787
  Emphysema 0.891 0.900 0.776 0.898 0.831 0.805
  Fibrosis 0.762 0.847 0.738 0.839 0.631 0.626
  Hernia 0.992 0.768 0.734 0.981 0.948 0.659
  Infiltration 0.683 0.742 0.709 0.692 0.626 0.628
  Mass 0.796 0.895 0.870 0.790 0.729 0.785
  Nodule 0.735 0.819 0.820 0.700 0.683 0.600
  Pleural_Thickening 0.708 0.829 0.747 0.785 0.622 0.685
  Pneumonia 0.705 0.768 0.809 0.788 0.491 0.610
  Pneumothorax 0.803 0.894 0.797 0.858 0.819 0.788
Overall# 0.248 0.257 0.175 0.218 0.103 0.138
Macro precision Macro precision Macro precision Macro precision Macro precision Macro precision
  Atelectasis 0.59 0.62 0.60 0.59 0.58 0.60
  Cardiomegaly 0.55 0.56 0.54 0.56 0.57 0.56
  Consolidation 0.54 0.55 0.55 0.54 0.54 0.54
  Edema 0.54 0.54 0.54 0.54 0.53 0.53
  Effusion 0.64 0.64 0.65 0.66 0.63 0.65
  Emphysema 0.57 0.57 0.54 0.57 0.54 0.54
  Fibrosis 0.52 0.52 0.51 0.52 0.51 0.51
  Hernia 0.55 0.50 0.50 0.52 0.51 0.50
  Infiltration 0.60 0.62 0.60 0.60 0.58 0.59
  Mass 0.57 0.63 0.60 0.57 0.56 0.57
  Nodule 0.55 0.57 0.57 0.54 0.54 0.53
  Pleural_Thickening 0.53 0.55 0.53 0.54 0.53 0.53
  Pneumonia 0.51 0.52 0.52 0.51 0.51 0.51
  Pneumothorax 0.58 0.63 0.58 0.60 0.58 0.57
Overall* 0.56 ± 0.01 (0.54, 0.58) 0.57 ± 0.01 (0.55, 0.60)a 0.56 ± 0.01 (0.53, 0.58) 0.56 ± 0.01 (0.54, 0.58) 0.55 ± 0.01 (0.53, 0.57) 0.55 ± 0.01 (0.53, 0.58)
Macro recall Macro recall Macro recall Macro recall Macro recall Macro recall
  Atelectasis 0.72 0.76 0.74 0.72 0.71 0.72
  Cardiomegaly 0.82 0.83 0.81 0.82 0.83 0.80
  Consolidation 0.73 0.74 0.74 0.73 0.72 0.73
  Edema 0.83 0.84 0.84 0.83 0.82 0.82
  Effusion 0.80 0.81 0.80 0.80 0.79 0.80
  Emphysema 0.85 0.87 0.82 0.82 0.78 0.79
  Fibrosis 0.74 0.74 0.72 0.71 0.72 0.72
  Hernia 0.72 0.73 0.78 0.78 0.75 0.72
  Infiltration 0.65 0.65 0.65 0.65 0.63 0.65
  Mass 0.76 0.75 0.74 0.75 0.75 0.75
  Nodule 0.69 0.70 0.68 0.68 0.66 0.65
  Pleural_Thickening 0.73 0.73 0.73 0.73 0.71 0.72
  Pneumonia 0.68 0.72 0.69 0.67 0.65 0.67
  Pneumothorax 0.80 0.81 0.80 0.80 0.78 0.78
Overall* 0.75 ± 0.02 (0.72, 0.79) 0.76 ± 0.02 (0.73, 0.80)b 0.75 ± 0.02 (0.72, 0.79) 0.75 ± 0.02 (0.71, 0.78) 0.74 ± 0.02 (0.70, 0.77) 0.74 ± 0.01 (0.70, 0.77)
Macro F1-score Macro F1-score Macro F1-score Macro F1-score Macro F1-score Macro F1-score
  Atelectasis 0.57 0.63 0.60 0.58 0.54 0.60
  Cardiomegaly 0.54 0.56 0.50 0.56 0.59 0.57
  Consolidation 0.48 0.53 0.51 0.51 0.44 0.47
  Edema 0.51 0.53 0.53 0.53 0.49 0.48
  Effusion 0.64 0.65 0.66 0.69 0.62 0.67
  Emphysema 0.59 0.60 0.51 0.59 0.53 0.52
  Fibrosis 0.47 0.51 0.46 0.50 0.41 0.41
  Hernia 0.58 0.44 0.43 0.54 0.50 0.40
  Infiltration 0.59 0.62 0.61 0.60 0.56 0.56
  Mass 0.58 0.66 0.63 0.57 0.53 0.57
  Nodule 0.53 0.58 0.57 0.51 0.50 0.45
  Pleural_Thickening 0.48 0.54 0.50 0.52 0.44 0.47
  Pneumonia 0.44 0.47 0.48 0.47 0.35 0.40
  Pneumothorax 0.58 0.67 0.58 0.63 0.59 0.57
Overall* 0.54 ± 0.02 (0.51, 0.57)c 0.57 ± 0.02 (0.53, 0.61)d 0.54 ± 0.02 (0.50, 0.58) 0.56 ± 0.02 (0.52, 0.59)e 0.51 ± 0.02 (0.46, 0.55) 0.51 ± 0.02 (0.46, 0.56)

aThere are significant differences when compared with ResNet50 + LWBCE (p = 0.043) and ResNet50 + Lours (p = 0.045).

bThere are differences when compared with ResNet50 + LWBCE (p = 0.051) and ResNet50 + Lours (p = 0.015)

cThere is a significant difference when compared with ResNet50 + LWBCE (p = 0.041)

dThere are significant differences when compared with ResNet50 + LWBCE (p = 0.010) and ResNet50 + Lours (p = 0.002)

eThere are significant differences when compared with ResNet50 + LWBCE (p = 0.002) and ResNet50 + Lours (p = 0.015). All statistical analyses were performed using repeated measures ANOVA tests with Bonferroni adjustments

#It indicates the correct prediction of all 14 labels

*Data were presented as mean ± standard error (95% confidence interval)