. 2021 Nov 8;21:311. doi: 10.1186/s12911-021-01679-4

Table 2.

Changes in the CR interpretation performance by DLCR use

	Without DLCR	With DLCR	P value	Without DLCR	With DLCR	P value
	Sensitivity (95% CI)	Specificity (95% CI)
Physician 1	61.00 (55.06, 66.94)	66.80 (61.06, 72.53)	0.001	96.90 (93.91, 99.89)	94.57 (90.66, 98.48)	0.177
Physician 2	65.64 (59.85, 71.42)	72.97 (67.56, 78.38)	< 0.001	87.60 (81.91,93.29)	87.60 (81.91, 93.29)	> 0.999
Physician 3	56.76 (50.72, 62.79)	64.86 (59.05, 70.68)	< 0.001	91.47 (86.65, 96.29)	96.12 (92.79, 99.46)	0.012
Physician 4	67.18 (61.46, 72.90)	76.06 (70.87, 81.26)	< 0.001	82.95 (76.46, 89.44)	86.05 (80.07, 92.03)	0.344
Physician 5	71.43 (65.93, 76.93)	75.68 (70.45, 80.90)	0.004	81.40 (74.68, 88.11)	86.05 (80.07, 92.03)	0.054
Physician 6	62.93 (57.05, 68.82)	69.88 (64.30, 75.47)	0.005	86.05 (80.07, 92.03)	93.02 (88.63, 97.42)	0.026
Physician 7	49.03 (42.95, 55.12)	55.98 (49.94, 62.03)	0.002	91.47 (86.65, 96.29)	96.12 (92.79, 99.46)	0.031
Overall physicians	62.00 (55.64, 68.35)	68.89 (64.68, 73.10)	< 0.001	88.26 (82.90, 93.62)	91.36 (88.49, 94.23)	0.015
	Accuracy (95% CI)	AUROC (95% CI)
Physician 1	72.94 (68.52, 77.36)	76.03 (71.68, 80.28)	0.022	0.790 (0.756, 0.823)	0.807 (0.772, 0.842)	0.167
Physician 2	72.94 (68.52, 77.36)	77.84 (73.70, 81.97)	0.003	0.766 (0.726, 0.807)	0.803 (0.764, 0.842)	0.032
Physician 3	68.30 (63.67, 72.93)	75.26 (70.96, 79.55)	< 0.001	0.741 (0.702, 0.780)	0.805 (0.771, 0.839)	< 0.001
Physician 4	72.42 (67.98, 76.87)	79.38 (75.36, 83.41)	< 0.001	0.751 (0.707, 0.794)	0.811 (0.771, 0.850)	0.004
Physician 5	74.74 (70.42, 79.07)	79.12 (75.08, 83.17)	< 0.001	0.764 (0.721, 0.808)	0.809 (0.769, 0.848)	0.002
Physician 6	70.62 (66.09, 75.15)	77.58 (73.43, 81.73)	< 0.001	0.745 (0.703, 0.787)	0.815 (0.779, 0.850)	< 0.001
Physician 7	63.14 (58.34, 67.94)	69.33 (64.74, 73.92)	< 0.001	0.703 (0.664, 0.742)	0.761 (0.726, 0.795)	< 0.001
Overall physicians	70.73 (65.91, 75.54)	76.36 (73.21, 79.51)	< 0.001	0.751 (0.719, 0.783)	0.801 (0.774, 0.828)	< 0.001

Without
DLCR

With
DLCR

P value

Without
DLCR

With
DLCR

P value

Sensitivity (95% CI)

Specificity (95% CI)

Physician 1

61.00

(55.06, 66.94)

66.80

(61.06, 72.53)

0.001

96.90

(93.91, 99.89)

94.57

(90.66, 98.48)

0.177

Physician 2

65.64

(59.85, 71.42)

72.97

(67.56, 78.38)

< 0.001

87.60

(81.91,93.29)

87.60

(81.91, 93.29)

> 0.999

Physician 3

56.76

(50.72, 62.79)

64.86

(59.05, 70.68)

< 0.001

91.47

(86.65, 96.29)

96.12

(92.79, 99.46)

0.012

Physician 4

67.18

(61.46, 72.90)

76.06

(70.87, 81.26)

< 0.001

82.95

(76.46, 89.44)

86.05

(80.07, 92.03)

0.344

Physician 5

71.43

(65.93, 76.93)

75.68

(70.45, 80.90)

0.004

81.40

(74.68, 88.11)

86.05

(80.07, 92.03)

0.054

Physician 6

62.93

(57.05, 68.82)

69.88

(64.30, 75.47)

0.005

86.05

(80.07, 92.03)

93.02

(88.63, 97.42)

0.026

Physician 7

49.03

(42.95, 55.12)

55.98

(49.94, 62.03)

0.002

91.47

(86.65, 96.29)

96.12

(92.79, 99.46)

0.031

Overall physicians

62.00

(55.64, 68.35)

68.89

(64.68, 73.10)

< 0.001

88.26

(82.90, 93.62)

91.36

(88.49, 94.23)

0.015

Accuracy (95% CI)

AUROC (95% CI)

Physician 1

72.94

(68.52, 77.36)

76.03

(71.68, 80.28)

0.022

0.790

(0.756, 0.823)

0.807

(0.772, 0.842)

0.167

Physician 2

72.94

(68.52, 77.36)

77.84

(73.70, 81.97)

0.003

0.766

(0.726, 0.807)

0.803

(0.764, 0.842)

0.032

Physician 3

68.30

(63.67, 72.93)

75.26

(70.96, 79.55)

< 0.001

0.741

(0.702, 0.780)

0.805

(0.771, 0.839)

< 0.001

Physician 4

72.42

(67.98, 76.87)

79.38

(75.36, 83.41)

< 0.001

0.751

(0.707, 0.794)

0.811

(0.771, 0.850)

0.004

Physician 5

74.74

(70.42, 79.07)

79.12

(75.08, 83.17)

< 0.001

0.764

(0.721, 0.808)

0.809

(0.769, 0.848)

0.002

Physician 6

70.62

(66.09, 75.15)

77.58

(73.43, 81.73)

< 0.001

0.745

(0.703, 0.787)

0.815

(0.779, 0.850)

< 0.001

Physician 7

63.14

(58.34, 67.94)

69.33

(64.74, 73.92)

< 0.001

0.703

(0.664, 0.742)

0.761

(0.726, 0.795)

< 0.001

Overall physicians

70.73

(65.91, 75.54)

76.36

(73.21, 79.51)

< 0.001

0.751

(0.719, 0.783)

0.801

(0.774, 0.828)

< 0.001

CR, chest radiograph; DLCR, deep learning-based assistive technology for chest radiograph; CI, confidence interval; AUROC, area under the receiver operating characteristic curve