TABLE 4.
Reading Times Analysis: Mean (SD) and Median [IQR] Read-Time in Seconds by Arm (With or Without ML Support), Reader Experience, and Read Round—All Cases, Colon Cases, and Lung Cases
| Experienced Readers | Inexperienced Readers | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Without ML | With ML | Without ML | With ML | |||||||||
| Read Round | n | Mean (SD) | Median [IQR] | n | Mean (SD) | Median [IQR] | n | Mean (SD) | Median [IQR] | n | Mean (SD) | Median [IQR] |
| All reads* | 188 | 595 (610) | 480 [300–720] | 188 | 560 (260) | 540 [360–720] | 53 | 691 (412) | 600 [420–900] | 53 | 645 (329) | 600 [360–840] |
| Round 1 | 92 | 715 (824) | 600 [360–780] | 96 | 663 (259) | 600 [450–810] | 26 | 842 (476) | 630 [540–1020] | 27 | 736 (382) | 660 [360–840] |
| Round 2 | 96 | 481 (236) | 420 [300–600] | 92 | 453 (216) | 390 [300–570] | 27 | 544 (275) | 540 [300–660] | 26 | 552 (235) | 480 [360–720] |
| Round 3 | 21 | 454 (206) | 420 [300–540] | 20 | 411 (156) | 390 [300–510] | 7 | 351 (112) | 360 [240–480] | 6 | 410 (158) | 360 [300–420] |
| Experienced Readers | Inexperienced Readers | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Colon | Without ML | With ML | Without ML | With ML | ||||||||
| Read Round | n | Mean (SD) | Median [IQR] | n | Mean (SD) | Median [IQR] | n | Mean (SD) | Median [IQR] | n | Mean (SD) | Median [IQR] |
| All reads* | 117 | 597 (357) | 540 [360–780] | 117 | 560 (257) | 540 [360–720] | 33 | 758 (481) | 600 [360–1020] | 33 | 705 (368) | 660 [360–840] |
| Round 1 | 58 | 703 (417) | 600 [360–840] | 59 | 655 (249) | 600 [420–840] | 13 | 1057 (559) | 960 [600–1320] | 20 | 756 (423) | 600 [420–840] |
| Round 2 | 59 | 492 (249) | 480 [300–600] | 58 | 463 (228) | 390 [300–660] | 20 | 564 (303) | 540 [300–780] | 13 | 626 (259) | 660 [420–720] |
| Round 3 | 12 | 455 (161) | 450 [330–570] | 10 | 432 (162) | 420 [300–600] | 5 | 396 (100) | 420 [360–480] | 3 | 460 (227) | 360 [300–720] |
| Experienced Readers | Inexperienced Readers | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Lung | Without ML | With ML | Without ML | With ML | ||||||||
| Read Round | n | Mean (SD) | Median [IQR] | n | Mean (SD) | Median (IQR) | n | Mean (SD) | Median [IQR] | n | Mean (SD) | Median [IQR] |
| All reads* | 71 | 593 (885) | 420 [300–720] | 71 | 559 (268) | 540 [360–720] | 20 | 579 (229) | 570 [450–630] | 20 | 546 (228) | 510 [360–660] |
| Round 1 | 34 | 736 (1253) | 540 [360–720] | 37 | 675 (276) | 660 [480–780] | 13 | 628 (243) | 600 [480–660] | 7 | 677 (249) | 600 [540–840] |
| Round 2 | 37 | 462 (213) | 420 [300–660] | 34 | 434 (195) | 390 [300–540] | 7 | 489 (181) | 540 [360–600] | 13 | 475 (189) | 420 [360–600] |
| Round 3 | 9 | 453 (265) | 420 [300–480] | 10 | 390 (156) | 330 [300–420] | 2 | 240 (0) | 240 [240–240] | 3 | 360 (60) | 360 [300–420] |
*Not including intrarater round 3 reads; ML, machine learning; SD, standard deviation; IQR, interquartile range.