Table 4.
Summary of imaging pitfalls by artificial intelligence (AI) tool compared with human performance
| AI interpretation | No | Body part | Diagnosis | No (%) radiologists correct |
|---|---|---|---|---|
| Non-interpretable images (n=42) | ||||
| False positive (uncertain) | 1 | Abdomen | Basal pneumothorax | 21 (81) |
| Images most radiologists (>50%) diagnosed incorrectly (n=20) | ||||
| False positive (uncertain) | 1 | Hand | Index finger bone lesion | 8 (31) |
| False negative | 9 | Knee | Lateral tibial spine fracture | 11 (42) |
| Pelvis | Left iliac wing fracture | 10 (38) | ||
| Chest | Pulmonary nodule | 8 (31) | ||
| Elbow | Coracoid fracture | 8 (31) | ||
| Foot | Second metatarsal fracture | 8 (31) | ||
| Scaphoid | Fourth metacarpal fracture | 5 (19) | ||
| Clavicle | Medial clavicular fracture | 3 (12) | ||
| Ankle | Distal fibular fracture | 3 (12) | ||
| Foot | Talar osteochondral defect | 0 | ||
| True positive (certain) | 5 | Foot | Fracture proximal phalanx of big toe | 12 (46) |
| Chest | Apical pneumothorax | 11 (42) | ||
| Chest | Multiple rib fractures | 9 (35) | ||
| Foot | Fracture distal phalanx of big toe | 7 (27) | ||
| Scaphoid | Scaphoid fracture | 0 | ||
| True positive (uncertain) | 3 | Foot | Navicular fracture | 11 (42) |
| Shoulder | Anterior shoulder dislocation | 10 (38) | ||
| Hand | Hamate fracture | 7 (27) | ||
| True negative | 2 | Pelvis | None | 12 (46) |
| Foot | None | 5 (19) | ||
| Images almost all radiologists (>90%) diagnosed correctly (n=148) | ||||
| False positive (certain) | 4 | Foot | Fifth metatarsal fracture | 25 (96) |
| Knee | Fractured patella | 24 (92) | ||
| Chest | Right lower lobe consolidation | 24 (92) | ||
| Shoulder | Glenohumeral dislocation | 24 (92) | ||
| False positive (uncertain) | 6 | Chest | Parenchymal opacity | 26 (100) |
| Chest | Right lower lobe consolidation | 26 (100) | ||
| Humerus | Proximal humeral fracture | 26 (100) | ||
| Chest | Right lower lobe consolidation | 25 (96) | ||
| Foot | Cuboidal fracture | 25 (96) | ||
| Hand | Proximal phalangeal fracture of thumb | 25 (96) | ||
| False negative | 4 | Foot | Second metatarsal fracture | 26 (100) |
| Foot | Second metatarsal fracture | 26 (100) | ||
| Hip | Paget’s disease | 25 (96) | ||
| Pelvis | Avulsion fracture | 25 (96) | ||
| True positive (certain) | 58 | For brevity, detailed review of these 134 correctly diagnosed radiographs by AI candidate is not provided | ||
| True positive (uncertain) | 9 | |||
| True negatives | 67 | |||