Skip to main content
[Preprint]. 2023 Jul 24:2023.07.16.23292743. [Version 2] doi: 10.1101/2023.07.16.23292743

Table 2:

Accuracy, Internal Concordance and Nonobvious Insights of ChatGPT Responses

Accuracy, N (%) Internal Concordance Insights
Open-Ended Format
 SCORE 80 (47.9%) 143 (85.6%) 111 (66.5%)
 Data-B 74 (66.1%) 112 (100%) 87 (77.7%)
 Combined 154 (55.2%) 255 (91.4%) 198 (71.0%)
Multiple Choice - Single Answer
 SCORE 119 (71.3%) 148 (88.6%) 106 (63.5%)
 Data-B 76 (67.9%) 109 (97.3%) 69 (61.6%)
 Combined 195 (69.9%) 257 (92.1%) 175 (62.7%)

SCORE: Surgical Council on Resident Education;

Data-B: refers to a second commonly used surgical knowledge assessment and question bank