Skip to main content
. 2024 Jan 13;281(4):2145–2151. doi: 10.1007/s00405-023-08423-w

Table 3.

Agreement among the usefulness responses of reviewers for ChatGPT and UpToDate

Coefficient Value 95% CI Interpretation
ChatGPT
Gwet's AC1 0.86 (0.78–0.93) Substantial
Percent agreement 0.92 (0.89–0.97) Almost perfect
Kappa 0.65 (0.41–0.90) Moderate
UpToDate
Gwet's AC1 0.55 (0.32–0.78) Fair
Percent agreement 0.73 (0.61–0.84) Substantial
Kappa 0.30 (0.02–0.60) Slight

AC agreement coefficient