Table 2. Comparing Performance of Endoscopists With or Without AI Assistance.
Metrics | Expert endoscopists (n = 2) | Senior endoscopists (n = 4) | Novice endoscopists (n = 6) | |||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Without AI | With AIa | P value | Without AI | With AI | P value | Without AI | With AI | P value | ||||
Sensitivity (95% CI) | 0.88 (0.75-0.95) | 0.80 (0.58-0.92) | >.99 | 0.72 (0.61-0.82) | 0.78 (0.67-0.86) | .39 | 0.61 (0.51-0.70) | 0.91 (0.83-0.95) | <.001 | |||
Specificity (95% CI) | 0.88 (0.69-0.96) | 0.85 (0.58-0.96) | >.99 | 0.84 (0.71-0.92) | 0.84 (0.71-0.92) | >.99 | 0.81 (0.70-0.89) | 0.88 (0.77-0.94) | .34 | |||
PPV (95% CI) | 0.92 (0.80-0.97) | 0.89 (0.67-0.97) | .66 | 0.88 (0.77-0.94) | 0.88 (0.78-0.94) | .89 | 0.84 (0.74-0.91) | 0.92 (0.85-0.96) | .10 | |||
NPV (95% CI) | 0.80 (0.62-0.91) | 0.73 (0.48-0.89) | .58 | 0.66 (0.53-0.77) | 0.71 (0.58-0.82) | .57 | 0.56 (0.46-0.66) | 0.85 (0.74-0.92) | <.001 | |||
Accuracy (95% CI) | 0.88 (0.78-0.94) | 0.82 (0.66-0.91) | >.99 | 0.77 (0.68-0.84) | 0.80 (0.72-0.87) | .23 | 0.69 (0.61-0.76) | 0.90 (0.83-0.94) | <.001 |
Abbreviations: AI, artificial intelligence; NPV, negative predictive value; PPV, positive predictive value
With AI: expert (n = 1).