Table 2. Contingency table comparing assessment by the crowd to the gold-standard two trained experts.
Crowd | Experts | Value (95% CI) | |
---|---|---|---|
Retain | Exclude | ||
Retain | 20 | 1 | PPV =95% (80–99%) |
Exclude | 0 | 127 | NPV =100% (98–100%) |
Value (95% CI) | Sensitivity =100% (88–100%) | Specificity =99% (67–79%) | – |
Sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) are provided as a percentage with a 95% confidence interval.