Table 2.
Crowdsourced against expert annotations.
| Expert annotations | Crowdsourced annotations | |||
|---|---|---|---|---|
| No risk | Low risk | Moderate risk | Severe risk | |
| No risk | 29 | 1 | 1 | 5 |
| Low risk | 11 | 13 | 20 | 6 |
| Moderate risk | 6 | 11 | 47 | 51 |
| Severe risk | 1 | 1 | 8 | 34 |
Crowdsourced against expert annotations.
| Expert annotations | Crowdsourced annotations | |||
|---|---|---|---|---|
| No risk | Low risk | Moderate risk | Severe risk | |
| No risk | 29 | 1 | 1 | 5 |
| Low risk | 11 | 13 | 20 | 6 |
| Moderate risk | 6 | 11 | 47 | 51 |
| Severe risk | 1 | 1 | 8 | 34 |