Table 3.
Accuracy, Recall, Precision and F-measure for various majority opinion levels measured by the 2008AA reference standard
| Performance Measure |
Unanimous | Strong majority |
Weak majority |
Unanimous + Strong Majority |
Unanimous + Strong Majority + Weak majority |
Average of all auditors on 178 concepts |
Average of all auditors on 232 concepts |
|---|---|---|---|---|---|---|---|
| Accuracy | 0.35 | 0.55 | 0.64 | 0.48 | 0.53 | 0.42 | 0.37 |
| Recall | 0.52 | 0.61 | 0.72 | 0.58 | 0.62 | 0.50 | 0.47 |
| Precision | 0.45 | 0.69 | 0.72 | 0.61 | 0.64 | 0.46 | 0.46 |
| F | 0.48 | 0.65 | 0.72 | 0.59 | 0.63 | 0.48 | 0.46 |