Table 6.
Results, kappa agreement among the evaluators for each of the 12 examples in the pilot study
Example | No of outcomes | P | Kappa | (SE) |
1 | 3 | 0.436 | 0.149 | 0.031 |
2 | 3 | 0.769 | 0.075 | 0.053 |
3 | 6 | 0.643 | 0.441 | 0.024 |
4 | 3 | 0.926 | 0.823 | 0.050 |
5 | 2 | 0.608 | -0.044 | 0.065 |
6 | 3 | 0.618 | 0.163 | 0.050 |
7 | 3 | 0.520 | -0.028 | 0.044 |
8 | 3 | 0.451 | 0.146 | 0.036 |
9 | 4 | 0.441 | -0.022 | 0.037 |
10 | 5 | 0.579 | 0.005 | 0.034 |
11 | 4 | 0.377 | 0.112 | 0.027 |
12 | 7 | 0.718 | -0.083 | 0.043 |