Table 3.
Inter-rater agreement for three observers
| Rater 1 & 2 | Rater 2 & 3 | Rater 1 & 3 | |
|---|---|---|---|
|
Unweighted K
|
|
|
|
| Observed |
0.85 |
0.53 |
0.53 |
| Maximum Possible |
0.95 |
0.69 |
0.69 |
| Standard Error |
0.057 |
0.08 |
0.08 |
| 95% CI |
0.74-0.96 |
0.37-0.68 |
0.38-0.68 |
|
Linear Weighted K
|
|
|
|
| Observed |
0.83 |
0.68 |
0.64 |
| Standard Error |
0.07 |
0.06 |
0.07 |
| Maximum Possible |
0.90 |
0.74 |
0.72 |
| 95% CI |
0.69-0.98 |
0.56-0.79 |
0.49-0.78 |
|
Proportions of Agreement
|
|
|
|
| Observed |
0.90 |
0.66 |
0.66 |
| Maximum Possible |
0.97 |
0.77 |
0.77 |
| Chance expected |
0.35 |
0.27 |
0.27 |
| 95% CI | 0.79-0.96 | 0.52-0.77 | 0.52-0.77 |