Table 2.
Inter-Rater Reliability | Intra-Rater Reliability | |||||||
---|---|---|---|---|---|---|---|---|
Items | Rater-1 | Rater-2 | ICC(Lower–Upper) | Kappa | First Assessment | Second Assessment | ICC(Lower–Upper) | Kappa |
1 | 3.50 ± 0.60 | 3.53 ± 0.55 | 0.89(0.83–0.93) | 0.86(0.76–0.97) | 3.50 ± 0.60 | 3.48 ± 0.59 | 0.89(0.84–0.93) | 0.86(0.75–0.96) |
2 | 3.50 ± 0.55 | 3.48 ± 0.55 | 0.96(0.94–0.97) | 0.93(0.85–1.00) | 3.50 ± 0.55 | 3.46 ± 0.55 | 0.94(0.91–0.96) | 0.95(0.89–1.02) |
3 | 3.53 ± 0.55 | 3.50 ± 0.55 | 0.96(0.94–0.97) | 0.88(0.78–0.98) | 3.53 ± 0.55 | 3.46 ± 0.55 | 0.90(0.85–0.94) | 0.95(0.89–1.02) |
4 | 3.58 ± 0.50 | 3.55 ± 0.50 | 0.95(0.92–0.97) | 0.87(0.76–0.98) | 3.58 ± 0.50 | 3.60 ± 0.52 | 0.81(0.71–0.87) | 0.95(0.84–1.06) |
5 | 3.25 ± 0.83 | 3.28 ± 0.84 | 0.98(0.97–0.99) | 0.87(0.77–0.96) | 3.25 ± 0.83 | 3.16 ± 0.80 | 0.94(0.91–0.96) | 0.96(0.91–1.01) |
6 | 3.33 ± 0.85 | 3.28 ± 0.87 | 0.97(0.95–0.98) | 0.82(0.71–0.94) | 3.33 ± 0.85 | 3.43 ± 0.76 | 0.79(0.70–0.86) | 0.92(0.84–1.00) |
7 | 3.18 ± 0.84 | 3.15 ± 0.83 | 0.98(0.97–0.99) | 0.90(0.82–0.98) | 3.18 ± 0.84 | 3.16 ± 0.80 | 0.95(0.93–0.97) | 0.96(0.91–1.01) |
8 | 2.85 ± 0.73 | 2.88 ± 0.72 | 0.98(0.96–0.98) | 0.89(0.79–0.98) | 2.85 ± 0.73 | 2.86 ± 0.67 | 0.94(0.90–0.96) | 0.96(0.90–1.02) |
9 | 2.83 ± 0.90 | 2.88 ± 0.82 | 0.97(0.95–0.98) | 0.89(0.80–0.98) | 2.83 ± 0.90 | 2.86 ± 0.91 | 0.93(0.89–0.96) | 0.93(0.86–0.99) |
10 | 3.13 ± 0.85 | 3.13 ± 0.85 | 1.00(1.00–1.00) | 0.86(0.76–0.96) | 3.13 ± 0.85 | 3.09 ± 0.80 | 0.94(0.90–0.96) | 1.00(1.00–1.00) |
11 | 2.78 ± 0.89 | 2.80 ± 0.91 | 0.99(0.98–0.99) | 0.80(0.70–0.91) | 2.78 ± 0.89 | 3.00 ± 0.89 | 0.76(0.65–0.84) | 0.84(0.74–0.94) |
12 | 2.73 ± 0.84 | 2.78 ± 0.83 | 0.97(0.95–0.98) | 0.87(0.77–0.96) | 2.73 ± 0.84 | 2.81 ± 0.83 | 0.94(0.91–0.96) | 0.93(0.85–1.00) |
13 | 3.08 ± 0.82 | 3.13 ± 0.82 | 0.96(0.95–0.98) | 0.89(0.80–0.97) | 3.08 ± 0.82 | 3.18 ± 0.76 | 0.89(0.83–0.93) | 0.93(0.85–1.00) |
14 | 2.30 ± 0.68 | 2.25 ± 0.74 | 0.95(0.93–0.97) | 0.77(0.65–0.90) | 2.30 ± 0.68 | 2.41 ± 0.69 | 0.87(0.80–0.91) | 0.92(0.79–1.04) |
Total | 43.68 ± 5.60 | 43.58 ± 5.58 | 0.99(0.988–0.995) | 0.95(0.90–1.00) | 43.68 ± 5.60 | 43.96 ± 4.91 | 0.95(0.93–0.97) | 0.90(0.79–1.01) |
ICC: intra-class correlation coefficient.