Table 3.
Inter- and intra-rater reliability
SHAP-C tasks |
Assessor 1 |
Assessor 1 |
Assessor 2 |
Assessor 3 |
Intra-rater reliability: Assessor 1 |
Inter-rater reliability |
||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Session 1 |
Session 2 |
Session 3 |
Session 3 |
(Session 1 and session 2) |
Assessor 1 (Session 2), Assessor 2 and Assessor 3 |
|||||||
Mean [SD] (seconds) | Mean [SD] (seconds) | Mean [SD] (seconds) | Mean [SD] (seconds) | Mean difference [SD] (seconds) a | P a | RC (seconds) | RRC (%) | F-ratio b | P b | RC b (seconds) | RRC (%) | |
AO tasks |
|
|
|
|
|
|
|
|
|
|
|
|
Light sphere |
0.77 [0.19] |
0.70 [0.17] |
0.90 [0.53] |
0.65 [0.25] |
0.07 [0.28] |
0.221 |
0.55 |
74.4 |
F(1.3, 29.2) = 3.60 |
0.059 |
0.98 |
130.6 |
Light tripod |
0.84 [0.20] |
0.83 [0.21] |
0.75 [0.24] |
0.71 [0.35] |
0.01 [0.26] |
0.927 |
0.51 |
60.6 |
F(2, 46) = 1.39 |
0.259 |
0.70 |
91.6 |
Light power |
0.88 [0.33] |
0.78 [0.27] |
0.83 [0.52] |
0.60 [0.26] |
0.10 [0.34] |
0.144 |
0.68 |
82.3 |
F(2, 46) = 2.93 |
0.063 |
0.98 |
133.8 |
Light lateral |
0.98 [0.25] |
0.87 [0.20] |
0.84 [0.30] |
0.93 [0.34] |
0.11 [0.25] |
0.044* |
0.53 |
58.0 |
F(2, 46) = 0.68 |
0.513 |
0.77 |
88.1 |
Light tip |
0.80 [0.22] |
0.78 [0.27] |
0.78 [0.30] |
0.75 [0.30] |
0.02 [0.36] |
0.790 |
0.68 |
86.6 |
F(2, 46) = 0.10 |
0.904 |
0.80 |
103.3 |
Light extension |
0.96 [0.40] |
0.89 [0.23] |
0.66 [0.24] |
0.98 [0.46] |
0.07 [0.37] |
0.365 |
0.72 |
77.5 |
F(2, 46) = 6.88 |
0.002* |
0.93 |
110.2 |
Heavy sphere |
0.83 [0.24] |
0.80 [0.16] |
0.76 [0.27] |
0.78 [0.26] |
0.03 [0.25] |
0.521 |
0.49 |
59.3 |
F(2, 46) = 0.26 |
0.775 |
0.58 |
74.3 |
Heavy tripod |
0.88 [0.29] |
0.87 [0.37] |
0.74 [0.28] |
0.88 [0.46] |
0.01 [0.48] |
0.906 |
0.92 |
105.1 |
F(2, 46) = 1.42 |
0.252 |
0.91 |
109.7 |
Heavy power |
0.95 [0.38] |
0.80 [0.15] |
0.76 [0.39] |
0.79 [0.51] |
0.14 [0.34] |
0.049* |
0.71 |
81.5 |
F(2, 46) = 0.10 |
0.901 |
0.97 |
123.3 |
Heavy lateral |
1.24 [0.38] |
1.22 [0.43] |
1.23 [0.49] |
1.13 [0.46] |
0.03 [0.29] |
0.663 |
0.56 |
45.6 |
F(2, 46) = 0.48 |
0.623 |
1.07 |
89.7 |
Heavy tip |
1.03 [0.28] |
1.01 [0.31] |
0.79 [0.35] |
0.97 [0.48] |
0.01 [0.35] |
0.845 |
0.67 |
65.9 |
F(1.7, 38.0) = 1.89 |
0.171 |
1.20 |
130.0 |
Heavy extension |
0.96 [0.32] |
0.91 [0.24] |
0.87 [0.28] |
1.05 [0.57] |
0.05 [0.30] |
0.389 |
0.58 |
62.5 |
F(1.4, 32.8) = 2.24 |
0.136 |
0.88 |
93.8 |
ADL tasks |
|
|
|
|
|
|
|
|
|
|
|
|
Pick up coins |
6.28 [2.07] |
5.71 [1.28] |
5.14 [0.93] |
5.42 [1.16] |
0.57 [1.99] |
0.173 |
3.98 |
66.3 |
F(2, 46) = 2.64 |
0.082 |
2.49 |
46.0 |
Undo buttons |
22.76 [10.84] |
20.91 [9.83] |
18.60 [12.35] |
14.17 [6.58] |
1.84 [9.65] |
0.359 |
18.87 |
86.4 |
F(1.6, 34.9) = 3.70 |
0.044* |
24.09 |
134.7 |
Food cutting |
7.08 [2.89] |
5.93 [1.53] |
4.41 [2.20] |
5.54 [2.09] |
1.14 [2.29] |
0.023* |
4.94 |
75.9 |
F(2, 46) = 6.05 |
0.005* |
4.80 |
90.7 |
Page turning |
1.75 [0.81] |
1.41 [0.55] |
1.26 [0.71] |
1.06 [0.51] |
0.33 [0.52] |
<0.01* |
1.18 |
75.0 |
F(2, 46) = 5.40 |
0.008* |
1.14 |
92.0 |
Remove jar lid |
2.44 [1.09] |
2.20 [1.01] |
2.22 [1.52] |
1.89 [1.15] |
0.24 [0.65] |
0.080 |
1.33 |
57.2 |
F(1.7, 39.4) = 1.02 |
0.359 |
2.47 |
117.2 |
Pour water from jug |
6.08 [2.22] |
5.08 [1.27] |
4.75 [2.27] |
4.59 [1.62] |
1.00 [1.71] |
<0.01* |
3.82 |
68.5 |
F(2, 46) = 1.01 |
0.371 |
3.34 |
69.5 |
Pour water from carton |
10.85 [3.80] |
8.88 [2.13] |
8.59 [3.16] |
8.06 [3.62] |
1.97 [3.22] |
<0.01* |
7.29 |
73.9 |
F(2, 46) = 1.03 |
0.366 |
5.59 |
65.7 |
Move a full jar |
1.02 [0.36] |
1.00 [0.29] |
0.75 [0.24] |
1.05 [0.58] |
0.02 [0.32] |
0.732 |
0.61 |
60.5 |
F(1.4, 32.0) = 5.09 |
0.021* |
1.02 |
109.5 |
Move an empty tin |
0.91 [0.31] |
0.84 [0.27] |
0.87 [0.60] |
0.74 [0.27] |
0.07 [0.30] |
0.245 |
0.58 |
67.1 |
F(1.7, 38.3) = 0.69 |
0.481 |
1.10 |
135.3 |
Move a tray |
3.00 [1.23] |
2.98 [1.16] |
3.58 [1.32] |
3.05 [1.52] |
0.02 [0.91] |
0.903 |
1.74 |
58.2 |
F(2, 46) = 3.95 |
0.026* |
2.40 |
75.0 |
Rotate a key 90° |
0.75 [0.35] |
0.70 [0.12] |
0.72 [0.25] |
0.88 [0.40] |
0.04 [0.31] |
0.492 |
0.60 |
82.9 |
F(1.7, 38.3) = 2.82 |
0.081 |
0.83 |
107.8 |
Open/close a zip |
2.06 [0.98] |
2.15 [1.04] |
2.12 [0.88] |
2.04 [1.10] |
−0.09 [1.00] |
0.649 |
1.93 |
91.4 |
F(2, 46) = 0.11 |
0.896 |
2.37 |
112.7 |
Rotate a screw 90° |
7.98 [2.86] |
7.47 [2.06] |
5.55 [2.40] |
7.17 [2.50] |
0.51 [2.67] |
0.359 |
5.22 |
67.6 |
F(2, 46) = 6.60 |
0.003* |
6.07 |
90.3 |
Rotate a door handle | 0.70 [0.21] | 0.60 [0.13] | 0.57 [0.22] | 0.70 [0.29] | 0.10 [0.21] | 0.030* | 0.45 | 70.1 | F(2, 46) = 2.58 | 0.087 | 0.58 | 93.7 |
Abbreviations and notations: SHAP-C–Southampton Hand Assessment Procedure for Children, AO–abstract objects, S–session, A–assessor, SD–standard deviation, RC–repeatability coefficient, RRC–relative repeatability coefficient, P–significance value.
aPaired t-test for the results of the first and the second session of assessor 1.
bRepeated measures ANOVA for the results of assessor 1 (second session) assessor 2 and assessor 3.
*Significance P < 0.05.