Table 3.
Test–retest reliability (kappa coefficient) for main analysis
| Item | Overall | GD1 | GD2 | GD3 | ||||
|---|---|---|---|---|---|---|---|---|
| n | Estimate (95% CI) | n | Estimate (95% CI) | n | Estimate (95% CI) | n | Estimate (95% CI) | |
| Part 1 | ||||||||
| P1-1 | 22 | 0.446 (−0.112, 1) | 7 | 0.774 (0.774, 0.774) | 9 | −0.438 (−1, 1) | 6 | 0.889 (0.714, 1) |
| P1-2 | 26 | 0.349 (−1, 1) | 8 | NA | 10 | −0.067 (−1, 1) | 8 | 0.842 (0.842, 0.842) |
| P1-3 | 10 | 0.828 (0.828, 0.828) | 4 | NA | 2 | NA | 4 | 0.750 (0.577, 0.923) |
| P1-4 | 27 | 0.468 (−0.158, 1) | 8 | NA | 10 | −0.067 (−1, 1) | 9 | 0.787 (0.561, 1) |
| P1-5 | 25 | 0.556 (0.269, 0.844) | 8 | − 0.111 (−1, 1) | 8 | 0.481 (−0.355, 1) | 9 | 0.471 (−0.199, 1) |
| P1-6 | 28 | 0.612 (0.486, 0.738) | 8 | 0.800 (0.800, 0.800) | 11 | 0.193 (−0.775, 1) | 9 | 0.769 (0.769, 0.769) |
| P1-7 | 24 | 0.286 (−1, 1) | 8 | 0.778 (0.778, 0.778) | 7 | −0.235 (−1, 1) | 9 | 0.542 (0.233, 0.852) |
| P1-8 | 26 | 0.438 (−0.788, 1) | 8 | 0.373 (−1, 1) | 9 | 0.091 (−0.847, 1) | 9 | 0.890 (0.890, 0.890) |
| P1-9 | 23 | 0.390 (− 0.931, 1) | 8 | 0.833 (0.833, 0.833) | 7 | 0.222 (−1, 1) | 8 | 0.517 (−0.179, 1) |
| P1-10 | 26 | 0.097 (−1, 1) | 8 | 0.625 (0.625, 0.625) | 10 | −0.231 (−1, 1) | 8 | 0.333 (−0.848, 1) |
| P1-11 | 28 | 0.487 (−1, 1) | 8 | 0.867 (0.867, 0.867) | 11 | −0.039 (−1, 1) | 9 | 0.679 (0.679, 0.679) |
| P1-12 | 24 | 0.538 (0.155, 0.922) | 7 | 0.887 (0.705, 1) | 8 | 0.132 (−1, 1) | 9 | 0.518 (−0.365, 1) |
| P1-13 | 30 | 0.444 (−0.388, 1) | 8 | 0.094 (−0.941, 1) | 13 | 0.221 (−0.656, 1) | 9 | 0.780 (0.780, 0.780) |
| P1-14 | 30 | 0.496 (−0.605, 1) | 8 | 0.576 (−1, 1) | 13 | 0.300 (−0.565, 1) | 9 | 0.046 (−1, 1) |
| P1-15 | 30 | 0.608 (0.331, 0.884) | 8 | 0.467 (−0.166, 1) | 13 | 0.273 (−1, 1) | 9 | 0.798 (0.798, 0.798) |
| Part 2 | ||||||||
| P2-1 | 29 | 0.971 (0.971, 0.971) | 8 | 0.857 (0.857, 0.857) | 12 | 0.175 (−1, 1) | 9 | 0.976 (0.976, 0.976) |
| P2-2 | 29 | 0.562 (−1, 1) | 7 | 0 (0, 0) | 13 | 0.649 (0.649, 0.649) | 9 | 0.434 (−1, 1) |
| P2-3 | 30 | 0.781 (0.781, 0.781) | 8 | 0.364 (−0.215, 0.943) | 13 | 0.787 (0.787, 0.787) | 9 | 0.799 (0.799, 0.799) |
| P2-4 | 30 | 0.612 (0.612, 0.612) | 8 | 0.298 (−0.500, 1) | 13 | 0.363 (−0.397, 1) | 9 | 0.917 (0.917, 0.917) |
| P2-5 | 30 | 0.746 (0.746, 0.746) | 8 | 0.926 (0.926, 0.926) | 13 | 0.483 (−1, 1) | 9 | 0.900 (0.900, 0.900) |
| P2-6 | 30 | 0.630 (0.630, 0.630) | 8 | 0.737 (0.737, 0.737) | 13 | 0.458 (−0.287, 1) | 9 | 0.739 (0.204, 1) |
| P2-7 | 30 | 0.658 (0.174, 1) | 8 | 0.846 (0.846, 0.846) | 13 | 0.703 (0.703, 0.703) | 9 | 0.361 (−1, 1) |
| P2-8 | 30 | 0.582 (−0.003, 1) | 8 | 0.793 (0.793, 0.793) | 13 | 0.680 (0.172, 1) | 9 | 0.247 (−1, 1) |
| P2-9 | 30 | 0.462 (−1, 1) | 8 | 0.154 (−1, 1) | 13 | 0.259 (−1, 1) | 9 | 0.428 (−1, 1) |
| Part 3 | ||||||||
| P3-1 | 30 | 0.842 (0.842, 0.842) | 8 | 0.769 (0.769, 0.769) | 13 | 0.768 (0.768, 0.768) | 9 | 0.967 (0.967, 0.967) |
| P3-2 | 30 | 0.683 (0.683, 0.683) | 8 | 0.580 (−0.107, 1) | 13 | 0.731 (0.731, 0.731) | 9 | 0.749 (0.749, 0.749) |
| P3-3 | 30 | 0.868 (0.868, 0.868) | 8 | NA | 13 | 0.786 (0.786, 0.786) | 9 | 0.856 (0.856, 0.856) |
| P3-4 | 30 | 0.988 (0.988, 0.988) | 8 | 0 (−1, 1) | 13 | 0.988 (0.988, 0.988) | 9 | 0.957 (0.957, 0.957) |
| P3-5 | 30 | 0.961 (0.961, 0.961) | 8 | 0.760 (0.760, 0.760) | 13 | 0.937 (0.937, 0.937) | 9 | 0.942 (0.942, 0.942) |
| P3-6 | 29 | 0.855 (0.855, 0.855) | 7 | NA | 13 | 0.869 (0.869, 0.869) | 9 | 0.518 (−1, 1) |
| P3-7 | 30 | 0.803 (0.803, 0.803) | 8 | 0.917 (0.917, 0.917) | 13 | 0.692 (0.058, 1) | 9 | 0.862 (0.862, 0.862) |
| P3-8 | 30 | 0.811 (0.811, 0.811) | 8 | 0.609 (0.609, 0.609) | 13 | 0.731 (0.731, 0.731) | 9 | 0.947 (0.800, 1) |
| P3-9 | 30 | 0.266 (−1, 1) | 8 | 0.191 (−0.206, 0.589) | 13 | 0.248 (−0.665, 1) | 9 | 0.286 (−0.0775, 1) |
| P3-10 | 30 | 0.659 (0.482, 0.835) | 8 | 0.841 (0.600, 1) | 13 | 0.511 (−0.486, 1) | 9 | 0.654 (0.160, 1) |
| P3-11 | 30 | 0.536 (−1, 1) | 8 | 0.167 (−1, 1) | 13 | 0.277 (−1, 1) | 9 | 0.930 (0.930, 0.930) |
| P3-12 | 29 | 0.608 (−0.024, 1) | 8 | 0 (0, 0) | 12 | 0.361 (−0.553, 1) | 9 | 0.696 (0.048, 1) |
| P3-13 | 30 | 0.776 (0.776, 0.776) | 8 | 0.632 (− 0.154, 1) | 13 | 0.736 (0.359, 1) | 9 | 0.860 (0.860, 0.860) |
| P3-14 | 30 | 0.782 (0.782, 0.782) | 8 | −0.070 (−1, 0.869) | 13 | 0.759 (0.286, 1) | 9 | 0.658 (0.658, 0.658) |
| P3-15 | 30 | 0.753 (0.753, 0.753) | 8 | −0.172 (−1, 1) | 13 | 0.845 (0.845, 0.845) | 9 | 0.657 (0.012, 1) |
| P3-16 | 27 | 0.514 (−0.255, 1) | 6 | 0.848 (0.848, 0.848) | 12 | 0.470 (−0.605, 1) | 9 | 0.112 (−1, 1) |
Kappa coefficients > 0.6 are in bold; coefficients < 0.2 are in italics. In general, a kappa coefficient < 0.2 indicates no agreement, 0.2–0.4 indicates minimal agreement, 0.4–0.6 indicates weak agreement, 0.6–0.8 indicates moderate agreement, 0.8–0.9 indicates strong agreement, and > 0.9 indicates almost perfect agreement [29]
CI: confidence interval; GD1/2/3: type 1/2/3 Gaucher disease; NA: not applicable; P: Part