Table 3.
Inter-rater reliability for each item in posture, activity, tools and handling observations.
| Item | Inter-rater reliability (n = 443 observation pairs) | |||
|---|---|---|---|---|
|
| ||||
| % agreement | Kappa | |||
|
| ||||
| Coefficient* | 95% CI | Classification | ||
| 1. Trunk posture | 74.5 | 0.53 | 0.46–0.60 | Fair to good |
| 2. Leg posture | 96.3 | 0.94 | 0.91–0.97 | Excellent |
| 3. Shoulder/arm elevation† | 87.8 | 0.66 | 0.55–0.76 | Fair to good |
| 4. Elbow posture† | 79.7 | 0.40 | 0.27–0.53 | Fair to good |
| 5. Weight in hands† | 99.3 | 0.40 | (–)0.15–0.94 | Fair to good |
| 6. Manual materials handling (MMH) | 100 | –§ | – | – |
| 7. MMH action | 98.8 | 0.37 | 0.01–0.73 | Poor |
| 8. Noise level† | 42.5 | (–)0.19 | (–)0.26–(–)0.11 | Poor |
| 9. Vibration | 99.5 | 0 | – | Poor |
| 10. Neutral/gross grasp | 72.2 | 0.44 | 0.36–0.53 | Fair to good |
| 11. Wrist/forearm deviation | 74.8 | 0.50 | 0.41–0.58 | Fair to good |
| 12. Pinch grip | 87.3 | 0.72 | 0.65–0.79 | Fair to good |
| 13. Keyboarding | 95.9 | 0.83 | 0.75–0.91 | Excellent |
| 14. Hand/forearm contact stress | 87.2 | 0.60 | 0.51–0.70 | Fair to good |
| 15. Hand/forearm vibration | 100 | 1.0 | – | Excellent |
| 16. Weight in hands† | 98.8 | 0.44 | 0.01–0.88 | Fair to good |
| 17. Hand observed | 100 | 1.0 | – | Excellent |
| 18. Hand activity level† | 75.3 | 0.65 | 0.58–0.71 | Fair to good |
Note: 95% CI and significance are shown for kappa.
*
Significance: p < 0.0001 for each kappa coefficient shown, except for vibration (no. 9, p > 0.99).
†
Ordinal variable for which the weighted kappa coefficient was calculated.
§
Undefined (zero in the denominator).