Table 5.

Comparison of inter-rater reliability between rater pairs with experienced raters in each pair (group A) and with one inexperienced rater in each pair (group B).

Item	Group A (n = 185 observation pairs)			Group B (n = 258 observation pairs)
	% agreement	Kappa		% agreement	Kappa
		Coeff.*	95% CI		Coeff.*	95% CI
1. Trunk posture	82.3	0.68	0.58–0.77	68.8	0.42	0.33–0.52
2. Leg posture	97.8	0.96	0.93–1.0	95.2	0.92	0.88–0.96
3. Shoulder/arm elevation†	90.0	0.75	0.61–0.88	86.2	0.56	0.41–0.71
4. Elbow posture†	77.7	0.33	0.14–0.53	81.2	0.45	0.27–0.62
5. Weight in hands†	99.4	0	–	99.2	0.50	(–)0.1–1.0
6. Manual materials handling (MMH)	100	–§	–	100	–§	–
7. MMH action	98.9	0	–	98.8	0.50	0.1–0.90
8. Noise level†	96.7	0.86	0.74–0.97	3.2	(–)0.59	(–)0.73–(–)0.46
9. Vibration	100	–§	–	99.2	0	–
10. Neutral/gross grasp	74.4	0.49	0.36–0.62	70.5	0.40	0.28–0.52
11. Wrist/forearm deviation	79.1	0.59	0.47–0.70	71.6	0.43	0.32–0.55
12. Pinch grip	93.7	0.87	0.79–0.94	82.5	0.60	0.49–0.71
13. Keyboarding	98.3	0.93	0.85–1.0	94.0	0.74	0.61–0.87
14. Hand/forearm contact stress	88.4	0.59	0.43–0.75	86.3	0.61	0.49–0.73
15. Hand/forearm vibration	100	–§	–	100	1.0	–
16. Weight in hands†	98.3	0	–	99.2	0.67	0.36–0.97
17. Hand observed	100	1.0	–	100	1.0	–
18. Hand activity level†	84.2	0.79	0.71–0.86	68.9	0.51	0.41–0.60

Note: 95% CI and significance are shown for kappa.

^*Significance: p < 0.0001 for each kappa coefficient shown, except for items (p > 0.99 each) such as weight in hands (no. 5 and no. 16), MMH action in group A and vibration (no. 9) in group B.

^†Ordinal variable for which the weighted kappa coefficient was calculated.

^§Undefined (zero in the denominator).