Skip to main content
. 2013 May 30;36(1):23–31. doi: 10.3109/09638288.2013.775360

Table 3.

Inter-rater agreement: item-by-item linear-weighted kappa coefficients interpreted according to Landis and Koch [19].

Item Agreement between two doctors (n = 47)
Agreement between Medical and MD Team scores (n = 94)
Kappa 95% CI* Interpretation Kappa 95% CI Interpretation
Left upper limb 0.94 0.72–1.0 Almost perfect 0.76 0.61–0.92 Substantial
Right upper limb 0.90 0.69–1.0 Almost perfect 0.74 0.59–0.90 Substantial
Left lower limb 0.93 0.72–1.0 Almost perfect 0.82 0.66–0.97 Almost perfect
Right lower limb 0.85 0.65–1.0 Almost perfect 0.76 0.92–0.59 Substantial
Trunk 0.87 0.64–1.0 Almost perfect 0.43 0.27–0.59 Moderate
Tone 0.63 0.44–0.82 Substantial 0.45 0.31–0.60 Moderate
Sensation 0.82 0.59–1.0 Almost perfect 0.65 0.51–0.79 Substantial
Perception 0.85 0.60–1.0 Almost perfect 0.63 0.47–0.79 Substantial
Speech 0.90 0.68–1.0 Almost perfect 0.81 0.66–0.96 Almost perfect
Cognitive 0.84 0.63–1.0 Almost perfect 0.66 0.52–0.79 Substantial
Behaviour 0.94 0.69–1.0 Almost perfect 0.13 0–0.27 Slight
Mood 0.75 0.54–0.96 Substantial 0.57 0.43–0.72 Moderate
Vision 0.80 0.56–1.0 Substantial 0.68 0.52–0.84 Substantial
Hearing 0.79 0.52–1.0 Substantial 0.77 0.59–0.95 Substantial
Pain 0.76 0.58–0.94 Substantial 0.43 0.29–0.56 Moderate
Fatigue 0.58 0.40–0.77 Moderate 0.39 0.27–0.52 Fair
Other 0.84 0.63–1.0 Almost perfect 0.44 0.29–0.59 Moderate
Total NIS Kappa 0.81 0.63–0.99 Almost perfect 0.69 0.56–0.95 Substantial
ICC 0.95 0.91–0.97 0.92 0.88–0.95
*

95% Confidence intervals (CI) were calculated as +/−1.96 s standard error and the upper limit truncated at a maximum of 1.0.