Table 3.
Inter-rater agreement: item-by-item linear-weighted kappa coefficients interpreted according to Landis and Koch [19].
| Item | Agreement between two doctors (n = 47) |
Agreement between Medical and MD Team scores (n = 94) |
||||
|---|---|---|---|---|---|---|
| Kappa | 95% CI* | Interpretation | Kappa | 95% CI | Interpretation | |
| Left upper limb | 0.94 | 0.72–1.0 | Almost perfect | 0.76 | 0.61–0.92 | Substantial |
| Right upper limb | 0.90 | 0.69–1.0 | Almost perfect | 0.74 | 0.59–0.90 | Substantial |
| Left lower limb | 0.93 | 0.72–1.0 | Almost perfect | 0.82 | 0.66–0.97 | Almost perfect |
| Right lower limb | 0.85 | 0.65–1.0 | Almost perfect | 0.76 | 0.92–0.59 | Substantial |
| Trunk | 0.87 | 0.64–1.0 | Almost perfect | 0.43 | 0.27–0.59 | Moderate |
| Tone | 0.63 | 0.44–0.82 | Substantial | 0.45 | 0.31–0.60 | Moderate |
| Sensation | 0.82 | 0.59–1.0 | Almost perfect | 0.65 | 0.51–0.79 | Substantial |
| Perception | 0.85 | 0.60–1.0 | Almost perfect | 0.63 | 0.47–0.79 | Substantial |
| Speech | 0.90 | 0.68–1.0 | Almost perfect | 0.81 | 0.66–0.96 | Almost perfect |
| Cognitive | 0.84 | 0.63–1.0 | Almost perfect | 0.66 | 0.52–0.79 | Substantial |
| Behaviour | 0.94 | 0.69–1.0 | Almost perfect | 0.13 | 0–0.27 | Slight |
| Mood | 0.75 | 0.54–0.96 | Substantial | 0.57 | 0.43–0.72 | Moderate |
| Vision | 0.80 | 0.56–1.0 | Substantial | 0.68 | 0.52–0.84 | Substantial |
| Hearing | 0.79 | 0.52–1.0 | Substantial | 0.77 | 0.59–0.95 | Substantial |
| Pain | 0.76 | 0.58–0.94 | Substantial | 0.43 | 0.29–0.56 | Moderate |
| Fatigue | 0.58 | 0.40–0.77 | Moderate | 0.39 | 0.27–0.52 | Fair |
| Other | 0.84 | 0.63–1.0 | Almost perfect | 0.44 | 0.29–0.59 | Moderate |
| Total NIS Kappa | 0.81 | 0.63–0.99 | Almost perfect | 0.69 | 0.56–0.95 | Substantial |
| ICC | 0.95 | 0.91–0.97 | 0.92 | 0.88–0.95 | ||
95% Confidence intervals (CI) were calculated as +/−1.96 s standard error and the upper limit truncated at a maximum of 1.0.