Skip to main content
. 2017 Aug 25;17:131. doi: 10.1186/s12874-017-0409-2

Table 4.

Inter-rater reliability of video evaluation

Primary outcome (PET-MBI total score)
Variance σs 2 of the subject effect Variance σr 2 of the rater effect Variance σE 2 of the error Intraclass correlation coefficient (Fleiss’ ICC) Lower limit of the 95% CI
Session 1 742.81 1.47 8.42 0.99 0.98
Session 2 732.19 3.65 7.67 0.99 0.97
Secondary outcome (PET-MBI, mean κ coefficient, mean agreement rate)
Session 1 Session 2
κw κ POw PO κw κ POw PO
Personal Hygiene 0.77 0.61 0.92 0.71 0.79 0.64 0.93 0.74
Self-bathing 0.80 0.70 0.94 0.81 0.74 0.64 0.92 0.75
Feeding 0.90 0.83 0.97 0.88 0.86 0.80 0.96 0.86
Using the Toilet 0.84 0.74 0.94 0.79 0.82 0.71 0.93 0.77
Stair Climbing 0.89 0.83 0.97 0.90 0.88 0.82 0.97 0.89
Getting dressed 0.87 0.69 0.94 0.75 0.84 0.63 0.93 0.70
Bowel Control 0.93 0.86 0.97 0.90 0.90 0.84 0.96 0.88
Bladder Control 0.94 0.89 0.97 0.92 0.93 0.89 0.97 0.92
Chair/Bed Transfer 0.85 0.77 0.95 0.82 0.86 0.78 0.95 0.84
Ambulation 0.91 0.74 0.97 0.79 0.95 0.79 0.98 0.82

κ w Weighted κ coefficient (linear weights), κ κ coefficient, P Ow Weighted agreement rate (linear weights), P O Agreement rate