Table 3. Inter rater reliability study results for included CPGs a.
Agree II Domain | P(G)MSb | RMS | EMS | n | K | ICC (Random) | Lower 95% Cl | Upper 95% Cl | P value |
Domain 1 | 54.382 | .045 | .545 | 12 | 2 | .990 (high) | .963 | .997 | .000 |
Domain 2 | 34.778 | 3.200 | 1.422 | 12 | 2 | .959 (high) | .835 | .990 | .000 |
Domain 3 | 165.756 | 16.200 | .494 | 12 | 2 | .987(high) | .947 | .997 | .000 |
Domain 4 | 58.482 | 3.682 | 5.082 | 12 | 2 | .913(high) | .677 | .977 | .000 |
Domain 5 | 35.64 | .182 | .482 | 12 | 2 | .986(high) | .950 | .996 | .000 |
Domain 6 | 21.467 | .200 | .533 | 12 | 2 | .975(high) | .900 | .994 | .000 |
CP Gs = clinical practice guidelines; P(G)MS = Patients’ (Guideline’s) Mean Square; RMS = Rater’s Mean Square; EMS = Error Mean Square; n = sample size; K = number of measurements; ICC = intraclass correlation coefficient; CI = confidence interval.
Temporary PMS, RMS, and EMS value.