Table 3.
Performance of AGREE (as shown by scores for domain percentage and mean outcome measures by user type), and measurement properties of the seven-point scale (as shown by Cronbach α and inter-rater reliability)
| Domain (D) or outcome measure (O) | Performance of AGREE |
Measurement properties of seven-point scale |
|||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| AGREE domain percentage score, mean (SD), or outcome measure score, mean (SD), by user type |
Significance (D v. C v. P) | Cronbach α | Inter-rater reliability (intraclass correlation average of n raters) |
R | |||||||
| Overall (83) | D (38) | C (28) | P (17) | 1 | 2 | 3 | 4 | ||||
| D1: Scope and purpose | 74 (22) | 67 (23) | 80 (19) | 78 (21) | 0.03 | 0.89 | 0.42 | 0.59 | 0.68 | 0.74 | 4 |
| D2: Stakeholder involvement | 52 (23) | 45 (23) | 55 (22) | 62 (19) | 0.03 | 0.73 | 0.40 | 0.57 | 0.67 | 0.73 | 4 |
| D3: Rigour of development | 69 (19) | 62 (22) | 74 (17) | 75 (12) | 0.01 | 0.75 | 0.30 | 0.46 | 0.56 | 0.63 | 6 |
| D4: Clarity of presentation | 68 (19) | 62 (22) | 72 (15) | 74 (15) | 0.04 | 0.68 | 0.35 | 0.52 | 0.62 | 0.68 | 5 |
| D5: Applicability | 45 (28) | 44 (30) | 49 (27) | 41 (28) | 0.62 | 0.80 | 0.57 | 0.73 | 0.80 | 0.84 | 2 |
| D6: Editorial independence | 62 (30) | 54 (31) | 67 (29) | 75 (21) | 0.03 | 0.64 | 0.47 | 0.64 | 0.73 | 0.78 | 3 |
| O1: Endorse (I would recommend this guideline for use in practice) | 5.11 (1.51) | 4.89 (1.64) | 5.25 (1.40) | 5.35 (1.41) | 0.49 | NA | NA | NA | NA | NA | NA |
| O2: Intend to use (I would make use of a guideline of this quality in my professional decisions) | 5.12 (1.57) | 4.97 (1.62) | 5.11 (1.73) | 5.47 (1.18) | 0.56 | NA | NA | NA | NA | NA | NA |
| O3: Guideline quality (Rate the overall quality of this guideline) | 5.11 (1.31) | 4.82 (1.52) | 5.32 (1.19) | 5.41 (0.80) | 0.17 | NA | NA | NA | NA | NA | NA |
Note: C = clinicians, D = developers or researchers, NA = not applicable, P = policy-makers, R = number of raters required to achieve inter-rater reliability of 0.7.