Table 2.
Characteristics of Validated Instruments and Study Methods
| Author | Evaluations (N) | Domains*(N) | Likert Scale† | Items (N) | Methods |
|---|---|---|---|---|---|
| Beckman, 2003 | 30 | 7 | 5 | 28 | IRR (KCC), ICR (α) |
| Benbassat, 1981 | — | 1 | 10 | 9 | Factor analysis, Pearson |
| Cohen, 1996 | 3,750 | — | 5 | 4 | IRR (ICC), test-retest |
| Copeland, 2000 | 7,845 | 1 | 5 | 15 | Factor analysis, ICR (α), IRR (g-coefficient), Pearson |
| Donnelly, 1989 | 218 | 2 | 7 | 12 | ICR (α), IRR (ICC) |
| Donner, 2003 | — | — | 4 | 43 | Test-retest (Pearson) |
| Guyatt, 1993 | — | 14 | 5 | 14 | Factor analysis, Pearson, ANOVA |
| Hayward, 1995 | 142 | 4 | 5 | 18 | Factor analysis, ICR (α), IRR (Spearman, ANOVA), generalizability coefficient |
| Irby, 1981 | 1,567 | 4 | 5 | 9 | Factor analysis, ICR (Split-half), IRR (Spearman, ANOVA) |
| James, 1999 | 156 | 4 | 4–6 | 25 | Factor analysis, ICR (α), correlation coefficients |
| Litzelman, 1998 | 1,581 | 7 | 5 | 25 | Factor analysis, ICR (α, Pearson, IIC) |
| Litzelman, 1999 | 360 | 7 | 5 | 25 | Factor analysis, ICR (α, IIC) |
| Macgill, 1986 | 195 | — | — | — | — |
| McLeod, 1993 | — | 2 | 6 | 25 | Factor analysis, ANOVA, Pearson, Spearman |
| Ramsbottom, 1994 | 639 | 8 | 6 | 9 | IRR (ICC, Spearman), ANOVA |
| Risucci, 1992 | — | 1 | 5 | 10 | Factor analysis, ICR (α), Test-retest, IRR (Pearson) |
| Shellenberger, 1982 | — | 6 | 4 | 34 | Factor analysis, ICR (α) |
| Solomon, 1997 | 1,570 | — | 4 | 13 | IRR (Ebel method, Spearman) |
| Steiner, 2000 | 48 | 4 | 5 | 4 | ICR (α), Spearman, multitrait-multimethod matrix |
| Tortolani, 1991 | — | 2 | 5 | 10 | Factor analysis, test-retest (Pearson) |
| Williams, 2002 | — | — | 5 | 1 | Multivariate Random Intercept Model |
*
Domains identified in evaluation instruments.
†
Number of points on instrument's Likert scales.
ANOVA, analysis of variance; α, Cronbach's coefficient α; ICC, intraclass correlation coefficient; ICR, internal consistency reliability; IIC, interitem correlation coefficient; IRR, interrater reliability; KCC, Kendall's coefficient of concordance; Pearson, Pearson's correlation coefficient; Spearman, Spearman-Brown prophecy formula; —, information unavailable.