Table 7.
Interrater Reliability for both Samples, Intraclass Correlation Coefficients
| JA Protocol Item | Sample 1 ICC |
Interpretation (Cicchetti and Sparrow, 1981) | Sample 2 ICC |
Interpretation (Cicchetti and Sparrow, 1981) |
|---|---|---|---|---|
| RJA 1 | .89 | Excellent | .50 | Fair |
| RJA 2 | .73 | Good | .62 | Good |
| RJA 3 | .78 | Excellent | .65 | Good |
| RJA 4 | 1 | Excellent | 1 | Excellent |
| RJA 5 | .94 | Excellent | .65 | Good |
| RJA 6 | 1 | Excellent | 0* | Unknown |
| RJA 7 | .87 | Excellent | .65 | Good |
| RJA 8 | .93 | Excellent | 0* | Unknown |
|
| ||||
| IJA 1 | .51 | Fair | .51 | Fair |
| IJA 2 | .72 | Good | .78 | Excellent |
| IJA 3 | .74 | Good | .28 | Poor |
| IJA 4 | .70 | Good | .39 | Poor |
| IJA 5 | .75 | Excellent | .48 | Poor |
| IJA 6 | .75 | Excellent | .62 | Good |
| IJA 7 | .77 | Excellent | .20 | Poor |
| IJA 8 | .77 | Excellent | .33 | Poor |
|
| ||||
| RJA Mean | .97 | Excellent | .99 | Excellent |
| IJA Mean | .89 | Excellent | .98 | Excellent |
*
0 values due to errors in variance/covariance matrix when calculating ICCs for this small sample, likely due to perfect agreement on these items. Kappa statistics for these items = 1.