Table 4.
Reliability statistics among independent expert raters
| ICC | |||||||
|---|---|---|---|---|---|---|---|
| Intraclass correlationa | 95% CI | Value | F-test with true value 0 | ||||
| Lower bound | Upper bound | df1 | df2 | Significance | |||
| Single measures | 0.826b | 0.447 | 0.954 | 10.524 | 9 | 9 | 0.001 |
| Average measures | 0.905c | 0.617 | 0.976 | 10.524 | 9 | 9 | 0.001 |
Notes: Two-way mixed-effects model where people effects are random and measures effects are fixed.
a
Type C ICCs using a consistency definition. The between-measure variance is excluded from the denominator variance.
b
The estimator is the same, whether the interaction effect is present or not.
c
This estimate is computed assuming the interaction effect is absent, because it is not estimable otherwise.
Abbreviation: ICC, intraclass correlation coefficient.