TABLE 2.
Inter-rater reliability results for intraclass correlation coefficients, Krippendorff’s alpha, and Dice coefficients. Values for ICCs and Krippendorff’s alpha are presented as mean (95% confidence interval) based on bootstrapping with 500 resampling iterations, using the bias-corrected and -accelerated method for estimating confidence intervals.
| Cognitive NOTE | Psychiatric NOTE | ||
|---|---|---|---|
| ICC (type = ICC2k) based on the ordinal assumption (worsen < no change < improved), excluding N/A values | Coefficient | 1.0 a | 0.96 (0.87–1.0) |
| p-value | <0.001 | <0.001 | |
| Number of subjects | 23 | 24 | |
| Krippendorff’s alpha | Alpha | 0.90 (0.74–1.0) | 0.91 (0.76–1.0) |
| Number of subjects | 30 | 30 | |
| Dice coefficient | N/A | 0.83 | 1.0 |
| Improve | 1.0 | 1.0 | |
| No change | 1.0 | 0.75 | |
| Worse | 0.92 | 0.90 |
a
Due to the perfect agreement between raters, calculating a 95% confidence interval using bootstrapping was not feasible.