TABLE 1.
Reliability analysis
Narrative Letter | Standardized Letter | |
---|---|---|
Personality | ||
Inter-rater - W | 0.437 | 0.654 |
Intrarater - Averaged ρ | 0.368 | 0.754 |
Work Ethic | ||
Inter-rater - W | 0.481 | 0.720 |
Intrarater - Averaged ρ | 0.542 | 0.906 |
Reliability | ||
Inter-rater - W | 0.456 | 0.723 |
Intrarater - Averaged ρ | 0.511 | 0.882 |
Perception of Letter Inflation | ||
Inter-rater - W | 0.282 | 0.364 |
Intrarater - Averaged ρ | 0.426 | 0.507 |
Global Score | ||
Inter-rater - W | 0.578 | 0.704 |
Intrarater - Averaged ρ | 0.643 | 0.764 |
W=Kendall Coefficient of Concordance
ρ=Spearman Rank Correlation Coefficient (averaged among 5 repeat interpreters)