TABLE 2.
Interrater reliability summary1
| Agreement | Cohen’s κ | Mean (SD) of self-rated difficulty of foods2 | Percent of foods for which both coders rated the difficulty as very easy or easy | |
|---|---|---|---|---|
| Pair 1 (n = 461 foods) | 98.2% | 0.97 | 1.5 (0.59) | 88.5% |
| Pair 2 (n = 507 foods) | 87.2% | 0.65 | 1.2 (0.47) | 94.5% |
| Pair 3 (n = 512 foods) | 79.2% | 0.64 | 1.5 (0.48) | 93.2% |
| Pair 4 (n = 583 foods) | 86.5% | 0.76 | 1.3 (0.45) | 94.7% |
| Pair 5 (n = 550 foods) | 85.4% | 0.60 | 1.6 (0.63) | 79.3% |
| Pair 6 (n = 487 foods) | 95.1% | 0.77 | 1.3 (0.60) | 89.7% |
| Overall | 88.3% | 0.75 | 1.4 (0.55) | 90% |
n represents all foods reviewed by coder pairs. However, the agreement and Cohen’s κ statistics were calculated using only those foods for which neither coder indicated “I don’t know.”
Possible range of self-rated difficulty: 1-Very Easy to 4-Very difficult.