Skip to main content
. 2022 Dec 19;117(1):182–190. doi: 10.1016/j.ajcnut.2022.10.016

TABLE 2.

Interrater reliability summary1

Agreement Cohen’s κ Mean (SD) of self-rated difficulty of foods2 Percent of foods for which both coders rated the difficulty as very easy or easy
Pair 1 (n = 461 foods) 98.2% 0.97 1.5 (0.59) 88.5%
Pair 2 (n = 507 foods) 87.2% 0.65 1.2 (0.47) 94.5%
Pair 3 (n = 512 foods) 79.2% 0.64 1.5 (0.48) 93.2%
Pair 4 (n = 583 foods) 86.5% 0.76 1.3 (0.45) 94.7%
Pair 5 (n = 550 foods) 85.4% 0.60 1.6 (0.63) 79.3%
Pair 6 (n = 487 foods) 95.1% 0.77 1.3 (0.60) 89.7%
Overall 88.3% 0.75 1.4 (0.55) 90%
1

n represents all foods reviewed by coder pairs. However, the agreement and Cohen’s κ statistics were calculated using only those foods for which neither coder indicated “I don’t know.”

2

Possible range of self-rated difficulty: 1-Very Easy to 4-Very difficult.