Table 6.
Agreement on both print and A/V PEMAT materials (N = 110 materials)
PEMAT Item number | Percent Raw Agreement | Fleiss Kappa (95% CI) | Gwet’s AC1 (95% CI) |
---|---|---|---|
1 | 0.99 | 0 (−0.01, 0) | 0.99 (0.97, 1) |
2a | 0.99 | −0.01 (−0.02, 0.01) | 0.99 (0.96, 1) |
3 | 0.96 | 0.78 (0.57, 0.99) | 0.96 (0.91, 1) |
4 | 0.93 | 0.39 (0.05, 0.73) | 0.92 (0.86, 0.98) |
1 | 1 (1, 1) | 1 (1, 1) | |
6 a | 0.70 | 0.34 (0.12, 0.56) | 0.45 (0.24, 0.66) |
7 a | 1 | 1 (1, 1) | 1 (1, 1) |
8 | 0.94 | 0.61 (0.33, 0.88) | 0.93 (0.88, 0.98) |
9 | 0.91 | 0.66 (0.46, 0.86) | 0.89 (0.83, 0.96) |
10 | 0.98 | 0.49 (−0.13, 1) | 0.98 (0.95, 1) |
11 | 0.75 | 0.17 (−0.04, 0.39) | 0.70 (0.59, 0.81) |
12 | 0.85 | 0.62 (0.45, 0.78) | 0.81 (0.72, 0.90) |
13b | 0.67 | 0.24 (−0.13, 0.61) | 0.57 (0.33, 0.82) |
14 b | 1 | 1 (1, 1) | 1 (1, 1) |
15 a | 0.94 | 0.51 (0.13, 0.89) | 0.93 (0.86, 0.99) |
16 a | 0.91 | 0.82 (0.69, 0.95) | 0.83 (0.70, 0.95) |
17 a | 0.86 | 0.74 (0.59, 0.88) | 0.81 (0.71, 0.92) |
18 | 0.85 | 0.70 (0.57, 0.83) | 0.79 (0.70, 0.89) |
19 | 0.90 | 0.69 (0.53, 0.86) | 0.88 (0.81, 0.95) |
20 | 0.98 | −0.01 (−0.02, 0) | 0.98 (0.96, 1) |
21 | 1 | 1 (1, 1) | 1 (1, 1) |
22 | 0.98 | 0.66 (0.21, 1) | 0.98 (0.95, 1) |
23 a | 0.88 | 0.22 (−0.12, 0.55) | 0.85 (0.75, 0.95) |
24 a | 0.94 | 0.61 (0.32, 0.91) | 0.93 (0.87, 0.99) |
25 | 0.82 | 0.50 (0.30, 0.69) | 0.78 (0.68, 0.87) |
26 a | 0.89 | 0.25 (−0.11, 0.60) | 0.87 (0.78, 0.96) |
Items that are only for print materials (n = 80 materials)
Items that are only for A/V materials (n = 30 materials)