Table 6.
Percent agreement and kappa statistics for expert rankings by sign or algorithm
Sign/Algorithm | Percent Agreement | Kappa |
---|---|---|
01-Pus | 87.8 | 0.75 |
02-Redness | ||
Exact | 68.0 | 0.55 |
Binary* | 85.7 | 0.70 |
03-Swelling | ||
Exact | 28.0 | 0.09 |
Binary* | 69.4 | 0.25 |
Alg-04 | 83.7 | 0.67 |
Alg-05 | 71.4 | 0.20 |
Alg-06 | 91.8 | 0.75 |
Alg-07 | 91.8 | 0.70 |
Alg-08 | 85.7 | 0.68 |
Alg-09 | 83.7 | 0.27 |
Alg-10 | 85.7 | 0.61 |
Ratings of none or mild, and moderate or severe were combined into single values (0 and 1 respectively).
Alg 04: Redness or swelling (moderate or severe)
Alg 05: Redness and swelling (moderate or severe)
Alg 06: Pus and (redness or swelling (moderate or severe))
Alg 07: Pus and redness (moderate or severe)
Alg 08: Pus and (redness and swelling (any degree))
Alg 09: Pus and (redness and swelling (moderate or severe))
Alg 10: (Pus and moderate redness) or (severe redness)