Table 3.
Mean agreement (Krippendorff’s Alpha αK) and (±) standard deviation between the gold standard (MALDI-TOF) and evaluators, and between evaluators (Inter-rater reliability) in bacterial identification after 24 and 48 h incubation on average (All) or per specific agar: Liofilchem Chromatic™ MH (LFCA), Flexicult® Vet Scandinavia (FLEX), and custom-made agar (CAVD).
| 24 h incubation | 48 h incubation | |||||||
|---|---|---|---|---|---|---|---|---|
| All | LFCA | FLEX | CAVD | All | LFCA | FLEX | CAVD | |
| Agreement (αK) | 0.73 ± 0.11 | 0.79 ± 0.15 | 0.72 ± 0.12 | 0.67 ± 0.08 | 0.79 ± 0.05 | 0.80 ± 0.10 | 0.84 ± 0.04 | 0.73 ± 0.04 |
| Inter-rater reliability | 0.69 ± 0.12 | 0.72 ± 0.08 | 0.64 ± 0.20 | 0.71 ± 0.18 | 0.80 ± 0.06 | 0.74 ± 0.08 | 0.84 ± 0.05 | 0.82 ± 0.11 |
| IRR(best) / IRR(worst) | 0.81 / 0.49 | 0.81 / 0.59 | 0.88 / 0.42 | 0.96 / 0.43 | 0.91 / 0.75 | 0.85 / 0.64 | 0.88 / 0.74 | 1.00 / 0.71 |
IRR (best) and IRR (worst) mark the best and worst agreement between two evaluators.