Table 2.
Between listener agreement | Listener (N=number of recordings interpreted by each panellist) | |||||||||
Dichotomous lung examination group | Overall (n=709) | Listener #1 (n=183) |
Listener #2 (n=172) |
Listener #3 (n=182) |
Listener #4 (n=159) |
Listener #5 (n=183) |
Listener #6 (n=187) |
Listener #7 (n=175) |
Listener #8 (n=177) |
|
Abnormal or normal† | Agreement, n (%) | 531 (74.9) | 143 (78.2) | 124 (72.0) | 135 (74.2) | 115 (72.4) | 128 (70.0) | 148 (79.2) | 123 (70.2) | 146 (82.4) |
Kappa statistic (95% CI) | 0.45 (0.40 to 0.50) | 0.49 | 0.41 | 0.44 | 0.43 | 0.37 | 0.52 | 0.31 | 0.60 | |
PABAK (95% CI)‡ | 0.50 (0.45 to 0.54) | 0.56 | 0.44 | 0.48 | 0.45 | 0.40 | 0.58 | 0.41 | 0.65 | |
Crackle or no crackle | Agreement, n/N (%) | 500/709 (70.6) | 114/183 (62.2) | 121/172 (70.4) | 126/182 (69.2) | 105/159 (66.0) | 134/183 (73.2) | 132/187 (70.6) | 131/175 (74.8) | 137/177 (77.4) |
Kappa statistic (95% CI) | 0.40 (0.35 to 0.44) | 0.30 | 0.32 | 0.36 | 0.29 | 0.44 | 0.40 | 0.50 | 0.54 | |
PABAK (95% CI)§ | 0.41 (0.36 to 0.46) | 0.25 | 0.41 | 0.39 | 0.32 | 0.46 | 0.41 | 0.50 | 0.55 | |
Wheeze or no wheeze | Agreement, n/N (%) | 515 (72.6) | 141/183 (77.0) | 120/172 (69.8) | 131/182 (72.0) | 121/159 (76.2) | 120/183 (65.6) | 136/187 (72.8) | 119/175 (68.0) | 142/177 (80.2) |
Kappa statistic (95% CI) | 0.45 (0.41 to 0.50) | 0.54 | 0.40 | 0.44 | 0.52 | 0.30 | 0.45 | 0.38 | 0.60 | |
PABAK (95% CI)¶ | 0.45 (0.41 to 0.50) | 0.54 | 0.40 | 0.44 | 0.52 | 0.31 | 0.46 | 0.36 | 0.61 |