Within listener agreement			Listener (N=number of recordings interpreted by each panellist)
Dichotomous lung examination group		Overall (n=136)	Listener #1 (n=18)	Listener #2 (n=13)	Listener #3 (n=20)	Listener #4 (n=19)	Listener #5 (n=18)	Listener #6 (n=17)	Listener #7 (n=16)	Listener #8 (n=15)
Abnormal or normal†	Agreement, n (%)	110 (80.8)	16 (88.8)	11 (84.6)	14 (70.0)	14 (73.6)	16 (88.8)	16 (94.2)	11 (68.8)	12 (80.0)
	Kappa statistic (95% CI)	0.61 (0.48 to 0.75)	0.75	0.68	0.42	0.44	0.73	0.77	0.23	0.55
	PABAK (95% CI)**	0.62 (0.49 to 0.75)	0.78	0.69	0.40	0.47	0.78	0.88	0.38	0.60
Crackle or no crackle	Agreement, n/N (%)	112 (82.4)	15 (83.4)	13 (100.0)	12 (60.0)	17 (89.4)	17 (94.4)	15 (88.2)	12 (75.0)	11 (73.4)
	Kappa statistic (95% CI)	0.62 (0.48 to 0.76)	0.67	1.00	0.20	0.46	0.82	0.77	0.50	0.47
	PABAK (95% CI)††	0.65 (0.52 to 0.78)	0.67	1.00	0.2	0.79	0.89	0.77	0.5	0.47
Wheeze or no wheeze	Agreement, n/N (%)	114 (83.8)	14 (77.8)	11 (84.6)	16 (80.0)	16 (84.2	17 (94.4)	16 (94.2)	13 (81.2)	11 (73.4)
	Kappa statistic (95% CI)	0.67 (0.55 to 0.80)	0.56	0.68	0.57	0.62	0.77	0.85	0.63	0.47
	PABAK (95% CI)‡‡	0.68 (0.55 to 0.80)	0.56	0.69	0.60	0.68	0.89	0.88	0.63	0.47

*Excludes uninterpretable primary listener lung examination results for 83/792 cases. Primary listeners were the first two listeners randomly assigned to interpret a lung sound examination.

†Crackle and/or wheeze (abnormal) or no crackle and/or wheeze (normal).

‡Prevalence index 0.30, bias index −0.04.

§Prevalence index −0.15, bias index 0.01.

¶Prevalence index 0.1, bias index −0.05.

**Prevalence index 0.13, bias index 0.03.

††Prevalence index −0.28, bias index 0.

‡‡Prevalence index −0.13, bias index 0.03.

PABAK, prevalence-adjusted, bias-adjusted kappa statistic.