Table 11.

Inter-rater agreement

Question	No. of studies	Gwet’s AC1/Gwet’s AC2	95% CI	p-value
1	16	0.73	0.43, 1.00	< 0.001
2	16	0.83	0.64, 1.00	< 0.001
3	16	0.68	0.40, 0.96	< 0.001
4	16	0.58	0.34, 0.83	< 0.001
5	16	0.72	0.38, 1.00	< 0.001
6	16	0.56	0.18, 0.95	0.006
7	16	0.91	0.81, 1.00	< 0.001
8	16	0.61	0.35, 0.87	< 0.001
9	16	0.87	0.69, 1.00	< 0.001
10	16	0.67	0.36, 0.97	< 0.001
11	12	0.49	0.02, 0.96	0.042
12	12	0.34	− 0.12, 0.80	0.133
13	16	0.43	0.03, 0.84	0.038
14	16	0.22	− 0.23, 0.66	0.321
15	12	0.58	0.16, 0.99	0.011
16	16	0.15	− 0.25, 0.55	0.444

Fifteen missing ratings. Italicised areas are considered the critical questions