. Author manuscript; available in PMC: 2017 Dec 1.

Published in final edited form as: J Biomed Inform. 2016 Oct 5;64:211–221. doi: 10.1016/j.jbi.2016.10.002

Pairwise Cohen’s kappa statistics for the reviewers in the six groups.

Briefly, with three reviewers in each group we can calculate three different kappa scores. The scores in the table are ordered with the minimum and maximum kappa scores per group shown on the left and righ respectively.

Group id	minimum		maximum

1	−0.0417	0.1071	0.3204
2	0.3407	0.3407	0.5604
3	0.0500	0.1688	0.2500
4	0.2947	0.4074	0.4217
5	−0.2276	−0.2178	0.0074
6	0.2147	0.2947	0.3401