Table 2.

List of the results of the evaluation of the 5 readers (CC = R1 Correct cases (round 1); CC R2 = Correct cases (round 2); WDD R1 = Wrong differential diagnoses (round 1); WDD R2 = Wrong differential diagnoses (round 2); EDD R1 = Empty differential diagnoses (round 1); EDD R2 = Empty differential diagnoses (round 2); MC R1 = Missed cases (round 1); MC R2 = Missed cases (round 1); WSC R1 = Weighted score (round 1); WSC R2 = Weighted score (round 2); TPC R1 = Time per case (round 1); TPC R2 = Time per case (round 2); ACC R1 = Accuracy (round 1); ACC R2 = Accuracy (round 2); k = Intra-rater agreement (Cohen’s kappa).

	CC R1	CC R2	WDD R1	WDD R2	EDD R1	EDD R2	MC R1	MC R2	WSC R1	WSC R2	TPC R1	TPC R2	ACC R1	ACC R2	k
Rater 1	5	19	67	50	78	81	45	31	14	48	183.24	239.68	0.1	0.38	0.07
Rater 2	10	11	92	93	48	46	40	39	16	20	130.5	324.72	0.2	0.22	0.22
Rater 3	7	14	95	85	48	51	43	36	12	29	135.34	136.22	0.14	0.28	0.12
Rater 4	12	17	83	99	55	34	38	33	26	27	256.78	258.76	0.24	0.34	0.34
Rater 5	9	23	83	91	58	36	41	27	20	36	323.74	295.7	0.18	0.46	0.45
Mean	8.60	16.80	84.00	83.60	57.40	49.60	41.40	33.20	17.60	32.00	205.92	251.02	0.172	0.336
SD	2.70	4.60	10.91	19.44	12.32	18.90	2.70	4.60	5.55	10.61	83.15	72.10	0.054	0.092