Table 1.

Number of P4P reports needed to estimate kappa

Pa − Pe	Relative Error
	20%	30%	40%
0.1	2500	1111	625
0.2	625	278	156
0.3	278	123	69
0.4	156	69	39
0.5	100	44	25
0.6	69	31	17
0.7	51	23	13
0.8	39	17	10
0.9	31	14	8
1.0	25	11	6