Table 3.

Number of raters correctly classifying clinical cases as “probable,” “possible,” or “unlikely”

Clinical case number	Correct valuesa		Number of raters selecting the correct rating
	Total score	Rating
1	11	Probable	10	Average number of raters selecting “probable” correctly: 9.0
2	10		7
3	10		10
4	10		10
5	9		9
6	9		10
7	9		10
8	9		9
9	9		8
10	9		7
11	8	Possible	6	Average number of raters selecting “possible” correctly: 7.9
12	8		8
13	8		9
14	8		7
15	7		6
16	7		9
17	7		7
18	7		9
19	7		8
20	7		10
21	6	Unlikely	9	Average number of raters selecting “unlikely” correctly: 8.9
22	6		8
23	6		8
24	6		10
25	6		8
26	6		8
27	5		9
28	5		10
29	5		9
30	4		10
Average number of raters selecting ratings correctly:			8.6

^aThe clinical cases were written to produce these “correct” ratings. The word “correct” is used here for clarity, but these are more precisely termed “target” ratings because of the inevitable possibility that the clinical cases were themselves in some way misleading