Table 1. Percent Agreement of Each External Rater With Site Classification and Between External Rater Pairs.

Agreement Pairing	Ratings, No.	Agreement Using 11 Categories, %	κ for Agreement Using 11 Categories	Agreement Using 6 Categories, %	κ for Agreement Using 6 Categories
Rater agreement with site
1	76	34.0	0.261	61.3	0.399
2	25	8.0	0.047	12.0	0.047
3	45	28.8	0.108	73.3	0.005
4	14	28.6	0.191	57.1	0.293
Rater pairs
1 and 2	25	16.0	0.112	36.0	0.234
1 and 3	39	28.0	0.157	64.0	0.348
1 and 4	14	35.0	0.200	43.0	0.104
2 and 3	24	8.0	0.047	17.0	0.068
2 and 4	13	7.7	−0.047	7.6	−0.110
3 and 4	13	38.5	0.235	53.8	−0.013