Table 7.

Inter-rater agreement on initial classification in each table

	Proportion agreement	Kappa statistic (CI)	Class-specific proportion agreementb
Table 3a	0.676
Table 4 – Genes	0.917	0.86 (0.67, 1.00)	0.86 (Y)	0.75 (N)	1.00 (NA)
Table 4 – Polymorphisms	0.933	0.89 (0.75, 1.00)	0.92 (Y)	0.60 (N)	0.93 (NA)
Table 5 – Recommendations	0.917	0.86 (0.75, 0.98)	1.00 (S)	0.64 (M)	0.85 (–)
Table 5 – Web sites	0.933	0.81 (0.70, 0.92)	0.80 (S)	0.50 (M)	0.92 (–)
Table 6 – Benefits, Recommendations	0.962	0.92 (0.77, 1.00)	0.91 (Y)	0.94 (N)
Table 6 – Benefits, Web sites	0.846	0.55 (0.30, 0.79)	0.87 (Y)	0.96 (N)
Table 6 – Benefits, Web sites A & B only	0.615	0.23 (0.00, 0.61)	0.87 (Y)	0.85 (N)
Table 6 – Risks, Recommendations	0.722	0.21 (0.00, 0.89)	0.17 (Y)	0.71 (N)
Table 6 – Risks, Web sites	0.956	0.78 (0.48, 1.00)	0.67 (Y)	0.95 (N)
Table 6 – Risks, Web sites A & B only	0.889	0.73 (0.38, 1.00)	0.67 (Y)	0.86 (N)

CI = 95% Confidence interval.

^aStatistics were not computed for Table 3 because there were different response categories for each line in the table.

^bY = Yes; S = should; N = no; M = maybe; NA = not available; – = the indication was not specifically mentioned.