Table 2.

Agreement of human raters with one another. For each rater (Column 2) who reached the result vaccine hesitant or pro-vaccination in Column 3, the fraction of times the other raters agreed is given in the remaining columns.

Platform	Reference Grader	Reference Result	Rater 1 Agreement	Rater 2 Agreement	Rater 3 Agreement
Facebook	Rater 1	Hesitant	-	83.5%	85.3%
		Pro	-	89.7%	97.9%
	Rater 2	Hesitant	89%	-	85%
		Pro	91.6%	-	94.7%
	Rater 3	Hesitant	89.6%	80.2%	-
		Pro	88.8%	84.1%	-
Twitter	Rater 1	Hesitant	-	83.5%	85.3%
		Pro	-	85.2%	83.5%
	Rater 2	Hesitant	94.6%	-	89.7%
		Pro	94.5%	-	87.2%
	Rater 3	Hesitant	86.4%	80.3%	-
		Pro	86.9%	81.7%	-