Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
Agreement of stance classification of social media posts by three human raters and automated algorithm. The columns show the fraction of time each of the individual raters agreed with a machine classification of vaccine hesitant versus pro-vaccination. All four possible categories were included when computing agreement.
| Platform | Machine | Total | Rater 2 | Rater 1 | Rater 3 |
|---|---|---|---|---|---|
| Hesitant | 92 | 67.4% | 60.9% | 69.6% | |
| Pro | 92 | 59.8% | 58.7% | 64.1% | |
|
| |||||
| Hesitant | 250 | 67.2% | 64.4% | 66.4% | |
| Pro | 106 | 72.6% | 72.6% | 71.7% | |
