Figure 2.

Comparison of SAEDR scores and crowdworker severity estimates. (A) Histogram of SAEDR scores for 12,198 adverse drug reactions (ADRs). (B) Crowdworker severity estimates (x-axis) versus SAEDR scores (y-axis) for a test set of 591 ADRs. The SAEDR scores showed a strong Spearman correlation, ρ=0.735, with the human crowdworker rankings. We noted that this correlation is greater than the interrater correlation, ρ=0.71, reported in the original crowdsource study by Gottlieb et al [8]. A select set of the least and most severe ADRs based on the SAEDR score has been annotated. (C) Differences between severity estimates seeded with FAERS rankings and those seeded with crowdworker rankings (x-axis) for different System Organ Class groups (y-axis). The dashed blue line indicates where the severity would be the same for both estimates. FAERS: Food and Drug Administration Adverse Event Reporting System; SAEDR: Severity of Adverse Events Derived from Reddit.