Abstract
Introduction
Our objective was to describe and compare self-reported side effects of COVID-19 vaccines in the USA.
Methods
A web-based registry enrolled volunteers who received a COVID-19 vaccine between March 19–July 15, 2021. We collected self-reported short-term side effects, medical consultation, hospitalization, and quality of life impact following completed vaccination regimens (Pfizer, Moderna, J&J).
Results
We recruited 6,966 volunteers who completed their full course of vaccination (median age 48 years, IQR 35.0–62.0; 83.6% female): Pfizer 3,486; Moderna 2,857; J&J 623. Few (3.1%) sought medical care for post-vaccination side effects. Hospitalization (n = 17; 0.3%) and severe allergic reactions (n = 39; 0.6%) also were rare. Those with autoimmune disease or lung disease were approximately twice as likely to seek medical care (adjusted odds ratio (aOR) 2.01, 95% CI:1.39; 2.92 and aOR 1.70, 95% CI: 1.12; .58 respectively). 92.4% of participants reported ≥ 1 side effect (median 3), with injection site reactions (78.9%), fatigue (70.3%), headache (49.0%) reported most frequently. More side effects were reported after the second dose of two-dose vaccines (medians: 1 vs. 2 for Pfizer and 1 vs. 3 for Moderna for first and second doses respectively) versus 3 for J&J's single-dose vaccine. For the employed, the median number of workdays missed was one. Diabetics and those vaccinated against influenza were substantially less likely to report 3 or more symptoms (aOR 0.68, 95% CI: 0.56;0.82] and aOR 0.82, 95% CI: 0.73;0.93, respectively).
Discussion
The total side effect burden was, not unexpectedly, greater with two-dose regimens but all three vaccines appear relatively safe. Very few subjects reported side effects serious enough to warrant medical care or reported post-vaccination hospitalization. While these findings do not address possible long-term effects, they do inform on their short-term safety and tolerability and will hopefully provide some reassurance and positively inform the benefit-risk and pharmacoeconomic assessment for all three vaccines.
See Clinicaltrials.gov NCT04368065.
Keywords: COVID-19, COVID-19 vaccines, Vaccine effectiveness, Vaccine side effects, Patient-reported outcomes, Epidemiology
1. Introduction
The United States (U.S.) Food and Drug Administration’s (FDA) regulatory pathway for Emergency Use Authorization (EUA) supports expedited review and authorization of vaccines for health emergencies, but never before have so many vaccines been developed and so quickly. Despite the pandemic proportions of coronavirus disease 2019 (COVID-19) and its heavy toll on society, vaccine hesitancy persists, in part due to concern regarding the speed and safety of the vaccines developed to fight COVID-19 [1]. Additionally, there is little information about how most people react to COVID-19 vaccinations outside of clinical trials, aside from a constant stream of anecdotal evidence. Reliable population-based scientific evidence may help address concerns by providing granularity on the number, type and severity of side effects and the clinical characteristics of those most impacted.
The objective of this work is to describe and compare self-reported side effects from the three COVID-19 vaccines authorized for use in the U.S. between March 19–July 15, 2021: two two-dose mRNA vaccines, Pfizer, Inc. and BioNTech (Pfizer) and Moderna, Inc. (Moderna), and a single-dose viral vector vaccine, Janssen Pharmaceuticals Companies of Johnson & Johnson (J&J) [2], [3], [4]. In addition, we characterize the side effects in terms of their impact on work and life and identify medical and other health-related practices that affect the risk of an acute side effect, such as having been vaccinated for influenza.
2. Materials and methods
We used a web-based registry — the COVID-19 Active Registry Experience (CARE) — to study self-reported COVID-19 vaccination and subsequent side effects. The registry was first launched on April 2, 2020 to study COVID-19 symptoms and severity outside of the hospital setting with the goal of understanding what factors, if any, could mitigate the impact of infection with COVID-19 (http://www.helpstopCOVID19.com), and then was updated in March 2021 to include information on vaccination, regardless of whether participants had ever contracted COVID-19 [5].
Here we examined CARE participants who reported having received a complete course of COVID-19 vaccination between March 19–July 15, 2021, either both doses of the Pfizer or Moderna vaccines or a single dose of the J&J vaccine. Participants were recruited via social media targeting adult U.S. residents who received a COVID-19 vaccine. Volunteers provided on-line informed consent. The enrollment and follow-up CARE surveys requested information on demographics, medical history, COVID-19-like symptoms [6] and severity, COVID-19 test results, COVID-19 vaccination, and use of prescription and non-prescription medications and dietary supplements. Those who reported having been vaccinated are also asked to provide the date of vaccination for first and second doses, as appropriate, manufacturer, and lot number, if known; participants were instructed to refer to their vaccination card to enhance data accuracy. Respondents are asked about side effects after each vaccination using a drop-down menu of choices along with a free text field where additional information can be provided. We also asked whether the COVID-19 vaccination affected their ability to perform activities of daily living such as bathing or dressing, whether they worked less or missed work due to the vaccine, and if they sought health care or were hospitalized due to these side effects. Missing data were not imputed.
We report individual side effects and the total number of side effects by manufacturer and first or second dose, as appropriate. For the two-dose vaccines, we also counted all side effects reported at either the first and/or second dose. Side effects that were not listed on the survey but were entered as free text were reviewed. The most frequent free text entries that used related terms (e.g., extreme chills, chills, severe chill) were collapsed and categorized into a new side effect (e.g., chills); we included these in the summation of total side effects. We used logistic regression to estimate the adjusted odds ratios of self-reported vaccine side effects (injection site reactions, fatigue, swollen lymph nodes, headache, new or worsening join pain, new or worsening muscle pain, fever, nausea or vomiting, or chills) by vaccine manufacturer, controlled for potential confounders. Due to small sample size in some potential confounder categories, we combined categories for the logistic regression model. Multivariable models were adjusted by: age (categorical), gender (female vs. nonfemale [including male, transgender, not disclosed, other]), education (high school or less, some college, 4-year college degree, >4 year college degree), race (White, Black or African American, other), ethnicity of Hispanic or Latino (yes, no), body mass index (BMI) (underweight or normal weight, overweight, obese, severe obesity), smoker (yes, no), medical conditions including anxiety, autoimmune disease, blood disorder, cardiovascular disease, depression, diabetes, hypertension, insomnia or trouble sleeping, kidney disease, lung disease, and influenza vaccination (yes, no). In addition, we ran four separate logistic regression models to understand the association of vaccine manufacturer on burden of side effects and self-care. The four models include binary dependent variables of (1) 3 or more side effects, (2) sought medical care for any side effects, (3) trouble with self-care due to side effects, and (4) worked less due to side effects, also controlled for the above listed potential confounders.
3. Results
3.1. Participant characteristics
COVID-19 vaccination was reported by 6,966 volunteers, including 3,486 who received both doses of the Pfizer vaccine, 2,857 who received both doses of the Moderna vaccine, and 623 who received the single-dose J&J vaccine (Table 1 ). Most CARE participants described themselves as White (90.8%), with additional representation from Asians (1.6%), Black or African American (1.3%) and a small group of people who reported a combination of races (3.6%). Approximately 80% of participants were female, a balance that was consistent across all vaccine manufacturers (range: 80.9–84.1%). A substantial proportion of COVID-19 vaccine recipients reported having various medical conditions at baseline, including anxiety (39.3%), depression (32.4%) and/or insomnia or trouble sleeping (30.7%), and only a small proportion of participants reported being treated for cancer (1.1%), a balance that was generally consistent for these conditions across all vaccines.
Table 1.
All Participants N = 6966 |
Pfizer N = 3486 |
Moderna N = 2857 |
J&J N = 623 |
|
---|---|---|---|---|
Age in years (N) | 6966 | 3486 | 2857 | 623 |
Mean (SD) | 48.3 (15.64) | 47.0 (15.62) | 50.1 (15.69) | 47.1 (14.78) |
Median [IQR] | 48 [35.0,62.0] | 45 [34.0,61.0] | 51 [36.0,64.0] | 48 [35.0,60.0] |
Missing | 0 | 0 | 0 | 0 |
Age Group (years) | 6966 | 3486 | 2857 | 623 |
18–29 | 781 (11.2) | 433 (12.4) | 260 (9.1) | 88 (14.1) |
30–39 | 1768 (25.4) | 966 (27.7) | 678 (23.7) | 124 (19.9) |
40–49 | 1067 (15.3) | 551 (15.8) | 402 (14.1) | 114 (18.3) |
50–59 | 1241 (17.8) | 581 (16.7) | 519 (18.2) | 141 (22.6) |
>=60 | 2109 (30.3) | 955 (27.4) | 998 (34.9) | 156 (25.0) |
Missing | 0 | 0 | 0 | 0 |
Gender | 6966 | 3486 | 2857 | 623 |
Female | 5821 (83.6) | 2913 (83.6) | 2404 (84.1) | 504 (80.9) |
Male | 971 (13.9) | 483 (13.9) | 392 (13.7) | 96 (15.4) |
Transgender | 72 (1.0) | 33 (0.9) | 27 (0.9) | 12 (1.9) |
Other | 82 (1.2) | 47 (1.3) | 27 (0.9) | 8 (1.3) |
Not Disclosed | 20 (0.3) | 10 (0.3) | 7 (0.2) | 3 (0.5) |
Missing | 0 | 0 | 0 | 0 |
Pregnant | 5821 | 2913 | 2404 | 504 |
Yes | 1121 (19.3) | 662 (22.7) | 398 (16.6) | 61 (12.1) |
Missing | 0 | 0 | 0 | 0 |
Education | 6949 | 3477 | 2850 | 622 |
High school or less | 624 (9.0) | 296 (8.5) | 248 (8.7) | 80 (12.9) |
Some college | 2056 (29.6) | 973 (28.0) | 855 (30.0) | 228 (36.7) |
4-yr college degree | 1813 (26.1) | 959 (27.6) | 701 (24.6) | 153 (24.6) |
>4yr college degree | 2456 (35.3) | 1249 (35.9) | 1046 (36.7) | 161 (25.9) |
Missing | 17 | 9 | 7 | 1 |
Race | 6957 | 3481 | 2856 | 620 |
Black or African American | 88 (1.3) | 52 (1.5) | 31 (1.1) | 5 (0.8) |
White | 6320 (90.8) | 3140 (90.2) | 2614 (91.5) | 566 (91.3) |
Other* | 549 (7.9) | 289 (8.3) | 211 (7.4) | 49 (7.9) |
Missing | 9 | 5 | 1 | 3 |
Ethnicity | 6949 | 3474 | 2853 | 622 |
Hispanic or Latino | 392 (5.6) | 203 (5.8) | 157 (5.5) | 32 (5.1) |
Missing | 17 | 12 | 4 | 1 |
BMI | 6626 | 3319 | 2719 | 588 |
Underweight or Normal weight (15.0 - <25.0) | 1778 (26.8) | 922 (27.8) | 703 (25.9) | 153 (26.0) |
Overweight (25.0- <30.0) | 1857 (28.0) | 913 (27.5) | 787 (28.9) | 157 (26.7) |
Obese (30.0 - ≤ 40.0) | 2215 (33.4) | 1113 (33.5) | 913 (33.6) | 189 (32.1) |
Severe Obesity (>40.0) | 776 (11.7) | 371 (11.2) | 316 (11.6) | 89 (15.1) |
Missing | 340 | 167 | 138 | 35 |
Smoker | 6484 | 3256 | 2647 | 581 |
Yes | 611 (9.4) | 275 (8.4) | 257 (9.7) | 79 (13.6) |
Missing | 482 | 230 | 210 | 42 |
Vaccinated for Influenza | 6677 | 3343 | 2738 | 596 |
Yes | 4974 (74.5) | 2514 (75.2) | 2111 (77.1) | 349 (58.6) |
Missing | 289 | 143 | 119 | 27 |
Medical Conditions | 6755 | 3383 | 2768 | 604 |
Anxiety | 2656 (39.3) | 1348 (39.8) | 1062 (38.4) | 246 (40.7) |
Autoimmune disease | 843 (12.5) | 406 (12.0) | 359 (13.0) | 78 (12.9) |
Blood disorder | 173 (2.6) | 87 (2.6) | 75 (2.7) | 11 (1.8) |
Cardiovascular disease | 407 (6.0) | 175 (5.2) | 186 (6.7) | 46 (7.6) |
Depression | 2190 (32.4) | 1103 (32.6) | 891 (32.2) | 196 (32.5) |
Diabetes | 678 (10.0) | 319 (9.4) | 304 (11.0) | 55 (9.1) |
Hypertension | 1583 (23.4) | 733 (21.7) | 715 (25.8) | 135 (22.4) |
Insomnia or trouble sleeping | 2074 (30.7) | 1039 (30.7) | 853 (30.8) | 182 (30.1) |
Kidney disease | 233 (3.4) | 113 (3.3) | 96 (3.5) | 24 (4.0) |
Lung disease | 671 (9.9) | 307 (9.1) | 301 (10.9) | 63 (10.4) |
Organ transplant | 18 (0.3) | 12 (0.4) | 6 (0.2) | 0 |
Missing | 211 | 103 | 89 | 19 |
On Treatment for Cancer? | 6745 | 3377 | 2764 | 604 |
Yes | 76 (1.1) | 44 (1.3) | 25 (0.9) | 7 (1.2) |
Missing | 221 | 109 | 93 | 19 |
Sub-study incentive received** | 6966 | 3486 | 2857 | 623 |
Yes | 110 (1.6) | 53 (1.5) | 37 (1.3) | 20 (3.2) |
Missing | 0 | 0 | 0 | 0 |
The race category of other includes: 24 American Indians, 112 Asians, 4 Hawaiian or Pacific Islander, 249 who selected multiple races and 160 who selected 'other'.
110 enrolled in a sub-study that required additional data collection. These participants were compensated for their time participating in the sub-study.
There were small differences in age across vaccine manufacturers. Pfizer recipients were slightly younger, median age of 45 years old compared to 51 years old for Moderna and 48 years old for J&J. Participants vaccinated with J&J included a higher percentage of smokers (13.6%) than those vaccinated with Moderna (9.7%) or Pfizer (8.4%). Participants who received Pfizer or Moderna vaccines had a higher education level, with many having completed a 4-year college degree and most having completed additional education after the college degree (63.5% and 61.3% respectively), compared to recipients of the J&J vaccine (50.5%). Other demographics and medical characteristics appeared to be comparable across the three vaccine manufacturers.
3.2. Vaccine side effects
Most COVID-19 vaccine recipients (92.4%) reported having at least one side effect at the first or second dose (80.9% to 95.4% across manufacturers), with a median of 3 side effects, ranging from a median of 3 to 4 across vaccine manufacturers (Table 2 ). However, only 3.1% reported seeking medical care for their post vaccination side effects, 4.3% for J&J vaccine recipients followed by Moderna (3.3%) and Pfizer (2.8%). Very few participants reported being hospitalized after vaccination (n = 17; 0.3% overall) or had severe allergic reactions (0.6%, such as swelling of lips or tongue, shortness of breath, severe hives . Severe allergic reactions differed slightly by vaccine, with more reported for recipients of J&J (1.3%) compared to 0.6% for Moderna and 0.4% for Pfizer.
Table 2.
All Participants N = 6966 |
Pfizer N = 3486 |
Moderna N = 2857 |
J&J N = 623 |
|
---|---|---|---|---|
Side Effects (n) | 6966 | 3486 | 2857 | 623 |
Fever | 2084 (29.9) | 770 (22.1) | 1119 (39.2) | 195 (31.3) |
Swollen lymph nodes | 788 (11.3) | 392 (11.2) | 353 (12.4) | 43 (6.9) |
Diarrhea | 69 (1.0) | 37 (1.1) | 27 (0.9) | 5 (0.8) |
Nausea or vomiting | 1099 (15.8) | 466 (13.4) | 525 (18.4) | 108 (17.3) |
Chills | 285 (4.1) | 101 (2.9) | 150 (5.3) | 34 (5.5) |
Injection site reactions | 5493 (78.9) | 2695 (77.3) | 2468 (86.4) | 330 (53.0) |
Severe allergic reactions | 39 (0.6) | 14 (0.4) | 17 (0.6) | 8 (1.3) |
Fatigue | 4897 (70.3) | 2312 (66.3) | 2222 (77.8) | 363 (58.3) |
New or worsening joint pain | 1505 (21.6) | 614 (17.6) | 767 (26.8) | 124 (19.9) |
New or worsening muscle pain | 2113 (30.3) | 894 (25.6) | 1043 (36.5) | 176 (28.3) |
Headache | 3416 (49.0) | 1538 (44.1) | 1595 (55.8) | 283 (45.4) |
Dizziness | 81 (1.2) | 39 (1.1) | 35 (1.2) | 7 (1.1) |
Missing | 0 | 0 | 0 | 0 |
No. of Side Effects (n) | 6966 | 3486 | 2857 | 623 |
Mean (SD) | 3.1 (2.00) | 2.8 (1.91) | 3.6 (2.00) | 2.7 (2.09) |
Median [IQR] | 3 [2.0,5.0] | 3 [1.0,4.0] | 4 [2.0,5.0] | 3 [1.0,4.0] |
Min - Max | (0–9) | (0–9) | (0–9) | (0–8) |
0 side-effects | 529 (7.6) | 279 (8.0) | 131 (4.6) | 119 (19.1) |
1 to 2 side-effects | 2419 (34.7) | 1443 (41.4) | 789 (27.6) | 187 (30.0) |
3 or more side-effects | 4018 (57.7) | 1764 (50.6) | 1937 (67.8) | 317 (50.9) |
Missing | 0 | 0 | 0 | 0 |
Sought medical care for any side effects(n) | 6473 | 3222 | 2737 | 514 |
Yes | 201 (3.1) | 90 (2.8) | 89 (3.3) | 22 (4.3) |
Missing | 493 | 264 | 120 | 109 |
Hospitalized post-vaccination(n) | 6473 | 3222 | 2737 | 514 |
Yes | 17 (0.3) | 10 (0.3) | 4 (0.1) | 3 (0.6) |
Missing | 493 | 264 | 120 | 109 |
Trouble with self-care due to side effects (Yes/No) (n) | 6473 | 3222 | 2737 | 514 |
Yes | 2030 (31.4) | 853 (26.5) | 1037 (37.9) | 140 (27.2) |
Missing | 493 | 264 | 120 | 109 |
Trouble with s self-care due to side effects (Categorical) (n) | 6473 | 3222 | 2737 | 514 |
Not at all | 4443 (68.6) | 2369 (73.5) | 1700 (62.1) | 374 (72.8) |
A little | 1166 (18.0) | 509 (15.8) | 562 (20.5) | 95 (18.5) |
Somewhat | 478 (7.4) | 200 (6.2) | 251 (9.2) | 27 (5.3) |
A lot | 386 (6.0) | 144 (4.5) | 224 (8.2) | 18 (3.5) |
Missing | 493 | 264 | 120 | 109 |
Worked less due to side effects(n) | 4648 | 2380 | 1910 | 358 |
Yes | 1646 (35.4) | 721 (30.3) | 813 (42.6) | 112 (31.3) |
Missing | 2318 | 1106 | 947 | 265 |
Note: For two-dose vaccine series, data include side effects reported after either first or booster dose. For those who report missing work due to side effects, it is unknown whether time off from work was sanctioned by their employer to facilitate getting vaccinated.
The most frequently reported side effects were injection site reactions (78.9%) and fatigue (70.3%) followed by headache (49.0%). Injection site reactions were reported most often for Moderna vaccine recipients (86.4%), followed by Pfizer (77.3%) and J&J (53.0%). Similarly, fatigue was also reported more frequently by recipients of Moderna (77.8%) than Pfizer (66.3%) or J&J (58.3%) as was headache (55.8% for Moderna compared to 45.4% for J&J and 44.1% for Pfizer). Other frequently reported reactions included muscle pain (30.3%), fever (29.9%) and joint pain (21.6%). Some differences were noted in the reporting of muscle pain and fever by vaccine manufacturer, with these events reported most frequently by those who received a Moderna vaccine (36.5% and 39.2%, respectively), followed by J&J (28.3%, 31.3%) and Pfizer (25.6%, 22.1%). Joint pain was also more frequently reported by Moderna vaccine recipients (26.8%) compared to J&J (19.9%) and Pfizer (17.6%).
Those who received a two-dose regimen (mRNA vaccines) reported more side effects at the second dose (Pfizer: 2 and Moderna: 3) than the first (Pfizer: 1 and Moderna: 1), with the median of 3 side effects for the single-dose J&J vaccine more like the second doses of the mRNA vaccines than the first doses of those vaccines (Table 3 ). Similarly, difficulty with self-care was reported more frequently after the second dose than the first dose for the mRNA vaccines (36.0% and 25.8% for the second doses of Moderna and Pfizer, respectively) than their first doses (17.0% and 11.7% for Moderna and Pfizer, respectively). Of those receiving the J&J vaccine, 27.2% reported trouble with self-care after the single dose. Overall few people sought medical care (3.1%) or were hospitalized (0.3%) after vaccination, with negligible differences between the first and second dose.
Table 3.
First dose |
Second Dose |
J&J N = 623 |
|||
---|---|---|---|---|---|
Pfizer N = 3486 |
Moderna N = 2857 |
Pfizer N = 3486 |
Moderna N = 2857 |
||
Side Effects(n) | 3486 | 2857 | 3486 | 2857 | 623 |
Fever | 211 (6.1) | 280 (9.8) | 688 (19.7) | 1027 (35.9) | 195 (31.3) |
Swollen lymph nodes | 160 (4.6) | 160 (5.6) | 332 (9.5) | 286 (10.0) | 43 (6.9) |
Diarrhea | 17 (0.5) | 5 (0.2) | 20 (0.6) | 22 (0.8) | 5 (0.8) |
Nausea or vomiting | 158 (4.5) | 167 (5.8) | 369 (10.6) | 449 (15.7) | 108 (17.3) |
Chills | 20 (0.6) | 16 (0.6) | 81 (2.3) | 134 (4.7) | 34 (5.5) |
Injection site reactions | 2418 (69.4) | 2245 (78.6) | 2289 (65.7) | 2180 (76.3) | 330 (53.0) |
Severe allergic reactions | 5 (0.1) | 5 (0.2) | 13 (0.4) | 14 (0.5) | 8 (1.3) |
Fatigue | 1309 (37.6) | 1194 (41.8) | 2051 (58.8) | 2060 (72.1) | 363 (58.3) |
New or worsening joint pain | 219 (6.3) | 277 (9.7) | 532 (15.3) | 661 (23.1) | 124 (19.9) |
New or worsening muscle pain | 333 (9.6) | 376 (13.2) | 756 (21.7) | 912 (31.9) | 176 (28.3) |
Headache | 788 (22.6) | 751 (26.3) | 1278 (36.7) | 1407 (49.2) | 283 (45.4) |
Dizziness | 13 (0.4) | 11 (0.4) | 26 (0.7) | 24 (0.8) | 7 (1.1) |
Missing | 0 | 0 | 0 | 0 | 0 |
No. of Side Effects (n) | 3486 | 2857 | 3486 | 2857 | 623 |
Mean (SD) | 1.6 (1.39) | 1.9 (1.56) | 2.4 (1.92) | 3.2 (2.04) | 2.7 (2.09) |
Median [IQR] | 1 [1.0,2.0] | 1 [1.0,3.0] | 2 [1.0,4.0] | 3 [2.0,5.0] | 3 [1.0,4.0] |
Min - Max | (0–9) | (0–8) | (0–9) | (0–9) | (0–8) |
0 side-effects | 633 (18.2) | 350 (12.3) | 538 (15.4) | 240 (8.4) | 119 (19.1) |
1 to 2 side-effects | 2120 (60.8) | 1725 (60.4) | 1489 (42.7) | 911 (31.9) | 187 (30.0) |
More than 3 side-effects | 733 (21.0) | 782 (27.4) | 1459 (41.9) | 1706 (59.7) | 317 (50.9) |
Missing | 0 | 0 | 0 | 0 | 0 |
Sought Medical care for any side effects(n) | 2884 | 2525 | 2964 | 2622 | 514 |
Yes | 41 (1.4) | 45 (1.8) | 68 (2.3) | 50 (1.9) | 22 (4.3) |
Missing | 602 | 332 | 522 | 235 | 109 |
Hospitalized post-vaccination(n) | 2884 | 2525 | 2964 | 2622 | 514 |
Yes | 6 (0.2) | 1 (0.0) | 9 (0.3) | 3 (0.1) | 3 (0.6) |
Missing | 602 | 332 | 522 | 235 | 109 |
Trouble with self-care due to side effects (Yes/No) (n) | 2884 | 2525 | 2964 | 2622 | 514 |
Yes | 337 (11.7) | 430 (17.0) | 764 (25.8) | 943 (36.0) | 140 (27.2) |
Missing | 602 | 332 | 522 | 235 | 109 |
Trouble with self-care due to side effects (Categorical) (n) | 2884 | 2525 | 2964 | 2622 | 514 |
Not at all | 2547 (88.3) | 2095 (83.0) | 2200 (74.2) | 1679 (64.0) | 374 (72.8) |
A little | 260 (9.0) | 306 (12.1) | 453 (15.3) | 520 (19.8) | 95 (18.5) |
Somewhat | 54 (1.9) | 80 (3.2) | 181 (6.1) | 220 (8.4) | 27 (5.3) |
A lot | 23 (0.8) | 44 (1.7) | 130 (4.4) | 203 (7.7) | 18 (3.5) |
Missing | 602 | 332 | 522 | 235 | 109 |
Missed work or worked less due to side effects(n) | 2141 | 1781 | 2147 | 1764 | 358 |
Yes | 239 (11.2) | 229 (12.9) | 628 (29.3) | 743 (42.1) | 112 (31.3) |
Missing | 1345 | 1076 | 1339 | 1093 | 265 |
Days worked less (n) | 180 | 162 | 443 | 504 | 79 |
Mean (SD) | 2.3 (3.76) | 2.5 (5.24) | 2.4 (6.48) | 1.8 (2.99) | 2.3 (2.88) |
Median (IQR) | 1 [1.0,2.0] | 1 [1.0,2.0] | 1 [1.0,2.0] | 1 [1.0,2.0] | 1 [1.0,3.0] |
Min-Max | (1–35) | (1–60) | (1–90) | (1–60) | (1–21) |
1 day | 105 (3.0) | 82 (2.9) | 277 (7.9) | 328 (11.5) | 43 (6.9) |
2 days | 37 (1.1) | 47 (1.6) | 102 (2.9) | 103 (3.6) | 16 (2.6) |
3 or more days | 38 (1.1) | 33 (1.2) | 64 (1.8) | 73 (2.6) | 20 (3.2) |
Missing | 3306 | 2695 | 3043 | 2353 | 544 |
Days missed work (n) | 165 | 176 | 478 | 592 | 99 |
Mean (SD) | 1.9 (2.97) | 2.3 (5.25) | 1.9 (5.52) | 1.6 (2.63) | 1.7 (1.92) |
Median (IQR) | 1 [1.0,2.0] | 1 [1.0,2.0] | 1 [1.0,2.0] | 1 [1.0,2.0] | 1 [1.0,2.0] |
Min-Max | (1–34) | (1–60) | (1–100) | (1–60) | (1–16) |
1 day | 109 (3.1) | 104 (3.6) | 331 (9.5) | 425 (14.9) | 66 (10.6) |
2 days | 34 (1.0) | 48 (1.7) | 101 (2.9) | 117 (4.1) | 21 (3.4) |
3 or more days | 22 (0.6) | 24 (0.8) | 46 (1.3) | 50 (1.8) | 12 (1.9) |
Missing | 3321 | 2681 | 3008 | 2265 | 524 |
Fig. 1 shows the odds of specific side effects for each mRNA vaccine (experienced at either first or second dose) compared to the J&J vaccine. After adjustment for potential confounding factors, injection site reactions, swollen lymph nodes, and fatigue were more likely to be reported with the two mRNA vaccines. Specifically, injection site reactions (pain, redness, or swelling at the vaccine injection site) were more likely to be reported by recipients of Pfizer and Moderna compared to J&J (Pfizer: aOR 3.13, 95% CI: 2.58;3.81; Moderna: aOR 6.60, 95% CI: 5.33;8.18), as were swollen lymph nodes (Pfizer: aOR 1.69, 95% CI: 1.20;2.38; Moderna: aOR 1.97, 95% CI: 1.40;2.77), and fatigue (Moderna: aOR 1.43 95% CI: 1.18;1.74; Pfizer: aOR 2.93, 95% CI: 2.39;3.59). Looking at side effects collectively, those who received the Moderna vaccine were more likely to report having 3 or more side effects (aOR 2.48, 95% CI: 2.03;3.02) compared to the J&J vaccine (Table 4 ).
Table 4.
3 or more side effects | Sought medical care for any side effects | Trouble with self care due to side effects | Worked less due to side effects | ||
---|---|---|---|---|---|
Covariate/factors | Category | aOR(95% CI) N = 6266 |
aOR(95% CI) N = 5864 |
aOR(95% CI) N = 5864 |
aOR(95% CI) N = 4247 |
Vaccine* | J&J | Ref | Ref | Ref | Ref |
Pfizer | 1.02(0.85;1.24) | 0.68(0.40;1.14) | 1.08(0.86;1.36) | 0.98(0.76;1.27) | |
Moderna | 2.48(2.03;3.02) | 0.84(0.50;1.41) | 2.22(1.75;2.80) | 1.76(1.36;2.29) | |
Age | 18–29 years | 3.65(2.95;4.51) | 1.62(0.93;2.82) | 4.80(3.84;6.01) | 1.89(1.45;2.45) |
30–39 years | 2.30(1.96;2.70) | 1.32(0.82;2.12) | 3.24(2.69;3.91) | 1.68(1.34;2.10) | |
40–49 years | 2.59(2.17;3.08) | 1.42(0.87;2.30) | 2.48(2.03;3.02) | 1.70(1.34;2.14) | |
50–59 years | 1.83(1.56;2.16) | 0.88(0.53;1.48) | 1.57(1.28;1.91) | 1.53(1.21;1.93) | |
>=60 years | Ref | Ref | Ref | Ref | |
Gender | Non-female** | Ref | Ref | Ref | Ref |
Female | 1.41(1.22;1.63) | 1.68(1.00;2.82) | 1.28(1.07;1.52) | 1.06(0.88;1.28) | |
Education | High school or less | Ref | Ref | Ref | Ref |
Some college | 0.99(0.80;1.22) | 0.99(0.57;1.72) | 1.04(0.83;1.31) | 1.18(0.88;1.57) | |
4-yr college degree | 1.00(0.81;1.24) | 0.95(0.53;1.72) | 1.00(0.79;1.28) | 1.14(0.85;1.53) | |
>4yr college degree | 1.16(0.94;1.44) | 0.94(0.52;1.68) | 1.02(0.81;1.30) | 1.23(0.92;1.64) | |
Race | White | Ref | Ref | Ref | Ref |
Black or African American | 0.50(0.31;0.81) | 2.23(0.79;6.26) | 0.87(0.50;1.53) | 0.77(0.41;1.45) | |
Other | 1.02(0.83;1.26) | 1.21(0.72;2.05) | 1.21(0.97;1.49) | 1.12(0.88;1.42) | |
Ethnicity: Hispanic or Latino | no | Ref | Ref | Ref | Ref |
yes | 0.87(0.69;1.11) | 1.27(0.70;2.29) | 0.86(0.66;1.10) | 0.97(0.73;1.30) | |
BMI | Underweight or Normal weight (15.0 - <25.0) | Ref | Ref | Ref | Ref |
Overweight (25.0 - <30.0) | 0.83(0.72;0.96) | 1.03(0.69;1.53) | 0.84(0.72;0.98) | 0.88(0.74;1.05) | |
Obese (30.0 - ≤ 40.0) | 0.94(0.82;1.09) | 0.79(0.53;1.20) | 0.74(0.63;0.86) | 0.84(0.71;1.00) | |
Severe Obesity (>40.0) | 0.93(0.76;1.13) | 0.89(0.52;1.53) | 0.76(0.61;0.94) | 0.83(0.65;1.06) | |
Smoker | no | Ref | Ref | Ref | Ref |
yes | 0.87(0.72;1.06) | 1.57(0.99;2.47) | 0.92(0.75;1.14) | 0.94(0.73;1.21) | |
Anxiety | no | Ref | Ref | Ref | Ref |
yes | 1.33(1.17;1.52) | 1.38(0.96;1.98) | 1.35(1.18;1.56) | 1.34(1.15;1.57) | |
Autoimmune disease | no | Ref | Ref | Ref | Ref |
yes | 1.14(0.97;1.35) | 2.01(1.38;2.92) | 1.21(1.01;1.45) | 1.06(0.85;1.32) | |
Blood disorder | no | Ref | Ref | Ref | Ref |
yes | 0.83(0.59;1.16) | 0.71(0.26;1.99) | 0.94(0.65;1.36) | 1.18(0.78;1.79) | |
Cardiovascular disease | no | Ref | Ref | Ref | Ref |
yes | 0.94(0.74;1.19) | 1.31(0.71;2.41) | 0.98(0.74;1.30) | 0.85(0.59;1.24) | |
Depression | no | Ref | Ref | Ref | Ref |
yes | 1.02(0.89;1.17) | 0.91(0.62;1.31) | 1.20(1.04;1.39) | 1.16(0.98;1.36) | |
Diabetes | no | Ref | Ref | Ref | Ref |
yes | 0.68(0.56;0.82) | 0.99(0.57;1.71) | 0.87(0.69;1.09) | 0.74(0.55;0.98) | |
Hypertension | no | Ref | Ref | Ref | Ref |
yes | 1.05(0.91;1.21) | 1.07(0.71;1.61) | 0.98(0.83;1.16) | 1.06(0.87;1.28) | |
Insomnia or trouble sleeping | no | Ref | Ref | Ref | Ref |
yes | 1.44(1.27;1.63) | 1.28(0.92;1.78) | 1.53(1.34;1.75) | 1.37(1.18;1.59) | |
Kidney disease | no | Ref | Ref | Ref | Ref |
yes | 1.25(0.92;1.68) | 1.15(0.56;2.38) | 1.42(1.03;1.96) | 1.23(0.81;1.87) | |
Lung disease | no | Ref | Ref | Ref | Ref |
yes | 1.35(1.11;1.63) | 1.70(1.12;2.58) | 1.35(1.11;1.64) | 1.12(0.88;1.42) | |
Received Influenza vaccine | no | Ref | Ref | Ref | Ref |
yes | 0.82(0.73;0.93) | 1.19(0.83;1.69) | 0.82(0.72;0.94) | 1.04(0.90;1.21) |
Note: The four models have different Ns due to missing values across the outcomes as well as the potential confounders.
Side effects reported at first and/or second dose for Pfizer and Moderna for recipients who completed the full vaccination series.
Non-female: male, transgender, not disclosed, other.
Nearly one-third (31.4%) of COVID-19 vaccine recipients reported having trouble taking care of themselves (e.g., with activities such as bathing and dressing) due to vaccination side effects, though only 6.0% described themselves as having had “a lot of trouble” (Table 3). The second dose of both mRNA vaccines (Pfizer: 25.8% and Moderna: 36.0%) were associated with greater trouble with self-care than the first doses (Pfizer: 11.7% and Moderna: 17.0%) compared with 27.2% for J&J. Those who received the Moderna vaccine were more than twice as likely to report having trouble caring for themselves (aOR 2.22, 95% CI: 1.75;2.80) compared to the J&J vaccines whereas there was essentially no difference between Pfizer and J&J vaccines (aOR 1.08, 95% CI: 0.86;1.36) (Table 4).
Among those employed 35.4% reported working less after being vaccinated, with a higher proportion of people missing work who received the Moderna vaccine (42.6%) than those who received either the J&J (31.3%) or Pfizer vaccines (30.3%). Of those employed, the median days missed from work was one for all vaccines.
In general, females reported experiencing more side effects and more trouble with self-care than men and others who described themselves as transgender or preferred not to disclose their gender (aOR 1.41, 95% CI: 1.22;1.63), though they did not report working any less. Younger people were more likely to report 3 or more side effects and to report problems caring for themselves than older people, with those ages 18–29 more than three times as likely to report 3 or more side effects (aOR 3.65, 95% CI: 2.95;4.51) and nearly five times as likely to report having trouble with self-care (aOR 4.80, 95% CI: 3.84;6.01). Black or African American participants were less likely to report 3 or more symptoms (aOR 0.50, 95% CI: 0.31, 0.81). For people reporting a high BMI (≥30), there was little difference in the proportion of participants reporting 3 or more symptoms, seeking medical consultation or working less than those who had lower BMI.
For self-reported medical conditions, those with autoimmune disorders (12.5%) were more likely to report trouble with self-care (34.8% vs 30.9%, aOR 1.21, 95% CI: 1.01;1.45) and to have sought medical care more often for side effects (5.8% vs. 2.7%, aOR 2.01, 95% CI: 1.38;2.92) than those without autoimmune disorders. Those who reported having insomnia (30.7%) or lung disease (9.9%) also were more likely to report 3 or more side effects (63.6% vs. 55.3%, aOR 1.44, 95% CI: 1.27;1.63 for insomnia, and 62.9% vs. 57%, aOR 1.35, 95% CI: 1.11;1.63 for lung disease) and report having more trouble caring for themselves (37.3% vs 28.8%, aOR 1.53, 95% CI: 1.34;1.75 for insomniacs, and 36.2% vs. 30.9%, aOR 1.35, 95% CI: 1.11;1.64 for those with lung disease) than those without insomnia or lung disease, respectively. In contrast, those with diabetes (10%) were less likely to report having 3 or more symptoms (46.3% vs. 59.1%, aOR 0.68, 95% CI: 0.56;0.82) than those without diabetes.
Those who reported having been vaccinated for influenza (74.5%) were less likely to report 3 or more symptoms (56.7% vs. 61.6%, aOR 0.82, 95% CI: 0.73;0.93) or to have trouble caring for themselves (29.97% vs 35.8%, aOR 0.82, 95% CI: 0.72;0.94) than those who did not report having been vaccinated for influenza.
4. Discussion
These registry data are consistent with other real-world studies that document few serious side effects from currently authorized COVID-19 vaccines and also support anecdotal reports describing mostly mild side effects with rapid resolution [7], [8], [9]. In this cohort, only 3.1% of vaccine recipients sought medical care for side effects post-vaccination, and almost none (0.3%) were hospitalized. However, 57.7% of CARE participants reported experiencing 3 or more side effects. Roughly one-third (31.4%) of COVID-19 vaccine recipients attributed having some amount of trouble taking care of themselves for the short period immediately after the vaccine due to vaccination side effects and 35.4% of employed participants reported working one day less, due to side effects. The median time lost from work of only one day may reflect employer practices of giving time off from work to encourage vaccination. It seems reasonable to conclude that work time lost from vaccination is far less impactful than work time lost as a consequence of COVID-19 illness.
When comparing the three vaccine manufacturers, Moderna appears to be the most reactogenic overall, with those who received a Moderna vaccine reporting more side effects than those who received Pfizer or J&J vaccines. Second doses of mRNA vaccines were more reactogenic than first doses and these second doses had higher rates of trouble with self-care compared with the first doses of Pfizer and Moderna.
Given the difficulty of comparing two-dose and single-dose regimens to understand side effects, our data enables some degree of comparison between the mRNA and viral vector vaccine classes. When the mean number of side effects per participant is compared, the J&J viral vector vaccine lies somewhere between that observed for the first and second doses of both mRNA vaccines. Thus, per 'shot' one might conclude that there is not a great difference in overall tolerability between the two classes, but that the total side effect burden is greater, as might be expected, with a two-dose regimen. This information may be of interest as vaccine supply and choice increase.
An interesting and biologically curious observation was that CARE participants who reported also having had a vaccination for influenza were less likely to report experiencing 3 or more side effects from COVID-19 vaccination, and had fewer problems taking care of themselves. Although these findings may be associated with health-seeking behavior of influenza vaccine recipients or a greater understanding of common vaccination side effects, there is some evidence that influenza vaccine effectiveness does not vary according to health-seeking behaviour [10], adding credence to the possibility that this may be a true biologic effect.
An increased number of side effects were reported for those with depression, anxiety, insomnia, lung disease, and autoimmune disease. We have previously reported that people with autoimmune disorders appeared to be particularly vulnerable to COVID-19, and their response to COVID-19 vaccination may possibly relate to this susceptibility [11]. In contrast, those with diabetes were less likely than others to report vaccine side effects. The lower reporting rates for diabetics may be influenced by an overlap in potential side effects with their metabolic disorder, or they may have found the vaccine associated side effects rather insignificant as a result. Alternatively, it could be that the progression to severe disease in diabetics has an immunological component that is being reflected in a different immunological reaction to the vaccine, or to the presence of actual virus.
It is important to keep in mind that online registries that survey volunteers without intervention or collaboration from medical care providers rely on the goodwill of participants to contribute information faithfully and accurately, and the results lack clinical or other confirmation. For example, although CARE participants reported their vaccine receipt, including manufacturer and lot number, there was no independent verification of such receipt – a condition that would have been challenging due to the diverse locations used for vaccine administration, the lack of centralized reporting and widespread handwritten vaccine information which would require manual coding. That said, the validity of reports from lay people of medication use has been demonstrated [12], and as such, reporting quality is likely to apply at least as well to vaccine reporting.
Considering the context of this reporting is also important. Although our findings are derived from community volunteers who responded to internet-based advertisements and posts from medical, patient and other community organizations, this study population has broad geographic representation across the U.S., with participants from all 50 states (with most participants from New York and California, followed by Illinois, Ohio, Pennsylvania, Florida and Texas). That said, CARE participants are undoubtedly not representative of the entire US population, including those without internet access or the free time to participate in surveys. CARE participants had a median age of 48 years, which is consistent with research showing a greater degree of altruism in older than younger adults. Moreover, in this registry most participants (80%) were female and 90% of those participants described themselves as Caucasian, a demographic combination known to frequently volunteer [13], and the side effect profile of males and non-Caucasians may differ from Caucasian females.
More side effects may have been reported by CARE participants than others because they self-selected into the registry whereas those with no side effects may have been less motivated to enroll in a study. Alternatively or additionally, the preponderance of female respondents may have biased the tolerability findings, as females are known, in general, to experience more side effects [14], [15] than males while developing higher antibody levels. Considering the high proportion of CARE participants who reported suffering from anxiety (39.3%), these reports also may reflect the experience of people who may be more attuned to how they react to vaccination. Nonetheless, comparisons within the CARE population, such as between vaccine manufacturers and by various medical and other personal characteristics, should be broadly generalizable and not subject to systematic error since it is unlikely that there was differential participation according to vaccine manufacturer or that responses selectively exaggerated reactions to one vaccine over another.
Nonetheless, although nearly 7,000 people reported their vaccination experience through CARE, the sample is too small to support detection of rare events nor to study rare subgroups. For example, we were not able to separately examine vaccine side effects for transgender people and others who did not wish to report their gender or whose gender did not conform to any of the choices presented in this study. Nonetheless, sensitivity analyses of our statistical models revealed little differences when restricted to those who reported their gender either as male or female.
5. Conclusion
On the whole, these community-based insights combined with other information that is accumulating about the effectiveness and safety of COVID-19 vaccines may provide a framework for guiding decision making on vaccine options and addressing vaccine hesitancy, including in particular vulnerable populations, such as diabetics and those with autoimmune disorders. Importantly, these findings provide a patient-centric estimation of vaccine burden by vaccine type and may help inform patients and health care providers about expected side effects and any potential short-term impact on their ability to perform daily activities or work. As CARE registry data continue to accrue, additional analyses may provide insight into real-world effectiveness of COVID-19 vaccines against COVID-19 infection in the context of both presence and severity of break-through infections, as well as more information on how various subgroups of special interest are impacted.
These data may also be useful in the context of current debates about whether COVID-19 vaccination should be made mandatory, at least for certain groups, e.g., healthcare workers and workers in residential care facilities. One of the discussion points in this debate concerns the safety and tolerability of the current COVID-19 vaccines, especially those which have been granted EUA only. While these data currently cannot address the long-term safety and tolerability of these vaccines, vaccines generally display the bulk of their side effects in the very short-term, often a day or less [16], [17]. Our findings inform on the short-term safety and tolerability of these vaccines, and will hopefully provide some reassurance on their adverse effects.
6. Ethics approval
This study was approved by Institutional Review Board and registered at Clinicaltrials.gov NCT04368065 and EU PAS register EUPAS36240. All participants provided informed consent online.
Funding
This work was supported in part by a contract with the US Food and Drug Administration. The bulk of the funding was provided by IQVIA.
Declaration of Competing Interest
The authors declare the following financial interests/personal relationships which may be considered as potential competing interests: IQVIA reports financial support was provided by US Food and Drug Administration.
Acknowledgements
We thank Savitha Pallipuram for leading the tech team, Damir Mohamed for his contributions to the statistical analysis, and Alex Secora for his thoughtful editing contributions.
References
- 1.Bhat A., Browning-McNee L.A., Ghauri K., Winckler S. COVID-19 vaccine confidence project. J Am Pharm Assoc. 2022 doi: 10.1016/j.japh.2021.06.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Centers for Disease Control and Prevention (CDC). Pfizer-BioNTech COVID-19 Vaccine Overview and Safety. https://www.cdc.gov/coronavirus/2019-ncov/vaccines/different-vaccines/Pfizer-BioNTech.html.
- 3.Centers for Disease Control and Prevention (CDC). Moderna COVID-19 Vaccine Overview and Safety. https://www.cdc.gov/coronavirus/2019-ncov/vaccines/different-vaccines/Moderna.html.
- 4.Centers for Disease Control and Prevention (CDC). Johnson & Johnson’s Janssen COVID-19 Vaccine Overview and Safety. https://www.cdc.gov/coronavirus/2019-ncov/vaccines/different-vaccines/janssen.html.
- 5.Dreyer N.A., Reynolds M., Mack C.D., Brinkley E., Petruski-Ivleva N., Hawaldar K., et al. Self-reported symptoms from exposure to Covid-19 provide support to clinical diagnosis, triage and prognosis: An exploratory analysis. Travel Med Infect Dis. 2020;38:101909. doi: 10.1016/j.tmaid.2020.101909. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Symptoms of Coronavirus. Center for Disease Control and Prevention (CDC) [accessed online on January 15, 2021] https://www.cdc.gov/coronavirus/2019-ncov/symptoms-testing/symptoms.html.
- 7.Gee J., Marquez P., Su J., Calvert G.M., Liu R., Myers T., et al. First Month of COVID-19 Vaccine Safety Monitoring - United States, December 14, 2020-January 13, 2021. MMWR Morb Mortal Wkly Rep. 2021;70(8):283–288. doi: 10.15585/mmwr.mm7008e3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Chapin-Bardales J., Gee J., Myers T. Reactogenicity Following Receipt of mRNA-Based COVID-19 Vaccines. JAMA. 2021;325(21):2201–2202. doi: 10.1001/jama.2021.5374. [DOI] [PubMed] [Google Scholar]
- 9.Shay D.K., Gee J., Su J.R., Myers T.R., Marquez P., Liu R., et al. Safety Monitoring of the Janssen (Johnson & Johnson) COVID-19 Vaccine - United States, March-April 2021. MMWR Morbidity Mortality Weekly Report. 2021;70(18):680–684. doi: 10.15585/mmwr.mm7018e2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Jackson M.L., Nelson J.C. The test-negative design for estimating influenza vaccine effectiveness. Vaccine. 2013;31(17):2165–2168. doi: 10.1016/j.vaccine.2013.02.053. [DOI] [PubMed] [Google Scholar]
- 11.Dreyer N., Petruski-Ivleva N., Albert L., Mohamed D., Brinkley E., Reynolds M., et al. Identification of a Vulnerable Group for Post-Acute Sequelae of SARS-CoV-2 (PASC): People with Autoimmune Diseases Recover More Slowly from COVID-19. Int J General Med. 2021;14:3941–3949. doi: 10.2147/IJGM.S313486. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Dreyer N.A., Blackburn S.CF., Mt-Isa S., Richardson J.L., Thomas S., Laursen M., et al. Direct-to-Patient Research: Piloting a New Approach to Understanding Drug Safety During Pregnancy. JMIR Public Health Surveillance. 2015;1(2):e22. doi: 10.2196/publichealth.4939. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Patterson T. Stats reveal how many Americans volunteer and where; 2018. CNN [retrieved December 1, 2021] from https://www.cnn.com/2018/07/19/us/volunteering-statistics-cfc/index.html.
- 14.Fathi A., Addo M.M., Dahlke C. Sex differences in immunity: implications for the development of novel vaccines against emerging pathogens. Front Immunol. 2021;11 doi: 10.3389/fimmu.2020.601170. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Fischinger S., Boudreau C.M., Butler A.L., Streeck H., Alter G. Sex differences in vaccine-induced humoral immunity. Seminars Immunopathol. 2019;41(2):239–249. doi: 10.1007/s00281-018-0726-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Lindsey N.P., Rabe I.B., Miller E.R., Fischer M., Staples J.E. Adverse event reports following yellow fever vaccination, 2007-13. J Travel Med. 2016;23(5) doi: 10.1093/jtm/taw045. [DOI] [PubMed] [Google Scholar]
- 17.Lane J.M., Ruben F.L., Neff J.M., Millar J.D. Complications of smallpox vaccination, 1968. New Engl J Med. 1969;281(22):1201–1208. doi: 10.1056/NEJM196911272812201. [DOI] [PubMed] [Google Scholar]