Abstract
Background
COVID-19 vaccine safety is of major interest worldwide, since there is no prior experience with it. Israel was one of the first countries to widely use the Comirnaty vaccine.
Aim
We aimed to assess the vaccine's short-term side effects directly from a large population and to predict influencing factors for self-reporting side effects.
Methods
In a retrospective cohort study, we investigated self-reported systemic vaccine side-effects using electronic surveys sent to vaccinated individuals between 20 December 2020 and 11 March 2021, within 3 days following administration of the first and second dose. We determined predictors for reporting systemic side effects by logistic regression.
Results
A total of 1,213,693 patients received at least one vaccine dose and 301,537 (24.8%) answered at least one survey. Among them, 68,162 (30.4%) and 89,854 (59.9%) individuals filled the first and the second dose surveys, respectively, and reported one or more side effects. Most common side effects were fatigue, headache and myalgia. Several respondents reported facial paraesthesia after first and second dose, respectively (n = 1,675; 0.7% and n = 1,601; 1.1%). Individuals younger than 40 years and women reported side effects more frequently than others, but pregnant women reported less. Pregnancy was a weak predictor for reporting any side effect in general and in particular fatigue, myalgia, headache, chills and fever.
Conclusions
We found further support for minor short-term side effects, within 3 days of receiving the Comirnaty vaccine. These findings from vaccine recipients in general and pregnant women in particular can improve vaccine acceptance.
Keywords: COVID-19, side effects, pregnancy, BNT162b2 vaccine, patient reporting, survey
Introduction
The coronavirus disease (COVID-19) pandemic has caused morbidity and mortality in Israel and a worldwide, large-scale health challenge on hospital and community settings [1]. On 20 December 2020, Israel initiated a large COVID-19 vaccination campaign, during which the Comirnaty (BNT162b2, BioNTech/Pfizer, Mainz, Germany/New York, United States (US)) vaccine was administered [2]. In Israel, the public health system comprises only four not-for-profit health maintenance organisations (HMO), and vaccinations were widely distributed by these HMO through special vaccination centres and local nurses' clinics. The whole Israeli population 16 years and older was eligible to receive the vaccine according to a prioritisation system determined by the Israeli Ministry of Health (MoH) [3]. Senior citizens 60 years and older and healthcare workers were the first populations to get vaccinated in Israel, starting from 20 December 2020. On 4 February 2021, vaccines were offered to all citizens 16 years and older.
The safety of the Comirnaty vaccine is of major interest worldwide since there is no prior experience with the vaccine. Post-marketing safety surveillance is critical for patient health and safety, for all medications and vaccines [4]. While most reports concerning side effects rely primarily on manufacturers and healthcare professionals, there may be a discrepancy between those reports and the reports from the vaccinated individuals [5]. Specifically, data concerning immediate systemic side effects, within a week, among pregnant women is scarce [6] because they were excluded from the initial COVID-19 vaccine trials [7]. Transparent information about potential vaccine-related side effects is of paramount importance to increase confidence in vaccines [8,9].
In this study, our first aim was to examine the safety of the Comirnaty vaccine with regard to short-term side effects within 3 days as directly reported from a large population shortly after receiving a first and/or second dose of the vaccine. Our second aim was to evaluate predictors for reporting side effects among vaccinated patients overall and among pregnant women in particular.
Methods
This investigation was an observational cross-sectional study consisting of data collected through an electronic survey of vaccinated individuals.
Questionnaire development
An online survey was developed as part of COVID-19 vaccine safety monitoring by Maccabi Healthcare Services (MHS). MHS is the second largest HMO in Israel, serving more than 2.5 million citizens, representing a quarter of the Israeli population. The questionnaire was composed of three questions regarding potential systemic symptoms after receiving a dose of the Comirnaty vaccine and the respondent's age and sex (see Supplement).
Each questionnaire included a predetermined list of symptoms, and participants were asked to choose whether they experienced any of them or not. The order of these symptoms changed randomly for every recipient of the survey. Upon completion of the questionnaire, respondents could add information on other symptoms in free text form.
The predetermined list of symptoms was based on common side effects published in the phase III trial of the Comirnaty vaccine [7]. During the first 2 weeks of the survey, all supplemental information in the free text form was manually reviewed on a daily basis in order to identify additional common systemic side effects that were not included in the original questionnaire. For some of the side effects reported (i.e. hoarseness, cough, eye irritation, facial swelling, rash), as defined by the MHS joint risk management committee, the respondents were instructed to contact their attending physician.
Survey administration
A link to the electronic survey was distributed by text messages to adults 18 years and older who are eligible by national law to answer surveys, 3 days after receiving a dose of the Comirnaty vaccine, between 20 December 2020 and 11 March 2021. Inclusion criteria were age 18–85 years, a valid cell phone number or email in MHS systems and no prior refusal to participate in electronic surveys. Individuals over the age of 75 years or without access to text messages received the survey via electronic mail. The invitation to participate in the survey was sent only once and was available in Hebrew and Arabic, the official languages of Israel. No follow-up was preformed to determine whether the reported side effects were transient or long-lasting. The link to the survey was valid for only 48 h. The response to the questionnaire was voluntary and without remuneration. The questionnaires were available in five languages: Hebrew, Arabic, Russian, French and English.
Data collection
The MHS has a nationwide centralised database spanning over 20 years. All surveys were linked to the Electronic Health Record by a unique patient identifier. Pregnancy status, diabetes, immunosuppression and oncological-related background were identified from MHS registries. For our analyses, we took data for age and sex from the MHS registries, although this information was also collected in the questionnaires. These registries are based on validated inclusion and exclusion criteria (considering coded diagnoses, treatments and laboratory findings, where applicable). The registries are continuously and retrospectively (since 1998) updated based on each patient’s central medical record. Residential socioeconomic status was based on a score ranked from 1 (lowest) to 10 derived by the Israel Central Bureau of Statistics [10]. Ethnical groups included Arabs, ultra-orthodox Jews and general (not ultra-orthodox) Jews.
Data analysis
Only surveys that included data regarding short-term side effects were included in the analysis. Association between respondents' characteristics and reporting side effects was estimated firstly by univariate analysis. Data were weighted by age group and sex to make the sample representative of the general vaccinated population registered at MHS [11].
Chi-squared test was used for categorical variables, and t-test for continuous variables. Furthermore, we performed a multivariable logistic regression using a binary logistic regression model applied to the survey respondents. 'Enter' method was used for including variables in the model. Regression was presented as adjusted odds ratios (OR) and 95% confidence interval (CI).
Pregnant respondents
In order to evaluate the association between pregnancy status and reporting specific symptoms, we set up a matched case–control study between pregnant and non-pregnant female respondents in 1:4 ratio, by age, socioeconomic status and ethnicity. The OR was calculated by the prevalence of systemic side effects. Adjusted OR was calculated by adjusting for comorbidities (immunosuppression, body mass index > 35, cancer and diabetes).
All statistical analyses were performed with the Statistical Package for the Social Sciences (SPSS) version 25 (IBM Corp., New York, US).
Ethical considerations
The study was approved by the MHS institutional review board (IRB) (0029–21-MHS). Informed consent was waived by the IRB, as all identifying details of the participants were removed before the computational analysis.
Results
By 11 March 2021, MHS had administered at least one Comirnaty vaccine dose to 1,213,693 of its members, representing 70.2% of the vaccine target population. Their mean age was 47.9 years (± standard deviation (SD): 17.5). Just over half of them (51.8%) were women (Table 1). Of 1,060,163 who met the inclusion criteria and received the electronic survey invitation (Figure 1), information on possible side effects of the vaccine was available for 301,537 (28.4%) individuals, who answered at least one-self-reported survey. The response rate for the first and second survey was 24.2% and 18.3%, respectively. A total of 106,291 and 106,622 individuals older than75 years or without access to text messages received the survey via electronic mail after, respectively, the first and second vaccine dose. Among them, respectively 32,242 (30.3%) and 11,241 (10.5%) filled the first and second survey. The survey respondents' mean age was 49.4 (± SD: 15.7) years.
Table 1. Characteristics of the general recipients of Comirnaty vaccine against COVID-19 and survey respondents, Israel, December 2020–March 2021 (n = 1,213,693).
All vaccine recipients n = 1,213,693 |
Survey respondents n = 301,537 |
|||
---|---|---|---|---|
n | % | n | % | |
Sex* | ||||
Male | 584,997 | 48.2 | 141,037 | 46.8 |
Female | 628,696 | 51.8 | 160,500 | 53.2 |
Age group (years)* | ||||
18–40 | 443,112 | 36.5 | 90,230 | 29.9 |
41–65 | 549,047 | 45.2 | 157,320 | 52.2 |
> 65 | 221,534 | 18.3 | 53,987 | 17.9 |
Comorbidities (one or more)a | ||||
Immunosuppression* | 28,775 | 2.4 | 7,971 | 2.6 |
Morbid obesity (BMI ≥ 35)* | 70,172 | 5.8 | 16,774 | 5.6 |
Cancer* | 97,909 | 8.1 | 30,199 | 10.0 |
Diabetes* | 117,254 | 9.7 | 26,595 | 8.8 |
Pregnancyb,* | 10,668 | 0.9 | 2,234 | 0.7 |
Ethnicity/sector* | ||||
Arabs | 54,060 | 4.5 | 5,101 | 1.7 |
Jewish ultra-orthodox | 59,164 | 4.9 | 10,072 | 3.3 |
Jewish non-orthodox | 1,100,469 | 90.7 | 286,364 | 95.0 |
Socioeconomic statusb,* | ||||
Low | 182,006 | 15.0 | 24,967 | 8.3 |
Medium | 602,927 | 49.7 | 141,206 | 46.8 |
High | 428,649 | 35.3 | 135,364 | 44.9 |
Smoking* | ||||
Non-smoker | 997,958 | 82.2 | 258,291 | 85.7 |
Previous smoker | 17,647 | 1.5 | 4,494 | 1.5 |
Smoker | 156,583 | 12.9 | 30,285 | 10.0 |
Unknown | 41,505 | 3.4 | 8,467 | 2.8 |
BMI: body mass index (kg/m2); COVID-19: coronavirus disease; MHS: Maccabi Healthcare Services.
a Identified from MHS registries.
b Residential socioeconomic status was based on a score ranked from 1 (lowest) to 10 derived by the Israel Central Bureau of Statistics [10].
* All background characteristics were statistically significant (p < 0.001).
Comparison between background characteristics of the general vaccine population and the survey respondents. Respondents who answered at least one of the two surveys (after the first or the second vaccine dose). Inclusion criteria were 18–85 years-old, a valid cell phone number or email in the MHS systems and no prior refusal to participate in electronic surveys. Data are presented as absolute (relative) frequency or mean (± SD). Chi-squared test was used for categorical variables.
Among the 301,537 respondents, 168,861 (56.0%), reported one or more side effects. Side effects were more frequently reported in the second dose survey (89,854/150,057; 59.9%) compared with the first dose survey (68,162/223,872; 30.4%). Most of the respondents who did not report any side effect in the first dose survey (n = 103,257/155,715; 66.3%) did not fill in the second dose survey, while most of the respondents who filled in only the second dose survey (n = 54,284/77,665; 69.9%) reported having a side effect.
The symptoms most frequently reported among all respondents for the respective doses were fatigue (n = 24,866; 11.1% and n = 54,417; 36.3% for first and second dose, respectively), headache (n = 21,974; 9.8% and n = 42,134; 28.1%) and myalgia (n = 19,791; 8.8% and n = 39,949; 26.6%) (Figure 2). Facial paraesthesia was reported by 1,675 (0.7%) and 1,601 (1.1%) of the first and second dose survey respondents, respectively. All reported side effects were more frequent after receipt of the second dose than after the first one, among all the respondents. Most of the respondents who reported a side effect (52,673/68,162; 77.3% for the first and 41,111/89,854; 45.8% for the second dose survey) reported only one or two symptoms. A third of the respondents to the second dose survey, 48,743 (32.5%), reported three symptoms or more, compared with 15,489 (6.9%) for the first dose (Figure 1). A total of 6,468 individuals used the free text response to add supplemental information beyond the symptoms listed in the questionnaires. About a third of them (n = 2,262) reported injection-site pain, and most expanded on one of the previously listed symptoms, giving descriptions such as 'a severe headache' or 'a productive cough'. No unexpected side effects were reported.
Crude-level correlations between reporting side effects and potential predictors found a strong link between age under 40 years, female sex and the tendency to report side effects in both the first and the second dose survey (Table 2), whereas comorbidities, particularly cancer and diabetes, were not correlated. Young age and female sex remained the strongest predictors in multivariate regression analysis (Table 3). Comorbidities (diabetes, morbid obesity, immunosuppression or cancer) were found as inconsistent predictors to report side effects in the first and second dose surveys. Comparison between pregnant women and their matched controls by age and ethnicity revealed that pregnant women reported symptoms less frequently than their controls (see the Supplement for details on this comparison, for all symptoms and each survey). Symptoms were also more commonly reported by pregnant women after the second dose than the first. Pregnancy was consistently less associated with reporting side effects than any other variables in univariate and multivariate analysis and in both surveys. Further comparison between pregnant female respondents and their matched controls found pregnancy to be a weak predictor for reporting any side effect in general and specifically fatigue, myalgia, headache, chills and fever (Figure 3). This pattern persisted over the two surveys.
Table 2. Comparison between respondents' characteristics and reporting side effects after COVID-19 vaccination with Comirnaty, Israel, December 2020–March 2021.
First dose | Second dose | |||||||
---|---|---|---|---|---|---|---|---|
One or more systemic side effectsa
n = 66,596 |
No systemic side effectsa
n = 157,276 |
One or more systemic side effectsa
n = 88,899 |
No systemic side effectsa
n = 61,158 |
|||||
n | % | n | % | n | % | n | % | |
Sex | ||||||||
Male | 23,628 | 35.5 | 81,324 | 51.7 | 54,080 | 60.8 | 25,723 | 42.1 |
Female | 42,968 | 64.5 | 75,952 | 48.3 | 34,819 | 39.2 | 35,435 | 57.9 |
Age group (years) | ||||||||
18–40 | 25,421 | 38.2 | 39,219 | 24.9 | 29,398 | 33.1 | 10,295 | 16.8 |
41–65 | 33,343 | 50.1 | 82,379 | 52.4 | 49,290 | 55.4 | 32,655 | 53.4 |
> 65 | 7,832 | 11.8 | 35,678 | 22.7 | 10,211 | 11.5 | 18,208 | 29.8 |
Ethnicity/sector | ||||||||
Arabs | 1,231 | 1.8 | 2,713 | 1.7 | 1,037 | 1.2 | 872 | 1.4 |
Jewish ultra-orthodox | 2,764 | 4.2 | 5,014 | 3.2 | 2,805 | 3.2 | 1,853 | 3 |
Jewish non-orthodox | 62,601 | 94 | 149,549 | 95.1 | 85,057 | 95.7 | 58,433 | 95.5 |
Socioeconomic statusb | ||||||||
Low | 6,329 | 9.5 | 12,394 | 7.9 | 6,572 | 7.4 | 4,563 | 7.5 |
Medium | 32,428 | 48.7 | 72,035 | 45.8 | 41,245 | 46.4 | 27,590 | 45.1 |
High | 27,839 | 41.8 | 72,847 | 46.3 | 41,082 | 46.2 | 29,005 | 47.4 |
Pregnancya | 591 | 0.9 | 1,059 | 0.7 | 1,980 | 2.2 | 1,998 | 3.3 |
Comorbidities (one or more)a | ||||||||
Immunosuppression | 1,682 | 2.5 | 4,533 | 2.9 | 4,857 | 5.5 | 3,658 | 6 |
Morbid obesity (BMI ≥ 35) | 4,050 | 6.1 | 8,542 | 5.4 | 7,608 | 8.6 | 8,522 | 13.9 |
Cancer | 5,535 | 8.3 | 18,364 | 11.7 | 2,556 | 2.9 | 7,985 | 13.1 |
Diabetes | 4,572 | 6.9 | 16,168 | 10.3 | 671 | 0.8 | 343 | 0.6 |
Smoking | ||||||||
Non smoker | 57,248 | 86 | 135,854 | 86.4 | 77,290 | 86.9 | 52,198 | 85.3 |
Previous smoker | 945 | 1.4 | 2,407 | 1.5 | 1,173 | 1.3 | 1,019 | 1.7 |
Smoker | 6,638 | 10 | 15,240 | 9.7 | 8,091 | 9.1 | 6,542 | 10.7 |
Unknown | 1,765 | 2.7 | 3,775 | 2.4 | 2,345 | 2.6 | 1,399 | 2.3 |
BMI: body mass index (kg/m2); COVID-19: coronavirus disease.
a Identified from Maccabi Healthcare Services registries.
b Residential socioeconomic status was based on a score ranked from 1 (lowest) to 10 derived by the Israel Central Bureau of Statistics [10].
Chi-squared test was used for categorical variables, comparing side effects those after the first dose with no side effects. All factors reported were statistically significant (p < 0.001).
Table 3. Predictors for reporting side effects after COVID-19 vaccination with Comirnaty, by multivariate analysis, Israel, December 2020–March 2021.
First dose | Second dose | |||||
---|---|---|---|---|---|---|
AOR | 95% CI | p value | AOR | 95% CI | p value | |
Age (years)a | 0.976 | 0.976–0.977 | < 0.001 | 0.963 | 0.962–0.964 | < 0.001 |
Sex | ||||||
Male | Reference | |||||
Female | 1.92 | 1.89–1.96 | < 0.001 | 2.13 | 2.08–2.17 | < 0.001 |
Comorbidities | ||||||
No comorbidity | Reference | |||||
Immunosuppression | 1.03 | 0.97–1.09 | 0.312 | 0.86 | 0.80–0.92 | < 0.001 |
BMI > 35 | 1.18 | 1.13–1.23 | < 0.001 | 0.96 | 0.92–1.01 | 0.096 |
Cancer | 0.97 | 0.93–0.99 | 0.039 | 0.95 | 0.92–0.98 | 0.004 |
Diabetes | 1.01 | 0.97–1.05 | 0.610 | 0.82 | 0.79–0.85 | < 0.001 |
Pregnancy status | 0.65 | 0.59–0.72 | < 0.001 | 0.44 | 0.39–0.51 | < 0.001 |
AOR: adjusted odds ratio; BMI: body mass index (kg/m2); CI: confidence interval; COVID-19: coronavirus disease.
a Age was a continuous variable, increase or decrease per year.
Multivariate logistic regression model. Comorbidities and pregnancy status were identified from Maccabi Healthcare Services registries.
Discussion
This large-scale study in a real-world community setting offers important insights into short-term systemic events within 3 days after receiving the Comirnaty vaccine. Data gathered directly from the vaccine recipients revealed overall not serious systemic side effects. After controlling for multiple factors, such as age, sex, comorbidities (diabetes, immunosuppression, cancer, obesity) and pregnancy status, adverse effects were more frequently reported in younger individuals and women, but less frequently among pregnant women (adjusted for age and ethnicity).
Passive reporting of vaccine recipients' side effects by healthcare professionals is the primary tool used for post-marketing surveillance (pharmacovigilance) of vaccine safety [5]. However, vaccine recipients play an essential part in subjectively identifying side effects and providing information about their incidence [12]. The rate of reports on systemic side effects from passive surveillance gathered by the Israeli MOH was substantially lower than in our study, recording the occurrence of fatigue and headache in, respectively, 0.3% and 0.25% of individuals after the second dose of vaccine [13], compared with 36.3% and 28.1% of the respondents in this survey. This discrepancy may indicate an under-reporting pattern of mild symptoms that do not require medical follow-up and do not interfere with daily routines. Our results confirm the expected adverse effects as reported in the pharmacovigilance reports but emphasise the value of the active response surveys as a research tool. The prevalence of systemic side effects of the Comirnaty vaccine was lower among the survey respondents than reported in the phase III trial, i.e. fatigue and headache after the second dose were reported by 59% and 52%, respectively, among younger vaccine recipients and by 51% and 39% among older recipients in the clinical trial [7]. This may reflect an overall high level of motivation to participate in the survey even without any symptoms to report. It may also result from more stringent reporting in the clinical trial compared with the suboptimal reporting in the real-world scenario. Nevertheless, our results are in concordance with another real-world study preformed in the United Kingdom [14].
Concerns about vaccine safety and potential side effects are part of the main barriers against vaccine acceptance [15-17]. In order to avoid over-heterogeneity of systemic adverse events, the survey was composed of built-in options of side effects and additional free text to maximise transparency of the side effect reports. We found that fatigue, headache and myalgia were the most commonly reported systemic events, and they were more prevalent among the second-dose and younger vaccine recipients. Notably, a unique side effect that had not been reported before [18], facial paraesthesia, was reported in 0.7% and 1.1% of respondents after the first and the second dose, respectively. This specific complaint was also reported to various media outlets by vaccinated individuals and was the topic of many online debates. It was also meticulously discussed by the appointed committee that oversees the vaccination campaign in Israel, and the incidence rate was found to be lower than that expected within the general population [13]. No other unexpected phenomenon was reported by the respondents using free text. These observations confirm that reports of mild immediate side effects, derived directly from the vaccinated individuals, can be used as additional relevant information when counselling patients about vaccination.
We found that women had twice the probability of reporting side effects compared with men and the rate of reporting increased inversely with age. This pattern may be behavioural or may reflect a more robust immune response [19,20]. Interestingly, there was no association between several comorbidities and reporting side effects. Considering that older age and certain underlying medical conditions are major risk factors for severe illness from COVID-19 [21,22], it is particularly important in this group of patients to underline that side effects are mild and therefore not an indication to avoid vaccination. Interestingly, we found that the fact of being pregnant at vaccination reduced the reporting ratio of all symptoms when compared with randomly matched controls. Different pharmacokinetics, masking of side effects by pregnancy symptoms or minimal expectation of side effects following vaccination [23] might be possible explanations. Skjefte et al. found that one of the top reasons for women to decline vaccination during pregnancy is their reluctance to expose their developing baby to any possible harmful side effects [24]. Comparison between pregnant women and their matched controls revealed fewer self-reported adverse reactions among pregnant women. Fever in particular, associated with adverse pregnancy outcome [25], was under-reported. Although pregnant women's opinion about the vaccination may be influenced mainly by severe and rare outcomes which might not be expressed in this survey, this information, confirming the immediate effects directly from the women, may contribute to increase vaccine confidence.
The strengths of our study are firstly its methodology, a survey systematically sent to most vaccinated individuals, which provides a valuable notification and reporting tool that can reach a large population. Other strengths include a large sample size and a 12-week study period, used to maximise the heterogeneity of people receiving at least one vaccine dose. The connection to the respondents' medical records, which gives validity to their background characteristics without relying only on their reports is also a strength.
Several limitations should be considered for this study. Firstly, the questionnaire did not provide information on fatal outcomes or outcomes that prevented the patient from filling out the questionnaire, and the number of respondents was not large enough to identify rare events. Also, with the time frame in which the survey was conducted, as questionnaires were sent and completed a few days after the vaccine uptake, long-term outcomes would not be observed by this study design and the duration of reported symptoms was not obtained. As with all public surveys, ours was a snapshot taken at a given point in time. Secondly, there may have been self-selection bias as participation was voluntarily and may have captured people more interested or willing to participate in online studies who may not be representative of the general population. Thirdly, the findings may not be representative of all vaccine recipients nationally as minorities and people of low socioeconomic status were less represented among the respondents. Finally, an electronic format may not be appropriate for some segments of the population such as elderly people [26] or those with major comorbidities because of physical or cognitive barriers; therefore, a non-electronic format or other options may improve representability of the survey.
Conclusions
In this extensive voluntary survey regarding short-term side effects of the Comirnaty vaccine, we found further support for the short-term safety of the vaccine. Systemic side effects after vaccination were less common in a real-world community setting than reported in phase III trial, but notably higher than reported by the Israeli MoH. We found that women had twice the probability of reporting side effects compared with men and the rate of reporting increased inversely with age. Pregnant women reported side effect less frequently than their matched controls. These findings present valuable information for individuals considering vaccination and for healthcare professionals and can contribute to increasing vaccine confidence. Continued monitoring of long-term side effect merits further studies.
Supplementary Data
Conflict of interest: The researchers declare no conflicts of interest.
Authors’ contributions: Na’ama Shamir-Stein and Anat Ekka Zohar perceived and designed the study. Material preparation, data collection and analysis were performed by Shirley Shapiro Ben David, Sharon Baruch Gez, Na’ama Shamir-Stein and Anat Ekka Zohar. The manuscript was written by Shirley Shapiro Ben David, Daniella Rahamim-Cohen and Uri Lerner and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
References
- 1.Johns Hopkins Coronavirus Resource Center. COVID-19 Dashboard by the Center for Systems Science and Engineering (CSSE) at Johns Hopkins University (JHU). Baltimore: JHU; 2020. Available from: https://coronavirus.jhu.edu/map.html
- 2. Rosen B, Waitzberg R, Israeli A. Israel’s rapid rollout of vaccinations for COVID-19. Isr J Health Policy Res. 2021;10(1):6. 10.1186/s13584-021-00440-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Israeli Ministry of Health. The first ones to have the COVID-19 vaccine within the "Ten Katef" vaccine campaign. Jerusalem: Ministry of Health; 2020. Available from: https://www.gov.il/en/departments/news/16122020-01
- 4. Raj N, Fernandes S, Charyulu NR, Dubey A, G S R, Hebbar S. Postmarket surveillance: a review on key aspects and measures on the effective functioning in the context of the United Kingdom and Canada. Ther Adv Drug Saf. 2019;10:2042098619865413. 10.1177/2042098619865413 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Stefanizzi P, Stella P, Ancona D, Malcangi KN, Bianchi FP, De Nitto S, et al. Adverse events following measles-mumps-rubella-varicella vaccination and the case of seizures: a post marketing active surveillance in Puglia Italian region, 2017-2018. Vaccines (Basel). 2019;7(4):140. 10.3390/vaccines7040140 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Shimabukuro TT, Kim SY, Myers TR, Moro PL, Oduyebo T, Panagiotakopoulos L, et al. Preliminary findings of mRNA Covid-19 vaccine safety in pregnant persons. N Engl J Med. 2021;384(24):2273-82. 10.1056/NEJMoa2104983 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Polack FP, Thomas SJ, Kitchin N, Absalon J, Gurtman A, Lockhart S, et al. Safety and efficacy of the BNT162b2 mRNA Covid-19 vaccine. N Engl J Med. 2020;383(27):2603-15. 10.1056/NEJMoa2034577 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Kumar D, Chandra R, Mathur M, Samdariya S, Kapoor N. Vaccine hesitancy: understanding better to address better. Isr J Health Policy Res. 2016;5(1):2. 10.1186/s13584-016-0062-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Larson HJ, Schulz WS, Tucker JD, Smith DM. Measuring vaccine confidence: introducing a global vaccine confidence index. PLoS Curr. 2015;7:ecurrents.outbreaks.ce0f6177bc97332602a8e3fe7d7f7cc4. 10.1371/currents.outbreaks.ce0f6177bc97332602a8e3fe7d7f7cc4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Israeli Central Bureau of Statistics. Characterization and classification of geographical units by the socio-economic level of the population 2015. Jerusalem: Central Bureau of Statistics; 2019. Available from: https://din-online.info/pdf/lst92e.pdf
- 11. Schoen C, Osborn R, Squires D, Doty MM. Access, affordability, and insurance complexity are often worse in the United States compared to ten other countries. Health Aff (Millwood). 2013;32(12):2205-15. 10.1377/hlthaff.2013.0879 [DOI] [PubMed] [Google Scholar]
- 12. Aslani P, Hamrosi K, Tong V, Chen TF, Cook J, Fois R, et al. Consumer opinions on adverse events associated with medicines and vaccines. Patient Prefer Adherence. 2018;12:1383-92. 10.2147/PPA.S167396 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Israeli Ministry of Health. COVID-19 vaccine efficacy and safety follow up committee. Jerusalem: Ministry of Health; 2021. Hebrew. Available from: https://govextra.gov.il/ministry-of-health/covid19-vaccine/covid-19-vaccine-efficacy-safety-follow-up-committee
- 14. Menni C, Klaser K, May A, Polidori L, Capdevila J, Louca P, et al. Vaccine side-effects and SARS-CoV-2 infection after vaccination in users of the COVID Symptom Study app in the UK: a prospective observational study. Lancet Infect Dis. 2021;21(7):939-49. 10.1016/S1473-3099(21)00224-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Wang J, Jing R, Lai X, Zhang H, Lyu Y, Knoll MD, et al. Acceptance of covid-19 vaccination during the covid-19 pandemic in CHINA. Vaccines (Basel). 2020;8(3):482. 10.3390/vaccines8030482 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Reiter PL, Pennell ML, Katz ML. Acceptability of a COVID-19 vaccine among adults in the United States: How many people would get vaccinated? Vaccine. 2020;38(42):6500-7. 10.1016/j.vaccine.2020.08.043 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Lin C, Tu P, Beitsch LM. Confidence and receptivity for COVID-19 vaccines: a rapid systematic review. Vaccines (Basel). 2020;9(1):16-41. 10.3390/vaccines9010016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Pfizer-Biontech COVID-19 Vaccine (BNT162, PF-07302048). Vaccines and related biological products advisory committee briefing document. Silver Spring: United States Food and Drug Administration; 2020. Available from: https://www.fda.gov/media/144246/download
- 19. Potluri T, Fink AL, Sylvia KE, Dhakal S, Vermillion MS, Vom Steeg L, et al. Age-associated changes in the impact of sex steroids on influenza vaccine responses in males and females. NPJ Vaccines. 2019;4(1):29. 10.1038/s41541-019-0124-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Furman D, Hejblum BP, Simon N, Jojic V, Dekker CL, Thiébaut R, et al. Systems analysis of sex differences reveals an immunosuppressive role for testosterone in the response to influenza vaccination. Proc Natl Acad Sci USA. 2014;111(2):869-74. 10.1073/pnas.1321060111 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Bialek S, Boundy E, Bowen V, Chow N, Cohn A, Dowling N, et al. Severe outcomes among patients with coronavirus disease 2019 (COVID-19) - United States, February 12-March 16, 2020. MMWR Morb Mortal Wkly Rep. 2020;69(12):343-6. 10.15585/mmwr.mm6912e2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Shapiro Ben David S, Cohen D, Karplus R, Irony A, Ofer-Bialer G, Potasman I, et al. COVID-19 community care in Israel-a nationwide cohort study from a large health maintenance organization. J Public Health (Oxf). 2021;43(4):723-30. 10.1093/pubmed/fdab055 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. Smith LE, Weinman J, Amlôt R, Yiend J, Rubin GJ. Parental expectation of side effects following vaccination is self-fulfilling: a prospective cohort study. Ann Behav Med. 2019;53(3):267-82. 10.1093/abm/kay040 [DOI] [PubMed] [Google Scholar]
- 24. Skjefte M, Ngirbabul M, Akeju O, Escudero D, Hernandez-Diaz S, Wyszynski DF, et al. COVID-19 vaccine acceptance among pregnant women and mothers of young children: results of a survey in 16 countries. Eur J Epidemiol. 2021;36(2):197-211. 10.1007/s10654-021-00728-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Dreier JW, Andersen AM, Berg-Beckhoff G. Systematic review and meta-analyses: fever in pregnancy and health impacts in the offspring. Pediatrics. 2014;133(3):e674-88. 10.1542/peds.2013-3205 [DOI] [PubMed] [Google Scholar]
- 26. Remillard ML, Mazor KM, Cutrona SL, Gurwitz JH, Tjia J. Systematic review of the use of online questionnaires of older adults. J Am Geriatr Soc. 2014;62(4):696-705. 10.1111/jgs.12747 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.