Abstract
Purposes: To explore the associated factors of COVID-19 vaccine hesitancy and examine psychometric properties of the coronavirus-related health literacy questionnaire (HLS-COVID-Q22) and Oxford COVID-19 Vaccine Hesitancy questionnaire. Methods: An online survey was conducted from 23 June to 16 July 2021 on 387 school principals across Taiwan. Data collection included socio-demographic characteristics, information related to work, physical and mental health, COVID-19 related perceptions, sense of coherence, coronavirus-related health literacy, and vaccine hesitancy. Principal component analysis, correlation analysis, linear regression models were used for validating HLS-COVID-Q22, Oxford COVID-19 Vaccine Hesitancy, and examining the associations. Results: HLS-COVID-Q22 and Oxford COVID-19 Vaccine Hesitancy were found with satisfactory construct validity (items loaded on one component with factor loading values range 0.57 to 0.81, and 0.51 to 0.78), satisfactory convergent validity (item-scale correlations range 0.60 to 0.79, and 0.65 to 0.74), high internal consistency (Cronbach’s alpha = 0.96 and 0.90), and without floor or ceiling effects (percentages of possibly lowest score and highest score <15%), respectively. Low scores of vaccine hesitancy were found in male principals (regression coefficient, B, −0.69; 95% confidence interval, 95%CI, −1.29, −0.10; p = 0.023), principals with better well-being (B, −0.25; 95%CI, −0.47, −0.03; p = 0.029), and higher HLS-COVID-Q22 (B, −1.22; 95%CI, −1.89, −0.54; p < 0.001). Conclusions: HLS-COVID-Q22 and Oxford COVID-19 Vaccine Hesitancy were valid and reliable tools. Male principals and those with better well-being, and higher health literacy had a lower level of vaccine hesitancy. Improving principals’ health literacy and well-being is suggested to be a strategic approach to increase vaccine acceptance for themselves, their staff, and students.
Keywords: COVID-19, coronavirus-related health literacy, Oxford COVID-19 vaccine hesitancy, gender, well-being, depression, school principal, employer, Taiwan
1. Introduction
Vaccines against the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection have been successfully developed with no significantly serious side effects identified [1,2,3,4]. Several new vaccines have been successfully developed and more are to be developed [4,5]. However, hesitancy for COVID-19 vaccines was higher than for other vaccines [6,7], and the vaccine hesitancy in the public has been a great concern to fight COVID-19 [8,9,10,11]. Therefore, improving public acceptance and confidence to get vaccinated is critically important [12,13,14].
A global survey has shown that 61.4% of respondents would accept their employers’ recommendation to take a COVID-19 vaccine [14]. Women were more likely vaccinated as recommended by their employers in Brazil and the United States, while men were more likely to follow their employer’s suggestion in India and South Korea [15]. In addition, in a study involving 1007 Austrians, lack of trust in the government was found to be linked to hesitancy toward a COVID-19 vaccine [16]. Therefore, understanding the leaders’ perception toward the COVID-19 vaccine and associated factors could help to increase the vaccination willingness and uptake of employees and communities.
The hesitancy to get vaccinated against SARS-CoV-2 was associated with health literacy in the general population [17]. Health literacy also plays an important role in controlling the pandemic and infodemic [18]. However, it was underestimated amidst the COVID-19 pandemic [19]. The valid coronavirus-related health literacy questionnaire (HLS-COVID-Q22) was developed to evaluate people’s ability to access, understand, appraise, and apply health-related information in the context of the COVID-19 pandemic [20]. The Oxford COVID-19 Vaccine Hesitancy questionnaire was developed to assess the willingness to take an approved COVID-19 vaccine [13]. The sum score of 7 items was used for analysis and interpretation [13], instead of using only one question and categorical values in other studies [10,21,22,23,24].
Hesitancy for COVID-19 vaccines was investigated in general populations [10], health care workers [25,26,27,28,29,30], students [31,32,33,34,35], and school teachers [36,37]. However, there is no study investigating vaccine hesitancy in school principals who are at the frontline of all school matters and may have an influence on their staff and student’s perceptions and behaviors. Therefore, we conducted an online survey of school leaders to explore factors associated with COVID-19 vaccine hesitancy, and to examine psychometric properties of the HLS-COVID-Q22 questionnaire and the Oxford COVID-19 Vaccine Hesitancy questionnaire.
2. Materials and Methods
2.1. Study Design and Data Collection
An online survey was conducted on school principals across Taiwan from 23 June to 16 July 2021, as a part of an international COVID-HL research network on school principals [38]. The Ministry of Education and local government agents were contacted to post the online survey web-link on the Principals’ Line group (for internal communications among principals). In addition, the National Association of Primary and Secondary Principals was contacted to post the online survey web-link in the member Line group (for internal communications among the head of City or County Association of Primary and Secondary Principals). The heads then announced the online survey web-link in their Principals’ Line group. We also used Messengers, Facebook, and Email to invite school principals at all levels in our network to fill the online survey. It took about 20–30 min to complete the survey. The data were coded and analyzed anonymously.
2.2. Sampling and Sample Size
A network sampling technique was used to recruit the study participants. The calculated sample size was 341 as estimated using the G Power software version 3.1.9.7 for Windows [39], with type I error of 0.05, effect size of 0.1, power of 0.95, and 23 potential predictors in multiple linear regression. In this study, we recruited 413 principals from 3909 schools [40], including 260 from primary school (out of 2631), 84 from junior high school (out of 737), 60 from senior high school and vocational school (out of 513), 9 from school for special children (out of 28). The final sample of 387 principals was used for analysis after excluding 26 outliers. The distribution of the study sample and the total school principals by different locations (north, center, south, east, and outlying islands) and school types (primary school, junior high school, senior high school and vocational school, and school for special children) is presented in Supplementary Material, Table S1. The study sample can be considered representative of the school principal population in Taiwan.
2.3. Instruments and Measurements
The Chinese version of questionnaires was used in this survey including sociodemographic factors, work-related factors, physical and mental health-related factors, COVID-19 related perceptions, sense of coherence, coronavirus-related health literacy, and Oxford COVID-19 vaccine hesitancy.
2.3.1. Sociodemographic Factors
We assessed the basic information, including age (year), gender (female vs. male), school types (primary school, junior high school, senior high school or vocational school, school for special children), school locations (north, center, south, east, outlying islands), school size (≤12 classes, 13–24 classes, 25–48 classes, ≥49 classes), according to the regulations of Ministry of Education in Taiwan [41].
2.3.2. Work-Related Factors
School principals were asked whether they were still involved in teaching or not, weekly working hours, and the changes in working hours as compared to that before the COVID-19 pandemic.
2.3.3. Physical and Mental Health-Related Factors
The school principals were asked about their general health status on a 5-point Likert scale from “very bad” to “very good” and dichotomized into “Very bad or bad or moderate” vs. “Good or very good” for analysis. Next, they were asked about the chronic health conditions (no vs. yes), and physical limitations due to chronic conditions (not limited vs. limited).
The symptoms that were similar to COVID-19, or suspected COVID-19 symptoms (S-COVID-19-S) were assessed [42], including fever, cough, and dyspnea, myalgia, fatigue, sputum production, confusion, headache, sore throat, rhinorrhea, chest pain, hemoptysis, diarrhea, and nausea/vomiting. The participants were divided into two groups (with and without S-COVID-19-S), based on their responses.
The level of fear was assessed using the fear of COVID-19 scale (FCoV-19S) [43] which was validated and used in Taiwan [44,45,46]. School principals responded to 7 items on a 5-point Likert scale from 1 = strongly disagree to 5 = strongly agree. The sum scores range from 7 to 35, with a higher score indicating a greater fear. The Cronbach’s alpha value in the current study was 0.90.
Stress was assessed using the 10-item perceived stress scale (PSS-10) that was widely used in international studies [47,48,49]. The tool was also validated and used in the Taiwanese context [50,51], and in the hospital staff during the COVID-19 pandemic [52]. School principals responded to each item on a 5-point Likert scale from 0 = never to 4 = very often. The score of items 4, 5, 7, 8 were reversed. The total scores range from 0 to 40, with a higher score representing higher perceived stress. The Cronbach’s alpha value for the overall scale in the current study was 0.80.
Subjective well-being was assessed using the WHO-5 well-being index with 5 items [53], which has been widely used across 35 countries [54]. The tool was validated and used in the Taiwanese context [55,56,57]. Respondents answered the questions on the 6-point Likert scale from 0 = at no time to 5 = all of the time. The final score (range 0–100) was calculated using the total raw score (range 0–25) multiplied by 4, with 0 reflecting the worst well-being and 100 reflecting the best well-being. The Cronbach’s alpha value in the current study was 0.92.
2.3.4. COVID-19 Related Perceptions
The school principals were asked about the levels of informing on COVID-19 related information “How well informed do you feel about the COVID-19 related information?” with 5-point responses ranging from “insufficiently informed” to “very well informed”, and levels of confusion due to COVID-19 related information “How much confusion do you feel about COVID-19 related information?” with 4-point responses ranging from “not at all confused” to “very confused” [20]. The response options were dichotomized into “Insufficient/poor/fine informed” vs. “Well or very well informed”, and “Not at all or little confused” vs. “Quite or very confused”, for analysis, respectively.
The perceived COVID-19 threat was assessed using two questions, including “How concerned are you that you or a family member could get infected with coronavirus in the next 1 year?” with 4-point responses ranging from “very concerned” to “not concerned at all”, and “How likely is it that you or a family member could get infected with coronavirus in the next 1 year?” with 4-point responses ranging from “very likely” to “definitely not” [23]. The response options were dichotomized into “Slightly concerned/not concerned at all” vs. “Very concerned/concerned”, and “Not likely/definitely not” vs. “Very likely/somewhat likely” for analysis, respectively.
2.3.5. Sense of Coherence
Sense of coherence (SOC) was assessed using the 9-item scale that was developed and validated in a previous study [58]. The original scale focuses on the work context (How do you personally find your current job and work situation in general?) [58]. This tool was adapted to assess the general living situation amidst the COVID-19 pandemic in the Chinese context [59]. Item response options ranged from 0 to 6. The responses of items 1,3,6,7,9 were reversed for calculating the overall score. The overall score was the average score of 9 items, with higher values indicating a higher SOC [58,59]. The Cronbach’s alpha value in the current study was 0.93.
2.3.6. Coronavirus-Related Health Literacy
Coronavirus-related health literacy was measured using the HLS-COVID-Q22, which includes 22 items and was developed and validated in a previous study [20]. The tool was used to assess the participants’ ability (difficulty or ease) to access, understand, appraise, and apply health-related information in the context of the COVID-19 pandemic [20]. Respondents answered the questions on a 4-point scale ranging from 1 = very difficult to 2 = difficult, 3 = easy, and 4 = very easy. The average scores ranged from 1 to 4 with a higher score presenting a better coronavirus-related health literacy [20].
2.3.7. COVID-19 Vaccine Hesitancy
The COVID-19 vaccine hesitancy was assessed using the Oxford COVID-19 vaccine hesitancy scale with seven items that was validated in a previous study [13]. Each item with specific response options was used and coded from 1 to 5 [60]. A “don’t know” option was excluded from scoring [13]. The sum scores ranged from 7 to 35 with higher scores with higher values indicating a higher level of vaccine hesitancy [12,13].
2.4. Ethical Consideration
This study was reviewed and approved by the Research Ethics Committee of National Chengchi University (IRB No. NCCU-REC-202106-I066). All participants were informed about the purposes and importance of the study and voluntarily took the survey.
2.5. Statistical Analysis
Since the COVID-19 vaccine hesitancy was an outcome, its normal distribution was checked. The histogram, normal Q-Q plot, and box plot showed that the COVID-19 vaccine hesitancy scores were approximately normally distributed, with a skewness of 0.179 (SE = 0.124) [61]. After excluded 26 outliners, the final sample for analysis was 387 school principals. The one-way ANOVA tests were performed to explore the distribution of COVID-19 vaccine hesitancy by different categories of independent variables.
2.5.1. Psychometric Properties of the HLS-COVID-Q22 and COVID-19 Vaccine Hesitancy
The construct validity was examined using the principal component analysis (PCA) with the oblique rotation (Promax) to evaluate the construct of the HLS-COVID-Q22 and COVID-19 Vaccine Hesitancy. The Kaiser-Meyer Olkin criterion and Bartlett’s Test of Sphericity value were used to determine the sampling adequacy, and the suitability of the data for PCA, respectively [62].
The correlations between scale and its items were checked using Spearman’s correlation to assess the item-scale convergent validity [63,64].
Floor and ceiling effects were calculated using the percentages of participants with the possibly lowest score and highest score [65].
The internal consistency of the HLS-COVID-Q22 and COVID-19 Vaccine Hesitancy were estimated using Cronbach’s alpha test. A Cronbach’s alpha value of ≥0.70 was designated for satisfactory reliability [66].
2.5.2. Associated Factors of COVID-19 Vaccine Hesitancy
Associated factors of COVID-19 vaccine hesitancy were investigated using bivariate and multivariate linear regression models. To minimize residual effects of confounders, all the factors in the bivariate model were analyzed in the multivariate model [67]. The variance inflation factor (VIF) values were checked to detect multicollinearity. Data were analyzed using the IBM SPSS Version 20.0 for Windows (IBM Corp., Armonk, NY, USA). A p-value < 0.05 was set as the significance level.
3. Results
3.1. Study Participants’ Characteristics
A sample of 387 school principals was analyzed, the mean age was 52.9 ± 4.8 years (ranged from 37 to 70), 64.9% were men, 27.4% were involved in teaching. Average working hours a week were 48.9 ± 14.9, 77.2% worked more than 40 h a week, 17.8% worked more than before the pandemic. The means of coronavirus-related health literacy and COVID-19 vaccine hesitancy were 3.2 ± 0.4 and 11.2 ± 2.7, respectively (Table 1).
Table 1.
Variables | Total (n = 387) | COVID-19 Vaccine Hesitancy | |
---|---|---|---|
n (%) | Mean ± SD | p-Value * | |
Age, mean ± SD, 37–70 years | 52.9 ± 4.8 | ||
Gender | 0.011 | ||
Women | 136 (35.1) | 11.7 ± 2.8 | |
Men | 251 (64.9) | 11.0 ± 2.6 | |
School type | 0.020 | ||
Primary school | 243 (62.8) | 11.1 ± 2.7 | |
Junior high school | 77 (19.9) | 12.0 ± 2.7 | |
Senior high school and vocational school | 58 (15.0) | 10.7 ± 2.5 | |
School for special children | 9 (2.3) | 12.1 ± 2.5 | |
School location | 0.359 | ||
North | 117 (30.2) | 11.3 ± 2.7 | |
Center | 127 (32.8) | 11.0 ± 2.6 | |
South | 80 (20.7) | 11.5 ± 2.8 | |
East | 38 (9.8) | 11.6 ± 2.5 | |
Outlying islands | 25 (6.5) | 10.6 ± 2.4 | |
School Size | 0.221 | ||
≤12 classes | 142 (36.7) | 11.5 ± 2.8 | |
13–24 classes | 71 (18.3) | 11.3 ± 2.7 | |
25–48 classes | 98 (25.3) | 10.8 ± 2.7 | |
≥49 classes | 76 (19.7) | 11.2 ± 2.4 | |
Involving teaching | 0.341 | ||
No | 281 (72.6) | 11.3 ± 2.7 | |
Yes | 106 (27.4) | 11.0 ± 2.7 | |
Weekly working hours, mean ± SD | 48.9 ± 14.9 | 0.857 | |
<40 h | 32 (8.3) | 11.0 ± 3.1 | |
40 h | 56 (14.5) | 11.3 ± 2.6 | |
>40 h | 299 (77.2) | 11.2 ± 2.6 | |
Weekly working hours changes | 0.745 | ||
Less than before the pandemic | 113 (29.2) | 11.4 ± 2.7 | |
About the same | 205 (53.0) | 11.1 ± 2.6 | |
More than before the pandemic | 69 (17.8) | 11.2 ± 2.8 | |
General health status | 0.024 | ||
Very bad or bad or moderate | 155 (40.1) | 11.6 ± 2.6 | |
Good or very good | 232 (69.9) | 11.0 ± 2.7 | |
Chronic health conditions | 0.583 | ||
No | 237 (61.2) | 11.2 ± 2.8 | |
Yes | 150 (38.8) | 11.3 ± 2.7 | |
Physical limitation due to chronic conditions | 0.725 | ||
Not limited | 279 (72.1) | 11.2 ± 2.6 | |
Limited | 108 (27.9) | 12.3 ± 2.7 | |
S-COVID-19-S | 0.552 | ||
No | 246 (63.6) | 11.2 ± 2.7 | |
Yes | 141 (36.4) | 11.3 ± 2.5 | |
FCoV-19S | 17.5 ± 5.3 | ||
Perceived stress, mean ± SD | 12.7 ± 4.5 | ||
WHO-5 Wellbeing Index, mean ± SD | 69.5 ± 15.4 | ||
Level of informing on COVID-19 related information | 0.246 | ||
Insufficient/poor/fine informed | 44 (11.4) | 11.7 ± 3.3 | |
Well or very well informed | 343 (88.6) | 11.2 ± 2.6 | |
Level of confusion due to COVID-19 related information | 0.187 | ||
Not at all or little confused | 351 (90.7) | 11.2 ± 2.6 | |
Quite or very confused | 36 (9.3) | 11.8 ± 3.3 | |
Level of concern about getting infected | 0.893 | ||
Slightly concerned/not concerned at all | 129 (33.3) | 11.2 ± 2.6 | |
Very concerned/concerned | 258 (66.7) | 11.2 ± 2.7 | |
Perceived likelihood of getting infected | 0.849 | ||
Not likely/definitely not | 159 (41.1) | 11.2 ± 2.7 | |
Very likely/somewhat likely | 228 (58.9) | 11.2 ± 2.7 | |
Sense of coherence, mean ± SD | 4.2 ± 1.1 | ||
Coronavirus-related HL, mean ± SD | 3.2 ± 0.4 | ||
Vaccine Hesitancy, mean ± SD | 11.2 ± 2.7 |
Abbreviations: COVID-19, coronavirus disease 2019; SD, standard deviation; S-COVID-19-S, suspected COVID-19 symptoms; FCoV-19S, fear of COVID-19; WHO, world health organization; HL, health literacy. * Results of one-way ANOVA test.
3.2. Psychometric Properties of HLS-COVID-Q22 and COVID-19 Vaccine Hesitancy
The KMO values of HLS-COVID-Q22 and COVID-19 Vaccine Hesitancy were 0.95, and 0.85 indicating sample adequacy (≥0.6) [62]. Bartlett’s Test of Sphericity values of HLS-COVID-Q22 and COVID-19 Vaccine Hesitancy were <0.001, which determined the suitability of the data for PCA [62]. Twenty-two items of the HLS-COVID-Q22, and 7 items of COVID-19 Vaccine Hesitancy were strongly loaded on one component each and explained 52.3%, and 49.4% of the scale variance, respectively. The HLS-COVID-Q22 items’ and COVID-19 Vaccine Hesitancy items’ factor loading values ranged from 0.57 to 0.81 (Table 2), and 0.51 to 0.78 (Table 3), respectively. This indicates a satisfactory construct validity [62].
Table 2.
HLS-COVID-Q22 | |
---|---|
Factor loading values * | Component 1 |
1. find information about the coronavirus on the internet? | 0.57 |
2. find information on the internet about protective behaviors that can help to prevent infection with the coronavirus? | 0.66 |
3. find information in newspapers, magazines and on TV about behaviors that can help to prevent infection with the corona-virus? | 0.64 |
4. find out information how to recognize if I am likely to be infected with the coronavirus? | 0.72 |
5. find information on how to find professional help in case of coronavirus infection? | 0.78 |
6. find information on how I much I am at risk for infection with coronavirus? | 0.75 |
7. understand your doctor’s, pharmacist’s or nurse’s instructions on protective measures against coronavirus infection? | 0.71 |
8. understand recommendations of authorities regarding protective measures against coronavirus infection? | 0.67 |
9. understand advice from family members or friends regarding protective measures against coronavirus infection? | 0.76 |
10. understand information in the media on how to protect myself against coronavirus infection? | 0.72 |
11. understand risks of the coronavirus that I find on the internet? | 0.77 |
12. understand risks of the coronavirus that I find in newspapers, magazines or on TV? | 0.77 |
13. judge if information on coronavirus and the coronavirus epidemic in the media is reliable? | 0.73 |
14. judge which behaviors are associated with higher risk of coronavirus infection? | 0.77 |
15. judge what protective measures you can apply to prevent a coronavirus infection? | 0.81 |
16. judge how much I am at risk for a coronavirus infection? | 0.72 |
17. judge if I have been infected with coronavirus? | 0.60 |
18. decide how you can protect yourself from coronavirus infection based on information in the media? | 0.76 |
19. follow instructions from your doctor or pharmacist regarding how to handle the coronavirus situation? | 0.73 |
20. use information the doctor gives you to decide how to handle an infection with coronavirus? | 0.73 |
21. use media information to decide how to handle an infection with coronavirus? | 0.77 |
22. to behave in a way to avoid infecting others? | 0.73 |
Percentage of variance, % | 52.3% |
Item-scale convergent validity, mean of Rho (range) | 0.72 (0.60–0.79) |
Internal consistency, Cronbach’s alpha | 0.96 |
Floor effects, % | 0.00 |
Ceiling effect, % | 5.90 |
Abbreviations: HLS-COVID-Q22, coronavirus-related health literacy; Rho, Spearman’s correlation coefficient. * Principal component analysis using Promax rotation method.
Table 3.
COVID-19 Vaccine Hesitancy |
|
---|---|
Factor loading values * | Component 1 |
1. Would you take a COVID-19 vaccine if offered? … | 0.51 |
2. If there is a COVID-19 vaccine available,… | 0.73 |
3. I would describe my attitude towards receiving a COVID-19 vaccine as:… | 0.76 |
4. If a COVID-19 vaccine was available at my local pharmacy, I would:… | 0.72 |
5. If my family or friends were thinking of getting a COVID-19 vaccination, I would:… | 0.72 |
6. I would describe myself as:… | 0.78 |
7. Taking a COVID-19 vaccination is:… | 0.66 |
Percentage of variance, % | 49.4% |
Item-scale convergent validity, mean of Rho (range) | 0.70 (0.65–0.74) |
Internal consistency, Cronbach’s alpha | 0.90 |
Floor effects, % | 11.60 |
Ceiling effect, % | 0.00 |
Abbreviations: COVID-19, coronavirus disease 2019; Rho, Spearman’s correlation coefficient. * Principal component analysis using Promax rotation method.
The correlations between HLS-COVID-Q22 and COVID-19 Vaccine Hesitancy and their items ranged from 0.60 to 0.79 (Table 2), and 0.65 to 0.74 (Table 3), respectively, indicating satisfactory convergent validity [63,64]. In addition, the Cronbach’s alpha values for HLS-COVID-Q22 and COVID-19 Vaccine Hesitancy were 0.96 and 0.90 respectively, reflecting a high level of internal consistency. There were no significant floor and ceiling effects with proportions of the lowest potential response, and the highest potential response of less than 15% for HLS-COVID-Q22 (Table 2), and COVID-19 Vaccine Hesitancy (Table 3) [65].
3.3. Associated Factors of COVID-19 Vaccine Hesitancy
In the multivariate analysis, male school principals had lower scores of vaccine hesitancy (regression coefficient, B, −0.69; 95% confidence interval, 95%CI, −1.29, −0.10; p = 0.023) as compared to female respondents. Principals of junior high schools had higher scores of vaccine hesitancy (B, 0.75; 95%CI, 0.02, 1.47; p = 0.043) as compared to those from primary schools. Respondents with higher scores of subjective well-being (a 10-score increment) had lower scores of vaccine hesitancy (B, −0.25; 95%CI, −0.47, −0.03; p = 0.029). Finally, school principals with higher HL scores had lower vaccine hesitancy scores (B, −1.22; 95%CI, −1.89, −0.54; p < 0.001; Table 4). The adjusted R2 = 0.138, the variance inflation factor (VIF) ranged 1.12 to 3.05, indicating no multicollinearity [62].
Table 4.
Variables | COVID-19 Vaccine Hesitancy | |||
---|---|---|---|---|
Bivariate | Multivariate | |||
B (95% CI) | p | B (95% CI) | p | |
Age | 0.01 (−0.05, 0.06) | 0.789 | 0.01 (−0.05, 0.07) | 0.697 |
Gender | ||||
Women | Reference | Reference | ||
Men | −0.72 (−1.27, −0.16) | 0.011 | −0.69 (−1.29, −0.10) | 0.023 |
School type | ||||
Primary school | Reference | Reference | ||
Junior high school | 0.89 (0.21, 1.57) | 0.010 | 0.75 (0.02, 1.47) | 0.043 |
Senior high school and vocational school | −0.35 (−1.10, 0.41) | 0.371 | −0.14 (−0.99, 0.71) | 0.744 |
School for special children | 1.04 (−0.72, 2.8) | 0.246 | 0.84 (−0.97, 2.65) | 0.362 |
School location | ||||
North | Reference | Reference | ||
Center | −0.33 (−1.00, 0.34) | 0.332 | −0.43 (−1.11, 0.26) | 0.226 |
South | 0.20 (−0.56, 0.96) | 0.596 | 0.16 (−0.65, 0.96) | 0.700 |
East | 0.27 (−0.71, 1.25) | 0.586 | 0.13 (−0.92, 1.17) | 0.810 |
Outlying islands | −0.75 (−1.90, 0.41) | 0.204 | −0.68 (−1.88, 0.52) | 0.265 |
School Size | ||||
≤12 classes | Reference | Reference | ||
13–24 classes | −0.15 (−0.91, 0.61) | 0.702 | −0.20 (−0.99, 0.59) | 0.622 |
25–48 classes | −0.72 (−1.41, −0.03) | 0.040 | −0.67 (−1.44, 0.09) | 0.085 |
≥49 classes | −0.29 (−1.03, 0.45) | 0.446 | −0.19 (−1.06, 0.68) | 0.671 |
Involving teaching | ||||
No | Reference | Reference | ||
Yes | −0.29 (−0.89, 0.31) | 0.341 | −0.12 (−0.73, 0.5) | 0.710 |
Weekly working hours | ||||
<40 h | −0.28 (−1.45, 0.88) | 0.635 | −0.35 (−1.53, 0.84) | 0.563 |
40 h | Reference | Reference | ||
>40 h | −0.01 (−0.77, 0.76) | 0.981 | −0.05 (−0.84, 0.75) | 0.906 |
Weekly working hours changes | ||||
Less than before the pandemic | 0.24 (−0.38, 0.86) | 0.444 | 0.31 (−0.31, 0.94) | 0.324 |
About the same | Reference | Reference | ||
More than before the pandemic | 0.10 (−0.63, 0.83) | 0.788 | 0.13 (−0.61, 0.88) | 0.726 |
Self-endangering work behavior | 0.18 (−0.31, 0.67) | 0.473 | 0.03 (−0.55, 0.61) | 0.913 |
General health status | ||||
Very bad or bad or moderate | Reference | Reference | ||
Good or very good | −0.62 (−1.16, −0.08) | 0.024 | −0.27 (−0.94, 0.40) | 0.436 |
Chronic health conditions | ||||
No | Reference | Reference | ||
Yes | 0.15 (−0.39, 0.70) | 0.583 | 0.22 (−0.46, 0.90) | 0.520 |
Physical limitation due to chronic conditions | ||||
Not limited | Reference | Reference | ||
Limited | 0.11 (−0.49, 0.70) | 0.725 | −0.44 (−1.22, 0.34) | 0.268 |
S-COVID-19-S | ||||
No | Reference | Reference | ||
Yes | 0.17 (−0.39, 0.72) | 0.552 | 0.05 (−0.54, 0.64) | 0.864 |
FCoV-19S | −0.02 (−0.07, 0.03) | 0.360 | −0.06 (−0.12, 0.00) | 0.059 |
Perceived stress | 0.01 (−0.05, 0.07) | 0.654 | −0.06 (−0.13, 0.02) | 0.152 |
WHO-5 Wellbeing Index, a 10-score increment | −0.28 (−0.45, −0.11) | 0.001 | −0.25 (−0.47, −0.03) | 0.029 |
Level of informing on COVID-19 related information | ||||
Insufficient/poor/fine informed | Reference | Reference | ||
Well or very well informed | −0.50 (−1.33, 0.34) | 0.246 | −0.04 (−0.94, 0.87) | 0.936 |
Level of confusion due to COVID-19 related information | ||||
Not at all or little confused | Reference | Reference | ||
Quite or very confused | 0.62 (−0.30, 1.53) | 0.187 | 0.44 (−0.56, 1.44) | 0.386 |
Level of concern about getting infected | ||||
Slightly concerned/not concerned at all | Reference | Reference | ||
Very concerned/concerned | 0.04 (−0.53, 0.60) | 0.893 | −0.02 (−0.98, 0.93) | 0.960 |
Perceived likelihood of getting infected | ||||
Not likely/definitely not | Reference | Reference | ||
Very likely/somewhat likely | 0.05 (−0.49, 0.59) | 0.849 | 0.01 (−0.90, 0.93) | 0.977 |
Sense of coherence | −0.15 (−0.40, 0.10) | 0.241 | 0.00 (−0.28, 0.27) | 0.986 |
Coronavirus-related HL | −1.27 (−1.87, −0.67) | <0.001 | −1.22 (−1.89, −0.54) | <0.001 |
Abbreviations: COVID-19, coronavirus disease 2019; B, regression coefficient; CI, confidence interval; S-COVID-19-S, suspected COVID-19 symptoms; FCoV-19S, fear of COVID-19; WHO, world health organization; HL, health literacy.
4. Discussion
The HLS-COVID-Q22 and COVID-19 Vaccine Hesitancy questionnaires were valid and reliable tools for assessing coronavirus-related health literacy and vaccine hesitancy in Taiwan during the pandemic. Both tools showed satisfactory construct validity [62], convergent validity [63,64], and reliability [68], and no floor or ceiling effect [65].
A previous study showed that vaccine willingness was low in Taiwan due to the relatively safe status of COVID-19 infection [28]. However, in our study, the prevalence of vaccine acceptance was relatively high (95.6% “probably” and “definitely” take a COVID-19 vaccine if offered, Supplementary Material, Table S2). In addition, the overall COVID-19 vaccine hesitancy score in our study (11.2 ± 2.7) was lower than that in a previous study (13.6 ± 7.3) that used the same tool [13]. The difference might be accounted for by survey time, as our survey was conducted during the peak of the pandemic in Taiwan [69]. This also reflects a fact that the school principals (a very highly educated population with high socioeconomic status, as compared to the general population) might have a higher willingness to get a jab against COVID-19. In addition, a previous finding showing that schoolteachers were likely or very likely to accept a COVID-19 vaccine [36].
In the current study, male principals had lower vaccine hesitancy scores than female respondents. This is consistent with previous studies’ findings that vaccine hesitancy is higher in women [22,36,70]. This could be explained that women had more concerns about safety [71,72], and reproductive health [73] during the pandemic. Inconsistently, in some countries, women were more likely to accept a vaccine (e.g., France, Germany, Sweden, and Russia) as they are gatekeepers for their family’s health-related decisions, and with higher empathy levels for their family safety [15]. In addition, the principals of junior high schools had higher scores of vaccine hesitancy than those of primary schools in the current study. The finding provides evidence for the COVID-19 vaccine promotion strategies suggesting more attention to female and junior high school principals. The COVID-19 vaccine hesitancy in school principals could be influenced by socio-demographic and health beliefs as found in a previous study conducted on the schoolteachers [37]. Social and organizational factors were also found to have certain influences on the public’s attitude toward vaccines [21].
In our study, better general well-being was associated with lower COVID-19 vaccine hesitancy. A previous study showed that healthcare workers with depression had a lower likelihood of taking a COVID-19 vaccine [25]. In turn, when they took the vaccine, the vaccine hesitancy showed a negative impact on their mental health [74]. Fear of COVID-19 and perceived stress were not found to be associated with vaccine hesitancy in our study. In contrast, a previous study showed that fear and anxiety were associated with higher COVID-19 vaccine acceptance [75]. The perceived COVID-19 threat was not associated with vaccine hesitancy in the current study. However, a previous study showed that people who perceived a higher COVID-19 risk had a higher likelihood of willingness to vaccinate [28]. In addition, people with greater health concerns about COVID-19 had a lower hesitant level [70].
In the present study, higher health literacy was strongly associated with lower COVID-19 vaccine hesitancy. In previous studies, the willingness to get a COVID-19 vaccine was determined by knowledge about coronavirus transmission [76], and COVID-19 [77]. The ability to detect fake news and higher health literacy was associated with a higher likelihood of a COVID-19 vaccine acceptance [17]. Conspiracy beliefs and myths about the COVID-19 vaccine affect COVID-19 vaccination [78]. Therefore, to increase the willingness to get vaccinated against COVID-19, it is suggested to improve individuals’ health literacy, and ability to detect fake news [17], by addressing the source of information [79], continuously providing reliable information, improving communication to address the root causes of mistrust, using a diverse range of policies and technologies [80], optimizing the official communication in the context of vaccine misinformation [81]. It is also important to implement health literacy intervention on the individual, interpersonal, and organizational levels [82], ideally facilitated by sustainable policy efforts both locally and nationally.
The level of being informed or confused about COVID-19 information was not significantly associated with vaccine hesitancy in our study. This was similar to previous evidence such that transparently informing people of the vaccination limitations did not affect vaccination intentions [83]. In addition, the characteristics of different vaccines potentially influenced the attitudes of the public towards vaccine acceptance [21]. People hesitated to receive a COVID-19 vaccine because of other reasons, e.g., fears of injection [84], or concerns about vaccine efficacy and fear of side effects [78]. Therefore, to increase the vaccination intentions, a simple message mentioning the vaccine efficacy is possibly influenced by context that might be helpful [85]. A simple “nudge” message could show the power to increase COVID-19 vaccine uptake [86,87].
Our study has some limitations. Firstly, this was a cross-sectional study in which the causal relationship cannot be generated. Secondly, the study was conducted during the peak of the pandemic in Taiwan [69], the measurement of COVID-19 vaccine hesitancy may be biased. However, we collected data from different regions with different infection rates, and vaccine hesitancy was not significantly differed by school locations. Finally, the sample investigated was about 9.9% (387/3909) of total school principals that may affect the generalizability of findings. However, the study can raise the phenomena and provide immediate evidence for appropriate interventions.
5. Conclusions
The HLS-COVID-Q22 and Oxford COVID-19 Vaccine Hesitancy are valid and reliable instruments to measure coronavirus-related health literacy and vaccine hesitancy, respectively, among educational leaders. We found that male principals, those with better well-being, and higher health literacy had a lower level of vaccine hesitancy. Strategical interventions are suggested to improve the perception of school principals toward COVID-19 vaccine. These further influences behaviors of school teachers and students regarding vaccination which helps to contain the pandemic.
Acknowledgments
The authors would like to thank the school principals who agreed and completed the survey, and the support from Associations of Primary and Secondary School Principals in Taiwan.
Supplementary Materials
The following are available online at https://www.mdpi.com/article/10.3390/vaccines9090985/s1, Table S1: The distribution of study sample and total school principals by school locations and types (n = 387), Table S2: The distribution of school principals by different COVID-19 vaccine hesitancy items (n = 387).
Author Contributions
Conceptualization, T.V.D., C.-Y.L., S.-C.C., Y.-K.H., O.O., K.D. and C.-F.L.; data curation, T.V.D., C.-Y.L., S.-C.C., Y.-K.H. and C.-F.L.; funding acquisition, C.-F.L.; investigation, T.V.D., C.-Y.L., S.-C.C., Y.-K.H., O.O., K.D. and C.-F.L.; methodology, T.V.D., C.-Y.L., S.-C.C., Y.-K.H., O.O., K.D. and C.-F.L.; project administration, C.-Y.L., S.-C.C. and C.-F.L.; resources, T.V.D., C.-Y.L., S.-C.C., Y.-K.H. and C.-F.L.; software, T.V.D. and C.-F.L.; supervision, T.V.D., O.O., K.D. and C.-F.L.; validation, T.V.D., C.-Y.L., S.-C.C., Y.-K.H., O.O., K.D. and C.-F.L.; visualization, T.V.D.; writing—original draft, T.V.D. and C.-F.L.; writing—review & editing, T.V.D., C.-Y.L., S.-C.C., Y.-K.H., O.O., K.D. and C.-F.L. All authors have read and agreed to the published version of the manuscript.
Funding
This research was supported by the Ministry of Science and Technology, Taiwan (grant number: MOST 109-2410-H-142-004).
Institutional Review Board Statement
The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Research Ethics Committee of National Chengchi University (IRB No. NCCU-REC-202106-I066).
Informed Consent Statement
The online informed consent was obtained from all subjects involved in the study.
Data Availability Statement
Data will be available on the reasonable request from the corresponding author.
Conflicts of Interest
The authors declare no conflict of interest.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Castells M.C., Phillips E.J. Maintaining safety with SARS-CoV-2 vaccines. N. Engl. J. Med. 2021;384:643–649. doi: 10.1056/NEJMra2035343. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Polack F.P., Thomas S.J., Kitchin N., Absalon J., Gurtman A., Lockhart S., Perez J.L., Pérez Marc G., Moreira E.D., Zerbini C., et al. Safety and Efficacy of the BNT162b2 mRNA COVID-19 Vaccine. N. Engl. J. Med. 2020;383:2603–2615. doi: 10.1056/NEJMoa2034577. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.WHO COVID-19 Vaccine Tracker and Landscape. [(accessed on 17 August 2021)]. Available online: https://www.who.int/publications/m/item/draft-landscape-of-covid-19-candidate-vaccines.
- 4.WHO and Cochrane The COVID-NMA Initiative. A Living Mapping and Living Systematic Review of COVID-19 Trials. [(accessed on 23 July 2021)]. Available online: https://covid-nma.com/vaccines/mapping/
- 5.Krammer F. SARS-CoV-2 vaccines in development. Nature. 2020;586:516–527. doi: 10.1038/s41586-020-2798-3. [DOI] [PubMed] [Google Scholar]
- 6.Kessels R., Luyten J., Tubeuf S. Willingness to get vaccinated against COVID-19 and attitudes toward vaccination in general. Vaccine. 2021;39:4716–4722. doi: 10.1016/j.vaccine.2021.05.069. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Odone A., Dallagiacoma G., Frascella B., Signorelli C., Leask J. Current understandings of the impact of mandatory vaccination laws in Europe. Expert Rev. Vaccines. 2021;20:559–575. doi: 10.1080/14760584.2021.1912603. [DOI] [PubMed] [Google Scholar]
- 8.Dror A.A., Eisenbach N., Taiber S., Morozov N.G., Mizrachi M., Zigron A., Srouji S., Sela E. Vaccine hesitancy: The next challenge in the fight against COVID-19. Eur. J. Epidemiol. 2020;35:775–779. doi: 10.1007/s10654-020-00671-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Troiano G., Nardi A. Vaccine hesitancy in the era of COVID-19. Public Health. 2021;194:245–251. doi: 10.1016/j.puhe.2021.02.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Sallam M. COVID-19 vaccine hesitancy worldwide: A concise systematic review of vaccine acceptance rates. Vaccines. 2021;9:160. doi: 10.3390/vaccines9020160. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Paul E., Steptoe A., Fancourt D. Attitudes towards vaccines and intention to vaccinate against COVID-19: Implications for public health communications. Lancet Reg. Health Eur. 2021;1:100012. doi: 10.1016/j.lanepe.2020.100012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Freeman D., Loe B.S., Yu L.M., Freeman J., Chadwick A., Vaccari C., Shanyinde M., Harris V., Waite F., Rosebrock L., et al. Effects of different types of written vaccination information on COVID-19 vaccine hesitancy in the UK (OCEANS-III): A single-blind, parallel-group, randomised controlled trial. Lancet Public Health. 2021;6:e416–e427. doi: 10.1016/S2468-2667(21)00096-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Freeman D., Loe B.S., Chadwick A., Vaccari C., Waite F., Rosebrock L., Jenner L., Petit A., Lewandowsky S., Vanderslott S., et al. COVID-19 vaccine hesitancy in the UK: The Oxford coronavirus explanations, attitudes, and narratives survey (Oceans) II. Psychol. Med. 2020:1–15. doi: 10.1017/S0033291720005188. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Lazarus J.V., Ratzan S.C., Palayew A., Gostin L.O., Larson H.J., Rabin K., Kimball S., El-Mohandes A. A global survey of potential acceptance of a COVID-19 vaccine. Nat. Med. 2021;27:225–228. doi: 10.1038/s41591-020-1124-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Lazarus J.V., Wyka K., Rauh L., Rabin K., Ratzan S., Gostin L.O., Larson H.J., El-Mohandes A. Hesitant or not? The association of age, gender, and education with potential acceptance of a COVID-19 vaccine: A country-level analysis. J. Health Commun. 2020;25:799–807. doi: 10.1080/10810730.2020.1868630. [DOI] [PubMed] [Google Scholar]
- 16.Schernhammer E., Weitzer J., Laubichler M.D., Birmann B.M., Bertau M., Zenk L., Caniglia G., Jäger C.C., Steiner G. Correlates of COVID-19 vaccine hesitancy in Austria: Trust and the government. J. Public Health. 2021:fdab122. doi: 10.1093/pubmed/fdab122. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Montagni I., Ouazzani-Touhami K., Mebarki A., Texier N., Schück S., Tzourio C. Acceptance of a COVID-19 vaccine is associated with ability to detect fake news and health literacy. J. Public Health. 2021:fdab028. doi: 10.1093/pubmed/fdab028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Chong Y.Y., Cheng H.Y., Chan H.Y.L., Chien W.T., Wong S.Y.S. COVID-19 pandemic, infodemic and the role of eHealth literacy. Int. J. Nurs. Stud. 2020;108:103644. doi: 10.1016/j.ijnurstu.2020.103644. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Paakkari L., Okan O. COVID-19: Health literacy is an underestimated problem. Lancet Public Health. 2020;5:e249–e250. doi: 10.1016/S2468-2667(20)30086-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Okan O., Bollweg T.M., Berens E.-M., Hurrelmann K., Bauer U., Schaeffer D. Coronavirus-related health literacy: A cross-sectional study in adults during the COVID-19 infodemic in Germany. Int. J. Environ. Res. Public Health. 2020;17:5503. doi: 10.3390/ijerph17155503. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Al-Jayyousi G.F., Sherbash M.A.M., Ali L.A.M., El-Heneidy A., Alhussaini N.W.Z., Elhassan M.E.A., Nazzal M.A. Factors influencing public attitudes towards COVID-19 vaccination: A scoping review informed by the socio-ecological model. Vaccines. 2021;9:548. doi: 10.3390/vaccines9060548. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Robertson E., Reeve K.S., Niedzwiedz C.L., Moore J., Blake M., Green M., Katikireddi S.V., Benzeval M.J. Predictors of COVID-19 vaccine hesitancy in the UK household longitudinal study. Brain Behav. Immun. 2021;94:41–50. doi: 10.1016/j.bbi.2021.03.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Khubchandani J., Sharma S., Price J.H., Wiblishauser M.J., Sharma M., Webb F.J. COVID-19 vaccination hesitancy in the United States: A rapid aational assessment. J. Community Health. 2021;46:270–277. doi: 10.1007/s10900-020-00958-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Liu T., He Z., Huang J., Yan N., Chen Q., Huang F., Zhang Y., Akinwunmi O.M., Akinwunmi B.O., Zhang C.J.P., et al. A Comparison of Vaccine Hesitancy of COVID-19 Vaccination in China and the United States. Vaccines. 2021;9:649. doi: 10.3390/vaccines9060649. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Szmyd B., Karuga F.F., Bartoszek A., Staniecka K., Siwecka N., Bartoszek A., Błaszczyk M., Radek M. Attitude and behaviors towards SARS-CoV-2 vaccination among healthcare Workers: A cross-sectional study from Poland. Vaccines. 2021;9:218. doi: 10.3390/vaccines9030218. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Elhadi M., Alsoufi A., Alhadi A., Hmeida A., Alshareea E., Dokali M., Abodabos S., Alsadiq O., Abdelkabir M., Ashini A., et al. Knowledge, attitude, and acceptance of healthcare workers and the public regarding the COVID-19 vaccine: A cross-sectional study. BMC Public Health. 2021;21:955. doi: 10.1186/s12889-021-10987-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Gagneux-Brunon A., Detoc M., Bruel S., Tardy B., Rozaire O., Frappe P., Botelho-Nevers E. Intention to get vaccinations against COVID-19 in French healthcare workers during the first pandemic wave: A cross-sectional survey. J. Hosp. Infect. 2021;108:168–173. doi: 10.1016/j.jhin.2020.11.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Kukreti S., Lu M.Y., Lin Y.H., Strong C., Lin C.Y., Ko N.Y., Chen P.L., Ko W.C. Willingness of Taiwan’s healthcare workers and outpatients to vaccinate against COVID-19 during a period without community outbreaks. Vaccines. 2021;9:246. doi: 10.3390/vaccines9030246. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Chew N.W.S., Cheong C., Kong G., Phua K., Ngiam J.N., Tan B.Y.Q., Wang B., Hao F., Tan W., Han X., et al. An Asia-Pacific study on healthcare workers’ perceptions of, and willingness to receive, the COVID-19 vaccination. Int. J. Infect. Dis. 2021;106:52–60. doi: 10.1016/j.ijid.2021.03.069. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Biswas N., Mustapha T., Khubchandani J., Price J.H. The Nature and extent of COVID-19 vaccination hesitancy in healthcare workers. J. Community Health. 2021:1–8. doi: 10.1007/s10900-021-00984-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Kelekar A.K., Lucia V.C., Afonso N.M., Mascarenhas A.K. COVID-19 vaccine acceptance and hesitancy among dental and medical students. J. Am. Dent. Assoc. 2021;152:596–603. doi: 10.1016/j.adaj.2021.03.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Mascarenhas A.K., Lucia V.C., Kelekar A., Afonso N.M. Dental students’ attitudes and hesitancy toward COVID-19 vaccine. J. Dent. Educ. 2021 doi: 10.1002/jdd.12632. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Jain J., Saurabh S., Kumar P., Verma M.K., Goel A.D., Gupta M.K., Bhardwaj P., Raghav P.R. COVID-19 vaccine hesitancy among medical students in India. Epidemiol. Infect. 2021;149:e132. doi: 10.1017/S0950268821001205. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Tavolacci M.P., Dechelotte P., Ladner J. COVID-19 vaccine acceptance, hesitancy, and resistancy among university students in France. Vaccines. 2021;9:654. doi: 10.3390/vaccines9060654. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Lucia V.C., Kelekar A., Afonso N.M. COVID-19 vaccine hesitancy among medical students. J. Public Health. 2020:fdaa230. doi: 10.1093/pubmed/fdaa230. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Racey C.S., Donken R., Porter I., Albert A., Bettinger J.A., Mark J., Bonifacio L., Dawar M., Gagel M., Kling R., et al. Intentions of public school teachers in British Columbia, Canada to receive a COVID-19 vaccine. Vaccine X. 2021;8:100106. doi: 10.1016/j.jvacx.2021.100106. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Handebo S., Wolde M., Shitu K., Kassie A. Determinant of intention to receive COVID-19 vaccine among school teachers in Gondar City, Northwest Ethiopia. PLoS ONE. 2021;16:e0253499. doi: 10.1371/journal.pone.0253499. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.COVID-HL Consortium. COVID-HL Network The COVID-HL School Survey. [(accessed on 15 June 2021)]. Available online: https://covid-hl.eu/research/school-survey/
- 39.Faul F., Erdfelder E., Lang A.-G., Buchner A. G* Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav. Res. Methods. 2007;39:175–191. doi: 10.3758/BF03193146. [DOI] [PubMed] [Google Scholar]
- 40.Pan W.-C. 2021–2022 Education in Taiwan. Department of Statistics, Ministry of Education; Taipei, Taiwan: 2021. [(accessed on 15 June 2021)]. p. 43. Available online: https://stats.moe.gov.tw/files/ebook/Education_in_Taiwan/2021-2022_Education_in_Taiwan.pdf. [Google Scholar]
- 41.Ministry of Education The Regulation Regarding Facilities and Equipment for Primary and Junior High Schools. [(accessed on 24 July 2019)]; Available online: https://edu.law.moe.gov.tw/LawContent.aspx?id=GL000314.
- 42.Editorial Overview of Novel Coronavirus (2019-nCoV) [(accessed on 10 February 2020)]. Available online: https://bestpractice.bmj.com/topics/en-gb/3000165.
- 43.Ahorsu D.K., Lin C.Y., Imani V., Saffari M., Griffiths M.D., Pakpour A.H. The Fear of COVID-19 Scale: Development and initial validation. Int. J. Ment. Health Addict. 2020:1–9. doi: 10.1007/s11469-020-00270-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Lin C.Y., Hou W.L., Mamun M.A., Aparecido da Silva J., Broche-Pérez Y., Ullah I., Masuyama A., Wakashima K., Mailliez M., Carre A., et al. Fear of COVID-19 Scale (FCV-19S) across countries: Measurement invariance issues. Nurs. Open. 2021;8:1892–1908. doi: 10.1002/nop2.855. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Chang K.C., Hou W.L., Pakpour A.H., Lin C.Y., Griffiths M.D. Psychometric testing of three COVID-19-related scales among people with mental illness. Int. J. Ment. Health Addict. 2020:1–13. doi: 10.1007/s11469-020-00361-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Pakpour A.H., Griffiths M.D., Chang K.C., Chen Y.P., Kuo Y.J., Lin C.Y. Assessing the fear of COVID-19 among different populations: A response to Ransing et al. (2020) Brain Behav. Immun. 2020;89:524–525. doi: 10.1016/j.bbi.2020.06.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Roberti J.W., Harrington L.N., Storch E.A. Further psychometric support for the 10-Item version of the Perceived Stress Scale. J. Coll. Couns. 2006;9:135–147. doi: 10.1002/j.2161-1882.2006.tb00100.x. [DOI] [Google Scholar]
- 48.Lee E.H., Chung B.Y., Suh C.H., Jung J.Y. Korean versions of the Perceived Stress Scale (PSS-14, 10 and 4): Psychometric evaluation in patients with chronic disease. Scand. J. Caring Sci. 2015;29:183–192. doi: 10.1111/scs.12131. [DOI] [PubMed] [Google Scholar]
- 49.Makhubela M. Assessing psychological stress in South African university students: Measurement validity of the perceived stress scale (PSS-10) in diverse populations. Curr. Psychol. 2020 doi: 10.1007/s12144-020-00784-3. [DOI] [Google Scholar]
- 50.Chang P.Y., Chang T.H., Yu J.M. Perceived stress and social support needs among primary family caregivers of ICU patients in Taiwan. Heart Lung. 2021;50:491–498. doi: 10.1016/j.hrtlng.2021.03.001. [DOI] [PubMed] [Google Scholar]
- 51.Chiu Y.H., Lu F.J., Lin J.H., Nien C.L., Hsu Y.W., Liu H.Y. Psychometric properties of the Perceived Stress Scale (PSS): Measurement invariance between athletes and non-athletes and construct validity. PeerJ. 2016;4:e2790. doi: 10.7717/peerj.2790. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Kuo F.L., Yang P.H., Hsu H.T., Su C.Y., Chen C.H., Yeh I.J., Wu Y.H., Chen L.C. Survey on perceived work stress and its influencing factors among hospital staff during the COVID-19 pandemic in Taiwan. Kaohsiung J. Med. Sci. 2020;36:944–952. doi: 10.1002/kjm2.12294. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Topp C.W., Østergaard S.D., Søndergaard S., Bech P. The WHO-5 Well-Being Index: A systematic review of the literature. Psychother. Psychosom. 2015;84:167–176. doi: 10.1159/000376585. [DOI] [PubMed] [Google Scholar]
- 54.Sischka P.E., Costa A.P., Steffgen G., Schmidt A.F. The WHO-5 well-being index—Validation based on item response theory and the analysis of measurement invariance across 35 countries. J. Affect. Disord. Rep. 2020;1:100020. doi: 10.1016/j.jadr.2020.100020. [DOI] [Google Scholar]
- 55.Wu S.F. Rapid screening of psychological well-being of patients with chronic illness: Reliability and validity test on WHO-5 and PHQ-9 scales. Depress. Res. Treat. 2014;2014:239490. doi: 10.1155/2014/239490. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Wang C.P., Lu Y.C., Hung W.C., Tsai I.T., Chang Y.H., Hu D.W., Hsu C.C., Wu C.C., Wei C.T., Chung F.M., et al. Inter-relationship of risk factors and pathways associated with chronic kidney disease in patients with type 2 diabetes mellitus: A structural equation modelling analysis. Public Health. 2021;190:135–144. doi: 10.1016/j.puhe.2020.02.007. [DOI] [PubMed] [Google Scholar]
- 57.Wu Y.C., Kornelius E., Yang Y.S., Chen Y.F., Huang C.N. An educational intervention using steno balance cards to improve glycemic control in patients with poorly controlled type 2 diabetes mellitus. J. Nurs. Res. 2019;27:1–7. doi: 10.1097/jnr.0000000000000275. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Vogt K., Jenny G.J., Bauer G.F. Comprehensibility, manageability and meaningfulness at work: Construct validity of a scale measuring work-related sense of coherence. SA J. Ind. Psychol. 2013;39:1–8. doi: 10.4102/sajip.v39i1.1111. [DOI] [Google Scholar]
- 59.Leung A.Y.M., Parial L.L., Tolabing M.C., Sim T., Mo P., Okan O., Dadaczynski K. Sense of coherence mediates the relationship between digital health literacy and anxiety about the future in aging population during the COVID-19 pandemic: A path analysis. Aging Ment. Health. 2021:1–10. doi: 10.1080/13607863.2020.1870206. [DOI] [PubMed] [Google Scholar]
- 60.Willem S., Melanie R., Jon A.K., Eric M.S. Comparing questions with agree/disagree response options to questions with item-specific response options. Surv. Res. Methods. 2010;4:61–79. [Google Scholar]
- 61.Doane D.P., Seward L.E. Measuring skewness: A forgotten statistic? J. Stat. Educ. 2011;19:1–18. doi: 10.1080/10691898.2011.11889611. [DOI] [Google Scholar]
- 62.Field A. Discovering Statistics Using IBM SPSS Statistics. 4th ed. Sage; London, UK: 2013. [Google Scholar]
- 63.Duong T.V., Aringazina A., Baisunova G., Nurjanah N., Pham T.V., Pham K.M., Truong T.Q., Nguyen K.T., Oo W.M., Su T.T., et al. Development and validation of a new short-form health literacy instrument (HLS-SF12) for the general public in six Asian countries. Health Lit. Res. Pract. 2019;3:e91–e102. doi: 10.3928/24748307-20190225-01. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Duong T.V., Nguyen T.T.P., Pham K.M., Nguyen K.T., Giap M.H., Tran T.D.X., Nguyen C.X., Yang S.-H., Su C.-T. Validation of the short-form health literacy questionnaire (HLS-SF12) and its determinants among people living in rural areas in Vietnam. Int. J. Environ. Res. Public Health. 2019;16:3346. doi: 10.3390/ijerph16183346. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Terwee C.B., Bot S.D.M., de Boer M.R., van der Windt D.A.W.M., Knol D.L., Dekker J., Bouter L.M., de Vet H.C.W. Quality criteria were proposed for measurement properties of health status questionnaires. J. Clin. Epidemiol. 2007;60:34–42. doi: 10.1016/j.jclinepi.2006.03.012. [DOI] [PubMed] [Google Scholar]
- 66.Cronbach L.J., Shavelson R.J. My current thoughts on coefficient alpha and successor procedures. Educ. Psychol. Meas. 2004;64:391–418. doi: 10.1177/0013164404266386. [DOI] [Google Scholar]
- 67.Maldonado G., Greenland S. Simulation study of confounder-selection strategies. Am. J. Epidemiol. 1993;138:923–936. doi: 10.1093/oxfordjournals.aje.a116813. [DOI] [PubMed] [Google Scholar]
- 68.Tavakol M., Dennick R. Making sense of Cronbach’s alpha. Int. J. Med. Educ. 2011;2:53–55. doi: 10.5116/ijme.4dfb.8dfd. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Taiwan Centers for Disease Control Attention COVID-19. [(accessed on 17 July 2021)]; Available online: https://www.cdc.gov.tw/En.
- 70.Stojanovic J., Boucher V.G., Gagne M., Gupta S., Joyal-Desmarais K., Paduano S., Aburub A.S., Sheinfeld Gorin S.N., Kassianos A.P., Ribeiro P.A.B., et al. Global trends and correlates of COVID-19 vaccination hesitancy: Findings from the iCARE study. Vaccines. 2021;9:661. doi: 10.3390/vaccines9060661. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Qiu X., Bailey H., Thorne C. Barriers and facilitators associated with vaccine acceptance and uptake among pregnant women in high income countries: A mini-review. Front. Immunol. 2021;12:626717. doi: 10.3389/fimmu.2021.626717. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Elgendy M.O., Abdelrahim M.E.A. Public awareness about coronavirus vaccine, vaccine acceptance, and hesitancy. J. Med. Virol. 2021 doi: 10.1002/jmv.27199. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Yilmaz S., Çolak F., Yilmaz E., Ak R., Hökenek N.M., Altıntaş M.M. Vaccine hesitancy of healthcare workers: Another challenge in the fight against COVID-19 in Istanbul. Disaster Med. Public Health Prep. 2021:1–18. doi: 10.1017/dmp.2021.257. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Palgi Y., Bergman Y.S., Ben-David B., Bodner E. No psychological vaccination: Vaccine hesitancy is associated with negative psychiatric outcomes among Israelis who received COVID-19 vaccination. J. Affect. Disord. 2021;287:352–353. doi: 10.1016/j.jad.2021.03.064. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Bendau A., Plag J., Petzold M.B., Ströhle A. COVID-19 vaccine hesitancy and related fears and anxiety. Int. Immunopharmacol. 2021;97:107724. doi: 10.1016/j.intimp.2021.107724. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Luk T.T., Zhao S., Wu Y., Wong J.Y., Wang M.P., Lam T.H. Prevalence and determinants of SARS-CoV-2 vaccine hesitancy in Hong Kong: A population-based survey. Vaccine. 2021;39:3602–3607. doi: 10.1016/j.vaccine.2021.05.036. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Huynh G., Nguyen T.V., Nguyen D.D., Lam Q.M., Pham T.N., Nguyen H.T.N. Knowledge about COVID-19, beliefs and vaccination acceptance against COVID-19 among high-risk people in Ho Chi Minh city, Vietnam. Infect. Drug Resist. 2021;14:1773–1780. doi: 10.2147/IDR.S308446. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Mohamad O., Zamlout A., AlKhoury N., Mazloum A.A., Alsalkini M., Shaaban R. Factors associated with the intention of Syrian adult population to accept COVID19 vaccination: A cross-sectional study. BMC Public Health. 2021;21:1310. doi: 10.1186/s12889-021-11361-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Hashemi-Shahri S.M., Khammarnia M., Ansari-Moghaddam A., Setoodehzadeh F., Okati-Aliabad H., Peyvand M. Sources of news as a necessity for improving community health literacy about COVID-19. Med. J. Islam. Repub. Iran. 2020;34:453–455. doi: 10.34171/mjiri.34.63. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Guljaš S., Bosnić Z., Salha T., Berecki M., Krivdić Dupan Z., Rudan S., Majnarić Trtica L. Lack of informations about COVID-19 vaccine: From implications to intervention for supporting public health communications in COVID-19 pandemic. Int. J. Environ. Res. Public Health. 2021;18:6141. doi: 10.3390/ijerph18116141. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Schwarzinger M., Luchini S. Addressing COVID-19 vaccine hesitancy: Is official communication the key? Lancet Public Health. 2021;6:e353–e354. doi: 10.1016/S2468-2667(21)00108-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 82.Finney Rutten L.J., Zhu X., Leppin A.L., Ridgeway J.L., Swift M.D., Griffin J.M., St Sauver J.L., Virk A., Jacobson R.M. Evidence-based strategies for clinical organizations to address COVID-19 vaccine hesitancy. Mayo Clin. Proc. 2021;96:699–707. doi: 10.1016/j.mayocp.2020.12.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.Kerr J.R., Freeman A.L.J., Marteau T.M., van der Linden S. Effect of information about COVID-19 vaccine effectiveness and side effects on behavioural intentions: Two online experiments. Vaccines. 2021;9:379. doi: 10.3390/vaccines9040379. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Freeman D., Lambe S., Yu L.M., Freeman J., Chadwick A., Vaccari C., Waite F., Rosebrock L., Petit A., Vanderslott S., et al. Injection fears and COVID-19 vaccine hesitancy. Psychol. Med. 2021:1–11. doi: 10.1017/S0033291721002609. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 85.Davis C.J., Golding M., McKay R. Efficacy information influences intention to take COVID-19 vaccine. Br. J. Health Psychol. 2021 doi: 10.1111/bjhp.12546. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Patel M.S. Text-message nudges encourage COVID vaccination. Nature. 2021 doi: 10.1038/d41586-021-02043-2. [DOI] [PubMed] [Google Scholar]
- 87.Kozlov M. A simple text has the power to increase COVID vaccinations. Nature. 2021 doi: 10.1038/d41586-021-02108-2. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Data will be available on the reasonable request from the corresponding author.