Abstract
Background
The Summit of Independent European Vaccination Experts (SIEVE) recommended in 2007 that efforts be made to improve healthcare workers’ knowledge and beliefs about vaccines, and their attitudes towards them, to increase vaccination coverage. The aim of the study was to compile and analyze the areas of disagreement in the existing evidence about the relationship between healthcare workers’ knowledge, beliefs and attitudes about vaccines and their intentions to vaccinate the populations they serve.
Methods
We conducted a systematic search in four electronic databases for studies published in any of seven different languages between February 1998 and June 2009. We included studies conducted in developed countries that used statistical methods to relate or associate the variables included in our research question. Two independent reviewers verified that the studies met the inclusion criteria, assessed the quality of the studies and extracted their relevant characteristics. The data were descriptively analyzed.
Results
Of the 2354 references identified in the initial search, 15 studies met the inclusion criteria. The diversity in the study designs and in the methods used to measure the variables made it impossible to integrate the results, and each study had to be assessed individually. All the studies found an association in the direction postulated by the SIEVE experts: among healthcare workers, higher awareness, beliefs that are more aligned with scientific evidence and more favorable attitudes toward vaccination were associated with greater intentions to vaccinate. All the studies included were cross-sectional; thus, no causal relationship between the variables was established.
Conclusion
The results suggest that interventions aimed at improving healthcare workers’ knowledge, beliefs and attitudes about vaccines should be encouraged, and their impact on vaccination coverage should be assessed.
Keywords: Immunization, Vaccination, Knowledge, Belief, Attitude, Healthcare worker, Coverage, Intentions
Background
Vaccination against preventable diseases is safe and cost-effective, and it has had an important impact on public health worldwide [1]. Because of universal vaccination, various diseases have been eradicated or substantially reduced in many countries [2]. However, vaccine coverage is still not sufficient to control some diseases, such as the measles, which the World Health Organization pledged in 1997 to eradicate from Western Europe by 2007. Recent years have seen repeated outbreaks in this region [3], including epidemics such as the one that occurred in Germany in 2006 [4].
Studies that investigate why a segment of the population does not accept universal vaccination [5-7] have highlighted reasons such as lack of knowledge, misperceptions and distrust in vaccines [8], combined with a low perceived risk of acquiring the disease because the incidence has declined as a result of vaccination programs [9]. Even HCW (healthcare workers) have low vaccine coverage, as is the case with the influenza vaccine, due to various factors, including knowledge about the disease, knowledge about the vaccine or past beliefs and past attitudes (related to influenza vaccination in previous seasons) [10,11].
Despite the significant impact of the media, health professionals have been identified as the most important source of information on vaccination for the general public. Health professionals are key players in recommending vaccination and encouraging the final decision to be vaccinated [12-17]. Therefore, the willingness of health professionals to recommend immunization is crucial. The Summit of Independent European Vaccination Experts (SIEVE) reported in 2007 [18] that strategies to optimize vaccination coverage in children and adults in Europe should be identified and targeted towards healthcare workers (HCWs). SIEVE emphasized the importance of HCWs’ perceptions about vaccines, their attitudes towards them and the need to improve their knowledge of vaccines and increase access to high-quality information about vaccination.
In this context, we posed the following question: Is there a relationship between HCWs’ knowledge of vaccines, their beliefs and attitudes towards them and their intentions to vaccinate the population they serve? To answer this question, we performed a systematic review of the literature on the subject to compile the existing information and identify the areas of disagreement in the knowledge base.
Methods
First, we performed a pilot study, analyzing the abstracts of the publications we found in our PubMed search that met the inclusion criteria. This process provided an overview of the main features that should be included in the review and allowed us to prepare the protocol for extracting data.
Search strategy
In June 2009, a literature search was conducted in the PubMed, EMBASE, CINAHL and CENTRAL databases for articles published in one of seven different languages. To ensure that our search was thorough, the search in each database was conducted using both free and controlled language. For the free-text search, the terms included the following: (vaccination OR immunization) AND (healthcare worker OR complementary therapies) AND (knowledge OR beliefs OR attitudes OR barriers). The controlled language search included the following exploded MeSH terms: "Immunization", "Occupational Groups", "Beliefs", "Culture" and "Attitude". The only filter applied was the date of publication; studies were included if they were published between February 1998 and the present (i.e., June 2009). Additional file 1 shows the complete search strategy used in Medline. In addition, for further material, the references of the retrieved articles were manually searched, and key authors were contacted and asked to identify published and unpublished studies that met the inclusion criteria.
Article selection
After the preliminary selection of potentially relevant titles, two authors (MJA and RH) independently assessed the study abstracts for inclusion or exclusion based on the established criteria (Additional file 2). Based on the abstracts, a consensus decision was made about reading the full text; the full text was read when there was any doubt. To ensure the fulfillment of the inclusion criteria and the exclusion of studies with data collected before the cut-off point, all the studies published after February 1998 that met the inclusion criteria were initially included and read in their entirety by the investigators. Disagreements in the final selection were resolved by consensus, and in cases of continuing disagreement, through consultation with a third reviewer (CD). The reviewers also recorded and compared their reasons for excluding studies, and a consensus was reached when there were disagreements. To determine the degree of agreement in the selection of abstracts and full papers, the Kappa index of inter-observer agreement was calculated using the tool accessible at the following website: http://faculty.vassar.edu/lowry/kappa.html.
Data extraction and critical appraisal
Each included study was reviewed independently by two investigators (MJA and RH), and the principal characteristics were extracted using a coding method developed in the pilot study. The risk of bias was evaluated using the Newcastle Ottawa scale for case–control studies and an adapted form of the Newcastle Ottawa cohort scale for cross-sectional studies (Additional file 3). Disagreements were resolved by consensus. Results are shown in Table 1.
Table 1.
Study (first author) |
Study design |
Selection |
Comparability |
Outcome |
|||||
---|---|---|---|---|---|---|---|---|---|
Representativeness of the sample | Sample size | Non-respondents | Ascertainment of exposure | Based on design and analysis | Assessment of outcome | Statistical test | |||
Gonik et al. (2000) [19] |
Cross-sectional |
+ |
|
|
+ |
|
+ |
|
|
Schupfner et al. (2002) [20] |
Cross-sectional |
+ |
+ |
|
+ |
++ |
+ |
+ |
|
Taylor et al. (2002) [21] |
Cross-sectional |
|
|
|
+ |
++ |
++ |
+ |
|
Zimmerman et al. (2002) [22] |
Cross-sectional |
+ |
|
+ |
+ |
++ |
+ |
+ |
|
Davis et al. (2003) [23] |
Cross-sectional |
+ |
|
+ |
+ |
++ |
+ |
+ |
|
Milledge et al. (2003) [24] |
Cross-sectional |
+ |
+ |
+ |
+ |
++ |
+ |
+ |
|
Jungbauer-Gans et al. (2003) 1st part [25] |
Cross-sectional |
+ |
|
|
+ |
|
+ |
+ |
|
Jungbauer-Gans et al. (2003) 2nd part [25] |
Cross-sectional |
+ |
|
|
+ |
|
++ |
+ |
|
Wilson et al. (2004) [26] |
Cross-sectional |
+ |
+ |
+ |
+ |
++ |
+ |
+ |
|
Russell et al. (2004) [27] |
Cross-sectional |
+ |
+ |
+ |
+ |
++ |
+ |
+ |
|
Petousis-Harris et al. (2005) [28] |
Cross-sectional |
+ |
+ |
|
+ |
|
+ |
|
|
Clark et al. (2006) [29] |
Cross-sectional |
+ |
|
|
+ |
|
+ |
|
|
Davis et al. (2007) [30] |
Cross-sectional |
+ |
+ |
|
+ |
|
+ |
+ |
|
Gust et al. (2008) [31] |
Cross-sectional |
+ |
|
|
+ |
++ |
+ |
+ |
|
Goodyear-Smith et al. (2009) [32] |
Cross-sectional |
+ |
+ |
+ |
+ |
++ |
++ |
+ |
|
Study (first author) |
Study design |
Selection |
Comparability |
Exposure |
|||||
Case definition adequate? |
Representativeness of the cases |
Selection of controls |
Definition of controls |
Based on design and analysis |
Ascertainment of exposure |
Same method for cases and controls |
Non-response rate |
||
Salmon et al. (2008) [33] | Case–control | + | + | + | + | + | + |
The results of the included studies are shown in tables. Three tables show the associations found in the cross-sectional studies between the intention to vaccinate and HCWs’ knowledge (Table 2), beliefs (Table 3) and attitudes (Table 4). A fourth table shows the results of the case–control study (Table 5). All studies that aimed to show a possible relationship or an association between the variables were included; there were no restrictions based on the statistical methods used. The adjustments used in the statistical analysis in each study are listed in the last column of the tables, grouped into the following topics: A) Location, B) Demographic characteristics of the patients, C) Practice organization, D) Characteristics of the HCW involved in the study, E) Vaccination-related characteristics, F) HCW experience with morbidity and mortality associated with vaccine-preventable diseases.
Table 2.
Authors | Setting | Study population/response rate | Determinant (knowledge) | Intention to vaccinate | Measure of association | Adjustments |
---|---|---|---|---|---|---|
Taylor et al. (2002) [21] |
USA |
112/? pediatricians |
Knowledge in vaccine contraindications |
Increase of record linked vaccine coverage per each contraindication less stated |
At 8 months |
2B,1C,3E |
2.0% (95% CI 0.3-3.7) p < 0.05 | ||||||
At 19 months | ||||||
2.6% (95% CI 1.1 - 4.7) p < 0.05 | ||||||
Petousis-Harris et al. (2005) [28] |
New Zealand |
150/89,3% family practice nurses |
Knowledge in vaccine contraindications |
Report of vaccination coverage |
Significantly greater rate of correct responses in those reporting high coverage (>95) than in those reporting low coverage (<70%). p < 0.05 |
None |
Goodyear-Smith et al. (2009) [32] |
New Zealand |
106/58% general practitioners |
Knowledge in vaccine contraindications |
Record linked vaccine coverage |
Results shown by region and practice governance: |
1A, 2B, 1C, 1D |
Auckland: Maori with right response, median coverage (MC) 30%. Maori with missed response, no practice with these characteristics. Non-Maori right, MC 71%, Non-Maori missed, MC 64%. | ||||||
Midland: Maori right, MC 58%. Maori missed, MC 56%. Non-Maori right, MC 78%. Non-Maori missed, MC 73%. | ||||||
After multivariate analysis, the knowledge remained associated with the coverage (p < 0.05). |
Table 3.
Authors | Setting | Study population/response rate | Determinant (belief) | Intention to vaccinate | Measure of association | Adjustments |
---|---|---|---|---|---|---|
Zimmerman et al. (2002) [22] |
USA |
281/72,4% general practitioners, family practice, pediatricians |
Perception of: A) Efficacy of the vaccine. yes vs no |
Would recommend vaccination |
A) To children 12–18 months: 85% vs 70% (p < 0.05) |
1A, 1C, 1D, 3E, 1F |
To children 4–6 years: 85% vs 80% (p < 0.05) | ||||||
To children 11–12 years: 86% vs 83% (p > 0.05) | ||||||
B) Storing the vaccine being a major problem. Yes vs no |
B) To children 12-18m: 62% vs 86% (p < 0.05) To Children 4–6 years: 73% vs 85% (p > 0.05) To children 11–12 years: 76% vs 87% (p > 0.05) |
|||||
Schupfner et al. (2002) [20] |
Germany |
97/73% pediatricians |
Belief that: A) Official vaccination recommendations are influenced by the industry |
Reported vaccine coverage rate |
A) 60% of those reporting high coverage rate (>80%). 46% of those with low coverage rate (<80%). p > 0.05 |
2C, 4D, 4E |
B) Behavior in vaccination is mostly conditioned by physician's beliefs |
B) 66% of those with high coverage and 59% of those with low coverage. p > 0.05 |
|||||
Davis et al. (2003) [23] |
USA |
694/60% family physicians |
Believe the new 7-valent pneumococcal vaccine will effectively prevent meningitis |
Reported habit of recommending the vaccine |
OR 1.86 (95% CI 0.93, 3.73) p > 0.05 |
4E, 1F |
Milledge et al. (2003) [24] |
Australia |
160/67% general practitioners |
Agreement that the following are a deterrent to vaccination: A) Cost- to- parent |
Would recommend universal varicella vaccination |
A) OR 1.54 (95% CI:0.70-3.38) p > 0.05 |
1B, 1C, 7E, 2F |
B) Another needle |
B) OR 0.79 (0.33–1.49) p > 0.05 |
|||||
Jungbauer-Gans et al. (2003) [25] |
Germany |
136/71% family physicians and pediatricians |
Training in alternative medicine |
Reported habit of recommending full vaccination |
With training 63%, without training 78%. p > 0.05 for the difference |
None |
|
|
94/71% family physicians and pediatricians |
Training in alternative medicine |
Record linked vaccine coverage |
Beta: -0,121 (p < 0.05) |
None |
Wilson et al. (2004) [26] |
Canada |
312/59,4% naturopathic students |
Belief that: A) Vaccines are beneficial |
Willingness to advise full vaccination |
A) OR: 16.4 (95% CI 5.15–73.6) p < 0.05 |
1D, 5E |
B) Vaccines are risky |
B) OR: 0.30 ( 0.11–0.74) p < 0.05 |
|||||
Russell et al. (2004) [27] |
Canada |
503/78,2% chiropractors |
Belief that: A) Vaccines are safe and efficacious |
Reported habit of recommending vaccination |
A) OR 25.2 [95% CI 8.7-72.7] p < 0.05 |
2D, 4E |
B) Social orientation of heath |
B) OR 2.9 [95% CI 1.7-5.1] p < 0.05 |
|||||
C) Broad view of chiropractic practice |
C) OR 0.6 [95% CI 0.3-1.1] p > 0.05 |
|||||
D) People are informed |
D) OR 1.5 [IC95 % 0.9–2.5] p > 0.05 |
|||||
E) Chiropractors should recommend vaccination |
E) OR 0.9 [IC95 % 0.5–1.4] p > 0.05 |
|||||
F) I believe in physicians who think I should recommend vaccination | F) OR 1.5 [IC95 % 1.0–2.4] p > 0.05 |
Table 4.
Authors | Setting | Study population/response rate | Determinant (attitude) | Intention to vaccinate | Measure of association | Adjustments |
---|---|---|---|---|---|---|
Gonik et al. (2000) [19] |
USA |
313/43% Obstetrician-gynecologists |
Assess routinely the patients for vaccine- preventable diseases |
Reported habit to administer vaccines |
Spearman rho correlation 0.30–0.70; p < 0.05 |
None |
Zimmerman et al. (2002) [22] |
USA |
281/72,4% general practitioners, family practice, pediatricians |
Agreement with the national recommendations on varicella vaccination. Yes vs no |
Would recommend the vaccination |
In children 12–18 months: 98% |
1A,1C, 1D,3E, 1F |
vs 3%, p < 0.05 | ||||||
Children 4–6 years: 93% | ||||||
vs 19%, p < 0.05 | ||||||
Children 11–12 years: | ||||||
86% vs 68%, p < 0.05 | ||||||
Taylor et al. (2002) [21] |
USA |
112/? pediatricians |
A) Number of injections willing to give in one visit. Range 1 to 6 (>5) |
Increase of record linked vaccine coverage |
A) Per each injection more: Increase at 8 months of 3.6% (95% CI 0.4-6.8) p > 0.05, at 19 months 1.5% (95% CI −2.8 - 5.5) p > 0.05 |
2B, 1C, 3E |
B) Recommendation of inactivated polio vaccine (IPV) vs oral vaccine |
B) Using IPV: Increase at 8 months of 8.9% (95% CI 3.3-15.4) p < 0.05, at 19 months 15.4% (95% CI 7.7 - 23.1) p < 0.05 |
|||||
Schupfner et al. (2002) [20] |
Germany |
97/73% pediatricians |
Prefer to give combined vaccines than separate |
Reported vaccine coverage rate |
100% in those with high reported coverage (>80%) vs 81% in low coverage (<80%) p > 0.05 |
2C,4D,4E |
Milledge et al. (2003) [24] |
Australia |
160/67% general practitioners |
Concerns about varicella vaccine: A) Immunity may not be life-long |
Would recommend universal varicella vaccination |
A) OR 0.60 (95%CI 0.33-1.21) p > 0.05 |
1B, 1C, 7E, 2F |
B) Increase in herpes zoster |
B) OR 1.08 (0.33-3.6) p > 0.05 |
|||||
C) More serious varicella disease in adults |
C) OR 0.92 (0.37-2.27) p > 0.05 |
|||||
D) Possible, unknown side effects |
D) OR: 0.31 (0.15–0.63) p > 0.05 |
|||||
Davis et al. (2003) [23] |
USA |
694/60% family physicians |
A) Considers giving 5 injections at 1 visit vs less |
Reported habit of recommending the vaccine |
A) OR 17.29 (95% CI 6.35, 47.05) p < 0.05 |
4E, 1F |
B) Considers giving 4 injections at 1 visit vs less |
B) OR 8.69(95% CI 4.21, 17.94) p < 0.05 |
|||||
Jungbauer-Gans et al. (2003) [25] |
Germany |
136/71% family physicians and pediatricians |
Importance of the officially recommended vaccinations (Index: 1 = not at all, 5 = very) |
Reported habit of recommending full vaccination |
Index of 4.8 in those recommending full vaccination vs 3.9 in those who did not. p < 0.05 |
None |
|
|
94/71% family physicians and pediatricians |
Importance of the officially recommended vaccinations (same Index) |
Record linked vaccine coverage |
One point increase in the Index was associated with an increase of 25.8% in the coverage. p < 0.05 |
None |
Wilson et al. (2004) [26] |
Canada |
312/59,4% naturopathic students |
Trust in Public Health information |
Willingness to advise full vaccination |
OR 3.72 (95% CI 1.42–10.7) p < 0.05 |
1D, 5E |
Clark et al. (2006) [29] |
USA |
183/54% obstetricians |
Perceive to have a role in promote Tdap vaccination to other adults (not mothers) in contact with infants |
Report to recommend Tdap vaccine to pregnant women |
77% perceive having a role in those recommending vaccine to pregnant women vs 50% in those who do not. p < 0.05 |
None |
Davis et al. (2007) [30] |
USA |
336/49% family physicians, general internists |
Agree that pertoussis is serious enough to warrant using Tdap in adults. Yes vs no or neutral |
Would recommend the vaccination if recommended |
93% vs 68%. p < 0.05 |
None |
Gust et al. (2008) [31] | USA | 733/65% family physicians, pediatricians | Have some concerns about immunization | Recommend full immunization | OR 0.32 (95% CI 0.56-0.19) p < 0.05 | 1C, 1D, 1E |
Table 5.
Authors | Setting | Study population/respnse rate | Determinant | Intention to vaccinate | Measure of association | Adjustments |
---|---|---|---|---|---|---|
Salmon et al. (2008) [33] |
USA |
Sample size 551 (55 cases/432 controls/64 mixed c ). Primary healthcare professionals |
Beliefs |
Cases: Primary healthcare professionals of unvaccinated |
|
Medical doctors or doctors in osteopathy |
A1) Disease susceptibility |
A1) OR 1.39 (95%CI:0.68–2.85) p < 0.05 |
|||||
A2) Disease severity |
children at school entry. vs Controls: Primary healthcare professionals only of vaccinated children. |
A2) OR 0.90 (0.59–1.38) p < 0.05 |
||||
A3) Vaccine efficacy |
A3) OR 1.37(0.65–2.86) p < 0.05 |
|||||
A4) Vaccine security |
A4) OR 0.37 (0.19-0.72) p < 0.05 |
|||||
B) Benefit when a child is fully vaccinated for: B1) Child |
B1) OR 0.30 (0.10–0.85) p < 0.05 |
|||||
B2) Community |
B2) OR 0.28 (0.09–0.88) p < 0.05 |
|||||
B3) Primary care practitioner |
B3) OR 0.59 (0.39–0.90) p < 0.05 |
|||||
B4) Insurance company |
B4) OR 0.56 (0.32–0.99) p < 0.05 |
|||||
B5) Government |
B5) OR 0.55 (0.32–0.96) p < 0.05 |
|||||
B6) Vaccine companies |
B6) OR 0.57 (0.30–1.10) p < 0.05 |
|||||
C) Agree or completely agree with the following statements: C1) Children get more immunizations than are good for them |
C1) OR 2.28 (1.56-5.10) p < 0.05 |
|||||
C2) A good diet is more important |
C2)OR 3.68 (1.61-8.38) p < 0.05 |
|||||
C3) Child’s immune system could be weakened |
C3) OR 4.03 (2.06-7.86) p < 0.05 |
|||||
C4) Better to develop immunity by getting sick |
C4) OR 4.08 (1.9-8.76) p < 0.05 |
|||||
|
|
|
Attitudes |
|
||
|
|
|
A) Should be allowed to send unvaccinated children to school |
A) 1.72 (1.13-2.6) p < 0.05 |
||
B) Worry that many of the reports of serious side effects from vaccines are accurate |
B) 2.03 (1.05-3,91) p < 0.05 |
|||||
C) Concerned the CDC/ACIP underestimates the frequency of vaccine side effects | C) 2.86 (1.65-4.97) p < 0.05 |
CMixed providers were those who had vaccinated and unvaccinated children. A binomial framework allowed for mixed providers to contribute to the odds ratio calculation. CDC: Centres for Disease Control and Prevention. ACIP: Advisory Commitee on Immunization Practices.
To evaluate whether the methodological quality of the included studies influenced the direction or the magnitude of the results, we performed a separate analysis on those that complied with stricter inclusion criteria: 1) using vaccination coverage (measured by vaccination registries) as a measurement of the intention to vaccinate and 2) controlling for the main confounding factors in the statistical analysis. In these studies, it is less likely that the intention to vaccinate was overestimated, compared to the studies that rely on personal evaluation. In addition, the association between the variables is less susceptible to bias caused by confounding factors; thus, the internal validity is greater. Using these filters, we performed a sensitivity analysis. We measured the changes that were observed in the associations when only the studies with greater internal validity were included, compared to the results when we included all the studies that met the initial criteria.
Based on the consensus between two authors (MJA and RH), the different questions posed to the HCW in the studies were grouped by topic. Table 6 shows a summary of the associations found between each topic or factor and HCWs’ intentions to vaccinate. The results of a study were classified as “null association” if the confidence interval included the value representing a null association, if the results were not statistically significant, if confounders were not controlled or if there was insufficient information to interpret the results. To allow for interpretation, some odds ratios had to be inverted to clarify the meaning of the association between the intention to vaccinate and the factors that were evaluated in several studies.
Table 6.
Factor |
Negative associations |
Null associations |
Positive associations |
||||||
---|---|---|---|---|---|---|---|---|---|
|
Logistic regression |
Other analysis |
Logistic regression |
Other analysis |
Logistic regression |
Other analysis |
|||
N | Range OR | N | N | Range OR | N | N | Range OR | N | |
1. Knowledge |
|
|
|
|
|
|
|
|
|
a. Vaccine contraindications. |
0 |
|
0 |
0 |
|
1 |
0 |
|
2 |
2. Beliefs |
|
|
|
|
|
|
|
|
|
a. Vaccines are more risky than beneficial. |
3 |
0,04-0,37* |
0 |
0 |
|
0 |
0 |
|
0 |
b. Vaccine low efficacy and benefit and low susceptibility and severity of the disease. |
2 |
0,04-0,06 |
1 |
2 |
0,54-1,39* |
0 |
0 |
|
0 |
c. Use of alternative medicine theories |
1 |
0,24*-0,44* |
1 |
1 |
0,6 |
0 |
0 |
|
0 |
d. More individualist than social orientation of the health care. |
2 |
0,28*-0,59* |
0 |
0 |
|
0 |
0 |
|
0 |
e. Cost-to-parent is a deterrent to vaccination. |
0 |
|
0 |
1 |
1,54 |
0 |
0 |
|
0 |
f. Another needle is a deterrent to vaccination. |
0 |
|
0 |
1 |
0,79 |
0 |
0 |
|
0 |
g. Stocking the vaccine is a problem. |
0 |
|
1 |
0 |
|
0 |
0 |
|
0 |
h. People are adequately informed about vaccine. |
0 |
|
0 |
1 |
1,5 |
0 |
0 |
|
0 |
i. Theories of conspiration, influence of the farmaceutical industry on the policy makers in immunization. |
0 |
|
0 |
0 |
|
1 |
0 |
|
0 |
j. Behavior in vaccination is mostly conditioned by physician's beliefs |
0 |
|
0 |
0 |
|
1 |
0 |
|
0 |
k. Chiropractors should counsel about immunization. |
0 |
|
0 |
0 |
|
1 |
0 |
|
0 |
3.Attitudes |
|
|
|
|
|
|
|
|
|
a. Have some concerns about immunization. |
1 |
0,32 |
0 |
0 |
|
0 |
0 |
|
0 |
b. Concerned about vaccine’s side effects. |
1 |
0,49* |
0 |
1 |
0,31 |
0 |
0 |
|
0 |
c. Low confidence in Public Healthcare information or national recommendations. |
2 |
0,27-0,35* |
1 |
0 |
|
0 |
0 |
|
0 |
d. Consider the disease serious enough to warrant using a vaccine or give importance to the vaccination. |
0 |
|
0 |
0 |
|
0 |
0 |
|
2 |
e. Number of injections the physician considers giving at one visit (4 vs less and 5 vs less). |
0 |
|
0 |
0 |
|
1 |
1 |
8,69 and 17,29 |
0 |
f. Perceive to have a role in vaccination. |
0 |
|
0 |
0 |
|
1 |
0 |
|
1 |
g. Preference for combined vaccine than for separate. |
0 |
|
0 |
0 |
|
1 |
0 |
|
0 |
h. Concerned about (A) vaccine immunity may not be life-long (B) will lead to more serious disease in adults. |
0 |
|
0 |
1 |
A) 0,6 B)1,08 |
0 |
0 |
|
0 |
i. Not having adopted the new recommendations in use of polio vaccine (still using Sabin vs Salk). |
0 |
|
1 |
0 |
|
0 |
0 |
|
0 |
j. It should be allowed to send unvaccinated children to school. | 1 | 0,58* | 0 | 0 | 0 | 0 | 0 |
N: Number of studies OR: Odds Ratio * Results from the case-control study.
Table 7 shows the main characteristics of the studies that were ultimately included, as well as the Kappa index of agreement.
Table 7.
Authors | Knowledge, beliefs, attitudes | Measure of intention to vaccinateA | Design | Type of tool | Mean to collect data | Anonymity | Questionnaire: new, previously used, validated | Target populationB | Vaccine studiedC |
---|---|---|---|---|---|---|---|---|---|
Clark et al. [29] |
attitude |
2 |
cross-sectional |
survey |
mail |
not specified |
new |
Obst./Gyn. |
DTP |
Petousis-Harris et al. [28] |
knowledge |
4 |
cross-sectional |
survey |
telephone |
not anonymous |
new |
Nurses |
P,MMR |
Wilson et al. [26] |
beliefs and attitude |
2 |
cross-sectional |
survey |
working place or similar |
not specified |
new |
Nat. stu. |
PedV |
Jungbauer-Gans et al. [25] |
beliefs and attitude |
1 and 3 |
cross-sectional |
survey and record linked |
not specified and record linked |
not specified |
not specified |
FP/GP, Ped. |
PedV |
Milledge et al. [24] |
beliefs and attitude |
2 |
cross-sectional |
survey |
mail |
not specified |
not specified |
FP/GP |
Var. |
Zimmerman et al. [22] |
beliefs and attitude |
2 |
cross-sectional |
survey |
mail, e-mail or web, telephone |
not anonymous |
new |
FP/GP, Ped. |
Var. |
Davis et al. [30] |
attitude |
2 |
cross-sectional |
survey |
mail |
not specified |
not specified |
FP/GP, Int. |
DTP |
Davis et al. [23] |
beliefs and attitude |
1 |
cross-sectional |
survey |
mail |
not specified |
new |
FP/GP, Ped. |
Pn. |
Russell et al. [27] |
beliefs |
1 |
cross-sectional |
survey |
mail |
not specified |
new |
Chiropractors |
GenV |
Taylor et al. [21] |
knowledge and attitude |
3 |
cross-sectional |
survey and record linked |
working place and record linked |
not anonymous |
not specified |
Ped. |
DTP,MMR, Hep. B,HiB,Pol. |
Gust et al. [31] |
attitude |
1 |
cross-sectional |
survey and record linked |
e-mail or web |
anonymous |
previously used |
FP/GP, Ped. |
PedV |
Gonik et al. [19] |
attitude |
1 |
cross-sectional |
survey |
mail |
anonymous |
new |
Obst./Gyn. |
DT, MMR, Hep.B, Var. |
Schupfner et al. [20] |
beliefs and attitude |
4 |
cross-sectional |
survey |
mail |
anonymous |
new |
Ped. |
PedV |
Goodyear-Smith et al. [32] |
knowledge |
3 |
cross-sectional |
survey and record linked |
telephone and record linked |
not anonymous |
previously used, modified |
FP/GP |
PedV |
Salmon et al. [33] |
beliefs and attitude |
1 |
case and control |
survey and record linked |
mail |
not anonymous |
not specified |
PHCP, DO |
SchV |
Kappa index | 0,65 | 0,71 | 1 | 0,72 | 0,9 | 0,89 | 0,9 | 0,92 | 0,83 |
A) 1) Reported habit of vaccination or recommending vaccination to the patients. 2) Reported intention to vaccinate or recommend vaccination to the patients. 3) Record linked vaccination coverage. 4) Reported vaccination coverage. B) FP/GP: family practice and general practice. Ped.: pediatrician. Int.: internist. Obst./Gyn.: obstetrician and gynecologist. Nat. stu.: naturopathy students. PHCP: primary healthcare provider. DO: doctors in osteopathy C) DT: difteria, tetanus. P: pertussis. MMR: measles, mumps, rubella. Hep.B: B hepatitis. HiB: Haemophilus influenzae type B. Pol.: polio Var: varicella. Pn.: antipneumoccocal vaccine for children. GenV: vaccine in general. PedV: vaccines recommended in pediatrics. SchV: vaccine required for school entry.
Results
Of the 2354 references identified in the initial search, 113 were pre-selected because they aligned with the study objectives. After applying the inclusion criteria to the abstracts, the full-text reports of 43 studies were evaluated. Of these, 15 met the inclusion criteria and were included in the final analysis. A flow chart illustrating the studies that were excluded at each stage in the review process is shown in Figure 1.
The Kappa index was 0.653 for the selection of the full-text studies to be read after applying the inclusion criteria to the abstracts, and it was 0.778 for the final inclusion of the studies. Of the studies ultimately selected, 14 were cross-sectional studies [19-32], and one was a case–control study [33]. We found no other published systematic reviews on this topic.
Three studies analyzed the relationship between the knowledge of HCW and their intentions to vaccinate, eight studied the relationship between beliefs and intentions to vaccinate, and 12 studied the relationship between attitudes and intentions to vaccinate. Seven studies analyzed the relationships between two of these variables and intentions to vaccinate.
The critical appraisal of the included studies is shown in Table 1.
HCWs’ knowledge of vaccines and their intentions to vaccinate
Three cross-sectional studies analyzed the relationship between HCWs’ knowledge and the intention to vaccinate. Their results are shown in Table 2. These studies included 106 to 150 participants, with a mean of 123 participants and a total of 368 participants. Two were performed in New Zealand and one in the USA. The three studies used different methods to measure knowledge, but they all found a significant association between knowledge and the intention to vaccinate, such that the greater the knowledge level, the greater the intention to vaccinate.
Two studies used multivariate analysis to control the influence of confounders and also used record-linked vaccination coverage as a measure of the intention to vaccinate. The results of these two studies are not comparable with the third study, because they used different tools to measure knowledge and intentions to vaccinate, as well as to measure the association. Therefore, subgroup analysis does not allow us to compare the magnitude of the association, but it does show the same direction of the association between the variables, independent of the internal validity of the studies.
HCWs’ beliefs about vaccines and their intentions to vaccinate
Seven cross-sectional studies and one case–control study collected information on HCWs’ beliefs and their relationship with intentions to vaccinate. The sample size in the eight studies ranged between 94 and 694, with a mean of 341 and a total of 2731 HCW. Three studies were performed in the USA, two in Germany, two in Canada and one in Australia. The results of the cross-sectional studies are shown in Table 3, and those from the case–control study are shown in Table 5.
Only the case–control study by Salmon et al. measured the intention to vaccinate using vaccination records and also controlled for confounding factors. It was not possible to compare the results of this study with the others included, because each study asked specific but different questions about beliefs. In spite of these differences, the sensitivity analysis shows that the study with the greatest internal validity found the same direction of association as the other studies: the beliefs most aligned with scientific evidence were associated with greater intentions to vaccinate among HCW.
Of the eight studies, four studied only conventional HCW (pediatricians, family and general practitioners), and two studied complementary or alternative medicine providers (chiropractors, naturopathy students). The difference between the beliefs held by these two groups could not be evaluated by comparing these studies because of the differences in the variables discussed above. However, the remaining two studies did compare the two types of HCW. One of them (Jungbauer-Gans et al.) compared family practitioners and pediatricians with and without training in naturopathy. They found that the physicians trained in naturopathy reported that they prescribed fewer vaccines (considering all the vaccines recommended by the competent authority in Germany (STIKO)) than the physicians without this training (63% vs. 78%, respectively), although the difference was not statistically significant. Likewise, the physicians trained in naturopathy had a significantly lower proportion of patients with up-to-date vaccinations (Beta: -0,121).
The case–control study (Salmon et al.) included different types of primary healthcare professionals. The study found that the conventional HCW made up a greater proportion of the control group (HCW whose patients were all fully vaccinated upon school entry), than the group of cases (those who were responsible for children with non-medical vaccination exemptions) (87.9% vs. 74.1%, respectively; p < 0.05). The doctors of osteopathy made up a greater proportion of the cases than the controls (13% vs. 5.4%, respectively; p < 0.05). However, the study was not designed to analyze the differences according to provider training, and it did not control for confounders.
HCWs’ attitudes towards vaccines and their intentions to vaccinate
We found 11 cross-sectional studies and one case–control study that examined the relationship between HCWs’ attitudes and their intentions to vaccinate. The results of the cross-sectional studies are shown in Table 4, and those from the case–control study are shown in Table 5. The sample size of the 12 studies ranged between 94 and 694 HCW, with a mean of 326 and a total of 3908. Eight studies were performed in the USA, two in Germany, one in Canada and one in Australia.
Seven of the 11 cross-sectional studies controlled for confounders, but only one included vaccination records (Taylor et al.). The case–control study (Salmon et al.) had both characteristics. These two studies were included in the sensitivity analysis. Each study included specific but different questions that explored attitudes, and therefore, the results are not comparable. However, two aspects about attitudes were examined by one of the two studies with greater internal validity and one other study. Thus, for the sensitivity analysis, we compare the results of these studies.
Taylor et al. and Davis et al. (2003) investigated the number of injections that HCW were willing to give in the same medical visit. Taylor et al. studied the record linked percentage of children with up-to-date vaccinations, and Davis et al. studied the self-reported habit of administering a recently-recommended injectable vaccine. Both studies found a positive association between the willingness to give a number of injections simultaneously and compliance with the recommended vaccination schedule, although the association did not remain significant after multiple regression analysis in the study by Taylor et al. The sensitivity analysis should take the lack of statistical significance into account, but this approach does not necessarily invalidate the results of Davis et al. In addition to the methodological differences, there were other basic differences, such as the type of vaccine studied and the associations explored.
Salmon et al. and Milledge et al. studied concerns about the known and unknown side effects of vaccination. Milledge et al. found that concerns about the possible unknown side effects of vaccination made HCW less willing to recommend it (OR: 0.31 (95% CI: 0.15-0 .63); p > 0.05). Salmon et al. found that concerns about the accuracy of the reported severe side effects of vaccination were more strongly associated with cases (i.e., physicians who signed non-medical exemptions from vaccination) than controls (OR: 2.03 (95% CI: 1.05-3.91); p <0.05). In both studies, the concern about side effects was associated with lower adherence to vaccination recommendations, and the study with the highest internal validity had statistically significant results. Therefore, the sensitivity analysis does not change the direction of the association.
Summary of associations
Table 6 shows a summary of the associations found in the studies between specific factors explored as knowledge, beliefs and attitudes, and HCWs’ intention to vaccinate. To measure knowledge, the three included studies evaluated the knowledge in vaccination contraindications. Three topics out of the nine on belief evaluations, showed up in more than two studies: “Vaccine low efficacy and benefit and low susceptibility and severity of the disease” (present in 5 studies), “Vaccine are more risky than beneficial” (3 studies), “Use of alternative medicine theories” (3 studies). Only one topic out of the ten exploring attitudes appeared in more than two studies: “Low confidence in Public Healthcare information or national recommendations”, (3 studies).
Characteristics of studies included
Table 7 shows the characteristics of each of the studies included in the review and the Kappa index of inter-observer agreement on the classification of the study characteristics.
Discussion
This review identifies and summarizes the quantitative evidence about the possible relationship between HCWs’ knowledge, beliefs and attitudes about vaccines and their intentions to vaccinate. The results of the included studies clearly show that these relationships do exist, although unfortunately, the data does not allow us to make conclusions about a causal link, mainly because all but one of the studies are cross-sectional. Only one retrospective case–control study could show a causal link between beliefs, attitudes and intentions to vaccinate, but even this study should be considered as cross-sectional because it evaluated HCWs’ beliefs and attitudes at a given point in time, and these variables may change over time.
Given the range of the inclusion criteria, the included studies differed widely in their evaluations of the variables, methodologies, and statistical analysis techniques. Therefore, the results cannot be integrated to quantify the magnitude of the associations and must be evaluated individually. Even so, it appears that all the studies show associations in the direction postulated by the SIEVE experts, although some associations were statistically significant, and others were not.
Knowledge measurement was only based on questions on vaccination contraindications, which may imply that researchers were especially worried about the importance of this factor in regard to the intention to vaccinate. On the other hand, the variety of topics that were explored such as beliefs and attitudes is wide, as is shown in Table 6, though few were repeated in various studies. This may denote interest of the researchers on showing the importance of this type of factors on the intention to vaccinate. In regard to beliefs, the topics that made reference to efficacy and security of the vaccines, severity of the vaccine preventable disease and use of alternative medicine theories, appeared in various studies and seem to be perceived by the researchers as important factors. The associations found with the intention to vaccinate, show this importance. As for attitudes, only “Low confidence in Public Healthcare information or national recommendations” factor was explored in more than two studies (in 3 out of 12 that measured attitudes). This may reflect that there doesn´t exist a clear investigation line intended to prove the importance of a specific factor. It´s also interesting to highlight that the knowledge, beliefs and attitude themes explored in the HCW in the included studies, do not differ from the barriers towards vaccination explored in the general population [6].
The results of this study must be understood in the context of the limitations of the methodology used. Including observational studies in systematic reviews presents specific challenges, as observational studies have inherent biases (mostly selection and information bias) and vary in their study designs. Taking these concerns into account, we have attempted to be as rigorous as possible in the methodology of this review [34].
We tried to reduce identification bias by performing the literature search in four databases in addition to a manual search, selecting studies in seven languages and making personal contact with authors when necessary. We did not search for unpublished articles or for “grey literature”, and there may be unidentified articles in databases we did not search. Consequently, there may be a risk of publication bias. One limitation was that we chose to include only the studies that started collecting data after the publication of the article by Wakefield et al. This article should not imply that changes occurred in the relationship between knowledge and the intention to vaccinate, and therefore, there may have been studies before this date whose results were equally valid for understanding the current situation. On the other hand, the included studies were those published up to June 2009, so at the time of its publishing our study won´t include the latest evidence. In spite of this, having not found other systematic reviews on this topic, the results may be of interest to investigators, policy makers and healthcare professionals. In addition, we only included data from developed countries. In other words, there may have been relevant studies from developing countries that were not included and also that the results cannot be extrapolated to these countries. HCWs’ perceptions of vaccines and of vaccine-preventable diseases may be different in developing countries because they face different disease burdens, and this is the reason why these studies were not included [35,36].
One difficulty we encountered was classifying and distinguishing the information related to knowledge, beliefs and attitudes, despite the definitions we established, as shown by the low Kappa index for inter-observer agreement. It is also likely that this difficulty in delimiting the variables caused the low Kappa index for the abstract selection, and we believe that an intentional training of the researchers in identifying and classifying the variables during the pilot study would have improved the concordance.
The tools used to determine the risk of bias and the quality of the studies included were based on the Newcastle-Ottawa scales, which are widely used for observational studies [37]. The deficiencies in the methodology and reporting of many of the studies are reflected in the low scores on the quality scales, questioning the reliability of the studies reviewed. With regard to the sample selection, almost all of the studies used an acceptable sampling method, but most failed to report the comparability of the respondents and the non-respondents, which may imply there was a self-selection bias. Many included studies used subjective measures (e.g., self-reporting, unverified intentions or behaviors), which can lead to information bias. Care must be taken in interpreting such information, as there is a tendency for respondents to provide what they believe to be socially acceptable answers [38]. Some studies did not control for confounders, such as demographic factors, meaning that the variability in the intentions to vaccinate may be incorrectly associated with knowledge, beliefs or attitudes. The studies also failed to use validated instruments to measure attitudes, knowledge and beliefs. In addition, there are factors related to immunization that fall in these three areas but were not measured in the included studies, so these studies may offer only a partial viewpoint of the relationship between HCWs’ attitudes, knowledge and beliefs and intentions to vaccinate.
This review fills a gap in the literature, and thus, despite the limitations of our methodology, we believe that the benefits of illuminating this relevant topic overcome the limitations. Qualitative studies, which were not considered in this review, could be the objective of a future review. A gold standard research study is a broad-based population study that controls for confounding factors and biases and uses validated tools to measure knowledge, beliefs, attitudes, and intentions to vaccinate or vaccine coverage. The knowledge, beliefs and attitudes that may determine the intention to vaccinate are those stated at the moment when the intent to vaccinate is measured. The fact that these variables change over time may explain the absence of longitudinal studies that are capable of demonstrating causality. Despite this lack of evidence, various studies have evaluated the impact of interventions on the intent to vaccinate or the practice of vaccination [25,39-44], and others have even assessed their cost-effectiveness [45].
Some years ago, it was stated that the success of vaccination programs depends on strong professional commitment, that it is important to have written clinical guidelines to strengthen, instruct and support professionals at the time of vaccination, and that effective use of information technology would be beneficial [46]. On the last two points, great strides have been made; it may be time, as the SIEVE experts state, to test and implement strategies to incentivize health professionals.
Conclusions
The available information shows that among HCW, greater knowledge about vaccines, beliefs that are aligned with scientific evidence and more favorable attitudes toward vaccines are associated with greater intentions to vaccinate. However, it is not possible to conclude that there is a causal relationship between these variables, because the included studies are observational and must be interpreted as cross-sectional. The fact that knowledge, beliefs and attitudes change over time may explain the absence of longitudinal studies capable of demonstrating causality. We conclude that the existing studies show associations between HCWs’ knowledge, beliefs and attitudes and their intentions to vaccinate the populations they serve. The next step is to test and implement interventions and strategies focused on the knowledge, beliefs and attitudes of HCW to attempt to improve vaccine coverage.
Abbreviations
HCW: Healthcare worker; SIEVE: Summit of Independent European Vaccination Experts.
Competing interests
The authors declare that they have no competing interests.
The Spanish Vaccinology Foundation financed the translation of the article.
Authors’ contributions
RH participated in the study design, the article search, the study selection process, the data extraction and analysis, and the drafting of the manuscript. MJA conceived the study and participated in the study design, the study selection process, the data extraction and analysis, and the drafting of the manuscript. CD assisted with the study selection process and the drafting of the manuscript. JLB assisted with the methodological aspects of the systematic review and the statistical interpretation of the included studies and revised the manuscript. JME performed the search in the electronic databases. AG participated in the design and coordination of the review, revised the manuscript and gave his approval for the manuscript to be published. All authors read and approved the final manuscript.
Pre-publication history
The pre-publication history for this paper can be accessed here:
Supplementary Material
Contributor Information
Raúl Herzog, Email: raul.herzog@salud.madrid.org.
Mª José Álvarez-Pasquin, Email: malvarezp.gapm02@salud.madrid.org.
Camino Díaz, Email: camino.diaz@salud.madrid.org.
José Luis Del Barrio, Email: jose.delbarrio@urjc.es.
José Manuel Estrada, Email: josemanuel.estrada@salud.madrid.org.
Ángel Gil, Email: angel.gil@urjc.es.
Acknowledgements
We thank Dr. Jesús Esteban of the Department of Preventive Medicine and Public Health at Rey Juan Carlos University in Madrid for his help and advice, Dr. Paco Rodriguez Salvanés of the Investigation Foundation at La Princesa Hospital of the Public Health System in Madrid for all his responses to our questions and Dr. Lydia Pradera for her help finding the right words in English.
References
- Centers for Disease Control and Prevention. Ten great public health achievements- United States 1900–1999. MMWR Morb Mortal Wkly Rep. 1999;48:1141–1147. [PubMed] [Google Scholar]
- Barquet N, Domingo P. Smallpox. The triumph over the most terrible of the ministers of death. Ann Intern Med. 1997;127:635–642. doi: 10.7326/0003-4819-127-8_part_1-199710150-00010. [DOI] [PubMed] [Google Scholar]
- Muscat M, Bang H, Glismann S. Measles is still a cause for concern in Europe. Euro Surveill. 2008;13:pii=18837. [PubMed] [Google Scholar]
- Van Treeck U. Measles outbreak in Germany: over 1000 cases now reported in Nordrhein Westfalen. Euro Surveill. 2006;11:pii=2955. doi: 10.2807/esw.11.19.02955-en. [DOI] [PubMed] [Google Scholar]
- Mills EJ, Montori VM, Ross CP, Shea B, Wilson K, Guyatt GH. Systematically reviewing qualitative studies complements survey design: an exploratory study of barriers to pediatric immunisation. J Clin Epidemiol. 2005;58:1101–1108. doi: 10.1016/j.jclinepi.2005.01.014. [DOI] [PubMed] [Google Scholar]
- Mills E, Jadad A, Ross C, Wilson K. Systematic review of qualitative studies exploring parental beliefs and attitudes toward childhood vaccination identifies common barriers to vaccination. J Clin Epidemiol. 2005;58:1081–1088. doi: 10.1016/j.jclinepi.2005.09.002. [DOI] [PubMed] [Google Scholar]
- Nowalk MP, Zimmerman RK, Tabbarah M, Raymund M, Jewell IK. Determinants of adult vaccination at inner-city health centers: a descriptive study. BMC Fam Pract. 2006;7:2. doi: 10.1186/1471-2296-7-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schmitt HJ, Booy R, Weil-Olivier C, Van Damme P, Cohen R, Peltola H. Child vaccination policies in Europe: report from the Summits of independent European vaccination experts. Lancet Infect Dis. 2003;3:103–108. doi: 10.1016/S1473-3099(03)00519-X. [DOI] [PubMed] [Google Scholar]
- Bedford H, Elliman D. Concerns about immunization. BMJ. 2000;320:240–243. doi: 10.1136/bmj.320.7229.240. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Llupià A, García-Basteiro AL, Mena G, Ríos J, Puig J, Bayas JM, Trilla A. Vaccination behaviour influences self-report of influenza vaccination status: a cross-sectional study among health care workers. PLoS One. 2012;7:e39496. doi: 10.1371/journal.pone.0039496. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Prematunge C, Corace K, McCarthy A, Nair RC, Pugsley R, Garber G. Factors influencing pandemic influenza vaccination of healthcare workers-A systematic review. Vaccine. 2012;30:4733–4743. doi: 10.1016/j.vaccine.2012.05.018. [DOI] [PubMed] [Google Scholar]
- European Vaccine Manufacturers. Survey regarding the Perception of Vaccines and Vaccinations. International Summary Report 2004. http://www.webcitation.org/query.php?url=http://www.evm-vaccines.org/pdfs/survey_perceptions.pdf&refdoi=10.1186/1741-7015-5-11.
- Navarro JA, Bernal PJ, Niguez JC. Analysis of factors influencing vaccine uptake:perspective from Spain. Vaccine. 2001;20(Suppl 1):13–15. doi: 10.1016/s0264-410x(01)00300-0. [DOI] [PubMed] [Google Scholar]
- Bovier PA, Chamot E, Bouvier M, Loutan L. Importance of patients' perceptions and general practitioners' recommendations in understanding missed opportunities for immunisations in Swiss adults. Vaccine. 2001;19:4760–4767. doi: 10.1016/S0264-410X(01)00223-7. [DOI] [PubMed] [Google Scholar]
- Centers for Disease Control and Prevention. Adult immunization: knowledge, attitudes and practices, DeKalb and Fulton Counties, Georgia, 1988. MMWR Morb Mortal Wkly Rep. 1988;37:657–661. [PubMed] [Google Scholar]
- Gellin BG, Maibach EW, Marcuse EK. Do parents understand immunizations? A national telephone survey. Pediatrics. 2000;106:1097–1102. doi: 10.1542/peds.106.5.1097. [DOI] [PubMed] [Google Scholar]
- Stefanoff P, Mamelund SE, Robinson M, Netterlid E, Tuells J, Bergsaker MA, Heijbel H, Yarwood J. VACSATC working group on standardization of attitudinal studies in Europe. Tracking parental attitudes on vaccination across European countries: The Vaccine Safety, Attitudes, Training and Communication Project (VACSATC) Vaccine. 2010;28:5731–5737. doi: 10.1016/j.vaccine.2010.06.009. [DOI] [PubMed] [Google Scholar]
- Schmitt HJ, Booy R, Aston R, Van Damme P, Schumacher RF, Campins M, Rodrigo C, Heikkinen T, Weil-Oliver C, Finn A, Olcen P, Fedson D, Peltola H. How to optimise the coverage rates of infant and adult immunisation in Europe. BMC Med. 2007;5:11. doi: 10.1186/1741-7015-5-11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gonik B, Jones T, Contreras D, Fasano N, Roberts C. The obstetrician-gynecologist’s role in vaccine-preventable diseases and immunization. Obstet Gynecol. 2000;96:81–84. doi: 10.1016/S0029-7844(00)00860-7. [DOI] [PubMed] [Google Scholar]
- Schupfner R, Reimer B, Markuzzi A, Von Sonnenburg F. How do pediatricians in Munich perform vaccination?: a healthcare service research study. Soz Praventivmed. 2002;47:100–106. doi: 10.1007/BF01318391. [DOI] [PubMed] [Google Scholar]
- Taylor JA, Darden PM, Brooks DA, Hendricks JW, Baker AE, Wasserman RC. Practitioner policies and beliefs and practice immunization rates: a study from Pediatric Research in Office Settings and the National Medical Association. Pediatrics. 2002;109:294–300. doi: 10.1542/peds.109.2.294. [DOI] [PubMed] [Google Scholar]
- Zimmerman RK, Mieczkowski TA, Mainzer HM, Medsger AR, Nowalk MP. Understanding physician agreement with varicella immunization guidelines. Prev Med. 2002;35:135–142. doi: 10.1006/pmed.2002.1068. [DOI] [PubMed] [Google Scholar]
- Davis MM, Ndiaye SM, Freed GL, Clark SJ. One-year uptake of pneumococcal conjugate vaccine: a national survey of family physicians and pediatricians. J American Board of Fam Pract. 2003;16:363–371. doi: 10.3122/jabfm.16.5.363. [DOI] [PubMed] [Google Scholar]
- Milledge JT, Cooper CD, Woolfenden S. Barriers to immunization: attitudes of general practitioners to varicella, the disease and its vaccine. J Paediatr Child Health. 2003;39:368–371. doi: 10.1046/j.1440-1754.2003.00176.x. [DOI] [PubMed] [Google Scholar]
- Jungbauer-Gans M, Kriwy P. Influence exercised by physicians on the vaccination rate. Gesundheitswesen. 2003;65:464–470. doi: 10.1055/s-2003-40806. [DOI] [PubMed] [Google Scholar]
- Wilson K, Mills E, Boon H, Tomlinson G, Ritvo P. A survey of attitudes towards paediatric vaccinations amongst Canadian naturopathic students. Vaccine. 2004;22:329–334. doi: 10.1016/j.vaccine.2003.08.014. [DOI] [PubMed] [Google Scholar]
- Russell ML, Injeyan HS, Verhoef MJ, Eliasziw M. Beliefs and behaviours: understanding chiropractors and immunization. Vaccine. 2004;23:372–379. doi: 10.1016/j.vaccine.2004.05.027. [DOI] [PubMed] [Google Scholar]
- Petousis-Harris H, Goodyear-Smith F, Turner N, Soe B. Family practice nurse views on barriers to immunising children. Vaccine. 2005;23:2725–2730. doi: 10.1016/j.vaccine.2004.11.038. [DOI] [PubMed] [Google Scholar]
- Clark SJ, Adolphe S, Davis MM, Cowan AE, Kretsinger K. Attitudes of US obstetricians toward a combined tetanus-diphtheria-acellular pertussis vaccine for adults. Infect Dis Obstet Gynecol. 2006;2006:87040. doi: 10.1155/IDOG/2006/87040. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Davis MM, Kretsinger K, Cowan AE, Stokley S, Clark SJ. New combined tetanus-diphtheria-acellular pertussis vaccines for adults: primary care physician attitudes and preferences. Hum Vaccin. 2007;3:130–134. doi: 10.4161/hv.3.4.4307. [DOI] [PubMed] [Google Scholar]
- Gust D, Weber D, Weintraub E, Kennedy A, Soud F, Burns A. Physicians who do and do not recommend children get all vaccinations. J Health Commun. 2008;13:573–582. doi: 10.1080/10810730802281726. [DOI] [PubMed] [Google Scholar]
- Goodyear-Smith F, Grant C, Petoussis-Harris H, Turner N. Immunization champions: characteristics of general practitioners associated with better immunization delivery. Hum Vaccin. 2009;5:403–411. doi: 10.4161/hv.5.6.8356. [DOI] [PubMed] [Google Scholar]
- Salmon DA, Pan WK, Omer SB, Navar AM, Orenstein W, Marcuse EK, Taylor J, deHart MP, Stokley S, Carter T, Halsey NA. Vaccine knowledge and practices of primary care providers of exempt vs. vaccinated children. Hum Vaccin. 2008;4:286–291. doi: 10.4161/hv.4.4.5752. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson D, Rennie D, Moher D, Becker BJ, Sipe TA, Thacker SB. Meta-analysis of observational studies in epidemiology. JAMA. 2000;283:2008–2012. doi: 10.1001/jama.283.15.2008. [DOI] [PubMed] [Google Scholar]
- Gentile A, Bhutta Z, Bravo L, Samy AG, Garcia RD, Hoosen A, Islam T, Karimi A, Salem M, Simasathien S, Sohail A, Watanaveeradej V, Wiedenmayer K, Schmitt HJ. Pediatric disease burden and vaccination recommendations: understanding local differences. Int J Infect Dis. 2010;14:649–658. doi: 10.1016/j.ijid.2009.11.006. [DOI] [PubMed] [Google Scholar]
- Schaetti C, Ali SM, Chaignat CL, Khatib AM, Hutubessy R, Weiss MG. Improving community coverage of oral cholera mass vaccination campaigns: lessons learned in zanzibar. PLoS One. 2012;7:e41527. doi: 10.1371/journal.pone.0041527. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stang A. Critical evaluation of the Newcastle-Ottawa scale for the assessment of the quality of nonrandomized studies in meta-analyses. Eur J Epidemiol. 2010;25:603–605. doi: 10.1007/s10654-010-9491-z. [DOI] [PubMed] [Google Scholar]
- Yu IT, Tse SL. Workshop 6-sources of bias in cross-sectional studies; summary on sources of bias for different study designs. Hong Kong Med J. 2012;18:226–227. [PubMed] [Google Scholar]
- Shaw JS, Samuels RC, Larusso EM, Bernstein HH. Impact of an encounter-based prompting system on resident vaccine administration performance and immunization knowledge. Pediatrics. 2000;105:978–983. [PubMed] [Google Scholar]
- Boom JA, Nelson CS, Laufman LE, Kohrt AE, Kozinetz CA. Improvement in provider immunization knowledge and behaviors following a peer education intervention. Clin Pediatr (Phila) 2007;46:706–717. doi: 10.1177/0009922807301484. [DOI] [PubMed] [Google Scholar]
- Sabnis SS, Pomeranz AJ, Amateau MM. The effect of education, feedback, and provider prompts on the rate of missed vaccine opportunities in a community health center. Clin Pediatr (Phila) 2003;42:147–151. doi: 10.1177/000992280304200208. [DOI] [PubMed] [Google Scholar]
- Vorsters A, Tack S, Hendrickx G, Vladimirova N, Bonanni P, Pistol A, Metlicar T, Pasquin MJ, Mayer MA, Aronsson B, Heijbel H, Van Damme P. A summer school on vaccinology: responding to identified gaps in pre-service immunisation training of future health care workers. Vaccine. 2010;28:2053–2059. doi: 10.1016/j.vaccine.2009.12.033. [DOI] [PubMed] [Google Scholar]
- Levi BH. Addressing parents’ concerns about childhood immunizations: a tutorial for primary care providers. Pediatrics. 2007;120:18–26. doi: 10.1542/peds.2006-2627. [DOI] [PubMed] [Google Scholar]
- Zimmerman RK, Barker WH, Strikas RA, Ahwesh ER, Mieczkowski TA, Janosky JE, Kanter SL. Developing curricula to promote preventive medicine skills: the teaching immunization for medical education (TIME) project. JAMA. 1997;278:705–711. doi: 10.1001/jama.1997.03550090029028. [DOI] [PubMed] [Google Scholar]
- Franzini L, Boom J, Nelson C. Cost-effectiveness analysis of a practice based immunization education intervention. Ambul Pediatr. 2007;7:167–175. doi: 10.1016/j.ambp.2006.12.001. [DOI] [PubMed] [Google Scholar]
- Nicoll A, Elliman D, Begg NT. Immunisation: causes of failure and strategies and tactics for success. BMJ. 1989;299:808–812. doi: 10.1136/bmj.299.6703.808. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rivera JA. Lo que Sócrates le diría a Woody Allen. Madrid: Espasa Calpe; 2008. [Google Scholar]
- Wakefield AJ, Murch SH, Anthony A, Linnell J, Casson DM, Malik M, Berelowitz M, Dhillon AP, Thomson MA, Harvey P, Valentine A, Davies SE, Walker-Smith JA. Ileal-lymphoid-nodular hyperplasia, non-specific colitis, and pervasive developmental disorder in children. Lancet. 1998;351:637–641. doi: 10.1016/S0140-6736(97)11096-0. [DOI] [PubMed] [Google Scholar]
- World economic and social survey 2006. Diverging Growth and Development. New York: United Nations Publications; 2006. [Google Scholar]
- Injeyan HS, Russell ML, Verhoef MJ, Mutasingwa D. Canadian chiropractors' perception of educational preparation to counsel patients on immunization. J Manipulative Physiol Ther. 2006;29:643–650. doi: 10.1016/j.jmpt.2006.08.009. [DOI] [PubMed] [Google Scholar]
- Davis MM, Broder KR, Cowan AE, Mijalski C, Katrina K, Stokley S, Clark SJ. Physician attitudes and preferences about combined Tdap vaccines for adolescents. Am J Prev Med. 2006;31:176–180. doi: 10.1016/j.amepre.2006.03.023. [DOI] [PubMed] [Google Scholar]
- Wilson K, Mills EJ, Norman G, Tomlinson G. Changing attitudes towards polio vaccination: a randomized trial of an evidence-based presentation versus a presentation from a polio survivor. Vaccine. 2005;23:3010–3015. doi: 10.1016/j.vaccine.2004.12.002. [DOI] [PubMed] [Google Scholar]
- Salmon DA, Moulton LH, Omer SB, Chace LM, Klassen A, Talebian P, Halsey NA. Knowledge, attitudes, and beliefs of school nurses and personnel and associations with nonmedical immunization exemptions. Pediatrics. 2004;113:552–559. doi: 10.1542/peds.113.6.e552. [DOI] [PubMed] [Google Scholar]
- Prislin R, Sawyer MH, Nader PR, Goerlitz M, De Guire M, Ho S. Provider-staff discrepancies in reported immunization knowledge and practices. Prev Med. 2002;34:554–561. doi: 10.1006/pmed.2002.1019. [DOI] [PubMed] [Google Scholar]
- Prislin R, Sawyer MH, De Guire M, Brennan J, Holcomb K, Nader PR. Missed opportunities to immunize: psychosocial and practice correlates. Am J Prev Med. 2002;22:165–169. doi: 10.1016/S0749-3797(01)00429-9. [DOI] [PubMed] [Google Scholar]
- Petrovic M, Roberts R, Ramsay M. Second dose of measles, mumps, and rubella vaccine: questionnaire survey of health professionals. BMJ. 2001;322:1120. doi: 10.1136/bmj.322.7294.1120. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zimmerman RK, Schlesselman JJ, Mieczkowski TA, Medsger AR, Raymund M. Physician concerns about vaccine adverse effects and potential litigation. Arch Pediatr Adolesc Med. 1998;152:7–10. doi: 10.1001/archpedi.152.1.12. [DOI] [PubMed] [Google Scholar]
- Mawn B, Pakkala K. Immunization update: a community-based nursing education program. J Contin Educ Nurs. 2000;31:101–110. doi: 10.3928/0022-0124-20000501-04. [DOI] [PubMed] [Google Scholar]
- Petousis-Harris H, Goodyear-Smith F, Turner N, Soe B. Family physician perspectives on barriers to childhood immunisation. Vaccine. 2004;22:2340–2344. doi: 10.1016/j.vaccine.2003.10.037. [DOI] [PubMed] [Google Scholar]
- Dionne M, Boulianne N, Duval B, Lavoie F, Laflamme N, Carsley J. Lack of conviction about vaccination in certain Quebec vaccinators. Can J Public Health. 2001;92:100–104. doi: 10.1007/BF03404939. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Henderson R, Oates K, Macdonald H, Smith WC. General practitioners’ concerns about childhood immunisation and suggestions for improving professional support and vaccine uptake. Commun Dis Public Health. 2004;7:260–266. [PubMed] [Google Scholar]
- Smith SW, Connery P, Knudsen K, Scott KL, Frintner MP, Outlaw G, Weingart S. Immunization practices and beliefs of physicians in suburban Cook County. Illinois. J Community Health. 1999;24:1–11. doi: 10.1023/A:1018766430491. [DOI] [PubMed] [Google Scholar]
- Slora EJ, Steffes JM, Harris D, Clegg HW, Norton D, Darden PM, Sullivan SA, Wasserman RC. Improving pediatric practice immunization rates through distance-based quality improvement: a feasibility trial from PROS. Clin Pediatr (Phila) 2008;47:25–36. doi: 10.1177/0009922807304597. [DOI] [PubMed] [Google Scholar]
- Cotter S, Ryan F, Hegarty H, McCabe TJ, Keane E. Immunisation: the views of parents and health professionals in Ireland. Euro Surveill. 2003;8:145–150. doi: 10.2807/esm.08.06.00416-en. [DOI] [PubMed] [Google Scholar]
- Smith A, McCann R, McKinlay I. Second dose of MMR vaccine: health professionals’ level of confidence in the vaccine and attitudes towards the second dose. Commun Dis Public Health. 2001;4:273–277. [PubMed] [Google Scholar]
- Lasserre A, Riviere M, Blanchon T, Alvarez F, Gaillat J, Romain O. Connaissance et application des recommandations vaccinales concernant la coqueluche par la médecine du travail des établissements de santé de Paris. Med Mal Infect. 2009;39:325–329. doi: 10.1016/j.medmal.2009.01.006. [DOI] [PubMed] [Google Scholar]
- Mahony A, Percival P, Condon R. Vaccine know-how. Kimberley immunisation study: community nurses immunisation education, knowledge and practice. Collegian. 1999;6:16–22. doi: 10.1016/s1322-7696(08)60325-x. [DOI] [PubMed] [Google Scholar]
- Lehrke P, Nuebling M, Hofmann F, Stoessel U. Attitudes of homoeopathic physicians towards vaccination. Vaccine. 2001;19:4859–4864. doi: 10.1016/S0264-410X(01)00180-3. [DOI] [PubMed] [Google Scholar]
- Ehresmann KR, Mills WA, Loewenson PR, Moore KA. Attitudes and practices regarding varicella vaccination among physicians in Minnesota: implications for public health and provider education. Am J Public Health. 2000;90:1917–1920. doi: 10.2105/ajph.90.12.1917. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Koepke CP, Vogel CA, Kohrt AE. Provider characteristics and behaviors as predictors of immunization coverage. Am J Prev Med. 2001;21:250–255. doi: 10.1016/S0749-3797(01)00373-7. [DOI] [PubMed] [Google Scholar]
- Newman RD, Taylor JA. Reactions of pediatricians to the recommendation for universal varicella vaccination. Arch Pediatr Adolesc Med. 1998;152:792–796. doi: 10.1001/archpedi.152.8.792. [DOI] [PubMed] [Google Scholar]
- Sharkness CM, Goun BD, Davis LA, Sykes LE. Do we practice what we teach about childhood immunization in New Jersey? Fam Med. 1998;30:727–732. [PubMed] [Google Scholar]
- Schaffer SJ, Bruno S. Varicella immunization practices and the factors that influence them. Arch Pediatr Adolesc Med. 1999;153:357. doi: 10.1001/archpedi.153.4.357. [DOI] [PubMed] [Google Scholar]
- Zucs AP, Crispin A, Eckl E, Weitkunat R, Schlipköter U. Risk factors for undervaccination against measles in a large sample of preschool children from rural Bavaria. Infection. 2004;32:127–133. doi: 10.1007/s15010-004-3122-0. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.