Abstract
We aimed to identify sociodemographic predictors of compliance after receiving a personalised reminder on lacking vaccinations against MMR (Measles, Mumps, Rubella) and/or HPV (Human Papilloma Virus) among parents of Danish adolescent girls.
A nationwide register-based study, including all 14-year-old girls (15 May 2014–14 May 2015) lacking either MMR, HPV-vaccination or both. Vaccination-compliance following a postal reminder was modelled using multivariable logistic regression and included the following socio-demographic predictors: maternal age, education, employment and ethnicity. Birth order, number of siblings, family-structure, location of residence, and household income.
The parents of 9692 girls received a reminder. Out of 4940 exclusively lacking an HPV-vaccine, 15.3% were subsequently vaccinated. Among 2026 only lacking an MMR vaccination, 8.5% were vaccinated. Among 2726 girls lacking both, 5% received an HPV, 4.4% an MMR and 5.4% received both vaccinations. We identified sociodemographic differences between reminderletter-compliers and non-compliers, also according to vaccination types. Non-western descendants were more likely to receive HPV-vaccination, although the association was only significant for those who only lacked HPV (OR 2.02, 95% 1.57–2.59). For girls only lacking an MMR, regional differences were identified. Among girls lacking both vaccines, girls of mothers with intermediate (OR 0.63, 0.42–0.95) or basic education (OR 0.43, 0.24–0.75) were less likely to be vaccinated compared to girls of higher educated mothers.
Reminders were in particular effective in increasing HPV uptake among immigrants of non-Western ethnicity. We found reminders to be less effective among less educated mothers whose daughters lacked both vaccines. To increase the coverage in this group, additional interventions are needed.
Keywords: Vaccination, Immunization, Socioeconomic factors
Highlights
-
•
14% reminded received a vaccine with the highest effect in girls only lacking HPV
-
•
Two-fold higher HPV-vaccination in girls with Non-western born mothers
-
•
Both MMR and HPV uptake increased disregarding theory of parents being opposed to HPV.
-
•
Sociodemographic factors and vaccine type influences effect of vaccination-reminder.
1. Introduction
Childhood immunization is one of the most powerful and cost-effective of all health interventions and prevents illness and saves millions of lives every year. (World Health Organization, Unicef, 2009).
Despite the proven safety and efficacy of vaccines, immunization rates remain suboptimal in many European countries, and some vaccine-preventable diseases are not sufficiently controlled (Muscat, 2011; WHO regional Office Europe, 2017).
The national immunization program (NIP) of Denmark is a voluntary and free-of-charge program with an overall high childhood vaccination uptake that exceeds 85% for most vaccines. The General Practitioners (GPs) administer vaccines during “Well child visits” which start at 5 weeks, 5 and 12 months and at 2, 3, 4 and 5 years of age. Lastly, there are two visits around 12 years of age (Sundhed.dk, n.d.).
Recent data on vaccination uptake in Denmark shows that coverage of the second vaccine against measles, mumps and rubella (MMR2) given at 4 years of age remains stable around 88% (figures for birth cohort 2012). On the other hand, coverage of first Human Papillomavirus vaccination (HPV1) has dropped from a historical high of 92% (birth cohorts 1998–2000) to a non-satisfactory coverage of 57% (birth cohort of 2004) (SSI, n.d.), following a public media discussion about concerns of HPV-vaccine safety in Denmark in the period 2015–16.
Suboptimal vaccination coverage results from a variety of challenges and obstacles acting on different subgroups of the population. These vary from vaccine to vaccine with specific challenges in the different age groups. Ethnicity, low parental socioeconomic status and education, older age of the child, younger maternal age, large family size, late birth order, forgetfulness, sick child delays, and delayed well child visits have been associated with suboptimal compliance to vaccinations (Falagas and Zarkadoulia, 2008; Luman et al., 2003; Strine et al., 2003; Tabacchi et al., 2016).
The literature describes two qualitatively different groups of parents to non-vaccinated children (Leask et al., 2014; Leask et al., 2012). The first are “conscientious objectors” or hesitant parents with expressed concerns about immunization. These parents may decline, delay or be selective in the vaccines they accept and tend to be more affluent and educated (Dubé et al., 2013). The second group comprises families experiencing barriers to access, which may relate to social disadvantage, cultural or logistical barriers (Smith et al., 2004).
Other factors of importance for vaccination uptake include the organisational structures around the vaccination programme as well as personal experience with vaccine-preventable diseases (Falagas and Zarkadoulia, 2008; Glatman-freedman and Nichols, 2012). Investigations of risk factors for non-compliance to reminders on lacking vaccinations may inform future strategies and interventions to increase vaccination coverage.
Systematic reviews show that several interventions are effective in increasing vaccination uptake (Briss et al., 2000; Harvey et al., 2015; Jacobson and Szilagyi, 2009). Reminder/recall may be particularly useful for adolescents who tend to visit medical providers less frequently than younger children, and have been shown to receive less preventive visits (Rand et al., 2007; Suh et al., 2012). New technology such as text messaging and other electronic messages can be especially effective in adolescents (Crocker-Buque et al., 2016).
To increase compliance with the NIP, the Danish parliament decided from May 2014 to issue written reminders to parents of children who lack one or more vaccinations. Vaccination-reminders are issued when the child turns 2, 6 1/2 and 14 years. The vaccination-reminders have been found to increase the vaccination-coverage of MMR2 with 5 percentage point in children at 7 years (Suppli et al., 2017).
However, it is unknown whether there is sociodemographic inequality in compliance with this health intervention and whether it differs by vaccination. Tseng et al. investigated the efficacy of sending letters reminding on cervical cancer screening and found a lower response in women in lower socioeconomic groups (Tseng et al., 2000).
By merging high-quality individual data from multiple national registries, we investigated demographic and socio economic predictors of vaccination compliance with the aims to identify at risk groups of non-compliance to vaccination reminders. A personalised reminder letter concerning HPV and MMR vaccination was sent to parents of Danish girls aged 14 years.
2. Methods and materials
2.1. Study design and study population
We carried out a register-based study including all girls born in Denmark from 15 May 2000 to 14 May 2001, who lacked at least one HPV or MMR-vaccination at their 14th birthday and received a reminder. From national registers, we obtained information on sociodemographic predictors and vaccines given in the following 6 months. Data were linked using the unique Danish civil registration number (CRS). Demographic characteristics and indicators of socioeconomic status included maternal age, maternal education level, family-structure (one- or two-parent household), household income level, place of residence, birth order of the girl, and number of siblings. The reference group was selected as the largest proportion within each sociodemographic predictor. All determinants excluding maternal age and birth order were extracted at the girls 14th birthday. We only included girls alive and living in Denmark in the full study period. Information on emigrations and deaths was extracted from the Danish Civil Registration System.
2.1.1. The Danish Vaccination Register (DDV)
The DDV contains information on all vaccinations given in the NIP to children born from 1996 and onwards. For reimbursement purposes, GPs report all vaccination information to the Health Region. From the health regions, the data is imported into the DDV register. The register contains information such as: date of vaccination, a unique personal identification number (CRS number) of the recipient, name and ID of the vaccine, and identification on the GP (Grove Krause et al., 2012). Since February 2013, citizens have had access to their own vaccination status online. Health professionals have accessed their patients' vaccination status from the NIP since 1996. In case of an under-registration of previously given vaccines, both patients and doctors can add such historical vaccinations online. Patient registered information is included in the register after validation by a doctor.
2.2. The reminder system
The reminder system was implemented 15 May 2014. All children who turn two, 6 1/2 and 14 years lacking at least one vaccination in the childhood vaccination programme are identified in DDV. Parents are reminded on all vaccinations in the NIP except lacking pneumococcal conjugate or Haemophilus influenzae B vaccinations. The reminder is sent to the parent in custody of the child. If the parents have joint custody but do not share the same address, the reminder is sent to both parents (Krause et al., 2015). Information on all written reminders is saved in a database. (See appendix 1 for generic reminder letter).
2.3. Demographic factors
The selection of potential socio-demographic predictors was based on prior knowledge of predictors for vaccination uptake in Denmark (Fernández de Casadevante et al., 2016; Sundhedsstyrelsen, 2007; Widgren et al., 2011) and as measures describing different aspects of the socio-economic position of the family.
-
•
Maternal age at time of birth (<25 years, 25–34 and ≥35), from the Danish Civil Registration System (Pedersen, 2011).
-
•
Maternal educational level at the daughter's 14th birthday (higher defined as bachelor degree or more), intermediate (high school level) and basic, from the Population's Education Register (Jensen and Rasmussen, 2011).
-
•
Maternal ethnicity, categorised by place of birth (Danish born, western-immigrant and non-western immigrant), from the Danish Civil Registration System (Pedersen, 2011).
-
•
Maternal level of employment (no unemployment, up to 26 weeks of unemployment and >26 weeks of unemployment), from the Integrated Labour Market Statistics Register (Timmermans, 2010).
-
•
Maternal birth order of the girl, (first, second and third or later), from The Medical Birth Register (Knudsen and Olsen, 1998).
-
•
Number of siblings, both older and younger (0, 1, 2 and 3 or more), from the Population Statistics Register (Statistics_Denmark, 2016).
-
•
Place of residence at the time of the reminder, by the five regions of Denmark (Nomenclature of Territorial Units for Statistics, level 2, from the Danish Civil Registration System (Pedersen, 2011)).
-
•
Family-structure (two parent and single parent household), from The Population Statistics Register (Statistics_Denmark, 2016).
-
•
Household income level in 2014 (0–20, 21–40, 41–60, 61–80 and 81–100 percentiles), from The Income Statistics Register (Baadsgaard and Quitzau, 2011).
2.4. Outcome variables
We defined three endpoints: (i) vaccination with MMR during the six months after reminder, (ii) vaccination with HPV, and (iii) vaccination with both MMR and HPV.
2.5. Statistical analysis
All variables were defined a priori and kept in the multivariable model. Logistic regression models were used to estimate crude and adjusted odds ratios (ORs and aORs) and their corresponding 95% confidence intervals (CIs) to examine the effect of sociodemographic characteristics on compliance to the reminder. Separate models were specified for a) uptake of MMR among girls only lacking MMR, b) uptake of HPV among girls only lacking HPV, c) uptake only of MMR among girls lacking MMR and HPV, d) uptake only of HPV among girls lacking MMR and HPV, and finally e) uptake of both MMR and HPV, among girls lacking MMR and HPV. Likelihood ratio tests were used to assess model fit when the predictors were individually removed from the full model. Analyses were performed using Stata (version 14 StataCorp, 2013).
3. Results
This study included 9692 girls who turned 14 years between 15 May 2014 and 14 May 2015; 4940 lacked one or more HPV-vaccine, 2026 lacked only one or more MMR-vaccine and 2726 lacked both HPV and MMR-vaccines. A large proportion of the girls resided in the Capital Region (31.7%), 85.7% had Danish-born mothers; 88% had mothers that were employed in the previous year and for 40.3% their mothers had a higher education.
Table 1 shows the number of registered vaccines in the six-month-period following the reminder. Overall, 14% of the girls responded to the reminder by receiving at least one vaccine. We registered 1042 HPV and 442 MMR-vaccinations in the study group. Overall, we found the highest response in girls lacking only an HPV (15.3%) and girls only lacking an MMR (8.5%). Among girls who lacked both vaccines, the highest response was seen in girls who received both an HPV and MMR -vaccine (5.4%).
Table 1.
Total | Girls lacking HPV-vaccination n = 4940 | Girls lacking MMR-vaccination n = 2026 | Girls lacking HPV- & MMR-vaccination n = 2726 | |
---|---|---|---|---|
Receiving only HPV | 894 | 757 (15.3%) | 137 (5.0%) | |
Receiving only MMR | 294 | 173 (8.5%) | 121 (4.4%) | |
Receiving both HPV and MMR | 148 | 148 (5.4%) |
Table 2 shows the distribution of sociodemographic factors in 9692 Danish 14 year old girls six months after receiving written reminders. The table includes the likelihood ratio test, p-values for each sociodemographic determinant and the odds ratios (OR) for vaccination with HPV, MMR or both.
Table 2.
OR for vaccination by sociodemographic variables, six month after receiving a reminder |
Girls only lacking HPV n = 4940 |
Girls only lacking MMR n = 2026 |
Girls lacking both HPV and MMR n = 2726 |
|||
---|---|---|---|---|---|---|
Receipt of HPV vaccine |
Receipt of MMR vaccine |
Receipt of MMR and HPV vaccine |
Receipt of MMR vaccine |
Receipt of HPV vaccine |
||
Number of vaccines administered |
757 |
173 |
148 |
121 |
137 |
|
Totalc n = 9692 | OR (95% CI) | OR (95% CI) | OR (95% CI) | OR (95% CI) | OR (95% CI) | |
Mothers' age | % (n)a | bp = 0.5969 | p = 0.1466 | p = 0.1095 | p = 0.8140 | p = 0.8296 |
>35 | 16.3 (1580) | 0.82 (0.82–1.32) | 0.73 (0.44–1.20) | 1.06 (0.65–1.74) | 1.01 (0.59–1.75) | 0.86 (0.51–1.45) |
25–34 | 67.9 (6580) | 1 | 1 | 1 | 1 | 1 |
<25 | 15.8 (1531) | 1.05 (0.82–1.33) | 0.66 (0.40–1.12) | 1.73 (1.05–2.83) | 0.83 (0.46–1.49) | 1.05 (0.61–1.79) |
Mothers' ethnicity | % (n) | p = 0.0000 | p = 0.9660 | p = 0.2578 | p = 0.6768 | p = 0.0733 |
Danish born | 85.7 (8306) | 1 | 1 | 1 | 1 | 1 |
Western immigrant | 2.4 (233) | 0.82 (0.45–1.48) | 1.54 (0.59–3.99) | 1.65 (0.58–4.72) | 0.76 (0.18–3.17) | |
Non-western immigrant | 11.9 (1153) | 2.02 (1.57–2.59) | 1.01 (0.59–1.74) | 1.54 (0.87–2.72) | 1.0 (0.47–2.11) | 1.96 (1.11–3.45) |
Family structure | % (n) | p = 0.8833 | p = 0.2010 | p = 0.7082 | p = 0.8273 | p = 0.0894 |
Two-parent household | 71.9 (6969) | 1 | 1 | 1 | 1 | 1 |
Single-parent household | 27.5 (2665) | 1.02 (0.82–1.27) | 1.33 (0.86–2.05) | 0.92 (0.99–2.65) | 1.06 (0.64–1.75) | 1.50 (0.94–2.39) |
Birth order | % (n) | p = 0.2969 | p = 0.1056 | p = 0.1087 | p = 0.0740 | p = 0.8213 |
First child | 42.1 (4080) | 1 | 1 | 1 | 1 | 1 |
Second | 35.8 (3470) | 1.15 (0.95–1.38) | 0.87 (0.61–1.25) | 1.02 (0.66–1.57) | 0.66 (0.43–1.02) | 1.06 (0.70–1.61) |
Third or later | 21.9 (2123) | 1.15 (0.90–1.47) | 0.58 (0.35–0.97) | 1.62 (0.99–2.65) | 0.57 (0.32–1.02) | 0.90 (0.53–1.54) |
Number of siblings | % (n) | p = 0.2109 | p = 0.8539 | p = 0.4480 | p = 0.6953 | p = 0.2916 |
0 | 17.1 (1657) | 1.05 (0.83–1.33) | 0.93 (0.59–1.46) | 1.02 (0.59–1.76) | 0.94 (0.55–1.61) | 0.89 (0.50–1.56) |
1 | 47.2 (4575) | 1 | 1 | 1 | 1 | 1 |
2 | 25.6 (2481) | 1.19 (0.98–1.45) | 0.92 (0.61–1.39) | 1.17 (0.76–1.81) | 0.95 (0.59–1.53) | 1.39 (0.91–2.13) |
≥3 | 9.4 (911) | 0.91 (0.67–1.24) | 1.23 (0.64–2.36) | 1.59 (0.91–2.78) | 0.61 (0.26–1.43) | 0.88 (0.44–1.76) |
Mothers' education | % (n) | p = 0.1096 | p = 0.1851 | p = 0.0067 | p = 0.6968 | p = 0.7218 |
Higher | 40.3 (3906) | 1 | 1 | 1 | 1 | 1 |
Intermediate | 39.7 (3848) | 0.96 (0.82–1.15) | 1.39 (0.96–2.02) | 0.63 (0.42–0.95) | 0.83 (0.53–1.30) | 0.95 (0.62–1.47) |
Basic | 18.0 (1745) | 0.76 (0.58–0.99) | 1.44 (0.85–2.43) | 0.43 (0.24–0.75) | 0.97 (0.54–1.72) | 1.18 (0.68–2.03) |
Place of residence by region | % (n) | p = 0.1500 | p = 0.0000 | p = 0.0957 | p = 0.0833 | p = 0.0774 |
North Denmark | 8.4 (814) | 1.02 (0.76–1.38) | 0.21 (0.09–0.49) | 0.68 (0.30–1.55) | 1.37 (0.68–2.76) | 0.59 (0.23–1.54) |
Central Denmark | 21.9 (2123) | 0.83 (0.66–1.04) | 0.48 (0.31–0.73) | 0.72 (0.43–1.19) | 0.55 (0.31–1.00) | 1.37 (0.88–2.14) |
Southern Denmark | 22.2 (2152) | 0.87 (0.70–1.08) | 0.62 (0.40–0.98) | 1.24 (0.79–1.95) | 0.70 (0.40–1.22) | 0.77 (0.45–1.32) |
Zealand | 15.9 (1541) | 0.76 (0.58–0.98) | 0.47 (0.28–0.81) | 0.64 (0.35–1.14) | 1.08 (0.65–1.82) | 0.67 (0.37–1.21) |
Capital | 31.7 (3072) | 1 | 1 | 1 | 1 | 1 |
Household income | % (n) | p = 0.6818 | p = 0.7224 | p = 0.7822 | p = 0.5854 | p = 0.6021 |
0–20 percentile | 19.9 (1929) | 0.81 (0.58–1.13) | 0.97 (0.51–1.84) | 1.26 (0.62–2.57) | 1.50 (0.69–3.23) | 0.69 (0.34–1.38) |
21–40 percentile | 19.9 (1929) | 0.98 (0.73–1.30) | 0.71 (0.40–1.26) | 1.42 (0.74–2.72) | 1.31 (0.64–2.67) | 0.61 (0.32–1.17) |
41–60 percentile | 19.9 (1929) | 0.97 (0.74–1.26) | 0.85 (0.51–1.40) | 1.43 (0.78–2.61) | 1.22 (0.63–2.39) | 0.68 (0.37–1.24) |
61–80 percentile | 19.9 (1929) | 0.98 (0.76–1.26) | 0.87 (0.53–1.43) | 1.31 (0.72–2.39) | 1.64 (0.89–3.05) | 0.70 (0.39–1.26) |
81–100 percentile | 19.9 (1929) | 1 | 1 | 1 | 1 | 1 |
Mothers' employment | % (n) | p = 0.8690 | p = 0.3276 | p = 0.6394 | p = 0.8335 | p = 0.3021 |
Employed | 88.0 (8529) | 1 | 1 | 1 | 1 | 1 |
Unemployed < 26 weeks | 7.8 (756) | 0.93 (0.68–1.26) | 0.68 (0.34–1.38) | 1.29 (0.73–2.28) | 0.81 (0.38–1.69) | 0.54 (0.23–1.26) |
Unemployed ≥ 26 weeks | 3.1 (301) | 1.05 (0.68–1.60) | 0.59 (0.20–1.69) | 0.82 (0.25–2.72) | 0.89 (0.27–2.96) | 1.00 |
The remaining proportion represents missing responses for each covariable.
p-value for Likelyhood ratio test (LR-test).
No marked differences in distribution of covariables by subgroups of missing vaccinations.
Many of the socio-demographic characteristics examined in this study, had little or no effect on vaccination-compliance to the reminder. Birth order and number of siblings, family structure, household income, mother's age, and unemployment showed no effect.
Mother's ethnicity had a strong predictive value for girls who only lacked HPV-vaccination. Here, we found a two-fold increase in vaccination-compliance for girls with non-western mothers (OR 2.02, 1.57–2.59).
The same tendency was seen for receiving a HPV-vaccination among those who also lacked MMR-vaccination although the likelihood ratio test was not significant.
The educational level was found to predict reminder-compliance in girls receiving both vaccinations, with higher response in the group with higher education. Girls having a mother with intermediate or basic education were less likely to be vaccinated (OR 0.63, 0.42–0.95) and (OR 0.43, 0.24–0.75) respectively. The same tendency was seen for receiving a HPV-vaccination among those only lacking HPV although the likelihood ratio test was not significant.
Girls only lacking an MMR-vaccination, were less likely to be vaccinated when living in the North Denmark (OR 0.21, 0.09–0.49), Central Denmark (OR 0.48, 0.31–0.73), Southern Denmark (OR 0.62, 0.40–0.98) or Zealand region (OR 0.47, 0.28–0.81) as compared to the Capital region.
4. Discussion
This study showed that vaccination-compliance after a personalised written reminder was affected by socio-demographic determinants and that these effects depend on the specific vaccines that were missing.
The strongest association was seen for girls only lacking HPV-vaccination, where we saw a twofold likelihood of receiving the vaccination in girls with non-western immigrant descent. The same pattern was seen for receiving a HPV-vaccination among those who also lacked MMR-vaccination although the likelihood ratio test was not significant. This finding may be related to the public discussion concerning the safety of HPV vaccines. These discussions occurred on social media platforms and public media (TV, newspapers, etc.) in Danish, from 2015 until 2016. Hence, it is possible that parents of non-Western ethnicity, who are not part of this discourse, may easily be convinced of vaccination by a personal reminder, whereas parents with Danish as their mother tongue may need more persuasion due to the expressed concerns about the safety of HPV-vaccination.
On the other hand, we found a decreased likelihood of MMR-vaccination reminder-compliance in girls living outside the Capital Region. This could be related to the fact that MMR-vaccination uptake in the Capital region consistently has been lower than the rest of the country. Hence, some parents of the Capital region may be “the low hanging fruits” that respond to the reminder, and do not represent conscientious objectors. Internationally, several studies have shown lower vaccination rates among inner-city or urban children providing pockets of poor coverage allowing for high susceptibility for vaccine-preventable disease (Finney Rutten et al., 2017; Wright and Polack, 2006).
Even though the correlation was only found to be significant for the group of girls lacking and receiving both vaccines, it is interesting to note that education was positively correlated with reminder-compliance in all groups except the group only lacking MMR-vaccination. The reasons for this may be manifold. We have no way to know if the reminder letter was opened, read and understood by all the parents, It is conceivable that the chance of reading and understanding a two-page letter from a public organisation increases by increased levels of education. More research is needed to investigate utilising various communication platforms as reminder tools.
Many of the socio-demographic characteristics examined in this study, had little or no effect on vaccination-compliance after the reminder. Contrary to previous studies of vaccination predictors, we did not find any effects of maternal birth order (Falagas and Zarkadoulia, 2008) and number of siblings (Ogilvie et al., 2010), family structure (Pearce et al., 2008; Vandermeulen et al., 2008), household income (Vandermeulen et al., 2008), mother's age (Widgren et al., 2011), and unemployment (Vandermeulen et al., 2008). This could in part be related to the fact that Denmark is a more homogeneous country than many other study settings with a Gini coefficient around 0.25 in 2014 (Organisation for Economic Co-operation and Development (OECD), n.d.).
We have been unable to identify previous studies investigating socio-economic or demographic variables for vaccination-compliance after a reminder with emphasis on different pathways for the MMR and HPV-vaccinations. Studies investigating mail and telephone reminder and recall interventions have shown low effectiveness in lower income populations (Irigoyen et al., 2006; LeBaron et al., 2004; Szilagyi et al., 2006). Tseng et al. investigated the efficacy of sending patient reminder letters for cervical screenings (Tseng et al., 2000), and found the letters to increase the rate of cervical cancer screenings, yet with less effect in lower socioeconomic groups. This coincides with our findings regarding education.
Evidence is now emerging that the association between under-vaccination and sociodemographic factors is complex. Our results of a higher likelihood of HPV/MMR vaccination in girls from highly educated women reaffirm the classical correlation. This correlation has been seen in vaccination decisions regarding MMR (Tabacchi et al., 2016) and HPV (Finney Rutten et al., 2017; Monnat et al., 2016). This contrasts with findings of vaccine acceptance being less likely in parents with longer educations in the USA and Canada (Constantine and Jerman, 2007; Ogilvie et al., 2010; Rosenthal et al., 2008). A recent meta-analysis did not find strong evidence for differences in HPV-vaccination by parental income or education (Fisher et al., 2013), and a study from Norway found opposing effects of parental education and income (Hansen et al., 2015).
In 2011, Widgren et al. showed that the adherence to MMR-vaccination was a strong determinant for uptake of HPV1 (Widgren et al., 2011), which is very much in line with previous studies on the predictive value of previous vaccination behaviour (Pearce et al., 2009). We found that 50% of the girls who received a reminder missed only HPV-vaccination, which is likely due to the current HPV crisis in Denmark. Among those who missed both MMR and HPV-vaccination the uptake was similar after the reminder.
Other signs of clustering of preventive health behaviour have been found. Prevention of cervical cancer is a combination of vaccination and screening (PAP-smear). Studies have shown social inequality in cervical cancer screening (Blackwell et al., 2008; Drolet et al., 2013; Scarinci et al., 2010) as well as knowledge of HPV (Rossi et al., 2014) and HPV-vaccination uptake (Marc et al., 2010). This pattern also extends to the daughters as mothers' intention has been shown to be the strongest predictor of their girls' HPV-vaccination uptake (Alberts et al., 2017). Also, girls of mothers attending regular PAP-smears have a higher likelihood of receiving HPV-vaccinations (Markovitz et al., 2014; Monnat and Wallington, 2013).
De Casadevante et al., found large differences in uptake of the first HPV-vaccination, indicating that some target groups are harder to reach than others. They also hypothesised that this difference was likely to dissipate as the integration occurs where differences between the different population groups seem to vanish (Fernández de Casadevante et al., 2016). In addition to what was mentioned below, the results of a higher effect in girls of non-western descent could be explained by the fact that girls in Denmark of non-native descent are less likely to initiate the HPV-vaccination series (Slåttelid Schreiber et al., 2015), in other words; there is a larger pool of girls to target with the reminder.
4.1. Predictors for compliance after reminder
Social-environmental factors including cultural beliefs as well as social group norms may also play a role (STURM et al., 2005). The debate on HPV-vaccination and suspected adverse events has been fierce over the previous years in Denmark. This could have affected the native Danish population to a higher degree than immigrant mothers and differentiate the reminder effect. We saw no signs of active opting out of HPV-vaccinations with the debate affecting the vaccination choices in this particular group. There were indications of a selective vaccination process in 258 girls (258/2726 = 9.5%) who lacked both HPV and MMR-vaccination. Out of the group, 121 girls received only an MMR-vaccination and 137 received only an HPV-vaccination but the numbers too small to conclude. Nevertheless, this indicates different decision pathways for the two vaccines.
Identifying and understanding the social determinants related to routine childhood vaccination in various countries are important to improve vaccination coverage. Our findings show that these factors are diverse and that the relationship between socio-demographic predictors and childhood vaccination is complex and driven by context. Some social determinants may be similar in countries with any income level while others may be population-specific (Glatman-freedman and Nichols, 2012).
Our findings supplement current knowledge on the social distribution of HPV and MMR-vaccination uptake and regional differences in coverage, particularly in relation to maternal ethnicity.
4.2. Strengths and limitations of this study
The study is nationwide and included all unvaccinated 14-year-old girls in Denmark in the study period. We investigated variables registered at the individual level and all dynamic variables refer to the year of the reminder. The use of national population-based registry data ensures no loss to follow up and minimises the risk of selection, misclassification and response-biases. We studied the associations between parents' income, mothers' education and other socio-demographic determinants and the uptake of vaccines while controlling for numerous possible confounders. However, we could not address causal relationships or identify individual barriers to HPV or MMR-vaccination. Using quantitative register based studies does not allow for investigations of barriers such as misinformation or concerns about adverse events previously identified in studies (Dubé et al., 2013). Qualitative studies are needed to address the individual decision process after receiving a written reminder-letter. Denmark is a high-income country with a high level of interpersonal and societal trust (Elgar and Aitken, 2011) and a free childhood vaccination schedule. Generalisation to other settings and/or other vaccines may be challenged by the fact that determinants for non-vaccination differ across countries depending on the cultural context and on the structures managing the vaccination programme. To uncover this it is necessary to apply a qualitative approach e.g. as included in the “Tailoring Immunisation Programme” developed by WHO. This has been carried out in England (Public Health England, 2016) and Sweden (Godoy-Ramirez, 2016).
The DDV has been shown to include a underreporting of vaccinations estimated to 3–4 percentage points (Wójcik et al., 2013). Misclassification of vaccination status could lead to parents receiving an irrelevant reminder, which could lead to a decrease in registered effect of the reminder. We have no reason to suspect differential misclassification between HPV and MMR-vaccination.
The multivariable model included variables, which are correlated, and could introduce over adjustment bias affecting the precision of the model. This is particularly the case for maternal education and household income as well as for number of siblings and birth order. All variables were adjusted for each other but the risk of residual confounding exists. Still, we found that the patterns observed in the crude estimates were similar to the patterns in the adjusted estimates. Sample size was limited and the lack of power could result in lacking identification of associations.
We only looked at predictors related to the mother as current international literature supports that the mother is the gatekeeper in the parental clinical decision-making process (Walhart, 2012). There is emerging evidence that paternal determinants play a role in vaccination behaviour (Rammohan et al., 2012). The available data indicate it to be less influential for HPV-vaccination. It is, on the other side conceivable that the relative importance of maternal versus paternal determinants must be high context specific and this needs to be considered in future studies.
Our study group was confined to girls born in Denmark, which excluded the possibility to investigate the associations in refugees and immigrants, a vulnerable groups, well known to be at risk for non-vaccination (Moller et al., 2015).
5. Conclusions
Overall, 14% of girls reminded received at least one vaccine with the highest effect found in girls only lacking HPV.
Among girls who only missed HPV-vaccination the compliance to the reminder was two-fold higher among girls with non-western born mothers, as compared to mothers born in Denmark. This is encouraging as cervical cancer incidence has been shown to have a higher prevalence in ethnic minority groups (Arnold et al., 2010). We found similar uptake of HPV and MMR-vaccination in girls lacking both vaccinations, disregarding the theory of Danish parents being more opposed to the new and less familiar HPV-vaccine. The finding of a lower effect in girls of mother with shorter education as well as girls living outside the capital region indicates the need of supplementary interventions in order to increase vaccination coverage in these groups.
We found that sociodemographic factors were associated with response to vaccination-reminders. Knowledge from this study may be relevant for other countries considering implementing a national reminder system to increase the vaccination coverage.
Conflicts of interest
All authors report no conflicts of interest.
Acknowledgments
Camilla Hiul Suppli, has received PhD research funding through unrestricted grants from the following private foundations: Axel Muusfeldts fond (3-635), Christian Larsen og Dommer Ellen Larsens legat (9681-3115), Else og Mogen Wedell-Wedellsborgs fond (24-15-1), Familien Hede-Nielsens fond (9681-3159), AP Møller Fonden - Fonden til Lægevidenskabens fremme (14-406), Helsefonden (9681-3095), Illum Fondet (9681-3177), Ole Kirks fond (20-5685) and Rosalie Petersens fond (020432-0001). None has any affiliation that poses a conflict of interest. The study was approved by the Danish Data Inspection Agency according to Danish Legislation.
Footnotes
Supplementary data to this article can be found online at https://doi.org/10.1016/j.pmedr.2018.02.005.
Appendix A. Supplementary data
References
- Alberts C.J., van der Loeff M.F.S., Hazeveld Y. A longitudinal study on determinants of HPV vaccination uptake in parents/guardians from different ethnic backgrounds in Amsterdam, the Netherlands. BMC Public Health. 2017;17(220) doi: 10.1186/s12889-017-4091-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Arnold M., Razum O., Coebergh J. Cancer risk diversity in non-western migrants to Europe: an overview of the literature. Eur. J. Cancer. 2010;46:2647–2659. doi: 10.1016/j.ejca.2010.07.050. [DOI] [PubMed] [Google Scholar]
- Baadsgaard M., Quitzau J. Danish registers on personal income and transfer payments. Scand. J. Public Health. 2011;39:103–105. doi: 10.1177/1403494811405098. [DOI] [PubMed] [Google Scholar]
- Blackwell D.L., Martinez M.E., Gentleman J.F. Women's compliance with public health guidelines for mammograms and pap tests in Canada and the United States. An analysis of data from the Joint Canada/United States Survey of Health. Womens Health Issues. 2008;18:85–99. doi: 10.1016/j.whi.2007.10.006. [DOI] [PubMed] [Google Scholar]
- Briss P.A., Rodewald L.E., Hinman A.R. Reviews of evidence regarding coverage in children, adolescents, and adults. Am. J. Epidemiol. 2000;18 doi: 10.1016/s0749-3797(99)00118-x. [DOI] [PubMed] [Google Scholar]
- Constantine N.A., Jerman P. Acceptance of human papillomavirus vaccination among Californian parents of daughters: a representative statewide analysis. J. Adolesc. Health. 2007;40:108–115. doi: 10.1016/j.jadohealth.2006.10.007. [DOI] [PubMed] [Google Scholar]
- Crocker-Buque T., Edelstein M., Mounier-Jack S. Interventions to reduce inequalities in vaccine uptake in children and adolescents aged. J. Epidemiol. Community Health. 2016 doi: 10.1136/jech-2016-207572. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Drolet M., Boily M.C., Greenaway C. Sociodemographic inequalities in sexual activity and cervical cancer screening: implications for the success of human papillomavirus vaccination. Cancer Epidemiol. Biomark. Prev. 2013;22:641–652. doi: 10.1158/1055-9965.EPI-12-1173. [DOI] [PubMed] [Google Scholar]
- Dubé E., Laberge C., Guay M., Bramadat P., Roy R., Bettinger J. a. Vaccine hesitancy: an overview. Hum. Vaccin. Immunother. 2013;9:1763–1773. doi: 10.4161/hv.24657. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Elgar F.J., Aitken N. Income inequality, trust and homicide in 33 countries. Eur. J. Pub. Health. 2011;21:241–246. doi: 10.1093/eurpub/ckq068. [DOI] [PubMed] [Google Scholar]
- Falagas M.E., Zarkadoulia E. Factors associated with suboptimal compliance to vaccinations in children in developed countries: a systematic review. Curr. Med. Res. Opin. 2008;24:1719–1741. doi: 10.1185/03007990802085692. [DOI] [PubMed] [Google Scholar]
- Fernández de Casadevante V., Cantarero-Arévalo L., Cuesta J.G., Valentiner-Branth P. Ethnic background and human papillomavirus vaccine uptake in Denmark: a countrywide retrospective cohort study including 274,154 women aged 19-28 years. Papillomavirus Res. 2016;2:78–84. doi: 10.1016/j.pvr.2016.03.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Finney Rutten L.J., Wilson P.M., Jacobson D.J. A population-based study of sociodemographic and geographic variation in HPV vaccination. Cancer Epidemiol. Biomark. Prev. 2017;26:533–540. doi: 10.1158/1055-9965.EPI-16-0877. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fisher H., Trotter C.L., Audrey S., MacDonald-Wallis K., Hickman M. Inequalities in the uptake of human papillomavirus vaccination: a systematic review and meta-analysis. Int. J. Epidemiol. 2013;42:896–908. doi: 10.1093/ije/dyt049. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Glatman-freedman A., Nichols K.A. 2012. On Immunization Programs © 2012 Landes Bioscience. Do not distribute. © 2012 Landes Bioscience; pp. 293–301. Do not distribute. [Google Scholar]
- Godoy-Ramirez K. Tailored communication to hard-to-reach groups–a pilot in a Somali community, Sweden, on vaccination. Eur. J. Pub. Health. 2016;26 [Google Scholar]
- Grove Krause T., Jakobsen S., Haarh M., Mølbak K. The Danish vaccination register. Euro Surveill. 2012;17:1–6. doi: 10.2807/ese.17.17.20155-en. [DOI] [PubMed] [Google Scholar]
- Hansen B.T., Campbell S., Burger E., Nygård M. Correlates of HPV vaccine uptake in school-based routine vaccination of preadolescent girls in Norway: a register-based study of 90,000 girls and their parents. Prev. Med. 2015;77:4–10. doi: 10.1016/j.ypmed.2015.04.024. [DOI] [PubMed] [Google Scholar]
- Harvey H., Reissland N., Mason J. Parental reminder, recall and educational interventions to improve early childhood immunisation uptake: a systematic review and meta-analysis. Vaccine. 2015;33:2862–2880. doi: 10.1016/j.vaccine.2015.04.085. [DOI] [PubMed] [Google Scholar]
- Irigoyen M.M., Findley S., Wang D. Challenges and successes of immunization registry reminders at inner-city practices. Ambul. Pediatr. 2006;6:100–104. doi: 10.1016/j.ambp.2005.10.006. [DOI] [PubMed] [Google Scholar]
- Jacobson V.J., Szilagyi P. Patient reminder and recall systems to improve immunization rates (review) Cochrane Database Syst. Rev. 2009;2005(3) doi: 10.1002/14651858.CD003941.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jensen V.M., Rasmussen A.W. Danish education registers. Scand. J. Public Health. 2011;39:91–94. doi: 10.1177/1403494810394715. [DOI] [PubMed] [Google Scholar]
- Knudsen L.B., Olsen J. The Danish Medical Birth Registry. Dan. Med. Bull. 1998;45:320–323. [PubMed] [Google Scholar]
- Krause T.G., Valentiner-Branth P., Galle M., Mølbak K. Epi-News; 2015. EPI-NEWS Reminders of Lacking Childhood Vaccinations, Experiences After the first 5 months. [Google Scholar]
- Leask J., Kinnersley P., Jackson C., Cheater F., Bedford H., Rowles G. Communicating with parents about vaccination: a framework for health professionals. BMC Pediatr. 2012;12(154) doi: 10.1186/1471-2431-12-154. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Leask J., Willaby H.W., Kaufman J. The big picture in addressing vaccine hesitancy. Hum. Vaccin. Immunother. 2014;10 doi: 10.4161/hv.29725. [DOI] [PMC free article] [PubMed] [Google Scholar]
- LeBaron C.W., Starnes D.M., Rask K.J. The impact of reminder-recall interventions on low vaccination coverage in an Inner-City population. Arch. Pediatr. Adolesc. Med. 2004;158:255. doi: 10.1001/archpedi.158.3.255. [DOI] [PubMed] [Google Scholar]
- Luman E., McCauley M., Shefer A., Chu S. Maternal characteristics associated with vaccination of young children. Pediatrics. 2003;111 [PubMed] [Google Scholar]
- Marc R., Alies V.L., Jan V.D.K., Laura R., Hester D.M. Determinants for HPV vaccine uptake in the Netherlands: a multilevel study. Vaccine. 2010;28:2070–2075. doi: 10.1016/j.vaccine.2009.12.042. [DOI] [PubMed] [Google Scholar]
- Markovitz A.R., Song J.Y., Paustian M.L., El Reda D.K. Association between maternal preventive care utilization and adolescent vaccination: It's not just about pap testing. J. Pediatr. Adolesc. Gynecol. 2014;27:29–36. doi: 10.1016/j.jpag.2013.08.012. [DOI] [PubMed] [Google Scholar]
- Moller S.P., Hjern A., Andersen A.M.N., Norredam M. Differences in uptake of immunisations and health examinations among refugee children compared to Danish-born children: a cohort study. Eur. J. Pediatr. 2015 doi: 10.1007/s00431-015-2663-9. [DOI] [PubMed] [Google Scholar]
- Monnat S.M., Wallington S.F. Is there an association between maternal pap test use and adolescent human papillomavirus vaccination? J. Adolesc. Health. 2013;52:212–218. doi: 10.1016/j.jadohealth.2012.05.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Monnat S.M., Rhubart D.C., Wallington S.F. Differences in human papillomavirus vaccination among adolescent girls in metropolitan versus non-metropolitan areas: considering the moderating roles of maternal socioeconomic status and health care access. Matern. Child Health J. 2016;20:315–325. doi: 10.1007/s10995-015-1831-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Muscat M. Who gets measles in Europe? J. Infect. Dis. 2011;204(Suppl):S353–65. doi: 10.1093/infdis/jir067. [DOI] [PubMed] [Google Scholar]
- Ogilvie G., Anderson M., Marra F. A population-based evaluation of a publicly funded, school-based HPV vaccine program in British Columbia, Canada: parental factors associated with HPV vaccine receipt. PLoS Med. 2010;7 doi: 10.1371/journal.pmed.1000270. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Organisation for Economic Co-operation and Development (OECD), n.d. Income inequality 2014 [WWW Document]. (URL https://data.oecd.org/inequality/income-inequality.htm (accessed 9.21.17)).
- Pearce A., Law C., Elliman D., Cole T.J., Bedford H., Millennium Cohort Study Child Health Group Factors associated with uptake of measles, mumps, and rubella vaccine (MMR) and use of single antigen vaccines in a contemporary UK cohort: prospective cohort study. BMJ. 2008;336:754–757. doi: 10.1136/bmj.39489.590671.25. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pearce A., Elliman D., Law C., Bedford H. Does primary immunisation status predict MMR uptake? Arch. Dis. Child. 2009;94:49–51. doi: 10.1136/adc.2007.132647. [DOI] [PubMed] [Google Scholar]
- Pedersen C.B. The Danish civil registration system. Scand. J. Public Health. 2011;39:22–25. doi: 10.1177/1403494810387965. [DOI] [PubMed] [Google Scholar]
- Public Health England . 2016. Tailoring Immunisation Programmes Charedi Community, North London. London. [Google Scholar]
- Rammohan A., Awofeso N., Fernandez R.C. Paternal education status significantly influences infants measles vaccination uptake, independent of maternal education status. BMC Public Health. 2012;12(1) doi: 10.1186/1471-2458-12-336. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rand C.M., Shone L.P., Albertin C., Auinger P., Klein J.D., Szilagyi P.G. National health care visit patterns of adolescents: implications for delivery of new adolescent vaccines. Arch. Pediatr. Adolesc. Med. 2007;161:252–259. doi: 10.1001/archpedi.161.3.252. [DOI] [PubMed] [Google Scholar]
- Rosenthal S.L., Rupp R., Zimet G.D. Uptake of HPV vaccine: demographics, sexual history and values, parenting style, and vaccine attitudes. J. Adolesc. Health. 2008;43:239–245. doi: 10.1016/j.jadohealth.2008.06.009. [DOI] [PubMed] [Google Scholar]
- Rossi P.G., Baldacchini F., Ronco G. vol. 4. 2014. The Possible Effects on Socio-economic Inequalities of Introducing HPV Testing as Primary Test in Cervical Cancer Screening Programs; pp. 1–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Scarinci I.C., Garcia F.A.R., Kobetz E. Cervical cancer prevention: new tools and old barriers. Cancer. 2010;116:2531–2542. doi: 10.1002/cncr.25065. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Slåttelid Schreiber S.M., Juul K.E., Dehlendorff C., Kjær S.K. Socioeconomic predictors of human papillomavirus vaccination among girls in the Danish childhood immunization program. J. Adolesc. Health. 2015;56:402–407. doi: 10.1016/j.jadohealth.2014.12.008. [DOI] [PubMed] [Google Scholar]
- Smith P.J., Chu S.Y., Barker L.E. Children who have received no vaccines: who are they and where do they live? Pediatrics. 2004;114:187–195. doi: 10.1542/peds.114.1.187. [DOI] [PubMed] [Google Scholar]
- SSI, n.d. Vaccination Coverage in Denmark [WWW Document]. Vaccinationstilslutning. URL http://www.ssi.dk/Smitteberedskab/Sygdomsovervaagning/VaccinationSurveillance.aspx?vaccination=12&xaxis=Cohort&sex=3&landsdel=100&show=Graph&datatype=Vaccination&extendedfilters=False#HeaderText
- Statistics_Denmark . familier og børn 2016. 2016. Statistikdokumentation for Husstande. [Google Scholar]
- Strine T.W., Luman E.T., Okoro C. a, McCauley M.M., Barker L.E. Predictors of age-appropriate receipt of DTaP Dose 4. Am. J. Prev. Med. 2003;25:45–49. doi: 10.1016/s0749-3797(03)00093-x. [DOI] [PubMed] [Google Scholar]
- STURM L., MAYS R., ZIMET G. Parental beliefs and decision making about child and adolescent immunization: from polio to sexually transmitted infections. J. Dev. Behav. Pediatr. 2005;26:441–452. doi: 10.1097/00004703-200512000-00009. [DOI] [PubMed] [Google Scholar]
- Suh C.A., Saville A., Daley M.F. Effectiveness and net cost of reminder/recall for adolescent immunizations. Pediatrics. 2012;129:e1437–45. doi: 10.1542/peds.2011-1714. [DOI] [PubMed] [Google Scholar]
- Sundhed.dk, n.d. Well-child Appointments in Denmark [WWW Document]. URL https://www.sundhed.dk/borger/patienthaandbogen/boern/undersoegelser/boerneundersoegelser/
- Sundhedsstyrelsen . 2007. Evaluering af de forebyggende børneundersøgelser i almen praksis. [Google Scholar]
- Suppli C.H., Rasmussen M., Mølbak K., Krause T.G. Written reminders increase vaccine coverage in Danish children - evaluation of a nationwide intervention using The Danish Vaccination Register, 2014 to 2015. Eur. Secur. 2017:1–8. doi: 10.2807/1560-7917.ES.2017.22.17.30522. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Szilagyi P.G., Schaffer S., Barth R. Effect of telephone reminder/recall on adolescent immunization and preventive visits. Arch. Pediatr. Adolesc. Med. 2006;160:157. doi: 10.1001/archpedi.160.2.157. [DOI] [PubMed] [Google Scholar]
- Tabacchi G., Costantino C., Napoli G. Determinants of European parents' decision on the vaccination of their children against measles, mumps and rubella: a systematic review and meta-analysis. Hum. Vaccin. Immunother. 2016;12:1909–1923. doi: 10.1080/21645515.2016.1151990. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Timmermans B. Aalborg; 2010. The Danish Integrated Database for Labor Market Research: Towards Demystification for the English Speaking Audience. [Google Scholar]
- Tseng D.S., Cox E., Plane M.B., Hia K.M. Efficacy of patient letter reminders on cervical. J. Gen. Intern. Med. 2000;16(8):563–568. doi: 10.1046/j.1525-1497.2001.016008567.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vandermeulen C., Roelants M., Theeten H., Van Damme P., Hoppenbrouwers K. Vaccination coverage and sociodemographic determinants of measles-mumps-rubella vaccination in three different age groups. Eur. J. Pediatr. 2008;167:1161–1168. doi: 10.1007/s00431-007-0652-3. [DOI] [PubMed] [Google Scholar]
- Walhart T. Parents, adolescents, children and the human papillomavirus vaccine: a review. Int. Nurs. Rev. 2012;2006:305–312. doi: 10.1111/j.1466-7657.2012.00991.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- WHO regional Office Europe . 2017. Measles outbreaks across Europe Threaten Progress Towards Elimination [WWW Document] (URL http://www.euro.who.int/en/media-centre/sections/press-releases/2017/measles-outbreaks-across-europe-threaten-progress-towards-elimination (accessed 5.21.17)) [Google Scholar]
- Widgren K., Simonsen J., Valentiner-Branth P., Mølbak K. Uptake of the human papillomavirus-vaccination within the free-of-charge childhood vaccination programme in Denmark. Vaccine. 2011;29:9663–9667. doi: 10.1016/j.vaccine.2011.10.021. [DOI] [PubMed] [Google Scholar]
- Wójcik O.P., Simonsen J., Mølbak K., Valentiner-Branth P. Validation of the 5-year tetanus, diphtheria, pertussis and polio booster vaccination in the Danish childhood vaccination database. Vaccine. 2013;31:955–959. doi: 10.1016/j.vaccine.2012.11.100. [DOI] [PubMed] [Google Scholar]
- World Health Organization, Unicef, W.B . 3rd ed. 2009. State of the World's Vaccines and Immunization. [Google Scholar]
- Wright J. a, Polack C. Understanding variation in measles-mumps-rubella immunization coverage—a population-based study. Eur. J. Pub. Health. 2006;16:137–142. doi: 10.1093/eurpub/cki194. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.