Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2021 Jul 1.
Published in final edited form as: Cancer Epidemiol Biomarkers Prev. 2020 Oct 2;30(1):13–21. doi: 10.1158/1055-9965.EPI-20-0617

Area-Level Variation and Human Papillomavirus Vaccination among Adolescents and Young Adults in the United States: A Systematic Review

Elizabeth K Do 1,2, Brianna Rossi 3, Carrie A Miller 1,2, Albert J Ksinan 1, David C Wheeler 2,4, Askar Chukmaitov 1, John W Cyrus 5, Bernard F Fuemmeler 6,2
PMCID: PMC8108385  NIHMSID: NIHMS1634715  PMID: 33008874

Abstract

Background:

Understanding how human papillomavirus (HPV) vaccination coverage varies by geography can help to identify areas of need for prevention and control efforts.

Methods:

A systematic review of the literature was conducted using a combination of keywords (HPV vaccination, geography, neighborhoods, and sociodemographic factors) on Medline and Embase databases. Studies had to provide information on HPV vaccination by area-level variables, be conducted in the United States, and published in English (analyzing data from January 2006 to February 2020). Conference abstracts and opinion pieces were excluded.

Results:

Of 733 records identified, 25 were included for systematic review. Across studies, the average initiation rate was 40.5% (range: 6.3% to 78.0%). The average rate of completion was 23.4% (range: 1.7% to 55.2%). Geographic regions and area-level factors were associated with HPV vaccination, including zip code tabulation area-level poverty, urbanicity/rurality, racial/ethnic composition, and health service region characteristics. Only three studies utilized geospatial approaches. None accounted for geospatial-temporal associations.

Conclusions:

Individual-level and area-level factors and their interactions are important for characterizing HPV vaccination.

Impact:

Results demonstrate the need to move beyond existing multilevel methods and towards the adoption of geospatial approaches that allow for the mapping and detection of geographic areas with low HPV vaccination coverage.

Keywords: Human papillomavirus, vaccination, geospatial, geographical variation, adolescents, young adults

INTRODUCTION

Human Papillomavirus (HPV) is the most common sexually transmitted infection. An estimated 75% of all sexually active people are infected during their lifetime (1). Although most HPV infections clear within a couple years, persistent infections can lead to more serious conditions (2). Certain HPV types are associated with precancerous lesions, genital and anogenital warts, and cancer. Approximately 33,700 new cancer cases are attributed to HPV annually (3). The two most common types of cancer caused by HPV are cervical and oropharynx cancers, as 91% of all cervical cancer cases and 70% of all oropharyngeal cancer cases are linked to HPV (4). The Food and Drug Administration (FDA) currently recommends the approved nanovalent (9-valent) HPV vaccine to provide additional protection against of HPV (strains 6, 11, 16, 18, 31, 33, 45, 52, 58) and to prevent an additional 4.2%−18.3% of new cancer cases (5). Recent estimates, however, indicate that only 54.2% of adolescents are up-to-date on HPV vaccination (6).

To better understand why coverage is low, extensive research has focused on identifying individual-level factors associated with HPV vaccination (7–9). A recent systematic review suggested a relationship between awareness and knowledge of HPV and vaccination (1). Other studies identified conflicting associations between individual-level sociodemographic factors (e.g., education level, income) and initiation (10–13). A meta-analysis of observational studies of parents’ coverage of HPV vaccines for their children demonstrated that having health insurance coverage, lower out-of-pocket costs, and recommendation by physicians are associated with greater odds of vaccination (14). Health care professionals also cite low perceived risk of HPV infection or lack of direct benefit for children among parents as barriers to HPV vaccination (2).

Intervention efforts addressing these factors have helped to improve vaccination initiation (15). However, efforts are often untargeted or limited to geographic areas selected from convenience samples. Further, despite overall increases, HPV vaccination coverage is very heterogeneous over space. Up-to-date HPV vaccination varies across US states, from 77.7% in Rhode Island to 28.8% in Mississippi (16). Geographic disparities in vaccination may contribute to continuing disparities in HPV-related cancers, especially in certain geographic areas within the US where HPV vaccination prevalence is low (e.g., rural and southern regions) (17). Identifying area-level characteristics (e.g., race/ethnicity, poverty, provider shortage areas, etc.) associated with variation in vaccination will be useful for identifying areas for systems-level intervention efforts.

The most widely used method involving area-level effects in HPV research is multilevel regression analysis. Although the multilevel approach helps to correct for area-level correlation among individual observations, it typically ignores potential between-area correlations due to underlying spatial processes. Using a multilevel approach that does not take into account spatial processes could lead to overstatement of the statistical significance of area-level effects (18–20).

Given the potential limitations of this approach, there is increasing interest in population precision health approaches that leverage geospatial technologies, such as geographic information system (GIS) tools, and spatial analysis methods to tailor prevention efforts to areas of high need (21). Spatial regression modeling explicitly models spatial correlations among observations (22,23) and can be used to improve mapping, detect significant risk areas, and identify potential risk factors at a particular geographic level (24,25). Further, geospatial methods can also be used to recognize patterns of occurrence, identify priority areas for prevention, and provide more accurate modeling of spatially clustered data (26,27). Despite the known benefits of using geospatial methods for disease surveillance and data exploration in a spatial context (28), its use in the context of HPV vaccination research is unknown.

As previously mentioned, HPV vaccination coverage varies greatly across US states (16). Yet, few studies have examined area-level variation in HPV vaccination and the factors associated with it. This systematic review will summarize and synthesize findings regarding associations between variation in area-level factors and HPV vaccination coverage. We will also summarize results with respect to how individual-level factors may interact with area-level factors to predict HPV vaccination.

MATERIALS AND METHODS

Electronic Search Strategy.

A systematic search for published literature was conducted in accordance with PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines using Medline (Ovid) and Embase (Ovid) databases. An initial search was conducted in February 2019 and a subsequent search using the same search strategy was conducted in February 2020 to update the review. The search used a combination of keywords and controlled vocabulary for the following concepts: HPV vaccination, geography, neighborhoods, and sociodemographic factors, adapted to each database (see Supplementary Table 1). Reference lists from journal articles were also used to discover publications not identified in database searches. Study selection process are depicted in Figure 1.

Figure 1.

Figure 1.

PRISMA flow diagram of literature search

Study Selection.

Articles were included if they: described HPV vaccination (e.g., initiation, completion, and “missed opportunities” for vaccination) by area-level factors (e.g., region, other neighborhood-level variables), were conducted in the US, and were published in English. Additionally, studies were eligible for inclusion only if they analyzed data from January 2006 (e.g. the year that vaccination programs were first implemented (7)) to February 2020 (e.g. when the updated search was conducted). Initially, 733 articles were identified. All references were uploaded to reference management software and exported into Microsoft Excel for review. Studies that were identified as: duplicates (N=6), conducted outside of the US (N= 314), or did not directly analyze HPV vaccine coverage by area-level variables (N=344) were excluded. Following full-text review, systematic reviews (N=37), conference notes (N=1), and conference abstracts with no attached article (N=6) were excluded.

Data Collection, Extraction, and Analysis.

Twenty-five articles were included and underwent an assessment of methodological quality, using the Effective Public Health Practice Project (EPHPP) Quality Assessment Tool for Quantitative Studies (29). This tool includes component ratings on selection bias, study design, confounders, blinding, data collection methods, withdrawals and dropouts, intervention integrity, and analysis. From component ratings, a global rating is calculated and a qualitative score (e.g., weak, moderate, or strong) is assigned. The EPHPP has been applied to other systematic reviews and demonstrated inter-rater reliability for individual domains and overall scores (30). The EPHPP was modified for use with cross-sectional studies by examining selection bias (e.g., sample representativeness, participation rate), data collection (e.g., reliability and validity), and study design. Methodological quality assessments were conducted by two reviewers (EKD, BR, and/or CAM), working independently. In the case of discrepancy, all reviewers worked to come to consensus. All studies were considered moderate to strong quality, as shown in Supplementary Table 2.

Following assessment of methodological quality, study information was collected using a double-coded, standardized data collection form including: author names, article title, journal, year of publication, study design, dataset/sample population and years data was collected, statistical methodological approach, sample size, age range and mean of sample, sex(es) of sample, measure of area-level variation, vaccination measure, prevalence of HPV vaccination, reported effect size, and potential confounders included in statistical analyses, as seen in Supplementary Table 3.

RESULTS

Study Characteristics

Study Design.

All studies that met inclusion criteria (N=25) utilized a secondary data analysis approach. Studies were conducted on data obtained between 2008 and 2017. A majority of studies obtained data from self-reported surveys [n=14; from the National Immunization Survey (31–44), the National Health Interview Survey (9), Behavioral Risk Factor Surveillance System (17,45–47), smaller observational studies conducted in Ohio (48), Texas (49), and Minnesota (50), and immunization registries [n=6; from immunization information systems in Utah (51) and North Carolina (52)]. Other studies obtained data from medical records (48) or insurance claims (53).

Sample Populations.

Across studies, the unit of analyses was the patient/individual. Sample sizes ranged from 277 (45) to 1,691,223 individuals (53). Of the studies, 11 included males and females (31–34,36,37,42,46,50,52,53), 10 included only females (9,17,35,38–40,45,47,49,51), and 2 included only males (41,48). The range of ages spanned from 9 years to 26 years, with most studies (e.g., n=18; 72.0 %) focusing on children under the age of 18 (17,31–42,47–50,52). Proportions of race/ethnicity groups varied widely across studies (see Supplementary Table 4).

Geographic scale of analysis.

Across studies, there was variation in the geographic scale of analysis for variables explaining vaccination coverage. Most studies focused on US geographic region (9,17,31,34,35,38,39,46,53). Across national studies (9,17,31–37,39–41,46,47), US geographic region was defined, at minimum as: living in the Northeast, West, or South of the contiguous US. One study combined North Central and Midwest regions (9), while other studies included Midwest (9,17,39,46), North Central (53), and Southwest (17) regions. One study investigated Appalachian regions extending from New York to Mississippi (e.g., Northern, North Central, Central, South Central, and South) (38), while another investigated the regions of the Intermountain West, which is comprised of Arizona, Colorado, Idaho, Montana, Nevada, New Mexico, Utah, and Wyoming (e.g., East, Central, and West) (35). A few studies focused on HPV vaccination coverage across states (37,42,43), while others used data that was specific to the following states: Minnesota (50), Utah (51), Texas (49), Ohio (48), and North Carolina (52). The remaining studies focused on: ZIP Code or ZIP Code tabulation area (ZCTA) (33,40,41,48,51,52), metropolitan statistical areas (44,48), or independent school zones (45).

Measures

HPV Vaccination Initiation and Completion.

Most studies reported measures of HPV vaccine initiation (n=20), which was defined as receiving 1 dose (17,31,33–48,50,53). Eleven studies reported HPV vaccine series completion, or receiving 3 doses within a year (17,33,35,38,39,41–43,46,48,50). Other studies reported: cumulative number of doses administered (52), receiving ≥2 doses (49,50), or “missed opportunities” (i.e., a clinical encounter when at least one adolescent vaccination was received, but not the HPV vaccine) (31,51).

As shown in Figure 2, HPV vaccination coverage varied across studies. Average percent of initiation across all studies was 40.5% (range: 6.3% to 78.0%). Average percent of completion was 23.4% (range: 1.7% to 55.2%). Generally, lower HPV vaccination coverage was found among studies conducted earlier in time, while more recent studies demonstrated higher coverage of HPV vaccination initiation and completion – suggesting a cohort effect. By sex, the average percent of initiation and completion was 43.7% and 30.8% among females versus 37.3% and 12.6% among males. The highest percent reported was found for a prospective medical chart review of male participants enrolled in a cohort study (48).

Figure 2.

Figure 2.

Rates of HPV Vaccination by Study. Note. The studies by Kepka et al. (2016) and Williams et al. (2020) not shown as their outcome variable is different than rates of HPV vaccination (missed opportunity).

Potential Covariates

Across these studies, covariates were divided into individual-level (n=24) (9,17,31–51,53) and area-level covariates (n=8) (36,40,43,45,47,50,52,53), as shown on Supplementary Table 3. A summary of these domains (sociodemographic characteristics, rurality/urbanicity, family characteristics, healthcare access, health history, substance use, HPV knowledge, and other variables) are provided on Supplementary Table 5. Sociodemographic characteristics were included in studies as either individual-level variables, area-level variables, or a combination of the two, as described below.

Individual-level variables.

The most common individual-level covariates included in studies were race/ethnicity (n=24) (9,17,31–52), age (n=21) (9,17,31–33,35,36,38–51), health insurance coverage and type (n=18) (17,31,33–36,38–41,44–50,53), and parent educational status (n=16) (17,31–33,35,36,38,40,41,43–48,50). At the individual-level, race/ethnicity was defined by self-report of race/ethnicity (Non-Hispanic White, Non-Hispanic Black, Hispanic, Asian, and/or Other race/ethnicity). Age was calculated from subtracting the year of birth from the date of HPV vaccination receipt. Health insurance was derived from electronic medical records (EMR) data (Employer or Union, Medicaid or State Children’s’ Health Insurance Program, military or Indian Health Service, or no insurance). Educational status was often derived from self-report (less than high school, some college or associate’s degree, bachelors’ degree or higher). Other individual-level covariates included: receipt of other vaccinations (such as Tdap, MCV) (9,17,36,39,46,48,49), information on provider/facility type administering vaccination (32,33,35,36,40–42,44), marital status (married/partnered, single-never married, or separated/divorced/widowed) (9,17,32,35,38,40,41,44,46,47), rurality or urbanicity based on home residence (e.g., urban, suburban, rural), poverty status based on self-reported annual household income (below federal poverty line, moderate income or above federal poverty level and earning less than $75,000, high income or above federal poverty level and earning $75,000 or greater) (33,35,37,40–43) or income-poverty ratio (31,32), and other health behaviors, history, and comorbidities (see Supplementary Table 3).

Area-level variables.

Studies used area-level sociodemographic variables such as: urbanicity/rurality (31–33,38,40,41,48,50,51,53), poverty level (33,40,41,47,50,52), racial/ethnic composition (40,41,50,52), and health service region characteristics (45,52) to explain variation in HPV vaccination coverage. Urban/rurality was measured using census block-area level estimates for population density (50), or Rural-Urban Commuting Area (RUCA) codes, which classifies US census tracts using measures of population density, urbanization, and daily commuting (33,51). Studies included ZIP Code level rurality of residence, as classified as urban, large rural, small rural, and isolated rural (31–33,41,45,51), or a combination of these classifications (e.g., urban, suburban, rural) (48). Measures of area-level poverty included the following: USDA-defined persistent poverty, having 20% or more of residents living below poverty in the last four censuses (52); ≥20% of residents living below poverty (40,41); or percent (33,47) or quartile living in poverty (47); or, a composite factor measuring low socioeconomic status, including measures of low median income, high percent unemployment, high percentage non-college education, high Medicaid insurance, and high poverty (50). Racial/ethnic composition at the area-level was defined as the proportion of non-White populations (e.g., Hispanic, Asian/Pacific Islander, Black, or Other, including American Indian/Native Alaskan) (40,41,50,52). Measures of health service region characteristics included the percentage of uninsured at the county and public health region level (45) and health professional shortage areas (HPSAs). HPSAs were defined as 1) the rational area for the delivery of primary medical services, where 2) there is the ratio of population to full-time-equivalent primary care physicians is 3,500:1 or a ratio less than 3,500:1 but greater than 3,000:1 and has a unusually high need for primary care services or insufficient capacity of existing primary care providers, and 3) primary medical care professionals in contiguous areas are over utilized, excessively distant, or inaccessible to the population of the area under consideration, according to the Health Resources and Services Administration (52). One study included state-level variables, such as: public health department type (decentral, central, mixed, or shared), CDC funding per capita, HPV vaccination mandates, sex education policy, political ideology, and religiosity (43).

Statistical Approaches

Assessing geographic differences in HPV vaccination.

Studies used a range of statistical methodological approaches to assess geographic differences in HPV vaccination. The most common approaches were regression-based modeling techniques, such as generalized linear mixed effects modeling (51), Poisson regression (35,53), linear regression (31), logistic regression, hierarchical linear modeling (39,42), or Bayesian hierarchical regression (48,52). Most often, such analyses employ a binary dichotomous outcome (initiated or completed, coded as yes/no) in a logistic model. Then, different individual- or higher-level (county, state) covariates are used as predictors of the binary outcome. The outcome can also be modeled as continuous, as when vaccination rate per geographic unit is analyzed, and employ linear regression, or as count data, which is then analyzed with Poisson regression modeling. Since many of the studies used large public datasets, they typically adjusted for complex sample design (clustering and stratification) and oftentimes used sample weights to make the results representative of the studied population. Several studies used a multilevel model accounting for the nesting of individuals in geographic units (e.g., individuals in counties and higher levels). Such model can then include covariates estimated at different levels of the model, as well as the interactions across levels. Some studies geocoded individual patient data and spatially linked it to American Community survey data at the census block group-level (48,50) or ZCTA-level (41,52).

Testing for Spatial Heterogeneity in Area-Level Effects on HPV Vaccination.

Three studies tested for spatial heterogeneity to determine if area-level effects on individual-level HPV vaccination varied by space (17,39,53). These studies utilized a common approach, which involved fitting models with main effects for region and area-level measures (e.g., ZCTA-level race/ethnicity, income (39), urban/rural (53), provider characteristics (17)) and interaction terms. Where significant interactions were found, models were stratified and reported by region.

Geospatial modeling of HPV vaccination coverage.

Only three studies utilized geospatial approaches that account for spatial correlation when modeling HPV vaccination coverage (49,50,52). Finney Rutten et al. (2017) assessed spatial variation using a multilevel spatial logistic regression model consisting of random effects with Bayesian inference using Integrated Nested Laplace Approximation and modeled the outcome as a binomial response (50). The other two studies tested for the presence of spatial autocorrelation in HPV vaccination for outcome measures using Moran’s I (49,52). While McKillop et al. (2019) utilized a spatial autoregressive probit model to assess the relationship between neighborhood vaccination coverage within a 0.5 mile of the individual and individual vaccination decisions among a sample of low-income adolescent females residing in Dallas, Texas from 2011–2012 (49), Trogdon and Ahn (2015) estimated negative binomial models with spatially correlated random effects (referred to as “conditional autoregressive models”), adjusted for demographic, economic, and healthcare variables using data from the North Carolina Immunization Registry (2014), US Census Bureau (2010), American Community Survey (2008–2012), and Zip Business Patterns (2010) (52).

Study Results

Geospatial Clustering of HPV Vaccination.

Significant geospatial clustering was identified in two studies (49,52). McKillop et al. (2019) found positive spatial autocorrelation for completing ≥2 HPV vaccination doses among females in Texas, suggesting that individuals were more likely to become vaccinated when others living within 0.5 miles were also vaccinated (49). Meanwhile, Trogdon et al. (2015) found significant geospatial clustering of HPV vaccination initiation and completion for males, but not for females in North Carolina.

Variation in HPV Vaccination by US Geographic Region.

Variation in HPV vaccination coverage was identified across the US geographic region (i.e., South, West, etc.) (9,17,39,46) and between geographic sub-regions (36,38). Lower HPV vaccination coverage was found in Southern regions (17,39,46). However, other generalizations about HPV vaccination based on US geographic region are complicated by inconsistent region definitions and results. For example, one study found that girls living in the Western region were less likely to initiate HPV vaccination compared to girls living in the Northeast (46), while another found those living in the West were more likely to initiate compared to girls living in the Northeast (39). A study comparing the Appalachia and non-Appalachian sub-regions of 13 states revealed higher but not statistically significant vaccination completion among initiated girls living in Appalachia (compared to non-Appalachian regions) (38).

State-Level Political Affiliation, Religiosity, and Vaccination Mandates and HPV Vaccination.

Differences in coverage among boys and girls based on the presidential election results of states were identified, with higher initiation among girls and boys in “blue” (Democratic) states relative to “red” (Republican) states (36). States with mandates requiring sex education and vaccination had higher completion rates, while states with a larger percentage of highly religious adults had significantly lower completion rates (43). Variables that were associated with higher levels of cumulative HPV vaccination among girls and boys included the share of the population that was Hispanic and Non-Hispanic Black relative to Non-Hispanic White, outpatient visits per capita, religious organizations per 1,000 population, and the number of uninsured and publicly insured children aged 9 to 14 years (52).

Urbanicity/Rurality and HPV Vaccination.

The overall effects of urbanicity and rurality were mixed. One study using ZCTA-level urban/rurality based on rural-urban commuting area codes (RUCAs) found that females living in a rural area had higher odds of HPV initiation (40), while another using ZIP Code-level RUCA codes found that females living in rural areas were more likely to have a missed opportunity to receive the HPV vaccine (51). A more consistent trend was observed among males. Males living in urban, higher population density communities had higher initiation (41,44,48) and completion (41), when compared to non-urban, less densely populated areas (at the ZCTA-level (41), or metropolitan statistical area or MSA-level (44,48)). Among both male and females, one study found rural adolescents at the MSA-level were less likely to vaccinate, when compared to urban adolescents, with the exception of those living in the Northeast region who were more likely to vaccinate (53). Another study of southern Minnesota found census-block rural residency was associated with increased odds of initiation (50).

Poverty and HPV Vaccination.

Across studies, poverty was measured at the household-level (31,35,37,38,40,43,47), ZCTA-level (40,41,52), census-block level (50), county-level (47), and state-level (36). ZCTA-level poverty was associated with greater odds of HPV vaccine series completion in males (OR = 1.22, 95% CI: 1.01, 1,48) (41) and initiation in females (OR = 1.18, 95% CI: 1.04, 1.33) (40). When including both county-level and state-level poverty in models for HPV vaccination coverage, higher county-level poverty was associated with greater odds of vaccination (OR = 1.64, 95% CI: 1.13, 2.37). However, increasing state-level poverty associated with lower odds of vaccination (OR = 0.91, 95% CI: 0.84, 0.98) (47). In contrast, lower census block group-level SES scores were associated with decreased odds of initiation and subsequent doses among males and females in southern Minnesota (OR = 0.96, 95% CI: 0.92, 0.99) (50).

Racial and Ethnic Composition and HPV Vaccination.

Higher HPV vaccination coverage was found among communities with a greater proportion of non-white individuals at the census block group-level (50) and among adolescents living in mostly Hispanic communities at the ZCTA-level (40,41,52). However, mixed associations were found for girls living in mostly Non-Hispanic Black communities at the ZCTA-level, as shown on Supplementary Table 4. One study showed an increased likelihood of HPV vaccination rate (40), while others showed either a decrease in likelihood (52) or no statistically significant difference (41). This study also found that African American adolescent females were less likely to complete the series when compared to Hispanics and older girls were less likely to complete compared to the youngest age group (49).

Health Insurance and Provider Shortages and HPV Vaccination.

Results suggest associations between HPV vaccination and area-level health insurance and provider shortages. Higher percentages of uninsured at county and health services region-levels were associated with lower odds of initiation among Texan females (45). HPV vaccination coverage was lower in areas of North Carolina with ZCTA-level provider shortages, even among those qualifying for publicly funded vaccination (52).

Spatial Heterogeneity in Area-Level Effects on HPV Vaccination.

Three studies tested for spatial heterogeneity of area-level effects on individual-level HPV vaccination (17,39,53). Hirth et al. (2014) reported that not having a primary care doctor was associated with lower odds of initiation within the Northeast/Midwest/Western region (OR = 0.53, 95% CI: 0.32, 0.87) and Hispanic girls were more likely to have initiated vaccination in the South/Southwest (OR = 1.57, 95% CI: 1.13, 2.18) (17). Rahman et al. (2014) tested for statistical interactions between region and area-level variables for race/ethnicity, and income, but none significantly influenced individual-level HPV vaccination intake (39). Meanwhile, Vielot et al (2017) found that rural adolescents had higher incidence ratios of HPV vaccination compared to urban adolescents in the Northeast, suggesting that region size and barriers to vaccination might be influencing associations between geographical area and vaccination rate (53).

Individual-Level and Area-Level Variable Interactions and HPV Vaccination.

Among identified studies, only one reported statistical interactions between individual-level characteristics and area-level variables (41). Henry et al. (2016) tested for interactions between individual-level race/ethnicity and ZIP Code-level poverty and individual-level race/ethnicity and ZIP Code-level racial-ethnic composition. The authors noted that both interactions were statistically significant, such that Hispanics living in high poverty ZIP codes had higher odds of HPV vaccination initiation, compared with Hispanics living in lower poverty ZIP codes. Similar associations were found for other/multiple races living in high poverty versus low poverty ZIP codes (41).

DISCUSSION

To our knowledge, this is the first systematic review of area-level variation in HPV vaccination among US adolescents and young adults. Generally, those residing in Southern regions were less likely to initiate or complete HPV vaccination, relative to the North or Northeastern regions. Included studies also demonstrate that HPV vaccination varies by ZCTA-level urbanicity/rurality, poverty, racial/ethnic composition, and health services. It seems to be the case that area-level attributes are more important for explaining variation in HPV vaccination coverage than random area-level effects. However, the strength of these associations is difficult to quantify from existing studies. Generally, higher area-level poverty (e.g., at the ZCTA-level, county-level) was associated with higher coverage of initiation. HPV vaccination initiation decreased with higher uninsured and lower provider shortages at the county-level. Communities where at least 50% of the population was Hispanic generally had higher coverage of HPV vaccination, relative to communities where at least 50% of the population was Non-Hispanic White. Mixed associations were found when comparing majority Non-Hispanic Black communities with majority Non-Hispanic White communities. Effects of urbanicity/rurality were mixed, potentially due to differing definitions of urbanicity and rurality across studies. Few studies investigated interactions between individual-level factors and area-level factors.

Current Gaps and Challenges

With the exception of two studies examining “missed opportunities” (31,51), all studies examined initiation and/or completion, using similar definitions (e.g., receiving 1 and 3 doses of the vaccine within a year, respectively). This suggests that the operational definition used for the outcome of interest (HPV vaccination) is consistent across studies. A majority of studies utilized a multilevel approach that ignores potential between-area correlations, which potentially violates the independent errors model assumption. If errors are not independent, due to spatial correlation, then spatially correlated random effects can be used to overcome the violation. This is standard practice with Bayesian hierarchal modeling, an approach used by three studies that also modeled spatial correlations in vaccination coverage (49,50,52). No studies incorporated geospatial-temporal effects into their statistical models.

Furthermore, there were inconsistencies in the operational definitions of variables included in analyses across studies. Definitions for area-level variables varied greatly by study (e.g., different combinations of US regions such as Northern, Southern, Eastern, Central, West, Midwest, Southwest, etc. were used across studies to define geographic region). Similar issues arose for variables measuring urbanicity/rurality at different geographical units. Definitions included US Census Bureau definitions of urban (based on population density and ZIP Code; e.g., urban, suburban, and rural; small rural town, large rural town, and urban focused), qualitative descriptors of residence based on ZIP Code (e.g., urban, suburban, and rural), and/or ZCTA-population density by quartile (e.g., based on population by square mile). More consistency in definition was found for variables measuring racial/ethnic composition (based upon ZCTA-level percentage of population of Hispanic, Non-Hispanic Black, Non-Hispanic White, or mixed/other race/ethnicity) and poverty (based upon percentage of the population below poverty at ZCTA, county, or state level). A couple of studies investigated health service variables, but measures were inconsistent (ZCTA-level health professional shortage areas vs. percent uninsured adults at the county and health service region level). Inconsistencies in operational definitions and geographic unit of measurements hinder the ability to make study comparisons. Additionally, it seems to be the case that studies examining geopolitical variation in HPV vaccination coverage are not reporting findings across states prior to aggregating these states into regions, which may influence the associations that are found – especially if certain states are receiving more resources relative to others within the same geographic region.

Another issue for consideration is that a majority of the studies focused on examining individual-level factors by location, neglecting to take into consideration potential statistical interactions between variables across space and/or time. Few studies accounted for any type of statistical interaction between area-level and individual-level variables. Even fewer reported on statistically significant interactions showing variation between area-level variables such as: ZCTA-level urbanicity/rurality and poverty. Cross-level interactions are important for assessing potential ecological fallacies, or false inferences of the association of individual-level variables on the basis of the observed association of parallel ecological variables (54).

For example, the association between higher ZCTA-level poverty and higher HPV vaccination coverage may signal the success of publicly-funded vaccination efforts targeting underserved areas, as eligibility is often based on income (47). However, the relationship between poverty and HPV vaccination coverage may be more complicated and potentially influenced by individual-level indicators of socioeconomic status, including race/ethnicity, education, and household income. The addition of cross-level interactions allows for the opportunity to explore whether area-level effects are different across individual-level socioeconomic status. For example, children from families with lower household incomes living in high socioeconomic neighborhoods may benefit from the collective resources in their neighborhoods (55–57). This information can then be used to inform programmatic efforts to address potential disparities related to HPV vaccination coverage through the quantitative and qualitative evaluation of targeted messaging and campaigns aimed at increasing HPV vaccination among specific populations across different geographic regions.

Limitations and Strengths

Our results should be considered within the context of study limitations. Heterogeneity in sample populations and geographic locations across studies made it difficult to compare results. Although most of the studies included information from surveys, the same constructs were typically coded or assessed differently. Further, the majority of studies focused on females, which further limits our ability to characterize HPV vaccination in US adolescents and young adults. Across studies, consideration of state mandates (36,43), school entry requirements (58,59), and provider-level factors (31,33–36,38,41,43,44,60) is limited and requires additional investigation. Further, current studies did not account for potential correlation between variables, occurring within the same geographical boundaries, with one exception (52). To balance these weaknesses, future research should report both descriptive and multivariate findings.

Despite these limitations, this study is the first, to our knowledge, to summarize how area-level factors influence HPV vaccination. Studies included in this systematic review focus predominantly on associations between specific area-level factors and HPV vaccination. Additionally, this study describes how area-level factors interact with individual-level factors to influence the initiation and completion of HPV vaccination. Results emphasize the importance of considering individual-level and area-level factors in analyses examining HPV vaccination. Results also suggest that multidisciplinary teams with a variety of expertise are needed to incorporate existing geospatial methods that account for significant interaction that variables have within a geographical space in shaping HPV vaccination.

Recommendations and Future Considerations

Although existing literature incorporates variables measuring area-level characteristics into research on HPV vaccination, there is a paucity of spatial regression modeling approaches in this research. Only three studies incorporated spatial autocorrelation in statistical models (49,50,52), and neither of the studies incorporated a geospatial-temporal approach. This reduces the ability of the field to identify geographic areas of need, regarding prevention and control of HPV-related incidence and morbidity. To overcome this challenge, we propose the following five recommendations and future considerations:

  1. Foster interdisciplinary collaborations and research. Interdisciplinary collaboration, such as that demonstrated by the field of spatial epidemiology is needed to answer multi-faceted problems (61), such as explaining the patterns and variation in HPV vaccination coverage using individual and area-level variables. Spatial epidemiology represents an intersection of statistics, biostatistics, epidemiology, geography, and geospatial information science. Methods and investigators from spatial econometrics and regional science may also be helpful for this problem. Fostering interdisciplinary collaborations encourages researchers to develop and link new data sets assembled from administrative claims, immunization information systems, and other existing sources to support more detailed analyses of geographic disparities in HPV vaccination coverage (62).

  2. Standardize procedures for immunization reporting systems. As reported elsewhere, technologies for data cataloguing and transfer of Immunization Information Systems (IIS) information is not standard across states, which makes it difficult to link IIS data to other data resources (63), such as area-level variables (e.g., racial/ethnic composition, poverty level available from the Census and the American Community Survey, and health professionals shortage areas from the Health Resources and Services Administration).

  3. Standardize variable definitions in research on HPV vaccination coverage. Although a majority of the studies utilized state-level surveys of immunization (e.g., BRFSS or NIS-Teen) and area-level variables obtained from the Census and the American Community Survey, definitions differed by study.

  4. Incorporate spatial regression modeling approaches. To date, the use of spatial regression methods to studies of HPV vaccination is limited to three studies (49,50,52). Geographic information systems (GIS) and spatial analytic approaches can help to identify where HPV-related burdens are elevated and prevention and intervention efforts are needed (64). These methods can be used to account for spatial correlation in HPV vaccination coverage, not explained by individual-level and area-level covariates. Other methods such as spatial lag models and spatial error models could also be applied to HPV vaccination registry data to further characterize spatial patterns in coverage. Bayesian regression models could also be used to model vaccination coverage over space and time (i.e., spatiotemporally), which was not explored in the current literature.

  5. Obtain data on HPV prevalence in smaller geographic areas. Although the National Immunization Survey (NIS) is the gold standard for establishing national vaccination coverage estimates, it offers limited power to characterize vaccination at geographic levels smaller than US region (e.g., state, county, ZIP Code/ZCTA) (62). In order to improve spatial modeling strategies, the use of smaller geographic units may allow for a more detailed description (65) of HPV vaccination coverage and may reveal hidden disparities, especially in areas where population density is smaller.

CONCLUSIONS

Given the effect that HPV vaccination has had on cancer prevention, it is important to identify factors influencing HPV vaccination coverage. Results demonstrate that area-level factors and their interactions with individual-level and community-level variables are important for characterizing HPV vaccination coverage. Further research is needed to examine how variation in area-level variables influence HPV vaccination, by either incorporating area-level effects in statistical models or utilizing geospatial approaches that account for spatial correlation.

Supplementary Material

1
2
3
4
5

ACKNOWLEDGEMENTS

The authors would like to acknowledge all the study participants of the included studies within this systematic review.

Financial support.

National Cancer Institute (2T32CA093423) provided to CAM.

Footnotes

Conflict of interest disclosure statement. The authors report no conflicts of interest.

REFERENCES

  • 1.Loke AY, Kwan ML, Wong Y-T, Wong AKY. The Uptake of Human Papillomavirus Vaccination and Its Associated Factors Among Adolescents: A Systematic Review. J Prim Care Community Health [Internet]. 2017. [cited 2019 Sep 4];8:349–62. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5932744/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Holman DM, Benard V, Roland KB, Watson M, Liddon N, Stokley S. Barriers to Human Papillomavirus Vaccination Among US Adolescents: A Systematic Review of the Literature. JAMA Pediatr [Internet]. 2014. [cited 2019 Sep 4];168:76–82. Available from: https://jamanetwork.com/journals/jamapediatrics/fullarticle/1779687 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Baseman JG, Koutsky LA. The epidemiology of human papillomavirus infections. J Clin Virol [Internet]. 2005. [cited 2019 Sep 4];32:16–24. Available from: http://www.sciencedirect.com/science/article/pii/S1386653204003725 [DOI] [PubMed] [Google Scholar]
  • 4.Centers for Disease Control and Prevention. How Many Cancers Are Linked with HPV Each Year? [Internet]. 2019. [cited 2019 Aug 26]. Available from: https://www.cdc.gov/cancer/hpv/statistics/cases.htm
  • 5.Saraiya M, Unger ER, Thompson TD, Lynch CF, Hernandez BY, Lyu CW, et al. US assessment of HPV types in cancers: implications for current and 9-valent HPV vaccines. J Natl Cancer Inst 2015;107:djv086. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Elam-Evans LD. National, Regional, State, and Selected Local Area Vaccination Coverage Among Adolescents Aged 13–17 Years — United States, 2019. MMWR Morb Mortal Wkly Rep [Internet]. 2020. [cited 2020 Aug 26];69. Available from: https://www.cdc.gov/mmwr/volumes/69/wr/mm6933a1.htm [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Kessels SJM, Marshall HS, Watson M, Braunack-Mayer AJ, Reuzel R, Tooher RL. Factors associated with HPV vaccine uptake in teenage girls: a systematic review. Vaccine. 2012;30:3546–56. [DOI] [PubMed] [Google Scholar]
  • 8.Kester LM, Zimet GD, Fortenberry JD, Kahn JA, Shew ML. A national study of HPV vaccination of adolescent girls: rates, predictors, and reasons for non-vaccination. Matern Child Health J. 2013;17:879–85. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Wei F, Moore PC, Green AL. Geographic variability in human papillomavirus vaccination among U.S. young women. Am J Prev Med 2013;44:154–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Brewer NT, Fazekas KI. Predictors of HPV vaccine acceptability: a theory-informed, systematic review. Prev Med 2007;45:107–14. [DOI] [PubMed] [Google Scholar]
  • 11.Dorell CG, Yankey D, Santibanez TA, Markowitz LE. Human Papillomavirus Vaccination Series Initiation and Completion, 2008–2009. Pediatrics [Internet]. 2011. [cited 2020 Apr 3];128:830–9. Available from: https://pediatrics.aappublications.org/content/128/5/830 [DOI] [PubMed] [Google Scholar]
  • 12.Guerry SL, De Rosa CJ, Markowitz LE, Walker S, Liddon N, Kerndt PR, et al. Human papillomavirus vaccine initiation among adolescent girls in high-risk communities. Vaccine. 2011;29:2235–41. [DOI] [PubMed] [Google Scholar]
  • 13.Smith LM, Brassard P, Kwong JC, Deeks SL, Ellis AK, Lévesque LE. Factors associated with initiation and completion of the quadrivalent human papillomavirus vaccine series in an ontario cohort of grade 8 girls. BMC Public Health [Internet]. 2011. [cited 2020 Apr 3];11:645. Available from: http://bmcpublichealth.biomedcentral.com/articles/10.1186/1471-2458-11-645 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Newman PA, Logie CH, Lacombe-Duncan A, Baiden P, Tepjan S, Rubincam C, et al. Parents’ uptake of human papillomavirus vaccines for their children: a systematic review and meta-analysis of observational studies. BMJ Open [Internet]. 2018. [cited 2020 Apr 3];8:e019206. Available from: https://bmjopen.bmj.com/content/8/4/e019206 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Frew PM, Lutz CS. Interventions to increase pediatric vaccine uptake: An overview of recent findings. Hum Vaccines Immunother 2017;13:2503–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Walker TY. National, Regional, State, and Selected Local Area Vaccination Coverage Among Adolescents Aged 13–17 Years — United States, 2018. MMWR Morb Mortal Wkly Rep [Internet]. 2019. [cited 2020 Jun 15];68. Available from: https://www.cdc.gov/mmwr/volumes/68/wr/mm6833a2.htm [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Hirth J. Disparities in HPV vaccination rates and HPV prevalence in the United States: a review of the literature. Hum Vaccines Immunother [Internet]. 2019. [cited 2020 Feb 18];15:146–55. Available from: 10.1080/21645515.2018.1512453 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Diggle PJ, Jr PJR. Bayesian Inference in Gaussian Model-based Geostatistics. Geogr Environ Model [Internet]. 2002. [cited 2020 Jun 25];6:129–46. Available from: 10.1080/1361593022000029467 [DOI] [Google Scholar]
  • 19.Dietz RD. The estimation of neighborhood effects in the social sciences: An interdisciplinary approach. Soc Sci Res [Internet]. 2002. [cited 2020 Jun 25];31:539–75. Available from: http://www.sciencedirect.com/science/article/pii/S0049089X02000054 [Google Scholar]
  • 20.Chaix B, Merlo J, Chauvin P. Comparison of a spatial approach with the multilevel approach for investigating place effects on health: the example of healthcare utilisation in France. J Epidemiol Community Health. 2005;59:517–26. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Lyles CR, Lunn MR, Obedin-Maliver J, Bibbins-Domingo K. The new era of precision population health: insights for the All of Us Research Program and beyond. J Transl Med [Internet]. 2018. [cited 2020 Apr 2];16:211. Available from: 10.1186/s12967-018-1585-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Lawson A. Bayesian Disease Mapping: Herarchial Modeling in Spatial Epidemiology. 3rd Edition. New York: Chapman & Hall/CRC Interdisciplinary Statistics; 2018. [Google Scholar]
  • 23.Waller LA, Gotway CA. Applied Spatial Statistics for Public Health Data. 1 edition. Hoboken, N.J: Wiley-Interscience; 2004. [Google Scholar]
  • 24.Schootman M, Gomez SL, Henry K, Paskett E, Ellison GL, Oh A, et al. Geospatial Approaches to Cancer Control and Population Sciences. Cancer Epidemiol Biomark Prev Publ Am Assoc Cancer Res Cosponsored Am Soc Prev Oncol [Internet]. 2017. [cited 2020 Jun 15];26:472–5. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5380532/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Baker TR, Battersby S, Bednarz SW, Bodzin AM, Kolvoord B, Moore S, et al. A Research Agenda for Geospatial Technologies and Learning. J Geogr 2015;114:118–30. [Google Scholar]
  • 26.Ostfeld RS, Glass GE, Keesing F. Spatial epidemiology: an emerging (or re-emerging) discipline. Trends Ecol Evol 2005;20:328–36. [DOI] [PubMed] [Google Scholar]
  • 27.Cromley EK, McLafferty SL. GIS and Public Health, Second Edition. Guilford Press; 2011. [Google Scholar]
  • 28.Singh H, Fortington LV, Thompson H, Finch CF. An overview of geospatial methods used in unintentional injury epidemiology. Inj Epidemiol [Internet]. 2016. [cited 2020 Jun 15];3. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5183571/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Evans N. Appendix A: Effective Public Health Practice Project (EPHPP) Quality Assessment Tool. Syst Rev Rural Dev Res [Internet]. Springer Briefs in Public Health; 2015. Available from: https://link.springer.com/content/pdf/bbm%3A978-3-319-17284-2/1.pdf [Google Scholar]
  • 30.Armijo-Olivo S, Stiles CR, Hagen NA, Biondo PD, Cummings GG. Assessment of study quality for systematic reviews: a comparison of the Cochrane Collaboration Risk of Bias Tool and the Effective Public Health Practice Project Quality Assessment Tool: methodological research. J Eval Clin Pract 2012;18:12–8. [DOI] [PubMed] [Google Scholar]
  • 31.Williams CL, Walker TY, Elam-Evans LD, Yankey D, Fredua B, Saraiya M, et al. Factors associated with not receiving HPV vaccine among adolescents by metropolitan statistical area status, United States, National Immunization Survey-Teen, 2016–2017. Hum Vaccines Immunother 2020;16:562–72. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Walker TY, Elam-Evans LD, Williams CL, Fredua B, Yankey D, Markowitz LE, et al. Trends in human papillomavirus (HPV) vaccination initiation among adolescents aged 13–17 by metropolitan statistical area (MSA) status, National Immunization Survey – Teen, 2013 – 2017. Hum Vaccines Immunother [Internet]. 2020. [cited 2020 Apr 2];16:554–61. Available from: 10.1080/21645515.2019.1671765 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Swiecki-Sikora AL, Henry KA, Kepka D. HPV Vaccination Coverage Among US Teens Across the Rural-Urban Continuum. J Rural Health Off J Am Rural Health Assoc Natl Rural Health Care Assoc 2019;35:506–17. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Sriram S, Ranganathan R. Why human papilloma virus vaccination coverage is low among adolescents in the US? A study of barriers for vaccination uptake. J Fam Med Prim Care [Internet]. 2019. [cited 2020 Feb 18];8:866–70. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6482788/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Bodson J, Ding Q, Warner EL, Hawkins AJ, Henry KA, Kepka D. Sub-Regional Assessment of HPV Vaccination Among Female Adolescents in the Intermountain West and Implications for Intervention Opportunities. Matern Child Health J 2017;21:1500–11. [DOI] [PubMed] [Google Scholar]
  • 36.Bernstein S, North A, Schwartz J, Niccolai LM. State-Level Voting Patterns and Adolescent Vaccination Coverage in the United States, 2014. Am J Public Health. 2016;106:1879–81. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Waldrop AR, Moss JL, Liu B, Zhu L. Ranking States on Coverage of Cancer-Preventing Vaccines Among Adolescents: The Influence of Imprecision. Public Health Rep Wash DC 1974. 2017;132:627–36. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Reiter PL, Katz ML, Paskett ED. HPV vaccination among adolescent females from Appalachia: implications for cervical cancer disparities. Cancer Epidemiol Biomark Prev Publ Am Assoc Cancer Res Cosponsored Am Soc Prev Oncol 2012;21:2220–30. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Rahman M, McGrath CJ, Berenson AB. Geographic variation in human papillomavirus vaccination uptake among 13–17 year old adolescent girls in the United States. Vaccine. 2014;32:2394–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Henry KA, Stroup AM, Warner EL, Kepka D. Geographic Factors and Human Papillomavirus (HPV) Vaccination Initiation among Adolescent Girls in the United States. Cancer Epidemiol Biomark Prev Publ Am Assoc Cancer Res Cosponsored Am Soc Prev Oncol 2016;25:309–17. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Henry KA, Swiecki-Sikora AL, Stroup AM, Warner EL, Kepka D. Area-based socioeconomic factors and Human Papillomavirus (HPV) vaccination among teen boys in the United States. BMC Public Health. 2017;18:19. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Bednarczyk RA, Ellingson MK, Omer SB. Human Papillomavirus Vaccination Before 13 and 15 Years of Age: Analysis of National Immunization Survey Teen Data. J Infect Dis 2019;220:730–4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Franco M, Mazzucca S, Padek M, Brownson RC. Going beyond the individual: how state-level characteristics relate to HPV vaccine rates in the United States. BMC Public Health. 2019;19:246. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Lu P-J, Yankey D, Fredua B, O’Halloran AC, Williams C, Markowitz LE, et al. Association of Provider Recommendation and Human Papillomavirus Vaccination Initiation among Male Adolescents Aged 13–17 Years—United States. J Pediatr [Internet]. 2019. [cited 2020 Jul 6];206:33–41.e1. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6487492/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Eberth JM, Zhang X, Hossain M, Tiro JA, Holt JB, Vernon SW. County-level estimates of human papillomavirus vaccine coverage among young adult women in Texas, 2008. Tex Public Health J 2013;65:37–40. [PMC free article] [PubMed] [Google Scholar]
  • 46.Rahman M, Islam M, Berenson AB. Differences in HPV Immunization Levels Among Young Adults in Various Regions of the United States. J Community Health. 2015;40:404–8. [DOI] [PubMed] [Google Scholar]
  • 47.Pruitt SL, Schootman M. Geographic disparity, area poverty, and human papillomavirus vaccination. Am J Prev Med 2010;38:525–33. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Nanagas VC, Stolfi A, Nanagas MT, Eberhart GM, Alter SJ. Adolescent Male Human Papillomavirus Vaccination. Glob Pediatr Health. 2016;3:2333794X16642373. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.McKillop CN, Leonard T, Pruitt SL, Tiro JA. Do traditional economic theories of free riding behavior explain spatial clustering of HPV vaccine uptake? SSM - Popul Health [Internet]. 2019. [cited 2020 Feb 18];8:100421. Available from: http://www.sciencedirect.com/science/article/pii/S2352827319301120 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Finney Rutten LJ, Wilson PM, Jacobson DJ, Agunwamba AA, Radecki Breitkopf C, Jacobson RM, et al. A Population-Based Study of Sociodemographic and Geographic Variation in HPV Vaccination. Cancer Epidemiol Biomark Prev Publ Am Assoc Cancer Res Cosponsored Am Soc Prev Oncol 2017;26:533–40. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Kepka D, Spigarelli MG, Warner EL, Yoneoka Y, McConnell N, Balch A. Statewide analysis of missed opportunities for human papillomavirus vaccination using vaccine registry data. Papillomavirus Res Amst Neth 2016;2:128–32. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Trogdon JG, Ahn T. Geospatial patterns in human papillomavirus vaccination uptake: evidence from uninsured and publicly insured children in North Carolina. Cancer Epidemiol Biomark Prev Publ Am Assoc Cancer Res Cosponsored Am Soc Prev Oncol 2015;24:595–602. [DOI] [PubMed] [Google Scholar]
  • 53.Vielot NA, Butler AM, Brookhart MA, Becker-Dreps S, Smith JS. Patterns of Use of Human Papillomavirus and Other Adolescent Vaccines in the United States. J Adolesc Health Off Publ Soc Adolesc Med 2017;61:281–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Blakely T, Woodward A. Ecological effects in multi-level studies. J Epidemiol Community Health [Internet]. 2000. [cited 2020 Jun 25];54:367–74. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1731678/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Ludwig J, Duncan GJ, Gennetian LA, Katz LF, Kessler RC, Kling JR, et al. Neighborhood effects on the long-term well-being of low-income adults. Science. 2012;337:1505–10. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Graif C, Arcaya MC, Diez Roux AV. Moving to opportunity and mental health: Exploring the spatial context of neighborhood effects. Soc Sci Med 1982. 2016;162:50–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Firebaugh G, Schroeder MB. Does Your Neighbor’s Income Affect Your Happiness? AJS [Internet]. 2009. [cited 2020 Jun 26];115:805–31. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4041613/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Perkins RB, Lin M, Wallington SF, Hanchate AD. Impact of school-entry and education mandates by states on HPV vaccination coverage: Analysis of the 2009–2013 National Immunization Survey-Teen. Hum Vaccines Immunother 2016;12:1615–22. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Moss JL, Reiter PL, Truong YK, Rimer BK, Brewer B. School Entry Requirements and Coverage of Nontargeted Adolescent Vaccines. Pediatrics [Internet]. 2016. [cited 2020 Jul 6];138. Available from: https://europepmc.org/article/pmc/pmc5127065 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Henry KA, Stroup AM, Warner EL, Kepka D. Geographic Factors and Human Papillomavirus (HPV) Vaccination Initiation among Adolescent Girls in the United States. Cancer Epidemiol Biomark Prev Publ Am Assoc Cancer Res Cosponsored Am Soc Prev Oncol 2016;25:309–17. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Aboelela SW, Larson E, Bakken S, Carrasquillo O, Formicola A, Glied SA, et al. Defining interdisciplinary research: conclusions from a critical review of the literature. Health Serv Res 2007;42:329–46. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Gilkey MB, Margolis MA. Human Papillomavirus Vaccination Coverage Gaps in Young Adolescents. J Infect Dis [Internet]. 2019. [cited 2020 Feb 18];220:727–9. Available from: https://academic.oup.com/jid/article/220/5/727/5265336 [DOI] [PubMed] [Google Scholar]
  • 63.Fuller JE, Walter EB, Dole N, O’Hara R, Herring AH, Durkin MS, et al. State-Level Immunization Information Systems: Potential for Childhood Immunization Data Linkages. Matern Child Health J 2017;21:29–35. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Pickle LW, Szczur M, Lewis DR, Stinchcomb DG. The crossroads of GIS and health information: a workshop on developing a research agenda to improve cancer control. Int J Health Geogr [Internet]. 2006. [cited 2020 Apr 3];5:51. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1665447/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Lebel A, Kestens Y, Clary C, Bisset S, Subramanian SV. Geographic Variability in the Association between Socioeconomic Status and BMI in the USA and Canada. PLoS ONE [Internet]. 2014. [cited 2020 Feb 18];9. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4059636/ [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

1
2
3
4
5

RESOURCES