Highlights
-
•
The California Immunization Registry has low HPV vaccine series completion.
-
•
California will benefit from increased provider reporting.
-
•
HPV vaccination in California is far below the national goal of 80 % by 13 years old.
-
•
Limitations of the databases must be considered when making vaccination policy.
Keywords: HPV vaccination, Cancer prevention, Vaccinations, Adolescents
Abstract
Accurate documentation of state-level human papillomavirus (HPV) vaccination is required for public health planning and to inform corrective actions. To examine the representativeness of the California Immunization Registry, we compared the National Immunization Survey (NIS)-Teen, commercial HMOs in California, Medi-Cal, and California Immunization Registry data for HPV vaccine series completion. Our objectives were to evaluate the vaccine registries, compare and report their completeness, and make recommendations on how to improve and use these studies. Vaccination values were extrapolated for all adolescents aged 13 to 17 years from 2018 to 2019 from NIS-Teen, adolescents aged 13 years from 2018 to 2019 reported in the California Immunization Registry, and adolescents aged 13 years for 2018 for commercial HMOs and Medi-Cal. HPV series completion among 13-year-olds in 2018 for commercial HMOs was 50 %, Medi-Cal was 45 %, and the California Immunization Registry was 28 %, with NIS-Teen rates for 13 to 17-year-olds at 50 % in 2018 and 54 % in 2019. Both rural and urban geographic regions were found to have low completion rates of the HPV series, with trends ranging from 13 % to 45 %. The California Immunization Registry’s lower HPV vaccine series completion among 13-year-olds compared to the other reporting sources is most likely due differences in reporting and data collection. Importantly, this data will serve as a comparator for future, similar studies of various sources of HPV vaccination rates following the passing of Bill-1797, which will mandate immunization reporting starting in January 2023.
1. Background
Human papillomavirus (HPV) is the most commonly sexually transmitted infection in the United States. (Centers for Disease Control, 2022) Each year, persistent infection with high-risk strains of HPV causes 34,800 new cases of cervical, anal/rectal, vaginal, oropharyngeal, vulvar, and penile cancer nationally. Despite ongoing efforts to reduce the number of HPV infections, and therefore prevent HPV associated cancers with the 9-valent HPV vaccine, only 75.1 % of eligible United States adolescents aged 13 to 17 years started the HPV vaccination series in 2020, with 58.6 % up to date (Pingali et al., 2021).
The Federal Drug Administration approved the 9-valent HPV vaccine in 2014. The vaccine is routinely recommended for children aged 9 to 12, for catch-up through age 26, and for some adults aged 27 to 45. (Meites et al., 2019) The vaccine is safe and effective in preventing most HPV-related cancers and genital warts. (Johnson and Burtness, 2020, Creamer et al., 2019, Shimabukuro et al., 2019, Medeiros et al., 2020) The age of series initiation is important given that earlier vaccination is associated with both higher levels of immunogenicity and series completion. (Markowitz et al., 2014, Kavanagh et al., 2017, Beachler et al., 2016, St. Sauver et al., 2016) Therefore, the Advisory Committee on Immunization Practices (ACIP) of the United States Centers for Disease Control and Prevention (CDC) recommends vaccination for 11- to 12-year-olds, but can begin as early as 9 years. (Petrosky et al., 2015) Despite the proven effectiveness of the HPV vaccine, its uptake is consistently lower than other childhood and teenage vaccines like the Tdap and meningococcal conjugate vaccines. (Centers for Disease Control, 2022).
California has the largest population in the United States with over 39 million people located in both urban and rural regions. According to National Immunization Survey-Teen (NIS-Teen), which measures the uptake of preteen vaccines, only 52.6 % of adolescents in California aged 13 to 17 years old as of 2018 have completed the HPV vaccine series. (Centers for Disease Control, 2022, Walker et al., 2019) Studies have found that socioeconomic status, rural residence, ethnicity/race and educational policy were often strong predictors of differences in vaccine uptake, (Staples et al., 2021, Rotsides et al., 2021, Vickers et al., 2019, Perkins et al., 2016, Niccolai et al., 2011) making it essential to understand regional variation and associated correlates when assessing vaccination patterns in California.
To help understand the differences, strengths, and weaknesses of the three California vaccination surveillance sources, we compared HPV vaccination data from the CDC-sponsored NIS-Teen, quality performance metrics from public and private health plans and provider groups in California, and the statewide California Immunization Registry (CAIR). Our objectives were threefold: to evaluate the vaccine registries, to compare and report their completeness, and to make recommendations on how to improve and use these studies.
2. Methods
2.1. Data collection
2.1.1. National Immunization survey (NIS)-Teen
We used the NIS-Teen for the 2018 to 2019 survey years as a data source to assess vaccine coverage levels in California. NIS-Teen is an annual, cross-sectional survey launched in 2006 to monitor vaccination coverage among adolescents 13 to 17 years of age living in the United States. (Jain et al., 2009) The NIS-Teen provides national, state, and selected local level estimates of vaccination coverage based on provider-reported vaccination histories for vaccines recommended by ACIP. HPV vaccine was added to NIS-Teen in 2008 for females and in 2012 for males. Additional details regarding NIS-Teen methodology are discussed elsewhere. (Jain et al., 2009, Wolter et al., 2017, [8]).
2.1.2. Health plans and provider groups reported vaccination rates
Another data source used to assess vaccine coverage levels was from the National Committee for Quality Assurance, which collects data annually from health plans and other health care organizations. Reports were received from the California Department of Health Care Services and the Integrated Healthcare Association. The California Department of Health Care Services calculates vaccination coverage through a sample of administrative claims data from Medi-Cal managed care health plans for California adolescents with at least 11 months of continuous coverage before the data retrieval date (n = 216,618; 13-year-olds as of 2018). (Quality Measures & Reporting, 2022) The Integrated Healthcare Association reports on commercial HMO performance based on claims, encounters, and supplemental electronic health records. (Integrated Healthcare Association, 2021) In 2018, the dataset included 10 health plans (Appendix A) and 200 physician organizations (n = 101,988; 13-year-olds).
2.1.3. California Immunization Registry
California’s immunization information system, the California Immunization Registry (CAIR), was another source used to assess vaccine coverage levels in California. The three California registries within CAIR are CAIR2, San Diego Immunization Registry, and Healthy Futures. CAIR2 is operated by the California Department of Public Health for 49 of the 58 California counties, the San Diego Immunization Registry operates in San Diego County, and the Healthy Futures covers 8 counties located in California’s Central Valley. To submit vaccination data, health records are sent to CAIR on each clinic’s behalf, either through EHR vendors or other third-party data submitters, using Health Level 7 Vaccine Update (HL7 VXU) messages. This data are then transmitted to CAIR via Simple Object Access Protocol web services. (Enhancing and Interoperability, 2016) As of 2019, CAIR has varying provider participation among regions. Pharmacists are the only health care providers in California who are mandated by state regulation to report immunization doses to CAIR. (California State Board of Pharmacy, 2022) Although Medi-Cal managed care plans must report to the immunization information system, a third of provider offices in 49 counties did not enter immunizations into CAIR. (Centers for Disease Control and Prevention, 2022) As of today, 2,413 distinct pediatric and family medicine sites currently submit data electronically to CAIR2. (Centers for Disease Control and Prevention, 2022).
2.2. Study population
Vaccination values were extrapolated from three different study populations. First, we obtained vaccination data from NIS-Teen survey for the years 2018 to 2019 for adolescents aged 13 to 17. The survey included both state and national data. For the year 2018, NIS-Teen surveyed 18,700 adolescents nationally and 356 in California. For the year 2019, NIS-Teen surveyed 18,788 adolescents nationally and 274 in California. Second, we examined data from CAIR for adolescents aged 13 for the years 2018 to 2019 (n = 558,480). Lastly, we examined data from commercial HMOs in California for adolescents aged 13 for the year 2018 (n = 101,988) and Medi-Cal (n = 400 randomly sampled from a total eligible population of 216,683 members). Individuals were included in the CAIR denominator if they met three criteria: born January 1, 2007 through December 31, 2007 (13- year-old cohort); had at least two doses of any vaccine in immunization information system; and were California residents. The year 2018 represents the most recent data on HPV vaccination for commercial HMOs and Medi-Cal, and the year 2019 represents the most recent data on HPV vaccination for CAIR.
2.3. Statistical analysis
Descriptive analysis was done on the data sources for HPV vaccination completion and initiation in California. Additionally, the CDC’s National Center for Health Statistics (NCHS) 2013 Urban-Rural Classification Scheme for Counties was used to analyze geographic disparities for HPV vaccine initiation and completion in California.
3. Results
3.1. Comparison of California HPV immunization databases
Table 1 shows a comparison of the statewide HPV vaccination series completion among 13-year-olds in 2018 by the three different immunization record databases. Teens enrolled in commercial HMOs in California and Medi-Cal managed care health plans had similar estimations of completion rates with 50 % and 45 %, respectively. In contrast, CAIR analyses yielded a lower completion estimate in 2018 at 28 %. Similar to the NIS-Teen findings, the proportion of California adolescents recorded in CAIR who completed the vaccine series in 2018 (28 %) was lower than the proportion who initiated it (50 %). Completion and initiation patterns followed a similar pattern in 2019 with completion at 30 % while initiation was 54 %. NIS-Teen shows that nationally in 2018, HPV series completion rates were lower among 13-year-olds versus adolescents aged 13 to 17 years with completion rates of 40 % (13-year-olds) and 51.1 % (13 to 17-year-olds). 2019 NIS-Teen data showed similar trends with 45.3 % and 54.2 % completion rates, respectively. Additionally, NIS-Teen found that while 78 % of adolescents aged 13 to 17 in California started the HPV vaccine series in 2019, only 56.4 % completed their doses (Table 2). This proportion is compared to 2018 where 74 % initiated and 52.6 % completed the series.
Table 1.
Human papillomavirus vaccine series initiation and completion among 13-year-olds, California, 2018 and 2019.
| Data Source | NIS-Teen Nationala | CAIRb | California Commercial HMOsc | Medi-Cald | ||||
|---|---|---|---|---|---|---|---|---|
| HPV Vaccination | 2018 | 2019 | 2018 | 2019 | 2018 | 2019 | 2018 | 2019 |
| Initiation, % (95 % CI) |
50 | 54 | ||||||
| Completion, % (95 % CI) |
40 (37.0–42.9) |
45.3 (42.1–48.5) |
28 | 30 | 50 | 45 | ||
NIS = National Immunization Survey, CAIR = California Immunization Registry, Blanks denote data not collected.
Based on 3,927 individuals randomly sampled in the national survey who were 13 years of age at the time of the interview in 2018 and 2019.
The 558,480 patients who turned 13 years of age in 2018 with 2 or immunizations in CAIR Were used as the denominator in this CAIR calculation.
HPV immunization status was ascertained for all 101,988 commercial HMO 13-year-old enrollees whose 200 physician organizations in 10 health plans participate in IHA Align.Measure.Perform program.
Based on approximately 400 patients randomly sampled for each of 53 reporting units of Medi-Cal managed care health plans from a total eligible population of 216,686 members who turned 13 years of age in 2018.
Table 2.
Human papillomavirus vaccine series initiation and completion among 13 to 17-year-olds, NIS-Teen, 2018 and 2019.
| Data Source | NIS-Teen, Nationala | NIS-Teen, Californiab | ||
|---|---|---|---|---|
| HPV Vaccination | 2018 | 2019 | 2018 | 2019 |
| Initiation, % (95 % CI) |
68.1 (66.8–69.3) |
71.5 (70.1–72.8) |
73.5 (96.7–79.4) |
78.7 (70.6–85.1) |
| Completion, % (95 % CI) |
51.1 (49.8–52.5) |
54.2 (52.7–55.8) |
52.6 (945.4–59.8) |
56.4 (48.3–65) |
NIS = National Immunization Survey.
Based upon 18,788 individuals randomly sampled in the national survey ages 13 to 17 at the time of the interview in 2019. Based upon 18,700 adolescents surveyed nationally in 2018 and 18,788 adolescents in 2019.
Based upon 356 individuals surveyed in California in 2018 and 274 in 2019.
3.2. HPV vaccine series completion differences among adolescent females and males
The NIS-Teen survey found that completion of HPV vaccination among 13-year-olds increased from 22.1 % in 2008 to 61.5 % in 2019 for females and 11.7 % in 2012 to 51.4 % in 2019 for males. Series completion increased for females from 50.1 % in 2018 to 61.5 % in 2019 but dropped for males from 55.1 % to 51.4 % in the same time period. Maximum population vaccination completion was 61.5 % for females and 55.4 % for males. CAIR had similar patterns of HPV vaccine series completion rates among females and males for both 2018 and 2019 with 29 % and 31 % completion for females, and 27 % and 30 % completion for males, respectively (data not shown).
3.3. HPV vaccine series initiation versus completion among 13-year-olds by county
In Fig. 1A, among 13-year-olds whose vaccination status is recorded in CAIR, HPV vaccine initiation ranged from 34 to 73 % by county, while vaccine completion rates ranged from 13 to 48 %. Rural and urban geographic disparities are apparent with the initiation of the HPV vaccine series being as low as 34 % in one rural county grouping and up to 73 % in an urban county (Fig. 1B). Completion of the series had similar trends with a rate as low as 13 % in one rural county and as high as 48 % in an urban county (Fig 1C). For both series initiation and completion, lower coverage was observed in the northern and eastern parts of the state .
Fig. 1A.
Human papillomavirus initiation and completion rate by county, California, 2019, California Immunization Registry.
Fig. 1B.
Human Papillomavirus vaccine series initiation proportion by county, California, 2019, California Immunization Registry.
Fig. 1C.
Human Papillomavirus vaccine series completion proportion by county, California, 2019, California Immunization Registry.
4. Discussion
Since the study was conceived and conducted, the California State Legislature passed Assembly Bill-1797 in August 2022 that will be effective January 1, 2023. With this Bill, all providers in California will be mandated to report immunizations they administer as well as the patient’s race and ethnicity into CAIR or Healthy Futures. (Weber et al., 2022).
This study compared California HPV vaccination estimates using three sources of immunization data. For California’s 13-year-olds, we observed substantial variation in the estimates of HPV vaccination status among the different immunization reporting systems. For California’s 13-year-olds, HPV vaccination rates varied across the databases with Medi-Cal managed care at 45 % completion, commercial HMO members at 50 %, and CAIR at 28 %. While the private and commercial plan estimates are consistent with NIS-Teen’s 2018 national survey estimate for 13-year-olds (40 %; 95 % CI 37.0–42.9 %) as well as NIS-Teen’s Californian 13- to 17-year-olds (52.6 %; 95 % CI 45.4–59.8 %), CAIR’s immunization data are discordant with these other sources.
Each of these data sources is vital in helping understand HPV vaccination uptake in California. While the NIS-Teen is the most used system to monitor vaccine coverage in the United States, there are limitations at the state level including larger margins of error compared to the national reports and systematic errors of non-response bias. (Wolter et al., 2017, Centers for Disease Control and Prevention National Center for Immunization and Respiratory Diseases, 2020) CAIR differs from NIS-Teen given CAIR is a population-based registry relying on provider reporting. At the time of this study, though, CAIR was limited by lack of mandated reporting. (California State Board of Pharmacy, 2022, Centers for Disease Control and Prevention, 2022) This is likely the main factor contributing to lower reported HPV vaccination rates by this system. The final source of data was gathered from Medi-Cal and California HMO reports. These reports included mixed methods of acquiring vaccine coverage through both random sampling as well as claims, encounters, and supplement EHR data. (Quality Measures & Reporting, 2022, Integrated Healthcare Association, 2021, National Committee for Quality Assurance, 2022). Together, NIS-Teen, CAIR, and health plan and provider group reports were triangulated to provide more accurate trends of HPV vaccination in California’s 13-year-old population.
As a result of Medi-Cal and HMO reporting methods, they may reflect up to 62 % of all 13-year-olds in the State. CAIR has the potential to describe 100 % of the State’s adolescents, but it is evident that CAIR’s lack of standard reporting protocol is impacting the completeness of the reported immunization rates. Examples of single-system provider reporting include Michigan and New York’s immunization information systems. They both require all providers to report their immunizations to the state registry. (Michigan Care Improvement Registry, 2022, New York State, 2022) These populous states serve as a good model and solution for California’s registry.
Similar to national trends, this study also found that regions with significantly lower initiation rates were in rural territories compared to urban areas. (Elam-Evans et al., 2020, Crosby et al., 2011) CAIR records show that San Francisco and San Mateo County have the highest HPV vaccine series completion at 48 % and 49 %, respectively, and Imperial, Lassen, Modoc, and Plumas Counties have the lowest series completion at about 13 %. While this may be due to disproportionate reporting across counties that would account for disproportionate uptake in the HPV vaccine, the initiation and completion in these regions follows the pattern where rural California counties having a higher burden of HPV-related cancer. (Gillette-Walch et al., 2021) Rural counties continue to have various limitations that lead to a decrease in utilization of preventative services. National and state studies have found that limitations in rural areas include decreased number of primary care providers, financial constraints, poor transportation, and fewer access points for vaccination. (Bull et al., 2001, Bouldin et al., 2018, Zhai et al., 2020, Boyd et al., 2018) Further investigation is needed to assess the relationship between those factors and HPV vaccine coverage in rural counties of California. Such studies could help inform interventions aimed to address the increased vulnerability to HPV-related cancers in these regions.
Despite differences in data sources, it is evident that no county or health system in California achieved the U.S. Department of Health and Human Services Healthy People’s recommendation that 80 % of the country’s adolescents be fully immunized against HPV by their 13th birthday. (People, 2030) While the gap is narrowing between male and female HPV initiation and completion rates according to both NIS-Teen and CAIR findings, there remain missed opportunities for vaccination with the NIS-Teen estimates of HPV vaccination series completion peaking at 51.4 % and 61.5 %, respectively, for the study years. (Walker et al., 2019) While this study did not investigate contributing factors in California’s HPV vaccination patterns, decreased awareness of the HPV vaccine41–43, lack of school entry requirements, (Ko et al., 2020) parental refusal based on informational, social, or cultural factors, (Wong et al., 2021, Hirth et al., 2019, Brewer et al., 2017, Szilagyi et al., 2020) and lack of standard provider recommendations (Kashani et al., 2019, Dempsey and O’Leary, 2018) have been noted as influences in decreased uptake across the United States. Future studies should elucidate patterns for HPV vaccine hesitancy and refusal in California, by region and population, to improve both initiation and completion rates.
There are limitations to this study. CAIR estimates are impacted by individuals who no longer participate in the immunization information system, or who move out of the state, which inflates the denominator and gives an underrepresentation of true vaccination. To mitigate this inflation, if a child had fewer than two vaccine doses recorded, they were excluded from the analysis. This method could inadvertently exclude unvaccinated children. Additionally, we did not collect initiation rates for the years 2018 and 2019 for Medi-Cal and commercial insurances plans, and completion rates were not gathered for the year 2019 for Medi-Cal and commercial insurances plans, preventing year to year comparisons of the data sources. With both sources, we also are not accounting for patients who are uninsured. Further, even with NIS-Teen as the comparison database, it is not a gold standard since estimates are made based on a few hundred teens within the state. Although there is no gold standard for direct comparison, we were still able to report and compare vaccination patterns for the California databases. Lastly, NIS-Teen does not report on state data for 13-year-olds alone. Given this lack of data, we were unable to do a direct comparison of NIS-Teen estimates for California compared to the other immunization sources for this age group.
5. Conclusion
It is important to evaluate the differences of the three HPV vaccination reporting sources in California to estimate current vaccination rates and to understand current patterns throughout the State. Our results suggest that the CAIR database has a lower proportion of HPV vaccination completion among California’s 13-year-olds when compared to commercial and Medi-Cal insurance plans due to differences in assessment of vaccine uptake. Where CAIR currently relies on voluntary provider reporting, the other sources have standardized procedures and sampling. Importantly, California’s adolescent HPV vaccination rates are stabilizing far below Healthy (People, 2030) national goal of 80 % vaccination, and there are lower initiation and completion rates in rural counties. California must follow models of other large states that have a comprehensive immunization registry that includes HPV immunization records for all adolescents within the State. With new mandatory vaccination reporting in 2023 throughout California, this paper will serve as a comparator for future, similar studies of various sources of HPV vaccination rates. Overall, this paper underscores the current similarities and differences of the three databases, and these must be acknowledged when they are being cited as evidence for state and county-wide vaccination policy.
6. Future directions
The findings of this study documenting less than 50 % HPV series competition for 13-year-olds ought to inform public health planning. Future work should be twofold: first, on identifying missed opportunities for HPV vaccinations and how to increase HPV vaccination across the state, and second, on investigating the impact of new provider reporting laws on vaccination rates across the three CAIR regions. Solutions for improving HPV vaccination series initiation and completion should ultimately be focused with consideration for regional and health system-level factors. California must prioritize and incentivize vaccine improvements to protect our youth and population from HPV-related cancers.
7. Financial disclosure
No financial disclosures were reported by the authors of this paper.
CRediT authorship contribution statement
Brooke R. Warren: Writing – original draft. Hilary Gillette-Walch: Data curation, Methodology, Formal analysis. Jaime Adler: Methodology, Writing – review & editing. Raquel Arias: Methodology, Writing – review & editing. Jeffrey D. Klausner: Conceptualization, Writing – review & editing. Kimlin T. Ashing: Writing – review & editing. Alessandro Villa: Supervision, Conceptualization, Writing – review & editing.
Declaration of Competing Interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Acknowledgments
Acknowledgements
California HPV Vaccination Roundtable Data Workgroup members (Alison Hermann, PhD, MS; Autumn Ogden-Smith; Rita Singhal, MD, MPH; Hoa Su, MPH; Dorothy Wiley, PhD, RN, FAAN), California Department of Public Health (Sarah Royce, MD, MPH; Jane Gray, MPH; Erin Whitney; MPH, Deanna Fink, MPH; Cynthia Yen, MPH; Kentaro Abe, MPH; Timothy Lo), California Cancer Registry (Sandy Kwong, MPH), Healthy Futures (Sukhnandan Bal; Neeraja Kadarum; Tim Dixon), San Diego Immunization Registry (Danelle Wallace)
Informed Consent Statement
Not applicable.
Data Available Statement
The data presented in this study are available on request from the corresponding author.
Appendix
Table A3.
HMO commercial plans, Integrated Healthcare Association.
| HMO Insurance Plans |
|---|
| Kaiser-Permanente-Northern California |
| Kaiser-Permanente-Southern California |
| CIGNA |
| Western Health Advantage |
| Anthem Blue Cross |
| Blue Shield of California |
| Sharp Health Plan |
| UnitedHealthcare of California |
| Aetna Health of California, Inc. |
| Health Net of California |
Data availability
Data will be made available on request.
References
- Beachler D.C., Gonzales F.A., Kobrin S.C., Kreimer A.R. HPV vaccination initiation after the routine-recommended ages of 11–12 in the United States. Papillomavirus Res. 2016:2. doi: 10.1016/j.pvr.2015.12.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bouldin E.D., Shaull L., Andresen E.M., Edwards V.J., McGuire L.C. Financial and Health Barriers and Caregiving-Related Difficulties Among Rural and Urban Caregivers. J Rural Heal. 2018;34(3) doi: 10.1111/jrh.12273. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Boyd E.D., Phillips J.M., Schoenberger Y.M.M., Simpson T. Barriers and facilitators to HPV vaccination among rural Alabama adolescents and their caregivers. Vaccine. 2018;36(28) doi: 10.1016/j.vaccine.2018.04.085. [DOI] [PubMed] [Google Scholar]
- Brewer N.T., Chapman G.B., Rothman A.J., Leask J., Kempe A. Increasing Vaccination: Putting Psychological Science Into Action. Psychol. Sci. Public Interes. 2017;18(3) doi: 10.1177/1529100618760521. [DOI] [PubMed] [Google Scholar]
- Bull C.N., Krout J.A., Rathbone-McCuan E., Shreffler M.J. Access and issues of equity in remote/rural areas. J Rural Heal. 2001;17(4) doi: 10.1111/j.1748-0361.2001.tb00288.x. [DOI] [PubMed] [Google Scholar]
- California State Board of Pharmacy. Board of Pharmacy: Order of Adoption. Accessed March 7, 2022. https://www.pharmacy.ca.gov/laws_regs/1746_4_oa.pdf.
- Centers for Disease Control and Prevention National Center for Immunization and Respiratory Diseases. National Immunization Survey-Teen A User’s Guide for the 2020 Public-Use Data File.; 2021. Accessed December 12, 2022. https://www.cdc.gov/vaccines/imz-managers/nis/downloads/NIS-TEEN-PUF20-DUG.pdf.
- 8.Centers for Disease Control and Prevention NC for I and RDNC for HS. Data User’s Guide for the 2017 NIS-Teen Public-Use Data File. Published 2018. Accessed January 2, 2022. https://www.cdc.gov/vaccines/imz-managers/nis/downloads/NIS-TEEN-PUF17-DUG.pdf.
- Centers for Disease Control and Prevention. California Data Quality Report. Accessed April 21, 2022. https://wwwn.cdc.gov/IISDashboard/DQR.aspx?AwardeeID=6.
- Centers for Disease Control. Human Papillomavirus (HPV) Statistics. Accessed February 5, 2022. https://www.cdc.gov/std/hpv/stats.htm.
- Centers for Disease Control. Vaccination Coverage among Adolescents (13 – 17 Years). Accessed February 5, 2022. https://www.cdc.gov/vaccines/imz-managers/coverage/teenvaxview/data-reports/index.html?CDC_AA_refVal=https%3A%2F%2Fwww.cdc.gov%2Fvaccines%2Fimz-managers%2Fcoverage%2Fteenvaxview%2Fdata-reports%2Fhpv%2Ftrend%2Findex.html.
- Creamer M.R., Wang T.W., Babb S., et al. Tobacco Product Use and Cessation Indicators Among Adults - United States, 2018. MMWR Morb Mortal Wkly Rep. 2019:681013–681689. doi: 10.15585/mmwr.mm6845a2. Published online 2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Crosby R.A., Casey B.R., Vanderpool R., Collins T., Moore G.R. Uptake of Free HPV Vaccination Among Young Women: A Comparison of Rural Versus Urban Rates. J Rural Heal. 2011:27(4). doi: 10.1111/j.1748-0361.2010.00354.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dempsey A.F., O’Leary S.T. Human Papillomavirus Vaccination: Narrative Review of Studies on How Providers’ Vaccine Communication Affects Attitudes and Uptake. Acad Pediatr. 2018;18(2) doi: 10.1016/j.acap.2017.09.001. [DOI] [PubMed] [Google Scholar]
- Elam-Evans L.D., Yankey D., Singleton J.A., et al. National, Regional, State, and Selected Local Area Vaccination Coverage Among Adolescents Aged 13–17 Years — United States, 2019. MMWR Morb Mortal Wkly Rep. 2020;69(33) doi: 10.15585/mmwr.mm6933a1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Myerburg S. Enhancing EHR-IIS Interoperability.; 2016. Accessed October 10, 2022. https://www.cdc.gov/vaccines/programs/iis/interop-proj/downloads/soap-br.pdf.
- Gillette-Walch H, Whitney E, Arias R, Fink D, Pezua J. Assessment of Human Papillomavirus (HPV) Attributable Cancers and Vaccination Rates in California: Report of Findings of the California HPV Vaccination Roundtable.; 2021. Accessed April 4, 2022. CAHPVRoundtable.org.
- Hirth J.M., Fuchs E.L., Chang M., Fernandez M.E., Berenson A.B. Variations in reason for intention not to vaccinate across time, region, and by race/ethnicity, NIS-Teen (2008–2016) Vaccine. 2019;37(4) doi: 10.1016/j.vaccine.2018.12.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Integrated Healthcare Association. Integrated Healthcare Association Align. Measure. Perform. (AMP) Programs: Measurement Year 2021 Technical Specifications.; 2021. Accessed December 12, 2022. https://iha.org/wp-content/uploads/2021/06/MY-2021-AMP-Technical-Specifications.pdf.
- Jain N., Singleton J.A., Montgomery M., Skalland B. Determining accurate vaccination coverage rates for adolescents: The National Immunization Survey-Teen 2006. Public Health Rep. 2009;124(5) doi: 10.1177/003335490912400506. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Johnson D.E., Burtness B. Head and neck squamous cell carcinoma. Nat Rev Dis Prim. 2020;6(92) doi: 10.1038/s41572-020-00224-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kashani B.M., Tibbits M., Potter R.C., Gofin R., Westman L., Watanabe-Galloway S. Human Papillomavirus Vaccination Trends, Barriers, and Promotion Methods Among American Indian/Alaska Native and Non-Hispanic White Adolescents in Michigan 2006–2015. J Community Health. 2019;44(3) doi: 10.1007/s10900-018-00615-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kavanagh K., Pollock K.G., Cuschieri K., et al. Changes in the prevalence of human papillomavirus following a national bivalent human papillomavirus vaccination programme in Scotland: a 7-year cross-sectional study. Lancet Infect Dis. 2017;17(12) doi: 10.1016/S1473-3099(17)30468-1. [DOI] [PubMed] [Google Scholar]
- Ko J.S., Goldbeck C.S., Baughan E.B., Klausner J.D. Association between human papillomavirus vaccination school-entry requirements and vaccination initiation. JAMA Pediatr. 2020;174(9) doi: 10.1001/jamapediatrics.2020.1852. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Markowitz L.E., Dunne E.F., Saraiya M., et al. Human Papillomavirus Vaccination Recommendations of the Advisory Committee on Immunization Practices (ACIP) MMWR Recomm Reports. 2014;63(1) [PubMed] [Google Scholar]
- Medeiros R., Vaz S., Rebelo T., Figueiredo-Dias M. Prevention of human papillomavirus infection. Beyond cervical cancer: A brief review. Acta Med Port. 2020;33(3) doi: 10.20344/amp.12259. [DOI] [PubMed] [Google Scholar]
- Meites E., Szilagyi P.G., Chesson H.W., Unger E.R., Romero J.R., Markowitz L.E. Human Papillomavirus Vaccination for Adults: Updated Recommendations of the Advisory Committee on Immunization Practices. MMWR Morb Mortal Wkly Rep. 2019;68(32) doi: 10.15585/mmwr.mm6832a3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Michigan Care Improvement Registry. Published 2022. Accessed March 7, 2022. https://mcir.org/.
- National Committee for Quality Assurance. Healthcare Effectiveness Data and Information Set (HEDIS). Published 2022. Accessed December 12, 2022. https://health.gov/healthypeople/objectives-and-data/data-sources-and-methods/data-sources/healthcare-effectiveness-data-and-information-set-hedis.
- New York State. New York State Immunization Information System (NYSIIS). Published 2022. Accessed March 7, 2022. https://www.health.ny.gov/prevention/immunization/information_system/.
- Niccolai L.M., Mehta N.R., Hadler J.L. Racial/ethnic and poverty disparities in human papillomavirus vaccination completion. Am J Prev Med. 2011;41(4) doi: 10.1016/j.amepre.2011.06.032. [DOI] [PubMed] [Google Scholar]
- Healthy People 2030. Increase the proportion of adolescents who get recommended doses of the HPV vaccine — IID‑08. U.S. Department of Health and Human Services. Published 2022. Accessed October 2, 2022. https://health.gov/healthypeople/objectives-and-data/browse-objectives/vaccination/increase-proportion-adolescents-who-get-recommended-doses-hpv-vaccine-iid-08.
- Perkins R.B., Lin M., Wallington S.F., Hanchate A.D. Impact of school-entry and education mandates by states on HPV vaccination coverage: Analysis of the 2009–2013 National Immunization Survey-Teen. Hum Vaccines Immunother. 2016;12(6) doi: 10.1080/21645515.2016.1150394. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Petrosky E., Bocchini J.A., Hariri S., et al. Use of 9-valent human papillomavirus (HPV) vaccine: updated HPV vaccination recommendations of the advisory committee on immunization practices. MMWR Morb Mortal Wkly Rep. 2015;64(11) [PMC free article] [PubMed] [Google Scholar]
- Pingali C., Yankey D., Elam-Evans L.D., et al. National, Regional, State, and Selected Local Area Vaccination Coverage Among Adolescents Aged 13–17 Years — United States, 2020. MMWR Recomm Reports. 2021;70(35) doi: 10.15585/mmwr.mm7035a1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- California Department of Health Care Services. Quality Measures & Reporting. Published 2022. Accessed December 12, 2022. https://www.dhcs.ca.gov/dataandstats/Pages/QualityMeasurementAndReporting.aspx.
- Rotsides JM, Oliver JR, Moses LE, et al. Socioeconomic and Racial Disparities and Survival of Human Papillomavirus–Associated Oropharyngeal Squamous Cell Carcinoma. Otolaryngol - Head Neck Surg (United States). 2021;164(1). doi:10.1177/0194599820935853. [DOI] [PubMed]
- Shimabukuro T.T., Su J.R., Marquez P.L., Mba-Jonas A., Arana J.E., Cano M.V. Safety of the 9-valent human papillomavirus vaccine. Pediatrics. 2019;144(6) doi: 10.1542/peds.2019-1791. [DOI] [PMC free article] [PubMed] [Google Scholar]
- St. Sauver JL, Rutten LJF, Ebbert JO, Jacobson DJ, McGree ME, Jacobson RM. Younger age at initiation of the human papillomavirus (HPV) vaccination series is associated with higher rates of on-time completion Prev Med (Baltim) 2016 89 10.1016/j.ypmed.2016.02.039. [DOI] [PMC free article] [PubMed]
- Staples J.N., Nelamangala S.L., Morris S., Wells K. Exploring socio-demographic and geospatial variation in human papillomavirus vaccination uptake in Virginia. Vaccine. 2021;39(38) doi: 10.1016/j.vaccine.2021.07.079. [DOI] [PubMed] [Google Scholar]
- Szilagyi P.G., Albertin C.S., Gurfinkel D., et al. Prevalence and characteristics of HPV vaccine hesitancy among parents of adolescents across the US. Vaccine. 2020;38(38) doi: 10.1016/j.vaccine.2020.06.074. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vickers M., Green C.L., Lee H.Y., Pierce J.Y., Daniel C.L. Factors Associated with HPV Vaccination Uptake and HPV-Associated Cancers: A County-Level Analysis in the State of Alabama. J Community Health. 2019;44(6):1214–1223. doi: 10.1007/s10900-019-00690-1. [DOI] [PubMed] [Google Scholar]
- Walker T.Y., Elam-Evans L.D., Yankey D., et al. National, Regional, State, and Selected Local Area Vaccination Coverage Among Adolescents Aged 13–17 Years — United States, 2018. MMWR Morb Mortal Wkly Rep. 2019;68(33) doi: 10.15585/mmwr.mm6833a2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Weber A., Pan L., Newman W., Wiener . Secretary of State; 2022. AB-1797 Immunization Registry. [Google Scholar]
- Wolter K.K., Smith P.J., Khare M., et al. Statistical Methodology of the National Immunization Survey, 2005–2014. Vital Health. Stat. 2017;1:(61). [PubMed] [Google Scholar]
- Wong A., Kraschnewski J.L., Spanos K.E., Fogel B., Calo W.A. Parental motivations for seeking second medical opinions for their child’s HPV vaccine. Prev Med Reports. 2021:24. doi: 10.1016/j.pmedr.2021.101550. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhai Y., Santibanez T.A., Kahn K.E., Srivastav A., Walker T.Y., Singleton J.A. Rural, urban, and suburban differences in influenza vaccination coverage among children. Vaccine. 2020;38(48) doi: 10.1016/j.vaccine.2020.10.030. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data will be made available on request.



