Skip to main content
JAMA Network logoLink to JAMA Network
. 2026 Nov 13;9(11):e2642247. doi: 10.1001/jamanetworkopen.2026.42247

Clinician Training, Text Messages, and Human Papillomavirus Vaccination Among Children Aged 10 to 12 Years

A Randomized Clinical Trial

Stephanie A S Staras 1,✉, Carma L Bylund 1, Matthew J Gurka 2, Lindsay A Thompson 3, Marta D Hansen 1, Tuo Lin 4,5, Pengchen Wang 5, Gabriela Sanchez 1, Xiaofei Chi 6, Christopher A Harle 7, Kennan DeGruccio 1, Georges E Khalil 1, Elizabeth A Shenkman 1
PMCID: PMC13768968  PMID: 43024238

Key Points

Question

Does training clinicians in communication strategies and sending parents text messages increase rates of HPV vaccination?

Findings

In this cluster and individually randomized clinical trial involving 30 pediatric primary care practices, 59 clinicians, and 7234 children aged 10 to 12 years in Florida, HPV vaccine initiation (first dose) and completion (second dose) did not differ by clinician training or text messaging.

Meaning

Unlike prior studies, as randomized, differences in HPV vaccination rates could not be attributed to the clinician training or text message intervention in this study.


This randomized clinical trial evaluates whether different clinician communication and parent outreach strategies increased the rates of human papillomavirus (HPV) vaccination among children in Florida.

Abstract

Importance

Human papillomavirus (HPV) vaccination rates among adolescents remain below recommendations.

Objective

To evaluate the effectiveness of clinician communication training and parent-targeted text messages at increasing HPV vaccination among children aged 11 to 12 years.

Design, Setting, and Participants

This doubly randomized, 2-level nested clinical trial was conducted from February 2022 to September 2024 among clinicians at 30 pediatric primary care clinics in Florida, children aged 10 to 12 years who had not received any of the 3 adolescent HPV vaccines, and their parents. Interventions occurred for 1 year, and vaccine records were collected for 2 years.

Interventions

Clinics were randomized 1:1:1 to 3 training groups: (1) the bundled approach, which presents the HPV vaccine in the middle of 2 other recommended vaccines; (2) the focused approach, which emphasizes cancer prevention; and (3) deferred, which offered clinicians the opportunity to participate in the focused training after the trial concluded. Clinicians in the first 2 groups completed a 1-hour communication training and a 5-minute booster session. Patients within clinics were randomized 1:1:1 to 3 text message groups, aligned with the communication strategies: (1) bundled, (2) focused, and (3) no text messages. Parents were sent text messages at the start of the study or prior to their child’s 11th birthday as well as prior to appointments.

Main Outcomes and Measures

Primary outcomes were HPV vaccine initiation (receipt of first dose) and completion (receipt of second dose). Analyses accounted for clinic-level clustering. Effects were analyzed as randomized and text messages as received.

Results

At baseline, 59 clinicians (44 [75%] female; 12 [20%] Asian, 21 [36%] Hispanic, and 21 [36%] non-Hispanic White) within 30 randomized clinics were included, with 17 randomized to the focused group, 21 to the bundled group, and 21 to the deferred group. A total of 7234 children were aged 10 (3576 [49%]), 11 (2617 [36%]), and 12 (1041 [14%]) years at study start (1673 [23%] Hispanic, 1001 [14%] non-Hispanic Black, and 1210 [17%] non-Hispanic White). A total of 28 clinics (93%), 50 clinicians (85%), and 6498 children (90%) completed the 2-year follow-up. The mean pre-post clinic-level difference for HPV vaccine initiation was 28.2 (95% CI, 25.3-31.1) percentage points and for completion was 16.1 (95% CI, 13.3-18.9) percentage points. Risk ratios for clinician training and text messaging did not differ between groups for initiation or completion. Among patients whose parents received text messages vs not, the risk ratio for initiation was 1.17 (95% CI, 1.08-1.26) and for completion was 1.29 (95% CI, 1.06-1.56).

Conclusions and Relevance

In this study of Florida children aged 10 to 12 years, clinic-level HPV vaccination increased over time. No differences in HPV vaccination by random assignment of clinician training or text messages were detected. When received, text messages were associated with higher HPV vaccination.

Trial Registration

ClinicalTrials.gov Identifier: NCT05006833

Introduction

Infections account for 10% of all cancers, and a major contributor is human papillomavirus (HPV), for which a safe and effective vaccine exists.1,2,3 Since 2011, the US Advisory Committee on Immunization Practices has recommended routine use of HPV vaccination for children aged 11 to 12 years.4,5 Among immunocompetent children who start the HPV vaccine series before age 15 years, 2 doses are needed for completion. If started later, 3 doses are recommended. The percentage of US adolescents who have completed the HPV vaccine series in 2024 (63%) is well below national targets (80%) and has not improved since 2020.6,7 Across the United States, inequities in HPV vaccine completion exist with lower rates often identified for children without health insurance or living in southern states and/or rural areas.7

Recommended strategies to increase HPV vaccination include training clinicians in communication and reminding and educating parents through direct messaging (eg, postcards or texts).8 Meta-analyses demonstrate HPV vaccine initiation increased by 5% with clinician trainings and 17% with text messages.9,10,11,12,13,14,15,16 However, while evidence suggests multilevel interventions (eg, targeting clinicians and parents) are most effective at increasing vaccination,17 only a small fraction of HPV vaccination studies are multilevel.18

Health agencies endorse 2 approaches for clinicians’ HPV vaccine recommendations. The US Centers for Disease Control and Prevention endorses a bundled approach: a scripted, presumptive statement to present the HPV vaccine in the middle of the 2 other recommended vaccines, ie, tetanus, diphtheria, pertussis (Tdap) and meningococcal ACWY (MenACWY).19,20 Alternatively, the President’s Cancer Panel endorsed a focused approach of emphasizing cancer prevention, vaccine efficacy and safety, and the importance of vaccination at age 11 to 12 years.21 The most effective wording remains unclear; therefore, the American Academy of Pediatrics recommends both strategies.22

Following 2 strategies (bundled and focused), we developed text message scripts and a clinician communication training with feedback from parents and clinicians.23,24 Guided by the Integrated Behavior Model,25 we conducted a multilevel randomized clinical trial (RCT) to evaluate the effectiveness of each intervention (clinician communication training and parent-targeted text messages) separately and combined to increase HPV vaccine initiation (≥1 dose) and completion (2 doses) among children aged 11 to 12 years seeking primary care in Florida. We hypothesized that (1) clinician communication training and parent-targeted text messages would each increase HPV vaccination, with similar increases for initiation and larger increases in completion with the focused approach; (2) combined effectiveness of clinician communication training and parent-targeted text messages would be greater than either intervention alone; and (3) concordant approaches (eg, bundled clinician training and bundled text messages) would be more effective than distinct approaches (eg, bundled clinician training and focused text messages). As a secondary outcome, we evaluated the effect of clinician communication training on clinicians’ frequency of recommending the HPV vaccine for patients aged 11 to 12 years. As a post hoc analysis, we evaluated the effectiveness of receiving text messages on HPV vaccination due to observed text message nonreceipt.

Methods

Study Design and Setting

From February 2022 to September 2024, we conducted a doubly randomized, 2-level nested longitudinal clinical trial to evaluate clinician-targeted communication training and parent-targeted text messages on HPV vaccination among children aged 11 to 12 years entitled Text & Talk.26 The full protocol is available in Supplement 1. We implemented interventions for 1 year and collected vaccine records for 2 years. The University of Florida institutional review board (IRB) served as the single IRB. Participation of investigators who moved to other universities during the study was covered through a reliance agreement with Wake Forest University Health Sciences and exempt approval at Indiana University and the University of Virginia. Parents and clinicians completed informed consent. A Health Insurance Portability and Accountability Act waiver of informed consent was approved to evaluate children’s vaccine records. The study was registered with ClinicalTrials.gov, and this report follows the 2025 Consolidated Standards of Reporting Trials (CONSORT) reporting guideline.

Selection of Clinics, Clinicians, Children, and Parents

We recruited 30 Florida-based pediatric primary care clinics. Clinic inclusion criteria were (1) HPV vaccine initiation rates among patients aged 13 to 17 years less than 68% (Florida state average available in 2022),27 (2) administered the HPV vaccine regardless of health insurance, (3) had 70 or more patients aged 11 to 12 years with a visit in the past 2 years or a scheduled appointment, (4) willing to send text messages to patients, and (5) willing to be randomly assigned to an intervention.

Recruitment of Practices

We first interacted with clinics through the Florida Department of Health Immunization Quality Improvement for Providers program staff, OneFlorida+ partners, and direct contact.28,29,30 Partners sent clinic leadership a 1-page summary and invited them to an introductory meeting. Representatives of 37 clinics attended a meeting, among whom 30 (81%) chose to participate (Figure 1). Clinics were compensated $6000.

Figure 1. Flow Diagram for the Text & Talk Trial.

Flow diagram of clinic, clinician, parent, and child randomization and follow-up. Top center rectangular node: 38 Florida clinics assessed for eligibility. A rightward arrow leads to a pale blue box: 8 excluded, with sublines 2 did not meet inclusion criteria and 6 declined to participate. A downward arrow leads to a centered rectangle: 8043 total children from 30 Florida clinics. A rightward arrow leads to a pale blue box: 809 excluded, with sublines 630 already vaccinated and 179 not 10 to 12 y old. A downward arrow leads to an oval: 30 clinics randomized. Three branches extend left, center, and right to three large colored boxes. Left pale blue box: 21 clinicians randomized to clinician training bundled from 10 clinics; 20 clinicians received allocated intervention; 1 did not receive allocated intervention. Center pale green box: 17 clinicians randomized to clinician training focused from 10 clinics; 17 clinicians received allocated intervention; 0 did not receive allocated intervention. Right pale yellow box: 21 clinicians randomized to clinician training deferred from 10 clinics; 21 clinicians received allocated intervention; 0 clinician did not receive allocated intervention. Beneath each clinician box, an oval lists randomized parents: left 2439, center 1827, right 2968. Under each parent oval are three small group boxes connected by lines. Left branch: 808 randomized to text messages bundled, 565 received allocated intervention; 824 randomized to text messages focused, 622 received allocated intervention; 807 randomized to text messages none, 773 received allocated intervention. Center branch: 600 randomized to text messages bundled, 459 received allocated intervention; 595 randomized to text messages focused, 419 received allocated intervention; 632 randomized to text messages none, 614 received allocated intervention. Right branch: 960 randomized to text messages bundled, 759 received allocated intervention; 989 randomized to text messages focused, 777 received allocated intervention; 1019 randomized to text messages none, 999 received allocated intervention. Lower rows contain follow-up loss boxes per branch: left gray box notes 5 clinicians lost to follow-up and 1 clinic closed; center gray box notes 1 clinician lost to follow-up; right gray box notes 3 clinicians lost to follow-up and 1 clinic change of ownership. Final rows list children lost to follow-up and children analyzed for each of the nine text-message groups: left branch lost 39, 39, and 37 with analyzed 769, 785, and 770; center branch lost 0, 0, and 2 with analyzed 600, 595, and 630; right branch lost 208, 204, and 207 with analyzed 752, 785, and 812.

Recruitment of Clinicians for Communication Training and Evaluation

Within each clinic, we invited all clinicians (MD, DO, advanced practice registered nurse [APRN], and physician assistant [PA]) who treated patients aged 11 to 12 years. Agreeing clinicians completed informed consent during remote sessions with study staff. Clinicians were offered Continuing Medical Education and Maintenance of Certification Part 2 credit for attending trainings, monetary incentives ($5 to $20) for completing surveys, and Maintenance of Certification Part 4 points for completing all activities, reviewing records, and reflecting.31 All clinicians consented to participate.

Inclusion of Children and Recruitment of Parents to a Survey

For enrollment, we considered any children aged 10 to 12 years who visited the participating clinic in the prior 2 years or had a scheduled visit during the 1-year implementation phase. We excluded patients who (1) had received Tdap, MenACWY, or HPV vaccine doses; (2) had opted out of text messages; or (3) did not have a phone number in the clinic’s electronic health records (EHR). Patients’ demographic information, including race and ethnicity, came from the clinics’ EHR. For analyses, racial and ethnic groups were combined following the 1997 Office of Management and Budget (OMB) Standards for Data on Race and Ethnicity due to small numbers in some groups.32 The final clinician sample included Asian, Hispanic, non-Hispanic Black, and non-Hispanic White individuals, while American Indian or Alaskan Native, Native Hawaiian or Other Pacific Islander, and multiracial clinicians as well as those with other and unspecified or unknown race and ethnicity were combined into the additional groups category; the final patient sample included Hispanic, non-Hispanic Black, and non-Hispanic White children, while American Indian or Alaska Native, Asian, multiracial (Asian and Black; Asian, Pacific Islander, and Native American; Asian, Pacific Islander, and White; Asian and White; Black and White; multiracial), Native Hawaiian or Other Pacific Islander, non-Hispanic Spanish American, and non-Hispanic Hispanic children as well as those who selected other for race and ethnicity were combined into the additional groups category. Race and ethnicity were collected for this study because of potential differences in HPV vaccination rates and response to text messaging.33,34

Parents were invited to complete a survey via text message 2 to 3 days after being sent the intervention text message.35 Nonresponding parents were sent 5 reminders: 2 via text message and 3 via phone. Parents completing the survey received $30.

Randomization

Study statisticians used stratified randomization at both levels (clinics and children) with programs in SAS version 9.4 (SAS Institute). Clinics were randomly assigned in a 1:1:1 ratio to bundled, focused, or deferred training (offered after the study was complete) using a covariate-constrained randomization strategy, with the baseline clinic initiation rate included as a covariate in the randomization process. Clinics’ baseline HPV vaccine initiation rates were obtained for patients aged 11 to 12 years from Florida’s immunization registry.36 Due to recruitment delays, we randomized clinics in 2 cohorts: 27 clinics (9 per group) in February 2022 and 3 clinics (1 per group) in May 2022. Within each clinic, children were subsequently randomized in a 1:1:1 ratio to bundled, focused, or no text messages within male or female strata using simple randomization. The combination of the clinic-level training assignment and child-level messaging assignment resulted in 9 intervention combinations, including 1 combination in which patients did not have a clinician who received training nor parent who received text messages. Study statisticians remained blinded to study group assignments until interventions were complete. Clinicians were aware of their study groups and were not blinded to assignment.

Interventions

As described in the introduction, we conducted interventions with bundled and focused strategies (eTable 1 in Supplement 2).19 Clinicians randomized to the deferred strategy could undertake the focused training after study completion; parents and children randomized to no text message did not receive any intervention.

Clinician Communication Training

Clinicians attended a 1-hour, synchronous, communication skills training over Zoom focused on our developed communication strategy—the C-LEAR approach24: counsel using the prespecified bundled or focused strategy; listen to questions; use empathy; answer questions; and recommend the vaccine. Trainings covered the value of clinician recommendations for HPV vaccination, the C-LEAR approach, and role plays.37 Two coders independently evaluated session recordings for fidelity based on prespecified guidelines and reconciled differences with the second author.38 Approximately 4.5 weeks after training completion, clinicians participated in a 5-minute booster involving recommending the HPV vaccine to a simulated patient educator playing a patient’s mother.

Text Messages

Clinics sent text messages either through existing platforms (22 clinics), receiving $1800 compensation, or with assistance from study staff through the vendor Intrado (8 clinics). Among the 22 clinics using existing platforms, messages were sent by a centralized data team (19 clinics) or a clinic manager (3 clinics). Text messages were sent in the child’s preferred language (English or Spanish) both at the study start for children aged 11 to 12 years or 2 weeks prior to the child’s 11th birthday and a few days before scheduled appointments. The number of text messages received varied by study group assignment, delivery completion, eligible at study start or only with an appointment (new patients), and the number of scheduled appointments. To facilitate text messaging, clinic staff reviewed scheduled appointments and HPV vaccine records weekly.

Implementation Outcome Measures

Clinicians completed behavioral surveys before, immediately following, and 1 and 2 years after training. Clinicians received $20 per completed survey.

We evaluated parent acceptability of text messages by survey. Parents who remembered receiving the text message were asked if they (1) recommended all parents receive a similar message, (2) changed the likelihood of having their child receive the HPV vaccine, and (3) took actions after receiving the message. We measured text message receipt by documentation of sending, lack of undeliverable status on system logs, a response, or a completed survey.

Effectiveness Outcome Measures

The primary outcomes were HPV initiation (first dose or more) and completion (second dose) received over 2 years, allowing children sufficient time to receive both doses.39 Vaccination records were collected from the clinic’s EHR and the clinics’ access to Florida SHOTS. Children without HPV vaccine records were interpreted as not vaccinated.

As a secondary outcome, we measured clinicians’ self-reported percentage of patients aged 11 to 12 years for whom they recommended the HPV vaccine. Using the clinics’ scheduled appointments, we sent each clinician a survey link for their first 3 well visits with patients aged 11 to 12 years each month during the 1-year implementation period (36 total). Surveys were sent via text or email on the appointment day with weekly and monthly reminders. For specified children, clinicians reported whether they saw them, recommended the HPV vaccine, and used the C-LEAR approach (if applicable) or received parent questions.

Sample Size

The sample size of 30 clinics (10 clinics per group; 2-3 clinicians per clinic; 90 patients per clinician) was powered to detect differences between any implementation strategy vs no strategy in HPV vaccine initiation of at least 9.1% and completion rates of at least 6.3%. We assumed a control 30% initiation rate and 10% completion rate based on 30% of initiated completing the series.40 Based on prior studies,41,42 we estimated the interclass correlation of 0.10 at the clinician level and 0.08 at the clinic level.

Statistical Analysis

We evaluated implementation outcomes with descriptive statistics. For effectiveness outcomes, we used generalized estimating equation (GEE) models (geepack package) with an exchangeable matrix structure to estimate risk ratios (RRs) comparing intervention assignments while accounting for the clinic-level clustering.43,44,45 At the clinic-level, intraclass correlation coefficient values for initiation ranged from 0.06 to 0.09 and for completion ranged from 0.12 to 0.18. EHR records did not link patients to clinicians one-to-one, and therefore, we did not estimate or adjust for clinician-level clustering. We also estimated RRs across intervention groups after further adjusting for randomization assignment and baseline HPV vaccination rates. We performed a sensitivity analysis of the intervention effects by applying a variance correlation factor. Finally, in a predetermined exploratory analysis, to evaluate the combined effects of the interventions, we estimated RRs between groups with both interventions compared with groups with only 1 intervention and considered differences between each combination using the Benjamini-Hochberg procedure to control the false discovery rate at .05.46 Missingness in covariates was low. All analyses were conducted with complete cases using R version 4.4.1 (R Project for Statistical Computing). Hypothesis tests were 2-sided with the type I error rate at .05.

Results

Study Participants

At baseline, 59 clinicians (44 [75%] female; 12 [20%] Asian, 21 [36%] Hispanic, and 21 [36%] non-Hispanic White) were randomized, with 17 randomized to the focused group, 21 to the bundled group, and 21 to the deferred group. A total of 7234 children were 10 (3576 [49%]), 11 (2617 [36%]), or 12 (1041 [14%]) at study start (1673 [23%] Hispanic, 1001 [14%] non-Hispanic Black, and 1210 [17%] non-Hispanic White). Characteristics of clinics, clinicians, and patients were similar across clinician training groups (Table 1). Likewise, patient characteristics were similar across text message groups (eTable 2 in Supplement 2). Among the 30 clinics and 7234 patients randomized, 28 clinics (93%) completed the study and provided HPV vaccination records for 6498 patients (Figure 1).

Table 1. Baseline Characteristics of Clinics, Clinicians, and Patients in the Text & Talk Trial by Clinician Training Intervention Assignment.

Characteristic Participants, No. (%)
Total Focused Bundled Deferred
Clinic characteristics
Total No. 30 10 10 10
Practice ownership
Physician-owned 12 (40) 2 (20) 8 (80) 2 (20)
Academic 7 (23) 3 (30) 2 (20) 2 (20)
Network-owned 11 (37) 5 (50) 0 6 (60)
No. of full-time clinicians seeing patients aged 11-12 y per clinic, median (IQR) 2.0 (1.0 to 2.0) 1.5 (1.0 to 2.0) 2.0 (1.0 to 2.0) 2.0 (1.0 to 3.0)
Preintervention HPV vaccine initiation rates among patients aged 10-12 y, median (IQR), % 49.4 (20.8 to 65.2) 49.4 (27.4 to 61.2) 39.5 (20.8 to 60.1) 51.9 (15.3 to 70.6)
Clinician characteristics
Total No. 59 17 21 21
Clinician type
MD/DO 51 (86) 16 (94) 18 (86) 17 (81)
APP 8 (14) 1 (6) 3 (14) 4 (19)
Sex
Female 44 (75) 12 (71) 16 (76) 16 (76)
Male 15 (25) 5 (29) 5 (24) 5 (24)
Race and ethnicity
Asian 12 (20) 4 (24) 2 (9) 6 (29)
Hispanic 21 (36) 5 (29) 8 (38) 8 (38)
Non-Hispanic Black 4 (7) 1 (6) 1 (5) 2 (9)
Non-Hispanic White 21 (36) 6 (35) 10 (48) 5 (24)
Additional groupsa 1 (1) 1 (6) 0 0
Patient characteristics
Total No. 7234 1827 2439 2968
Age at study start, y
10 3576 (49) 897 (49) 1239 (51) 1440 (49)
11 2617 (36) 637 (35) 890 (37) 1090 (37)
12 1041 (14) 293 (16) 310 (13) 438 (15)
Sex
Female 3479 (48) 871 (48) 1183 (49) 1425 (48)
Male 3755 (52) 956 (52) 1256 (52) 1543 (52)
Race and ethnicity
Hispanic 1673 (23) 341 (19) 470 (19) 862 (29)
Non-Hispanic Black 1001 (14) 220 (12) 399 (16) 382 (13)
Non-Hispanic White 1210 (17) 233 (13) 308 (13) 669 (23)
Additional groupsb 264 (4) 78 (4) 84 (3) 102 (3)
Missing 3086 (43) 955 (52) 1178 (48) 953 (32)
Most recent health insurance
Commercial or third-party administrator 1613 (22) 268 (15) 721 (30) 624 (21)
Medicaid or government sponsored 1876 (26) 522 (29) 619 (25) 735 (25)
Other multiplan 28 (<1) 1 (<1) 26 (1) 1 (<1)
Self-pay 116 (2) 33 (2) 64 (3) 19 (1)
Not provided by clinic 3601 (50) 1003 (55) 1009 (41) 1589 (54)

Abbreviations: APP, advanced practice practitioner; DO, doctor of osteopathic medicine; HPV, human papillomavirus; MD, medical doctor.

a

Additional groups for clinicians included American Indian or Alaskan Native, Native Hawaiian or Other Pacific Islander, and multiracial clinicians as well as those with other and unspecified or unknown race and ethnicity.

b

Additional groups for patients included American Indian or Alaska Native, Asian, multiracial (Asian and Black; Asian, Pacific Islander, and Native American; Asian, Pacific Islander, and White; Asian and White; Black and White; multiracial), Native Hawaiian or Other Pacific Islander, non-Hispanic Spanish American, and non-Hispanic Hispanic children as well as those with other race and ethnicity.

Intervention Implementation Outcomes

We conducted 14 clinician training sessions; facilitators were 80% adherent to the training guidelines. Nearly all assigned clinicians completed the 1-hour synchronous training (37 of 38 [97%]) and the follow-up booster training (36 of 37 [97%]). Overall, 36 of 37 clinicians (97%) agreed the training was helpful, the content was easy to understand, and they intended to implement what they learned. A majority (29 of 37 [78%]) agreed the trained approach would increase HPV vaccination. Most clinicians reported using the trained approach most of the time or more to talk to parents of children aged 11 to 12 years about the HPV vaccine (35 of 36 [97%] at 1 year; 21 of 28 [75%] at 2 years).

Throughout the study, 4286 parents were sent text messages, among which 3153 (74%) were considered received. Nonreceived text messages were due to clinic staff or system failing to send (718 messages), clinics not sending to inactive patients or those with scheduled appointments (197 messages), or nonwireless numbers (218 messages). Among parents sent text messages, our American Association for Public Opinion Research response rate 4 for the survey was 21% (750 parents).47 Among respondents, 559 (75%) remembered receiving the text message. Acceptability was high: 398 (71%) recommended all parents receive a similar text message, 219 (39%) felt more likely to have their child vaccinated for the HPV vaccine after receiving the text message, and 295 (53%) reported taking some action toward getting the HPV vaccine for their child (81 [14%] talked to a health care provider, 74 [13%] talked to their child, 96 [17%] spoke to family or friends, 152 [27%] looked up information, and 64 [11%] made a doctor’s appointment).

Effect on HPV Vaccination Rates

Across the 28 participating clinics, the mean baseline HPV vaccine initiation rate was 45.4% (95% CI, 36.4%-54.4%) and the completion rate was 20.2% (95% CI, 13.5%-26.9%) (Figure 2). The mean pre-post increase in HPV vaccine initiation was 28.2 (95% CI, 25.3-31.1) percentage points and completion was 16.1 (95% CI, 13.3-18.9) percentage points.

Figure 2. Line Graphs of Human Papillomavirus (HPV) Vaccination Rates by Participating Health System.

Two-panel line charts of HPV initiation and completion rates from baseline to end of study. Two side-by-side panels labeled A and B, each a line chart with many colored lines. Panel A title at upper left: Initiation. Vertical axis label: HPV vaccine initiation rate, percent, with tick marks from 0 to 100. Horizontal axis has two categories: Baseline at left and End of study at right. Each clinic represented by a distinct solid-colored line segment connecting its baseline value to its end-of-study value; colors include black, teal, light blue, dark blue, green, orange, yellow, pink, purple, maroon, brown, and gray, with no visible legend. Most lines slope upward. Baseline initiation values span from about 2 percent to about 78 percent. End-of-study initiation values span from about 22 percent to about 95 percent. A black line near the top rises from roughly 77 percent at baseline to roughly 94 percent at end of study. Several mid-high lines rise from approximately 55 to 75 percent at baseline to approximately 80 to 90 percent at end of study. Lower lines include a light gray line rising from about 3 percent to about 22 percent, and several lines rising from about 14 to 28 percent to about 41 to 63 percent. Panel B title at upper right: Completion. Vertical axis label: HPV vaccine completion rate, percent, with tick marks from 0 to 100. Horizontal axis again: Baseline and End of study. The same set of colored clinic lines appears, each connecting baseline to end-of-study completion values; most lines slope upward. Baseline completion values range from about 0 percent to about 55 percent, and end-of-study completion values range from about 2 percent to about 72 percent. A black line near the top rises from about 52 percent to about 72 percent, closely paralleled by an orange line rising from about 54 percent to about 71 percent. Several midrange lines rise from roughly 32 to 43 percent to roughly 48 to 61 percent. Lower lines rise from roughly 0 to 10 percent at baseline to roughly 2 to 18 percent at end of study.

Each colored line represents 1 clinic, with the colors matching for each clinic in A and B.

HPV vaccination did not differ between clinician training and text messaging assignment groups even when applying a variance correlation factor (Table 2; eTable 3 in Supplement 2). Compared with deferred trainings, we found no differences in HPV vaccination rates among clinics assigned to trainings when considered separately (focused or bundled) or together (focused and bundled). Similarly, compared with no text messages, we found no differences in HPV vaccination rates among children whose parents were assigned to text messages when considered separately (focused or bundled) or together (focused and bundled).

Table 2. Postintervention Effectiveness of Implementation Strategies on HPV Vaccine Initiation and Completion Rates Among Patients Aged 10 to 12 Years.

Outcome Unvaccinated patients by randomization group
Clinician training groups Text messaging groups
Focused (n = 1825) Bundled (n = 2324) Deferred (n = 2349) Focused (n = 2165) Bundled (n = 2121) None (n = 2212)
Initiation
HPV vaccine initiation rate (95% CI), % 44.2 (39.0-50.2) 45.6 (38.9-53.4) 48.8 (40.4-58.9) 46.6 (42.2-51.6) 45.8 (41.5-50.4) 46.0 (41.6-50.9)
Risk ratio (95% CI), adjusted for clinic clustering 0.91 (0.72-1.14) 0.94 (0.73-1.20) 1 [Reference] 1.01 (0.95-1.08) 0.99 (0.94-1.05) 1 [Reference]
Risk ratio (95% CI), additionally adjusted for group assignment and stratification measuresa 0.92 (0.77-1.11) 0.97 (0.81-1.17) 1 [Reference] 1.01 (0.95-1.08) 0.99 (0.94-1.05) 1 [Reference]
Completion
HPV vaccine up to date rate (95% CI), % 7.8 (5.1-11.9) 8.7 (5.5-13.7) 13.0 (7.3-23.1) 10.3 (7.6-13.8) 9.9 (7.1-13.9) 9.1 (6.3-13.0)
Risk ratio (95% CI), adjusted for clinic clustering 0.60 (0.29-1.23) 0.67 (0.32-1.39) 1 [Reference] 1.13 (0.91-1.40) 1.09 (0.93-1.28) 1 [Reference]
Risk ratio (95% CI), additionally adjusted for group assignment and stratification measuresa 0.52 (0.28-0.95) 0.58 (0.31-1.09) 1 [Reference] 1.13 (0.92-1.40) 1.09 (0.94-1.27) 1 [Reference]

Abbreviation: HPV, human papillomavirus.

a

Clinician training groups adjusted for baseline vaccination rates and text messaging groups adjusted for patient sex.

We found limited differences in our predetermined, exploratory analyses of intervention combinations. First, we did not find differences in HPV vaccination comparing multiple interventions vs 1 intervention. For example, for initiation, the RR for multiple interventions to clinician training was 0.99 (95% CI, 0.93-1.05), and the RR for multiple interventions to text messages was 1.09 (95% CI, 0.87-1.36). Second, compared with concordant approaches, distinct approaches to clinician training and parent text messaging increased HPV completion (RR, 1.35; 95% CI, 1.07-1.71) but were not different for initiation (RR, 1.07; 95% CI, 0.98-1.16). Third, when examining specific intervention combinations, all were similar except one combination for completion. Completion rates were higher among children whose clinicians were trained in the focused approach and whose parents received bundled rather than focused text messages (RR, 1.47; 95% CI, 1.13-2.08).

In our post hoc analysis adjusted for clinic clustering, the RR for text message receipt vs not for initiation was 1.17 (95% CI, 1.08-1.26) and completion was 1.29 (95% CI, 1.06-1.56). Increased number of text messages received was associated with higher initiation and completion rates (Figure 3). For initiation, compared with no text messages, the RR for 1 text message was 1.09 (95% CI, 1.00-1.18), and for 2 or more text messages, it was 1.43 (95% CI, 1.29-1.59). For completion, compared with no text messages, the RR for 2 or more text messages was 1.95 (95% CI, 1.47-2.60). Results were similar when adjusting for clinician training group, clinic baseline vaccination rate, and baseline patient demographic characteristics.

Figure 3. Bar Chart of Human Papillomavirus (HPV) Vaccine Initiation (First Dose) and Completion (Second Dose) by Number of Text Messages Parents Received.

Bar chart of HPV vaccine dose percentages by number of text messages received. Single-panel grouped bar chart with error bars. Vertical axis labeled Unvaccinated adolescents at baseline receiving each H P V vaccine dose, percent, ranging from zero to one hundred with horizontal gridlines at about twenty-unit intervals. Horizontal axis labeled Text messages received, No., with three categories: zero with n equals three thousand two hundred seventy eight, one with n equals two thousand four hundred sixty two, and greater than or equal to two with n equals seven hundred fifty eight. In the upper right, a boxed legend contains two colored swatches: a blue-gray swatch labeled First dose and an orange swatch labeled Second dose. For the zero text message group, the blue-gray first-dose bar reaches about forty three percent with a short black capped error bar spanning roughly forty one to forty five; the orange second-dose bar reaches about ten percent with an error bar spanning roughly nine to eleven. For the one text message group, the blue-gray first-dose bar reaches about forty six percent with an error bar spanning roughly forty four to forty eight; the orange second-dose bar reaches about eleven percent with an error bar spanning roughly ten to twelve. For the greater than or equal to two text message group, the blue-gray first-dose bar reaches about sixty percent with an error bar spanning roughly fifty six to sixty three; the orange second-dose bar reaches about twenty one percent with an error bar spanning roughly eighteen to twenty four. Bars are separated within each group, with first-dose bars consistently taller than second-dose bars across all three message categories.

Error bars indicate 95% CIs.

Effect on Clinician Recommendations

Overall, for the patient-level HPV vaccine recommendation surveys, 50 of 59 clinicians (85%) completed at least 1 with a mean (SD) completion of 11.4 (6.0) surveys per clinician. Regardless of group, clinicians reported recommending the HPV vaccine to nearly all parents of patients aged 11 to 12 years: bundled (mean [SD], 94.7% [5.3]), focused (mean [SD], 89.8% [16.5]), and deferred (mean [SD], 90.6% [15.5]).

Discussion

In this multilevel clustered RCT, HPV vaccine initiation and completion rates among patients aged 10 to 12 years increased over 2 years, with higher vaccination rates associated with those whose parents received text messages. Clinicians self-reported recommending the HPV vaccine for nearly all patients aged 11 to 12 years; yet, we did not find differences in HPV vaccination rates between the clinician communication training groups. Clinics can increase their HPV vaccination rates with evidence-based strategies, and text messages may be particularly effective.

The increases in clinic-level HPV vaccine initiation and completion rates from before to after the study were higher than changes across Florida during the same years (2022 to 2024). Among adolescents aged 13 to 17 years, Florida initiation rates increased 8.6 percentage points (from 75.6% to 84.2%) and completion rates increased 0.1 percentage points (from 58.9% to 59.0%).7,48 Compared with 2 cluster RCTs focused on clinician communication, initiation increases were similar (15 to 19 percentage points); however, while only one considered completion, our completion increases were larger (3.4 to 3.7 percentage points).49,50

Our results bolster prior findings of text messages as an effective intervention for HPV vaccination and extend knowledge by demonstrating larger increases associated with receiving multiple messages.13,14,15,16 Differences in effectiveness of text message assignment and receipt highlight challenges of messaging campaigns in day-to-day pediatric primary care clinics, including errors sending messages and phone number issues (eg, changes in number, intermittent disconnection, inability to receive texts).51,52

Despite high participation rates, clinician acceptability of the training, and previously published evidence of clinicians’ incorporating trained skills into their practices,37 we did not find differences in HPV vaccination between clinician training groups. This contrasts with other studies showing small but meaningful effects of clinician training on HPV vaccination rates.9,20 Furthermore, unlike a prior meta-analysis,9 we did not find that the presumptive strategy within the bundled approach was more effective than a less presumptive focused approach. Our findings may have been weakened by inadvertently creating a separate intervention when regularly prompting clinicians to complete a survey about their HPV vaccine recommendations. However, our results suggest that regularly reminding clinicians about HPV vaccine recommendations may be sufficient.

Strengths and Limitations

This study had 3 important strengths. First, we assessed HPV vaccination using clinical record verification. Second, we had high participation rates, which improved the likelihood of detecting effects. Third, our study observed patients for over 2 years, which is 1.0 to 1.5 years longer than other HPV vaccine intervention studies.18,53

The study had 3 important limitations. First, vaccine records could be missed in the registry if any patients moved out of state or clinics only searched their patient panel but children received their most recent vaccine elsewhere. Second, we were unable to evaluate clinician-level vaccination rates because patients saw multiple clinicians. Differences in clinician adherence to the trainings may have masked differences between groups. Third, clinics in the deferred training group participated in the texting intervention, which necessitated clinic staff to regularly review vaccination and appointment records. This practice possibly elevated the clinic’s awareness of HPV vaccination biasing the clinician training effect toward the null.

Conclusions

In this study of children in Florida aged 10 to 12 years, there were no differences in HPV vaccination rates by assignment for clinician training and text messages; however, we found much larger pre-post clinic level vaccination changes than seen overall in Florida. When received, text messages were associated with increased HPV vaccination, especially for families who received 2 or more messages. This study adds to the evidence that clinics should consider sending multiple text messages to families to increase HPV vaccination among patients aged 10 to 12 years.

Supplement 1.

Trial Protocol

Supplement 2.

eTable 1. Intervention Wording for Each Strategy

eTable 2. Baseline Characteristics of Patients in the Text & Talk Trial by Text Message Intervention Assignment

eTable 3. Postintervention Effectiveness of Implementation Strategies on HPV Vaccine Initiation and Completion Rates Among 10- to 12-Year-Olds With Variance Correction

Supplement 3.

Data Sharing Statement

References

  • 1.Forman D, de Martel C, Lacey CJ, et al. Global burden of human papillomavirus and related diseases. Vaccine. 2012;30(suppl 5):F12-F23. doi: 10.1016/j.vaccine.2012.07.055 [DOI] [PubMed] [Google Scholar]
  • 2.Kjaer SK, Dehlendorff C, Belmonte F, Baandrup L. Real-world effectiveness of human papillomavirus vaccination against cervical cancer. J Natl Cancer Inst. 2021;113(10):1329-1335. doi: 10.1093/jnci/djab080 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Fink H, Langselius O, Vignat J, et al. Global and regional cancer burden attributable to modifiable risk factors to inform prevention. Nat Med. 2026;32(4):1306-1315. doi: 10.1038/s41591-026-04219-7 [DOI] [PubMed] [Google Scholar]
  • 4.Meites E, Szilagyi PG, Chesson HW, Unger ER, Romero JR, Markowitz LE. Human papillomavirus vaccination for adults: updated recommendations of the Advisory Committee on Immunization Practices. MMWR Morb Mortal Wkly Rep. 2019;68(32):698-702. doi: 10.15585/mmwr.mm6832a3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Centers for Disease Control and Prevention (CDC) . Recommendations on the use of quadrivalent human papillomavirus vaccine in males—Advisory Committee on Immunization Practices (ACIP), 2011. MMWR Morb Mortal Wkly Rep. 2011;60(50):1705-1708. [PubMed] [Google Scholar]
  • 6.Office of Disease Prevention and Health Promotion (ODPHP) . Increase the proportion of adolescents who get recommended doses of the HPV vaccine—IID-08. Healthy People 2030. Accessed October 7, 2026. https://odphp.health.gov/healthypeople/objectives-and-data/browse-objectives/vaccination/increase-proportion-adolescents-who-get-recommended-doses-hpv-vaccine-iid-08
  • 7.Pingali C, Yankey D, Elam-Evans LD, et al. Vaccination coverage among adolescents aged 13-17 years—National Immunization Survey-Teen, United States, 2024. MMWR Morb Mortal Wkly Rep. 2025;74(30):466-472. doi: 10.15585/mmwr.mm7430a1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.American Cancer Society; National HPV Vaccination Roundtable . Cancer prevention through HPV vaccination: an action guide for large health systems. Accessed March 25, 2026. https://hpvroundtable.org/wp-content/uploads/2024/10/Cancer-Prevention-Through-HPV-Vaccination-An-Action-Guide-for-Large-Health-Systems.pdf
  • 9.Chandeying N, Thongseiratch T. Clinician communication training to increase human papillomavirus vaccination uptake: a systematic review and meta-analysis. Vaccines (Basel). 2024;12(6):611. doi: 10.3390/vaccines12060611 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Matheson EC, Derouin A, Gagliano M, Thompson JA, Blood-Siegfried J. Increasing HPV vaccination series completion rates via text message reminders. J Pediatr Health Care. 2014;28(4):e35-e39. doi: 10.1016/j.pedhc.2013.09.001 [DOI] [PubMed] [Google Scholar]
  • 11.Rand CM, Vincelli P, Goldstein NPN, Blumkin A, Szilagyi PG. Effects of phone and text message reminders on completion of the human papillomavirus vaccine series. J Adolesc Health. 2017;60(1):113-119. doi: 10.1016/j.jadohealth.2016.09.011 [DOI] [PubMed] [Google Scholar]
  • 12.O’Leary ST, Lee M, Lockhart S, et al. Effectiveness and cost of bidirectional text messaging for adolescent vaccines and well care. Pediatrics. 2015;136(5):e1220-e1227. doi: 10.1542/peds.2015-1089 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Francis DB, Cates JR, Wagner KPG, Zola T, Fitter JE, Coyne-Beasley T. Communication technologies to improve HPV vaccination initiation and completion: a systematic review. Patient Educ Couns. 2017;100(7):1280-1286. doi: 10.1016/j.pec.2017.02.004 [DOI] [PubMed] [Google Scholar]
  • 14.Chandeying N, Thongseiratch T. Systematic review and meta-analysis comparing educational and reminder digital interventions for promoting HPV vaccination uptake. NPJ Digit Med. 2023;6(1):162. doi: 10.1038/s41746-023-00912-w [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Currie GE, McLeod C, Waddington C, Snelling TL. SMS-based interventions for improving child and adolescent vaccine coverage and timeliness: a systematic review. BMC Public Health. 2024;24(1):1753. doi: 10.1186/s12889-024-18900-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Louw GE, Hohlfeld AS, Kalan R, Engel ME. Mobile phone text message reminders to improve vaccination uptake: a systematic review and meta-analysis. Vaccines (Basel). 2024;12(10):1151. doi: 10.3390/vaccines12101151 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Community Preventive Services Task Force . Vaccination programs: health care system-based interventions implemented in combination. The Community Guide. Accessed March 23, 2026. https://www.thecommunityguide.org/findings/vaccination-programs-health-care-system-based-interventions-implemented-combination.html
  • 18.Escoffery C, Petagna C, Agnone C, et al. A systematic review of interventions to promote HPV vaccination globally. BMC Public Health. 2023;23(1):1262. doi: 10.1186/s12889-023-15876-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.US Centers for Disease Control and Prevention (CDC) . Human Papillomavirus (HPV). Five ways to boost vaccination rates. Accessed March 23, 2026. https://www.cdc.gov/hpv/hcp/vaccination-considerations/boost-rates.html#:~:text=Bundle%20your%20recommendation%20for%20all,any%20questions%20about%20these%20vaccines?%E2%80%9D
  • 20.Brewer NT, Hall ME, Malo TL, Gilkey MB, Quinn B, Lathren C. Announcements versus conversations to improve HPV vaccination coverage: a randomized trial. Pediatrics. 2017;139(1):e20161764. doi: 10.1542/peds.2016-1764 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.US Department of Health and Human Services, National Institutes of Health, National Cancer Institute . HPV vaccination for cancer prevention: progress, opportunities, and a renewed call to action. Accessed October 15, 2026. https://prescancerpanel.cancer.gov/reports-meetings/hpv-vaccination-cancer-prevention-report-2018
  • 22.American Academy of Pediatrics . Immunizations: human papillomavirus vaccines—how pediatricians can recommend HPV vaccination to parents and caregivers. Updated October 15, 2025. Accessed March 23, 2026. https://www.aap.org/en/patient-care/immunizations/human-papillomavirus-vaccines/how-to-recommend-hpv-vaccination/
  • 23.Staras SAS, Bylund CL, Mullis MD, et al. Messaging preferences among Florida caregivers participating in focus groups who had not yet accepted the HPV vaccine for their 11- to 12-year-old child. BMC Public Health. 2022;22(1):2413. doi: 10.1186/s12889-022-14852-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Bylund CL, Thompson LA, Hansen M, Staras SAS. A pilot test of a workshop for pediatric clinicians about communicating with parents about the HPV vaccine using the C-LEAR Approach. J Cancer Educ. 2023;38(3):798-804. doi: 10.1007/s13187-022-02188-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Montaño DE, Kasprzyk D. Theory of reasoned action, theory of planned behavior, and the integrated behavioral model. In: Glanz K, Rimer BK, Viswanath K, eds. Health Behavior: Theory, Research, and Practice. 5th ed. Jossey-Bass; 2015:95-124. [Google Scholar]
  • 26.Brown CH, Curran G, Palinkas LA, et al. An overview of research and evaluation designs for dissemination and implementation. Annu Rev Public Health. 2017;38:1-22. doi: 10.1146/annurev-publhealth-031816-044215 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Pingali C, Yankey D, Elam-Evans LD, et al. National vaccination coverage among adolescents aged 13-17 years—National Immunization Survey-Teen, United States, 2021. MMWR Morb Mortal Wkly Rep. 2022;71(35):1101-1108. doi: 10.15585/mmwr.mm7135a1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Collins FS, Hudson KL, Briggs JP, Lauer MS. PCORnet: turning a dream into reality. J Am Med Inform Assoc. 2014;21(4):576-577. doi: 10.1136/amiajnl-2014-002864 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.US Centers for Disease Control and Prevention (CDC) . Immunization quality improvement for providers (IQIP). Accessed March 25, 2026. https://www.cdc.gov/iqip/php/about-for-providers/index.html
  • 30.Shenkman E, Hurt M, Hogan W, et al. OneFlorida Clinical Research Consortium: linking a clinical and translational science institute with a community-based distributive medical education model. Acad Med. 2018;93(3):451-455. doi: 10.1097/ACM.0000000000002029 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.The American Board of Pediatrics . The four parts of maintenance of certification (MOC). Updated March 5, 2026. Accessed March 25, 2026. https://www.abp.org/content/four-parts-moc
  • 32.Office of Management and Budget . Revisions to the standards for the classification of federal data on race and ethnicity. Fed Regist. 1997;62(210):58782-58790. [Google Scholar]
  • 33.Szilagyi PG, Humiston SG, Gallivan S, Albertin C, Sandler M, Blumkin A. Effectiveness of a citywide patient immunization navigator program on improving adolescent immunizations and preventive care visit rates. Arch Pediatr Adolesc Med. 2011;165(6):547-553. doi: 10.1001/archpediatrics.2011.73 [DOI] [PubMed] [Google Scholar]
  • 34.Spencer JC, Calo WA, Brewer NT. Disparities and reverse disparities in HPV vaccination: a systematic review and meta-analysis. Prev Med. 2019;123:197-203. doi: 10.1016/j.ypmed.2019.03.037 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Khalil GE, Fisher CL, Chi X, et al. The role of personal social networks in parental decision-making for HPV vaccination: examining support and norms among Florida parents. Vaccines (Basel). 2025;13(7):667. doi: 10.3390/vaccines13070667 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Florida Department of Health . Florida SHOTS: Florida statewide immunization information system. Accessed August 26, 2026. https://flshotsusers.com/
  • 37.Bylund CL, Thompson LA, Hansen MD, et al. Human papillomavirus vaccine communication skills intervention for pediatric primary care clinicians: evaluation of the C-LEAR training on clinicians’ behavior. J Pediatr Clin Pract. 2026;21:200221. doi: 10.1016/j.jpedcp.2026.200221 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Bylund CL, Brown RF, Lubrano di Ciccone B, Diamond C, Eddington J, Kissane DW. Assessing facilitator competence in a comprehensive communication skills training programme. Med Educ. 2009;43(4):342-349. doi: 10.1111/j.1365-2923.2009.03302.x [DOI] [PubMed] [Google Scholar]
  • 39.Meites E, Kempe A, Markowitz LE. Use of a 2-Dose schedule for human papillomavirus vaccination—updated recommendations of the Advisory Committee on Immunization Practices. MMWR Morb Mortal Wkly Rep. 2016;65(49):1405-1408. doi: 10.15585/mmwr.mm6549a5 [DOI] [PubMed] [Google Scholar]
  • 40.Liu G, Kong L, Du P. HPV vaccine completion and dose adherence among commercially insured females aged 9 through 26 years in the US. Papillomavirus Res. 2016;2:1-8. doi: 10.1016/j.pvr.2015.10.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Price-Haywood EG, Harden-Barrios J, Cooper LA. Comparative effectiveness of audit-feedback versus additional physician communication training to improve cancer screening for patients with limited health literacy. J Gen Intern Med. 2014;29(8):1113-1121. doi: 10.1007/s11606-014-2782-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Tiro JA, Pruitt SL, Bruce CM, et al. Multilevel correlates for human papillomavirus vaccination of adolescent girls attending safety net clinics. Vaccine. 2012;30(13):2368-2375. doi: 10.1016/j.vaccine.2011.11.031 [DOI] [PubMed] [Google Scholar]
  • 43.Murray DM, Varnell SP, Blitstein JL. Design and analysis of group-randomized trials: a review of recent methodological developments. Am J Public Health. 2004;94(3):423-432. doi: 10.2105/AJPH.94.3.423 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Turner EL, Prague M, Gallis JA, Li F, Murray DM. Review of recent methodological developments in group-randomized trials: part 2-analysis. Am J Public Health. 2017;107(7):1078-1086. doi: 10.2105/AJPH.2017.303707 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Højsgaard S, Halekoh U, Yan J. The R package geepack for Generalized Estimating Equations. J Stat Soft. 2005;15(2):1-11. doi: 10.18637/jss.v015.i02 [DOI] [Google Scholar]
  • 46.Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc B. 1995;57(1):289-300. doi: 10.1111/j.2517-6161.1995.tb02031.x [DOI] [Google Scholar]
  • 47.American Association for Public Opinion Research . Standard definitions: final dispositions of case codes and outcome rates for surveys (10th ed). Accessed March 25, 2026. https://aapor.org/wp-content/uploads/2023/05/Standards-Definitions-10th-edition.pdf
  • 48.Pingali C, Yankey D, Elam-Evans LD, et al. Vaccination coverage among adolescents aged 13–17 years—National Immunization Survey–Teen, United States. MMWR Morb Mortal Wkly Rep. 2023;72(34):912-919. doi: 10.15585/mmwr.mm7234a3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Gilkey MB, Heisler-MacKinnon J, Boynton MH, Calo WA, Moss JL, Brewer NT. Impact of brief quality improvement coaching on adolescent HPV vaccination coverage: a pragmatic cluster randomized trial. Cancer Epidemiol Biomarkers Prev. 2023;32(7):957-962. doi: 10.1158/1055-9965.EPI-22-0866 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Gilkey MB, Grabert BK, Heisler-MacKinnon J, et al. Coaching and communication training for HPV vaccination: a cluster randomized trial. Pediatrics. 2022;150(2):e2021052351. doi: 10.1542/peds.2021-052351 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Gonzales AL. Health benefits and barriers to cell phone use in low-income urban U.S. neighborhoods: indications of technology maintenance. Mob Media Commun. 2014;2(3):233-248. doi: 10.1177/2050157914530297 [DOI] [Google Scholar]
  • 52.Blumberg SJ, Luke JV. Wireless substitution: early release of estimates from the National Health Interview Survey, July-December 2023. National Center For Health Statistics. June 2024. Accessed March 25, 2026. https://www.cdc.gov/nchs/data/nhis/earlyrelease/wireless202406.pdf
  • 53.Mavundza EJ, Iwu-Jaja CJ, Wiyeh AB, et al. A systematic review of interventions to improve HPV vaccination coverage. Vaccines (Basel). 2021;9(7):687. doi: 10.3390/vaccines9070687 [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplement 1.

Trial Protocol

Supplement 2.

eTable 1. Intervention Wording for Each Strategy

eTable 2. Baseline Characteristics of Patients in the Text & Talk Trial by Text Message Intervention Assignment

eTable 3. Postintervention Effectiveness of Implementation Strategies on HPV Vaccine Initiation and Completion Rates Among 10- to 12-Year-Olds With Variance Correction

Supplement 3.

Data Sharing Statement


Articles from JAMA Network Open are provided here courtesy of American Medical Association

RESOURCES