Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2023 Jan 1.
Published in final edited form as: Prev Med. 2021 Nov 17;154:106896. doi: 10.1016/j.ypmed.2021.106896

Does Mailing Unsolicited HPV Self-Sampling Kits to Women Overdue for Cervical Cancer Screening Impact Uptake of Other Preventive Health Services in a United States Integrated Delivery System?

Hitomi Kariya 1, Diana S M Buist 1,2,3, Melissa L Anderson 3, John Lin 2, Hongyuan Gao 3, Linda K Ko 1,4, Rachel L Winer 2,3
PMCID: PMC8724401  NIHMSID: NIHMS1759887  PMID: 34800474

Abstract

Women overdue for cervical cancer screening often have other preventive care gaps. We examined whether mailing unsolicited human papillomavirus (HPV) self-sampling kits to increase cervical cancer screening impacted receipt of other preventive services women were due for: mammography, colorectal cancer (CRC) screening, influenza vaccination, depression screening, and diabetic HbA1c monitoring. From 2014–2016, 16,590 underscreened women were randomized to receive a mailed kit or usual care Pap reminders within Kaiser Permanente Washington. We used logistic regression to estimate odds ratios (ORs) of preventive services receipt within 12-months between the intervention vs. control arms, and within the intervention arm (comparing those returning a kit vs. attending Pap vs. nothing), adjusting models for demographic variables. There were no significant between-arm differences in uptake of any of the preventive services: intervention vs. control: mammography OR=1.01 (95% confidence interval:0.88–1.17), CRC screening OR=0.98 (0.86–1.13), influenza vaccination OR=0.99 (0.92–1.06), depression screening OR=1.07 (0.99–1.16), HbA1c OR=0.84 (0.62–1.13). Within the intervention arm, preventive services uptake was higher in women who completed cervical cancer screening vs. did not, with stronger effects for women who attended Pap: Pap vs. nothing: mammography OR=11.81 (8.11–17.19), CRC screening OR=7.31 (5.57–9.58), influenza vaccination OR=2.06 (1.82–2.32), depression screening OR=1.79 (1.57–2.05), HbA1c OR=3.35 (1.49–7.52); kit vs. nothing: mammography OR=2.26 (1.56–3.26), CRC screening OR=5.05 (3.57–7.14), influenza vaccination OR=1.67 (1.41–1.98), depression screening OR=1.09 (0.89–1.33), HbA1c OR=1.23 (0.57–2.65). Mailing HPV self-sampling kits to underscreened women did not negatively impact uptake of other preventive services. However, overall preventive service uptake was the highest among women who attended in-clinic cervical cancer screening.

Keywords: human papillomavirus, cervical cancer, cancer screening, self-testing, preventive health services

INTRODUCTION

Most cervical cancers are preventable with human papillomavirus (HPV) vaccination and screening.13 In the U.S., cervical cancer mortality has significantly declined through routine screening,4 yet approximately 1 in 4 people with a cervix (henceforth referred to as women) remain underscreened (overdue for guideline-recommended routine screening or never screened).5,6 More than 50% of cervical cancers diagnosed occur in underscreened women.79 Despite the availability of effective HPV vaccines, screening remains critical for cervical cancer prevention because HPV vaccination uptake is suboptimal in the U.S.10 and vaccines do not protect against all cancer-causing HPV types.

Previous studies suggested multiple barriers to screening uptake including lack of time or transportation, difficulties finding childcare or taking time off work, fear of pelvic exams, and prior negative experiences with screening.7,1115 Non-clinic-based HPV kits could address these well-known barriers to cervical cancer screening. Previous studies demonstrated that non-clinic-based HPV kits increase cervical cancer screening participation, particularly in hard-to-reach populations.16 However, one concern about offering non-clinic-based screening is that women who are underscreened for cervical cancer often have other important preventive care gaps,17,18 and removing in-clinic visits could result in greater care gaps for other preventive health services, as attending in-clinic screening offers opportunities for interaction with healthcare providers. While women underscreened for cervical cancer are less likely to be engaged in other preventive care, a significant portion attend in-clinic visits with primary care providers. For example, we previously observed that one-third of 30–64-year-old women at Kaiser Permanente Washington (KPWA) (a U.S. integrated healthcare delivery system) who were overdue for cervical cancer screening had an in-clinic visit with a primary care provider within the prior year.19

We are unaware of studies that have evaluated whether non-clinic-based cancer screening modalities, such as fecal immunochemical test (FIT) kits for colorectal cancer (CRC) screening or HPV kits for cervical cancer screening, positively or negatively influence receipt of other recommended preventive services. Offering non-clinic-based screening could activate individuals to engage in other preventive services. For example, completing non-clinic-based screening may motivate individuals to adhere to other recommended preventive services. Furthermore, individuals who participate in non-clinic-based screening may have opportunities to receive other preventive services if they need to attend in-clinic follow-up after a positive result. On the other hand, unlike onsite health screening, non-clinic-based screening may reduce opportunities for individuals to attend other preventive services by removing the in-person visit in some cases.

To address this question, we used data from Home-based Options to Make cervical cancer screening Easy (HOME), a pragmatic randomized controlled trial of mailed HPV self-sampling kits in 30–64-year-old women who were overdue for cervical cancer screening within Kaiser Permanente Washington (KPWA), a U.S. integrated healthcare delivery system.20 We selected five preventive services that are routinely recommended for all 30–64-year-old women or a subset based on age or health status and are included in KPWA’s annual preventive services reminders birthday letter.21,22 These five preventive services are part of Healthcare Effectiveness Data and Information Set (HEDIS) quality metrics,6,23,24 and are often offered opportunistically during clinic visits: 1) mammography; 2) CRC screening; 3) influenza vaccination; 4) depression screening; and 5) hemoglobin A1c (HbA1c) testing for monitoring diabetes. We compared preventive services uptake over 12 months in women randomized to receive the self-testing kit versus usual care Papanicolaou (Pap) reminders. Additionally, we evaluated preventive services uptake among women in the intervention arm by their cervical cancer screening behavior: a) women who returned a kit but did not attend in-person Pap screening; b) women who attended in-person Pap screening regardless of returning a kit; and c) women who did not use a kit and did not attend Pap screening.20

METHODS

We conducted a secondary analysis of data from the HOME trial.20 The HOME trial was designed to compare cervical cancer screening uptake and detection and treatment of cervical pre-cancers between two different strategies: 1) usual care Pap screening reminders plus adding a mailed HPV self-sampling kit (intervention group); and 2) usual care Pap screening reminders only (control group).20 The HOME trial demonstrated that mailing HPV self-sampling kits to underscreened women increased cervical cancer screening uptake.25

The trial randomized 16,590 women who: 1) were aged 30–64 years, 2) had not had a hysterectomy, 3) had a primary care provider within KPWA’s integrated delivery system, 4) had been continuously enrolled in KPWA for at least 3 years and 5 months, and 5) had not had a Pap test within 3 years and 5 months.20 Women became eligible 5 months after receiving an annual preventive care birthday letter reminder indicating they were due or overdue for their Pap screening (no Pap test within the prior 3 years).20 We allowed 5 months after women received their birthday letter reminders to ensure that our recruitment did not interfere with usual Pap screening outreach strategies.20 Eligible women were identified using electronic medical record (EMR) data and enrolled under a waiver of informed consent. The trial was approved by KPWA and University of Washington institutional review boards.

The control arm received KPWA’s usual care outreach, which includes an annual birthday letter with tailored recommendations and reminders for preventive care based on when they are due for services that are specific to their age and previous preventive services receipt; all women in the trial were reminded they were overdue for cervical cancer screening.20 Additionally, there were clinician-targeted automatic alerts for preventive services, centralized outreach to inform women of care gaps and primary care outreach to bring in individuals who have care gaps, and opportunistic preventive care.20,22 Women randomized to the intervention group received the same usual care outreach as the control arm and a mailed HPV self-sampling kit 5 months following their birthday letter, research information sheet, educational materials on how to self-collect and return a sample, and a prepaid return envelope addressed to the KPWA clinical laboratory.20 The letter advised women to attend routine Pap screening regardless of whether they chose to complete the HPV self-sampling kit because HPV self-screening is not standard of care in the U.S. Kit use and Pap screening uptake was captured within six months after randomization from their EMR.

Women who received a recent Pap test prior to randomization or disenrolled from KPWA close to randomization were retroactively excluded from HOME analyses (n = 359). For the analysis of other preventive services uptake, we additionally excluded women who opted out of EMR review (n = 96), and women who died or disenrolled from KPWA during the 12-month follow-up period (n = 1917), leaving 14,218 women who were enrolled for at least 12-months after randomization. We compared uptake of the five preventive services by randomization arm, and by cervical cancer screening behavior within the intervention arm: a) women who returned a kit but did not attend Pap screening; b) women who attended Pap screening regardless of returning a kit; and c) women who did nothing.

We used EMR data to identify the first receipt of each preventive service within 12 months after randomization. Uptake of HbA1c testing was restricted to women with diabetes (n=1,036). For uptake of mammography and CRC screening, we used HEDIS definitions.23,24 Mammography analyses were restricted to women who were between the ages of 52–64 years and not considered up-to-date per HEDIS at randomization (n=3,500).23 Women were due for mammography if they had not had a mammogram to screen for breast cancer in the past two years. CRC screening analyses were restricted to women who were between the ages of 51–64 years and not up-to-date per HEDIS at randomization (n=4,482).24 Women were due for CRC screening if they had not had a fecal occult blood test (FOBT) in the past year, a FIT test in the past 3 years, flexible sigmoidoscopy or computed tomography colonography in the past 5 years, or a colonoscopy in the past 10 years.24 There were no restrictions for influenza vaccination uptake or depression screening, as these services are recommended annually for all adults.

Our data were analyzed in aggregate due to human subjects restrictions on obtaining individual level data for HOME trial intervention arm women who did not return the home-based HPV kit.20 Observations were at the level of the individual participant, with the woman as the unit of analysis, using frequency weighting in regression models. We fit a univariate logistic regression model for each exposure (randomization arm, or screening behavior subgroup within the intervention arm) and preventive service outcome (10 models total). The dependent variable was defined as a binary indicator of whether the health service was completed during the 12-month follow-up period. The independent variable of interest was defined as a binary indicator of randomization group, or three-level indicator of screening behavior within the intervention arm. Models estimated odds ratios (OR) and 95% confidence intervals (CI) for associations between using the preventive health services and either randomization arm or intervention subgroups. Statistical significance was defined as p-value <0.05 based on two-sided tests.

For between randomization arm comparisons, we fit unadjusted models, and models that adjusted for covariates that were unbalanced between arms (chi-square test p-value <0.05). We considered the following demographic covariates extracted from the EMR, measured at randomization: age (30–39, 40–49, 50–59, 60–64); race (White, Asian or Native Hawaiian or Other Pacific Islander, Black or African American, other, or unknown); ethnicity (Non-Hispanic, Hispanic, or unknown); length of health plan enrollment before randomization (≥3.4 to <5 years, ≥5 to <10 years, or ≥10 years); time since last Pap test (attended Pap screening in the past >3.4 to 5 years, attended Pap screening in the past ≥5 to <10 years, attended Pap screening ≥10 years ago, or no recorded Pap test); women’s U.S. Census block median household income26 (<$49,999, ≥$50,000 to ≤$74,999, ≥$75,000 to ≤$99,999, ≥$100,000, or unknown); travel time from women’s home to primary care clinic (<10 minutes, ≥10 to <20 minutes, ≥20 to <30 minutes, ≥30 minutes, or unknown); body mass index (BMI) (<24.9, ≥25 to ≤29.9, ≥30 to ≤34.9, ≥35 to ≤39.9, ≥40, or unknown); tobacco use (never, current, former, or unknown); Charlson Comorbidity Index27 (0, 1, 2, or ≥3); and randomization year.

For within-intervention arm comparisons, we adjusted for covariates that changed OR estimates by 10% or more when they were added individually to models.28 The categorizations of some covariates were different from those used for between-arm comparisons, as aggregate data restrictions precluded cell sizes less than five: race (White or Non-White); enrollment length (≥3.4 to <10 years or ≥10 years); time since last Pap test (attended Pap screening more than 3.4 years ago or no recorded Pap test); and Charlson Comorbidity Index27 (0, 1, or ≥2). Additionally, we were unable to assess potential confounding by ethnicity, BMI, tobacco use, and travel time from women’s home to primary care clinic due to the aggregate data restrictions on cell sizes less than five. All remaining potential confounders were assessed for influenza vaccination and depression screening. All covariates except for ethnicity, median household income, BMI, tobacco use, Charlson Comorbidity Index, and travel time were assessed for mammography. For CRC screening, all covariates except for ethnicity, BMI, tobacco use, Charlson Comorbidity Index, and travel time were assessed. We could not assess any potential confounders for HbA1c testing.

RESULTS

For influenza vaccination, depression screening, and HbA1c testing, regression analyses comparing randomization arm were adjusted for enrollment duration; all other covariates were balanced within the populations eligible for each of the five preventive services (Table 1).

Table 1:

Demographic Characteristics of Control and Intervention Group Participants by Preventive Health Services Eligibility

Mammography (n=3500)a CRC screening (n=4482)b Influenza vaccination (n=14,218)c Depression screening (n=14,218)c HbA1c testing (n=1036)d

Characteristice Control (n=1752)% Intervention (n=1748)% Control (n=2293)% Interve ntion (n=218 9)% Control (n=7135)% Intervention (n=7083)% Control (n=7135)% Intervention (n=7083)% Control (n=522)% Intervention (n=514)%
Age at randomization, y
 30–39 - - - - 17.2 17.6 17.2 17.6 7.3 4.7
 40–49 - - - - 25.8 26.4 25.8 26.4 16.3 18.3
 50–59 63.4 65.6 66.8 68.7 37.3 37.0 37.3 37.0 43.3 45.1
 60–64 36.6 34.4 33.2 31.3 19.7 19.0 19.7 19.0 33.1 31.9
Race
 White 72.4 72.2 74.1 74.5 72.6 72.1 72.6 72.1 66.1 67.7
 Asian or Native Hawaiian or other Pacific Islander 9.4 8.3 9.3 7.9 10.5 10.5 10.5 10.5 13.0 11.7
 Black or African
 American 4.6 4.3 4.2 3.7 4.3 4.6 4.3 4.6 5.0 6.6
 Other 5.6 6.5 5.7 6.8 6.6 7.3 6.6 7.3 11.5 10.3
 Unknown 8.0 8.7 6.7 7.1 6.0 5.5 6.0 5.5 4.4 3.7
Ethnicity
 Non-Hispanic 87.8 87.6 89.3 88.8 89.2 89.6 89.2 89.6 86.8 91.2
 Hispanic 4.6 4.3 4.6 4.6 5.0 5.0 5.0 5.0 8.8 5.3
 Unknown 7.6 8.1 6.1 6.6 5.8 5.4 5.8 5.4 4.4 3.5
Length of health plan enrollment before randomization, y f
 3.4 to < 5 20.6 22.6 21.4 23.6 23.9 23.9 23.9 23.9 27.2 19.8
 5 to < 10 23.7 25.2 23.1 24.4 28.5 30.4 28.5 30.4 20.9 25.3
 ≥ 10 55.7 52.2 55.5 52.0 47.6 45.7 47.6 45.7 51.9 54.9
Time since last Pap test (by length of enrollment), y
Enrolled 3.4 to < 5
  No Pap test 79.7 76.0 76.0 72.3 67.5 65.8 67.5 65.8 68.3 70.6
  > 3.4 to < 5 20.3 24.1 24.0 27.7 32.5 34.2 32.5 34.2 31.7 29.4
Enrolled 5 to < 10
  No Pap test 47.1 46.0 45.7 42.7 28.7 29.7 28.7 29.7 28.4 30.8
  > 3.4 to < 5 37.0 39.2 40.4 45.9 58.1 57.0 58.1 57.0 56.0 53.1
  5 to < 10 15.9 14.7 14.0 11.4 13.1 13.3 13.1 13.3 15.6 16.2
Enrolled ≥ 10
  No Pap test 20.7 20.6 18.2 19.1 12.3 12.6 12.3 12.6 11.4 12.8
  > 3.4 to < 5 37.9 39.8 43.8 45.8 58.2 59.2 58.2 59.2 57.2 56.0
  5 to < 10 26.1 24.5 23.9 22.4 20.5 19.9 20.5 19.9 18.8 20.9
  ≥ 10 15.3 15.1 14.2 12.7 9.0 8.3 9.0 8.3 12.6 10.3
Women’s census block: Median Household Income, $
 < 49,999 22.4 22.8 22.6 22.8 22.2 22.5 22.2 22.5 27.0 29.0
 50,000–74,999 35.0 33.8 33.8 33.3 34.7 34.9 34.7 34.9 39.8 39.1
 75,000–99,999 23.7 23.6 23.7 23.7 25.3 24.7 25.3 24.7 18.2 18.1
 ≥ 100,000 9.6 11.0 11.1 11.3 10.4 10.5 10.4 10.5 6.9 6.8
 Unknown 9.2 8.9 8.7 9.0 7.4 7.3 7.4 7.3 8.0 7.0
Travel time from women’s home to primary Journal Pre-proof care clinic, min g
 < 10 33.7 32.4 33.5 32.7 32.5 32.9 32.5 32.9 34.5 NA
 10 – < 20 40.1 43.5 39.5 41.9 41.3 41.9 41.3 41.9 38.9 NA
 20 – < 30 14.4 13.8 15.0 13.9 14.4 14.3 14.4 14.3 13.4 NA
 ≥ 30 10.2 9.3 10.5 10.5 10.8 10.0 10.8 10.0 11.7 NA
 Unknown 1.7 0.9 1.5 1.0 1.1 0.8 1.1 0.8 1.5 NA
BMI, kg/m 2 h
 < 24.9 19.9 22.2 21.0 22.8 24.3 24.8 24.3 24.8 7.7 10.3
 25 – 29.9 21.9 20.3 23.0 20.6 22.9 22.6 22.9 22.6 16.7 15.8
 30 – 34.9 15.4 16.3 15.8 16.4 16.7 16.2 16.7 16.2 22.6 17.7
 35 – 39.9 10.5 9.8 10.5 11.2 10.9 11.4 10.9 11.4 21.1 19.3
 ≥ 40 10.1 10.3 10.6 11.6 11.9 12.9 11.9 12.9 29.9 33.3
 Unknown 22.2 21.1 19.1 17.4 13.3 12.1 13.3 12.1 2.1 3.7
Tobacco use
 Never 45.8 43.2 49.2 46.5 54.0 54.2 54.0 54.2 55.7 50.2
 Current 14.6 17.0 13.9 15.6 12.6 12.6 12.6 12.6 13.6 15.4
 Former 19.1 20.1 19.3 20.7 20.8 21.4 20.8 21.4 28.5 31.1
 Unknown 20.4 19.6 17.6 17.2 12.7 11.8 12.7 11.8 2.1 3.3
Charlson Comorbidity Index score 27
 0 82.8 80.7 81.3 81.0 81.1 81.0 81.1 81.0 5.9 7.2
 1 9.1 11.4 10.4 11.3 11.6 11.1 11.6 11.1 39.5 36.2
 2 4.3 4.4 4.7 4.5 4.0 4.4 4.0 4.4 26.8 30.2
 3+ 3.8 3.5 3.6 3.2 3.3 3.5 3.3 3.5 27.8 26.5
Randomization year
 2014 63.4 62.0 58.6 58.2 52.3 52.5 52.3 52.5 57.1 55.8
 2015 24.9 25.6 28.7 28.1 31.0 30.7 31.0 30.7 27.2 26.5
 2016 11.8 12.4 12.7 13.8 16.6 16.8 16.6 16.8 15.7 17.7

Abbreviation: BMI, Body Mass Index.

a

Mammography analyses were restricted to women who were between the ages of 52 and 64 years and not considered up-to-date per HEDIS.23

b

CRC screening analyses were restricted women who were between the ages of 51 and 64 years and not considered up-to-date per HEDIS.24

c

There were no restrictions for influenza vaccination uptake or depression screening, as these services are recommended annually for all adults.

d

Uptake of HbA1c testing was restricted to women with diabetes.

e

Based on electronic medical record data.

f

Chi-square tests indicated significant differences (p-value < 0.05) in length of health plan enrollment between the intervention group and control group for influenza vaccination, depression screening, and HbA1c testing.

g

Distributions of travel time to from women’s home to primary care clinic are not available for participants in the intervention group of HbA1c testing due to cell sizes less than 5.

h

Calculated as weight in kilograms divided by height in meters squared.

In the comparison by randomization arm, preventive services uptake varied by service and ranged from 20.9% for depression screening to 79.9% for HbA1c testing among women who were randomized to the control group, with few differences between the intervention vs. control groups. Overall, no analyses showed significant differences between arms on any preventive services uptake (Table 2).

Table 2:

Odds Ratios (ORs) for Preventive Health Services Receipt by Randomization Arm

Preventive Health Services by Randomized Arms Received preventive health servicea n (%) OR, Unadjusted (95% CI) OR, Adjustedg (95% CI)

Mammography b
 Control (n=1752) 586 (33.4) Ref -
 Intervention (n=1748) 590 (33.8) 1.01 (0.88, 1.17) -
CRC screening c
 Control (n=2293) 544 (23.7) Ref -
 Intervention (n=2189) 512 (23.4) 0.98 (0.86, 1.13) -
Influenza vaccination d
 Control (n=7135) 2422 (33.9) Ref Ref
 Intervention (n=7083) 2377 (33.6) 0.98 (0.92, 1.05) 0.99 (0.92, 1.06)
Depression screening e
 Control (n=7135) 1488 (20.9) Ref Ref
 Intervention (n=7083) 1556 (22.0) 1.07 (0.99, 1.16) 1.07 (0.99, 1.16)
HbA1c testing f
 Control (n=522) 417 (79.9) Ref Ref
 Intervention (n=514) 396 (77.0) 0.85 (0.63, 1.14) 0.84 (0.62, 1.13)
a

Uptake of the preventive health services were assessed in the 12 months after randomization.

b

Mammography analysis was restricted to women ages 52 to 64 years and not considered up-to-date per HEDIS.23

c

CRC analysis was restricted women ages 51 to 64 years and not considered up-to-date per HEDIS.24

d

There was no age restriction for influenza vaccination uptake. Influenza vaccination is recommended annually for all adults.

e

There was no age restriction for depression screening uptake. Depression screening is recommended annually for all adults.

f

There was no age restriction for HbA1c testing, but the analysis was restricted to women with diabetes.

g

Models for influenza vaccination, depression screening, and HbA1c testing were adjusted for length of health plan enrollment prior to randomization (≥3.4 to < 5, ≥ 5 to < 10, or ≥10 years).

In the within-intervention arm comparison, preventive services uptake was higher in women who received cervical cancer screening using a kit or attending Pap screening than in women who did nothing (Table 3). Comparing women who attended Pap screening to women who did nothing, there were significant differences in uptake for all preventive services. All comparisons between women who completed a kit only and women who did nothing were significant, except for depression screening and HbA1c testing. We also compared preventive services uptake among women who attended Pap screening to women who completed the kit only (Table 4). All comparisons were significant, except for HbA1c testing and CRC testing adjusted for time since last Pap.

Table 3:

Preventive Health Services Receipt and Odds Ratios (ORs) for Preventive Health Services Receipt by Intervention Subgroup

Preventive Health Services by Subgroups of Interventiona Received preventive health serviceb n (%) OR, Unadjusted OR, Adjustedc (95% CI)
Mammography d
 Did nothing (n=1424) 379 (26.6) Ref Ref
 Completed the kit only (n=131) 58 (44.3) 2.19 (1.52, 3.15) 2.26 (1.56, 3.26)
 Attended Pap screening (n=193) 153 (79.3) 10.55 (7.30, 15.23) 11.81 (8.11, 17.19)
CRC screening e
 Did nothing (n=1740) 262 (15.1) Ref Ref
 Completed the kit only (n=152) 74 (48.7) 5.35 (3.79, 7.55) 5.05 (3.57, 7.14)
 Attended Pap screening (n=297) 176 (59.3) 8.21 (6.29, 10.71) 7.31 (5.57, 9.58)
Influenza vaccination f
 Did nothing (n=4997) 1455 (29.1) Ref -
 Completed the kit only (n=651) 265 (40.7) 1.67 (1.41, 1.98) -
 Attended Pap screening (n=1435) 657 (45.8) 2.06 (1.82, 2.32) -
Depression screening g
 Did nothing (n=4997) 955 (19.1) Ref Ref
 Completed the kit only (n=651) 141 (21.7) 1.17 (0.96, 1.43) 1.09 (0.89, 1.33)
 Attended Pap screening (n=1435) 460 (32.1) 2.00 (1.75, 2.28) 1.79 (1.57, 2.05)
HbA1c testing h
 Did nothing (n=398) 296 (74.4) Ref -
 Completed the kit only (n=41) 32 (78.0) 1.23 (0.57, 2.65) -
 Attended Pap screening (n=75) 68 (90.7) 3.35 (1.49, 7.52) -
a

Subgroups were defined by cervical cancer screening behavior in the 6 months after randomization.

b

Preventive health services uptake was assessed in the 12 months after randomization.

c

Models were adjusted for demographic, health, or health plan enrollment covariates that changed OR estimates by 10% or more. No adjusted OR are reported for outcomes where no covariate changed the OR by 10% or more.

d

Mammography analysis restricted to women ages 52 to 64 years and not considered up-to-date per HEDIS.23 Adjusted model adjusted for randomization year (2014, 2015 or 2016).

e

CRC screening analysis was restricted to women ages 51 to 64 years and not considered up-to-date per HEDIS.24 Adjusted model adjusted for time since last Pap screening (no recorded Pap test or attended Pap screening more than 3.4 years ago).

f

There was no age restriction for influenza vaccination uptake, as the service is recommended annually for all adults.

g

Depression screening uptake had no age restriction, as the service is recommended annually for all adults. Adjusted model adjusted for time since last Pap screening (no recorded Pap test or attended Pap screening more than 3.4 years ago).

h

There was no age restriction for HbA1c testing uptake, but the analysis was restricted to women with diabetes.

Table 4:

Preventive Health Services Receipt and Odds Ratios (ORs) for Preventive Health Services Receipt Comparing Attended Pap Screening to Completed the Kit only

Preventive Health Services by Subgroups of Interventiona Received preventive health serviceb n (%) OR, Unadjusted (95% CI) OR, Adjustedc (95% CI)
Mammography d
 Completed the kit only (n=131) 58 (44.3) Ref Ref
 Attended Pap screening (n=193) 153 (79.3) 4.81 (2.95, 7.86) 5.23 (3.18, 8.59)
CRC screening e
 Completed the kit only (n=152) 74 (48.7) Ref Ref
 Attended Pap screening (n=297) 176 (59.3) 1.53 (1.03, 2.27) 1.45 (0.97, 2.15)
Influenza vaccination f
 Completed the kit only (n=651) 265 (40.7) Ref -
 Attended Pap screening (n=1435) 657 (45.8) 1.23 (1.02, 1.48) -
Depression screening g
 Completed the kit only (n=651) 141 (21.7) Ref Ref
 Attended Pap screening (n=1435) 460 (32.1) 1.71 (1.37, 2.12) 1.64 (1.32, 2.04)
HbA1c testing h
 Completed the kit only (n=41) 32 (78.0) Ref -
 Attended Pap screening (n=75) 68 (90.7) 2.73 (0.93, 7.99) -
a

Subgroups were defined by cervical cancer screening behavior in the 6 months after randomization.

b

Preventive health services uptake was assessed in the 12 months after randomization.

c

Models were adjusted for demographic, health, or health plan enrollment covariates that changed OR estimates by 10% or more. Adjusted ORs are not reported for outcomes where no covariate changed the OR by 10% or more.

d

Mammography analysis restricted to women ages 52 to 64 years and not considered up-to-date per HEDIS.23 Adjusted model adjusted for randomization year (2014, 2015 or 2016).

e

CRC screening analysis was restricted to women ages 51 to 64 years and not considered up-to-date per HEDIS.24 Adjusted model adjusted for time since last Pap screening (no recorded Pap test or attended Pap screening more than 3.4 years ago).

f

There was no age restriction for influenza vaccination uptake, as the service is recommended annually for all adults.

g

Depression screening uptake had no age restriction, as the service is recommended annually for all adults. Adjusted model adjust for time since last Pap screening (no recorded Pap test or attended Pap screening more than 3.4 years ago).

h

There was no age restriction for HbA1c testing uptake, but the analysis was restricted to women with diabetes.

There were some important differences in preventive services uptake when evaluating screening modality selected. Mammography adherence was higher among women who attended Pap screening (79.3%) than in women who returned a self-sampling kit (44.3%) or did neither (26.6%). Compared with women who did neither, the adjusted odds of mammography adherence were 2.26 times greater (95%CI:1.56–3.26) for women who returned a kit only, and 11.81 times greater (95%CI:8.11–17.19) for women who attended Pap screening regardless of kit return. Across preventive services, uptake was higher among women who attended Pap screening than among women who completed a kit. The strongest association was observed for mammography adherence (adjusted OR=5.23, 95%CI:3.18–8.59).

CRC screening adherence was higher among women who completed a kit only (48.7%; adjusted OR=5.05, 95%CI:3.57–7.14) or attended Pap screening (59.3%; adjusted OR=7.31, 95% CI:5.57–9.58) than women who did neither (15.1%). CRC screening adherence was not statistically significantly different when comparing women attending Pap screening and to those completing kits (adjusted OR=1.45, 95%CI:0.97–2.15).

Influenza vaccination uptake was also higher among women who completed cervical cancer screening (kit: 40.7%; OR=1.67, 95%CI:1.41–1.98) (Pap: 45.8%; OR=2.06, 95%CI:1.82–2.32) than women who did nothing (29.1%). Uptake was slightly higher among women who attended Pap screening than women who returned a kit only (OR=1.23, 95%CI:1.02–1.48).

Depression screening was higher among women who attended Pap screening (32.1%; adjusted OR=1.79, 95%CI:1.57–2.05) compared with women who did nothing (19.1%). Compared with women who returned a kit, the adjusted odds of depression screening were 1.64 greater (95% CI:1.32–2.04) for women who attended Pap screening.

HbA1c testing was higher among diabetic women who attended Pap screening (90.7%) than who did nothing (74.4%; OR=3.35, 95%CI:1.49–7.52). Comparisons with kit returners were not statistically significant.

DISCUSSION

This study evaluated the impact of unsolicited, mailed HPV self-sampling kits for cervical cancer screening on receipt of other preventive services. Among women in an integrated healthcare delivery system who were underscreened for cervical cancer, uptake of other recommended preventive services was low. We found no significant differences in uptake of other cancer screening (mammography and CRC screening), annual influenza vaccination, depression screening, and HbA1c testing for diabetic monitoring between women randomized to receive a mailed self-sampling kit versus usual care Pap screening reminders. Mailing HPV self-sampling kits to underscreened women increased cervical cancer screening (we previously reported that screening uptake was 26.3% in the intervention group versus 17.4% in the control group25) without 11/15/2021 4:12:00 PMnegatively or positively impacting uptake of other preventive services for women in the intervention arm.

Among women randomized to receive HPV self-sampling kits, preventive services uptake was higher in women who completed cervical cancer screening than in women who remained underscreened. Similar to previous studies,18,2933 we observed positive associations between cervical cancer screening attendance and both mammography and CRC screening. We also observed a positive association between cervical cancer screening and influenza vaccination, in contrast to a previous study that found no association using self-reported data from the population-based 2016 Behavioral Risk Factor Surveillance System survey.34

Within the intervention arm, there were clinically important differences in preventive services uptake by whether women did nothing, returned the kit or attended in-person screening. Mammography, CRC screening, and influenza vaccination receipt was higher in women who returned the self-sampling kit vs. did nothing, suggesting that mailing kits may have activated some women to engage in other preventive care. However, each preventive service evaluated was higher for women who chose in-clinic screening vs. returning the self-sampling kit. This was especially pronounced for mammography, which is consistent with previous studies suggesting that women who attend Pap screening are more engaged in female cancer screenings than other types of cancer screenings.31,35 Some women may have had a Pap test and mammography at the same clinic visit, as both screenings can be offered opportunistically. However, we did not have the ability to assess this with these data. Our within-intervention arm comparison suggests there will need to be additional strategies in place to improve uptake of other preventive services (particularly mammography) if non-clinic-based screening is introduced for women overdue for cervical cancer screening. For example, health systems may consider additional patient-, provider-, and/or health system-level strategies such as financial incentives,36,37 patient education,38,39 provider assessment and feedback,40 and/or behavioral interventions to target other preventive services in conjunction with offering HPV self-sampling.41,42

All eligible women were enrolled into the HOME trial under a waiver of consent, with only 0.6% of women opting out of medical record review, reducing the likelihood of participation bias, recall bias,43 Hawthorne effects,44,45 and social desirability bias.46 Other strengths include the large sample size (except for HbA1c testing) and the novelty of looking at the effect of a screening outreach intervention on other preventive services. Also, we are unaware of any prior studies that have examined associations between Pap screening and depression screening or HbA1c testing for monitoring diabetes. Including HbA1c testing also offered a comparison of a preventive service that is used for routine monitoring in a subgroup of individuals with a chronic condition versus the other services used for prevention or early detection. In our study population, HbA1c testing uptake was relatively higher than uptake of the other preventive services.

Aggregate data restrictions limited our ability to adjust for demographic covariates with small cell size categories. Additionally, temporality between cervical cancer screening and other preventive services could not be established in the within-intervention arm comparison due to the overlapping time periods for assessing the exposure (cervical cancer screening uptake within 6-months post-randomization) and the outcomes (preventive service receipt within 12-months post-randomization). For example, a woman could have received her annual influenza vaccination before she returned a kit or attended Pap screening. While we cannot infer a causal relationship of using a HPV self-sampling kit or attending Pap screening on increased participation in other preventive services,47,48 the temporality is less relevant in this context because our primary objective was to evaluate whether mailing HPV kits impacts adherence to other preventive service recommendations.

Since this study was restricted to women who were underscreened for cervical cancer, the findings may not be applicable to cervical cancer screening-adherent women. The impact of mailing HPV self-sampling kits to women who are adherent to cervical cancer screening is still unknown. Gaps in preventive services could potentially be created by removing in-person Pap screening if non-clinic-based screening is introduced as an option for adherent women. Offering non-clinic-based screening for adherent women could result in greater care gaps for other preventive health services; however, gaps might not be as large if adherent women tend to be better about receiving their preventive services regardless of whether they select HPV kits or in-person Pap screening. The sample of this study was a subset of insured women with access to care at KPWA, which, like the underlying region of the U.S., has a high proportion of non-Hispanic White, higher income, and highly educated individuals. The study also had several limitations. All women in the study had insurance and access to healthcare; therefore, our findings may not be generalizable to other U.S. populations. Our results also may not be applicable to women with limited English proficiency, since women with an “interpreter needed” flag in their EMR were excluded. Finally, while the main study was a randomized trial, this sub-study was limited to women due for each preventive service. Models adjusted for variables that were imbalanced between groups; however, it is possible that there is residual confounding.

CONCLUSION

Individuals who are overdue for cervical cancer screening remain a hard-to-reach population, even after removing barriers associated with in-person screening. While cervical cancer screening rates remained low,25 mailing HPV kits improved cervical cancer screening rates and did not result in reduced uptake of other recommended preventive services. Our within-intervention arm comparisons demonstrated differences in preventive services uptake by whether women did nothing, returned the kit or attended in-person screening. As health systems implement HPV self-testing for cervical cancer screening, they should identify additional targeted strategies to encourage and engage patients in other preventive services uptake.

Highlights.

  • Offering non-clinic-based cervical cancer screening did not reduce preventive care use compared to usual care.

  • Preventive care use was highest in those who screened for cervical cancer in-clinic.

Acknowledgments

Funding: This work was supported by the National Cancer Institute of the National Institutes of Health [grant number R01CA168598]. The National Institutes of Health had no role in study design; in the collection, analysis and interpretation of data; in the writing of the report; or in the decision to submit the article for publication.

Abbreviations

BMI

body mass index

CI

confidence intervals

CRC

colorectal cancer

EMR

electronic medical record

FIT

fecal immunochemical test

FOBT

fecal occult blood test

HbA1c

hemoglobin A1c

HEDIS

Healthcare Effectiveness Data and Information Set

HOME

Home-based Options to Make cervical cancer screening Easy

HPV

human papillomavirus

KPWA

Kaiser Permanente Washington

ORs

odds ratios

Pap

Papanicolaou screening

Footnotes

CRediT authorship contribution statement

Hitomi Kariya: Conceptualization, Formal Analysis, Visualization, Writing – original draft

Diana S.M. Buist: Conceptualization, Writing – Review & Editing, Funding Acquisition

Melissa L. Anderson: Methodology, Writing – Review & Editing

John Lin: Data Curation, Validation, Writing – Review & Editing

Hongyuan Gao: Data Curation, Validation, Writing – Review & Editing

Linda K. Ko: Writing – Review & Editing

Rachel L. Winer: Conceptualization, Writing – Review & Editing, Supervision, Funding Acquisition

Author disclosure statement:

Hitomi Kariya: No competing financial interests exist.

Diana S.M. Buist: No competing financial interests exist.

Melissa L. Anderson: No competing financial interests exist.

John Lin: No competing financial interests exist.

Hongyuan Gao: No competing financial interests exist.

Linda K. Ko: No competing financial interests exist.

Rachel L. Winer: No competing financial interests exist.

Declaration of interests

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

REFERENCES

  • 1.US Preventive Services Task Force, Curry SJ, Krist AH, et al. Screening for Cervical Cancer: US Preventive Services Task Force Recommendation Statement. JAMA. 2018;320(7):674. doi: 10.1001/jama.2018.10897 [DOI] [PubMed] [Google Scholar]
  • 2.Saslow D, Solomon D, Lawson HW, et al. American Cancer Society, American Society for Colposcopy and Cervical Pathology, and American Society for Clinical Pathology Screening Guidelines for the Prevention and Early Detection of Cervical Cancer. J Low Genit Tract Dis. 2012;16(3):175–204. doi: 10.1097/LGT.0b013e31824ca9d5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Guo F, Cofie LE, Berenson AB. Cervical Cancer Incidence in Young U.S. Females After Human Papillomavirus Vaccine Introduction. Am J Prev Med. 2018;55(2):197–204. doi: 10.1016/j.amepre.2018.03.013 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Centers for Disease Control and Prevention (CDC). Ten great public health achievements--worldwide, 2001–2010. MMWR Morb Mortal Wkly Rep. 2011;60(24):814–818. [PubMed] [Google Scholar]
  • 5.White A, Thompson TD, White MC, et al. Cancer Screening Test Use — United States, 2015. MMWR Morb Mortal Wkly Rep. 2017;66(8):201–206. doi: 10.15585/mmwr.mm6608a1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Cervical Cancer Screening. NCQA. Accessed May 28, 2020. https://www.ncqa.org/hedis/measures/cervical-cancer-screening/ [Google Scholar]
  • 7.Leyden WA, Manos MM, Geiger AM, et al. Cervical Cancer in Women With Comprehensive Health Care Access: Attributable Factors in the Screening Process. JNCI J Natl Cancer Inst. 2005;97(9):675–683. doi: 10.1093/jnci/dji115 [DOI] [PubMed] [Google Scholar]
  • 8.Kinney W, Sung HY, Kearney KA, Miller M, Sawaya G, Hiatt RA. Missed opportunities for cervical cancer screening of HMO members developing invasive cervical cancer (ICC). Gynecol Oncol. 1998;71(3):428–430. doi: 10.1006/gyno.1998.5135 [DOI] [PubMed] [Google Scholar]
  • 9.Janerich D, Hadjimichael O, Schwartz P, et al. The screening histories of women with invasive cervical cancer, Connecticut. Am. J. Public. Health, 85 (6) (1995), pp. 791–794, 10.2105/ajph.85.6.791 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Elam-Evans LD. National, Regional, State, and Selected Local Area Vaccination Coverage Among Adolescents Aged 13–17 Years — United States, 2019. MMWR Morb Mortal Wkly Rep. 2020;69. doi: 10.15585/mmwr.mm6933a1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Oscarsson MG, Benzein EG, Wijma BE. Reasons for non-attendance at cervical screening as reported by non-attendees in Sweden. J Psychosom Obstet Gynecol. 2008;29(1):23–31. doi: 10.1080/01674820701504619 [DOI] [PubMed] [Google Scholar]
  • 12.Glasgow RE, Whitlock EP, Valanis BG, Vogt TM. Barriers to mammography and pap smear screening among women who recently had neither, one or both types of screening. Ann Behav Med. 2000;22(3):223. doi: 10.1007/BF02895117 [DOI] [PubMed] [Google Scholar]
  • 13.Eaker S, Adami H-O, Sparén P. Reasons Women Do Not Attend Screening for Cervical Cancer: A Population-Based Study in Sweden. Prev Med. 2001;32(6):482–491. doi: 10.1006/pmed.2001.0844 [DOI] [PubMed] [Google Scholar]
  • 14.Waller J, Bartoszek M, Marlow L, Wardle J. Barriers to cervical cancer screening attendance in England: a population-based survey: J Med Screen. Published online December 1, 2009. doi: 10.1258/jms.2009.009073 [DOI] [PubMed] [Google Scholar]
  • 15.Goins K, Zapka J, Geiger A, et al. Implementation of systems strategies for breast and cervical cancer screening services in health maintenance organizations. Am. J. Manag. Care, 9 (11) (2003), pp. 745–755 https://www.ajmc.com/view/nov03-1683p745-755 [PubMed] [Google Scholar]
  • 16.Arbyn M, Smith SB, Temin S, Sultana F, Castle P. Detecting cervical precancer and reaching underscreened women by using HPV testing on self samples: updated meta-analyses. BMJ. 2018;363:k4823. doi: 10.1136/bmj.k4823 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Schueler KM, Chu PW, Smith-Bindman R. Factors Associated with Mammography Utilization: A Systematic Quantitative Review of the Literature. J Womens Health. 2008;17(9):1477–1498. doi: 10.1089/jwh.2007.0603 [DOI] [PubMed] [Google Scholar]
  • 18.Wirth MD, Brandt HM, Dolinger H, Hardin JW, Sharpe PA, Eberth JM. Examining connections between screening for breast, cervical and prostate cancer and colorectal cancer screening. Colorectal Cancer. 2014;3(3):253–263. doi: 10.2217/crc.14.18 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Malone C, Buist DSM, Tiro J, et al. Out of reach? Correlates of cervical cancer underscreening in women with varying levels of healthcare interactions in a United States integrated delivery system. Prev Med. 2021;145:106410. doi: 10.1016/j.ypmed.2020.106410 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Winer RL, Tiro JA, Miglioretti DL, et al. Rationale and design of the HOME trial: A pragmatic randomized controlled trial of home-based human papillomavirus (HPV) self-sampling for increasing cervical cancer screening uptake and effectiveness in a U.S. healthcare system. Contemp Clin Trials. 2018;64:77–87. doi: 10.1016/j.cct.2017.11.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Bowles EJA, Gao H, Brandzel S, Bradford SC, Buist DSM. Comparative effectiveness of two outreach strategies for cervical cancer screening. Prev Med. 2016;86:19–27. doi: 10.1016/j.ypmed.2016.01.016 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Buist DSM, Gao H, Anderson ML, et al. Breast cancer screening outreach effectiveness: Mammogram-specific reminders vs. comprehensive preventive services birthday letters. Prev Med. 2017;102:49–58. doi: 10.1016/j.ypmed.2017.06.028 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Breast Cancer Screening. NCQA. Accessed May 11, 2020. https://www.ncqa.org/hedis/measures/breast-cancer-screening/ [Google Scholar]
  • 24.Colorectal Cancer Screening. NCQA. Accessed May 11, 2020. https://www.ncqa.org/hedis/measures/colorectal-cancer-screening/ [Google Scholar]
  • 25.Winer RL, Lin J, Tiro JA, et al. Effect of Mailed Human Papillomavirus Test Kits vs Usual Care Reminders on Cervical Cancer Screening Uptake, Precancer Detection, and Treatment: A Randomized Clinical Trial. JAMA Netw Open. 2019;2(11):e1914729–e1914729. doi: 10.1001/jamanetworkopen.2019.14729 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Onega T, Duell EJ, Shi X, Wang D, Demidenko E, Goodman D. Geographic access to cancer care in the U.S. Cancer. 2008;112(4):909–918. doi: 10.1002/cncr.23229 [DOI] [PubMed] [Google Scholar]
  • 27.Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: Development and validation. J Chronic Dis. 1987;40(5):373–383. doi: 10.1016/0021-9681(87)90171-8 [DOI] [PubMed] [Google Scholar]
  • 28.Lee PH. Is a Cutoff of 10% Appropriate for the Change-in-Estimate Criterion of Confounder Identification? J Epidemiol. 2014;24(2):161–167. doi: 10.2188/jea.JE20130062 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.González P, Borrayo EA. Role of Physician Involvement on Latinas’ Mammography Screening Adherence. Womens Health Issues Off Publ Jacobs Inst Womens Health. 2011;21(2):165–170. doi: 10.1016/j.whi.2010.09.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Kang SK, Jiang M, Duszak R, Heller SL, Hughes DR, Moy L. Use of Breast Cancer Screening and Its Association with Later Use of Preventive Services among Medicare Beneficiaries. Radiology. 2018;288(3):660–668. doi: 10.1148/radiol.2018172326 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Bertaut A, Coudert J, Bengrine L, Dancourt V, Binquet C, Douvier S. Does mammogram attendance influence participation in cervical and colorectal cancer screening? A prospective study among 1856 French women. PLoS ONE. 2018;13(6). doi: 10.1371/journal.pone.0198939 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Carlos RC, Fendrick AM, Patterson SK, Bernstein SJ. Associations in breast and colon cancer screening behavior in women1. Acad Radiol. 2005;12(4):451–458. doi: 10.1016/j.acra.2004.12.024 [DOI] [PubMed] [Google Scholar]
  • 33.Carlos RC, Fendrick AM, Ellis J, Bernstein SJ. Can breast and cervical cancer screening visits be used to enhance colorectal cancer screening? J Am Coll Radiol. 2004;1(10):769–776. doi: 10.1016/j.jacr.2004.05.018 [DOI] [PubMed] [Google Scholar]
  • 34.Oancea SC, Watson IW. The association between history of screening for cancer and receipt of an annual flu vaccination: Are there reinforcing effects of prevention seeking? Am J Infect Control. 2019;47(11):1309–1313. doi: 10.1016/j.ajic.2019.05.009 [DOI] [PubMed] [Google Scholar]
  • 35.Lo SH, Waller J, Wardle J, von Wagner C. Comparing barriers to colorectal cancer screening with barriers to breast and cervical screening: a population-based survey of screening-age women in Great Britain. J Med Screen. 2013;20(2):73–79. doi: 10.1177/0969141313492508 [DOI] [PubMed] [Google Scholar]
  • 36.Purnell JQ, Thompson T, Kreuter MW, McBride TD. Behavioral Economics: “Nudging” Underserved Populations to Be Screened for Cancer. Prev Chronic Dis. 2015;12:E06. doi: 10.5888/pcd12.140346 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Constantinou P, Sicsic J, Franc C. Effect of pay-for-performance on cervical cancer screening participation in France. Int J Health Econ Manag. Published online December 22, 2016. doi: 10.1007/s10754-016-9207-3 [DOI] [PubMed] [Google Scholar]
  • 38.KURT G, AKYUZ A. Evaluating the Effectiveness of Interventions on Increasing Participation in Cervical Cancer Screening. J Nurs Res. 2019;27(5):e40. doi: 10.1097/jnr.0000000000000317 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Naz MSG, Kariman N, Ebadi A, Ozgoli G, Ghasemi V, Fakari FR. Educational Interventions for Cervical Cancer Screening Behavior of Women: A Systematic Review. Asian Pac J Cancer Prev APJCP. 2018;19(4):875–884. doi: 10.22034/APJCP.2018.19.4.875 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Sabatino SA, Lawrence B, Elder R, et al. Effectiveness of Interventions to Increase Screening for Breast, Cervical, and Colorectal Cancers: Nine Updated Systematic Reviews for the Guide to Community Preventive Services. Am J Prev Med. 2012;43(1):97–118. doi: 10.1016/j.amepre.2012.04.009 [DOI] [PubMed] [Google Scholar]
  • 41.Thompson EL, Galvin AM, Daley EM, Tatar O, Zimet GD, Rosberger Z. Recent changes in cervical cancer screening guidelines: U.S. women’s willingness for HPV testing instead of Pap testing. Prev Med. 2020;130:105928. doi: 10.1016/j.ypmed.2019.105928 [DOI] [PubMed] [Google Scholar]
  • 42.Tatar O, Thompson E, Naz A, et al. Factors associated with human papillomavirus (HPV) test acceptability in primary screening for cervical cancer: A mixed methods research synthesis. Prev Med. 2018;116:40–50. doi: 10.1016/j.ypmed.2018.08.034 [DOI] [PubMed] [Google Scholar]
  • 43.Coughlin SS. Recall bias in epidemiologic studies. J Clin Epidemiol. 1990;43(1):87–91. doi: 10.1016/0895-4356(90)90060-3 [DOI] [PubMed] [Google Scholar]
  • 44.Landsberger HA. Hawthorne Revisited: Management and the Worker, Its Critics, and Developments in Human Relations in Industry. Published online 1958.
  • 45.McCambridge J, Witton J, Elbourne DR. Systematic review of the Hawthorne effect: New concepts are needed to study research participation effects. J Clin Epidemiol. 2014;67(3):267–277. doi: 10.1016/j.jclinepi.2013.08.015 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Edwards AL. The relationship between the judged desirability of a trait and the probability that the trait will be endorsed. - PsycNET. Accessed December 19, 2020. https://content.apa.org/record/1954-00551-001 [Google Scholar]
  • 47.Hill AB. The Environment and Disease: Association or Causation? Proc R Soc Med. 1965;58(5):295–300. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Rothman KJ, Greenland S. Causation and Causal Inference in Epidemiology. Am J Public Health. 2005;95(S1):S144–S150. doi: 10.2105/AJPH.2004.059204 [DOI] [PubMed] [Google Scholar]

RESOURCES