Abstract
Key clinical and community members need to be involved in the identification of feasible and impactful implementation strategies for translation of evidence-based interventions into practice. While a wide range of implementation strategies has been developed, there is little research on their applicability for cancer prevention and control (CPC) efforts in primary care. We conducted a survey of primary care physicians to identify implementation strategies they perceive as most feasible and impactful. The survey included both primary prevention behavior change counseling and cancer screening issues. Analyses contrasted ratings of feasibility and impact of nine implementation strategies, and among clinicians in different settings with a focus on comparisons between clinicians in rural vs. non-rural settings. We recruited a convenience sample of 326 respondents from a wide range of practice types from four practice-based research networks in 49 states and including 177 clinicians in rural settings. Ratings of impact were somewhat higher than those for feasibility. Few of the nine implementation strategies were high on both impact and feasibility. Only ‘adapting to my practice’ was rated higher than a 4 (“moderate”) on both impact and feasibility. There were relatively few differences between rural and non-rural clinicians or associated with other clinician or setting characteristics. There is considerable variability in perceived impact and feasibility of implementation strategies for CPC activities among family medicine clinicians. It is important to assess both feasibility and impact of implementation strategies as well as their generalizability across settings. Our results suggest that optimal strategies to implement evidence-based CPC activities will likely need to be adapted for primary care settings. Future research is needed to replicate these findings and identify practical, implementation partner informed implementation strategies.
Keywords: Implementation strategies, Context, Cancer prevention and control, Primary prevention, Engagement, Primary care
Introduction
There is a large gap and time lag between the evidence on effective cancer prevention and control (CPC) strategies and their implementation in diverse clinical settings (Hall et al., 2018; Khan et al., 2021; Neta, 2021; Sauer et al., 2017). This is true for both primary prevention and cancer screenings (Fisher et al., 2011). To design effective, practical programs and strategies to address real world CPC challenges it is important to understand the complex settings in which they are to be implemented (Luig et al., 2018). Implementation challenges are especially acute in rural primary care settings (Saman et al., 2019), which have fewer resources to conduct preventive interventions among patient populations that have many social determinants of health challenges and higher rates of morbidity and mortality (Blake et al., 2017; Charlton et al., 2015).
To design programs that will have wide uptake, be successfully implemented, and sustained, it is important to prioritize engagement of clinical and community partners in design of appropriate interventions (Brownson & Proctor, 2018) and identification of feasible and impactful implementation strategies (Meissner et al., 2020). Although a wide range of implementation strategies have been identified and employed (Powell et al., 2015), there is little research on their applicability for different CPC issues or settings (Rabin & Glasgow, 2015). While there has been considerable recent attention to the issue of engagement, including clinician involvement in design and adaptation of interventions in primary care (Luig et al., 2018; Saman et al., 2019), and some on staff in rural settings (Harry et al., 2020; Saman et al., 2019), there has been almost no research on clinicians’ perspectives on different implementation strategies.
Obtaining clinician input on implementation strategies that are both feasible and effective constitutes an important opportunity for both advancing implementation science and for providing pragmatic assistance to primary care and other practice settings (Powell et al., 2015, 2017). There is a large number of implementation strategies that differ widely on time and cost, expertise required, etc. (Proctor et al., 2013) We are not aware of comparative data on which strategies are superior or preferred by different types of primary care implementers or practice settings (e.g., rural vs. urban; experienced vs. novice practitioners; high vs. low resource settings). It is likely (Powell et al., 2017) that the optimal and preferred strategies will vary by issue, context, and other factors (Chambers et al., 2013; Waltz et al., 2019). We consider overall helpfulness to be a function of both feasibility and reach, and impact or effectiveness. To achieve improvement in population health, both are needed.
We conducted a primary care clinician survey as part of our NCI funded Implementation Science Center in Cancer Control (ISC3) (Oh et al., 2021). The purpose of the Colorado P50 center grant, Pragmatic Implementation Science Approaches to Assess and Enhance Value of Cancer Prevention and Control in Rural Primary Care (COISC3), is to develop, implement, evaluate, and disseminate pragmatic implementation science approaches to cost and value to enhance CPC in rural primary care. We focus especially on tailoring and adapting implementation strategies and intervention approaches to local contexts, populations, settings, and resources (Shelton et al., 2020).
In summary, it will be useful for both research and practice in CPC, and especially research-practice partnerships, to have information about clinician perspectives on which implementation strategies are most feasible and most impactful in general, for different CPC issues, and for particular contexts. To address this issue, we conducted an exploratory study involving a convenience survey of primary care clinicians. The purpose of this report is to (1) identify CPC activities with which clinicians would most like assistance; (2) evaluate perceived impact and feasibility of different implementation strategies to assist with delivery of CPC services; and (3) investigate clinician and practice characteristics potentially related to CPC activities with particular focus on rural vs. non-rural comparisons.
Methods
This study was reviewed by the Colorado Multiple Institutional Review Board at the University of Colorado, approved as expedited research, and written informed consent was not required. This survey was conducted from September to December 2021.
Settings and target population
A national sample of primary care clinicians was obtained from the American Academy of Family Physicians (AAFP) combined with clinicians from four practice-based research networks (PBRNs) which are collaborating with our COISC3 Center. Eligible respondents were adult primary care clinicians including doctors of medicine, doctors of osteopathic medicine, nurse practitioners and physicians’ assistants who were providers of record. The vast majority of the practices in these networks were family medicine, which reflected the ‘implementation laboratory partners’ in our NCI funded center. While the study focused on rural primary care, both rural and non-rural clinicians were surveyed to allow comparison.
Survey design and development
The survey instrument (see Appendix 1) covered the following conceptual areas: perceived need for assistance to improve various CPC services; preferences for assistance with CPC vs. other types of preventive service activities (this issue is the topic of a separate publication); (Brtnikova et al., 2022) perceived feasibility and impact of different implementation strategies; and physician and practice characteristics. The survey underwent internal evaluation and revision by members of the investigative team including cancer researchers (n = 5), local primary care clinicians (n = 4), and PBRN directors having large numbers of rural practices (n = 3). The penultimate version was pilot-tested by a group of 5 cancer researchers and practicing primary care physicians from different regions of the country. More detail on the survey design, development, sample and procedures are available elsewhere (Brtnikova et al., 2022).
Needs for assistance with CPC activities
To provide context and specificity for rating the implementation strategies, respondents were asked to select one of seven different CPC activities that they ‘would most like help with implementing’ in their practice. The seven activities included (1) primary prevention behavior change counseling activities (i.e., assessment and counseling on nutrition and diet; physical activity; tobacco use; and HPV vaccine; (2) screening for lung cancer and colorectal cancer; and (3) support for cancer survivorship care.
Implementation strategies
To minimize respondent burden, it was necessary to limit the number of implementation strategies rated. Pilot testing indicated that it was feasible to rate only 8–10 strategies. We selected implementation strategies (Powell et al., 2015) from different ERIC conceptual categories (Waltz et al., 2015) that were most applicable to primary care and preventive services. Items were selected from two sources. First, we selected an item from each of five clusters of Expert Recommendations for Implementing Change (ERIC) strategies identified by Waltz et al. (2015) These items were: audit and feedback (from the evaluative and iterative strategies cluster); facilitation (from the interactive assistance cluster); adapt to our practice (from the adapt and tailor to context cluster); training and education for staff (from the train and educate stakeholders cluster); and engage patients (from the engage consumers cluster). Because of our focus on prevention and primary care, we also included items from each of the four categories of implementation strategies identified as used most frequently in the national Evidence Now project that targeted improvement of multiple preventive services in over 200 primary care settings in 12 states (Perry et al., 2019). These implementation strategies were: (1) build a health information technology tool; (2) assess and redesign clinic workflow; (3) refer patients to community resources; and (4) use a quality improvement approach. Pre-testing, cognitive testing, and piloting activities indicated that it was necessary to slightly modify the wording of some items to fit the vocabulary and understanding of practicing primary care clinicians rather than implementation researchers. We intended to have respondents rate implementation strategies for different CPC activities, but pilot testing revealed that respondents were only able to confidently provide answers for activities they desired assistance. Also, time constraints prevented having respondents rate strategies for more than the CPC activity most relevant to that clinician.
Ratings of feasibility and impact of implementation strategies
Respondents were asked to provide two ratings for each implementation strategy: perceived feasibility and impact. The rationale was that many evidence-based interventions and strategies identified in efficacy and effectiveness research may not be feasible for many settings or populations (Glasgow & Emmons, 2007). Feasibility was defined for respondents as “how easy it would be to conduct this strategy in your practice”. Impact was defined as “the effect this strategy would have on facilitating consistent delivery in your practice”. Both feasibility and impact were rated on 6-point Likert-type scales. This allowed us to calculate an Overall Fit (helpfulness) index by multiplying impact and feasibility responses for each item, as well as to create a figure that illustrated the combination of feasibility and impact. All implementation strategies rated were presented in a random order across respondents to control for potential order effects.
Physician and practice characteristics
Several variables were included for descriptive purposes and as potential moderating factors. Related to our COISC3 Center goals, of greatest a priori interest and a focus of many of our analyses was a classification of rural vs. non-rural clinical settings. Rural status was assessed using zip code of the respondent and the corresponding RUCA codes 4–10 (U.S. Department of Agriculture ERS 2010). Other respondent and practice characteristics included clinician specialty and gender, number of adult patients seen, years since training, size and type of practice (e.g., federally qualified health center; private practice; hospital system), implementation climate (Jacobs et al., 2014), presence of any disease registries or prompting systems, and estimated age group, insurance type, and race/ethnicity characteristics of their patient population.
Survey administration
A convenience sample was recruited using Dillman’s Tailored Designed Method, (Dillman & Christian, 2014). All clinicians received an electronic cover letter endorsed by their PBRN or national organization together with a 19-item questionnaire. Those with a known email address received an initial survey using QualtricsXM and up to two emailed reminders. Due to rules and mandatory practices regarding surveys in different PBRNs, slightly different follow-up procedures were used after the identical initial mail distribution. Those without an email address received a paper survey sent via standard mail. Email non-responders from two PBRNs also received a mailed survey. Each respondent was offered an incentive of $50 using RewardsLink. Due to confidentially concerns we did not have information on nonrespondents to compare characteristics of those who responded vs. did not.
Statistical analyses
All statistical analyses were performed using SAS software (SAS 9.4, SAS Institute, Cary, NC). Analyses were primarily descriptive and focused on means, standard deviations, and ranges for the implementation strategies. To compare ratings on a) different CPC activities and b) different strategies (with repeated responses for individuals) general linear mixed effects modeling was used for continuous measures with random effect for individual respondent, adjusted for clinician characteristics that impacted results (Ramon et al., 1999). As appropriate, chi-square or ANOVA was used to evaluate potential differences associated with continuous or categorical data on physician and practice characteristics. As this was an exploratory study, we did not conduct formal power analyses, but our resulting sample size of 326 allowed a power of 0.84 to detect an effect size of 0.4, using a two-sided alpha level of 0.01 to adjust for multiple comparisons. (https://www.ai-therapy.com/psychology-statistics/power-calculator).
Results
Sample
We received a total of 326 eligible surveys. Respondents practiced in 49 states and included 177 rural and 149 non-rural providers. The overall response rate for completed surveys was 4%, after removing those ineligible (e.g., not providers, not practicing in the U.S., not having adult patients; and incomplete responses). Table 1 summarizes overall clinician and practice characteristics and Table 2 displays characteristics by and differences between rural vs. nonrural providers. As would be expected given the networks which are participating with our center, most respondents were family physicians (91%). There was a wide range of practice types, sizes and number of patients seen. Almost half (47%) of respondents’ patient panels were over 50 years of age; an estimated 32% had Medicare insurance, and 31% had Medicaid insurance (23%) or were uninsured (8%). Clinicians estimated that 66% of their patients were non-Hispanic White, 15% were Latinx, 12% African American and 5% or less were Asian and American Indian/Alaskan Natives.
Table 1.
Overall (n = 326) | |
---|---|
Practice location, % (n) | |
Rural | 54% (177) |
Non-rural | 46% (149) |
Type of practice, % (n) | |
FQHC | 16% (49) |
Private practice | 38% (112) |
Hospital/health-system owned | 39% (116) |
Academic | 13% (40) |
Other (VA, HMO) | 1% (4) |
Registry or prompting system for cancer prevention and control services, % (n) | |
Very robust | 31% (92) |
For some | 46% (139) |
No | 23% (68) |
Degree, % (n) | |
MD | 77% (251) |
DO | 11% (37) |
NP | 5% (15) |
PA | 4% (14) |
Other (eliminated from survey) | 3% (9) |
Specialty, % (n) | |
Family physician | 91% (293) |
Internal medicine | 6% (19) |
Other | 4% (12) |
Gender, % (I) | |
Male | 47% (148) |
Female | 53% (167) |
Panel size (patients per week), mean (SD) | 73 (103) |
Years from finished clinical training, years (SD) | 20 (12) |
Total number of clinical staff members, mean (SD) | 18 (19) |
Patient age, mean % (SD) | |
Percent < 18 years old | 13% (11) |
Percent 18–50 years old | 39% (15) |
Percent > 50 years old | 47% (18) |
Patients’ insurance types, mean % (SD) | |
Percent uninsured | 8% (12) |
Percent medicaid | 23% (18) |
Percent medicare | 32% (16) |
Percent private | 36% (21) |
Patient’s race and ethnicity, mean % (SD) | |
Percent white or caucasian | 66% (24) |
Percent hispanic or latino | 15% (17) |
Percent black or African American | 13% (16) |
Percent Asian | 5% (8) |
Percent other (American Indian, Alaska native, Native Hawaiian or Pacific Islander) | 4% (9) |
FQHC = Federally qualified health center; VA = Veterans affairs, HMO = Health maintenance organization; SD = Standard deviation; MD = Doctor of medicine; DO = Doctor of osteopathic medicine; NP = Nurse practitioner; PA = Physician’ assistant
Table 2.
Rural n = 177 |
Nonrural n = 149 |
p value* (Rural vs. nonrural) |
|
---|---|---|---|
Practice location, % (n) | 54% | 46% | |
Type of practicea, col % | |||
FQHC | 21% | 11% | 0.025 |
Private practice | 31% | 45% | 0.008 |
Hospital/health-system owned | 45% | 32% | 0.019 |
Academic | 8% | 20% | 0.002 |
Other (VA, HMO) | 4% | 0% | 0.179 |
Registry or prompting system for cancer prevention and control services, col % | 0.460 | ||
Very robust | 31% | 30% | |
For some | 44% | 50% | |
No | 25% | 20% | |
Degree, col % | 0.008 | ||
MD | 73% | 81% | |
DO | 10% | 13% | |
NP | 7% | 2% | |
PA | 5% | 3% | |
Other (eliminated from survey) | 5% | 0% | |
Specialty, col % | |||
Family physician | 91% | 91% | 0.821 |
Internal medicine | 4% | 8% | 0.116 |
Other | 5% | 1% | 0.039 |
Gender, col % | 0.577 | ||
Male | 46% | 48% | |
Female | 54% | 52% | |
Panel size (patients per week), mean (SD) | 67 (45) | 79 (142) | 0.328 |
Years from finished clinical training, years (SD) | 18 (12) | 22 (12) | 0.005 |
Total number of clinical staff members, mean (SD) | 17 (19) | 19 (19) | 0.339 |
Patient age, mean % (SD) | |||
Percent < 18 years old | 13 (10) | 14 (12) | 0.780 |
Percent 18–50 years old | 37 (16) | 42 (15) | 0.018 |
Percent > 50 years old | 49 (19) | 44 (17) | (0.012) |
Patients’ insurance types, mean % (SD) | |||
Percent uninsured | 8 (11) | 8 (13) | 0.881 |
Percent medicaid | 25 (18) | 22 (18) | 0.132 |
Percent medicare | 36 (17) | 29 (13) | 0.0002 |
Percent private | 32 (19) | 41 (22) | 0.0004 |
Patient’s race and ethnicity, mean % (SD) | |||
Percent white or Caucasian | 72 (22) | 60 (24) | < .0001 |
Percent Hispanic or Latino | 14 (16) | 17 (19) | 0.142 |
Percent black or African American | 8 (13) | 17 (18) | < 0.0001 |
Percent Asian | 4 (8) | 6 (7) | 0.014 |
Percent other (American Indian, Alaska Native, Native Hawaiian or Pacific Islander) | 5 (11) | 3 (5) | 0.084 |
FQHC = Federally qualified health center; VA = Veterans affairs, HMO = Health maintenance organization; SD = Standard deviation; MD = Doctor of medicine; DO = Doctor of osteopathic medicine; NP = Nurse practitioner; PA = Physician’ assistant
*Chi-Square for comparison between rural and nonrural (p < 0.05 in bold)
aType of practice: percentages within rural and nonrural exceed 100% because respondents could select all that applied
Need for assistance across CPC areas
Thirty two percent of clinicians chose nutrition and diet as the CPC area in which they would most like help; 16% chose lung cancer screening; 12% chose each of physical activity, colorectal cancer screening, and cancer survivorship support, 11% chose tobacco use assessment and counseling and 5% HPV discussion. There were no differences on which CPC activity assistance was selected as most desired between clinicians in rural and non-rural settings.
Ratings of implementation strategies
Impact
In general, the various implementation strategies were rated as having moderate impact as summarized in Table 3 (M = 3.95 on the 6-point scale). Three of the strategies–‘Engaging patients for tailoring’ (M = 4.32), ‘Adapting to our practice’ (M = 4.17), and ‘Training and education’ (M = 4.12) had more than moderate impact (> than 4). Referring patients to community resources was rated as having little impact, especially among rural clinicians. There was moderate variability on impact ratings within and across the implementation strategies.
Table 3.
Implementation strategy | Impact mean (SD) |
Feasibility mean (SD) |
Fit mean (SD) |
|||
---|---|---|---|---|---|---|
Rural | Nonrural | Rural | Nonrural | Rural | Nonrural | |
Assess and redesign clinic workflow | 3.73 (1.42) | 3.91 (1.22) | 3.25 (1.30) | 3.42 (1.23) | 13.16 (8.64) | 14.31 (8.15) |
Have a practice facilitator or coach | 3.87 (1.46) | 4.17 (1.33) | 2.94 (1.55) | 3.05 (1.53) | 12.46 (9.24) | 13.65 (9.13) |
Refer patients to community resources (e.g., WIC, YMCA, Quitline) | 3.21 (1.33) | 3.62 (1.31) | 3.29 (1.39) | 3.75 (1.35) | 11.50 (7.70) | 14.65 (8.86) |
Use a quality improvement approach | 3.96 (1.20) | 4.06 (1.18) | 3.97 (1.32) | 3.94 (1.27) | 16.62 (8.51) | 17.08 (8.98) |
Training and education for practice staff | 4.13 (1.20) | 4.11 (1.21) | 3.87 (1.28) | 4.05 (1.22) | 16.66 (8.44) | 17.32 (8.28) |
Adapt evidence-based intervention (or guideline) to our practice | 4.18 (1.17) | 4.16 (1.19) | 4.18 (1.16) | 4.26 (1.17) | 17.95 (7.99) | 18.42 (8.29) |
Use audit and feedback or some type of periodic data reporting | 3.70 (1.22) | 3.82 (1.24) | 3.65 (1.27) | 3.44 (1.18) | 14.29 (7.87) | 13.99 (7.83) |
Engage patients to help create an individually tailored action plan | 4.34 (1.21) | 4.30 (1.21) | 3.77 (1.17) | 3.72 (1.21) | 16.93 (8.10) | 16.79 (8.31) |
Build a health information technology tool (e.g., EHR reminder or decision aid) | 3.94 (1.39) | 3.92 (1.36) | 3.33 (1.44) | 3.42 (1.38) | 13.96 (8.86) | 14.18 (8.13) |
Overall Mean across all strategies | 3.90 (0.93) | 4.01 (0.89) | 3.58 (0.92) | 3.67 (0.88) |
14.84 (6.32) |
15.60 (6.30) |
Means in bold were significantly different between rural and nonrural respondents
After forming subgroups based on the CPC activity chosen, we compared average ratings on impact among categories of (1) primary prevention (nutrition, physical activity, smoking cessation, or HPV counseling), (2) cancer screening (lung, colorectal) and (3) cancer survivorship support. Although average impact ratings were slightly lower among those selecting cancer survivorship (M = 3.74 vs. 4.02 for primary prevention activities and 3.90 for cancer screening), these differences were not significant.
There were no differences between rural and non-rural clinicians with the exception that the impact of referral to community resource strategy was rated significantly lower in rural than non-rural practices (p < 0.008). Exploratory subgroup analyses evaluating the impact of other practice characteristics indicated that only gender was significant: females rated the implementation strategies as having higher impact (p < 0.03) than males. Inclusion of gender in the analysis did not alter results concerning rural-non-rural comparisons.
Feasibility
Ratings of feasibility (M = 3.62) were lower than those for impact, with the exceptions of making adaptions to one’s practice and referral to community resources (Table 3). The implementation strategy rated as the most feasible was adapting to local context. Practice facilitation was rated as the least feasible strategy, especially for rural clinicians. Once again there was considerable variability across clinicians for the same strategy, suggesting that contextual factors may be important. There were few meaningful differences on feasibility ratings between rural and non-rural clinicians. Rural clinicians did rate the strategy of community referrals as less feasible than non-rural clinicians (M of 3.3 vs. 3.8, p < 0.004). The only other clinician, practice, and patient population characteristic to moderate results was that clinicians serving a higher percentage of uninsured patients rated implementation strategies as less feasible (p < 0.03). Inclusion of this variable in the analysis did not alter results concerning rural-non-rural comparisons.
Although average feasibility ratings were lower among those selecting cancer survivorship as their top area of need (M = 3.30 vs. 3.68 for primary prevention activities and 3.66 for cancer screening), these differences were not significant.
Overall fit
To evaluate the overall helpfulness of implementation strategies, we calculated an overall ‘fit to context’ score by multiplying the feasibility and impact ratings for each strategy as seen in the right-hand columns of Table 3. These scores could range between 1 and 36 and as can be seen, most scores were in the middle to lower range of possible scores: a score of moderate on both feasibility and impact would result in a score of 16. These scores as well as the scatter plot diagram divided into quadrants in Fig. 1 illustrate that only four strategies: adaptations to local practice; training and education; quality improvement; and engaging patients for tailoring received relatively strong fit scores (> 16). The correlation between rated feasibility and impact was 0.68 (p < 0.001) indicating that these characteristics while conceptually distinct were far from independent.
Clinician and practice characteristics related to Fit scores were similar to those observed for Impact and Feasibility scores. The only difference between rural and non-rural clinicians was on community referrals with rural clinicians having significantly lower Fit scores than non-rural (p < 001). No other clinician or practice characteristics were related to overall Fit scores.
Average FIT scores were marginally lower (p < 0.06) for respondents selecting cancer survivorship as their top area of need for assistance (M = 13.4) vs. primary prevention activities (M = 15.6) or cancer screening (M = 15.2) which did not differ.
Figure 1 presents a scatterplot illustrating mean ratings of results for impact and feasibility. As can be seen, only the strategy of adapting evidence-based intervention or guideline to practice had a mean rating falling into the upper right quadrant of having both moderate or greater impact and feasibility. Four strategies- referring patients to community resources; using audit and feedback or periodic reporting; building a health information technology tool; and assessing and redesigning clinic workflow had mean ratings falling into the bottom left quadrant of less than moderate ratings on both impact and feasibility.
Discussion
This study adds to the literature on clinician perspectives on CPC areas in which clinicians desire assistance. It also advances the implementation science literature on the characteristics and practicality of implementation strategies in the primary care context. In general, the strategies were rated as higher on impact than feasibility. An important recommendation for future research is to consider the combination of both feasibility and impact for selecting implementation strategies. This issue is similar to the broader issue of considering level of adoption and reach of interventions in addition to their clinical effectiveness (Glasgow, 2008; Glasgow & Emmons, 2007; Glasgow et al., 2013) to impact population health.
Few of the nine implementation strategies were high on both impact and feasibility, suggesting that optimal strategies to implement evidence-based CPC activities will likely need to be developed or adapted for primary care settings. Supporting this interpretation, only ‘adapting to my practice’ was rated higher than a 4 (“moderate”) on both impact and feasibility. In contrast, some of the strategies such as practice facilitation were not viewed as feasible, especially in rural settings. Referring patients to community resources was not seen as either feasible or impactful, especially in rural settings, possibly reflecting the relative dearth of CPC resources in these settings.
There was moderate variability on ratings of each implementation strategy. Respondents used the entire 1–6 range in rating the feasibility and impact of all the strategies. With few exceptions this variability was not explained by rural vs. non-rural differences, type of CPC activity being rated, or other clinician, practice, or patient populations factors. This study investigated only a handful of quantitative practice and clinician characteristics. There are multiple possible factors that may have influenced results or obscured differences related to these factors including ease of implementation, availability of resources or other unmeasured influences. Due to survey length restrictions, it was only possible to investigate a few clinician and practice characteristics. More investigation of context—and changing context (Pfadenhauer et al., 2017) is needed. It may also be that ‘micro-tailoring’ is needed: that there is not one category of strategies that is generally more preferred, but that strategies need to be selected in each practice to deal with practice-specific contexts.
This research is an important early step in identifying implementation strategies likely to be most useful for delivering evidence-based CPC services in primary care. Other steps could include (1) evaluating if actual ‘observed feasibility’ (implementation consistency) and impact (effectiveness) are similar to these clinician ratings of projected impact and feasibility (Damschroder et al., 2022; Reilly et al., 2020) and (2) investigating additional ERIC strategies (Powell et al., 2015; Waltz et al., 2015) or those created by practice teams. Implementing and studying CPC activities in primary care is a challenging undertaking, including complexities such as that context, personnel, and competing demands. Implementation strategies often change over time, (Kirk et al., 2020) and strategies are often used in combinations or strategy bundles (Miller et al., 2020). Thus, sequential or contingent selection and tracking of strategies may be important.
This report has several strengths and some limitations. Its strengths include the moderately large sample size and especially the good sized sample of rural primary care clinicians; a variety of practice types, clinician and patient panel characteristics; the random order of presentation of implementation strategies across respondents to control for potential order effects; inclusion of strategies from multiple ERIC categories and those found be applicable in primary care settings; (Perry et al., 2019) and comparison of results for primary prevention, cancer screening and survivorship support activities. We were also able to conduct some subgroup comparisons, especially those relevant to rural-non-rural differences for which there are often insufficient sample sizes to conduct such analyses.
Key limitations include the relatively low survey return rate despite following many best survey research practices recommended by Dillman (Dillman & Christian, 2014) and others (Brtnikova et al., 2018) inclusion of signed, strong letters of support from PBRN leaders and a $50 stipend. This return rate and possibly the observed ratings may be due at least in part to the challenges of coping with COVID-19 and in some cases even the tenuous continued existence of the practices of the clinicians surveyed. In contrast, response rates in surveys to physicians before COVID-19 outbreak were as low as 11% (Cook et al., 2016). Consequently, this is a convenience rather than representative sample; is composed primarily family physicians; and does not represent the perspectives of patients, internal medicine physicians or other practitioners (e.g., PAs and NPs who deliver many services in some rural and low resource practices). Due to the knowledge required to make ratings and survey length restrictions, we only had respondents rate the CPC area in which they most need assistance, rather than have clinicians rate strategies for each CPC activity which would have had methodological advantages.
Although we have hypotheses concerning why the observed pattern of results was obtained, without supporting qualitative data or experimental tests of such interpretations we cannot be confident in these explanations. There was also considerable variability across clinicians, suggesting that there may be other unmeasured contextual factors that influenced our results.
Conclusions
This study obtained clinician perspectives on the estimated feasibility and impact of different implementation strategies. Impact ratings were moderate and feasibility ratings somewhat lower across a variety of CPC activities, clinicians and types of primary care settings. There were few differences observed between clinicians in rural and non-rural settings on feasibility, impact, or overall ‘fit’ of strategies, despite the well documented challenges of rural CPC (Blake et al., 2017; Charlton et al., 2015). Future research is needed to replicate and expand these findings with different settings and populations, including other types of preventive service activities and implementation strategies.
Acknowledgements
We would like to thank all PBRNs and their leaders for their support, specifically Dr. Andrea Nederveld and The Partners Engaged in Achieving Change in Health Network, Paulette Lail Kashiri, MPH and Ben Webel and The Virginia Ambulatory Care Outcomes Research Network, Tamara Oser, MD and Linda Zittleman, MSPH and The High Plains Research Network, Brian Manning, MPH, CHES and The National Research Network and American Academy of Family Physicians. Big thanks to the P50 team who helped pretest and pilot the survey. Big thanks to Monica McNulty for assisting with statistical analysis. Finally, we would like to thank Elise Robertson, John Cronin and Rebekah Marsh for help during data collection.
Appendix 1
Survey on primary care priorities for prevention activities
We would like to understand how you think about and prioritize prevention and screening for different chronic illnesses among your adult patients. This survey should take approximately 10 min. You will be compensated with a $50 gift card, or you may elect to donate the $50 to one of several charities. To be eligible for the incentive, you need to be one of the following: Doctor of Medicine (MD), Doctor of Osteopathic Medicine (DO), Nurse Practitioner (NP), or a Physician's Assistant (PA).
Your responses will be confidential. Results will be reported only in summary fashion. You, and if relevant, your practice-based research network will receive summary results of the survey.
This survey is being conducted as part of the Pragmatic Implementation Science Approaches to Assess and Enhance Value of Cancer Prevention and Control in Rural Primary Care Project funded by The National Cancer Institute. The research study is based at the University of Colorado | Anschutz Medical Campus. Participation in this survey is completely voluntary. By answering the questions and submitting the questionnaire you are providing consent and permission to use the information shared. If you have questions, you can contact Bryan Ford at bryan.ford@cuanschutz.edu or 303.724.3422. If you have questions about your rights as a participant, you can call the COMIRB (the responsible Institutional Review Board) at 303–724-1055. We believe this research study presents no risk to all participants; if you do not want to respond to any question, simply skip it. There may be risks the researchers have not thought of. This study is not designed to benefit you directly. The data we collect will be used for this study but may also be important for future research. Your data may be used for future research or distributed to other researchers for future study without additional consent if information that identifies you is removed from the data.
Authors contribution
RG participated in Conceptualization, Methodology, Formal analysis, Writing—Original Draft, Writing—Review & Editing, Supervision, Funding acquisition. MB participated in Conceptualization, Methodology, Formal analysis, Investigation, Resources, Writing—Original Draft, Writing—Review & Editing, Visualization, Supervision, Project administration. LMD participated in Conceptualization, Methodology, Formal analysis, Writing—Original Draft, Writing—Review & Editing. JC participated in Methodology, Investigation, Resources, Writing—Review & Editing, Project administration. JS participated in Conceptualization, Methodology, Writing—Review & Editing.
Funding
This study was partially supported by NCI Implementation Science Center grant P50CA244688 and Comprehensive Cancer Center grant P30CA046934. The funder did not participate in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.
Data availability
The datasets during and/or analyzed during the current study available from the corresponding author on reasonable request.
Code availability
Codes will be shared upon request.
Declarations
Conflicts of interest
Dr. Studts has provided compensated consultation to the J&J Lung Cancer Initiative, uncompensated consultation to Genentech, and serves on a Medical Advisory Board for the Lung Ambition Alliance, supported by AstraZeneca. None of the other authors have conflict of interest.
Ethical approval
This study was approved as expedited by the Colorado Multiple Institutional Review Board, protocol # 19-1706.
Consent to participate
The Waiver of Consent was approved by the Colorado Multiple Institutional Review Board (no identifiable data was collected).
Consent for publication
N/A (no individual’s data or images are published).
Footnotes
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- Blake KD, Moss JL, Gaysynsky A, Srinivasan S, Croyle RT. Making the case for investment in rural cancer control: an analysis of rural cancer incidence, mortality, and funding trends. Cancer Epidemiology, Biomarkers & Prevention. 2017;26(7):992–997. doi: 10.1158/1055-9965.EPI-17-0092. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brownson RC, Colditz GA, Proctor EK. Dissemination and implementation research in health: Translating science to practice. 2. Oxford University Press; 2017. [Google Scholar]
- Brtnikova M, Studts JL, Robertson E, Dickinson LM, Carroll JK, Krist AH, Cronin JT, Glasgow RE. Priorities for improvement across cancer and non-cancer related preventive services among rural and non-rural clinicians. BMC Primary Care. 2022;23(1):231. doi: 10.1186/s12875-022-01845-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brtnikova M, Crane LA, Allison MA, Hurley LP, Beaty BL, Kempe A. A method for achieving high response rates in national surveys of U.S. primary care physicians. PLOS ONE. 2018;13(8):e0202755. doi: 10.1371/journal.pone.0202755. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brtnikova M, Studts JL, Robertson E, Dickinson LM, Carroll JK, Krist AH, et al. Priorities for improvement across cancer and non-cancer related preventive services among rural and non-rural clinicians. BMC Prim Care. 2022;23(1):231. doi: 10.1186/s12875-022-01845-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science. 2013;8:117. doi: 10.1186/1748-5908-8-117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Charlton M, Schlichting J, Chioreso C, Ward M, Vikas P. Challenges of rural cancer care in the United States. Oncology (Williston Park) 2015;29(9):633–640. [PubMed] [Google Scholar]
- Cook DA, Wittich CM, Daniels WL, West CP, Harris AM, Beebe TJ. Incentive and reminder strategies to improve response rate for internet-based physician surveys: A randomized experiment. Journal of Medical Internet Research. 2016;18(9):e244. doi: 10.2196/jmir.6318. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Damschroder LJ, Reardon CM, Opra Widerquist MA, Lowery J. Conceptualizing outcomes for use with the consolidated framework for implementation research (CFIR): The CFIR outcomes addendum. Implementation Science. 2022;17(1):7. doi: 10.1186/s13012-021-01181-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dillman DA, Christian LM. Internet, Phone, Mail, and Mixed-Mode Surveys: The Tailored Design Method. 4. John Wiley & Sons Inc.; 2014. [Google Scholar]
- Fisher EB, Fitzgibbon ML, Glasgow RE, Haire-Joshu D, Hayman LL, Kaplan RM, Nanney MS, Ockene JK. Behavior matters. American Journal of Preventive Medicine. 2011;40(5):e15–30. doi: 10.1016/j.amepre.2010.12.031. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Glasgow RE. What types of evidence are most needed to advance behavioral medicine? Annals of Behavioral Medicine. 2008;35(1):19–25. doi: 10.1007/s12160-007-9008-5. [DOI] [PubMed] [Google Scholar]
- Glasgow RE, Brownson RC, Kessler RS. Thinking about health-related outcomes: What do we need evidence about? Clinical and Translational Science. 2013;6(4):286–291. doi: 10.1111/cts.12080. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Glasgow RE, Emmons KM. How can we increase translation of research into practice? Types of evidence needed. Annual Review of Public Health. 2007;28:413–433. doi: 10.1146/annurev.publhealth.28.021406.144145. [DOI] [PubMed] [Google Scholar]
- Hall IJ, Tangka FKL, Sabatino SA, Thompson TD, Graubard BI, Breen N. Patterns and trends in cancer screening in the United States. Preventing Chronic Disease. 2018;15:E97. doi: 10.5888/pcd15.170465. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Harry ML, Saman DM, Truitt AR, Allen CI, Walton KM, O'Connor PJ, et al. Pre-implementation adaptation of primary care cancer prevention clinical decision support in a predominantly rural healthcare system. BMC Medical Informatics and Decision Making. 2020;20(1):117. doi: 10.1186/s12911-020-01136-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jacobs SR, Weiner BJ, Bunger AC. Context matters: Measuring implementation climate among individuals and groups. Implementation Science. 2014;9:46. doi: 10.1186/1748-5908-9-46. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Khan S, Chambers D, Neta G. Revisiting time to translation: Implementation of evidence-based practices (EBPs) in cancer control. Cancer Causes and Control. 2021;32(3):221–230. doi: 10.1007/s10552-020-01376-z. [DOI] [PubMed] [Google Scholar]
- Kirk MA, Moore JE, Wiltsey Stirman S, Birken SA. Towards a comprehensive model for understanding adaptations' impact: The model for adaptation design and impact (MADI) Implementation Science. 2020;15(1):56. doi: 10.1186/s13012-020-01021-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Luig T, Asselin J, Sharma AM, Campbell-Scherer DL. Understanding implementation of complex interventions in primary care teams. Journal of the American Board of Family Medicine. 2018;31(3):431–444. doi: 10.3122/jabfm.2018.03.170273. [DOI] [PubMed] [Google Scholar]
- Meissner P, Cottler LB, Eder MM, Michener JL. Engagement science: The core of dissemination, implementation, and translational research science. J Clin Transl Sci. 2020;4(3):216–218. doi: 10.1017/cts.2020.8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Miller CJ, Wiltsey-Stirman S, Baumann AA. Iterative decision-making for evaluation of adaptations (IDEA): A decision tree for balancing adaptation, fidelity, and intervention impact. Journal of Community Psychology. 2020;48(4):1163–1177. doi: 10.1002/jcop.22279. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Neta G. Ensuring the value of cancer research: Opportunities in implementation science. Trends Cancer. 2021;7(2):87–89. doi: 10.1016/j.trecan.2020.10.003. [DOI] [PubMed] [Google Scholar]
- Oh A, Vinson CA, Chambers DA. Future directions for implementation science at the national cancer institute: Implementation science centers in cancer control. Transl Behav Med. 2021;11(2):669–675. doi: 10.1093/tbm/ibaa018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Perry CK, Damschroder LJ, Hemler JR, Woodson TT, Ono SS, Cohen DJ. Specifying and comparing implementation strategies across seven large implementation interventions: A practical application of theory. Implementation Science. 2019;14(1):32. doi: 10.1186/s13012-019-0876-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pfadenhauer LM, Gerhardus A, Mozygemba K, Lysdahl KB, Booth A, Hofmann B, et al. Making sense of complexity in context and implementation: The Context and Implementation of complex interventions (CICI) framework. Implementation Science. 2017;12(1):21. doi: 10.1186/s13012-017-0552-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Powell BJ, Beidas RS, Lewis CC, Aarons GA, McMillen JC, Proctor EK, et al. Methods to improve the selection and tailoring of implementation strategies. The Journal of Behavioral Health Services & Research. 2017;44(2):177–194. doi: 10.1007/s11414-015-9475-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: Results from the expert recommendations for implementing change (ERIC) project. Implementation Science. 2015;10:21. doi: 10.1186/s13012-015-0209-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Proctor EK, Powell BJ, McMillen JC. Implementation strategies: Recommendations for specifying and reporting. Implementation Science. 2013;8:139. doi: 10.1186/1748-5908-8-139. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rabin B, Glasgow RE. An implementation science perspective on psychological science and cancer: What is known and opportunities for research, policy, and practice. American Psychologist. 2015;70(2):211–220. doi: 10.1037/a0036107. [DOI] [PubMed] [Google Scholar]
- Ramon C. Littell GAM., Walter W. Stroup., Russell D. Wolfinger. (1999). SAS System for Mixed Models. 2nd (ed.) Cary, NC: SAS Institute, Inc. p 656
- Reilly KL, Kennedy S, Porter G, Estabrooks P. Comparing, contrasting, and integrating dissemination and implementation outcomes included in the RE-AIM and implementation outcomes frameworks. Frontiers in Public Health. 2020;8:430. doi: 10.3389/fpubh.2020.00430. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Saman DM, Walton KM, Harry ML, Asche SE, Truitt AR, Henzler-Buckingham HA, et al. Understanding primary care providers' perceptions of cancer prevention and screening in a predominantly rural healthcare system in the upper Midwest. BMC Health Services Research. 2019;19(1):1019. doi: 10.1186/s12913-019-4872-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sauer AG, Siegel RL, Jemal A, Fedewa SA. Updated review of prevalence of major risk factors and use of screening tests for cancer in the united states. Cancer Epidemiology, Biomarkers & Prevention. 2017;26(8):1192–1208. doi: 10.1158/1055-9965.EPI-17-0219. [DOI] [PubMed] [Google Scholar]
- Shelton RC, Chambers DA, Glasgow RE. An extension of RE-AIM to enhance sustainability: Addressing dynamic context and promoting health equity over time. Frontiers in Public Health. 2020;8:134. doi: 10.3389/fpubh.2020.00134. [DOI] [PMC free article] [PubMed] [Google Scholar]
- U.S. Department of Agriculture ERS. (2010). Rural-Urban commuting area codes. U.S. Department of Agriculture Economic Research Service 2010 [updated 8/17/2020. Available from: https://www.ers.usda.gov/data-products/rural-urban-commuting-area-codes.aspx.
- Waltz TJ, Powell BJ, Fernandez ME, Abadie B, Damschroder LJ. Choosing implementation strategies to address contextual barriers: Diversity in recommendations and future directions. Implementation Science. 2019;14(1):42. doi: 10.1186/s13012-019-0892-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Waltz TJ, Powell BJ, Matthieu MM, Damschroder LJ, Chinman MJ, Smith JL, et al. Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: Results from the Expert recommendations for implementing change (ERIC) study. Implementation Science. 2015;10:109. doi: 10.1186/s13012-015-0295-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The datasets during and/or analyzed during the current study available from the corresponding author on reasonable request.
Codes will be shared upon request.