Skip to main content
Implementation Science : IS logoLink to Implementation Science : IS
. 2018 Nov 29;13:144. doi: 10.1186/s13012-018-0833-7

De-implementation of low value castration for men with prostate cancer: protocol for a theory-based, mixed methods approach to minimizing low value androgen deprivation therapy (DeADT)

Ted A Skolarus 1,2,, Sarah T Hawley 1, Daniela A Wittmann 2, Jane Forman 1, Tabitha Metreger 1, Jordan B Sparks 1, Kevin Zhu 1, Megan E V Caram 1,3, Brent K Hollenbeck 2, Danil V Makarov 5,6, John T Leppert 7,8, Jeremy B Shelton 9, Vahakn Shahinian 10, Sriram Srinivasaraghavan 11, Anne E Sales 1,4
PMCID: PMC6262964  PMID: 30486836

Abstract

Background

Men with prostate cancer are often castrated with long-acting injectable drugs termed androgen deprivation therapy (ADT). Although many benefit, ADT is also used in patients with little or nothing to gain. The best ways to stop this practice are unknown, and range from blunt pharmacy restrictions to informed decision-making. This study will refine and pilot two different de-implementation strategies for reducing ADT use among those unlikely to benefit in preparation for a comparative effectiveness trial.

Methods/design

This innovative mixed methods research program has three aims. Aim 1: To assess preferences and barriers for de-implementation of chemical castration in prostate cancer. Guided by the theoretical domains framework (TDF), urologists and patients from facilities with the highest and lowest castration rates across the VA will be interviewed to identify key preferences and de-implementation barriers for reducing castration as prostate cancer treatment. This qualitative work will inform Aim 2 while gathering rich information for two proposed pilot intervention strategies. Aim 2: To use a discrete choice experiment (DCE), a novel barrier prioritization approach, for de-implementation strategy tailoring. The investigators will conduct national surveys of urologists to prioritize key barriers identified in Aim 1 for stopping incident castration as localized prostate cancer treatment using a DCE experiment design. These quantitative results will identify the most important barriers to be addressed through tailoring of two pilot de-implementation strategies in preparation for Aim 3 piloting. Aim 3: To pilot two tailored de-implementation strategies to reduce castration as localized prostate cancer treatment. Building on findings from Aims 1 and 2, two de-implementation strategies will be piloted. One strategy will focus on formulary restriction at the organizational level and the other on physician/patient informed decision-making at different facilities. Outcomes will include acceptability, feasibility, and scalability in preparation for an effectiveness trial comparing these two widely varying de-implementation strategies.

Discussion

Our innovative approach to de-implementation strategy development is directly aligned with state-of-the-art complex implementation intervention development and implementation science. This work will broadly advance de-implementation science for low value cancer care, and foster participation in our de-implementation evaluation trial by addressing barriers, facilitators, and concerns through pilot tailoring.

Trial registration

ClinicalTrials.gov Identifier: NCT03579680, First Posted July 6, 2018.

Keywords: Castration, De-implementation, Choosing wisely, Low value care, Implementation science, Intervention, Formulary restriction, Decision-making, Behavior change, Discrete choice, Stakeholder, Androgen deprivation therapy (ADT)

Background

Prostate cancer is the most common male cancer in the USA [1]. One in three men with prostate cancer is chemically castrated at some point with long-acting injectable drugs (i.e., androgen deprivation therapy or ADT) [2]. This impacts the well-being of thousands of men annually. Although some patients with prostate cancer benefit from ADT in terms of survival and symptom improvement, chemical castration is also commonly performed when there is no high level evidence for use and little to no health benefits to patients raising questions of low value care. A growing awareness of iatrogenic harms (e.g., heart attack, osteoporosis, diabetes, loss of sexual function) [3], coupled with a lack of evidence supporting chemical castration in many cases [1, 46], creates patient safety concerns. Despite this, chemical castration with ADT in low value cases persists as in the case of localized prostate cancer treatment [7].

Because prostate cancer cells are dependent on androgens, e.g., testosterone, androgen deprivation with castration can improve clinical outcomes, for some patients [8]. The highest levels of evidence for chemical castration with ADT injections to treat prostate cancer occur in two scenarios: (1) high risk localized disease in combination with radiation therapy, and (2) metastatic cancer with spread to bones or other organs causing symptoms such as pain [811]. However, a significant amount of castration among patients receiving fee-for-service or integrated health system care occurs outside those instances where high levels of benefit exist [1, 47]. Neither long-term studies nor current guidelines support castration as primary treatment for localized prostate cancer [11]. For example, using castration for the primary treatment of localized prostate cancer does not improve prostate cancer-specific survival and can be harmful [12], yet remains common in the US Veterans Health Administration [13], a large publicly funded integrated health system, as well as among patients in the US Medicare system [14]. Many times, this castration, which is potentially reversible, is continued indefinitely without clear indication. Even in cases of metastatic prostate cancer without symptoms, an American Society of Clinical Oncology Panel could not recommend initiating treatment with ADT before symptoms of disease progression (e.g., bone pain) occur due to the lack of evidence of an overall survival advantage for early treatment [15].

There are several possible reasons why low value ADT in the treatment of localized prostate cancer persists. First, ADT decreases the serum PSA level, a biomarker of prostate cancer activity, providing false reassurance of a “remission.” This is potentially harmful in a couple of ways. Depriving prostate cancer cells of testosterone too early in the disease process may foster castration resistance, limiting ADT’s effectiveness when it may actually be needed later (e.g., metastatic setting) [16, 17], and PSA is a poor surrogate marker for survival in localized disease so a lowered PSA in this setting creates false optimism [18]. Second, surgical specialists are prescribing a drug with potentially devastating metabolic and cardiovascular effects creating a disconnect between treating PSA levels among men with localized disease and the consequences. Primary care providers are often left to deal with this combination of treating PSA levels without good evidence, and the significant negative health consequences for the patient [1922].

Ineffective and harmful practices such as chemical castration of patients with prostate cancer outside of the evidence base are ripe for de-implementation. De-implementation, or stopping low value practices, has the potential to improve patient outcomes and decrease healthcare costs [2326]. For example, stopping chemical castration for localized prostate cancer treatment could prevent harm, and limit spending without affecting survival. However, provider and patient preferences regarding de-implementation are not well understood, and possible de-implementation interventions range from blunt policies to more informed decision-making, potentially with decision support tools to facilitate unlearning [23, 2729]. Blunt policy interventions such as formulary restriction of ADT (e.g., pre-authorization, order templates) might seem warranted given patient safety concerns, yet could result in significant provider resistance, work-arounds, and even a chilling effect on evidence-supported use of ADT if introduced poorly [3043]. More nuanced, patient-centered interventions such as informed decision-making (e.g., decision aid, values elicitation) likely involve extra clinical time [4446]. Both intervention strategies need tailoring for acceptability and feasibility in clinical practice, including piloting prior to trialing [47]. The messaging and operation of strategies to stop low value cancer care hinges on stakeholder input. As many medical practices lack evidence and cause harm, robust behavioral theory-based methods for incorporating provider preferences into de-implementation strategy development will advance both implementation research and practice. While lowering PSA might make sense on the surface, understanding beliefs and preferences for using ADT is a critical step in stopping its low value use. In many respects, this is an ideal model for understanding de-implementation of low value cancer care.

Our preliminary data indicate thousands of men are at risk of ongoing low value castration, especially those with localized disease. Indeed, this calls for effective de-implementation strategies grounded in an understanding of context, provider and patient preferences, and evidence-based behavior change techniques to overcome the wide variation in practice patterns we have observed [4857]. A significant scientific and clinical knowledge gap remains in prioritizing which barriers to stopping castration in low value settings need to be targeted for effective de-implementation. While a major focus in this study pertains to identifying, prioritizing, and overcoming barriers, the facilitators for stopping ADT which may be transferable across settings also need to be considered [58]. Using a discrete choice experiment (DCE) will allow prioritization of both positive (facilitators, preferences) and negative factors (barriers) to guide theory-based de-implementation strategies as a promising stakeholder-based approach applicable to other low value cancer care [5963].

Methods/design

For these reasons, we will examine urologist and patient perspectives on chemical castration with ADT in low value conditions, i.e., as localized prostate cancer treatment. Using a theory-based, exploratory-sequential mixed methods approach to tailor different de-implementation strategies, we will pilot interventions to prepare for a pragmatic, randomized comparative effectiveness trial of two different approaches that vary widely in delivery, impact, and expected results for reducing low value ADT use. We have three specific aims:

  • Aim 1: To assess preferences and barriers for de-implementation of chemical castration in prostate cancer. Guided by the theoretical domains framework (TDF) [49, 64, 65], we will interview urologists and patients from facilities with the highest, and a few of the lowest, castration rates across an integrated delivery system to identify key preferences and de-implementation barriers, as well as facilitators, for reducing castration as prostate cancer treatment. This qualitative work will inform Aim 2 and gather rich information for our proposed pilot intervention strategies.

  • Aim 2: To use a discrete choice experiment, a novel barrier prioritization approach, for de-implementation strategy tailoring. We will conduct a national survey of urologists to prioritize the key barriers identified in Aim 1 for not recommending castration as localized prostate cancer treatment using a DCE. These quantitative results will identify the most important barriers to be addressed through tailoring of our two pilot de-implementation strategies in preparation for Aim 3 piloting.

  • Aim 3: To pilot two tailored de-implementation strategies to reduce castration as localized prostate cancer treatment. Building on findings from Aims 1 and 2, we will refine two pilot de-implementation strategies. One strategy will focus on formulary restriction at the organizational level, and the other on decision-making at the physician/patient level. Outcomes will include acceptability, feasibility, and scalability [66] in preparation for an effectiveness trial comparing these two widely varying de-implementation strategies across the integrated delivery system.

Conceptual framework

It is useful to consider a conceptual model for theory-based qualitative barrier assessment (Aim 1), quantitative prioritization (Aim 2), and piloting of de-implementation strategies tailored to provider behavior change techniques (Aim 3). As illustrated in Fig. 1, we highlight several TDF domains and constructs in our conceptual model that may contribute to organizational, provider, and patient behavior in the setting of ADT for localized prostate cancer. In addition, our qualitative approach allows for flexibility as we conceptualize the main issues when it comes to chemical castration. Last, the quantitative discrete choice methods (Aim 2) create significant opportunities to examine interactions among domains and constructs allowing us to select, tailor, and pilot the most informed organizational and individual level de-implementation interventions during Aim 3.

Fig. 1.

Fig. 1

Conceptual model for de-implementation of low value prostate cancer care

Setting

This study is being conducted across several sites in the Veterans Health Administration with the majority of study activities at two sites: the VA Health Services Research & Development Center for Clinical Management Research at the VA Ann Arbor Healthcare System and the Rogel Cancer Center at the University of Michigan.

Study population and eligibility criteria

We will identify potential study participants using methods successfully used in prior studies of VA providers and prostate cancer survivors [67, 68]. Specifically for the Aim 1 semi-structured provider interviews, we will purposefully sample 10–12 urologists from our integrated delivery system facilities with the highest use of castration as primary treatment to achieve thematic saturation. Likewise, we will also sample 2–4 urologists from facilities with the lowest use of castration. Any urologist who has experience caring for prostate cancer patients on ADT and expresses interest in prostate cancer care will be eligible to participate in semi-structured interviews. We will consider interviewing non-physician providers (e.g., nurse practitioners) if they prescribe a significant amount of ADT. To better understand patient perspectives on not initiating or stopping castration with ADT, we also plan to conduct a limited number of patient interviews (~ 6) from high outlier sites.

For the Aim 2 DCE, we will distribute invitations to the national VA Urology listserv which includes approximately 250 VA urologists. We anticipate this survey will be available over the intranet, as an online survey, as well as available in paper and pen form if preferred. We will use a modified Dillman technique to enhance response rates similar to prior successful survey research [69]. Our engagement with the national VA Urology listserv and the American Urological Association Annual Meeting, alongside operational support from the VA Urology Surgery Advisory Board, should ensure that at least the minimum number of providers needed participate. If needed, we can pursue other organizations (e.g., American Urological Association, Society of Urologic Oncology) given our prominent urologic oncology team.

For Aim 3, we will conduct pilot testing at two sites during years 3 and 4 of this proposal. This will take place at the VA Ann Arbor Healthcare System and University of Michigan’s Rogel Cancer Center Urologic Oncology clinics. The number of patients initiating primary ADT at each site should be adequate for piloting based on preliminary data. However, the primary purpose of the pilots is to assess for issues described in more detail below [70], not effectiveness, so the number of patients on ADT is not critical to success for pilot outcomes.

Potential human subjects risks and protections against them

This proposal received Institutional Review Board approval from the VA Ann Arbor Healthcare System and the University of Michigan. Aim 1 initially involves analyses of retrospective administrative data to identify facilities, their characteristics, and ADT utilization rates. Study data will come from the VA Corporate Data Warehouse and its Oncology database. This is a centrally maintained national electronic data repository consisting of cancer registry, laboratory, pharmacy, utilization, and administrative data for all patients receiving care in the delivery system. Reported data will be aggregated to the facility level which will not permit identification of individual patients or providers. Next, we will conduct semi-structured interviews with providers and a limited number of patients from facilities with the highest ADT treatment rates for localized prostate cancer. We will audiotape and analyze this data in Aim 1. The risks of the proposed semi-structured interviews are limited, but do include psychological stress related to discussions of appropriateness of prostate cancer treatment with ADT and possible tensions given the low levels of evidence supporting ADT use in localized disease. Another risk is the potential breach of confidentiality of this interview data. Precautions will be taken to protect against any such breach, making the risk low, following standard operating procedures at our Center. Potential human subjects’ risks for the national survey in Aim 2 are low including an email and minimal disruption to provider work flow. With the exception of some demographic information (e.g., age in 5-year increments), the participant information and responses will be kept anonymous. Aim 3 risks for pilot site providers include disruption of clinical workflow and a low likelihood of psychological distress. These risks will be site- and intervention-dependent with a research assistant on-site to assist with recruitment, acceptability of the intervention, feasibility in clinical practice, and data collection and outcome assessment issues. The right of subjects to discontinue their involvement in the research at any time will also be fully disclosed during the informed consent process.

Participant recruitment and consent

For the qualitative portions of Aim 1, in person and telephone interviews will be piloted with providers at the VA Ann Arbor Healthcare System followed by 12–16 urologists from several other VA Medical Centers as described. Medical Center Directors and Chief Urologists will be contacted via email and brief telephone calls initially and will also be provided information on the nature and purpose of the study, as well as the types of questions their providers will be asked. With approval, urologists who express an interest in participation will be consented by a trained research assistant, who will provide them with information on the nature and purpose of the study, as well as the types of questions that they will be asked (focused on ADT treatment for prostate cancer). Written or recorded phone consent will be obtained. Those who are eligible will then be called at a later date for a formal interview lasting approximately 45 min. Interviews will be conducted by the study team and will be audiotaped. We will use similar recruitment methods for our limited number of patient interviews.

For the survey portion of Aim 2, providers will be identified through a national urologist email listserv and contacted/recruited via email to participate in a DCE survey. An informed consent form will be included, highlighting the nature and purpose of the proposed research as well as sample questions. Participants will be asked to electronically sign the consent form, and will be clearly offered the option of not participating.

Urologists at the pilot sites in Aim 3 will be given an overview of the site-specific intervention, highlighting the nature and purpose of the proposed research, as well as what they should expect to encounter during routine clinical care should they agree to proceed with the study. Pilot site urologists will be asked to sign the consent form by the site research assistant, if they agree to participate, and will be clearly offered the option of not participating.

Aim 1 methods

The goal of Aim 1 is to clarify barriers and facilitators to stopping castration with ADT as primary prostate cancer treatment using an individual behavior change framework, the theoretical domains framework (TDF) [71]. This approach will identify key barriers to de-implementation of low value ADT-based castration. We will conduct semi-structured interviews with urologists to clarify preferences for (i.e., facilitators) and barriers to stopping ADT use. This will prepare us for development of a theory-based DCE among a national sample of urologists in Aim 2 to quantify the relative importance of barriers, and to direct intervention strategy tailoring to increase acceptability and effectiveness. Embedding use of the TDF within a DCE is particularly innovative.

Semi-structured provider and patient interviews

In order to maximize the likelihood that data collected from participants will address our study aims, we will pilot interviews with consultants and providers on our study team. Using the TDF to understand provider and patient ADT behavior will help (1) map our findings to key TDF behavioral constructs; (2) select appropriate evidence-based behavior change techniques (BCTs) [72, 73]; (3) understand barriers, facilitators, and stated preferences for our de-implementation interventions; and (4) advance implementation science. We will explore provider and patient (1) understanding of ADT as primary prostate cancer treatment, (2) harms of castration, (3) behavioral determinants and barriers to delivering (receiving for patients) ADT as primary prostate cancer treatment for localized prostate cancer, and (4) intention to treat localized prostate cancer with ADT.

Interviews will be audiotaped and transcribed verbatim for content. We will use a preliminary coding scheme based on the TDF and prior work [52, 74], consisting of a three step process including (1) coding affirmative and negative utterances regarding ADT use as localized treatment into TDF domains, (2) collecting responses across respondents into themes (e.g., “ADT prevents cancer spread” into a “ADT is beneficial” theme, “urologists should be able to treat patients as they wish” into a “Physician autonomy” theme), and (3) tallying the total number of mentions per theme, as well as conflicting beliefs within a theme (e.g., ADT is good vs. ADT is bad), according to the TDF domains, with particular emphasis on those included in our conceptual model. The principal investigator and research assistant will both independently review and code at least two transcripts and meet regularly to compare coding results until reaching agreement on code definitions and establish the reliability of the coding process (> 80% simple agreement). During this process, the research team will also meet to categorize the codes into TDF domains, identify emerging themes, and document ongoing data interpretation in memos. The research assistant will code the remaining transcripts. Once data are coded, we will use QSR NVivo™ software to organize the data. The research team will meet regularly to discuss code summaries and memos, developing findings with a focus on informing the Aim 2 discrete choice tool [75]. At the end of this aim, we will have identified the highest frequency themes and themes with conflicting provider and patient beliefs across TDF domains for de-implementing ADT.

Aim 2 methods

The goal of Aim 2 is to then prioritize barriers and facilitators to de-implementation of chemical castration with ADT discovered in Aim 1. The highest priority barriers will need to be addressed during strategy development and tailoring for our pilot interventions in Aim 3 to support acceptability and feasibility in practice. We will accomplish this using a DCE. This stated preference method drives marketing strategy development based on stakeholder preferences for a given practice and is a promising applied approach for health care optimization [5962, 76, 77]. Real-world DCE examples include prioritizing provider preferences related to hospital consultant work and electronic medical record use [78, 79].

In our DCE, the barriers and themes with the highest frequency and most conflicting beliefs across respondents identified in Aim 1 will be refined and presented as the “attributes” and associated levels will be developed. In short, we will use data obtained from Aim 1 to develop TDF-based choice sets for inclusion in a national urologist DCE. Once we have the most important, not just most common or conflicting, themes and barriers based on a national urologist DCE, we can select the most effective evidence-based behavior change techniques to direct de-implementation tailoring efforts in Aim 3.

In a DCE, stakeholders, in this case urologists prescribing ADT, choose between hypothetical alternatives described by themes and barrier characteristics identified from Aim 1 (i.e., attributes and levels). The five or six highest frequency and most conflicting themes based on Aim 1 findings will be varied across hypothetical examples. Through systematically varying a set of levels in a series of choice sets where providers are asked which option they most prefer, we gather critical data on castration preferences and tailoring for our pilot interventions. This results in a preference structure where certain attributes (barriers) are most important across the respondent sample. The data obtained on the levels of attributes shows which direction the attribute is most favored. In an example of whether high or low physician autonomy or level of evidence is driving ADT treatment decisions, for each choice set given, we will ask respondents to choose the situation that they would most prefer when prescribing ADT for their prostate cancer patients (choice A, choice B, or neither). We may ask participants: “Please select the situation that you most prefer when prescribing ADT as primary treatment.” Candidate themes, attributes, and levels include, for example, the ability to make the final recommendation (levels: yes, no), and the amount of clinical time required (levels: 15 min, 30 min). We will use an opt-out option to ensure realistic scenarios. Data from this DCE survey will identify leading themes and attributes (barriers).

Designing and fielding the national urologist DCE

We will decide on the number of attributes based on Aim 1 findings, likely 4–6 per scenario as suggested by the literature [63]. The DCE will measure TDF-based themes across 10–20 choice sets, pared down using a fractional factorial approach, to a reasonable number of hypothetical scenarios per respondent to minimize respondent burden. We will use software to construct the choice sets to identify the least number of choice sets completed by the least number of respondents to detect significant differences among covariates in our model. We will draft a DCE survey tool for refinement and pre-testing on our study team and a sample of urologists. We will modify it accordingly based on pre-testing. We will then distribute invitations to participate to the national VA Urology listserv which includes approximately 250 VA urologists. As described above, we may include other organizations if our response rate is lower than expected.

DCE statistical analysis

Discrete choice experiments are based on random utility theory which assumes that participants will select responses with the most personal utility [78]. Because respondents respond to a variety of choice sets, we will be able to estimate the relative priority of our barrier attributes and their levels. We will model urologists’ stated preferences providing quantitative information about the relative value, or utility, providers place on barrier attributes such as physician autonomy or clinical time, for example, using the equations below. If 50% of the 250 urologists respond: 125 surveys with ~ 5 scenarios − 625 scenarios × 5 attributes = 3125 data elements for analysis. Our methods will adjust for dependency of responses within individuals (autoregression) as they respond to different choice sets and will be modeled after published DCEs according to the following example equation:

Utility=constant+β1e.g.physician autonomy+β2e.g.clinical time

We will assess for model fit and need for random parameters among the attributes. Attribute levels will range from − 1 for our reference level to + 1 for the alternative to allow determination of relative importance. Our outcomes will be based on the beta parameter values (β1, β2, etc.) and standard errors that correspond to each attribute where a negative value will indicate preference for the reference group, statistical significance will be set at 0.05. Once we have our leading barrier attributes and corresponding TDF domains, we will select the most relevant candidate evidence-based behavior change technique components based on prior work by Michie et al. [49, 73] to guide tailoring of pilot de-implementation interventions. We also plan to adjust our models for facility-level ADT rates, and perform a subgroup analysis for facilities with high primary ADT rates to better understand barriers to tailor toward (Table 1).

Table 1.

Data sources and variables

Information Source Variables
Aim 1
 Barriers and facilitators to stopping low value chemical castration 12–16 urologists, selected patients from high and a few low ADT facilities Semi-structured interview data coded into themes and TDF domains for use in Aim 2
Aim 2
 Themes, barriers, attributes for discrete choice scenarios TDF domains and themes related to treating localized prostate cancer with ADT from Aim 1 4–6 attributes with varying levels (e.g., physician autonomy, clinical time)
 Discrete choice experiment (DCE) Mixed multinomial logit analysis of DCE survey results among national sample of urologists Choice sets, attributes, model outcomes (barrier attribute weights)
 Behavior change techniques for most relevant attributes for Aim 3 Michie et al. The Behavior Change Wheel: A Guide to Designing Interventions [72] Relevant TDF domains from the DCE model output for use in tailoring strategies

Broad intervention strategies require tailored design: formulary restriction and decision-making

There are several potential implementation strategies to de-implement low value castration within the broad categories we identified for this proposal. We focus on formulary restriction and informed decision-making because of their difference in key attributes, including level (organizational vs. individual), likelihood of quick success vs. long-term sustainment, and effort required by clinicians. We describe some possible strategy design features briefly for each type in Table 2. While several options exist, there is no existing evidence to inform the best approach from the provider perspective. Aims 1 and 2 will inform which of these strategies is likely to be most acceptable to clinicians, and provide data needed to tailor them. For example, we do not know how a blunt formulary restriction intervention would be received by providers considering primary ADT treatment.

Table 2.

Examples of potential pilot de-implementation interventions

Formulary restriction
 Prior authorization
 - Oncology consultation
 - Pharmacy review
Used in infectious disease
 Criteria for use
 - EMR order template
 - Selected prescribers
Currently used for restricted drugs
 Medication safety (VAMedSAFE) Evaluate, educate, and prevent adverse events
Decision-making
 Decision aid using a brief in-office pro/con (e.g., Option Grid™) Commercialized shared decision-making for prostate cancer
 Provider training in communication and values elicitation Evidence-based practice though difficult to implement/sustain
 Informed consent for ADT VA iMed consent

While formulary restriction of ADT for localized prostate cancer seems warranted, we may find that it is widely considered unacceptable to providers and patients. Nor do we know how shared or informed decision-making can be efficiently operationalized in a clinical setting for patients considering castration for localized disease. By tailoring each strategy using behavior change techniques and barrier solutions derived from Aims 1 and 2, we believe we can design implementation interventions that will be accepted by providers, but still allow us to test differences in the widely varying mechanisms of action. We will refine these approaches through robust efforts and finding from Aims 1 and 2 (Table 1) and the expertise of our trans-disciplinary investigative team.

Aim 3 methods

Based on findings from Aims 1 and 2, Aim 3 pilot work plays a critical role to help us understand the acceptability, feasibility, and scalability of these complex interventions in preparation for a full-scale randomized de-implementation evaluation trial. In fact, the UK Medical Research Council guidance indicates piloting is essential to complex intervention development and testing prior to large-scale evaluation [47]. The main goal of both pilots will be to decrease castration rates for patients with localized prostate cancer, in a way that is acceptable to patients and to the clinicians who treat these patients. We are purposely choosing intervention strategies from opposite ends of the behavior change continuum because of their evidence-based potential to change provider behavior. Specifically, we are selecting one approach (formulary restriction policy) that operates at the organizational level and is widely perceived as a forcing function, giving providers little leeway to exercise judgment. The other, physician/patient shared or informed decision-making, operates at an individual and dyadic level, and is perceived as maximizing the opportunity for discussions between patients and providers. The first approach requires little to no learning on the part of providers, while the second requires considerable upfront learning (“cost” to the provider and possibly also to the patient). This approach sets up a testable hypothesis for our subsequent comparative effectiveness trial, that a blunt de-implementation policy may be effective in the short term but that it will lose its effects as providers learn work-arounds. Conversely, a shared or informed decision-making approach to de-implementation might take longer to observe measurable decreases in castration rates, but its effects will create sustainable change as providers internalize and routinize this clinical practice.

Methodological issues to be addressed in de-implementation pilots

A well-designed pilot study has many purposes, including testing methods of recruitment, selecting the most appropriate primary outcome, testing acceptability of the intervention by stakeholders, ironing out feasibility and fidelity issues, developing the full study protocol, and estimating sample size for a full trial [70]. As highlighted in implementation literature, preparation and planning are central to successful pilot development and implementation [47, 58, 80]. The need for clear outcomes (e.g., inappropriate castration rate), systematic, theory-based interventions to change provider behavior (i.e., TDF-driven), and a timetable are necessary to successfully set up our full-scale evaluation trial. Although it is likely that chemical castration rates among prostate cancer patients will be our primary outcome for the full evaluation trial (# of primary ADT patients with localized prostate cancer/total incident prostate cancer patients), we will also need to consider implementation outcomes (e.g., feasibility) and hybrid study designs. Further refinement in the pilot studies will allow us to explore other outcomes including the total number of ADT injections as we will also be working to stop treatment among those with localized disease who have been continued on ADT. As illustrated in Table 3, the piloting of the intervention strategies will focus on four major methodological issues. We will examine issues surrounding recruitment, acceptability, feasibility, scalability, and data collection for the full-scale trial [66].

Table 3.

Methodological issues requiring Aim 3 pilot evaluation prior to a full-scale de-implementation trial

Issue Assessment Potential outcome
Recruitment randomization scalability Monitor proposed recruitment strategy at each facility; check practicality of cluster randomization of facilities; identify issues of participation refusal or withdrawal; acceptability of randomization; number of eligible participants per month; compare clinic flow across recruitment strategies Select most effective recruitment and randomization strategy; trial messaging to sites; discern patient, provider and cluster sample sizes; refining eligibility screening
Acceptability of intervention Check acceptability of interventions with urologists and clinic staff at pilot sites; settings for each intervention; consent and documentation practices; tailoring strategies are acceptable; timing of intervention relative to visit Identify acceptable components of each intervention in clinical practice; consent processes; efficient documentation practices
Feasibility in clinical practice Assess burden on clinic staff and providers to participate; monitor clinical time and workflow; assess adherence to intervention; technical performance of EMR-based intervention(s); participants representative of those expected in full-scale trial; intervention fidelity Time and resources needed to roll out in randomized sites; learn research and clinic administrative staff roles for trial; standardization; scheduling practices
Data collection and outcome assessment Monitor follow up practices for patients on ADT; monitor for asymmetric attrition/retention across intervention sites; missing data; review choice of primary outcome, study design; effect variability Willingness to participate by intervention preference; effect size; consider hybrid study; duration; full-scale protocol

Discussion

Many men with prostate cancer are castrated with long-acting injectable drugs. Although some patients benefit, it is also used in patients who have little or nothing to gain, such as men with localized prostate cancer. The best ways to stop, or de-implement, low value cancer care are unknown. A significant scientific and clinical knowledge gap remains in prioritizing which barriers to stopping castration in low value settings need to be targeted for effective de-implementation. Using a mixed methods approach, we will identify, refine, and pilot two different approaches for reducing low value ADT use in preparation for a randomized comparative effectiveness trial. In doing so, this proposal will address important issues surrounding provider behavior change and serve as a model to decrease overtreatment more broadly. Throughout this project, we will keep a broad focus so that our work lays a foundation for transforming how and why castration is performed for prostate cancer treatment. This work will advance de-implementation science for low value care and foster participation in our subsequent de-implementation evaluation trial by addressing preferences and concerns through pilot tailoring.

Dissemination

While the next steps for this work will be a cluster randomized comparative effectiveness trial, setting up this complex trial will create opportunities for dissemination. We will publish at least one manuscript per research aim in peer-reviewed journals, as well as submit at least one abstract to clinical, quality improvement, and/or implementation research meetings. We will convene a Steering Committee and update this group through quarterly phone calls as we progress through the research plan. In addition, we will present our findings to the American Society of Clinical Oncology, Society of Urologic Oncology, and the Association of VA Hematology/Oncology as an opportunity to include a de-implementation of low value cancer care theme in their annual meeting agendas. We will brief relevant operational partners annually including the VA National Program Director for Oncology and the VA National Urology Surgery Advisory Board. We will also share our findings and recruit for our cluster RCT at the Annual AUA Meeting.

Trial status

Provider recruitment for Aim 1 started in August 2018.

Acknowledgements

All authors receive funding from the National Institutes of Health for the project: De-implementation of Low Value Castration for Men with Prostate Cancer. The funding source did not play any role in the design; in the collection, analysis, and interpretation of data; in the writing of the manuscript; and in the decision to submit the manuscript for publication. The content is solely the responsibility of the authors and does not necessarily represent the official views of NIH.

Funding

This project is funded by a National Cancer Institute Award (1-R37-CA-222885-01). The funding source did not play any role in the design; in the collection, analysis, and interpretation of data; in the writing of the manuscript; and in the decision to submit the manuscript for publication. Dr. Skolarus is also supported by VA HSR&D Career Development Award −2 (CDA 12−171).

Availability of data and materials

The datasets supporting the conclusions of this article will be shared upon request. Members of the scientific community who would like a copy of the final data sets (i.e., data sets underlying any publication) from this study can request a copy by e-mailing Dr. Ted Skolarus at Ted.Skolarus@va.gov. The investigator should state their reason for requesting the data and their plans for analyzing the data. De-identified data will be provided after requestors sign a Letter of Agreement detailing the mechanisms by which the data will be kept secure and access restricted to their study team. The agreements will also state the recipient will not attempt to identify any individual whose data are included and will not share the data with anyone outside of their research team. The dataset will not include private or protected information and all dates will be changed to integers to allow for calculation of time periods. Final data sets will be copied onto a CD and limited data sets will be encrypted and the password will be sent to the requestor via e-mail. The CD will be sent to the requestor via FedEx. Each data set will be accompanied by documentation that lists all variables described in the publication and links them with variable names in the data set.

Abbreviations

ADT

Androgen deprivation therapy

AUA

American Urological Association

Authors’ contributions

TS, TM, MC, SH, JF, DW, AS, JBS, KZ, DM, JL, JS, BH, VS, and SS. TS conceived of the study, created the application that succeeded in obtaining the funding from the National Cancer Institute, and is the principal investigator of the study. The following authors reviewed and approved the grant submission: TS, BH, AS, ST. All authors contributed to the development of the intervention and study design, refinement of aims and recruitment process, and analysis plan of the study. TM managed study staff, ensured study compliance, organized meetings, provided staff training, managed study data, and completed all regulatory documents. TS drafted the manuscript. All authors read and approved the final manuscript.

Ethics approval and consent to participate

This study has been approved by the VA Ann Arbor Healthcare System IRB (IRB-2017-1047) and the University of Michigan IRB (HUM00133932). As this study is conducted solely by phone and by mail and is considered minimal risk, a waiver of documentation of signed informed consent and HIPAA Authorization was approved. Verbal informed consent is obtained for all patients participating in the research. Further information and documentation on IRB approval is available upon request.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests. Dr. Skolarus is a prostate cancer survivorship author for UpToDate™.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Contributor Information

Ted A. Skolarus, Phone: (734) 936-0054, Email: tskolar@med.umich.edu

Sarah T. Hawley, Email: sarahawl@umich.edu

Daniela A. Wittmann, Email: dwittman@med.umich.edu

Jane Forman, Email: jane.forman@va.gov.

Tabitha Metreger, Email: tabitha.metreger@va.gov.

Jordan B. Sparks, Email: jordan.sparks2@va.gov

Kevin Zhu, Email: kevzhu@umich.edu.

Megan E. V. Caram, Email: mveresh@med.umich.edu

Brent K. Hollenbeck, Email: bhollen@med.umich.edu

Danil V. Makarov, Email: danil.makarov@nyumc.org

John T. Leppert, Email: jleppert@stanford.edu

Jeremy B. Shelton, Email: jeremy.shelton@va.gov

Vahakn Shahinian, Email: vahakn@med.umich.edu.

Sriram Srinivasaraghavan, Email: ssrira@umich.edu.

Anne E. Sales, Email: salesann@med.umich.edu

References

  • 1.Shahinian VB, Kuo YF, Freeman JL, Goodwin JS. Determinants of androgen deprivation therapy use for prostate cancer: role of the urologist. J Natl Cancer Inst. 2006;98(12):839–845. doi: 10.1093/jnci/djj230. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Gilbert SM, Kuo YF, Shahinian VB. Prevalent and incident use of androgen deprivation therapy among men with prostate cancer in the United States. Urol Oncol. 2011;29(6):647–653. doi: 10.1016/j.urolonc.2009.09.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Skolarus TA, Wolf AM, Erb NL, Brooks DD, Rivers BM, Underwood W, 3rd, et al. American Cancer Society prostate cancer survivorship care guidelines. CA Cancer J Clin. 2014;64(4):225–249. doi: 10.3322/caac.21234. [DOI] [PubMed] [Google Scholar]
  • 4.Shahinian VB, Kuo YF, Gilbert SM. Reimbursement policy and androgen-deprivation therapy for prostate cancer. N Engl J Med. 2010;363(19):1822–1832. doi: 10.1056/NEJMsa0910784. [DOI] [PubMed] [Google Scholar]
  • 5.Lu-Yao GL, Albertsen PC, Moore DF, Lin Y, DiPaola RS, Yao SL. Fifteen-year outcomes following conservative management among men aged 65 years or older with localized prostate Cancer. Eur Urol. 2015;68(5):805–811. doi: 10.1016/j.eururo.2015.03.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Potosky AL, Haque R, Cassidy-Bushrow AE, Yood MU, Jiang M, Tsai HT, et al. Effectiveness of primary androgen-deprivation therapy for clinically localized prostate cancer. J Clin Oncol. 2014;32(13):1324. doi: 10.1200/JCO.2013.52.5782. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Yang DD, Mahal BA, Muralidhar V, Boldbaatar N, Labe SA, Nezolosky MD, et al. Receipt of definitive therapy in elderly patients with unfavorable-risk prostate cancer. Cancer. 2017;123(24):4832–4840. doi: 10.1002/cncr.30948. [DOI] [PubMed] [Google Scholar]
  • 8.Thompson I, Thrasher JB, Aus G, Burnett AL, Canby-Hagino ED, Cookson MS, et al. Guideline for the management of clinically localized prostate cancer: 2007 update. J Urol. 2007;177(6):2106–2131. doi: 10.1016/j.juro.2007.03.003. [DOI] [PubMed] [Google Scholar]
  • 9.Heidenreich A, Bastian PJ, Bellmunt J, Bolla M, Joniau S, van der Kwast T, et al. EAU guidelines on prostate cancer. Part II: treatment of advanced, relapsing, and castration-resistant prostate cancer. Eur Urol. 2014;65(2):467–479. doi: 10.1016/j.eururo.2013.11.002. [DOI] [PubMed] [Google Scholar]
  • 10.Heidenreich A, Bastian PJ, Bellmunt J, Bolla M, Joniau S, van der Kwast T, et al. EAU guidelines on prostate cancer. Part 1: screening, diagnosis, and local treatment with curative intent-update 2013. Eur Urol. 2014;65(1):124–137. doi: 10.1016/j.eururo.2013.09.046. [DOI] [PubMed] [Google Scholar]
  • 11.Network NCC. NCCN Clinical Practice Guidelines in Oncology: Prostate Cancer v2.2017 [updated Feb 2017Jun 2017]. Available from: https://www.nccn.org/professionals/physician_gls/pdf/prostate.pdf.
  • 12.Sammon JD, Abdollah F, Reznor G, Pucheril D, Choueiri TK, Hu JC, et al. Patterns of declining use and the adverse effect of primary androgen deprivation on all-cause mortality in elderly men with prostate cancer. Eur Urol. 2015;68(1):32–39. doi: 10.1016/j.eururo.2014.10.018. [DOI] [PubMed] [Google Scholar]
  • 13.Nambudiri VE, Landrum MB, Lamont EB, McNeil BJ, Bozeman SR, Freedland SJ, et al. Understanding variation in primary prostate cancer treatment within the veterans health administration. Urology. 2012;79(3):537–545. doi: 10.1016/j.urology.2011.11.013. [DOI] [PubMed] [Google Scholar]
  • 14.Borza T, Kaufman SR, Shahinian VB, Yan P, Miller DC, Skolarus TA, et al. Sharp decline in prostate cancer treatment among men in the general population, but not among diagnosed men. Health Aff (Millwood) 2017;36(1):108–115. doi: 10.1377/hlthaff.2016.0739. [DOI] [PubMed] [Google Scholar]
  • 15.Loblaw DA, Virgo KS, Nam R, Somerfield MR, Ben-Josef E, Mendelson DS, et al. Initial hormonal management of androgen-sensitive metastatic, recurrent, or progressive prostate cancer: 2006 update of an American Society of Clinical Oncology practice guideline. J Clin Oncol. 2007;25(12):1596–1605. doi: 10.1200/JCO.2006.10.1949. [DOI] [PubMed] [Google Scholar]
  • 16.Sato N, Akakura K, Isaka S, Nakatsu H, Tanaka M, Ito H, et al. Intermittent androgen suppression for locally advanced and metastatic prostate cancer: preliminary report of a prospective multicenter study. Urology. 2004;64(2):341–345. doi: 10.1016/j.urology.2004.03.032. [DOI] [PubMed] [Google Scholar]
  • 17.Akakura K, Bruchovsky N, Rennie PS, Coldman AJ, Goldenberg SL, Tenniswood M, et al. Effects of intermittent androgen suppression on the stem cell composition and the expression of the TRPM-2 (clusterin) gene in the Shionogi carcinoma. J Steroid Biochem Mol Biol. 1996;59(5–6):501–511. doi: 10.1016/S0960-0760(96)00132-X. [DOI] [PubMed] [Google Scholar]
  • 18.Lu-Yao GL, Albertsen PC, Moore DF, Shih W, Lin Y, DiPaola RS, et al. Survival following primary androgen deprivation therapy among men with localized prostate cancer. JAMA. 2008;300(2):173–181. doi: 10.1001/jama.300.2.173. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Gillessen S, Templeton A, Marra G, Kuo YF, Valtorta E, Shahinian VB. Risk of colorectal cancer in men on long-term androgen deprivation therapy for prostate cancer. J Natl Cancer Inst. 2010;102(23):1760–1770. doi: 10.1093/jnci/djq419. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Tsai HT, Keating NL, Van den Eeden SK, Haque R, Cassidy-Bushrow AE, Yood MU, et al. Risk of diabetes among patients receiving primary androgen deprivation therapy for clinically localized prostate cancer. J Urology. 2015;193(6):1956–1962. doi: 10.1016/j.juro.2014.12.027. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Shahinian VB, Kuo YF, Freeman JL, Goodwin JS. Risk of fracture after androgen deprivation for prostate cancer. N Engl J Med. 2005;352(2):154–164. doi: 10.1056/NEJMoa041943. [DOI] [PubMed] [Google Scholar]
  • 22.Shahinian VB, Kuo YF, Freeman JL, Goodwin JS. Risk of the “androgen deprivation syndrome” in men receiving androgen deprivation for prostate cancer. Arch Intern Med. 2006;166(4):465–471. doi: 10.1001/.465. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Montini T, Graham ID. “Entrenched practices and other biases”: unpacking the historical, economic, professional, and social resistance to de-implementation. Implement Sci. 2015;10:24. doi: 10.1186/s13012-015-0211-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Prasad V, Ioannidis JP. Evidence-based de-implementation for contradicted, unproven, and aspiring healthcare practices. Implement Sci. 2014;9:1. doi: 10.1186/1748-5908-9-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Voorn VM, Marang-van de Mheen PJ, So-Osman C, Kaptein AA, van der Hout A, van den Akker-van Marle ME, et al. De-implementation of expensive blood saving measures in hip and knee arthroplasties: study protocol for the LISBOA-II cluster randomized trial. Implement Sci. 2014;9:48. doi: 10.1186/1748-5908-9-48. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Aron DC, Lowery J, Tseng CL, Conlin P, Kahwati L. De-implementation of inappropriately tight control (of hypoglycemia) for health: protocol with an example of a research grant application. Implement Sci. 2014;9:58. doi: 10.1186/1748-5908-9-58. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Gupta DM, Boland RJ, Jr, Aron DC. The physician’s experience of changing clinical practice: a struggle to unlearn. Implement Sci. 2017;12(1):28. doi: 10.1186/s13012-017-0555-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Macdonald G. Transformative unlearning: safety, discernment and communities of learning. Nurs Inq. 2002;9(3):170–178. doi: 10.1046/j.1440-1800.2002.00150.x. [DOI] [PubMed] [Google Scholar]
  • 29.Rushmer R, Davies HT. Unlearning in health care. Qual Saf Health Care. 2004;13(Suppl 2):ii10–ii15. doi: 10.1136/qshc.2003.009506. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Burkhart CG. And the beat goes on: formulary restriction, generic substitution, prior authorization, drug utilization, and now therapeutic interchange. J Drugs Dermatol. 2004;3(1):11. [PubMed] [Google Scholar]
  • 31.Kreling DH, Knocke DJ, Hammel RW. Changes in market shares for internal analgesic products after a Medicaid formulary restriction. J Pharm Mark Manag. 1988;3(2):65–76. doi: 10.3109/J058v03n02_06. [DOI] [PubMed] [Google Scholar]
  • 32.Climo Michael W. Hospital-wide Restriction of Clindamycin: Effect on the Incidence of Clostridium difficile-Associated Diarrhea and Cost. Annals of Internal Medicine. 1998;128(12_Part_1):989. doi: 10.7326/0003-4819-128-12_Part_1-199806150-00005. [DOI] [PubMed] [Google Scholar]
  • 33.Baboolal SM, Mayo M. Comment: ketorolac formulary restriction and usage evaluation. Ann Pharmacother. 1992;26(9):1158–1160. doi: 10.1177/106002809202600926. [DOI] [PubMed] [Google Scholar]
  • 34.Huang X, Liu Z, Shankar RR, Rajpathak S. Description of anti-diabetic drug utilization pre- and post-formulary restriction of sitagliptin: findings from a national health plan. Curr Med Res Opin. 2015;31(8):1495–1500. doi: 10.1185/03007995.2015.1060211. [DOI] [PubMed] [Google Scholar]
  • 35.Bassetti M, Di Biagio A, Rebesco B, Amalfitano ME, Topal J, Bassetti D. The effect of formulary restriction in the use of antibiotics in an Italian hospital. Eur J Clin Pharmacol. 2001;57(6–7):529–534. doi: 10.1007/s002280100338. [DOI] [PubMed] [Google Scholar]
  • 36.DeVito JM, John JF., Jr Effect of formulary restriction of cefotaxime usage. Arch Intern Med. 1985;145(6):1053–1056. doi: 10.1001/archinte.1985.00360060117018. [DOI] [PubMed] [Google Scholar]
  • 37.Kreling DH, Knocke DJ, Hammel RW. The effects of an internal analgesic formulary restriction on Medicaid drug expenditures in Wisconsin. Med Care. 1989;27(1):34–44. doi: 10.1097/00005650-198901000-00004. [DOI] [PubMed] [Google Scholar]
  • 38.O'Connor AB, Lang VJ, Quill TE. Eliminating analgesic meperidine use with a supported formulary restriction. Am J Med. 2005;118(8):885–889. doi: 10.1016/j.amjmed.2005.01.061. [DOI] [PubMed] [Google Scholar]
  • 39.Hensley PL, Nurnberg HG. Formulary restriction of selective serotonin reuptake inhibitors for depression: potential pitfalls. PharmacoEconomics. 2001;19(10):973–982. doi: 10.2165/00019053-200119100-00001. [DOI] [PubMed] [Google Scholar]
  • 40.Bassetti M, Di Biagio A, Rebesco B, Cenderello G, Amalfitano ME, Bassetti D. Impact of an antimicrobial formulary and restriction policy in the largest hospital in Italy. Int J Antimicrob Agents. 2000;16(3):295–299. doi: 10.1016/S0924-8579(00)00249-1. [DOI] [PubMed] [Google Scholar]
  • 41.Reed EE, Stevenson KB, West JE, Bauer KA, Goff DA. Impact of formulary restriction with prior authorization by an antimicrobial stewardship program. Virulence. 2013;4(2):158–162. doi: 10.4161/viru.21657. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Gianarkis DG. Ketorolac formulary restriction and usage evaluation. DICP. 1991;25(12):1399. doi: 10.1177/106002809102501229. [DOI] [PubMed] [Google Scholar]
  • 43.Wetmore RW, Jennings RH. Retrospective analysis of formulary restriction demonstrates significant cost savings. Hospital Formul. 1991;26(Suppl D):30–32. [PubMed] [Google Scholar]
  • 44.Holmes-Rovner M, Montgomery JS, Rovner DR, Scherer LD, Whitfield J, Kahn VC, et al. Informed decision making: assessment of the quality of physician communication about prostate cancer diagnosis and treatment. Med Decis Making. 2015;35(8):999–1009. doi: 10.1177/0272989X15597226. [DOI] [PubMed] [Google Scholar]
  • 45.Hawley ST, Jagsi R. Shared decision making in cancer care: does one size fit all? JAMA Oncol. 2015;1(1):58–59. doi: 10.1001/jamaoncol.2014.186. [DOI] [PubMed] [Google Scholar]
  • 46.Kehl KL, Landrum MB, Arora NK, Ganz PA, van Ryn M, Mack JW, et al. Association of actual and preferred Decision roles with patient-reported quality of care: shared decision making in cancer care. JAMA Oncol. 2015;1(1):50–58. doi: 10.1001/jamaoncol.2014.112. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, et al. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655. doi: 10.1136/bmj.a1655. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Dyson J, Lawton R, Jackson C, Cheater F. Development of a theory-based instrument to identify barriers and levers to best hand hygiene practice among healthcare practitioners. Implement Sci. 2013;8:111. doi: 10.1186/1748-5908-8-111. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A, et al. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005;14(1):26–33. doi: 10.1136/qshc.2004.011155. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.French SD, Green SE, O'Connor DA, McKenzie JE, Francis JJ, Michie S, et al. Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the theoretical domains framework. Implement Sci. 2012;7(1):38. doi: 10.1186/1748-5908-7-38. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Huijg JM, Gebhardt WA, Dusseldorp E, Verheijden MW, van der Zouwe N, Middelkoop BJ, et al. Measuring determinants of implementation behavior: psychometric properties of a questionnaire based on the theoretical domains framework. Implement Sci. 2014;9:33. doi: 10.1186/1748-5908-9-33. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Huijg JM, Gebhardt WA, Crone MR, Dusseldorp E, Presseau J. Discriminant content validity of a theoretical domains framework questionnaire for use in implementation research. Implement Sci. 2014;9:11. doi: 10.1186/1748-5908-9-11. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Gould NJ, Lorencatto F, Stanworth SJ, Michie S, Prior ME, Glidewell L, et al. Application of theory to enhance audit and feedback interventions to increase the uptake of evidence-based transfusion practice: an intervention development protocol. Implement Sci. 2014;9:92. doi: 10.1186/s13012-014-0092-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.McAteer J, Stone S, Fuller C, Michie S. Using psychological theory to understand the challenges facing staff delivering a ward-led intervention to increase hand hygiene behavior: a qualitative study. Am J Infect Control. 2014;42(5):495–499. doi: 10.1016/j.ajic.2013.12.022. [DOI] [PubMed] [Google Scholar]
  • 55.Steinmo S, Fuller C, Stone SP, Michie S. Characterising an implementation intervention in terms of behaviour change techniques and theory: the ‘Sepsis Six’ clinical care bundle. Implement Sci. 2015;10:111. doi: 10.1186/s13012-015-0300-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Davidoff F, Dixon-Woods M, Leviton L, Michie S. Demystifying theory and its use in improvement. BMJ Qual Saf. 2015;24(3):228–238. doi: 10.1136/bmjqs-2014-003627. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Kirsh SR, Lawrence RH, Aron DC. Tailoring an intervention to the context and system redesign related to the intervention: a case study of implementing shared medical appointments for diabetes. Implement Sci. 2008;3:34. doi: 10.1186/1748-5908-3-34. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Complex Interventions in Health: an overview of research methods. Edited by David A. Richards, Ingalill Rahm Hallberg. © 2015 – Routledge.
  • 59.de Bekker-Grob EW, Ryan M, Gerard K. Discrete choice experiments in health economics: a review of the literature. Health Econ. 2012;21(2):145–172. doi: 10.1002/hec.1697. [DOI] [PubMed] [Google Scholar]
  • 60.Salloum RG, Shenkman EA, Louviere JJ, Chambers DA. Application of discrete choice experiments to enhance stakeholder engagement as a strategy for advancing implementation: a systematic review. Implement Sci. 2017;12(1):140. doi: 10.1186/s13012-017-0675-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Ryan M. Discrete choice experiments in health care. BMJ. 2004;328(7436):360–361. doi: 10.1136/bmj.328.7436.360. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Ryan M, Gerard K. Using discrete choice experiments to value health care programmes: current practice and future research reflections. Appl Health Econ Health Policy. 2003;2(1):55–64. [PubMed] [Google Scholar]
  • 63.Reed Johnson F, Lancsar E, Marshall D, Kilambi V, Muhlbacher A, Regier DA, et al. Constructing experimental designs for discrete-choice experiments: report of the ISPOR conjoint analysis experimental design good research practices task force. Value Health. 2013;16(1):3–13. doi: 10.1016/j.jval.2012.08.2223. [DOI] [PubMed] [Google Scholar]
  • 64.Cane J, O'Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implementation science : IS. 2012;7:37. doi: 10.1186/1748-5908-7-37. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Atkins L1, Francis J2,3, Islam R3, O'Connor D4, Patey A3, Ivers N5, Foy R6, Duncan EM7, Colquhoun H8, Grimshaw JM3,9, Lawton R10, Michie S11. A guide to using the Theoretical Domains Framework of behaviour change to investigate implementation problems. Implement Sci. 2017;12(1):77. 10.1186/s13012-017-0605-9. [DOI] [PMC free article] [PubMed]
  • 66.Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Admin Pol Ment Health. 2011;38(2):65–76. doi: 10.1007/s10488-010-0319-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Mitchinson AR, Kerr EA, Krein SL. Management of chronic noncancer pain by VA primary care providers: when is pain control a priority? Am J Manag Care. 2008;14(2):77–84. [PubMed] [Google Scholar]
  • 68.Skolarus TA, Metreger T, Hwang S, Kim HM, Grubb RL, 3rd, Gingrich JR, et al. Optimizing veteran-centered prostate cancer survivorship care: study protocol for a randomized controlled trial. Trials. 2017;18(1):181. doi: 10.1186/s13063-017-1925-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.Dillman D. Mail and internet surveys: the tailored design method. New York: Wiley; 2000. [Google Scholar]
  • 70.Lancaster GA, Dodd S, Williamson PR. Design and analysis of pilot studies: recommendations for good practice. J Eval Clin Pract. 2004;10(2):307–312. doi: 10.1111/j..2002.384.doc.x. [DOI] [PubMed] [Google Scholar]
  • 71.Francis JJ, O'Connor D, Curran J. Theories of behaviour change synthesised into a set of theoretical groupings: introducing a thematic series on the theoretical domains framework. Implement Sci. 2012;7:35. doi: 10.1186/1748-5908-7-35. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.The behaviour change wheel: a guide to designing interventions. Copyright © Susan Michie, Lou Atkins and Robert West Silverback Publishing 2014.
  • 73.Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95. doi: 10.1007/s12160-013-9486-6. [DOI] [PubMed] [Google Scholar]
  • 74.Birken SA, Presseau J, Ellis SD, Gerstel AA, Mayer DK. Potential determinants of health-care professionals’ use of survivorship care plans: a qualitative study using the theoretical domains framework. Implement Sci. 2014;9:167. doi: 10.1186/s13012-014-0167-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.Patton MQ. Qualitative research and evaluation methods. 3. Thousand Oaks: Sage Publications; 2002. [Google Scholar]
  • 76.Clark MD, Determann D, Petrou S, Moro D, de Bekker-Grob EW. Discrete choice experiments in health economics: a review of the literature. PharmacoEconomics. 2014;32(9):883–902. doi: 10.1007/s40273-014-0170-x. [DOI] [PubMed] [Google Scholar]
  • 77.Howard Kirsten, Salkeld Glenn P., Patel Manish I., Mann Graham J., Pignone Michael P. Men's preferences and trade-offs for prostate cancer screening: a discrete choice experiment. Health Expectations. 2014;18(6):3123–3135. doi: 10.1111/hex.12301. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Struik MH, Koster F, Schuit AJ, Nugteren R, Veldwijk J, Lambooij MS. The preferences of users of electronic medical records in hospitals: quantifying the relative importance of barriers and facilitators of an innovation. Implement Sci. 2014;9:69. doi: 10.1186/1748-5908-9-69. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 79.Ubach C, Scott A, French F, Awramenko M, Needham G. What do hospital consultants value about their jobs? A discrete choice experiment. BMJ. 2003;326(7404):1432. doi: 10.1136/bmj.326.7404.1432. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 80.Sharp ND, Pineros SL, Hsu C, Starks H, Sales AE. A qualitative study to identify barriers and facilitators to implementation of pilot interventions in the veterans health administration (VHA) northwest network. Worldviews Evid-Based Nurs. 2004;1(2):129–139. doi: 10.1111/j.1741-6787.2004.04023.x. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The datasets supporting the conclusions of this article will be shared upon request. Members of the scientific community who would like a copy of the final data sets (i.e., data sets underlying any publication) from this study can request a copy by e-mailing Dr. Ted Skolarus at Ted.Skolarus@va.gov. The investigator should state their reason for requesting the data and their plans for analyzing the data. De-identified data will be provided after requestors sign a Letter of Agreement detailing the mechanisms by which the data will be kept secure and access restricted to their study team. The agreements will also state the recipient will not attempt to identify any individual whose data are included and will not share the data with anyone outside of their research team. The dataset will not include private or protected information and all dates will be changed to integers to allow for calculation of time periods. Final data sets will be copied onto a CD and limited data sets will be encrypted and the password will be sent to the requestor via e-mail. The CD will be sent to the requestor via FedEx. Each data set will be accompanied by documentation that lists all variables described in the publication and links them with variable names in the data set.


Articles from Implementation Science : IS are provided here courtesy of BMC

RESOURCES