Abstract
Rationale & Objective
The translation of clinical research to practice has been the subject of intense scrutiny in the efforts to identify ways to improve the uptake of findings that can enhance patient care.
Study Design
This study evaluated the experience of nephrology health care providers who manage patients with autosomal dominant polycystic kidney disease (ADPKD) to identify promoters and barriers to the translation of research results into clinical practice. We used inductive thematic analysis to evaluate the experience, attitudes, and beliefs of physicians in the evaluation and translation of research findings into clinical practice for the care of patients with ADPKD.
Setting & Participants
Participants in a continuing education activity on ADPKD volunteered for semistructured interviews exploring their experience translating new knowledge into care for patients with ADPKD. An independent institutional review board (Solutions IRB) found the study to be exempt as an educational survey.
Analytical Approach
Transcripts were coded and excerpted, and emergent themes and relationships were identified through an analysis performed using Dedoose software. Particular attention was paid to characterizing the facilitators and barriers to research translation at different levels of the health care environment.
Results
Textual interpretation of data from 13 interviews showed that while well-established barriers to research translation are prevalent among health care providers managing patients with ADPKD, these clinicians also face unique challenges. Principal among these is the burden of interpreting the clinical research literature given the lack of official guidelines.
Limitations
This study did not explore the translation of all levels of research, such as basic science and animal studies, and it was limited to the translation of knowledge from clinical studies. The number of participants was limited but was found to be sufficient for saturation.
Conclusions
We identified factors that may either enhance or impede research translation for nephrology health care providers. These observations may help in the design of continuing education interventions to promote innovation.
Index Words: Autosomal dominant polycystic kidney disease, continuing education, health care environment, learning theory, nephrology, qualitative analysis, research translation
Plain-Language Summary.
Despite progress in clinical research, translating new findings about autosomal dominant polycystic kidney disease in patient care can be slow. We conducted semistructured interviews to evaluate the experiences of nephrologists in the evaluation and translation of research findings. Inductive thematic analysis was used to qualitatively analyze the data. The results showed that barriers to research translation are prevalent among nephrology clinicians and that those managing patients with autosomal dominant polycystic kidney disease face unique challenges, such as a lack of official guidelines. Factors that can either enhance or impede research translation were identified. These observations may help in the development of continuing education interventions to promote innovation.
Research has shown that translational science exists on a continuum beginning with biomedical science, progressing to studies in animals and humans, and eventually being applied to clinical practice.1,2 Various models have characterized the process of translation as being nonlinear, such as having a circular or a back-and-forth process of change while ultimately progressing between research and practice. Translating knowledge to practice is challenging because of the complexity of health care systems and processes underlying the adoption of new practices in medicine.3 Accordingly, change in clinical practice is often frustratingly slow, and it can take as long as 17 years for new findings to be put into use.4
Understanding translation is important to identify the skills needed to use research results to improve patient care. Additionally, identifying and mitigating barriers to research translation can enhance the efficiency of bringing new knowledge into practice and enhancing the diffusion of innovation.5 Barriers and facilitators of research translation are heterogeneous with regard to disease states, and they are influenced by a myriad of organizational, social, and structural factors.6 Although linear and nonlinear models have been used as a framework to examine research implementation, little is known about how health care providers evaluate and implement research findings in practice. Qualitative studies that take a holistic and nonlinear approach to this question by considering the magnitude and influence of contextual factors are needed.
Autosomal dominant polycystic kidney disease (ADPKD) is the fourth most common cause of kidney failure in the United States,7, 8, 9 where it is estimated to affect 140,000 people9 and leads to significant morbidity, with total costs of $7.3 to $9.6 billion annually.10 ADPKD is considered an orphan disease, and the numbers of patients available to participate in clinical studies are limited. Outside of academic or research settings, the infrequency of ADPKD in nephrology practice limits clinicians’ experience with and exposure to the most current evidence-based practices.11 Translational research in ADPKD has expanded rapidly in recent decades. Clinicians apply recent clinical findings in molecular genetics, imaging, and disease-modifying therapy to better manage patients with ADPKD by diagnosing the disease earlier, promptly initiating and tailoring treatment, and potentially improving outcomes.12
To gain insight into the facilitators and barriers to translation of research into practice as specifically related to ADPKD, we conducted a qualitative study of health care providers practicing nephrology. Nephrology clinicians were interviewed to better understand their experiences evaluating and applying new findings to the care of patients with ADPKD.
Methods
The online continuing medical education (CME) learning activity, Strategies to Improve Management of ADPKD: Navigating Pitfalls and Overcoming Challenges, was released in September 2020 and was available online for 12 months at Healio.com and freeCME.com. The activity was certified for physicians and nurses by Medical Education Resources, a nonprofit accredited provider, and the faculty person was one of the authors (AC). The target audience was physicians and nurses involved in the care of patients with ADPKD. On completion of the activity evaluation, participants were asked if they wanted to volunteer to participate in an interview on the translation of clinical results to patient care.
The qualitative study described here was designed to enhance the understanding of research translation in the nephrology setting by identifying emerging themes. We employed an inductive strategy to analyze the results of semistructured interviews. Participants were identified when they volunteered for an interview at the time of completing the CME activity. Informed consent was obtained verbally, and a semistructured interview was conducted by telephone by one investigator (DR). Interview questions embraced several methods, including hypothetical (Do you think that…?), provocative (It’s believed that…what do you think?), ideal (What would be a solution to…?), and interpretive (What do you mean by…?). The interview was dynamic and focused on the experiences, opinions, feelings, and knowledge of the interviewee while soliciting input from the participant. Survey questions were partially refined based on the interview results, but the conceptual framework of the interviews was preserved throughout data collection. Interviews were conducted up to the point of redundancy of responses and a lack of emergent themes.
Audio recordings were transcribed verbatim. Deidentified transcripts were read, and a framework was constructed considering both explanatory and exploratory observations. Codes were formulated by 2 investigators (DR and BG); codes were then reviewed and revised by all investigators. To a limited extent, sensitizing concepts from extant research were used to create the initial coding schemes used to validate the conceptual framework of the study.13 Excerpts were identified and assigned to established codes. Interviews and notes were coded and analyzed using Dedoose software version 9.0.14 Thematic analysis was initially performed by DR and BG, then reviewed and revised by all the investigators.
The nature and risks/benefits of participation were explained to all prospective interviewees, and all participants provided verbal consent before the interviews. All participant data were deidentified. The study was reviewed by an independent institutional review board (Solutions IRB), and the research was verified to be an exempt educational survey according to 45 CFR 46.101(b)(2).
Results
A total of 1,926 health care professionals participated in the CME learning activity, including 462 nephrologists. Half of the participants had been practicing for more than 20 years. The self-reported confidence levels of the learners increased substantially following the exercise, and a statistically significant improvement was seen in knowledge when the pretest and posttest questions were evaluated (n = 3; P < 0.001 for all). Thirteen participants volunteered for an interview. Interviewees were comparable to the population of CME activity participants in terms of practice setting, experience, age, and gender. All the 13 participants who completed the semistructured interview were nephrology providers. Twelve interviewees were nephrologists and 1 was a nephrology nurse practitioner.
Textual analysis of the interview data revealed several factors related to ADPKD research evaluation and translation that emerged as individual or shared ideas. Individual responses were heterogeneous and suggested a wide range in the level of comfort and success in evaluating and applying clinical research data to the management of ADPKD.
Challenges
Several recurrent themes were noted that are common to translational science in many areas of medical practice. These include the quality and quantity of research, institutional and noninstitutional structural factors, dissemination of findings, practice type, and sociocultural characteristics of the work environment.6,15 The challenges identified in the present study included poor comprehension of complex research reports, difficulty with statistics, and the lack of an organizational culture that promotes the uptake of new research results. As expected, these factors diverged substantially when comparing different practice settings. In academic settings, nephrologists were often in the vanguard of research translation, whereas translation lagged in private and community practices where the demands of patient care responsibilities often impeded the evaluation and implementation of new approaches to ADPKD care.
One clinician explained, “…[T]hat’s not what the private practice is about at all…you go in, you see a lot of patients, you try to follow the standards of care…I’m trying to stay up-to-date with the most recent treatment options…but there is a big difference between [me and] an academic person practicing…you don’t just go and read literature.” (MD) Another stated, “You know, when you’re in that academic environment, people constantly push you to look at the data, and I’m not sure that happens as much in private practice. So if there could be simpler algorithms for people to follow, I think that would be helpful.” (MD)
Burden of the Literature
With the absence of official guidelines and consensus recommendations for ADPKD, the private practitioner faces the burden of trying to determine best-care practices from original articles and reviews, which are technically challenging and time-consuming to understand. As one interviewee shared, “When you’re in private practice, you don’t have time or expertise to understand all the details of an original manuscript…and that makes it really granular for them to know how to deal with this.” (MD)
A key observation in the thematic framework analysis of this study was that several factors can either impede or promote research translation (Table 1). This “boon or bust” pattern clearly emerged as a recurrent theme reflecting shared experiences among respondents.
Table 1.
Factors That Can Promote or Impede Research Translation into Clinical Practice in ADPKD
| Factor | Impedes Translation | Promotes Translation |
|---|---|---|
| Research methods |
|
|
| CME |
|
|
| Dissemination |
|
|
| Institution |
|
|
| Years in practice |
|
|
| Type of practice |
|
|
| Guidelines |
|
|
| Innovation |
|
|
| Time |
|
|
Abbreviations: ADPKD, autosomal dominant polycystic kidney disease; CME, continuing medical education.
Interpretation of Statistical Data
One of the most prominent factors in research translation that emerged from the interview data is difficulty in comprehending research methods. Statistics can be challenging to interpret, and many participants found them to be vexing when trying to assimilate study results. One participant noted, “I always found myself very challenged by biostatistics, but along the way, I’ve been taught enough to at least have a primitive sense of are the right questions being asked, is the data being looked at in a reasonable way…” (MD) Another stated, “I think that the hardest part to understand of a study is probably the statistics and all the math involved; that sometimes loses one, especially. So I would say that’s what distracts the most…” (MD) Another clinician observed, “People have concerns that the statistics may not have been done properly in the first place, but they don’t know how to figure that out…” (MD)
Some statistical results can clarify the interpretation of the clinical implications and provide confidence in the adoption of new practices. For example, results such as a significant P value, the number needed to treat, and the number needed to harm offer practical guidance for clinicians.16
There was a recurring sentiment that clinicians are sometimes unable to critically evaluate research articles and identify the implications for care from individual studies. As one interviewee noted, “Some of our colleagues probably haven’t been trained in a setting where they’ve literally been taught to think critically to evaluate papers.” (MD) Another participant reflected, “…people are not interpreting these [studies] because maybe they understand the data, but they just don't know really how to apply it and put it together; what does it really mean for patient care?” (MD) Another participant suggested, “I think there should be a bit more education on research. Polycystic [kidney disease] is not so well talked about. We talk about diabetes and hypertension and cancer and stroke, but not much about polycystic kidney disease.” (NP)
Clinical Translation Is Often Not Considered When Reporting Results
Another recognized barrier to translation into clinical practice is that research translation is not considered when designing or interpreting clinical research results, making it hard for the reader to discern the clinical implications of the study. Authors of clinical research often take a conservative approach when making conclusions about the implications of their results. As one participant observed, “Sometimes the researchers don’t want to step out on a limb, and even though they think they know what the promise is of their research, they're afraid to say it ‘out loud’…I think what they could do is speculate on what the outcomes might be, and indicate what their reservations might be, and that lets people look at things in a new way.” (MD)
There are relatively few studies in the field of ADPKD, and the lack of replication made some clinicians reluctant to adopt new practices. Replicated study findings carry greater weight as evidence supporting practice changes.
Reputation of Journals and Authors
The importance of the dissemination of research in innovation was another key finding of this study. The provenance of research was highly influential for learners. Data from a highly rated journal reassured clinicians, whereas they were more skeptical about the implementation of studies published in less prestigious journals. Similarly, the reputation of the study authors added to the sense of validity on the part of health care providers. One participant described their thought process as, “What journal am I seeing it in? Is it a top-notch general journal…is it one of the best of the renal journals?” (MD) Another participant would ask, “Is it people I know and respect over a period of time where there’s a certain trust in integrity, and that I know they’ve run medium to large outcomes trials before?” (MD)
Many nephrology health care providers in private and community practice did not have the time or resources to attend conferences and meetings. CME was commonly cited as a dominant factor in understanding the implications of research for clinical practice. Study participants repeatedly emphasized the unique role that CME played in their approach to innovation. One clinician noted, “CME programs help…they’re opening your mind up to other treatments, other possibilities, increasing your knowledge rather than this little narrow path that you follow.” (MD) Another clinician observed, “In general, [providers] found [CME] activities they had completed to be highly relevant and a valuable opportunity to learn from experts for both adopting new practices and validating current practice.” (MD) Another participant reflected, “I think the information [from this activity] was really objective, and I think it helps to clarify the current studies that are out there. So it kind of summarizes everything.” (MD)
Practice and Institution Characteristics
Institutional and practice characteristics weighed heavily on whether research translation was impeded or promoted. The promotion of communication and interdisciplinary strategies to improve care can encourage innovation.17 Many participants felt that their institutions impeded innovation because they had competing priorities or lacked resources for implementation, or their administration was not committed to the adoption of new approaches.
Differences in seniority and experience among nephrologists were also found to be decisive factors in research translation. Participants reported that senior providers may continue to rely on outdated approaches. In contrast, less senior clinicians are often more up-to-date on ADPKD research and are interested in newer ways of doing things but can be reluctant to rely on their experience and instincts because they often seek the security of strictly adhering to guidelines. As one participant described, “Sometimes it’s hard to change [younger physicians’] minds. They want to do what is in the book. It’s hard to make them sort of be open to other ideas. But someone who has been practicing for 20 years…they’re more open to other things.” (MD)
Discussion
This qualitative study evaluated data from nephrology health care providers who manage patients with ADPKD to characterize their experience evaluating and applying clinical research to patient care. There are well-known gaps in the application of research findings to clinical practice, although little is known about these gaps as they relate to ADPKD care practices by nephrology providers.
A landmark US study found that adults received recommended care only 55% of the time18 and that the delivery of appropriate care decreased in the presence of comorbid conditions.19 More recently, the CareTrack study evaluated the appropriateness of the health care delivery provided to 1,154 adults and found that compliance with indicators of appropriate care varied from 13%-90% depending on the medical condition.20 Given the lack of widely accepted clinical guidelines and quality indicators for the management of ADPKD, it is difficult to assess the appropriateness and currency of evidence-based care being delivered. Clinicians treating patients with ADPKD must rely heavily on expert opinion and consensus for treatment decision-making. As a result, it was not surprising to find a wide range of attitudes, beliefs, and practices in ADPKD research translation among nephrology clinicians.
A key finding of this study was the “boon or bust” theme, in which the same factors could act as either facilitators or barriers to research translation in different situations. It is possible that this phenomenon reflects the lack of official evidence-based promulgated guidelines for the management of ADPKD. We postulate that in the absence of clear indicators of appropriate care, the nephrology health care provider has the burden of navigating the research to determine best practices in caring for patients with ADPKD. In lieu of official practice guidelines, evaluating factors such as the methods, statistical analysis, quality, implications, and dissemination of research becomes the burden of the nonacademic practicing clinician. In this scenario, the success of implementation can easily pivot on factors such as author and journal reputation, terminology, comprehension of statistical methods, the learner’s seniority, the limitations of the research design, and knowledge of the ADPKD canon. Further, guidelines are designed to save time and effort in the implementation of best practices. In the absence of such resources, health care providers must draw on scarce resources, such as time to review research, attendance at conferences or journal clubs, and guidance from colleagues. In response to these demands, health care providers frequently depend on CME to learn about recent developments in ADPKD and how to apply findings to clinical care. Other strategies identified as important in this process included digital and mobile resources and concise online practice summaries written by highly credible authors.
Continuing education is well suited for disseminating new practices and promoting practice innovation.21, 22, 23 Methods such as transformative learning, team-based learning, and simulations can facilitate the diffusion of innovation and clinical knowledge development.24, 25, 26 Interview participants cited the importance of learning about research implications and innovations in the CME activity that they completed as part of this study.
There was a wide spectrum of attitudes toward preparedness for research translation on the part of nephrology providers. The transtheoretical model of change proposes 6 stages of change that characterize an individual’s readiness to adopt behavior change (precontemplation, contemplation, preparation, action, maintenance, and termination).22 Like Rogers’s diffusion of innovation theory,27 the transtheoretical model postulates several stages of diffusion in the application of new knowledge and understanding. We found in a previous study that CME participants recognize the mechanisms of behavior change that are important for translational mechanisms in evidence-based care for patients with multiple sclerosis.28
Identification of the factors that can be either a promoter or an impediment to the translation of ADPKD research can inform strategies to improve the diffusion of innovative practices. Consideration of these factors may be beneficial when formulating education and other interventions to encourage the translation of clinical research into the care of patients with ADPKD. Notably, consideration of pivotal factors reveals tipping points, beyond which factors become more (or less) likely to be effective at promoting the translation of research findings. For example, statistical data can help clinicians interpret the clinical implications of research results, but they must be presented in such a way so as not to pass the tipping point beyond which they become overly complex and impede the learner’s understanding (Fig 1).
Figure 1.
Model of a postulated tipping point characterizing the effectiveness of various factors in the promotion of research translation. In this example, the learner seeks statistical data to interpret implications for care. Understanding the implications for care is difficult if the statistical data are inadequate (left). Optimally, some statistical findings such as P values, number needed to treat, and number needed to harm can promote understanding and make translation more likely (center). When statistics pass the tipping point beyond which they become overly complex and difficult to understand clinically, the factor becomes an impediment to the translation (right).
The results reported here should be viewed in the context of the study limitations. Our research did not consider issues related to all stages of translation, such as the translation of basic science, biomedical advances, and animal studies. This study focused on what has been referred to as T2 translation, or “the translation of results from clinical studies into everyday clinical practice and health decision-making.”1
Although a relatively small number of health care providers were interviewed, redundancy in data collection was observed. A sufficient level of saturation was likely achieved with the 13 interviewees. Our sample was highly homogeneous, and we only sought the power to detect prevalent themes, factors that improve the likelihood of identifying themes in a smaller sample.
One study assessed the necessary sample size for thematic analysis of interviews conducted with patients with multiple sclerosis.28 The study authors concluded that 12 interviews were adequate for saturation. In another study, the researchers conducted 60 interviews and observed saturation after the first 12 interviews.29 In the present study, a narrative method was used, which emphasizes illustrative or evocative sampling, rather than data saturation.30
Although many factors influencing research translation identified in this study have been characterized in the literature on translational science, the context was intended to focus on the nephrology setting, and in particular, on the care of patients with ADPKD. Despite this observation, the results of the analysis were not intended to be generalizable or universal but rather reflective of the participants who practice in the area of focus. Future research is needed to extend these results to other areas of clinical practice, such as other disease states in nephrology or other orphan diseases. This and subsequent research in this area may provide insights into the influence of CME and other educational and noneducational interventions regarding translation practices and patient outcomes in ADPKD.
In conclusion, various factors that were influential in the translation of clinical research into patient care among nephrology providers managing patients with ADPKD were identified. Overall, this thematic analysis helps identify potential educational and noneducational interventions to enhance promoters and mitigate barriers to research translation. This study found that the same factors can be either promoters or impediments to translation and that understanding the specific considerations that influence this difference in effect—herein referred to as the tipping point—may help in formulating strategies to improve translation in the nephrology setting.
Article Information
Authors’ Full Names and Academic Degrees
Dana Ravyn, PhD, MPH, Beth Goodwin, MA, Rob Lowney, MBA, and Arlene Chapman, MD
Authors’ Contributions
Study design: AC, RL, DR; data acquisition: RL, DR; data analysis and interpretations: AC, BG, RL, DR. Each author contributed important intellectual content during manuscript drafting of revision and accepts accountability for the overall work ensuring that questions pertaining to the accuracy or integrity of any portion of the work are appropriately investigated and resolved.
Support
This research was supported in part by an educational grant from Otsuka America Pharmaceutical, Inc (GRT-ME-000906). The funders of this study had no role in study design, collection, analysis, and interpretation of data, writing the report, and the decision to submit the report for publication.
Financial Disclosure
The authors declare that they have no relevant financial interests.
Acknowledgments
We thank Susan Jones, MS, CHCP for critical review of the manuscript.
Peer Review
Received November 7, 2021. Evaluated by 2 external peer reviewers, with direct editorial input from an Associate Editor and the Editor-in-Chief. Accepted in revised form February 14, 2022.
Footnotes
Complete author and article information provided before references.
References
- 1.Sung N.S., Crowley W.F., Jr., Genel M., et al. Central challenges facing the national clinical research enterprise. JAMA. 2003;289(10):1278–1287. doi: 10.1001/jama.289.10.1278. [DOI] [PubMed] [Google Scholar]
- 2.Austin C.P. Opportunities and challenges in translational science. Clin Transl Sci. 2021;14(5):1629–1647. doi: 10.1111/cts.13055. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Greenhalgh T., Papoutsi C. Studying complexity in health services research: desperately seeking an overdue paradigm shift. BMC Med. 2018;16(1):95. doi: 10.1186/s12916-018-1089-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Morris Z.S., Wooding S., Grant J. The answer is 17 years, what is the question: understanding time lags in translational research. J R Soc Med. 2011;104(12):510–520. doi: 10.1258/jrsm.2011.110180. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Kitson A.L., Rycroft-Malone J., Harvey G., McCormack B., Seers K., Titchen A. Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges. Implement Sci. 2008;3:1. doi: 10.1186/1748-5908-3-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Fudge N., Sadler E., Fisher H.R., Maher J., Wolfe C.D., McKevitt C. Optimising translational research opportunities: a systematic review and narrative synthesis of basic and clinician scientists’ perspectives of factors which enable or hinder translational research. PLoS One. 2016;11(8) doi: 10.1371/journal.pone.0160475. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Chebib F.T., Torres V.E. Autosomal dominant polycystic kidney disease: core curriculum 2016. Am J Kidney Dis. 2016;67(5):792–810. doi: 10.1053/j.ajkd.2015.07.037. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Mao Z., Chong J., Ong A.C. Autosomal dominant polycystic kidney disease: recent advances in clinical management. F1000Res. 2016;5:2029. doi: 10.12688/f1000research.9045.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Willey C., Kamat S., Stellhorn R., Blais J. Analysis of nationwide data to determine the incidence and diagnosed prevalence of autosomal dominant polycystic kidney disease in the USA: 2013-2015. Kidney Dis (Basel) 2019;5(2):107–117. doi: 10.1159/000494923. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Cloutier M., Manceur A.M., Guerin A., Aigbogun M.S., Oberdhan D., Gauthier-Loiselle M. The societal economic burden of autosomal dominant polycystic kidney disease in the United States. BMC Health Serv Res. 2020;20(1):126. doi: 10.1186/s12913-020-4974-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Pariser A.R., Gahl W.A. Important role of translational science in rare disease innovation, discovery, and drug development. J Gen Intern Med. 2014;29(suppl 3):S804–S807. doi: 10.1007/s11606-014-2881-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Chapman A.B., Devuyst O., Eckardt K.U., et al. Autosomal-dominant polycystic kidney disease (ADPKD): executive summary from a Kidney Disease: Improving Global Outcomes (KDIGO) Controversies Conference. Kidney Int. 2015;88(1):17–27. doi: 10.1038/ki.2015.59. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Hsieh H.F., Shannon S.E. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–1288. doi: 10.1177/1049732305276687. [DOI] [PubMed] [Google Scholar]
- 14.Dedoose version 8.0.35. SocioCultural Research Consultants, LLC; 2018. https://www.dedoose.com
- 15.Rycroft-Malone J., Harvey G., Seers K., Kitson A., McCormack B., Titchen A. An exploration of the factors that influence the implementation of evidence into practice. J Clin Nurs. 2004;13(8):913–924. doi: 10.1111/j.1365-2702.2004.01007.x. [DOI] [PubMed] [Google Scholar]
- 16.Bartlett G., Gagnon J. Physicians and knowledge translation of statistics: mind the gap. CMAJ. 2016;188(1):11–12. doi: 10.1503/cmaj.151254. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Ortiz A. Translational nephrology: what translational research is and a bird’s-eye view on translational research in nephrology. Clin Kidney J. 2015;8(1):14–22. doi: 10.1093/ckj/sfu142. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.McGlynn E.A., Asch S.M., Adams J., et al. The quality of health care delivered to adults in the United States. N Engl J Med. 2003;348(26):2635–2645. doi: 10.1056/NEJMsa022615. [DOI] [PubMed] [Google Scholar]
- 19.Higashi T., Wenger N.S., Adams J.L., et al. Relationship between number of medical conditions and quality of care. N Engl J Med. 2007;356(24):2496–2504. doi: 10.1056/NEJMsa066253. [DOI] [PubMed] [Google Scholar]
- 20.Runciman W.B., Hunt T.D., Hannaford N.A., et al. CareTrack: assessing the appropriateness of health care delivery in Australia. Med J Aust. 2012;197(2):100–105. doi: 10.5694/mja12.10510. [DOI] [PubMed] [Google Scholar]
- 21.Russell B., Maher G., Prochaska J.O., Johnson S.S. Strategic approaches to continuing medical education: applying the transtheoretical model and diffusion of innovation theory. CE Meas. 2012;6:27–31. [Google Scholar]
- 22.Prochaska J.O. A stage paradigm for integrating clinical and public health approaches to smoking cessation. Addict Behav. 1996;21(6):721–732. doi: 10.1016/0306-4603(96)00031-7. [DOI] [PubMed] [Google Scholar]
- 23.Shirazi M., Lonka K., Parikh S.V., et al. A tailored educational intervention improves doctor’s performance in managing depression: a randomized controlled trial. J Eval Clin Pract. 2013;19(1):16–24. doi: 10.1111/j.1365-2753.2011.01761.x. [DOI] [PubMed] [Google Scholar]
- 24.Frenk J., Chen L., Bhutta Z.A., et al. Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. Lancet. 2010;376(9756):1923–1958. doi: 10.1016/S0140-6736(10)61854-5. [DOI] [PubMed] [Google Scholar]
- 25.King H.B., Battles J., Baker D.P., et al. In: Henriksen K., Battles J.B., Keyes M.A., Grady M.L., editors. Vol. 3. Agency for Healthcare Research and Quality (US); 2008. TeamSTEPPS: team strategies and tools to enhance performance and patient safety. (Advances in Patient Safety: New Directions and Alternative Approaches (Vol. 3: Performance and Tools)). [PubMed] [Google Scholar]
- 26.Schmitt M.H., Gilbert J.H., Brandt B.F., Weinstein R.S. The coming of age for interprofessional education and practice. Am J Med. 2013;126(4):284–288. doi: 10.1016/j.amjmed.2012.10.015. [DOI] [PubMed] [Google Scholar]
- 27.Rogers E.M. 5th ed. Free Press; 2003. Diffusion of Innovations. [Google Scholar]
- 28.Ando H., Cousins R., Young C. Achieving saturation in thematic analysis: development and refinement of a codebook. Comprehensive Psychology. 2014;3(4):1–7. doi: 10.2466/03.CP.3.4. [DOI] [Google Scholar]
- 29.Guest G., Bunce A., Johnson L. How many interviews are enough? An experiment with data saturation and variability. Field Methods. 2006;18(1):59–62. doi: 10.1177/1525822X05279903. [DOI] [Google Scholar]
- 30.Marshall V., Long B.C. Coping processes as revealed in the stories of mothers of children with autism. Qual Health Res. 2010;20(1):105–116. doi: 10.1177/1049732309348367. [DOI] [PubMed] [Google Scholar]

