Abstract
Background
Over the past few decades, the popularity of complementary and alternative medicine (CAM) has grown considerably and along with it, scrutiny regarding its evidence base. While this is to be expected, and is in line with other health disciplines, research in CAM is confronted by numerous obstacles. This scoping review aims to identify and report the strategies implemented to address barriers to the conduct and application of research in CAM.
Methods
The scoping review was undertaken using the Arksey and O’Malley framework. The search was conducted using MEDLINE, EMBASE, EMCARE, ERIC, Scopus, Web of Science, The Cochrane Library, JBI and the grey literature. Two reviewers independently screened the records, following which data extraction was completed for the included studies. Descriptive synthesis was used to summarise the data.
Results
Of the 7945 records identified, 15 studies met the inclusion criteria. Using the oBSTACLES instrument as a framework, the included studies reported diverse strategies to address barriers to the conduct and application of research in CAM. All included studies reported the use of educational strategies and collaborative initiatives with CAM stakeholders, including targeted funding, to address a range of barriers.
Conclusions
While the importance of addressing barriers to the conduct and application of research in CAM has been recognised, to date, much of the focus has been limited to initiatives originating from a handful of jurisdictions, for a small group of CAM disciplines, and addressing few barriers. Myriad barriers continue to persist, which will require concerted effort and collaboration across a range of CAM stakeholders and across multiple sectors. Further research can contribute to the evidence base on how best to address these barriers to promote the conduct and application of research in CAM.
Supplementary Information
The online version contains supplementary material available at 10.1186/s12906-021-03371-6.
Keywords: Complementary and alternative medicine, Complementary therapies, Scoping review, Evidence-based practice, Evidence-based medicine, Knowledge translation, Knowledge transfer, Barriers, Enablers, Facilitators, Strategies, Conduct of research, Application of research
Background
Evidence-based practice (EBP) is an approach whereby healthcare decisions are based on the best available, current, relevant and valid evidence and where there is continual evolvement of techniques, procedures and policies. The intent of EBP is to reduce variations in care, increase patient safety and improve patient outcomes [1]. Over the past few decades, the original definition of evidence-based practice [2] has evolved in the “integration of the production and the application of research evidence” [3]. There is increasing pressure within all health sectors to generate [4], implement and evaluate evidence [5, 6], in combination with a patient’s preferences and needs. Even though engagement in EBP may lead to greater professional satisfaction, EBP is not consistently used across all disciplines [7–9].
In 2009, the National Academy of Medicine’s Roundtable Conference on Evidence-based Medicine set an ambitious goal that 90% of clinical decisions will be based on evidence by 2020 [10]; unfortunately, this goal has yet to be achieved [11]. This is partly because barriers to evidence-based practice (EBP) uptake continue to exist in all areas of healthcare [12–14] including barriers to conducting research for the generation of evidence [15–17] as well as barriers to applying evidence into practice [13, 14]. To improve EBP uptake and in turn, the quality of health care, strategies addressing existing barriers are constantly being examined. There are also calls to improve health service delivery through innovation [18, 19] and evidence [4, 20], and to address barriers to evidence-based practices within conventional and allied healthcare [21–23]. CAM too is being subjected to similar evidence rules [24–26].
“Complementary and alternative medicine”, is an umbrella term capturing a diverse group of therapies not considered part of the conventional medical system [27]. CAM practices can be divided into five broad categories including, Mind-body medicine, Whole medical systems, Energy medicine, Biologically based practices, and Manipulative/Body-based practices [28]. This group of health-care practices use interventions and approaches that promote the innate healing ability of the body while retaining a core focus on individuality, holism, education, and disease prevention.
CAM use is growing internationally [29, 30]. Many factors can be attributed to the rising interest in CAM, including the move towards holistic well-being, the recognition of limitations of conventional medicine, increasing healthcare costs and the growing discourse on the important contribution of CAM [30]. The growing popularity of CAM has been paralleled by increased scrutiny of the evidence-base of the field, with calls for more research and critical appraisal of the evidence underpinning CAM [31]. Corresponding to calls for more CAM research is recognition of the numerous barriers to conducting rigorous research in CAM [32–35] and the challenges in translating this evidence into practice [36].
The EBP movement has placed considerable pressure on the field of CAM, which historically has relied heavily on traditional, experiential evidence [34]. The tension between traditional versus scientific evidence continues to persist in CAM, for which there may be a number of explanations. A recent systematic review [35] comprehensively mapped a range of obstacles to engaging with research within the field of CAM. These obstacles were divided into two broad categories: (1) Barriers to the conduct of research (i.e. evidence generation), and (2) Barriers to the application of research (i.e. evidence utilisation). The review highlighted the multifactorial and complex nature of these barriers, and the need for a comprehensive, systematic, and targeted approach to addressing these barriers.
To date, there has been no synthesis of strategies aimed at overcoming barriers to the conduct and application of research in CAM. This review aims to address this knowledge gap, and in doing so, may identify potential strategies that could help improve EBP uptake in CAM.
Methods
Study design
Scoping reviews are a relatively new but an increasingly common approach for mapping broad topics [37, 38]. A scoping review methodology was selected over other review methodologies as it can comprehensively map evidence across a range of study designs in a broader area of interest, and identify knowledge gaps to help inform future research practice, systematic reviews or programs/policy [37, 38]. The protocol for this scoping review adheres to the PRISMA-ScR guidelines [39] and is informed by a related scoping review in the field of chiropractic [40]. This scoping review also follows established frameworks in the conduct and reporting of scoping reviews, including those reported by Arksey and O’Malley [41], advanced by Levac and colleagues [42], and published by the Joanna Briggs Institute (JBI) [43].
Identifying the research question
The scoping review aimed to answer the following research question: “What enabling strategies have been implemented to address barriers to the conduct and application of research in complementary and alternative medicine?”
Identification of relevant studies
A search strategy was developed for MEDLINE (Appendix 1. MEDLINE search strategy) with guidance from an academic librarian. The search strategy was modified for use in other databases including EMBASE, EMCARE, ERIC, Scopus, Web of Science, The Cochrane Library, and the Joanna Briggs Institute EBP database. Google Scholar, the Google search engine (up to the first ten pages) [44] and MedNar were searched to identify relevant grey literature, blogs and reports. ProQuest and Trove were also searched to identify theses/dissertations and conference abstracts or proceedings. Reference lists of included studies were scanned to ensure no relevant studies were missed. The reviewer also intended to contact authors of primary studies or reviews for further information, if required. Publications were restricted to those published only in the English language. No limits were applied to the publication date. Selected literature was exported and saved on EndNote™, screened for duplicates, and exported to Covidence™ for a second screening of duplicates and eligibility screening. The search was operationalised between January and May 2019 and updated on 1st June 2021.
Study selection
Inclusion criteria
Primary studies (quantitative and qualitative) reporting the application and evaluation of any enabling strategy/intervention aimed at addressing barriers to the conduct or application of research within CAM, were eligible for inclusion. This included both published and unpublished studies.
Exclusion criteria
Opinion articles, discussion papers and reviews were not eligible for inclusion. Also excluded from the review were studies focusing on CAM products, treatments or remedies, vendors and manufacturers of CAM products, integrative medicine or conventional medicine practitioners and bio-medical researchers. Studies examining knowledge of CAM, attitudes towards CAM or the effectiveness of CAM were also excluded.
Screening
Two researchers independently screened the title and abstract of all retrieved studies to determine eligibility against the review selection criteria. Studies considered potentially eligible for inclusion were screened in full text by two researchers, independently. Conflicts between researcher decisions were discussed, and if disagreement persisted, decisions were resolved by consulting a third researcher.
Data extraction
A customised data extraction form was developed for the review [45]. The data extraction form was piloted by two researchers using a sample of one included article. Duplicated and irrelevant variables were removed after pilot testing. The data extraction form was informed by the aim of the review, research team expertise, and literature on barriers to research conduct or application. Items included in the form were author(s), year, country, design/method, objectives, CAM disciplines, participants/sample size, enabling strategies (concept/context, characteristics, funding/grants, outcome domains measured), results (attitudes, skills, knowledge, competencies), barriers addressed (conduct/application of research), study limitations and future recommendations. Data were extracted by YV and SK, and verified by ML. In accordance with scoping review guidelines, included studies were not appraised [37].
Collating, summarising and reporting
Data extracted from each included article were collated and reviewed by the research team. Any discrepancies in extracted data were discussed until consensus was reached. Data were then synthesized in narrative form. The “BarrierS To the Application and Conduct of rEsearch” (oBSTACLES) instrument [46] was used as a guide to classify barriers (i.e. conduct or application of research) addressed by the enabling strategies. The oBSTACLES instrument was selected as it (a) maps barriers to both the conduct and application of research [35], (b) is published and psychometrically tested [46, 47], and (c) maps the continuum of evidence from conduct to application. The results of this scoping review were also reported in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for scoping reviews [39, 48].
Results
Search results
The initial search identified 7601 records (Fig. 1). After the removal of duplicates, a total of 5321 titles and abstracts were screened, of which 5301 did not meet the inclusion criteria. The 20 remaining records were screened in full text; 6 records were excluded as they were either duplicate records (n = 1) or did not report a strategy/intervention (n = 5). The remaining 14 studies were included in this review. An updated search was conducted on 1st June 2021, which resulted in 2525 citations. After title and abstract screening, 3 articles proceed to full text screening. Full text screening resulted in exclusion of 2 articles (as they did not report intervention strategies) and inclusion of 1 additional article. Therefore, the final number of included studies in this review was 15.
Description of the included studies
The fifteen included studies [49–63] were published between the years 2008 and 2019 (Table 1). Most studies were conducted in the USA (n = 11; 73%) [49, 50, 52–55, 58–62], followed by Australia (n = 2; 13%) [56, 57], and China (n = 2; 13%) [51, 63]. All studies were undertaken in the educational sector. Myriad study designs were reported, including survey (n = 5) [49, 56, 59, 61, 62], descriptive (n = 2) [53, 55], multi-method (n = 2) [57, 60], action research (n = 1) [51], prospective cohort (n = 1) [50], pre-post (n = 2) [54, 63], qualitative (n = 1) [52], and exploratory randomised trial (n = 1) [58].
Table 1.
Author (Year) | Methodology utilised | Country | Participants sample size (n) | EBP Barriers addressed | Funding (Y/N) | Interventions |
---|---|---|---|---|---|---|
Allen et al. (2011) [49] | Survey | USA | Faculty (n = 11) | Lack of EBP approaches among CAM practitioners | Y | University developed *EBP course for Natural & Chinese medicine faculty |
Caldwell et al. (2018) [51] | Action research (survey, focus groups, diary notes, field notes) | China | Teachers, Assistants (n = 25) & students(n = 86) | Lack of research education and training | Y | International collaboration to assess initial *EBP workshop to help in the redesign |
Cramer et al. (2015) [59] | Survey | USA | Principle investigators from CAM and traditional research-intensive institutions (n-19) | Lack of research culture in CAM institutions; lack of collaboration between CAM and non-CAM institutions and faculty | Y | CAM Faculty & *TRI collaboration (seminars, mentorship joint development of courses, *EBP resources, and consulting) |
Evans et al. (2011) [53] | Descriptive | USA | Faculty and students | Lack of research education and training among CAM practitioners | Y | CAM & *TRI collaborated faculty development research program |
Haas et al. (2012) [50] | Prospective cohort (exam scores, questionnaire) | USA | Students (n = 370) | Poor knowledge, attitude, behaviour and skills in EBP | Y | CAM College & *TRI partnership to incorporate *EBP curriculum in existing 4-year program |
Laird et al. (2010) [54] | Pre and post | USA | Course directors (n = 34) | Lack of EBP learning in course content | Y | *EBP workshops series for faculty |
Long et al. (2014) [62] | Survey | USA | Program directors of CAM academic institutions (n = 9) | Lack of research expertise, literacy and evidence-based practice among CAM faculty | Y | *EBP literacy & training (e.g. workshops, seminars, online resources, short courses, intensive multiday training programs) |
McCarty et al. (2011) [52] | Qualitative (Focus group, Interviews) | USA | Faculty (n = 9) | Lack of EBP in CAM education and practice | Y | Clinical Exchange program between CAM school and *TRI |
Schneider et al. (2016) [58] | Exploratory randomised trial (survey) | USA | Practitioners (n = 293) | Lack of online EBP distance-learning | Y | Online *EBP course and booster lessons |
Steel, Adams, Sibbritt (2014) [57] | Multi-method (Audit, survey) | Australia | Practitioners (n = 1306) | Disconnect between researchers and practitioners | Y | Establish a protocol for a multi-modality *PBRN |
Steel, et al. (2018) [56] | Survey | Australia | Practitioners (n = 764) | Disconnect between researchers and practitioners | Y | Multi-modality, national *PBRN |
Sullivan, Furner & Cramer (2013) [60] | Multi-method (summaries, semi-structured interviews, surveys) | USA | Pre-doctoral CAM Students (n = 6) | Need for translational, interdisciplinary, and integrative research in CAM | Y | *TRI mentored research program for CAM institution |
Wayne et al. (2008) [55] | Descriptive | USA | Faculty, staff, alumni, students | Lack of research education and training in CAM institutions | Y | Training and research literacy collaboration between CAM school & Medical School |
Wong et al. (2019) [63] | Pre and post | China | Students (n = 59) | Lack of EBP in practice | Y | Face-to-face 3-day workshop |
Zwickey et al. (2014) [61] | Survey | USA | CAM colleges (n = 9) | Lack of research education and training in EBP | Y | Curricular revision of research literacy teaching |
*EBP Evidence-based practice, *PBRN Practitioner-based research network, *TRI Traditional research-intensive
All studies (100%) were undertaken in the educational sector. Ten studies (66.6%) reported the provision of funding by the National Institute of Health (NCCAM) to improve research conduct or application within CAM institutions and practice [49, 50, 52, 53, 55, 58–62]. The fifteen included studies targeted twenty-one CAM disciplines (i.e. Acupuncture, Aromatherapy, Ayurveda, Bowen therapy, Classical Chinese medicine, Chinese Herbal medicine, Chiropractic, Counselling, Homeopathy, Kinesiology, Massage therapy, Musculoskeletal therapy, Myotherapy, Naturopathy, Nutrition (non-dietetic), Osteopathy, Oriental medicine, Reflexology, Traditional Chinese medicine, Western Herbalism and Yoga). Seven studies (46.6%) focused on a single CAM discipline [50–52, 54, 55, 58], and eight studies (53%) focused on multiple CAM disciplines [49, 53, 56, 57, 59–62]. Disciplines represented the most in the included studies were Chiropractic (n = 7 studies), aturopathy (n = 7 studies), Acupuncture (n = 6 studies), Massage therapy (n = 5 studies), Osteopathy (n = 4 studies), Chinese Herbal Medicine (n = 4 studies), and Nutrition (n = 3 studies). Aromatherapy, Ayurveda, Bowen Therapy, Homeopathy, Kinesiology, Myotherapy, Musculoskeletal therapy, Oriental medicine, Reflexology, Traditional Chinese medicine, Western Herbalism and Yoga were represented in two studies each. Counselling, and Classical Chinese medicine were each reported in a single study.
Description of enabling strategies
All fifteen studies reported enabling strategies that focused on both education and collaborative activities. Eleven studies (73%) reported education strategies [49–51, 53–55, 58, 60–63], and eleven studies (73%) [49–57, 59, 60] reported on the formation of networks or collaborations. Among the eleven studies that reported collaborations, nine studies (60%) reported collaborations between CAM institutions (schools, colleges) and traditional research intensive (TRI) non-CAM institutions (i.e. conventional universities, medical schools) [49–55, 59, 60], and two studies reported on the formation of a practice-based research network (PBRN) [56, 57].
Description of barriers addressed
Informed by the oBSTACLES instrument, the enabling strategies reported in the included studies were categorised into three distinct groups, including those that addressed: (a) barriers to the conduct of research, (b) barriers to the application of research, and (c) barriers to both the conduct and application of research. Figure 2 summarises the enabling strategies captured within each of these groups. A supplementary data extraction file is also provided.
Strategies addressing barriers to the conduct of research
Two studies (13%) [56, 57] reported enabling strategies that solely addressed barriers to the conduct of research. Both studies reported the establishment of a practice-based research network (PBRN). While neither study reported the impact of the PBRN, the authors indicated that the PBRN aimed to provide infrastructure for researchers to engage with practitioners in grass-roots clinical practice to facilitate research inquiry [57].
Strategies addressing barriers to the application of research
Eight studies (53%) [49–54, 58, 63] reported enabling strategies that addressed barriers to the application of research in CAM practice. All eight studies used education as an enabling strategy that targeted CAM faculty, staff, students and/or practitioners. Six studies [49–54] reported on collaborative education initiatives between CAM educational institutions and TRI institutions, such as the implementation of an intensive short course in EBM [49], research workshops [54, 63], an evidence-informed practice (EIP) development program [53], the integration of EBP curriculum into an existing program [50], improvement of a previously developed course [51], and clinical exchange between CAM faculty and an allopathic clinic [52]. One study, not linked to any collaborative activity, used a standalone online distance education program to teach practitioners about the principles of EBP [58].
Outcomes for faculty
Five studies that addressed barriers to the application of research reported outcomes for faculty. The educational and collaborative strategies reportedly improved faculty attitude, such as commitments to enhancing skills, using EBM in teaching [49], adopting interactive teaching methods [51], improved confidence [54], change in culture [49], appreciation of the exposure to clinical experiences outside the usual naturopathic scope [49], affirmation of naturopathic profession/training [52], and the value of observations of clinical resources in a university setting [52]. Changes in participant knowledge and skills were also reported including improvements in practical skills [49], understanding of EBM [54], and the ability to teach critical appraisal and apply it to patient care [54]. Furthermore, the initiatives appeared to forge new relationships with the clinical exchange experience [52] being viewed as a favourable way to help integrate EBM into CAM clinical teaching. There was also an impact on teaching and learning. Resources, including improvements to existing teaching tools [51, 52], development of new EBP courses [53], and the creation of a CAM school-specific library modelled after the collaborating university library [52].
Outcomes for students
Three studies addressing barriers to the application of research reported outcomes for students. The educational strategies employed in these studies appeared to enhance student attitudes [50, 51], confidence [63], knowledge, self-assessed skills and behaviours regarding the utilisation of EBP [50, 63]. One study [63] reported that despite the use of an educational strategy involving a 3-day workshop, subjective norms about EBP did not change.
Outcomes for practitioners
One study addressing barriers to the application of research reported outcomes for practitioners. Authors of a single trial reported a modest improvement in practitioner attitude and skills in EBP, but not in EBP use, among practitioners assigned to the online educational strategy compared with those allocated to waitlist control [58].
Strategies addressing barriers to the conduct and application of research
Five studies (33%) [55, 59–62] reported enabling strategies that addressed barriers to the conduct and application of research. Of these, three studies reported the use of both educational and collaborative strategies including cross-institutional research training [55], a research mentorship for CAM students [60] and evaluating best practice models for implementing curricular and culture change [61]. One study examined the approaches used to develop faculty expertise in research literacy and EBP [62]. One study reported the impact of collaborative strategies between CAM and TRI institutions to increase the quality and quantity of research content and curricula [59].
Outcomes for faculty and staff
Four studies addressing barriers to the conduct and application of research reported outcomes for faculty and staff. The enabling strategies reportedly enhanced faculty attitudes, confidence, and skills in EBP and research [55, 59, 62], as well as faculty and staff research experience [59]. Incentives such as providing credit for continuing education [55, 62], allowing time for participation in research-related conferences and seminars and creating opportunities to apply for small grants to attend research-related seminars and conferences helped to reinforce the idea that research should inform practice [62]. Improved access to resources and research training [62] was also reported. One study described improvements in research output [55], with the strategy contributing toward the publication of more than 25-peer reviewed papers [55]. Cross-institutional collaborations reportedly helped CAM institutions capitalise on resources provided by conventional partners, enabled CAM faculty/staff to enroll in university clinics and research training programs, developed instructional approaches in research literacy and EBP programs, developed assessment tools and strategies to evaluate faculty development, and provided mentorship opportunities [62].
Outcomes for students
Student outcomes were reported in three studies addressing barriers to the conduct and application of research. The use of both educational and collaborative strategies were reported to improve student learning, knowledge acquisition, application and demonstration of competence in research [61], participation in research studies (including increased participation in masters and doctoral programs) [60, 61], confidence in undertaking independent studies [55], developing research clubs [61], and including research as a significant component of their career [55].
Outcomes for institutions
Four studies addressing barriers to the conduct and application of research reported outcomes for institutions. The use of education and training initiatives, along with cross-institutional collaborations, appeared to transform a “vocational” institution into an “academic” institution [55], elevated EBP content in curricula and clinical training [55, 61, 62], increased the number of research faculty appointments with doctoral degrees [55], and created new programs to support faculty development in medical education [62] and Integrative Medicine research [61]. Cross-institutional collaborations also reportedly improved the culture and relationships between CAM and clinical science faculties [59, 61], helped devlop a greater understanding of similarities and differences between healthcare disciplines and paradigms, and improved perceptions of the viability of future collaborations [59]. One study also indicated that as a result of the strategy, librarians emerged as leaders in supporting understanding and use of EBM resources, and facilitating the development and implementation of systems for teaching EBM content [61].
Discussion
This is the first known synthesis of evidence of strategies aimed at addressing barriers to the conduct and application of research in CAM. By doing so, this review addresses an important knowledge gap in the literature. While there have been some concerted efforts to overcome these barriers, this review found the evidence to be limited to a handful of jurisdictions (e.g., United States of America), a small number of CAM disciplines (e.g., chiropractic, naturopathy, and acupuncture), and addressed few barriers (e.g., skill development, collaborative and targeted funding opportunities).
Education was the most frequently used strategy to address gaps in knowledge, participation, attitudes, and skills as a means of improving CAM practitioner, faculty, staff, and student engagement in research. The use of educational strategies to promote engagement with research is not unique to CAM and has been reported widely across a range of health disciplines. For example, in medicine [64], and in allied health [65], numerous training programs have been used to improve research literacy. There is considerable research relating to using education to address barriers to incorporate EBM principles and practices in healthcare [21, 66–69]. Educational strategies, targeted at institutions that train CAM practitioners, may assist in developing future CAM workforce that is skilled, and confident to engage in research. For those in clinical practice, embedding research and EBP training in continuing professional development requirements may provide an incentive to upskill in these areas [36, 70]. However, while such initiatives have been successfully utilised in medicine and allied health [71, 72], they may not be necessarily successful in CAM.
The reluctance of many CAM disciplines to engage in EBP or research may be attributed to epistemological [73] and philosophical [74] differences between CAM and bio-medical disciplines. For example, CAM approaches towards disease are often reported to be incompatible with standardized research protocols like randomised controlled trials [75] which rarely reflect the individualised, multi-modality delivery of CAM interventions [76]. As a result, what may be considered robust research and evidence by biomedical disciplines, may not be shared by CAM disciplines [73, 74, 76–80]. Other challenges impacting CAM practitioner engagements include barriers to training (i.e. lack of dedicated research training for CAM disciplines) [81], in clinical practice (i.e lack of incentives and time, financial disincentives and the need to ensure financial survivability [82]) and the lack of a research culture [35]. Notwithstanding, these barriers are shared across several health disciplines, including medical [17, 83] and allied health [84–90].
As a means of addressing barriers to engagement with research, many of the included studies utilised collaborative approaches, such as building relationships between TRI institutions and CAM stakeholders and creating a PBRN. Linking with TRI institutions could be a worthwhile strategy as these institutions have long incorporated research and evidence-based practice principles within their curricula [64, 91, 92]. These learnings and experiences could be used by CAM stakeholders to develop a CAM workforce that has the knowledge, skills, and competencies to engage with research.
The use of PBRNs has been shown to be another effective strategy for improving the conduct and application of research as it is a mature collaborative effort that can facilitate a research culture for practitioners [93], as well as provide a necessary first-step to EBP [82]. PBRNs can also serve as ideal environments to increase understanding of barriers to professional behaviour change [40]. This is critical as PBRNs can provide useful insights into barriers that may confront a workforce when engaging with research at the frontline of clinicial practice. This can inform development of practitioner-driven strateiges to support “bench to behaviour” [94].
The important role of funding, the impact of the lack thereof, has been widely reported in the literature [95, 96]. Funding can influence the production of knowledge [97, 98], and this review found many of the strategies reported in this review were developed with the support of targeted funding opportunities for CAM researchers and practitioners; without which, these developments may not have been possible. While such targeted approaches have reported benefits [99, 100], they have been confined to limited jurisdictions and thus require wider implementation and evaluation.
Strengths, limitations, and recommendations
This review has several strengths. This scoping review was underpinned by rigorous and transparent methods and followed best practices in the conduct and reporting of a scoping review. The review protocol was devised and reviewed by members of a research team with significant expertise in knowledge synthesis and review methods, and the search strategy was independently validated by an academic librarian. The inclusion of both quantitative and qualitative study designs added to the analytical breadth and depth of this review.
However, as with any research, this review too has limitations. First, searching CAM-related literature can be challenging due to the diversity of professions classified as CAM; further, not all CAM literature are published in indexed journals. Second, this scoping review was limited to studies published in the English language, therefore, it is possible that relevant studies and insights may have been missed.
While several barriers to the conduct and application of research in CAM have been identified [46], the review identified studies that targeted only a handful of these barriers. Collectively, these barriers could be categorised into those associated with knowledge and skills (e.g. limited knowledge and skills to apply research evidence into practice), capacity (e.g. limited opportunities for CAM undergraduate students to contribute to CAM research), collaborative opportunities (e.g. limited collaboration between CAM researchers and other health researchers) and funding. The narrow range of barriers addressed by initiatives to date is a limitation of the current knowledge base; notwithstanding, it does highlight potential opportunities for future research (i.e. addressing other barriers to the conduct and application of research in CAM). These research initiatives could explore innovative strategies to address CAM-centric barriers to research (such as customised educational programs) or build on strategies that have demonstrated impact elsewhere (such as collaborative approaches with TRI institutions).
Conclusion
Despite the growing popularity of CAM and wide-spread recognition of research to inform CAM practices, there continue to persist numerous barriers to the conduct and application of research in CAM. While this has been recognized, much of the focus to date has been limited to initiatives originating from a handful of jurisdictions and mainly for a small group of CAM disciplines; these initiatives also target few barriers. While research in this field is encouraging, myriad barriers continue to persist, and the effectiveness of these initiatives warrants further examination. Addressing these barriers, will require concerted effort and collaboration by a range of CAM stakeholders and across multiple sectors. Further research can contribute to the evidence base on how best to address these barriers to promote the conduct and application of research in CAM.
Supplementary Information
Acknowledgements
We acknowledge the generous help of Ms. Sarah McQuillen, academic librarian, University of South Australia, for generously providing guidance, feedback and validation of the search strategy used in this scoping review. Ms. Veziari acknowledges the Australian Government Research Training Program Scholarship and the Commonwealth Scholarships Program of South Australia that fund her PhD.
Abbreviations
- CAM
Complementary and alternative medicine
- EBP
Evidence-based practice
- EBM
Evidence-based medicine
- TRI
Traditional research-intensive
- PBRN
Practice-based research network
- EIP
Evidence-informed practice
- oBSTACLES
BarrierS To the Application and Conduct of rEsearch
Appendix 1
Medline search
1-complementary therapies/
2-acupuncture therapy/
3-acupuncture analgesia/
4-acupuncture, ear/
5-homeopathy/
6-Aromatherapy/
7-Medicine, Ayurvedic/
8-medicine, traditional/
9-mind-body therapies/
10-yoga/
11-naturopathy/
12-Massage/
13-Herbal Medicine/
14-ACUPUNCTURE/
15-Manipulation, Chiropractic/
16-Manipulation, Osteopathic/
17-KINESIOLOGY, APPLIED/
18-Medicine, Chinese Traditional/
19-NUTRITIONISTS/
20-OSTEOPATHIC PHYSICIANS/
21-(Complementary medicine? or alternative medicine? or chinese medicine? or traditional medicine? or alternative therap* or complementary therap* or traditional therap* or acupunct* or homeopath* or mind-body therap* or mind body therap* or yoga or naturopath* or massage? or massaging or herbal medicine? or herbalism or osteopath* or chiropract* or TCAM? or ayurved* or hindu medicine? or siddha medicine? or myotherapy* or bowen?? therap* or aromatherap* or aroma therap* or reflexolog* or bodywork or bodyworks or kinesiolog* or nutrition or clinical nutritionist?).mp. [mp = title, abstract, heading word, drug trade name, original title, device manufacturer, drug manufacturer, device trade name, keyword, floating subheading word, candidate term word].
22-or/1–21
23-Evidence-Based Practice/
24-(evidence? base? or evidence?-base? or EBP).mp. [mp = title, abstract, heading word, drug trade name, original title, device manufacturer, drug manufacturer, device trade name, keyword, floating subheading word, candidate term word]
25-Policy/
26-Organizational policy/
27-(policy or policies).mp. [mp = title, abstract, heading word, drug trade name, original title, device manufacturer, drug manufacturer, device trade name, keyword, floating subheading word, candidate term word]
(policy or policies).mp. [mp = title, abstract, heading word, drug trade name, original title, device manufacturer, drug manufacturer, device trade name, keyword, floating subheading word, candidate term word]
28-Practice Guidelines as Topic/
29-(best?practice? or best practice?).mp. [mp = title, abstract, heading word, drug trade name, original title, device manufacturer, drug manufacturer, device trade name, keyword, floating subheading word, candidate term word]
30-or/23–29
31-“diffusion of innovation”/
32-Clinical Decision-Making/
33-“Diagnostic Techniques and Procedures”/
34- Decision Making, Organizational/
35- information dissemination/
36- “Access to Information”/
37-Knowledge Management/
38-Translational Medical Research/
39-(Translational adj (medic* or research)).mp. [mp = title, abstract, heading word, drug trade name, original title, device manufacturer, drug manufacturer, device trade name, keyword, floating subheading word, candidate term word]
40-(Clinical decision making or clinical decision-making or diagnos* technique? or diagnos* procedure? or “barrier? to conduct*” or “barrier? to research conduct*” or “barrier? to application?” or “barrier? to research application?” or research barrier? or conduct barrier? or application barrier? or “facilitator? to conduct*” or “facilitator? to research conduct*” or “facilitator? to application?” or “facilitator? to research application?” or research facilitator? or conduct facilitator? or application facilitator? or “application of knowledge” or appl* knowledge).mp. [mp = title, abstract, heading word, drug trade name, original title, device manufacturer, drug manufacturer, device trade name, keyword, floating subheading word, candidate term word]
41- ((Data or datum or information or knowledge or research* or innovation?) adj2 (share? or sharing or disseminat* or distribut* or manag* or diffus* or translat* or transfer* or utilize or utilise or utili?ation or synthes* or implement* or exchang* or access* or barrier? or facilitat* or select* or tailor* or attitude?)).mp. [mp = title, abstract, heading word, drug trade name, original title, device manufacturer, drug manufacturer, device trade name, keyword, floating subheading word, candidate term word]
42-or/31–41
43–22 and 30 and 42
44-limit 43 to (english language and humans)
Authors’ contributions
YV conceived the original review. ML and SK assisted YV in refining the review topic and YV, ML and SK co-developed the search strategy. YV and SK undertook independent searching of the literature and the selection of articles were undertaken in collaboration with YV, ML and SK. While YV lead the critical appraisal and data extraction stages, ML and SK also undertook critical appraisal and data extraction, as independent reviewers, to ensure rigour in the review process. YV, ML and SK were all involved in the data synthesis stage. All three authors contributed to the development of this manuscript in its current form through various revisions and approved the final manuscript.
Funding
This study is supported by the Australian Government Research Training Program Scholarship and the Commonwealth Scholarships Program of South Australia.
Availability of data and materials
All data generated or analysed during this study are included in this published article.
Declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Yasamin Veziari, Email: Yasamin.Veziari@mymail.unisa.edu.au.
Saravana Kumar, Email: Saravana.Kumar@unisa.edu.au.
Matthew Leach, Email: Matthew.Leach@scu.edu.au.
References
- 1.Leasure AR, Stirlen J, Thompson C, Barriers and facilitators to the use of evdence-based best practices. Dimens Crit Care Nurse. 2008;27(2):83–4.10.1097/01.dcc.0000311600.25216.c5. [DOI] [PubMed]
- 2.Sackett DL, Rosenberg WMC, Gray JAM, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn't. BMJ. 1996;312(7023):71–72. doi: 10.1136/bmj.312.7023.71. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Jeffrey C. Evidence-based practice: evolution, challenges, and current status. Electron Int J Educ Arts Sci. 2016;2:23–48. [Google Scholar]
- 4.Facey K, Henshall C, Sampietro-Colom L, Thomas S. Improving the effectiveness and efficiency of evidence production for health technology assessment. Int J Technol Assess Health Care. 2015;31(4):201–206. doi: 10.1017/S0266462315000355. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Harris C, Garrubba M, Allen K, King R, Kelly C, Thiagarajan M, Castleman B, Ramsey W, Farjou D. Development, implementation and evaluation of an evidence-based program for introduction of new health technologies and clinical practices in a local healthcare setting. BMC Health Serv Res. 2015;15(1):575. doi: 10.1186/s12913-015-1178-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Hisham R, Ng CJ, Liew SM, Hamzah N, Ho GJ. Why is there variation in the practice of evidence-based medicine in primary care? A qualitative study. BMJ Open. 2016;6(3):e010565. doi: 10.1136/bmjopen-2015-010565. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Kristensen N, Nymann C, Konradsen H. Implementing research results in clinical practice- the experiences of healthcare professionals. BMC Health Serv Res. 2016;16:48. [DOI] [PMC free article] [PubMed]
- 8.Shayan SJ, Kiwanuka F, Nakaye Z. Barriers associated with evidence-based practice among nurses in low - and middle - income countries: a systematic review. Worldviews Evid Based Nurs. 2019;16(1):12–20. https://doi.org/101111/wvn.12337. [DOI] [PubMed]
- 9.Upton D, Upton P. Knowledge and use of evidence-based practice by allied health and health science professionals in the United Kingdom. J Allied Health. 2006;35(3):127–33. [PubMed]
- 10.Medicine., I.o.M.R.o.E.b. Leadership commitments to improve value in healthcare: finding common ground: workshop summary. Washington (DC): National Academies Press; 2009. [PubMed]
- 11.Lehane E, Leahy-Warren P, O’Riordan C, Savage E, Drennan J, O’Tuathaigh C, O’Connor M, Corrigan M, Burke F, Hayes M, Lynch H, Sahm L, Heffernan E, O’Keeffe E, Blake C, Horgan F, Hegarty J. Evidence-based practice education for healthcare professions: an expert view. BMJ Evidence Based Med. 2019;24(3):103–108. doi: 10.1136/bmjebm-2018-111019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Barends E, Villanueva J, Rousseau DM, Briner RB, Jepsen DM, Houghton E, ten Have S. Managerial attitudes and perceived barriers regarding evidence-based practice: an international survey. PLoS One. 2017;12(10):e0184594. doi: 10.1371/journal.pone.0184594. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Ramírez-Vélez R, Bagur-Calafat MC, Correa-Bautista JE, Girabent-Farrés M. Barriers against incorporating evidence-based practice in physical therapy in Colombia: current state and factors associated. BMC Med Educ. 2015;15(1):220. doi: 10.1186/s12909-015-0502-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Sadeghi-Bazargani H, Tabrizi J, Azami-Aghdash S. Barriers to evidence-based medicine: a systematic review. J Eval Clin Pract. 2014;20(6):793–802. doi: 10.1111/jep.12222. [DOI] [PubMed] [Google Scholar]
- 15.Taylor R. The essentials of nursing and healthcare research. London: SAGE; 2014. [Google Scholar]
- 16.Ashrafi-Rizi H, Fateme Z, Khorasgani ZG, Kazempour Z, Imani ST. Barriers to research activities from the perspective of the students of Isfahan University of Medical Sciences. Acta Inform Med. 2015;23(3):155–159. doi: 10.5455/aim.2015.23.155-159. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Safdari R, et al. Barriers to participation in medical research from the perspective of researchers. J Educ Health Promot. 2018;7:22. doi: 10.4103/jehp.jehp_26_17. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Weintraub P, McKee M. Leadership for innovation in healthcare: an exploration. Int J Health Policy Manag. 2019;8(3):138–144. doi: 10.15171/ijhpm.2018.122. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Nolte E. In: How do we ensure that innovation in health service delivery and organization is implemented, sustained and spread?, in Health Systems for Prosperity and Solidarity. Kluge H, Figueras J, editors. Denmark: World Health Organisation; 2018. [Google Scholar]
- 20.Black AT, et al. Promoting Evidence-Based Practice Through a Research Training Program for Point-of-Care Clinicians. 2015. pp. 14–20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Shifaza F, Evans D, Bradley H. Nurses’ perceptions of barriers and facilitators to implement EBP in the Maldives. Adv Nurs. 2014;2014:1–7. doi: 10.1155/2014/698604. [DOI] [Google Scholar]
- 22.Lai NM, Teng CL, Lee L. The place and barriers of evidence based practice: knowledge and perceptions of medical, nursing and allied health practitioners in Malaysia. BMC Res Notes. 2010;3(1):279. doi: 10.1186/1756-0500-3-279. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Dizon JM, Grimmer K, Louw Q, Machingaidze S, Parker H, Pillen H. Barriers and enablers for the development and implementation of allied health clinical practice guidelines in south African primary healthcare settings: a qualitative study. Health Res Policy Syst. 2017;15(1):79. doi: 10.1186/s12961-017-0243-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Leach MJ, Gillham D. Are complementary medicine practitioners implementing evidence based practice? Complement Ther Med. 2011;19(3):128–136. doi: 10.1016/j.ctim.2011.04.002. [DOI] [PubMed] [Google Scholar]
- 25.Schneider MJ, Evans R, Haas M, Leach M, Hawk C, Long C, Cramer GD, Walters O, Vihstadt C, Terhorst L. US chiropractors' attitudes, skills and use of evidence-based practice: a cross-sectional national survey. Chiropractic Manual Ther. 2015;23(1):16. doi: 10.1186/s12998-015-0060-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Jonas WB. Building an evidence house: challenges and solutions to research in complementary and alternative medicine. Forsch Komplementarmed Klass Naturheilkd. 2005;12(3):159–167. doi: 10.1159/000085412. [DOI] [PubMed] [Google Scholar]
- 27.Goldstein M. In: The Growing Acceptance of Complementary and Alternative Medicine, in Handbook of Medical Sociology. Bird C, Conrad P, Fremont A, editors. New Jersey: Prentice Hall; 2000. pp. 284–295. [Google Scholar]
- 28.National Center for, C. and M. Alternative, Expanding horizons of healthcare: five-year strategic plan, 2001–2005, NCCAM. NIH publication ;no. 01–5001. 2000, [Bethesda, Md.?]: U.S. Dept. of Heath and Human Services, Public Health Service, National Institutes of Health. 44 p.
- 29.Frass M, Strassl RP, Friehs H, Müllner M, Kundi M, Kaye AD. Use and acceptance of complementary and alternative medicine among the general population and medical personnel: a systematic review. Ochsner J. 2012;12(1):45–56. [PMC free article] [PubMed] [Google Scholar]
- 30.Bodane C, Brownson K. The growing acceptance of complementary and alternative medicine. Health Care Manager. 2002;20(3):11–21. doi: 10.1097/00126450-200203000-00003. [DOI] [PubMed] [Google Scholar]
- 31.Gray AC, Steel A, Adams J. A critical integrative review of complementary medicine education research: key issues and empirical gaps. BMC Complement Altern Med. 2019;19(1):73. doi: 10.1186/s12906-019-2466-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Ernst E. Obstacles to research in Compkementary and alternative medicine. Med J Aust. 2003;179(6):279–280. doi: 10.5694/j.1326-5377.2003.tb05546.x. [DOI] [PubMed] [Google Scholar]
- 33.Coulter ID, Lewith G, Khorsan R, Kirk R, Mittman B. Research methodology: choices, logistics, and challenges. Evid Based Complement Alternat Med. 2014. 10.1155/2014/780520. [DOI] [PMC free article] [PubMed]
- 34.Sarris J. Current challenges in appraising complementary medicine evidence. Med J Aust. 2012;196(5):310–311. doi: 10.5694/mja11.10751. [DOI] [PubMed] [Google Scholar]
- 35.Veziari Y, Leach M, Kumar S. Barriers to the conduct and application of research in complementary and alternative medicine: a systematic review. BMC Complement Altern Med. 2017;17(1):166. doi: 10.1186/s12906-017-1660-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Walker BF, Stomski NJ, Hebert JJ, French SD. A survey of Australian chiropractors’ attitudes and beliefs about evidence-based practice and their use of research literature and clinical practice guidelines. Chiropractic Manual Ther. 2013;21(1):44. doi: 10.1186/2045-709X-21-44. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Pham MT, Rajić A, Greig JD, Sargeant JM, Papadopoulos A, McEwen SA. A scoping review of scoping reviews: advancing the approach and enhancing the consistency. Res Synth Methods. 2014;5(4):371–385. doi: 10.1002/jrsm.1123. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Munn Z, Peters MDJ, Stern C, Tufanaru C, McArthur A, Aromataris E. Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol. 2018;18(1):143. doi: 10.1186/s12874-018-0611-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, Moher D, Peters MDJ, Horsley T, Weeks L, Hempel S, Akl EA, Chang C, McGowan J, Stewart L, Hartling L, Aldcroft A, Wilson MG, Garritty C, Lewin S, Godfrey CM, Macdonald MT, Langlois EV, Soares-Weiser K, Moriarty J, Clifford T, Tunçalp Ö, Straus SE. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467–473. doi: 10.7326/M18-0850. [DOI] [PubMed] [Google Scholar]
- 40.Bussières AE, al Zoubi F, Stuber K, French SD, Boruff J, Corrigan J, Thomas A. Evidence-based practice, research utilization, and knowledge translation in chiropractic: a scoping review. BMC Complement Altern Med. 2016;16(1):216. doi: 10.1186/s12906-016-1175-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32. doi: 10.1080/1364557032000119616. [DOI] [Google Scholar]
- 42.Levac D, Colquhoun H, O'Brien KK. Scoping studies: advancing the methodology. Implement Sci. 2010;5(1):69. doi: 10.1186/1748-5908-5-69. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Peters M, et al. Guidance for conducting systematic scoping reviews. Int J Evid Based Healthcare. 2015;13(3):141–146. doi: 10.1097/XEB.0000000000000050. [DOI] [PubMed] [Google Scholar]
- 44.Archambault PM, van de Belt TH, Grajales III FJ, Eysenbach G, Aubin K, Gold I, Gagnon MP, Kuziemsky CE, Turgeon AF, Poitras J, Faber MJ, Kremer JAM, Heldoorn M, Bilodeau A, Légaré F. Wikis and collaborative writing applications in health care: a scoping review protocol. JMIR Res Protoc. 2012;1(1):e1. doi: 10.2196/resprot.1993. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Peters M, et al. In: Joanna Briggs Institute Reviewer's Manual. Aromataris E, Munn Z, et al., editors. The Joanna Briggs Institute; 2017. [Google Scholar]
- 46.Veziari Y, Kumar S, Leach M. The development of a survey instrument to measure the barriers to the conduct and application of research in complementary and alternative medicine: a Delphi study. BMC Complement Altern Med. 2018;18(1):335. doi: 10.1186/s12906-018-2352-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Veziari Y, Kumar S, Leach MJ. Evaluating the reliability of the oBSTACLES instrument. Adv Integr Med. 2020;8(1):50–7. 10.1016/j.aimed.2020.02.007.
- 48.Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097. doi: 10.1371/journal.pmed.1000097. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Allen ES, et al. A train the trainer model for integrating evidence-based medicine into a complementary and alternative medicine training program. Explore (New York, N.Y.) 2011;7(2):88–93. doi: 10.1016/j.explore.2010.12.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Haas M, Leo M, Peterson D, LeFebvre R, Vavrek D. Evaluation of the effects of an evidence-based practice curriculum on knowledge, attitudes, and self-assessed skills and behaviors in chiropractic students. J Manip Physiol Ther. 2012;35(9):701–709. doi: 10.1016/j.jmpt.2012.10.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Caldwell PHY, Lai L, Li X, Fei Y, Cao H, Sun J, Liang N, Liu J, Scott KM. Development and delivery of an evidence-based medicine programme for traditional Chinese medicine students using an international collaborative approach: an action research project. Eur J Int Med. 2018;20:98–105. doi: 10.1016/j.eujim.2018.05.001. [DOI] [Google Scholar]
- 52.McCarty RL, et al. Building bridges: qualitative assessment of a clinical faculty exchange between a naturopathic and an allopathic medical training program. Explore (New York, N.Y.) 2011;7(4):249–253. doi: 10.1016/j.explore.2011.04.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Evans R, et al. Advancing evidence informed practice through faculty development: the Northwestern Health Sciences University model. Explore (New York, N.Y.) 2011;7(4):265–268. doi: 10.1016/j.explore.2011.04.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Laird S, George J, Sanford SM, Coon S. Development, implementation, and outcomes of an initiative to integrate evidence-based medicine into an osteopathic curriculum. J Am Osteopathic Assoc. 2010;110(10):593–601. [PMC free article] [PubMed] [Google Scholar]
- 55.Wayne P, Buring JE, Davis RB, Andrews SM, John MS, Kerr CE, Kaptchuk TJ, Schachter SC. Increasing research capacity at the new England School of Acupuncture through faculty and student research training initiatives. Altern Ther Health Med. 2008;14(2):52–58. [PubMed] [Google Scholar]
- 56.Steel A, Leach M, Wardle J, Sibbritt D, Schloss J, Diezel H, Adams J. The Australian complementary medicine workforce: a profile of 1,306 practitioners from the PRACI study. J Altern Complement Med. 2018;24(4):385–394. doi: 10.1089/acm.2017.0206. [DOI] [PubMed] [Google Scholar]
- 57.Steel A, Adams J, Sibbritt D. Developing a multi-modality complementary medicine practice-based research network: the PRACI project. Adv Integ Med. 2014;1(3):113–118. doi: 10.1016/j.aimed.2014.11.003. [DOI] [Google Scholar]
- 58.Schneider M, Evans R, Haas M, Leach M, Delagran L, Hawk C, Long C, Cramer GD, Walters O, Vihstadt C, Terhorst L. The effectiveness and feasibility of an online educational program for improving evidence-based practice literacy: an exploratory randomized study of US chiropractors. Chiropractic Manual Ther. 2016;24(1):27. doi: 10.1186/s12998-016-0109-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Cramer GD, Guiltinan J, Maiers M, Laird S, Goertz C, Furner SE, Kreitzer MJ, Dexheimer JM, Coon S. Benefits, challenges, and culture change related to collaborations between complementary and alternative medicine and traditional research-intensive institutions. Med Sci Educ. 2015;25(1):27–34. doi: 10.1007/s40670-014-0077-3. [DOI] [Google Scholar]
- 60.Sullivan B, Furner S, Cramer G. Development of a student mentored research program between complementary and alternative medicine and traditional, Research Intensive Universities to Foster Evidence-based Practitioners and Clinician-researchers EXPLORE. J Sci Heal. 2013;9:323. [Google Scholar]
- 61.Zwickey H, et al. Teaching evidence-based medicine at complementary and alternative medicine institutions: strategies, competencies, and evaluation. J Altern Complement Med (New York, N.Y.) 2014;20(12):925–931. doi: 10.1089/acm.2014.0087. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Long CR, et al. Faculty development initiatives to advance research literacy and evidence-based practice at CAM academic institutions. J Altern Complement Med (New York, N.Y.) 2014;20(7):563–570. doi: 10.1089/acm.2013.0385. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Wong CH, et al. Impact of evidence-based healthcare education for Chinese medicine practitioners: a pre-post evaluation. Complement Ther Med. 2019;45:38–44. doi: 10.1016/j.ctim.2019.05.004. [DOI] [PubMed] [Google Scholar]
- 64.Gillman J, Pillinger M, Plottel CS, Galeano C, Maddalo S, Hochman JS, Cronstein BN, Gold-von Simson G. Teaching translational research to medical students: the new York University School of Medicine's Master's of science in clinical investigation dual-degree program. Clin Transl Sci. 2015;8(6):734–739. doi: 10.1111/cts.12328. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Asokan GV. Evidence-based practice curriculum in allied health professions for teaching-research-practice nexus. J Evid Based Med. 2012;5(4):226–231. doi: 10.1111/jebm.12000. [DOI] [PubMed] [Google Scholar]
- 66.Zwolsman S, te Pas E, Hooft L, Waard MWD, van Dijk N. Barriers to GPs' use of evidence-based medicine: a systematic review. Bri J Gen Pract. 2012;62(600):e511–e521. doi: 10.3399/bjgp12X652382. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Scurlock-Evans L, Upton P, Upton D. Evidence-based practice in physiotherapy: a systematic review of barriers, enablers and interventions. Physiotherapy. 2014;100(3):208–219. doi: 10.1016/j.physio.2014.03.001. [DOI] [PubMed] [Google Scholar]
- 68.Tasca G, et al. Addressing challenges and barriers to translating psychotherapy research into clinical practice: the development of a psychotherapy practice research network in Canada. Can Psychol. 2014;55(3):197–203. doi: 10.1037/a0037277. [DOI] [Google Scholar]
- 69.Toklu HZ. Promoting evidence-based practice in pharmacies. Integrated Pharm Res Pract. 2015;4:127–131. doi: 10.2147/IPRP.S70406. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Leach MJ, Tucker B. Current understandings of the research–practice gap from the viewpoint of complementary medicine academics: a mixed-method investigation. Explore. 2017;13(1):53–61. doi: 10.1016/j.explore.2016.10.005. [DOI] [PubMed] [Google Scholar]
- 71.Slade SC, Philip K, Morris ME. Frameworks for embedding a research culture in allied health practice: a rapid review. Health Res Policy Syst. 2018;16(1):29. doi: 10.1186/s12961-018-0304-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Sharplin G, et al. Establishing and sustaining a culture of evidence-based practice: an evaluation of barriers and facilitators to implementing the best practice spotlight organization program in the australian healthcare context. Healthcare (Basel, Switzerland) 2019;7(4):142. doi: 10.3390/healthcare7040142. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Polich G, Dole C, Kaptchuk TJ. The need to act a little more ‘scientific’: biomedical researchers investigating complementary and alternative medicine. Sociol Health Illn. 2010;32(1):106–122. doi: 10.1111/j.1467-9566.2009.01185.x. [DOI] [PubMed] [Google Scholar]
- 74.Bode M, Payyapallimana U. Evidence based traditional medicine: for whom and to what end. eJournal Indian Med. 2013;6:1–20. [Google Scholar]
- 75.Mills E, et al. Teaching evidence-based complementary and alternative medicine: 1. Learn Struct Clin Dec Changes. 2002;8(2):207–214. doi: 10.1089/107555302317371514. [DOI] [PubMed] [Google Scholar]
- 76.Nahin RL, Straus SE. Research into complementary and alternative medicine: problems and potential. BMJ (Clinical research ed) 2001;322(7279):161–164. doi: 10.1136/bmj.322.7279.161. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Bradbury J, Avila C, Grace S. Multidisciplinary Digital Publishing Institute. 2020. Practice-Based Research in Complementary Medicine: Could N-of-1 Trials Become the New Gold Standard? In Healthcare. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Giordano J, Engebretson J, Garcia MK. Challenges to complementary and alternative medical research: focal issues influencing integration into a cancer care model. Integra Cancer Ther. 2005;4(3):210–218. doi: 10.1177/1534735405279179. [DOI] [PubMed] [Google Scholar]
- 79.Elder WG, Jr, et al. Toward interdisciplinary care: bridging the divide between biomedical and alternative health care providers. Ann Behav Sci Med educ. 2008;14(2):56–61. [PMC free article] [PubMed] [Google Scholar]
- 80.Shekelle PG, et al. Challenges in systematic reviews of complementary and alternative medicine topics. Ann Int Med. 2005;142(12_Part_2):1042–1047. doi: 10.7326/0003-4819-142-12_Part_2-200506211-00003. [DOI] [PubMed] [Google Scholar]
- 81.Vos L, Brennan R. Marketing complementary and alternative medical therapies. 2005. [Google Scholar]
- 82.Sherwood G, Armstrong GE, Lindell D, Jenkins P, Dolansky MA, Sable-Baus S. Leadership and systems improvement for the DNP. New York: Springer; 2019. 10.1891/9780826188632.
- 83.Zegers-Hochschild F. Barriers to conducting clinical research in reproductive medicine: Latin America. Fertil Steril. 2011;96(4):802–804. doi: 10.1016/j.fertnstert.2011.08.043. [DOI] [PubMed] [Google Scholar]
- 84.Al-Tannir M, et al. Research knowledge and skills among medical and allied health students attending a summer research course: a pretest and posttest analysis. Cureus. 2018;10(8):e3132. doi: 10.7759/cureus.3132. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 85.Matus J, Wenke R, Hughes I, Mickan S. Evaluation of the research capacity and culture of allied health professionals in a large regional public health service. J Multidiscip Healthc. 2019;12:83–96. doi: 10.2147/JMDH.S178696. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Harding KE, et al. Not enough time or a low priority? Barriers Evid Based Pract Allied Health Clin. 2014;34(4):224–231. doi: 10.1002/chp.21255. [DOI] [PubMed] [Google Scholar]
- 87.Carrick-Sen D, et al. International perspectives of nurses, midwives and allied health professionals clinical academic roles: are we at tipping point? Int J Pract Based Learn Health Soc Care. 2019;7(2):1–15. doi: 10.18552/ijpblhsc.v7i2.639. [DOI] [Google Scholar]
- 88.Aref F, Manyibe EO, Washington AL, Johnson J, Davis D, Eugene-Cross K, Moore CA. Research productivity in rehabilitation, disability, and allied health programs: a focus group perspective on minority-serving institutions. Rehabil Res Policy Educ. 2017;31(3):194–207. doi: 10.1891/2168-6653.31.3.194. [DOI] [Google Scholar]
- 89.Smith A, et al. Self-perceptions of value, barriers, and motivations for graduate education among dental hygienists. J Dent Educ. 2016;80(9):1033–40. 10.1002/j.0022-0337.2016.80.9.tb06185.x. [PubMed]
- 90.Pickstone C, Nancarrow S, Cooke J, Wesley V, Mountain G, Boyce RA. Building research capacity in the allied health professions. Evid and Policy A J Res Debate and Prac. 2012;4(1):75–90. 10.1332/174426408783477864. [DOI]
- 91.Acharya Y, Raghavendra Rao MV, Arja S. Evidence-based medicine in pre-clinical years: a study of early introduction and usefulness. J Adv Med Educ Profession. 2017;5(3):95–100. [PMC free article] [PubMed]
- 92.Weber S, et al. Incorporating evidence-based principles in medical training. Sharing experience with McMaster. MedEdPublish; 2018. p. 7. [DOI] [PMC free article] [PubMed]
- 93.Schloss J, McIntyre E, Steel A, Bradley R, Harnett J, Reid R, et al. Lessons from outside and within: exploring advancements in methodology for naturopathic medicine clinical research. J Altern Complement Med. 2019;25(2):135–40. 10.1089/acm.2018.0403. [DOI] [PMC free article] [PubMed]
- 94.Hartung D, et al. ‘Bench To Behavior’: Translating Comparative Effectiveness Research Into Improved Clinical Practice. Health Aff (Millwood) 2010;29(10):1891–1900. doi: 10.1377/hlthaff.2010.0696. [DOI] [PubMed] [Google Scholar]
- 95.Braun L, Cohen M. Herbs and Natural Supplements: Vol. 1. Australia: Churchill Livingstone; 2015.
- 96.Pelkonen O, Xu Q, Fan T-P. Why is research on herbal medicinal products important and how can we improve its quality? J Tradit Complement Med. 2014;4(1):1–7. doi: 10.4103/2225-4110.124323. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 97.Rosenbloom JL, Ginther DK, Juhl T, Heppert JA. The effects of Research & Development Funding on scientific productivity: academic chemistry, 1990-2009. PLoS One. 2015;10(9):e0138176. doi: 10.1371/journal.pone.0138176. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 98.Gottlieb M, Lee S, Burkhardt J, Carlson JN, King AM, Wong AH, Santen SA. Show me the money: successfully obtaining Grant funding in medical education. West J Emerg Med. 2019;20(1):71–77. doi: 10.5811/westjem.2018.10.41269. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 99.Gläser J, Velarde KS. Changing funding arrangements and the production of scientific knowledge: introduction to the special issue. Minerva. 2018;56(1):1–10. doi: 10.1007/s11024-018-9344-6. [DOI] [Google Scholar]
- 100.Arnott JC, Neuenfeldt RJ, Lemos MC. Co-producing science for sustainability: can funding change knowledge use? Glob Environ Chang. 2020;60:101979. doi: 10.1016/j.gloenvcha.2019.101979. [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
All data generated or analysed during this study are included in this published article.