Skip to main content
Journal of Alternative and Complementary Medicine logoLink to Journal of Alternative and Complementary Medicine
. 2019 Feb 22;25(2):135–140. doi: 10.1089/acm.2018.0403

Lessons from Outside and Within: Exploring Advancements in Methodology for Naturopathic Medicine Clinical Research

Janet Schloss 1,,2,, Erica McIntyre 1, Amie Steel 1,,2, Ryan Bradley 1,,3, Joanna Harnett 1,,4, Rebecca Reid 1,,2, Jason Hawrelak 1,,5, Joshua Goldenberg 1,,6, Claudine Van De Venter 1,,7, Kieran Cooley 1,,8
PMCID: PMC6424155  PMID: 30785314

Abstract

Introduction: Naturopathy is a mixture of both traditional and complementary medicine. It incorporates a broad set of health care practices that may or may not be traditional to that country or conventional medicine and are not fully integrated into the dominant health care system. Research required to evaluate or substantiate naturopathic medicine may not fall under the testing of randomized clinical trials, which opens up discussions on what is the best practice for research in naturopathic medicine.

Discussion: Not only do advances in health research methodology offer important opportunities to progress naturopathic research, there are also areas where the unique characteristics of naturopathic philosophy and practice can impact other areas of health research. Some of the new advances in health research methodology involve whole-system research, pragmatic trials, template for intervention description and replication protocols for complex interventions, patient-centered care models, and the pragmatic-explanatory continuum indicator summary tool for designing pragmatic trials. Discussion and critique of these health-related methodologies shows that these research methods are more suited for the philosophy and treatment options that naturopathy is based on.

Conclusions: Successful implementation of naturopathic research methodologies, and translation and dissemination of research will require a substantial paradigm shift in which naturopathic practitioners adopt a greater level of responsibility for developing an evidence base for naturopathic medicine.

Keywords: naturopathy, whole-system research, research methodology, patient centered, pragmatic trials

Background

Traditional and complementary medicine have a very long history throughout all regions around the world. The World Health Organization (WHO) defines traditional medicine as “the sum total of the knowledge, skill and practices based on the theories, beliefs and experiences indigenous to different cultures, whether explicable or not, used in the maintenance of health as well as in the prevention, diagnosis, improvement or treatment of physical and mental illness.”1 Similarly, the WHO defines complementary medicine as “a broad set of health care practices that are not part of that country's own tradition or conventional medicine and are not fully integrated into the dominant health-care system.”1 In this way, naturopathy is a system of medicine that aligns with the definitions of both traditional and complementary medicine.

The National Center for Complementary and Integrative Health (USA) defined naturopathy as a whole medical system based on philosophical principles that guide practice and is “classified” as a complementary approach to health care.2 Commentators and critics of complementary approaches to health care repeatedly call for quality evidence that is drawn from research that employs randomized controlled trial (RCT) research designs.3 This poses several methodological challenges for whole-system interventions such as naturopathy, general practice medicine, chiropractic, acupuncture, and massage. For naturopathy this has been highlighted by The Naturopathic Medical Research Agenda.4 Current methodology models such as RCTs are well suited for measuring the effects of chemically defined substances on predefined target tissues in homogeneous well-defined populations with clear attribution to a particular agent. Despite some of the assumptions inherent in this approach, this type of research can be conducted for, by, or on medical, naturopathic, and other complementary medicine professions.5 However, a respect for the dynamic interplay between a range of factors that shape health and well-being is inherent to the philosophy of naturopathy and professions that use whole-system interventions and presents tensions, trade-offs, and challenges to effective application of the more conventional RCT design and also begs adoption of other types of research methods appropriate for generating different types of evidence.6–8

Within naturopathic practice, interventions are typically tailored for the individual and may involve dietary and lifestyle modifications, mind–body therapies, physical or manual therapies, and ingestible medicines with complex chemical compositions and multiple actions.4,9,10 Consequently, research designs must include appropriate measurements that respect and respond to the complexity and various features of naturopathic interventions. The goal of this commentary is to draw attention to key innovations in study design that are relevant to the future of research in the field of naturopathy. Although this article focuses on naturopathy, the principles can be applied to other health professions that use whole-system approaches to health care, including other complementary medicine and conventional medicine professions.11 This article explores what naturopathic research and researchers may offer the wider health research community and considers the advancements occurring within health research that will support future robust and rigorous naturopathic research.

Contemporary Advances in Health Research Methods and Research Tools

Trials involving health care interventions are generally centered around explanatory research utilizing the RCT model—often considered the highest recognized level of clinical evidence.12 However, current opinions on explanatory research now recognize that although this type of research may ascertain causal factors (efficacy) in an ideal or controlled situation, it does not confirm whether the intervention is effective in a real-world setting (effectiveness).13 To be able to measure effectiveness, pragmatic trials need to be developed and implemented for translational science and application in real-world settings.12 The spectrum between explanatory and pragmatic trials is not dichotomous, but can be seen as a continuum with trials incorporating aspects of both in a variety of dimensions.14

Certain aspects of naturopathic care can be suited to clinical trials; however, if assessing a holistic intervention, this may not be applicable, due to the perceived reductionist paradigm underpinning the traditional RCT design. Naturopathic medicine is not the only area of health care that has raised this concern. In fact, recognition of the restrictions inherent to the RCT model has launched the preference for pragmatic research designs to evaluate the effectiveness of health care as it really occurs. Most medical and allied health care interventions require an understanding of what is applicable in a real-world setting. The pragmatic-explanatory continuum indicator summary (PRECIS-2) is an instrument that assists researchers in developing trials for this particular purpose.15 More importantly, the tool has been useful for articulating important aspects of design and intention, essentially framing what is sometimes a dynamic and disconnected process through the stages of research design, conduct, interpretation, and clinical application.16

Being able to combine, develop, and assess trials using the PRECIS-2 model supports researchers to develop trials that provide high-level clinical evidence that allows for individualized clinical decision-making and the delivery of complex multimodal interventions. In addition to the PRECIS-2, a template for intervention description and replication checklist and guide was developed by an international team of experts to assist researchers to promote full and accurate descriptions of trial interventions.17 These guidelines are particularly useful for complex interventions, which aligns with the diverse practices inherent to individualized health research.

Focusing on real-world outcomes and effectiveness also increases the need for participatory/community-based involvement.18 Equally, an observational or quasi-experimental trial may be advantageous when assessing application in a community-based setting. These types of research designs generally require a mixed-methods approach that is patient centered rather than disease centered.

A focus on designing and implementing patient-centered research has also become more prominent in an era wherein policy makers are emphasizing person-centered care.19 Innovation in research methodology has been a necessary response to these policy-driven demands. Fortunately, based on a recognition that clinical outcomes in clinical trials do not capture all important mediators and predictors of real-life clinical practice, several funding agencies including the National Institutes of Health (NIH) and the Patient-Centered Research Outcomes Institute in the United States have endorsed and led the development of research instruments and processes. This includes the Patient Reported Outcomes Measure Information System (PROMIS)20 that is used to capture more holistic data on functional, social, emotional, and spiritual domains of health, and more directly involves patients in research.

Overall, the wider health research community has acknowledged the value and importance of a range of diversity in the accepted research designs to answer questions meaningful to the real-world settings and populations. This is evidenced by several studies; for example, an acupuncture pragmatic trial,21 an asthma trial being conducted in England,22 and a physical activity trial for chronic obstructive pulmonary disease.23 These advancements in some way address the concerns underlying previous attempts within complementary medicine research to advocate for whole-system research approaches.24

Adapting and Using Advancements in Health Research to Examine Naturopathic Medicine

The diversification of accepted health research methods to include pragmatic designs supporting assessment of complex patient-centered interventions, as outlined in the previous section, provides important opportunities for researchers focusing on the real-world practice of naturopathic medicine. This type of research is important because patients who require a variety of different interventions due to complex disease status are not normally included in certain trials since they do not fit the “optimal” requirements for that trial (e.g., too many potentially confounding health complications). In pragmatic trials, all patients who have the conditions of interest, regardless of their responsiveness, past compliance, and comorbidities, can be enrolled.25

Recent research evaluating treatments for low-back pain provides excellent examples of multiple research methodologies highly applicable to naturopathic practice, and practices, including inclusion of education and self-care practices in randomized trials26–29; development and inclusion of multidimensional patient-reported outcome measures30–32; application of mixed-method designs to capture patients' experiences with the intervention33,34; evaluating assessments of individual predictors of outcomes35,36 including experience of care,37,38 inclusion of informed choice,39,40 and expectations41 as predictive factors for improved clinical outcomes. These research methodologies are richly aligned with naturopathic principles of “doctor as teacher” (Docere), “hierarchy of therapeutics,” and “treat the whole person” (Tolle Totum)42 because there is significant patient engagement, attention to education and self-reflection, as well as assessing aspects of the whole person as part of the intervention or outcome.

Several of the methods described have been applied to clinical research evaluating naturopathic practice. For example, studies in primary prevention of heart disease collecting data on the outcomes of highest priority to patients in addition to traditional Framingham risk scores,43 and quasi-experimental research in type 2 diabetes collecting patient-reported outcomes including self-efficacy and stress, in addition to clinical hemoglobin A1c changes,44 and including qualitative elements to capture patients' experiences with care.45

Other research has also been published that describes patients experiencing person-centered care when treated by a naturopathic medicine clinician.46 For this reason, the patient-centered research methods being developed within the broader health research community have particular relevance within naturopathic research. In fact, instruments such as PROMIS and other patient-reported outcome measures afford researchers an opportunity to capture changes to health status as experienced by the patients themselves.

The nature of naturopathic practice and the practices of most clinical disciplines are complex to research in totality. However, the pragmatic and patient-centered research methods emerging from innovations in health research methods provide an approach to interrogate the complexity of practice while not requiring violation of fundamental naturopathic principles of practice, allowing high external validity in the study design. In fact, these new research methods may help determine fidelity to complex naturopathic practices previously undervalued or overlooked in health research.47

The Potential Contribution of Naturopathic Approaches and Perspectives to Strengthen Health Research

Not only do advances in health research methodology offer important opportunities to progress naturopathic research and benefit patients, there are also areas where the unique characteristics of naturopathic philosophy and practice can impact on other areas of health research. The tolle totem principle of naturopathy that focuses on treatment of all aspects of the individual requires clinicians to acknowledge the complexity of disease etiology and pathophysiology.48,49 In doing so, naturopathic clinical understanding may open up new avenues for researchers from other disciplines to explore. A recent example of this is the growing research interest in the clinical importance of gastrointestinal health in an array of health conditions50–54—a concept well established within the naturopathic clinical approach.55 There are undoubtedly many other areas where the insights and experience of naturopathic clinicians may, once communicated to a wider audience through case reports and medical hypothesis articles, encourage more research breakthroughs that will benefit the community in ways as yet unmeasured.

Such an opportunity to capture clinical insights as a basis for future research may not only assist the substantive topic in question, it may also offer a practical method for recalibrating the balance within the evidence-based medicine triad in general, serving to bolster the value and awareness of the pillars of clinical expertise and patient values through research.56–58 As the naturopathic profession works with researchers to document and share the experience and insights of clinicians (both past and present), naturopaths and researchers will provide a model through which the “clinician experience” pillar of evidence-based medicine can be operationalized.58

Naturopaths are well placed to support new research by effectively and rapidly implementing practices developed through new areas of research such as precision or personalized medicine,59 thereby providing opportunities to better understand the real-world implications of the health technology as it develops. In fact, the emphasis on individualized treatments as a core philosophical element of naturopathic care55 may mean that naturopaths are more ideologically and logistically prepared to incorporate such personalized health care than conventional health professionals. However, despite a natural and opportune fit, issues with capacity, mentorship, and training and support for naturopath scientists and cross-disciplinary teams need to be addressed.60,61

There are still gaps in the available health research methods and instruments, which limits the robustness of some facets of naturopathic research. The authors cannot meaningfully build the experience and knowledge of past (i.e., historical) naturopaths into the design of research projects, for example, without a rigorous framework to guide the analysis and appropriate use of traditional information sources (e.g., historical texts and ancestral or elder-based knowledge).62 The authors also need to develop instruments that measure the outcomes uniquely important in naturopathic clinical decision-making and treatment evaluation (e.g., vital force). In some instances, some relevant instruments may already exist that only require small modifications to capture nuances specific to naturopathic principles and practice. In other cases, the instruments will need to be developed in full.

Implications and Future Directions

There are several implications related to naturopathic medicine research methodology that require careful consideration. One major challenge to conducting naturopathic research is the need for adequate infrastructure, which includes practitioner research capacity, consumer and practitioner engagement, and integration into health care systems, all of which are not fully developed in naturopathic medicine. The lack of integration of naturopathic health services in health care systems prevents access to resources to assist clinical research, such as health databases (e.g., e-health records) and practitioner databases (e.g., registration agencies). Creating practice-based research networks (PBRNs) or academic networks63 are potential solutions that enable researchers to access practitioners and their patients.64

PBRNs will also help facilitate a research culture within naturopathy by providing an opportunity for practitioners to participate in research within grass roots practice.65 Lack of clinician research capacity is a barrier to conducting research such as pragmatic trials, translating research, codifying knowledge, and developing suitable research methods. Naturopathic practitioners in some situations are adequately trained to adopt a researcher–practitioner model of practice in which research and clinical skills are equally valued. To enable naturopathic practitioners to be involved in the research process, there needs to be adequate educational infrastructure to increase research capacity. There is currently insufficient undergraduate, graduate, and postgraduate education in health and social science research methods in naturopathic medicine.66 This shortfall needs to be urgently addressed, otherwise lack of research skills will continue to be a significant barrier for practitioners to participate in and translate naturopathic research.

There is an enormous amount of research needed in naturopathic medicine. Participatory community-based methods such as Delphi techniques could be used to engage naturopaths and consumers to determine naturopathic research priorities.67,68 It is critical that naturopathic research is translatable to clinical practice and meaningful to health care consumers. Delphi techniques allow for clinician participation in design of the research process to ensure clinically meaningful outcomes and provide an opportunity to involve health consumers in research to ensure it is patient centered. Consensus methods such as Delphi would also be suitable for identifying methods for research translation to both naturopathic practice and health care consumers. This participatory approach could be extended to assist with codifying knowledge, which includes developing clinical guidelines for naturopathic care. These methods could also facilitate the consolidation of traditional evidence into meaningful frameworks that are accessible to clinicians and the public. An example of this is described in an article that discusses the naturopathic approaches to irritable bowel syndrome.69

Developing and evolving naturopathic research methodologies can be considered an iterative process that has the potential to influence health research more broadly. However, the advancements in health research methodologies more generally afford an opportunity for naturopathic research to align with established research designs while still answering clinically relevant and philosophically sensitive research questions.

However, successful implementation of naturopathic research methodologies, and translation and dissemination of research will require a substantial paradigm shift in which naturopathic practitioners adopt a greater level of responsibility for developing an evidence base for naturopathic medicine. Initiatives to support and evaluate knowledge mobilization70 within the community of naturopathic medical research, education, and practice may play a key, but yet unexplored role.71 Researchers in this field have an important leadership role to effectively facilitate this transformation, which will benefit health consumers, naturopathic practitioners, and health care systems they serve. Practitioners who are not in the research field can also contribute by being part of PBRNs, therefore, assisting in this paradigm shift and allowing the leaders in the field to move forward.

Acknowledgments

All authors of this article thank the Australian Research Centre in Complementary and Integrative Medicine (ARCCIM), especially esteemed Professor Jon Adams and Professor David Sibbritt from the University of Sydney who established and run the International Naturopathic Leadership Group.

Author Disclosure Statement

No competing financial interests exist.

References

  • 1. World Health Organisation. Traditional, complementary and integrative medicine. Definitions 2003. Online document at: www.who.int/traditional-complementary-integrative-medicine/about/en/, accessed December6, 2018
  • 2. National Center for Complementary and Integrative Health. Naturopathy. 2017. Online document at: https://nccih.nih.gov/health/naturopathy, accessed December6, 2018
  • 3. Bothwell LE, Greene JA, Podolsky SH, Jones DS. Assessing the gold standard—lessons from the history of RCTs. N Engl J Med. 2016;374:2175–2181 [DOI] [PubMed] [Google Scholar]
  • 4. Standish LJ, Calabrese C, Snider P. The naturopathic medical research agenda: The future and foundation of naturopathic medical science. J Altern Complement Med 2006;12:341–345 [DOI] [PubMed] [Google Scholar]
  • 5. Walach H, Falkenberg T, Fonnebo V, et al. . Circular instead of hierarchical: Methodological principles for the evaluation of complex interventions. BMC Med Res Methodol 2006;6:29. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Bell IR, Koithan M. Models for the study of whole systems. Integr Cancer Ther 2006;5:293–307 [DOI] [PubMed] [Google Scholar]
  • 7. Dammann O, Gray P, Gressens P, et al. . Systems epidemiology: What's in a name? Online J Public Health Inform 2014;6:e198. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Upshur RE, VanDenKerkhof EG, Goel V. Meaning and measurement: An inclusive model of evidence in health care. J Eval Clin Pract 2001;7:91–96 [DOI] [PubMed] [Google Scholar]
  • 9. Oberg E, Bradley R, Cooley K, et al. . Estimated effects of whole-system naturopathic medicine in select chronic disease conditions: A systematic review. Altern Integ Med 2015;4:2 [Google Scholar]
  • 10. Wardle JL, Adams J, Lui CW, Steel AE. Current challenges and future directions for naturopathic medicine in Australia: A qualitative examination of perceptions and experiences from grassroots practice. BMC Complement Altern Med 2013;13:15. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Jonas WB. The evidence house: How to build an inclusive base for complementary medicine. West J Med 2001;175:79–80 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Merali Z, Wilson JR. Explanatory versus pragmatic trials: An essential concept in study design and interpretation. Clin Spine Surg 2017;30:404–406 [DOI] [PubMed] [Google Scholar]
  • 13. Califf RM, Sugarman J. Exploring the ethical and regulatory issues in pragmatic clinical trials. Clin Trials 2015;12:436–441 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Neta G, Johnson KE. Informing real-world practice with real-world evidence: The value of PRECIS-2. BMC Med 2018;16:76. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Loudon K, Treweek S, Sullivan F, et al. . The PRECIS-2 tool: Designing trials that are fit for purpose. BMJ 2015;350:h2147. [DOI] [PubMed] [Google Scholar]
  • 16. Lipman PD, Loudon K, Dluzak L, et al. . Framing the conversation: Use of PRECIS-2 ratings to advance understanding of pragmatic trial design domains. Trials 2017;18:532. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Cotterill S, Knowles S, Martindae AM, et al. . Getting messier with TIDieR: Embracing context and complexity in intervention reporting. BMC Med Res Methodol 2018;18:12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Verhoef M, Koithan M, Bell IR, et al. . Whole complementary and alternative medical systems and complexity: Creating collaborative relationships. Complement Med Res 2012;19(Suppl. 1):3–6 [DOI] [PubMed] [Google Scholar]
  • 19. Jayadevappa R. Patient-centered outcomes research and patient-centered care for older adults: A perspective. Gerontol Geriatr Med 2017;3:2333721417700759 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Cella D, Riley W, Stone A, et al. . The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. J Clin Epidemiol 2010;63:1179–1194 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Luo J, Xu H, Liu B. Real world research: A complementary method to establish the effectiveness of acupuncture. BMC Complement Altern Med 2015;15:153. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Woodcock A, Bakerly ND, New JP, et al. . The Salford Lung Study protocol: A pragmatic, randomised phase III real-world effectiveness trial in asthma. BMC Pulm Med 2015;15:160. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Nguyen HQ, Moy ML, Fan VS, et al. . Applying the pragmatic-explanatory continuum indicator summary to the implementation of a physical activity coaching trial in chronic obstructive pulmonary disease. Nurs Outlook 2018;66:455–463 [DOI] [PubMed] [Google Scholar]
  • 24. Verhoef M, Lewith G, Ritenbaugh C, et al. . Complementary and alternative medicine whole systems research: Beyond identification of inadequacies of the RCT. Complement Ther Med 2005;13:206–212 [DOI] [PubMed] [Google Scholar]
  • 25. Gaglio B, Philips SM, Heurtin-Roberts S, et al. . How pragmatic is it? Lessons learned using PRECIS and RE-AIM for determining pragmatic characteristics of research. Implement Sci 2014;9:96. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Sherman KJ, Cherkin DC, Wellman RD, et al. . A randomized trial comparing yoga, stretching, and a self-care book for chronic low back pain. Arch Intern Med 2011;171:2019–2026 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Saper RB, Lemaster C, Delitto A, et al. . Yoga, physical therapy, or education for chronic low back pain: A randomized noninferiority trial. Ann Intern Med 2017;167:85–94 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Turner JA, Anderson ML, Balderson BH, et al. . Mindfulness-based stress reduction and cognitive behavioral therapy for chronic low back pain: Similar effects on mindfulness, catastrophizing, self-efficacy, and acceptance in a randomized controlled trial. Pain 2016;157:2434–2444 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. Goertz CM, Long CR, Vining RD, et al. . Assessment of chiropractic treatment for active duty, US military personnel with low back pain: Study protocol for a randomized controlled trial. Trials 2016;17:70. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Chen CX, Kroenke K, Stump TE, et al. . Estimating minimally important differences for the PROMIS pain interference scales: Results from 3 randomized clinical trials. Pain 2018;159:775–782 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31. Ramasamy A, martin ML, Blum DI, et al. . Assessment of patient-reported outcome instruments to assess chronic low back pain. Pain Med 2017;18:1098–1110 [DOI] [PubMed] [Google Scholar]
  • 32. Stief F, Meurer A, Wienand J, et al. . Effect of lumbar spinal fusion surgery on the association of self-report measures with objective measures of physical function. Gait Posture 2018;61:7–12 [DOI] [PubMed] [Google Scholar]
  • 33. Keosaian JE, Lemaster CM, Dresner D, et al. . “We're all in this together”: A qualitative study of predominantly low income minority participants in a yoga trial for chronic low back pain. Complement Ther Med 2016;24:34–39 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34. Martin ML, Blum SI, Liedgens H, et al. . Mixed-methods development of a new patient-reported outcome instrument for chronic low back pain: Part 1—the Patient Assessment for Low Back Pain-Symptoms (PAL-S). Pain 2018;159:1045. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35. Sherman KJ, Cherkini DC, Ichikawa L, et al. . Characteristics of patients with chronic back pain who benefit from acupuncture. BMC Musculoskelet Disord 2009;10:114. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36. Stein KM, Weinberg J, Sherman KJ, et al. . Participant characteristics associated with symptomatic improvement from yoga for chronic Low back pain. J Yoga Phys Ther 2014;4:151. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37. Evers S, Hsu C, Sherman KJ, et al. . Patient perspectives on communication with primary care physicians about chronic low back pain. Perm J 2017;21. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. Goertz CM, Salsbury SA, Long CR, et al. . Patient-centered professional practice models for managing low back pain in older adults: A pilot randomized controlled trial. BMC Geriatr 2017;17:235. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39. Sherman KJ, Cherkin DC, Ichikawa L, et al. . Treatment expectations and preferences as predictors of outcome of acupuncture for chronic back pain. Spine 2010;35:1471. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40. Tran HH, Weinberg J, Sherman KJ, et al. . Preference and expectation for treatment assignment in a randomized controlled trial of once-vs twice-weekly yoga for chronic low back pain. Glob Adv Health Med 2015;4:34–39 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41. Hsu C, Sherman KJ, Eaves ER, et al. . New perspectives on patient expectations of treatment outcomes: Results from qualitative interviews with patients seeking complementary and alternative medicine treatments for chronic low back pain. BMC Complement Altern Med 2014;14:276. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42. American Association of Naturopathic Physicians. Definition of naturopathic medicine. In: House of Delegates Position Paper Bethesda, MD: American Association of Naturopathic Physicians, 2011 [Google Scholar]
  • 43. Seely D, Szczurko O, Cooley K, et al. . Naturopathic medicine for the prevention of cardiovascular disease: A randomized clinical trial. CMAJ 2013;185:E409–E416 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44. Bradley R, Sherman KJ, Catz S, et al. . Adjunctive naturopathic care for type 2 diabetes: Patient-reported and clinical outcomes after one year. BMC Complement Altern Med 2012;12:44. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45. Oberg EB, Bradley R, Hsu C, et al. . Patient-reported experiences with first-time naturopathic care for type 2 diabetes. PLoS One 2012;7:e48549. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46. Foley H, Steel AE. Patient perceptions of clinical care in complementary medicine: A systematic review of the consultation experience. Patient Educ Couns 2016;100:212–223 [DOI] [PubMed] [Google Scholar]
  • 47. Dodds SE, Herman PM, Sechrest L, Abraham I. When a whole practice model is the intervention: Developing fidelity evaluation components using program theory-driven science for an integrative medicine primary care clinic. Evid Based Complement Alternat Med 2013;2013:11. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48. Bradley R, Oberb EB. Naturopathic medicine and type 2 diabetes: A retrospective analysis from an academic clinic. Altern Med Rev 2006;11:30. [PMC free article] [PubMed] [Google Scholar]
  • 49. Mills PJ, Patel S, Barsotti T, et al. . Advancing research on traditional whole systems medicine approaches. J Evid Based Complementary Altern Med 2017;22:527–530 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50. Huang YJ, Marsland BJ, Bunyavanich S, et al. . The microbiome in allergic disease: Current understanding and future opportunities-2017 PRACTALL document of the American Academy of Allergy, Asthma & Immunology and the European Academy of Allergy and Clinical Immunology. J Allergy Clin Immunol 2017;139:1099–1110 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51. Barin JG, Tobias LD, Peterson DA. The microbiome and autoimmune disease: Report from a Noel R. Rose Colloquium. Clin Immunol 2015;159:183–188 [DOI] [PubMed] [Google Scholar]
  • 52. Boulangé CL, Neves AL, Chilloux J, et al. . Impact of the gut microbiota on inflammation, obesity, and metabolic disease. Genome Med 2016;8:42. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53. Ferguson JF, Allayee J, Gerszten RE, et al. . Nutrigenomics, the microbiome, and gene-environment interactions: New directions in cardiovascular disease research, prevention, and treatment: A scientific statement from the American Heart Association. Circ Cardiovasc Genet 2016;9:291–313 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54. Alam R, Abdolmaleky HM, Zhou JR. Microbiome, inflammation, epigenetic alterations, and mental diseases. Am J Med Genet B Neuropsychiatr Genet 2017;174:651–660 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55. Steel A, Sibbritt D, Schloss J, et al. . An overview of the practitioner research and collaboration initiative (PRACI): A practice-based research network for complementary medicine. BMC Complement Altern Med 2017;17:87. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56. Szajewska H. Evidence-based medicine and clinical research: Both are needed, neither is perfect. Ann Nutr Metab 2018;72 Suppl 3:13–23 [DOI] [PubMed] [Google Scholar]
  • 57. Bartlett SJ, Barnes T, McIvor RA. Integrating patients into meaningful real-world research. Ann Am Thorac Soc 2014;11 Suppl 2:S112–S117 [DOI] [PubMed] [Google Scholar]
  • 58. Leech B, Schloss J, Steel A. Health services research as a framework for expanding a whole systems research agenda in complementary and integrative medicine: The example of intestinal permeability. Eur J Integr Med 2018;17:22–25 [Google Scholar]
  • 59. Jameson JL, Longo DL. Precision medicine—Personalized, problematic, and promising. Obstet Gynecol Surv 2015;70:612–614 [DOI] [PubMed] [Google Scholar]
  • 60. Menard MB, Weeks J, Anderson B, et al. . Consensus recommendations to NCCIH from research faculty in a transdisciplinary academic consortium for complementary and integrative health and medicine. J Altern Complement Med 2015;21:386–394 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61. Aucoin M, Cooley K, Knee C, et al. . Naturopathy special interest group research capacity and needs assessment survey. J Altern Complement Med 2018 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62. Haines J, Du JT, Geursen G, et al. . Understanding Elders' knowledge creation to strengthen Indigenous ethical knowledge sharing. In: Proceedings of RAILS—Research Applications, Information and Library Studies, 2016, School of Information Management, Victoria University of Wellington, New Zealand: Information Research; 2017;22 [Google Scholar]
  • 63. Steel A, Goldenberg JZ, Cooley K. Establishing an international research collaborative for naturopathy: The International Research Consortium of Naturopathic Academic Clinics (IRCNAC). Adv Integr Med 2017;4:93–97 [Google Scholar]
  • 64. Steel A, Adams J, Sibbritt D. Developing a multi-modality complementary medicine practice-based research network: The PRACI project. Adv Integr Med 2014;1:113–118 [Google Scholar]
  • 65. Reid R, Steel A. The importance of the PRACI project for grass roots complementary medicine practice: A call for practitioner involvement. Aust J Herbal Med 2015;27:101.+. [Google Scholar]
  • 66. Steel A, McEwen B. The need for higher degrees by research for complementary medicine practitioners. Aust J Herbal Med 2014;26:136 [Google Scholar]
  • 67. Goldenberg JZ, Steel A, Day A, et al. . Naturopathic approaches to irritable bowel syndrome—A Delphi study. J Altern Complement Med 2018;25:227–233 [DOI] [PubMed] [Google Scholar]
  • 68. Kezar A, Maxey D. The Delphi technique: An untapped approach of participatory research. Int J Soc Res Methodol 2016;19:143–160 [Google Scholar]
  • 69. Goldenberg JZ, Steel A, Day A, et al. . Naturopathic approaches to irritable bowel syndrome: Protocol for a prospective observational study in academic teaching clinics. Integr Med Res 2018;7:279–286 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70. Worton SK, Loomis C, Pancer SM, et al. . Evidence to impact: A community knowledge mobilisation evaluation framework. Gateways Int J Community Res Engagement 2017;10:121–142 [Google Scholar]
  • 71. Steel A, Rapport F, Adams J. Towards an implementation science of complementary health care: Some initial considerations for guiding safe, effective clinical decision-making. Adv Integr Med 2018;5:5–8 [Google Scholar]

Articles from Journal of Alternative and Complementary Medicine are provided here courtesy of Mary Ann Liebert, Inc.

RESOURCES