Abstract
There is an abundance of outcomes research for clinical hypnosis showing promising results. Nonetheless, hypnosis is still underutilized in clinical care. For a behavioral intervention to enter mainstream clinical care, efficacy needs to be demonstrated with exceptionally high quality of evidence, and its reporting needs to be complete and sufficiently clear to enable replication and clinical use. The present article provides best practice guidelines formulated by the Task Force for Establishing Efficacy Standards for Clinical Hypnosis for conducting and reporting clinical hypnosis research.The recommendations are presented in two tiers. Tier I recommendations include essential best practices, such as a call for the use of detailed research and intervention manuals, plans for and reporting of participant-education about hypnosis, the use of hypnotizability scales with good psychometric properties, and clear reporting of the hypnotizability measurement. Tier I also includes the sharing of intervention manuals, the reporting of the induction procedure, the labeling of the intervention for participants, and the definition of hypnosis used. Tier II includes preferred recommendations, calling for measurement of adherence to home practice, measurement of hypnotizability using scales with both subjective and behavioral measures of responsiveness, and the involvement of participants from the full hypnotizability spectrum. Tier II also includes the assessment of variables related to proposed mechanisms of action, the reporting of participants prior hypnosis experiences, and the relationship of expectancies and treatment outcomes.This list of recommendations will be useful for researchers, reviewers, and journal editors alike when conducting, reporting, or evaluating studies involving clinical hypnosis.
Keywords: hypnosis, outcomes research, best practices, reporting guidelines, research methods
Introduction
Hypnosis is used in a large variety of clinical contexts, including the treatment of medical and psychological problems such as chronic pain, acute pain, irritable bowel syndrome (IBS), anxiety, depression, sleep disturbances, oncological treatment side effects, hot flashes, and stress.1-4 However, as in many clinical and experimental domains, there is a need for more high quality well-controlled randomized clinical trials. This paper presents a set of recommendations developed by the Task Force for Establishing Efficacy Standards for Clinical Hypnosis, which aim to provide guidance towards improving methodological rigor and transparency in the reporting of efficacy research on clinical hypnosis applications.
At present there are published primary studies on many applications of hypnosis (for current applications and their research base see eg 1 ). Furthermore, in the past ten years there has been an increase in systematic reviews and meta-analyses of hypnosis applications. However, recently published systematic reviews and meta-analyses have identified a considerable risk of bias in the reviewed clinical trials.3,5-11 In addition, there is some evidence showing that the studies with low risk of bias and high methodological quality report lower effect sizes,8,12 although this relationship is not uniform across all applications (see eg, 10 ). Thus, the authors of these and other systematic reviews have generally called for studies in the field of hypnosis to use more rigorous methodologies.
Another related issue is rigor in reporting results of clinical trials. Many publications of randomized clinical trials of hypnosis interventions have been unclear or incomplete in reporting of the design elements that are necessary for the evaluation of the quality of evidence, 13 or have not provided sufficient details for possible direct replication.14,15 Indeed, it has been long recognized that full and detailed reporting of clinical trial protocols is necessary for readers to judge the quality of evidence, and lack of clear reporting of interventions prevents further study and clinical use of the intervention. 14 Thus, reporting guidelines of clinical research have been published such as the Consolidated Standards of Reporting Trials (CONSORT) 16 or the Strengthening the Reporting of Observational studies in Epidemiology (STROBE) 17 statements, which have been endorsed by most major journals and societies of clinical medicine. The need for better reporting has also been noted in reviews of the literature of clinical hypnosis trials. 12
In recognition of the need for efficacy standards in the field of clinical hypnosis, the Task Force for Establishing Efficacy Standards for Clinical Hypnosis (henceforth the Task Force) was established in 2018 18 with the support of six professional organizations in the field of hypnosis (the Society for Clinical and Experimental Hypnosis, the American Society of Clinical Hypnosis, the American Psychological Association Division 30, the Milton Erickson Foundation, the National Pediatric Hypnosis Training Institute, and the International Society of Hypnosis). The Task Force was convened by [anonymized] and [anonymized], and was composed of nine selected researchers from Hungary, Italy, the UK, and the US, who committed to participating in the Task Force deliberations. The participants are the authors of this paper. Three additional researchers agreed to serve as consultants to the Task Force: [anonymized], [anonymized], and [anonymized].
The Task Force identified that in order to establish a list of efficacious clinical hypnosis applications there was a need for more clinical trials with high methodological quality and good reporting standards. In order to address this need, the Task Force set out to develop recommendations for conducting and reporting future outcomes research on clinical hypnosis. This paper is the end-product of this work.
The primary goal of the present paper is to raise awareness of the issues that need to be considered, and to provide specific guidelines for researchers on conducting and reporting clinical hypnosis trials in order to ensure the highest quality standards. To serve this purpose, we list guidelines for high quality research design and reporting. The guidelines listed in this paper are specific to hypnosis research. The scope of this work does not allow for a comprehensive guide for clinical research in general, but we provide a list of generic clinical research guidelines and their sources in Supplement 1.
Material and Methods
In the following section we list the Best Practice Recommendations by the Task Force. The following recommendations are intended to guide clinicians and researchers who want to conduct high quality clinical trials assessing the effectiveness of certain applications of clinical and medical hypnosis, as well as reviewers and editors who are assessing the quality and merit of these trials. The recommendations apply to research studies in which human participants are prospectively assigned to one or more interventions involving hypnosis to evaluate the effects of those interventions on health-related biomedical, subjective, or behavioral outcomes.
The guidelines are divided into two parts: (1) recommendations for designing and conducting research, and (2) recommendations for reporting the research. These guidelines were developed during a series of meetings of the Task Force between February 2019 and February 2022. Initially, a list of best practice guidelines were collected from different sources such as the CONSORT statement, 16 Template for Intervention Description and Replication (TIDieR) checklist, 15 and the Cochrane Handbook for Systematic Reviews of Interventions. 19 These guidelines were then supplemented by the Task Force members during and between the meetings with hypnosis-research-specific recommendations. The recommendations were later sent out to the external members of the Task Force ([anonymized], [anonymized], [anonymized]) who also provided their input. In a final meeting the content of the list and the wording of the recommendations were approved by all Task Force members.
Specific Problem Areas in Methodology and Reporting
In the majority of the hypnosis studies included in recent systematic reviews, risk of bias was rated either high or uncertain for topics considered in the Cochrane Risk of Bias Tool,20,21 which is the most commonly used tool in systematic reviews to assess methodological quality. Risk of bias in clinical hypnosis studies was reported in all common bias domains assessed in this tool, including inadequacy of allocation concealment, random sequence generation, blinding of personnel and outcome assessors, handling of incomplete outcome data (eg, attrition bias), and selective reporting of outcome findings.5-9,22 Furthermore, risk of bias was reported in areas such as determination of data collection stopping rules (no or inadequate sample size calculation), lack of specification of demographic characteristics of the sample, no use of a treatment manual, and not describing the intervention as hypnosis.5,22 Only a handful of clinical hypnosis studies were rated as having low risk of bias across all of these bias domains in the reviews. As previously noted, these problems do not only pertain to poor study design, but also to poor reporting practices.
Results
Best Practice Recommendations for Conducting and Reporting Clinical Hypnosis Research
Clinical research is a vast domain where researchers need to consider a range of domain specific and domain general considerations when planning and conducting their studies. The problem areas discussed above include some methodological problems that are domain general, relevant to most clinical research of psychological interventions, but also some that are more specific to hypnosis research. In this paper we focus on formulating recommendations that are specific to studies including hypnosis. For general recommendations and considerations on conducting clinical research, the reader should consult the following papers and handbooks: the Cochrane handbook for systematic reviews of interventions, 19 Risk of Bias 2 tool, 21 the CONSORT statement, 16 the STROBE checklist, 17 the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) checklist, 23 and papers and handbooks on clinical psychology research.24-26
Conducting clinical trials according to the current state of the art is not enough on its own to produce research that is useful and informative for the field. The study, the intervention, and the findings also need to be reported clearly and with sufficient detail (either in the paper or by using easily accessed supplemental materials) to allow readers to evaluate the methodological quality of the work, and the implications of the findings for populations of interest, and to independently replicate the intervention. In fact, it is possible that there are many clinical hypnosis trials already published that would meet the highest quality standards if they provided greater details of their methods and findings, the lack of which leads to uncertainty and undermines the ability of researchers and clinicians to make the best use of the results. There are already several excellent checklists for reporting clinical trials and clinical interventions. In line with the current consensus in the medical research community, we highly recommend the use of the SPIRIT checklist 23 when reporting protocols for clinical trials, the CONSORT checklist 16 when reporting randomized controlled clinical trials, or the STROBE checklist 17 when reporting on observational clinical studies. These should be used in conjunction with the TIDieR checklist 15 for better reporting of the clinical interventions used in the trials.
Following the best practices is essential for producing high quality evidence. However, it is outside the scope of the present paper to give a complete guide on conducting and reporting clinical research in general, but we provide a non-comprehensive list of the most important recommendations from the sources listed above in Supplement 1.
However detailed the above-mentioned domain general guidelines may be, they do not cover some methodological elements that are specifically important to report in clinical hypnosis research, or they do not cover them in sufficient detail. Accordingly, the Task Force created this list of recommendations that are specific to trials involving hypnosis. Importantly, the recommendations presented below are designed to be used as a supplement to the above mentioned, field-general guidelines and checklists for clinical trials.
We present our recommendations in two tiers. In Tier I we list essential recommendations that should apply to all or most prospective controlled clinical hypnosis trials. Tier II recommendations also promote high quality research and reporting, but they are more situational, and might not apply or might not be feasible in some clinical trials. A summary of these recommendations is listed in Box 1. Below, we provide context and reasoning for these recommendations.
Box 1.
List of recommendations for conducting and reporting controlled clinical trials assessing the efficacy of hypnosis interventions.
Tier I - Essential Recommendations for Research Practice
Designing and conducting studies
- Use detailed research protocols or treatment manuals, intervention scripts, and/or recorded interventions for all study groups.
- Specify the procedures used for participant-education about hypnosis.
- If hypnotizability is measured in the study, use a validated scale with sound psychometric properties.
Reporting
- Make hypnosis scripts, recordings of the intervention, or manuals of the intervention available directly in the manuscript, as a supplement, or as an external reference or link where the materials can be easily accessed by interested parties.
- Describe in detail the procedures for participant education about hypnosis. If it was manualized, provide access to the manual; if not, describe the general approach taken in the study for participant-education about hypnosis.
- Clearly describe the hypnotic induction procedure. If it was manualized, provide access to the manual; if not, provide enough detail so that the induction used could be replicated by others.
- Describe how the intervention was labeled to participants (eg, whether it was presented to them as “hypnosis”).
- Describe the criteria, rationale, or definition used to determine that the intervention was considered hypnosis (or hypnosis-based).
- If hypnotizability was measured in the study, describe in detail how it was measured (including the timing of measurement within the sequence of study procedures, the scale used, the mode of administration [online vs in-person; live vs recorded] and the role of the person(s) administering the measurement and whether they were blind to group allocation and outcome data).
- If hypnotizability was measured in the study, describe the psychometric properties of the hypnotizability scale used, including the internal consistency in the study sample.
Tier II - Preferred Recommendations for Research Practice
Designing and conducting studies
- Measure adherence to any home practice or homework that is a part of the treatment.
- Assess participant hypnotizability.
- Utilize someone other than the interventionist to assess hypnotizability.
- Use a hypnotizability measure that takes into account both subjective and behavioral measures of responsiveness.
- Do not restrict enrollment to only high and low hypnotizable individuals.
- Assess response expectancy using validated measures.
- Use valid measures to assess the level of rapport, therapeutic alliance, or therapeutic relationship between the client and the therapist (if any).
- Include measures of variables that may elucidate potential mechanisms of action of the hypnosis intervention.
Reporting
- Report information about participants’ prior experiences with hypnosis (eg, whether participants were naive to hypnosis, or whether they had prior experiences with hypnosis, and if known, what were these experiences).
- Report response expectancies pertaining to relevant outcomes separately for different intervention groups and, if measured, for different levels of hypnotizability.
- - Report the associations between response expectancies and the study outcomes.
Notes on Tier I. Essential Recommendations for Research Practice
Use detailed research protocols or treatment manuals, intervention scripts, and/or recorded interventions for all study groups. The use of a detailed research protocol or treatment manual, intervention scripts, and/or recorded intervention is needed to ensure that the intervention is delivered as intended for all participants. A sufficiently standardized intervention protocol in combination with good training of interventionists can ensure that the intervention is consistently delivered. Consistency in the implementation of treatment procedures leads to less noise in the data and improves statistical power. 27 Moreover, use of and reporting of a detailed and standardized research protocol optimizes the possibility of accurate replication of the tested intervention in future studies. Standardization does not have to mean that every participant receives exactly the same intervention. Intervention manuals can include strategies for tailoring the intervention in a controlled manner, which might increase intervention effectiveness. 28 The procedure should be similarly detailed for control and treatment groups to achieve these benefits.
Specify the procedures used for participant-education about hypnosis. A client's or study participant's expectations, hopes, and misconceptions related to hypnosis are important factors in determining treatment success.29-31 Thus, the research protocol or the intervention manual should specify how the patient is introduced to and/or educated about the hypnotic intervention, to ensure that these processes are standardized across participants. For example the APA Division 30 brochure “Hypnosis: What it is and how it can help you feel better” can be used as an aid for participant education, and to dispel negative expectations about hypnosis 32 (p30) during a discussion about the intervention with the therapist.
If hypnotizability is measured in the study, use a validated scale with sound psychometric properties. There are a variety of scales available to assess hypnotizability.33-35 We recommend using scales that have demonstrated reliability (internal consistency or test-retest reliability) of at least 0.70, and scales that have been validated, because these improve statistical conclusion validity and internal validity of any research claims connected to hypnotizability. 36 Scales that have been shown to have good reliability and validity at the time of writing this paper include the Stanford Hypnotic Susceptibility Scale: Forms C (45-60 min to administer), 37 the Barber Suggestibility Scale (10-15 min to administer),38,39 the Elkins Hypnotizabilty Scale (25-30 min to administer),40-42 the Waterloo-Stanford Group C (WSGC) Scale of Hypnotic Susceptibility (45-60 min to administer), 43 and the Harvard Group Scale of Hypnotic Susceptibility: Form A (45-60 min to administer).44,45 It is important to note that current hypnotizability measures have several limitations, and further improvements are necessary to boost the utility of measuring hypnotizability in clinical hypnosis research, see for example. 33
Share hypnosis scripts, recordings of the intervention, or intervention manuals. The reproducibility of the interventions that are described in research papers is crucial for both clinicians and researchers. This is recognized by international reporting guidelines for clinical research study protocol and research reports such as CONSORT and SPIRIT. 23 Subsequently, these guidelines have been supplemented by a TIDieR. 15 As stated above, the Task Force recommends following the TIDieR guidelines for reporting clinical interventions.
TIDieR gives clear instructions on what details should be shared about interventions. However, the Task Force provides some instructions that refer specifically to hypnosis treatments, which should be used as a supplement to TIDieR. Specifically, the Task Force recommends that in order to ensure the reproducibility of treatment protocols, the authors should provide the hypnosis scripts, recording, and treatment manual (all that are available) as a supplemental file or appendix to the publication, or via an external reference. If for some reason direct publication of the script/recording or intervention manual is not possible, one of the following alternative options is advised: (a) use a protected repository (a non-complete list of such repositories can be found on the Open Science Framework as Approved Protected Access Repositories at https://osf.io/tvyxz/wiki/8.%20Approved%20Protected%20Access%20Repositories/); (b) clearly state that the script/recording/manual is available upon request by other researchers together with details on how and under which circumstances access will be granted; or (c) clearly state that the script/recording/manual will not be shared, and state the reason(s). In these shared materials, inform potential future users regarding appropriate hypnosis training and supervision of sessions. Without appropriate clinical hypnosis competence, the interventions could be less effective or even harmful.
Describe the procedures for participant education about hypnosis. TIDieR also instructs authors to share the informational materials used in the intervention provided to participants and intervention deliverers. For hypnosis interventions, this instruction should extend to clearly describing the procedure used for informing the participant about hypnosis, so this can be reproduced along with the other elements of the intervention. For example, was participant education about hypnosis manualized? If so, make the manual available. If not, describe the general approach taken in the study to educate and orient participants about hypnosis.
Describe the hypnosis induction, how the intervention was labeled for participants, and how hypnosis is conceptualized in the study. Despite several efforts, there is still no universally accepted definition of hypnosis. For example, the latest definition published by the Hypnosis Definition Committee of the American Psychological Association Division 30 was formulated by a group of prominent researchers in the field. 46 However, it was immediately followed by critical opinion pieces published in the same journal issue formulated by equally prominent researchers most of whom are members of the same professional society, see eg. 47 Given the lack of consensus regarding what constitutes hypnosis, it is not surprising that there is an inconsistency in the literature about what is considered a hypnosis intervention or a hypnosis-based intervention. Interventions such as guided imagery, autogenic training, therapeutic suggestions, and Ericksonian conversation may be considered hypnosis-based treatments by some, but not by others. Settling the issue of definition is outside the scope of this paper. Nevertheless, the Task Force recognizes the need for more clarity in the reporting of the interventions utilizing hypnosis.
One of the signature components of hypnosis interventions is a hypnosis induction procedure, which is simply defined in the latest APA Division 30 definition paper as “A procedure designed to induce hypnosis.” However, there are interventions that are considered hypnotic or hypnosis-based by some researchers that do not involve a formal hypnosis induction. The Task Force recommends that it should always be reported in clinical hypnosis research papers whether or not the intervention included a formal induction, and if so, this procedure should be described in detail.
Another important issue is the labeling of the intervention to the research participants. Sometimes clinicians and researchers do not identify the intervention as hypnosis. Some studies have shown that the use of the label “hypnosis” on an intervention can itself contribute to an increase in the treatment effect compared to an identical intervention labeled differently.48-50 Accordingly, we recommend that authors make clear whether an intervention was identified as hypnosis to participants, and if not, how it was labeled or described to them. Note that the use of the label “hypnosis” does not always result in increased response to hypnotic suggestion. For example, some studies have indicated that sizable proportions of participants are less responsive to verbal suggestions following a hypnotic induction.51,52 However, this effect has been only demonstrated in laboratory studies so far, and might not be generalizable to clinical contexts. One reason for this is the higher motivation of clinical patients. 53 More research is required to be able to properly predict the effect of labeling the intervention as hypnosis for a given individual.
Finally, it is important to clarify whether the authors themselves consider the treatment they used to be a hypnosis intervention or a hypnosis-based intervention, and if so, the rationale underlying their beliefs. This may be trivial in some cases, for example if the researchers used a formal induction. However, if there is no formal hypnosis induction, it is important to clarify why the treatment is considered a hypnosis intervention. For example, the authors might argue that even though no formal hypnosis induction was used, the intervention was labeled hypnosis for the participants, and they consider this intervention as hypnosis in the theoretical framework of Kirsch 54 wherein the only specific ingredient of a hypnosis treatment is the label “hypnosis.” Alternatively, another might argue that even though no induction was used, they worked with patients in the emergency room who suffered traumatic injury, so they had a narrow focus of attention and were in an altered state of consciousness, so they are considered to be in a naturally occurring hypnotic state based on the recent APA Division 30 definition of hypnosis 46 (although it should be noted that hypnosis of such a kind is controversial). Importantly, in this recommendation we are not identifying either of these rationales, or any others, as correct or incorrect. Rather, we are advocating for clarity about the rationale of the authors. Such clarity will help clinicians and researchers to better place the intervention in their theoretical frame of reference, and it will also help reviewers of the literature to be able to accurately group similar interventions together, in order to achieve a clearer picture of efficacy. 18
Describe in detail how hypnotizability was measured. The Task Force recommends that detailed description should be given about how hypnotizability was measured in the study. The report should include the timing of the measurement of hypnotizability within the sequence of study procedures, since it is possible that knowledge of hypnotizability might influence expectancies of treatment outcome by both participants and researchers. Furthermore, although hypnotizability is generally considered as a stable trait, 55 it is important to note that several studies indicate that hypnotizability can be increased with various approaches, such as hypnotizability training, 56 altering expectancy57,58 (but some failed replications also exist, eg 59 ) and sensory deprivation. 60 Modification effects tend to be modest but could be clinically meaningful in certain contexts. It is possible that extensive practice with hypnosis, which is not uncommon in clinical studies, could alter the measured hypnotizability values from pre- to post intervention.61-64 Thus, it should be noted whether hypnotizability was measured before, after, or during the intervention period, and also, how data regarding participants’ hypnotizability levels was managed and concealed. For the same reason, it is important to disclose in the report the role of the person(s) conducting the measurement and whether they were blind to group allocation and outcome data. As mentioned above, there are many hypnotizability scales. Authors should describe the scale used for hypnotizability measurement, its known psychometric properties as reported in previous validation studies, and internal consistency in the sample of their study.
Notes on Tier II. Preferred Recommendations for Research Practice
Measure adherence to any home practice or homework that is a part of treatment. Many hypnosis-based interventions include instructions for home practice exercises for the participants between sessions with the interventionist. This could include listening to recordings of the hypnosis sessions, listening to supplementary hypnosis recordings, or carrying out specific self-hypnosis practice. For example, a recent systematic review on the effects of hypnosis-based interventions on sleep outcomes indicated that more than 50% of the interventions included instructions for home practice. 65 It is possible that higher adherence to home practice instructions could lead to better clinical outcomes, and there is some evidence supporting this in the psychotherapy literature.66,67 However, although it is common to prescribe home practice and homework in clinical hypnosis interventions, very few studies actually measure adherence to the instructions. Accordingly, we recommend that adherence of participants to such instructions is measured in clinical hypnosis studies. Furthermore, it is recommended to use techniques that facilitate adherence to home practice (see68,69 for more details). Smartphone and mHealth technology can also be integrated into research protocols to prompt home practice and provide a log of practice session completion.70-72
Assess participant hypnotizability. Hypnotizability (sometimes called hypnotic suggestibility) refers to trait responsiveness to hypnotic suggestions, 73 through the use of a standardized work-sample instrument. 35 Even though hypnotizability assessment is not strictly necessary for establishing efficacy of a hypnosis-based treatment in a scientifically rigorous way, the assessment of hypnotizability is recommended when feasible in clinical hypnosis research, because this can help us understand the role that hypnotizability might play in the outcomes of the treatment studied. When the treatment effect is stronger in those participants higher in hypnotizability – as is found sometimes but not always eg 74 that provides greater evidence that the effect is related to trait hypnotizability, and thus, to the hypnotic suggestions used in the intervention. 35 Nevertheless, it should be noted that the predictive utility of hypnotizability on clinical outcomes tends to be small to medium in most clinical studies, eg.10,75 Thus, in research where hypnotizability as a correlate or moderator of clinical outcomes is of central interest, the study should be powered accordingly with large sample size targets.
Utilize someone other than the interventionist to assess hypnotizability. The knowledge of the hypnotizability of a participant could potentially influence the therapeutic process in multiple ways. In some cases this could be beneficial, where the intervention can be individualized to accommodate different needs based on different hypnotizability levels of participants. However, this knowledge could also be a threat to construct validity in assessment of the clinical impact of an intervention. For example, if the interventionist or another staff member knows or suspects that a participant has low hypnotizability, they might expect the participant to be less responsive to the treatment, which might turn into a self-fulfilling prophecy. Participants might also respond differently due to demand characteristics. For example, if the participant's hypnotizability was measured by the interventionist, and it was low, the participant might act in ways that would reinforce that they are less responsive to the treatment, whereas if the interventionist is unaware of their hypnotizability level, they might act more freely. Or the interventionist might consciously or unconsciously invest less energy into the treatment, since they believe the participant to be a low responder. Thus, in research studies where hypnotizability is measured, it is important to evaluate the risks and benefits of concealing the level of hypnotizability from different research staff members. One method for doing this would be assessment of hypnotizability by a data collector trained in hypnosis who is blind to treatment conditions. Another would be to measure hypnotizability only after the outcomes have been assessed. Even the latter approach could produce biases, such as participants displaying greater hypnotizability purely because they expected to do so after displaying a positive response to the intervention. In any case, these variables should be transparently reported. Sometimes it is possible to measure hypnotizability and the other variable(s) in different contexts (eg two different courses at a university), and interrelate them only afterwards.
Use a hypnotizability measure that takes into account both subjective and behavioral measures of responsiveness. Responsiveness to suggestions is traditionally measured via observable behavioral reactions in the most commonly used hypnotizability scales such as the Stanford Hypnotic Susceptibility Scale: Forms A, B, and C, 37 and their group versions, the Harvard Group Scale of Hypnotic Susceptibility: Form A 45 and the WSGC Scale of Hypnotic Susceptibility. 43 However, the effects of hypnotic suggestions can also be manifested in subjective experiences, and sometimes, suggested effects might only manifest in subjective experience and not lead to changes in overt behavior. Furthermore, a purely behavioral scoring is stipulated to be prone to bias from social compliance, and taking into account subjective experiences might correct this bias.76-78 Thus, multiple scales incorporate subjective as well as behavioral scoring of hypnotic suggestibility.40,79,80 This can also improve the content validity of the measurement. Thus, we recommend the use of hypnotizability scales that incorporate both behavioral and subjective scoring. See also. 81
Do not restrict enrollment to only high and low hypnotizable individuals. When the sample composition is based on hypnotizability, it is recommended to include medium hypnotizables as well (instead of contrasting high vs low hypnotizables), as medium hypnotizables form the majority of the general population.35,82-84 This will increase the generalizability of the study findings. The inclusion of medium hypnotizables, and avoidance of extreme-groups designs, 85 can also be informative for mechanistic research.53,86 Including the medium hypnotizability range can also help to uncover non-linear relationships between hypnotizability and the outcome or other moderating variables. shed light on potential curvilinear relationships.
Assess response expectancies of participants using valid measures. Response expectancies for relevant outcomes are an important predictor of treatment outcome in nearly all forms of psychological treatments, including hypnotherapy, 29 and they are proposed as a major causal component of treatment effects in some theories of hypnosis. 54 Thus, in interventional studies where expectancy is considered as a potential mechanism, researchers should consider the measurement of response expectancies for relevant outcome variables before and/or during the intervention in clinical hypnosis trials, and they should analyze and report the relationships of response expectancies relative to the main outcomes. If expectancies are considered a relevant mechanism, researchers should also report descriptive data about expectancies of treatment outcomes in study groups separately, and note whether there were differences in expectancies between the groups at baseline. This can help to evaluate the importance of distinct treatment elements versus common factors as mechanisms for change. Valid measures of response expectancies include the Stanford Expectations of Treatment Scale (SETS), 87 and the credibility/expectancy questionnaire (CEQ). 88 At the same time, studies employing such measures should similarly consider whether and to what extent the measurement of expectancies shapes behavior through demand characteristics (eg, consistency motivation).
Use valid measures to assess the level of rapport, therapeutic alliance, or therapeutic relationship between the client and the therapist (if any). It has been demonstrated in many studies that therapeutic relationship and related concepts such as therapeutic alliance and rapport, are important factors in determining treatment success.89-91 Relatedly, in a recent large-scale international survey among hypnosis practitioners, we found that rapport with the client was rated as the most important factor in producing desirable clinical hypnosis therapeutic outcomes. 92 Thus, the Task Force strongly recommends the assessment and reporting of the therapeutic relationship, alliance, or rapport between the therapist and the client. These variables can be assessed with various measures with established validity and reliability.89,90,93-95
Attitude toward hypnosis is a construct that is related to several of the recommendations mentioned above. Due to popular media, many people have misconceptions about hypnosis and hypnotherapy that affect willingness to use these interventions as well as outcome expectancy. Rapport and patient education are very important for dispelling misconceptions and fostering a reasonable attitude toward hypnosis-based treatments. Thus, the assessment of attitudes and beliefs about hypnosis might also be beneficial to understand individual differences in treatment responses. The following works provide good summaries about the potential impacts of attitudes and beliefs related to hypnosis.96,97
Include valid and reliable measures of variables that may elucidate potential mechanisms of action of the hypnosis intervention. Response expectancies and the therapeutic relationship are just some of many potential factors that may contribute to the outcome of hypnotherapy, so for certain applications other factors might be additionally, or even more, relevant. Understanding the mechanisms underlying a treatment effect is critically important in clinical research. 98 It allows for the improvement of the efficacy of the interventions by identifying and focusing on the effective components. It also makes it possible to target the interventions more effectively. Thus, researchers should consider the possible underlying mechanisms of action, and include measurements in the clinical trials that allow for testing and estimating the effect of these mechanistic components. The mechanisms studied should always be based on theory and/or prior findings (see eg 99 ; exploratory research can still be informative but should be correctly acknowledged as exploratory).
Report information about participants’ prior experiences with hypnosis, and provide a detailed report of response expectancies by outcome and research group together with its predictive power. As noted above, expectations about what will happen during hypnosis, and what are the short and long term benefits and potential harms of the hypnotic treatment, can play an important role in determining the treatment outcomes. 29 To develop a better understanding of these factors, and prior influences shaping expectations, the Task Force recommends that the report should document whether participants were naive to hypnosis at measurement, and if not, the report should specify how many and what type of previous sessions they had undergone. Furthermore, response expectancies pertaining to each relevant outcome should be presented separately for different intervention groups or conditions. If the study uses hypnotizability as a predictor of treatment outcome, the relationship between hypnotizability and outcome expectancies should be reported as well. The correlation or predictive power of response expectancies relative to the main outcomes should also be presented in the paper when possible.
Discussion
In this paper, we presented the best practice recommendations for conducting and reporting clinical hypnosis research, formulated by the Task Force. When applied by researchers, the recommendations are intended to be used right from the planning stage of a research project. This is true even for the reporting guidelines, because these guidelines require data collection as well. The list of recommendations also has other uses. For example, it can be used when assessing the methodological quality and risk of bias of clinical hypnosis research papers for systematic reviews and meta-analyses, or when making clinical recommendations based on the existing literature. The reporting guidelines can also be used during peer review of papers describing hypnosis interventions, and journal editors can endorse or require its use from authors to ensure that submissions concerning clinical hypnosis trials report all necessary information.
The list of recommendations was originally designed to apply to controlled clinical trials involving a hypnosis intervention. However, case studies, feasibility studies, and uncontrolled pilot studies are also critically important in the research ecosystem. In turn, the recommendations may be fully or partially relevant for these types of studies as well, so we encourage researchers and reviewers of non-controlled clinical trials to utilize them where applicable. Furthermore, even though the items specifically focus on hypnosis interventions, these recommendations may inform the design, implementation, and critical evaluation of relevant clinical trials (eg, the use of interventions involving non-hypnotic verbal suggestions) and serve as a model for the development of other mind-body medicine intervention-specific recommendations in the future. Although the recommendations were designed for clinical research, most of them are applicable to laboratory or non-clinical observational studies as well. Thus, we encourage researchers conducting non-controlled clinical trials and non-clinical studies to follow the guidelines from our list of recommendations that apply to their research studies.
The Task Force focused on formulating recommendations that capture the current state of the art, but changes will likely be necessary as the field progresses. Also, the recommendations listed here are designed to be applicable in general to most controlled clinical hypnosis trials. There may be research best practices and reporting guidelines in specific sub-fields and clinical applications that are not listed here, because they are too specific to that area. Accordingly, the list of recommendations should not be considered complete and will be updated in the future. Furthermore, as noted above, there are a host of important recommendations and reporting guidelines that are not specific to hypnosis research. We present these in Supplement 1.
One such area where field-general recommendations already exist is the area of the use of blinding (also known as masking) of people involved in the study with regards to group allocation. This topic has been discussed extensively at the Task Force meetings, so even though this issue is not included in the list of recommendations, we still wanted to mention it in the paper. Blinding study participants, research personnel, and data assessors has a long tradition in medical research, and for good reasons, the main one being that it prevents or reduces threats to construct validity related to participant and researcher expectations. 100 The main benefit of blinding participants in terms of their group allocation is to be able to distinguish the effects of the intervention-specific components from the effects of common factors such as expectancies. However, the use of blinding is much more controversial when it comes to psychotherapy research. 101 Particularly, as discussed above, both research evidence and theory indicate that response expectancy is a crucial effective component of psychotherapy, and hypnosis-based interventions especially.29,102 Thus, making participants unaware or uncertain whether they are receiving an intervention could interfere with the treatment, and in some cases could possibly be ethically questionable. 103 Furthermore, the distinction between the effects of intervention-specific effective components and common factors is not crucial to establishing efficacy of clinical hypnosis trials. Hypnosis can be highly efficacious even if the sole causal factor is response expectancy. Taken together, the Task Force does not consider participant-blinding in terms of receiving a hypnosis treatment strictly necessary in efficacy trials of clinical hypnosis interventions.
However, this is not to say that blinding of participants would be useless in clinical hypnosis trials. If the effect of expectancy on the outcome is of central interest, blinding through the utilization of a placebo control or a minimally effective control condition may be useful.104-107 For example, blinding of participants as to whether they are in the active treatment arm can be achieved with supportive listening, a placebo intervention specific to their condition, or a minimally effective hypnosis treatment condition such as a hypnotic induction without specific treatment-oriented suggestions. Blinding of participants can hold additional benefits as well, such as decreased likelihood for dropout or seeking additional adjunctive interventions. 100
Furthermore, the use of blinding for research personnel, such as data collectors, data analysts, or the principal investigator, and members of the medical care team, such as physicians, psychologists, or nurses, with regards to group allocation is essential to mitigate threats to construct validity. The benefits include (but are not limited to) lower likelihood to transfer expectations and attitudes about intervention effectiveness to participants and to bias results through differentially adjusting dose, withdrawing participants, or encouraging or discouraging participants to continue in the trial, and so on. 100
The Task Force discussed recommendations related to hypnotizability scales extensively. While in some clinical studies, application of the above highlighted scales are appropriate, in some clinical settings it is not feasible to include some or any of them. One of the common reasons for not including hypnotizability measurement in therapy is time constraints. Some of the above mentioned tests take a considerable amount of time to administer, often as long or more than the clinical intervention itself. Another reason might be the inappropriateness of the items used in the scale for the clinical context or the sample. There are multiple hypnotizability scales that are designed to overcome these challenges, which are often referred to as “clinical scales”, such as the Stanford Hypnotic Clinical Scale, 108 Elkins Hypnotizability Scale—Clinical Form, 40 and the Hypnotic Induction Profile. 109 The clinical scales generally have poorer psychometric properties than the laboratory scales, so when possible, the Task Force recommends the use of the laboratory scales.108,110,111 Nevertheless, if the use of the laboratory scales are not feasible, the researchers might consider using a clinical scale, taking into consideration the tradeoff on the reliability or validity of the measurement.
Advances in digital technology can make the adoption of best practice guidelines easier. As mentioned above, such tools can enable objective monitoring of home practice, and even facilitating adherence via gamification. Mobile apps can make intervention delivery standardized while enabling self-administration, drastically increasing the reach of clinical interventions. Short, informative online materials can aid in participant education about hypnosis in a standardized fashion. Computerized hypnotic suggestibility scales such as the HIP/App 112 or the SWASH 113 can help in scaling up hypnotizability measurement or screening, or with further development may even enable automation of these research steps, which could also help in maintaining blinding of the interventionist with regards to the hypnotizability of the participant. Digital tools can also make it very easy to transparently report methods used enabling close reproducibility. Similarly, using electronic data capture in research workflows can increase the reliability of data management while at the same time making data sharing easier. Future developments in digital technology will no doubt unlock more potential for conducting high quality research.
In implementing the recommended guidelines for conducting clinical trials on hypnosis interventions, researchers may encounter several practical challenges. For example, writing up research protocols and treatment manuals can be time consuming. A manual with too little detail might be misinterpreted by research or clinical staff, while a manual with too much detail is not handy in day-to-day operations, and important details might be missed just due to information-overload. Thus, piloting the manual is important as well as supplementing it with summaries and checklists for day-to-day use. Another practical challenge can be changing previous habits. Researchers, clinicians, and study participants may have established habits or preconceived notions about hypnosis that could influence their adherence to the recommended protocols. For instance, clinicians accustomed to more traditional therapeutic approaches may find it challenging to adopt standardized hypnosis induction procedures or to accurately implement scripted interventions. Overcoming these challenges requires targeted efforts to educate and familiarize stakeholders with the rationale and procedures underlying the recommended guidelines, as well as ongoing support and training to facilitate adherence to standardized practices. Additionally, fostering a culture of openness to new methodologies and a willingness to adapt existing practices can help mitigate resistance to change and promote the adoption of best practices in hypnosis research.
Finally, it is important to note that methodological quality and reporting practices are not the only areas where the field of clinical hypnosis research can improve. In addition to the issues mentioned already, the presence of publication bias (ie, the inordinately high proportion of positive findings in the literature, especially among studies with low sample sizes), and large heterogeneity among hypnosis research studies also limit the generalizability of the findings and result in more cautious recommendations by reviewers of the field. This indicates a need for a field-wide improvement in publication (eg, pre-registration, publication of non-significant results, registered reports) and in the standardization of research.
Conclusions
The present article summarizes two years of deliberations of the Task Force for Establishing Efficacy Standards for Clinical Hypnosis. The Task Force reviewed widely respected best practice principles including the CONSORT statement, 16 TIDieR checklist, 15 and the Cochrane Handbook for Systematic Reviews of Interventions 19 and developed best practice guidelines for research and reporting for clinical research in hypnosis. The guidelines are presented in two tiers: Tier I includes essential recommendations that should apply to most prospective controlled clinical hypnosis trials, whereas Tier II includes recommendations that are more situational.
The Tier I guidelines aim to increase the standardization and clarity of research and treatment protocols, and to promote the use of valid and reliable measures. They also recommend sharing research materials such as manuals and scripts, clear description of participant education and hypnosis induction, and reporting details about the hypnotizability measurement. Tier II includes recommendations for facilitating and measuring adherence, assessment of hypnotizability with robust measures by someone other than the interventionist and including participants from the whole hypnotizability spectrum. Tier II also includes guidelines for measurement and reporting of response expectancy and the therapeutic relationship, and assessment of potential other mechanisms.
Researchers should keep these guidelines in mind while research studies are designed and implemented, to ensure that the required information will be available for the research report. The Task Force recommends that hypnosis researchers carefully follow these best practice and reporting guidelines in order to elevate the quality of research designs in the clinical hypnosis field. The field of evidence-based healthcare has increased the standards for research on clinical applications, and if hypnosis is to be considered as an evidence-based behavioral intervention, then its evidence must be of the highest quality.
Supplemental Material
Supplemental material, sj-docx-1-chp-10.1177_2515690X241274538 for Best Practice Recommendations for Conducting and Reporting Controlled Trials in Clinical Hypnosis Research by Zoltan Kekecs, Donald Moss, Peter J. Whorwell, Katalin Varga, Devin B. Terhune, Philip D. Shenefelt, Olafur S. Palsson, Giuseppe De Benedittis and Gary Elkins in Journal of Evidence-Based Integrative Medicine
Acknowledgements
We want to acknowledge the support of the external consultants of the Task Force: Mark P. Jensen, Elvira Lang, David Patterson, and Audrey Vanhaudenhuyse, who reviewed the list of guidelines and recommended improvements. We are also grateful to Balint Domok for editing the citations and references in this paper.
Abbreviations
- CONSORT
Consolidated Standards of Reporting Trials
- TIDieR
Template for Intervention Description and Replication
- STROBE
Strengthening the Reporting of Observational studies in Epidemiology
- SPIRIT
Standard Protocol Items: Recommendations for Interventional Trials
- Task Force
The Task Force for Establishing Efficacy Standards for Clinical Hypnosis
Footnotes
Author Contributions: ZK drafted the guidelines based on the Task Force meetings, was involved in coordinating Task Force discussions on the guidelines and led manuscript write-up.
DM initiated the Task Force, was involved in coordinating Task Force discussions on the guidelines and participated in manuscript write-up.
GDB, GE, DBT, KV, OP, PDS and PJW attended the meetings of the Task Force on the guidelines, contributed to formulating and editing the guidelines, reviewed and approved the final wording of the guidelines, and participated in writing the manuscript.
Availability of Data and Materials: The dataset(s) supporting the conclusions of this article is(are) included within the article (and its additional file(s)). The online supplement (Supplement 1) is also accessible at: https://osf.io/t832x
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Ethical Approval: This is a theoretical work that does not require ethical approval.
Funding: The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This research was funded via the Nemzeti Kutatási Fejlesztési és Innovációs Hivatal's OTKA FK grant #132248. Zoltan Kekecs was also supported by the János Bolyai Research Scholarship of the Hungarian Academy of Science, and the ÚNKP New National Excellence Program of the Ministry for Innovation and Technology from the source of the National Research, Development and Innovation Fund. Katalin Varga was supported by MTA-ELTE Lendület Adaptation Research Group, Institute of Psychology, ELTE Eötvös Loránd University, Budapest, Hungary. Saybrook University, Pasadena, CA, provided the ZOOM platform for Task Force meetings.
Prior Versions: A previous version of the manuscript was posted on PsyArXiv as a preprint: https://psyarxiv.com/nv39u
ORCID iD: Zoltan Kekecs https://orcid.org/0000-0001-9247-9781
Supplemental Material: Supplemental material for this article is available online.
References
- 1.Elkins G. Handbook of medical and psychological hypnosis: Foundations, applications, and professional issues. Springer Publishing Company; 2016. [Google Scholar]
- 2.Bicego A, Rousseaux F, Faymonville ME, Nyssen AS, Vanhaudenhuyse A. Neurophysiology of hypnosis in chronic pain: A review of recent literature. Am J Clin Hypnosis. 2021;64(1):62-80. doi: 10.1080/00029157.2020.1869517 [DOI] [PubMed] [Google Scholar]
- 3.Langlois P, Perrochon A, David R, et al. Hypnosis to manage musculoskeletal and neuropathic chronic pain: A systematic review and meta-analysis. Neurosci Biobehav Rev. 2022;135:104591. doi: 10.1016/j.neubiorev.2022.104591 [DOI] [PubMed] [Google Scholar]
- 4.Grégoire C, Faymonville ME, Jerusalem G, Gosseries O, Vanhaudenhuyse A. Psycho-oncology interventions focusing on fatigue and sleep disturbances. Curr Opin Oncol. 2022;34(4):270-278. doi: 10.1097/CCO.0000000000000847 [DOI] [PubMed] [Google Scholar]
- 5.Adachi T, Fujino H, Nakae A, Mashimo T, Sasaki J. A meta-analysis of hypnosis for chronic pain problems: A comparison between hypnosis, standard care, and other psychological interventions. Int J Clin Exp Hypnosis. 2014;62(1):1-28. doi: 10.1080/00207144.2013.841471 [DOI] [PubMed] [Google Scholar]
- 6.Bernardy K, Füber N, Klose P, Häuser W. Efficacy of hypnosis/guided imagery in fibromyalgia syndrome - a systematic review and meta-analysis of controlled trials. BMC Musculoskelet Disord. 2011;12(1):1-11. doi: 10.1186/1471-2474-12-133 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Birnie KA, Noel M, Parker JA, et al. Systematic review and meta-analysis of distraction and hypnosis for needle-related pain and distress in children and adolescents. J Pediatr Psychol. 2014;39(8):783-808. doi: 10.1093/jpepsy/jsu029 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Kekecs Z, Nagy T, Varga K. The effectiveness of suggestive techniques in reducing postoperative Side effects: A meta-analysis of randomized controlled trials. Anesth Analg. 2014;119(6):1407-1419. doi: 10.1213/ANE.0000000000000466 [DOI] [PubMed] [Google Scholar]
- 9.Madden K, Middleton P, Cyna AM, Matthewson M, Jones L. Hypnosis for pain management during labour and childbirth. Cochrane Pregnancy and Childbirth Group, ed. Cochrane Database Syst Rev. 2016;5:1-100. doi: 10.1002/14651858.CD009356.pub3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Milling LS, Valentine KE, LoStimolo LM, Nett AM, McCarley HS. Hypnosis and the alleviation of clinical pain: A comprehensive meta-analysis. Int J Clin Exp Hypnosis. 2021;69(3):297-322. doi: 10.1080/00207144.2021.1920330 [DOI] [PubMed] [Google Scholar]
- 11.Thompson T, Terhune DB, Oram C, et al. The effectiveness of hypnosis for pain relief: A systematic review and meta-analysis of 85 controlled experimental trials. Neurosci Biobehav Rev. 2019;99:298-310. doi: 10.1016/j.neubiorev.2019.02.013 [DOI] [PubMed] [Google Scholar]
- 12.Tefikow S, Barth J, Maichrowitz S, Beelmann A, Strauss B, Rosendahl J. Efficacy of hypnosis in adults undergoing surgery or medical procedures: A meta-analysis of randomized controlled trials. Clin Psychol Rev. 2013;33(5):623-636. doi: 10.1016/j.cpr.2013.03.005 [DOI] [PubMed] [Google Scholar]
- 13.Dwan K, Gamble C, Williamson PR, Kirkham JJ, the Reporting Bias Group. Systematic review of the empirical evidence of study publication bias and outcome reporting bias — an updated review. Boutron I, ed. PLoS ONE. 2013;8(7):e66844. doi: 10.1371/journal.pone.0066844 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Glasziou P, Meats E, Heneghan C, Shepperd S. What is missing from descriptions of treatment in trials and reviews? Br Med J. 2008;336(7659):1472-1474. doi: 10.1136/bmj.39590.732037.47 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Hoffmann TC, Glasziou PP, Boutron I, et al. Better reporting of interventions: Template for intervention description and replication (TIDieR) checklist and guide. Br Med J. 2014;348:g1687-g1687. doi: 10.1136/bmj.g1687 [DOI] [PubMed] [Google Scholar]
- 16.Schulz KF, Altman DG, Moher D, CONSORT Group. CONSORT 2010 Statement: Updated guidelines for reporting parallel group randomized trials. Ann Intern Med. 2010;152(11):726-732. doi: 10.7326/0003-4819-152-11-201006010-00232 [DOI] [PubMed] [Google Scholar]
- 17.von Elm E, Altman DG, Egger M, et al. The strengthening the reporting of observational studies in epidemiology (STROBE) statement: Guidelines for reporting observational studies*. Bull World Health Organ. 2007;85(11):867-872. doi: 10.2471/BLT.07.045120 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Kekecs Z, Moss D, Elkins G, et al. Guidelines for the assessment of efficacy of clinical hypnosis applications. Int J Clin Exp Hypnosis. 2022;70(2):104-122. doi: 10.1080/00207144.2022.2049446 [DOI] [PubMed] [Google Scholar]
- 19.Higgins JPT, Thomas J, Chandler J, et al. Cochrane handbook for systematic reviews of interventions. John Wiley & Sons; 2019. [Google Scholar]
- 20.Higgins JPT, Altman DG, Gotzsche PC, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. Br Med J. 2011;343(oct18 2):d5928-d5928. doi: 10.1136/bmj.d5928 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Higgins JPT, Savović J, Page MJ, Sterne JAC. Revised Cochrane risk-of-bias tool for randomized trials (RoB 2). riskofbias.info. Published 2019. Accessed April 29, 2021. https://drive.google.com/file/d/19R9savfPdCHC8XLz2iiMvL_71lPJERWK/view?usp=drive_open&usp=embed_facebook.
- 22.Landolt AS, Milling LS. The efficacy of hypnosis as an intervention for labor and delivery pain: A comprehensive methodological review. Clin Psychol Rev. 2011;31(6):1022-1031. doi: 10.1016/j.cpr.2011.06.002 [DOI] [PubMed] [Google Scholar]
- 23.Chan AW, Tetzlaff JM, Gøtzsche PC, et al. SPIRIT 2013 Explanation and elaboration: Guidance for protocols of clinical trials. Br Med J. 2013;346:e7586. doi: 10.1136/bmj.e7586 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Chambless DL, Hollon SD. Defining empirically supported therapies. J Consult Clin Psychol. 1998;66(1):7-18. doi: 10.1037/0022-006X.66.1.7 [DOI] [PubMed] [Google Scholar]
- 25.Miles J, Gilbert P. A Handbook of research methods for clinical and health psychology. Oxford University Press; 2005. [Google Scholar]
- 26.Roberts MC, Ilardi SS. Handbook of research methods in clinical psychology. John Wiley & Sons; 2008. [Google Scholar]
- 27.Chambless DL, Hollon SD. Treatment validity for intervention studies. In: Cooper H, Camic PM, Long DL, Panter AT, Rindskopf D, Sher KJ, eds. APA Handbook of research methods in psychology, vol 2: research designs: quantitative, qualitative, neuropsychological, and biological. American Psychological Association; 2012:529-552. doi:10.1037/13620-028. [Google Scholar]
- 28.Barabasz M, Spiegel D. Hypnotizability and weight loss in obese subjects. Int J Eating Disord. 1989;8(3):335-341. doi: [DOI] [Google Scholar]
- 29.Kirsch I. Response expectancy and the placebo effect. In: Colloca L, ed. International review of neurobiology. Vol 138. Neurobiology of the placebo effect part I. Academic Press; 2018:81-93. doi:10.1016/bs.irn.2018.01.003. [DOI] [PubMed] [Google Scholar]
- 30.Lynn SJ, Weekes JR, Neufeld V, Zivney O, Brentar J, Weiss F. Interpersonal climate and hypnotizability level: Effects on hypnotic performance, rapport, and archaic involvement. J Pers Soc Psychol. 1991;60(5):739-743. doi: 10.1037/0022-3514.60.5.739 [DOI] [Google Scholar]
- 31.Lynn SJ, Cardeña E, Green JP, Laurence JR. The case for clinical hypnosis: Theory and research-based do’s and don’ts for clinical practice. Psychol Conscious: Theory Res Pract. Published online 2022;9(2):187-1200. doi: 10.1037/cns0000257 [DOI] [Google Scholar]
- 32.Division 30. Hypnosis: What it is and how it can make you feel better. https://www.apadivisions.org. Published 2004. Accessed March 23, 2022. https://www.apadivisions.org/division-30/about.
- 33.Acunzo DJ, Terhune DB. A critical review of standardized measures of hypnotic suggestibility. Int J Clin Exp Hypnosis. 2021;69(1):50-71. doi: 10.1080/00207144.2021.1833209 [DOI] [PubMed] [Google Scholar]
- 34.Barnier AJ, Council JR. Hypnotizability matters: the what, why, and how of measurement. In: Handbook of clinical hypnosis, 2nd Ed. American Psychological Association; 2010:47-77. doi:10.2307/j.ctv1chs5qj.7. [Google Scholar]
- 35.Woody EZ, Barnier AJ. Hypnosis scales for the twenty-first century: what do we need and how should we use them? In: Nash MR, Barnier AJ, eds. The Oxford handbook of hypnosis: theory, research, and practice. Oxford University Press; 2008:255-280. [Google Scholar]
- 36.Shadish WR, Cook TD, Campbell DT. Experimental and quasi-experimental designs for generalized causal inference. Houghton scMifflin and Company; 2002. [Google Scholar]
- 37.Weitzenhoffer AM, Hilgard ER. Stanford hypnotic susceptibility scale, form C. Vol 27. Consulting Psychologists Press; 1962. [Google Scholar]
- 38.Barber TX, Calverley DS. “Hypnotic-like” suggestibility in children and adults. J Abnormal Social Psychol. 1963;66(6):589-597. doi: 10.1037/h0041709 [DOI] [PubMed] [Google Scholar]
- 39.Pellicer Asensio X, Fusté Escolano A, Ruiz Rodríguez J. Psychometric analysis of the barber suggestibility scale in a clinical population. Am J Clin Hypnosis. 2018;60(4):386-402. doi: 10.1080/00029157.2017.1421138 [DOI] [PubMed] [Google Scholar]
- 40.Elkins G. Hypnotic relaxation therapy: principles and applications. Springer Publishing Company; 2013. [Google Scholar]
- 41.Kekecs Z, Bowers J, Johnson A, Kendrick C, Elkins G. The Elkins hypnotizability scale: Assessment of reliability and validity. Int J Clin Exp Hypnosis. 2016;64(3):285-304. doi: 10.1080/00207144.2016.1171089 [DOI] [PubMed] [Google Scholar]
- 42.Kekecs Z, Roberts L, Na H, et al. Test–retest reliability of the Stanford hypnotic susceptibility scale, form C and the Elkins hypnotizability scale. Int J Clin Exp Hypnosis. 2021;69(1):142-161. doi: 10.1080/00207144.2021.1834858 [DOI] [PubMed] [Google Scholar]
- 43.Bowers KS. The Waterloo-Stanford group C (WSGC) scale of hypnotic susceptibility: Normative and comparative data. Int J Clin Exp Hypnosis. 1993;41(1):35-46. doi: 10.1080/00207149308414536 [DOI] [PubMed] [Google Scholar]
- 44.Spanos NP, Radtke HL, Hodgins DC, Stam HJ, Bertrand LD. The carleton university responsiveness to suggestion scale: Normative data and psychometric properties. Psychol Rep. 1983;53(2):523-535. doi: 10.2466/pr0.1983.53.2.523 [DOI] [PubMed] [Google Scholar]
- 45.Shor RE, Orne EC. Norms on the Harvard Group scale of hypnotic susceptibility, form A. Int J Clin Exp Hypnosis. 1963;11(1):39-47. doi: 10.1080/00207146308409226 [DOI] [PubMed] [Google Scholar]
- 46.Elkins G, Barabasz AF, Council JR, Spiegel D. Advancing research and practice: The revised APA division 30 definition of hypnosis. Int J Clin Exp Hypnosis. 2015;63(1):1-9. doi: 10.1080/00207144.2014.961870 [DOI] [PubMed] [Google Scholar]
- 47.Lynn SJ, Green JP, Kirsch I, et al. Grounding hypnosis in science: The “new” APA division 30 definition of hypnosis as a step backward. Am J Clin Hypnosis. 2015;57(4):390-401. doi: 10.1080/00029157.2015.1011472 [DOI] [PubMed] [Google Scholar]
- 48.Gandhi B, Oakley DA. Does ‘hypnosis’ by any other name smell as sweet? The efficacy of ‘hypnotic’ inductions depends on the label ‘hypnosis.’. Conscious Cogn. 2005;14(2):304-315. doi: 10.1016/j.concog.2004.12.004 [DOI] [PubMed] [Google Scholar]
- 49.Kirsch I, Lynn SJ. The altered state of hypnosis: Changes in the theoretical landscape. Am Psychologist. 1995;50(10):846-858. doi: 10.1037/0003-066X.50.10.846 [DOI] [Google Scholar]
- 50.Schoenberger NE, Kirsch I, Gearan P, Montgomery G, Pastyrnak SL. Hypnotic enhancement of a cognitive behavioral treatment for public speaking anxiety. Behav Ther. 1997;28(1):127-140. doi: 10.1016/S0005-7894(97)80038-X [DOI] [Google Scholar]
- 51.Braffman W, Kirsch I. Imaginative suggestibility and hypnotizability: An empirical analysis. J Pers Soc Psychol. 1999;77(3):578-587. doi: 10.1037/0022-3514.77.3.578 [DOI] [PubMed] [Google Scholar]
- 52.Hilgard ER, Tart CT. Responsiveness to suggestions following waking and imagination instructions and following induction of hypnosis. J Abnorm Psychol. 1966;71(3):196-208. doi: 10.1037/h0023323 [DOI] [PubMed] [Google Scholar]
- 53.Jensen MP, Jamieson GA, Lutz A, et al. New directions in hypnosis research: Strategies for advancing the cognitive and clinical neuroscience of hypnosis. Neurosci Conscious. 2017;2017(1):nix004. doi: 10.1093/nc/nix004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Kirsch I. Clinical hypnosis as a nondeceptive placebo. In: Kirsch I, Capafons A, Cardeña-Buelna E, Amigó S, eds. Clinical hypnosis and self-regulation: cognitive-behavioral perspectives. American Psychological Association; 1999:211-225. doi:10.1037/10282-008. [Google Scholar]
- 55.Piccione C, Hilgard ER, Zimbardo PG. On the degree of stability of measured hypnotizability over a 25-year period. J Pers Soc Psychol. 1989;56(2):289-295. doi: 10.1037/0022-3514.56.2.289 [DOI] [PubMed] [Google Scholar]
- 56.Gfeller JD, Lynn SJ, Pribble WE. Enhancing hypnotic susceptibility: Interpersonal and rapport factors. J Pers Soc Psychol. 1987;52(3):586-595. doi: 10.1037/0022-3514.52.3.586 [DOI] [PubMed] [Google Scholar]
- 57.Kirsch I, Wickless C, Moffitt KH. Expectancy and suggestibility: Are the effects of environmental enhancement due to detection? Int J Clin Exp Hypnosis. 1999;47(1):40-45. doi: 10.1080/00207149908410021 [DOI] [PubMed] [Google Scholar]
- 58.Wickless C, Kirsch I. Effects of verbal and experiential expectancy manipulations on hypnotic susceptibility. J Pers Soc Psychol. 1989;57(5):762-768. doi: 10.1037/0022-3514.57.5.762 [DOI] [Google Scholar]
- 59.Benham G, Bowers S, Nash M, Muenchen R. Self-fulfilling prophecy and hypnotic response are not the same thing. J Pers Soc Psychol. 1998;75(6):1604-1613. doi: 10.1037//0022-3514.75.6.1604 [DOI] [PubMed] [Google Scholar]
- 60.Darakjy J, Barabasz M, Barabasz A. Effects of dry flotation restricted environmental stimulation on hypnotizability and pain control. Am J Clin Hypnosis. 2015;58(2):204-214. doi: 10.1080/00029157.2014.979275 [DOI] [PubMed] [Google Scholar]
- 61.Ås A. Hypnotizability as a function of nonhypnotic experiences. J Abnormal Soc Psychol. 1963;66(2):142-150. doi: 10.1037/h0045590 [DOI] [Google Scholar]
- 62.Reilley RR, Parisher DW, Carona A, Dobrovolsky NW. Modifying hypnotic susceptibility by practice and instruction. Int J Clin Exp Hypnosis. 1980;28(1):39-45. doi: 10.1080/00207148008409826 [DOI] [PubMed] [Google Scholar]
- 63.Jensen MP, Battalio SL, Chan JF, et al. Use of neurofeedback and mindfulness to enhance response to hypnosis treatment in individuals with multiple sclerosis: Results from a pilot randomized clinical trial. Int J Clin Exp Hypnosis. 2018;66(3):231-264. doi: 10.1080/00207144.2018.1460546 [DOI] [PubMed] [Google Scholar]
- 64.Batty MJ, Bonnington S, Tang BK, Hawken MB, Gruzelier JH. Relaxation strategies and enhancement of hypnotic susceptibility: EEG neurofeedback, progressive muscle relaxation and self-hypnosis. Brain Res Bull. 2006;71(1):83-90. doi: 10.1016/j.brainresbull.2006.08.005 [DOI] [PubMed] [Google Scholar]
- 65.Chamine I, Atchley R, Oken BS. Hypnosis intervention effects on sleep outcomes: A systematic review. J Clin Sleep Med. 2018;14(2):271-283. doi: 10.5664/jcsm.6952 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Kazantzis N, Whittington C, Dattilio F. Meta-analysis of homework effects in cognitive and behavioral therapy: A replication and extension. Clin Psychol: Sci Pract. 2010;17(2):144-156. doi: 10.1111/j.1468-2850.2010.01204.x [DOI] [Google Scholar]
- 67.Kazantzis N, Lampropoulos GK. Reflecting on homework in psychotherapy: What can we conclude from research and experience? J Clin Psychol. 2002;58(5):577-585. doi: 10.1002/jclp.10034 [DOI] [PubMed] [Google Scholar]
- 68.Bunnell BE, Nemeth LS, Lenert LA, et al. Barriers associated with the implementation of homework in youth mental health treatment and potential Mobile health solutions. Cogn Ther Res. 2021;45(2):272-286. doi: 10.1007/s10608-020-10090-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Dobson KS. A commentary on the science and practice of homework in cognitive behavioral therapy. Cogn Ther Res. 2021;45(2):303-309. doi: 10.1007/s10608-021-10217-5 [DOI] [Google Scholar]
- 70.Lang EV, Jackson W, Senn P, et al. Efficacy of a self-hypnotic relaxation app on pain and anxiety in a randomized clinical trial: Results and considerations on the design of active and control apps. Int J Clin Exp Hypnosis. 2021;69(2):277-295. doi: 10.1080/00207144.2021.1883988 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.O’Reilly GA, Spruijt-Metz D. Current mHealth technologies for physical activity assessment and promotion. Am J Prev Med. 2013;45(4):501-507. doi: 10.1016/j.amepre.2013.05.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Schultchen D, Terhorst Y, Holderied T, et al. Stay present with your phone: A systematic review and standardized rating of mindfulness apps in European app stores. IntJ Behav Med. 2021;28(5):552-560. doi: 10.1007/s12529-020-09944-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Laurence JR, Beaulieu-Prévost D, Chéné Td. Measuring and understanding individual differences in hypnotizability. In: The Oxford handbook of hypnosis: theory, research, and practice. Oxford University Press; 2008:225-253. [Google Scholar]
- 74.Holroyd J. The uncertain relationship between hypnotizability and smoking treatment outcome. Int J Clin Exp Hypnosis. 1991;39(2):93-102. doi: 10.1080/00207149108409623 [DOI] [PubMed] [Google Scholar]
- 75.Montgomery GH, Schnur JB, David D. The impact of hypnotic suggestibility in clinical care settings. Int J Clin Exp Hypnosis. 2011;59(3):294-309. doi: 10.1080/00207144.2011.570656 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Bowers KS. Do the Stanford scales tap the “classic suggestion effect”? Int J Clin Exp Hypnosis. 1981;29(1):42-53. doi: 10.1080/00207148108409142 [DOI] [PubMed] [Google Scholar]
- 77.Bowers P, Laurence JR, Hart D. The experience of hypnotic suggestions. Int J Clin Exp Hypnosis. 1988;36(4):336-349. doi: 10.1080/00207148808410523 [DOI] [PubMed] [Google Scholar]
- 78.Ruch JC, Morgan AH, Hilgard ER. Measuring hypnotic responsiveness: A comparison of the barber suggestibility scale and the Stanford hypnotic susceptibility scale, form a. Int J Clin Exp Hypnosis. 1974;22(4):365-376. doi: 10.1080/00207147408413016 [DOI] [PubMed] [Google Scholar]
- 79.Kirsch I, Council JR, Wickless C. Subjective scoring for the harvard group scale of hypnotic susceptibility, form A. Int J Clin Exp Hypnosis. 1990;38(2):112-124. doi: 10.1080/00207149008414506 [DOI] [PubMed] [Google Scholar]
- 80.Kirsch I, Milling LS, Burgess C. Experiential scoring for the Waterloo-Stanford group c scale. Int J Clin Exp Hypnosis. 1998;46(3):269-279. doi: 10.1080/00207149808410007 [DOI] [PubMed] [Google Scholar]
- 81.Woody EZ, Szechtman H. To see feelingly: Emotion, motivation, and hypnosis. In: Jamieson G, ed. Hypnosis and conscious states: The cognitive neuroscience perspective. Oxford University Press; 2007:241–249. [Google Scholar]
- 82.Hilgard ER. Hypnotic susceptibility. Harcourt, Brace & World; 1965:xiii, 434. [Google Scholar]
- 83.Perri RL. In medio stat virtus: The importance of studying mediums in hypnosis research. Am J Clin Hypnosis. 2021;64(1):4-11. doi: 10.1080/00029157.2020.1859980 [DOI] [PubMed] [Google Scholar]
- 84.Perri RL, Bianco V, Facco E, Di Russo F. Now you see one letter, now you see meaningless symbols: Perceptual and semantic hypnotic suggestions reduce Stroop errors through different neurocognitive mechanisms. Front Neurosci. 2021;14:600083. doi: 10.3389/fnins.2020.600083 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 85.Preacher KJ, Rucker DD, MacCallum RC, Nicewander WA. Use of the extreme groups approach: A critical reexamination and new recommendations. Psychol Methods. 2005;10(2):178-192. doi: 10.1037/1082-989X.10.2.178 [DOI] [PubMed] [Google Scholar]
- 86.Lynn SJ, Kirsch I, Knox J, Fassler O, Lilienfeld SO. Hypnosis and neuroscience: implications for the altered state debate. In: Hypnosis and conscious states: the cognitive neuroscience perspective. Oxford University Press; 2007:145-165. [Google Scholar]
- 87.Younger J, Gandhi V, Hubbard E, Mackey S. Development of the Stanford Expectations of Treatment Scale (SETS): A tool for measuring patient outcome expectancy in clinical trials. Clin Trials. 2012;9(6):767-776. doi: 10.1177/1740774512465064 [DOI] [PubMed] [Google Scholar]
- 88.Devilly GJ, Borkovec TD. Psychometric properties of the credibility/expectancy questionnaire. J Behav Ther Exp Psychiatry. 2000;31(2):73-86. doi: 10.1016/S0005-7916(00)00012-4 [DOI] [PubMed] [Google Scholar]
- 89.Cameron SK, Rodgers J, Dagnan D. The relationship between the therapeutic alliance and clinical outcomes in cognitive behaviour therapy for adults with depression: A meta-analytic review. Clin Psychol Psychother. 2018;25(3):446-456. doi: 10.1002/cpp.2180 [DOI] [PubMed] [Google Scholar]
- 90.Flückiger C, Del Re AC, Wampold BE, Horvath AO. The alliance in adult psychotherapy: A meta-analytic synthesis. Psychotherapy. 2018;55(4):316-340. doi: 10.1037/pst0000172 [DOI] [PubMed] [Google Scholar]
- 91.Totura CMW, Fields SA, Karver MS. The role of the therapeutic relationship in psychopharmacological treatment outcomes: A meta-analytic review. PS (Wash DC). 2018;69(1):41-47. doi: 10.1176/appi.ps.201700114 [DOI] [PubMed] [Google Scholar]
- 92.Palsson OS, Kekecs Z, DeBenedittis G, et al. Current practices, experiences, and views in clinical hypnosis: Findings of an international survey. Int J Clin Exp Hypnosis. 2023;71(2):92-114. Published online in press. [DOI] [PubMed] [Google Scholar]
- 93.Barnett MD, Parsons TD, Moore JM. Measuring rapport in neuropsychological assessment: The barnett rapport questionnaire. Appl Neuropsychol: Adult. 2021;28(5):556-563. doi: 10.1080/23279095.2019.1663523 [DOI] [PubMed] [Google Scholar]
- 94.Murphy R, Kettner H, Zeifman R, et al. Therapeutic alliance and rapport modulate responses to psilocybin assisted therapy for depression. Front Pharmacol. 2022;12:788155. doi: 10.3389/fphar.2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 95.Varga K, Józsa E, Bányai ÉI, Gősi-Greguss AC. A new way of characterizing hypnotic interactions: Dyadic Interactional Harmony (DIH) questionnaire. Contemp Hypn. 2006;23(4):151-166. doi: 10.1002/ch.320 [DOI] [Google Scholar]
- 96.Lynn SJ, Kirsch I, Terhune DB, Green JP. Myths and misconceptions about hypnosis and suggestion: Separating fact and fiction. Appl Cogn Psychol. 2020;34(6):1253-1264. doi: 10.1002/acp.3730 [DOI] [Google Scholar]
- 97.Benham G, Woody EZ, Wilson KS, Nash MR. Expect the unexpected: Ability, attitude, and responsiveness to hypnosis. J Pers Soc Psychol. 2006;91(2):342-350. doi: 10.1037/0022-3514.91.2.342 [DOI] [PubMed] [Google Scholar]
- 98.Chen W. New Funding Initiatives on “Phased Innovation Award for Mechanistic Studies to Optimize Mind and Body Interventions.” NCCIH. Published 16 2015. Accessed June 10, 2022. https://www.nccih.nih.gov/research/blog/new-funding-initiatives-on-phased-innovation-award-for-mechanistic-studies-to-optimize-mind-and-body-interventions.
- 99.Day MA, Thorn BE, Ehde DM, et al. Moderators of mindfulness meditation, cognitive therapy, and mindfulness-based cognitive therapy for chronic low back pain: A test of the limit, activate, and enhance model. J Pain. 2020;21(1):161-169. doi: 10.1016/j.jpain.2019.06.006 [DOI] [PubMed] [Google Scholar]
- 100.Schulz KF, Grimes DA. Blinding in randomised trials: Hiding who got what. Lancet. 2002;359(9307):696-700. doi: 10.1016/S0140-6736(02)07816-9 [DOI] [PubMed] [Google Scholar]
- 101.Kirsch I, Wampold B, Kelley JM. Controlling for the placebo effect in psychotherapy: Noble quest or tilting at windmills? Psychol Conscious: Theory Res Pract. 2016;3(2):121-131. doi: 10.1037/cns0000065 [DOI] [Google Scholar]
- 102.Kirsch I. How expectancies shape experience. American Psychological Association; 1999:xiv, 431. doi: 10.1037/10332-000. [DOI] [Google Scholar]
- 103.Anand R, Norrie J, Bradley JM, McAuley DF, Clarke M. Fool’s gold? Why blinded trials are not always best. Br Med J. 2020;368:l6228. doi: 10.1136/bmj.l6228 [DOI] [PubMed] [Google Scholar]
- 104.Barton DL, Fee Schroeder KC, Banerjee T, Wolf S, Keith T, Elkins G. Efficacy of a biobehavioral intervention for hot flashes: A randomized controlled pilot study. Menopause. 2017;24(7):774-782. doi: 10.1097/GME.0000000000000837 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 105.Jensen MP, Patterson DR. Control conditions in hypnotic-analgesia clinical trials: Challenges and recommendations. Int J Clin Exp Hypnosis. 2005;53(2):170-197. doi: 10.1080/00207140590927536 [DOI] [PubMed] [Google Scholar]
- 106.Kendrick C, Koep L, Johnson A, Fisher W, Elkins G. Feasibility of a sham hypnosis: Empirical data and implications for randomized trials of hypnosis. Contemp Hypn Integr Ther. 2012;29(4):317-331. [Google Scholar]
- 107.Sliwinski J, Elkins G. Enhancing placebo effects: Insights from social psychology. Am J Clin Hypnosis. 2013;55(3):236-248. doi: 10.1080/00029157.2012.740434 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 108.Agargun MY, Ozturk R, Cimen D. The Stanford hypnotic clinical scale for adults (SHCS): Validity and reliability of the Turkish version. Sleep Hypn. 2007;9(2):71-81. [Google Scholar]
- 109.Stern DB, Spiegel H, Nee JCM. The hypnotic induction profile: Normative observations, reliability and validity. Am J Clin Hypnosis. 1978;21(2-3):109-133. doi: 10.1080/00029157.1978.10403967 [DOI] [PubMed] [Google Scholar]
- 110.Gritzalis N, Oster M, Frischholz EJ. A concurrent validity study between the hypnotic induction profile (HIP) and the Stanford hypnotic clinical scale for adults (SHCS:A) in an inpatient sample: A brief report. Am J Clin Hypnosis. 2009;52(2):89-93. doi: 10.1080/00029157.2009.10401700 [DOI] [PubMed] [Google Scholar]
- 111.Orne MT, Hilgard ER, Spiegel H, et al. The relation between the hypnotic induction profile and the Stanford hypnotic susceptibility scales, Forms A and C. Int J Clin Exp Hypnosis. 1979;27(2):85-102. doi: 10.1080/00207147908407549 [DOI] [PubMed] [Google Scholar]
- 112.Alexander JE, Stimpson KH, Kittle J, Spiegel D. The hypnotic induction profile (HIP) in clinical practice and research. Int J Clin Exp Hypnosis. 2021;69(1):72-82. doi: 10.1080/00207144.2021.1836646 [DOI] [PubMed] [Google Scholar]
- 113.Lush P, Moga G, McLatchie N, Dienes Z. The Sussex-Waterloo Scale of Hypnotizability (SWASH): Measuring capacity for altering conscious experience. Neuroscience of Consciousness. 2018;2018(1):niy006. doi: 10.1093/nc/niy006 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Supplemental material, sj-docx-1-chp-10.1177_2515690X241274538 for Best Practice Recommendations for Conducting and Reporting Controlled Trials in Clinical Hypnosis Research by Zoltan Kekecs, Donald Moss, Peter J. Whorwell, Katalin Varga, Devin B. Terhune, Philip D. Shenefelt, Olafur S. Palsson, Giuseppe De Benedittis and Gary Elkins in Journal of Evidence-Based Integrative Medicine
