Introduction
Ioannidis (2016) has illustrated that the number of meta-analyses has proliferated over the last several decades. Indeed, the number of meta-analyses published annually has increased exponentially in this time (Papatheodorou, 2019), and the number of meta-analyses now likely exceeds the number of randomized trials published annually (Ioannidis, 2016). This mass production of meta-analyses is potentially harmful if a given meta-analysis's contributions and methods are not clearly differentiated from existing meta-analyses, because publishing redundant results can give a false impression that the literature is more robust than it actually is. This problem is especially concerning given that meta-analyses sit atop the “hierarchy of evidence” and carry substantial weight in decision making about evidence-based medicine and psychology (American Psychological Association, 2006; Murad et al., 2016).
Stapleton et al. (2023) meta-analysis entitled “Emotional freedom techniques for treating post traumatic stress disorder: an updated systematic review and meta-analysis,” used meta-analytic methods that notably overlap with a prior meta-analysis on emotional freedom techniques (EFT) for posttraumatic stress disorder (PTSD) by Sebastian and Nelms (2017). Although Stapleton et al. (2023) wrote that the prior meta-analysis warranted an update due to the “increase in research and time elapsed since the initial meta-analysis on EFT for PTSD” (p. 4), Table 1 shows that five of the six articles (83.3%) in the Stapleton meta-analysis were included in the Sebastian and Nelms meta-analysis, and the sixth article was published before the Sebastian and Nelms meta-analysis. Surprisingly absent is a reason why two primary studies (Church et al., 2012, 2018) included in the Sebastian and Nelms meta-analysis were not included in the Stapleton meta-analysis, as both primary studies appear to meet the only stated inclusion criteria of “an RCT investigating the use of EFT for treating the symptoms of trauma or PTSD” (Stapleton et al., 2023; p. 4). Thus, Stapleton et al. did not sufficiently support their claim that the elapsed time corresponded to an increase in research on EFT for PTSD.
Table 1.
Meta-analysis | ||
---|---|---|
Study | Stapleton et al. ( 2023 ) | Sebastian and Nelms ( 2017 ) |
Al-Hadethe et al. (2015) | Included | Not included |
Church et al. (2012) | Not included | Included |
Church et al. (2013) | Included | Included |
Church et al. (2016) | Included | Included |
Church et al. (2018) | Not included | Included |
Geronilla et al. (2016) | Included | Included |
Karatzias et al. (2011) | Included | Included |
Nemiro and Papworth (2015) | Included | Included |
Stapleton et al.'s meta-analytic methods were also virtually identical to those used in the Sebastian and Nelms meta-analysis. Both meta-analyses used standard methods to calculate a Cohen's d effect size from pre-treatment and post-treatment data from the EFT study conditions. A major difference in these two meta-analyses was that Stapleton et al. (2023) additionally calculated a Cohen's d effect size representing post-treatment data between EFT and waitlist conditions, but this was never acknowledged as a methodological strength or difference from the Sebastian and Nelms meta-analysis.
In addition to these methodological overlaps, Stapleton et al. stated that the studies included in their meta-analyses were randomized controlled trials “investigating the use of EFT for treating the symptoms of trauma or PTSD” (p. 4). However, they acknowledged in their limitations section that the “trials included in this meta-analysis all employed self-report measures to evaluate the presence of PTSD and reduction of symptoms” (p. 8). Such an approach to evaluate the presence of PTSD and its symptoms violates foundational practice in clinical psychology that requires an integration of multiple datapoints to warrant diagnosis, including a diagnostic clinical interview. The reliance on self-reported diagnoses and symptoms without the support of a clinical interview and other assessments prevents the authors from claiming that EFT affected PTSD or its symptoms.
Stapleton et al. (2023) made multiple inaccurate statements about EFT and its evidence base. In the introduction, the authors stated that EFT “utilizes techniques from both Cognitive Behavioral Therapy (CBT) and Prolonged Exposure therapy (PE)” (p. 2). This statement is inaccurate, considering that EFT has been repeatedly identified as a pseudoscientific and discredited therapy, and the proposed techniques in EFT do not actually resemble elements from CBT or PE (Norcross and Koocher, 2006; Boness et al., 2023). In the discussion, Stapleton et al. (2023) stated that the results of their meta-analysis indicated that EFT met the American Psychological Association's standards for empirically supported treatments, and that the current meta-analysis “demonstrated Clinical EFT to be an effective evidence-based treatment for PTSD” (p. 9). Both statements are misleading: EFT is not listed on the APA's website as an empirically supported treatment for treating PTSD or any other psychological disorder (www.psychologicaltreatments.org), and multiple independent research teams have discredited the methodological quality and conclusions of randomized controlled trials and meta-analyses on EFT (McCaslin, 2009; Bakker, 2013; Spielmans et al., 2020; Spielmans and Rosen, 2022; Boness et al., 2023). Thus, EFT does not actually meet APA Division 12 (Society of Clinical Psychology)'s standards for empirically supported treatments.
Stapleton et al. (2023) made at least one other inaccurate statement in their declaration of conflicts of interest. The first author declared that “she may lead clinical research trials in the topic.” Without context, it is not entirely clear what is the “topic.” We assume that the first author intends the topic to be EFT, as they write that the first author “does not conduct trials in the area of PTSD” on page 9. Furthermore, this conflict is understated as the first author writes that her “most significant contribution in her research life has been to lead world-first randomized clinical trials investigating Emotional Freedom Techniques” and described the results of that trial as “outstanding” (https://www.petastapleton.com/about). On that same webpage, the first author offers a paid EFT program titled “Emotional Freedom Techniques for Weight Management.” We are concerned that the first author did not disclose that they lead paid EFT trainings because the Frontiers in Psychology conflict of interest policy asks authors to declare “other relationships or activities that readers could perceive to have influenced, or that give the appearance of potentially influencing… submitted work.”
Finally, we wonder why a paper on EFT warrants publication in a psychology journal. EFT is predicated on mechanisms that are derived not from psychological science but rather from traditional Chinese medicine and theories of acupuncture (Ma et al., 2016). On page 3, Stapleton et al. themselves describe that “the stimulation of acupuncture points is the primary somatic ingredient of EFT,” and “a core concept of acupuncture is that stimulating electrically sensitive points on the skin sends impulses to related organs along ‘energy pathways' known as meridians.” To our knowledge, EFT is not compatible with any branch of science (Bakker, 2013).
For all the above reasons, we question the contribution of Stapleton et al. (2023) meta-analysis. We also believe it is harmful to individuals seeking treatment for PTSD, detrimental to the scientific understanding of PTSD and its treatment, and inconsistent with ethical practice in professional psychology. Individuals seeking treatment should consult the APA Division 12 website that currently supports CBT, PE, and cognitive processing therapy for PTSD (https://div12.org/treatments/?_sfm_related_diagnosis=8142). Principle C of the APA Ethics Code, Integrity, states that “Psychologists seek to promote accuracy, honesty, and truthfulness in the science, teaching, and practice of psychology” (p. 3–4). Stapleton et al.'s meta-analysis represents an inaccurate representation of PTSD treatments.
Author contributions
RP: Conceptualization, Writing – original draft, Writing – review & editing. CB: Conceptualization, Writing – original draft, Writing – review & editing. DT: Conceptualization, Writing – original draft, Writing – review & editing.
Funding Statement
The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. RP was partially supported by grants from the Tennessee Department of Mental Health and Substance Abuse Services and the International Center for Responsible Gaming. CB was partially supported by the National Institute on Alcohol Abuse and Alcoholism (K08030301).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
- Al-Hadethe A., Hunt N., Al-Qaysi G., Thomas S. (2015). Randomised controlled study comparing two psychological therapies for posttraumatic stress disorder (PTSD): emotional freedom techniques (EFT) vs. narrative exposure therapy (NET). J. Traumat. Stress Disord. Treat. 4:1000145. 10.4172/2324-8947.1000145 [DOI] [Google Scholar]
- American Psychological Association (2006). Evidence-based practice in psychology. Am. Psychol. 61, 271–285. 10.1037/0003-066X.61.4.271 [DOI] [PubMed] [Google Scholar]
- Bakker G. M. (2013). The current status of energy psychology: extraordinary claims with less than ordinary evidence. Clin. Psychol. 17, 91–99. 10.1111/cp.12020 [DOI] [Google Scholar]
- Boness C. L., Pfund R. A., Tolin D. F. (2023). Acupressure in psychotherapy as an unsinkable Rubber Duck: a reply to Feinstein (2023). J. Psychother. Integr. 10.31234/osf.io/jbrgu. [Epub ahead of print]. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Church D., Hawk C., Brooks A. J., Toukolehto O., Wren M., Dinter I., et al. (2013). Psychological trauma symptom improvement in veterans using emotional freedom techniques: a randomized controlled trial. J. Nerv. Mental Dis. 201, 153–160. 10.1097/NMD.0b013e31827f6351 [DOI] [PubMed] [Google Scholar]
- Church D., Piña O., Reategui C., Brooks A. (2012). Single-session reduction of the intensity of traumatic memories in abused adolescents after EFT: a randomized controlled pilot study. Traumatology 18, 73–79. 10.1177/1534765611426788 [DOI] [Google Scholar]
- Church D., Sparks T., Clond M. (2016). EFT (emotional freedom techniques) and resiliency in veterans at risk for PTSD: a randomized controlled trial. Explore 12, 355–365. 10.1016/j.explore.2016.06.012 [DOI] [PubMed] [Google Scholar]
- Church D., Yount G., Rachlin K., Fox L., Nelms J. (2018). Epigenetic effects of PTSD remediation in veterans using clinical emotional freedom techniques: a randomized controlled pilot study. Am. J. Health Promot. 32, 112–122. 10.1177/0890117116661154 [DOI] [PubMed] [Google Scholar]
- Geronilla L., Minewiser L., Mollon P., McWilliams M., Clond M. (2016). EFT (emotional freedom techniques) remediates PTSD and psychological symptoms in veterans: a randomized controlled replication trial. Energy Psychol. J. 8, 29–41. 10.9769/EPJ.2016.8.2.LG [DOI] [Google Scholar]
- Ioannidis J. P. A. (2016). The mass production of redundant, misleading, and conflicted systematic reviews and meta-analyses. Milbank Q. 94, 485–514. 10.1111/1468-0009.12210 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Karatzias T., Power K., Brown K., McGoldrick T., Begum M., Young J., et al. (2011). A Controlled comparison of the effectiveness and efficiency of two psychological therapies for posttraumatic stress disorder: eye movement desensitization and reprocessing vs. emotional freedom techniques. J. Nerv. Mental Dis. 199, 372–378. 10.1097/NMD.0b013e31821cd262 [DOI] [PubMed] [Google Scholar]
- Ma Y., Dong M., Zhou K., Mita C., Liu J., Wayne P. M. (2016). Publication trends in acupuncture research: a 20-year bibliometric analysis based on PubMed. PLoS ONE 11:e0168123. 10.1371/journal.pone.0168123 [DOI] [PMC free article] [PubMed] [Google Scholar]
- McCaslin D. L. (2009). A review of efficacy claims in energy psychology. Psychotherapy 46, 249–256. 10.1037/a0016025 [DOI] [PubMed] [Google Scholar]
- Murad M. H., Asi N., Alsawas M., Alahdab F. (2016). New evidence pyramid. Evid. Based Med. 21, 125–127. 10.1136/ebmed-2016-110401 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nemiro A., Papworth S. (2015). Efficacy of two evidence-based therapies, emotional freedom techniques (EFT) and cognitive behavioral therapy (CBT), for the treatment of gender violence in the congo: a randomized controlled trial. Energy Psychol. Theory Res. Treat. 7, 13–25. 10.9769/EPJ.2015.7.2.AN [DOI] [Google Scholar]
- Norcross J. C., Koocher G. P. (2006). Discredited psychological treatments and tests: a Delphi Poll. Prof. Psychol. 37, 515–522. 10.1037/0735-7028.37.5.515 [DOI] [Google Scholar]
- Papatheodorou S. (2019). Umbrella reviews: what they are and why we need them. Eur. J. Epidemiol. 34, 543–546. 10.1007/s10654-019-00505-6 [DOI] [PubMed] [Google Scholar]
- Sebastian B., Nelms J. (2017). The effectiveness of emotional freedom techniques in the treatment of posttraumatic stress disorder: a meta-analysis. Explore 13, 16–25. 10.1016/j.explore.2016.10.001 [DOI] [PubMed] [Google Scholar]
- Spielmans G. I., Rosen G. M. (2022). Corrigendum compounds errors and again fails to support the specificity of acupoint tapping. J. Nerv. Mental Dis. 210, 139–142. 10.1097/NMD.0000000000001376 [DOI] [PubMed] [Google Scholar]
- Spielmans G. I., Rosen G. M., Spence-Sing T. (2020). Tapping away at a misleading meta-analysis: no evidence for specificity of acupoint tapping. J. Nerv. Mental Dis. 208, 628–631. 10.1097/NMD.0000000000001181 [DOI] [PubMed] [Google Scholar]
- Stapleton P., Kip K., Church D., Toussaint L., Footman J., Ballantyne P., et al. (2023). Emotional freedom techniques for treating post traumatic stress disorder: an updated systematic review and meta-analysis. Front. Psychol. 14:1195286. 10.3389/fpsyg.2023.1195286 [DOI] [PMC free article] [PubMed] [Google Scholar]