Abstract
Background
This study evaluates the reporting quality of randomized controlled trials (RCTs) on acupuncture use for the treatment of postherpetic neuralgia and explores related factors.
Methods
The following six databases PubMed, Embase, Cochrane Library, VIP, CNKI, and SinoMed, were systematically searched from their inception to December 2018. RCTs using acupuncture as an intervention for postherpetic neuralgia were selected and incorporated in this study. The reporting quality was assessed based on the CONSORT statement and the STRICTA guidelines. Regression analyses were also conducted on pre-specified study characteristics searching for factors associated with reporting quality.
Results
A total of 137 RCTs were included in this study. The CONSORT based median OQS was 12 (minimum 3, maximum 29). Of the items comprised in the statement, ten were sufficiently reported (reported in over 70% of trials). The remaining fifty-five items were poorly reported (reported by fewer than 5% of trials). The STRICTA based median OQS was 9 (minimum 2, maximum 15). The results showed that eight of the comprised items were well reported (reported in over 70% of trials), and only three were incompletely reported (reported in fewer than 20% of trials). Based on the CONSORT statement related analysis, a post-2010 publication (β coefficient 2.394, 95% confidence interval [CI] 1.168–3.620) and funding (β coefficient 4.456, 95% CI: 3.009–5.903) represented independent and significant predictors of a high overall reporting quality. However, only a funding source (β coefficient 1.305, 95% CI 0.219–2.391) was associated with an increased OQS based on STRICTA analysis.
Conclusion
The findings indicated that RCTs on acupuncture for PHN generally had a sub-optimal reporting quality, a situation that improved for those published after 2010 or with funding sources. Therefore, rigorous adherence to the CONSORT statement and the STRICTA guidelines should be emphasized in future studies.
Keywords: randomized controlled trials, acupuncture, postherpetic neuralgia, CONSORT, STRICTA
Introduction
Postherpetic neuralgia (PHN) is one of the most common complications of herpes zoster.1 It is defined as neuropathic pain persisting for 90–120 days after the acute phase of VZV reactivation.2 It is estimated that 10–15% of patients who have shingles will experience PHN.3 However, the incidence of PHN could be as high as 83% among over 50 years old patients.4 PHN has been considered a health care problem due to its severity, chronicity,5 and the resulting poor quality of life.6 Tricyclic antidepressants, such as gabapentin and pregabalin, are recommended as first-line treatments for PHN.7 However, a high incidence of adverse events such as dizziness, somnolence, fatigue, and ataxia remains refractory.5 Most importantly, the effectiveness of pharmacologic therapies remains limited,8 with satisfactory analgesia in only 50% of patients.9,10
Owing to the significant health risks of PHN and the limitations of currently available conventional therapies, complementary and alternative medicine (CAM), due to their significant analgesic effects,11 have received much attention worldwide.
As a widely-used CAM, acupuncture is generally considered to be safe and effective in different chronic pain conditions.12 Recent years have seen many clinical trials reporting the effects of acupuncture in PHN management.13 Among these clinical trials, randomized controlled trials (RCTs) are considered to have the optimal study design.14 A meta-analysis of these RCTs reported that acupuncture is a safe and effective procedure for the management of PHN.13 However, inappropriate study methodology with incomplete reporting is the Achilles’ heel of those RCTs, and significantly affect their reliability and validity.15
The Consolidated Standards of Reporting Trials (CONSORT) statement, developed in 2001 and revised in 2010,16,17 provides guidelines for the identification of biased results and improvement of trial reporting. Its purpose is to facilitate the assessment and interpretation of RCTs.18 While as the Standards for Reporting Interventions in Controlled Trials of Acupuncture (STRICTA) guidelines, drafted in 2001 and revised in 2010,19,20 serve as an extension of the CONSORT statement. The combination of these two sets of guidelines has been used worldwide to assess the completeness as well as the transparency of RCTs for reporting acupuncture interventions.21–23
This study not only assesses the extent to which current RCTs examining acupuncture for PHN comply with the CONSORT statement and the STRICTA guidelines but also explores factors associated with reporting quality. The main goals are to reveal the present compliance status of RCTs on the use of acupuncture for PHN with the above guidelines and to provide ideas for facilitating and improving reporting quality of RCTs in that field for better and reliable medical decisions.
Methods
Included studies
All RCTs examining the effect of acupuncture interventions for PHN were assessed for inclusion. Non-randomized, cross-over clinical trials, case-control studies, retrospective studies, animal experiments, case reports, and reviews were excluded.
Participants
All study subjects with a clinical diagnosis of PHN were included regardless of age, sex, occupation, or other demographic factors. PHN was clinically diagnosed according to the observed signs and symptoms (eg, pain persisting for three months or more after herpes zoster infection) or recognized diagnostic standards.24,25
Interventions and comparisons
Acupuncture is defined as manual or electronic stimulations due to filiform needle penetration of the body, scalp, or auricular acupoints regardless of diameter, length, manufacturer, or material.26,27 Only studies using acupuncture alone or in combination with other interventions (eg, acupuncture-related treatment, drugs, Chinese herbal medicine, physical therapy) were included. Studies testing non-filiform-needle-penetration (eg, acupoint injection, bleeding with plum-blossom needles) as a primary intervention were excluded. Any additional comparisons in the control groups were considered as acceptable.
Search strategy
The following six databases China National Knowledge Infrastructure (CNKI), Wanfang, Chinese VIP Information (VIP), Cochrane Library, Embase and PubMed, were searched from the date of their inception to December 2018. Combinations of the MeSH terms “neuralgia, postherpetic”, “acupuncture therapy” and text words “postherpetic neuralgia”, “herpes zoster”, “shingles”, “acupuncture”, “electroacupuncture”, “pricking”, “needling”, “meridian”, “acupoint”, “randomized controlled trial”, and “RCTs” were searched. Languages were restricted to Chinese and English.
Data extraction
Duplicate records were initially identified and removed by one of the reviewers using EndNote X8. The abstracts screening was independently performed by both reviewers (Luo and Chen) looking for potentially eligible studies. They subsequently read the full texts for potential inclusion. Disagreements, if any, were resolved through mediation with a third reviewer (Lu). A fourth reviewer (Pei) extracted the relevant information such as eligibility criteria, publication year, number of centers, and sample size.
Evaluation of reporting quality
Overall reporting quality rating
Two reviewers Liu and Zeng used the CONSORT and STRICTA statements to independently assessed the reporting quality of included RCTs. Cohen’s κ-statistic was calculated to evaluate the degree of agreement between the two evaluators. A κ of 0.40 or lower, between 0.40 and 0.60, between 0.60 and 0.80 and from 0.80 to 1.00 were considered as poor, moderate, substantial and “good” or “perfect” agreements respectively. Cohen’s κ-statistical analysis was performed using STATA 13.0.
The overall quality score (OQS) was used for the comprehensive quality evaluation of the included RCTs. Thirty-seven items were scored based on the CONSORT 2010, and seventeen items were scored based on the STRICTA statements. For the calculation of the OQS, one point was scored if the item related information was stated, and zero points if it was either not addressed or unclear.
OQS was used as a dependent variable to explore factors relevant to the reporting quality. Only significant variables (p≤0.10) in the univariate analysis were included in the multivariate regression model (p≤0.05).28
Key methodological items rating
Randomization, allocation concealment, blinding, baseline characteristics, and intent-to-treat (ITT) analysis are the five major methodological items included in the 2010 CONSORT guidelines.28 They are each related to factors that could potentially cause bias and were consequently evaluated in each study. A combined key methodological index score (MIS) was calculated for each study by adding the scores of these five factors. One point score was assigned for each reported item and a score of zero when the subsequent item is not reported or uncertain.
MIS was used as an outcome variable in the regression analysis to search for factors related to methodological quality. We regarded MIS as count data and relied on an ordinal regression model. Linear and ordinal regression analyses were performed using SPSS 21.0.
Results
Reports selection
The initial search identified a total of 3,609 relevant reports among which, 670 were retained after titles and abstracts screening. A total of 137 eligible RCTs were ultimately extracted for analysis (Additional file 2). Search terms for each database are customized and shown in Additional file 1. The general characteristics of the included RCTs are indicated in Additional file 3. Figure 1 outlines the RCTs search and selection process.
Figure 1.
Flow chart of the performed search and selection process.
Characteristics of included trials
Thirty-two (23.4%) and 105 (76.6%) RCTs were published in the early periods (1983–2009) and the late periods (2010–2018), respectively. All included articles were written in English (2%) and in Chinese (98%). The sample size ranged from 24 to 211 (median: 68). One hundred and thirty-two (96%) were single-centered trials with 23 (17%) being funded. No trials reported a registration or study protocol (Table 1).
Table 1.
General characteristics of included RCTs
| Features of included RCTs | N | ％ (n/137) |
|---|---|---|
| Publication year | ||
| Before 2010 | 32 | 23% |
| After 2010 | 105 | 77% |
| Sample size [Median (IQR)] | 68 (60–87) | |
| <80 | 91 | 66% |
| ≧80 | 46 | 34% |
| Research centers | ||
| Single center | 132 | 96% |
| Multi-center | 5 | 4% |
| Number of arms | ||
| 2 arms | 124 | 91% |
| >2 arms | 13 | 9% |
| The main effect of the primary outcome | ||
| Significant | 127 | 93% |
| Insignificant | 10 | 7% |
| Sources of funding | ||
| Not-for-profit funding | 23 | 17% |
| For-profit funding | 0 | 0 |
| Clearly stated, not funded | 0 | 0 |
| Not reported | 114 | 83% |
| Was a protocol mentioned? | ||
| Yes | 0 | 0 |
| No | 137 | 100% |
| Was the study registered? | ||
| Yes | 0 | 0 |
| No | 0 | 0 |
| Not reported | 137 | 100% |
Reporting quality evaluation
Overall reporting quality rating using the CONSORT and STRICTA checklists
As presented in Table 2, the analysis based on the CONSORT statement showed a sub-optimal reporting quality for the included RCTs. Among the 37 items of the CONSORT checklist, only ten were sufficiently reported (reported in more than 70% of trials). The remaining fifty-five items were poorly reported (reported by fewer than 5% of trials). Items related to the “structured summary”, “trial design”, “eligibility criteria”, “settings and locations”, “interventions”, “outcomes”, “recruitment and follow-up”, “participants randomly assigned”, “participants included in analysis” and “results for outcomes” sections were well reported while as those in the “title”, “changes to methods”, “changes to outcomes”, “sample size”, “interim analyses”, “type of randomization”, “implementing”, “random allocation sequence”, “blinding”, “additional analyses”, “reasoning for ending”, “absolute and relative effect sizes”, “ancillary analyses”, ‘registration ‘and “full trial protocol” sections were poorly reported. The overall median OQS was 11, ranging from 3 to 29. Item number 5 (Table 2) had a poor degree of agreement, while as 11b had a “moderate” degree of agreement. Items 2a, 2b, 20 and 22 had a “substantial” degree of agreement. The remaining others had a “good” or “perfect” degrees of agreement.
Table 2.
Compliance of reporting to the CONSORT checklist
| Items | n | ％ (n/137) | Cohen’s к | 95% CI | |
|---|---|---|---|---|---|
| Coefficient | |||||
| 1a | Identification as a randomized trial in the title. | 2 | 1 | 1 | [0.00–0.03] |
| 1b | Structured summary of trial design, method, results, and conclusions (for specific guidance see CONSORT for abstracts). | 126 | 92 | 1 | [0.87–0.97] |
| 2a | Scientific background and explanation of rationale. | 19 | 14 | 0.5 | [0.08–0.20] |
| 2b | Specific objectives or hypotheses. | 13 | 9 | 0.56 | [0.05–0.14] |
| 3a | Description of trial design (such as parallel, factorial) including allocation ratio. | 124 | 91 | 0.93 | [0.86–0.96] |
| 3b | Important changes made to the method after the trial commencement (such as eligibility criteria), with reason. | 1 | 1 | 1 | [0.00–0.02] |
| 4a | Eligibility criteria for participants. | 112 | 82 | 0.91 | [0.75–0.88] |
| 4b | Settings and locations where the data were collected. | 123 | 90 | 0.79 | [0.85–0.95] |
| 5 | Sufficient details of each intervention, including how and when they were administered to allow replication. | 132 | 96 | 0.27 | [0.93–1.00] |
| 6a | Defined pre-specified primary and secondary outcome measures, including how and when they were assessed. | 97 | 71 | 0.72 | [0.63–0.79] |
| 6b | Any changes to trial outcomes after the beginning of the trial, and the reasons. | 2 | 1 | 1 | [0.01–0.03] |
| 7a | How was the sample size determined. | 1 | 1 | 1 | [0.01–0.02] |
| 7b | Explanation of any interim analyses and stopping guidelines when applicable. | 2 | 1 | 1 | [0.01–0.03] |
| 8a | Methods used to generate the random allocation sequence. | 23 | 17 | 0.84 | [0.10–0.23] |
| 8b | Type of randomization; details of any restrictions (such as blocking and block size). | 1 | 1 | 1 | [0.01–0.02] |
| 9 | The mechanism used to implement the random allocation sequence (such as sequentially numbered containers), description of any steps taken to conceal the sequence until the assignment of interventions. | 6 | 4 | 1 | [0.01–0.08] |
| 10 | Who had generated the random allocation sequence, who had enrolled participants, and who had assigned participants to the interventions. | 2 | 1 | 1 | [0.01–0.03] |
| 11a | Who had been blinded (for example, participants, care providers, those assessing outcomes) and how. | 5 | 4 | 1 | [0.00–0.07] |
| 11b | Description of the similarity of interventions if relevant. | 23 | 17 | 0.44 | [0.10–0.23] |
| 12a | Statistical methods used to compare the primary and secondary outcomes in each group. | 77 | 56 | 0.76 | [0.48–0.65] |
| 12b | Methods for additional analyses, such as subgroup analyses and adjusted analyses. | 2 | 1 | 1 | [0.01–0.03] |
| 13a | For each group, the numbers of randomly assigned participants, whether they received the intended treatment, and whether the primary outcome was analyzed. | 135 | 99 | 0.8 | [0.97–1.01] |
| 13b | Losses and exclusions after randomization in each group and the corresponding reasons. | 13 | 9 | 0.89 | [0.05–0.14] |
| 14a | Dates defining the periods of recruitment and follow-ups. | 106 | 77 | 1 | [0.70–0.84] |
| 14b | The reason why the trial was stopped or terminated. | 1 | 1 | 1 | [0.01–0.02] |
| 15 | A table showing baseline demographics and clinical characteristics for each group. | 20 | 15 | 1 | [0.09–0.21] |
| 16 | For each group, the number of participants (denominator) included in each analysis and whether the analysis had been performed by the originally assigned groups. | 121 | 88 | 0.87 | [0.83–0.94] |
| 17a | The primary and secondary outcomes result for each group, the estimated effect size and its precision (such as 95% confidence interval). | 137 | 100 | 1 | 1 |
| 17b | The presentation of both absolute and relative effect sizes was recommended for binary outcomes. | 0 | 0 | 0 | 1 |
| 18 | Results of any other performed analysis, including subgroup analysis and adjusted analysis, distinguishing the pre-specified from the exploratory. | 1 | 1 | 1 | [0.00–0.02] |
| 19 | All important adverse or unintended effects in each group (for specific guidelines see CONSORT for adverse effects) | 29 | 21 | 0.91 | [0.14–0.28] |
| 20 | Trial limitations, addressing sources of potential bias, imprecision, and, if relevant, multiplicity of analyses | 12 | 9 | 0.52 | [0.04–0.14] |
| 21 | Generalisability (external validity, applicability) of the trial findings | 76 | 55 | 0.9 | [0.47–0.64] |
| 22 | Interpretation consistent with results, balancing benefits and side effects, and considering other relevant evidence | 35 | 26 | 0.69 | [0.18–0.33] |
| 23 | Registration number and name of trial registry | 0 | 0 | 1 | 1 |
| 24 | Where the full trial protocol can be accessed, if available | 1 | 1 | 1 | [0.01–0.02] |
| 25 | Sources of funding or other supports (such as drug supply), role of funders | 23 | 17 | 1 | [0.10–0.23] |
The analysis indicated that the STRICTA checklist items are mostly well reported. Among the 17 items, eight had an excellent report rate (reported in over 70% of trials), and only three items were incompletely reported (reported in fewer than 20% of trials). Items such as “acupuncture style”, “reasoning for treatment”, “names of points”, “needle stimulation”, “needle retention time”, “numbers of treatment session”, “frequency and duration of treatment session”, and “details of other interventions” had positive rates as higher as 70%. Meanwhile, Items under the extent to which treatment was varied, setting and context of treatment, and qualification of acupuncturists sections had below 20% positive rates. Details related to acupuncture interventions were sufficiently described in most RCTs. The overall median OQS was 9, with a minimum of 2 and a maximum of 15. Most of the items had “good” or “perfect” degrees of agreement (Table 3).
Table 3.
Reporting compliance to the STRICTA checklist
| Items | n | ％ (n/137) | Cohen’s к | 95% CI | |
|---|---|---|---|---|---|
| Coefficient | |||||
| 1. Acupuncture rationale (explanations and examples) | 1a) Style of acupuncture (eg, Traditional Chinese Medicine, Japanese, Korean, Western medical, Five Element, ear acupuncture). | 134 | 98 | 1 | [0.95–1.00] |
| 1b) Reasoning for provided treatment, based on historical context, literature sources, or consensus methods, with references where appropriate. | 125 | 91 | 0.59 | [0.86–0.96] | |
| 1c) Extent to which treatment varied. | 0 | 0 | 1 | [0.00–0.01] | |
| 2. Details of needling (explanations and examples) | 2a) Number of needle insertions per subject per session (mean and range where relevant). | 51 | 37 | 0.86 | [0.29–0.45] |
| 2b) Names (or location if there was no standard name) of points used (uni/bilateral). | 130 | 95 | 0.7 | [0.91–0.99] | |
| 2c) Depth of insertion, based on a specified unit of measurement, or on a particular tissue level. | 62 | 45 | 0.88 | [0.37–0.54] | |
| 2d) Response sought (eg, de qi or muscle twitch response). | 50 | 36 | 0.79 | [0.28–0.45] | |
| 2e) Needle stimulation (eg, manual, electrical). | 106 | 77 | 0.86 | [0.70–0.84] | |
| 2f) Needle retention time. | 112 | 82 | 1 | [0.75–0.88] | |
| 2g) Needle type (diameter, length, and manufacturer or material). | 62 | 45 | 0.86 | [0.37–0.54] | |
| 3. Treatment regimen (Explanations and examples) | 3a) Number of treatment sessions. | 112 | 82 | 0.82 | [0.75–0.88] |
| 3b) Frequency and duration of treatment sessions | 118 | 86 | 0.76 | [0.80–0.92] | |
| 4. Other components of treatment (explanations and examples) | 4a) Details of other interventions administered to the acupuncture group (eg, moxibustion, cupping, herbs, exercises, lifestyle change). | 102 | 74 | 0.8 | [0.67–0.82] |
| 4b) Setting and context of treatment, including instructions to practitioners, information and explanations to patients. | 7 | 5 | 0.87 | [0.01–0.09] | |
| 5. Practitioner background (explanations and examples) | 5) Description of participating acupuncturists (qualifications or professional affiliations, years in acupuncture practice, other relevant experiences). | 1 | 1 | 1 | [0.01–0.02] |
| 6. Control or comparator interventions (explanations and examples) | 6a) The rationale for the control or comparator in the context of the research question, with sources that justify this choice. | 47 | 34 | 0.73 | [0.26–0.42] |
| 6b) A precise description of the control or comparator. If sham acupuncture or any other type of acupuncture-like control was used, provide details as in items 1–3 above. | 32 | 23 | 0.78 | [0.16–0.31] |
Factors associated with reporting quality
The univariate analysis results indicated that the numbers of centers, the publishing year and the funding source were associated with a higher total score based on the CONSORT statement. After adjustment, the author’s affiliation, the year, the center, and the funding source were included in the multivariate linear regression analyses. Results showed that RCTs published after 2010 (β coefficient 2.394, 95% confidence interval (CI) 1.168–3.620) and supported by a funding source (β coefficient 4.456, 95% CI: 3.009–5.903) remained independent and were significant predictors of overall reporting quality. As shown in Figure 2, mean scores of studies after 2010 are higher than those of before 2010. The CONSORT statement OQS mean OQS increased by 2.394 for articles published after 2010, and by 4.456 for those supported by a funding source (Table 4).
Figure 2.
Distribution of RCT scores with complete reporting of the CONSORT statement items. The blue and red bars represent the before and after 2010 RCT score means according to the CONSORT statement, with 95% CI.
Table 4.
Factors associated with OQS based on the CONSORT statement
| Variables | Univariate analysis | P | Multivariate analysis | P |
|---|---|---|---|---|
| Coefficient (95% CI) | Coefficient (95% CI) | |||
| Main effect of the primary outcome | 1.833 (−0.570–4.236) | 0.134 | / | |
| Significant vs non-significant | ||||
| Author’s affiliation | −1.896 (−3.832–0.040) | 0.055 | −1.131 (−2.780to 0.518) | 0.177 |
| Hospital vs other | ||||
| Center | 2.699 (1.042–4.356) | 0.002 | 1.306 (−0.1476to 2.760) | 0.078 |
| Multicenter vs single center | ||||
| Sample size | 0.418 (−0.915–1.751) | 0.536 | / | |
| <80 vs ≧80 | ||||
| Year | 2.627 (1.206–4.048) | <0.001 | 2.394 (1.168–3.620) | <0.001 |
| Before 2010 vs after 2010 | ||||
| Funding | 5.323 (3.901–6.746) | <0.001 | 4.456 (3.009–5.903) | <0.001 |
| yes vs no |
The univariate analysis showed that only funding source (β coefficient 1.305, 95% CI 0.219–2.391) was associated with an increase in STRICTA guideline related OQS. Furthermore, the STRICTA guideline OQS mean rose by 1.305 for articles with funding sources (Table 5). As shown in Figure 3 and according to the STRICTA guideline based assessments, there are no significant differences between mean scores of studies before 2010 and those after 2010.
Table 5.
Factors associated with OQS based on the STRICTA checklist
| Variables | Univariate analysis | P |
|---|---|---|
| Coefficient (95% CI) | ||
| The main effect of the primary outcome | 1.153 (−0.428–2.733) | 0.152 |
| Significant vs insignificant | ||
| Author’s affiliation | −0.771 (−2.054–0.512) | 0.237 |
| Hospital vs other | ||
| Center | −0.716 (−1.840–0.408) | 0.21 |
| Multicenter vs single center | ||
| Sample size | −0.132 (−1.009–0.745) | 0.766 |
| <80 vs ≧80 | ||
| Year | −0.114 (−1.093–0.865) | 0.818 |
| Before 2010 vs after 2010 | ||
| Funding | 1.305 (0.219–2.391) | 0.019 |
| Yes vs no |
Figure 3.
Distribution of RCT scores with complete reporting of the STRICTA checklist items. The blue and red bars represent the before and after 2010 RCT score means with 95% CI according to the STRICTA checklist.
As for the MIS, the ordinal regression analysis showed that no variables were associated with better methodological quality (P>0.05).
Discussion
To our knowledge, this study is the first to systematically assess the extent of compliance of RCTs on the use of acupuncture for PHN with reporting guidelines.
One hundred and thirty-seven trials were assessed, indicating that a considerable number of essential items are incomplete or omitted. This may substantially impact the internal validity assessment and the applicability of the trial results. These findings are consistent with results of previous studies examining RCTs’ adherence to the CONSORT and STRICTA statements in various fields including acupuncture.21,22
The results showed that only ten of the items on the CONSORT statement has sufficient data, while fifteen others were incompletely reported. The under-reported items, similar to previous reports,29 are particularly those related to key methodological domains such as the type of randomization, the generation of random allocation sequences, the allocation concealment, and blinding. These items are crucial for bias risk assessment and subsequently, the weighing of effects reliability and adaptability. Indeed, previous studies have indicated an overestimation of treatment effects in trials with inadequate blinding or inadequate randomization concealment.30 Additionally, considering the subjectivity and susceptivity of pain assessment, rigorous designs and better implementation of interventions are necessary for the avoidance of result exaggeration or overestimation.31
Consistent with previous studies,27,31 the assessment also showed that the most under-reported items are those in the following sections: changes to the method, calculation of sample size, losses and exclusions, other analyses, registry, and protocol. Standard adherence requires that any changes made to the initial method or outcome should be demonstrated and explained to guarantee the value and validity of the study results. Moreover, sample size calculation is required for the statistical consideration of differences in therapeutic effects and clinical significance. Even though losses and exclusions might result in deviations from the predetermined number of participants, measures (intention-to-treat, ITT)32 can be taken to lower the occurrence of related bias. Additionally, subgroup or adjusted analyses could help eliminate several confounders by providing supplemental information. However, to avoid misleading or confusing readers, results of subgroup analyses should not be reported as substitutes to the main results. Therefore, knowledge of the pre-established RCT protocols is essential for a clear understanding of the reasons and purposes of any additional group analysis.
The STRICTA checklist assessment indicated a moderate reporting quality with the majority of the items being accounted for at the exception of those related to the following sections: the extent to which treatment varied, the number of needles, response sought, setting and context, acupuncture rationale and practitioner background. As shown by previous studies conducted by Zhuang and You,28,31 details describing acupoints location, needle retention time, and needle stimulation are crucial and provide valuable references for clinicians. What’s more, items reporting the reasoning behind the choice of treatment or style of acupuncture are also important for the determination of suitability or future clinical implementation of that technique. Unfortunately, as seen in Table 5, items related to contextual factors (items 4b and 5) and practitioner qualifications were severely lacking. This may have a significant impact on the validity and safe implementation of those interventions. In practice, acupuncture is a practitioner-dependent, experience-required, and non-pharmacological intervention. This means inadequate reporting of items or details related to the manipulation and technique is a barrier for future replication. Thus, it is never too late to emphasize a complete adherence to the STRICTA guidelines during design, implementation, and reporting of acupuncture RCTs to guarantee the generalization and the reliability of the obtained results.
In compliance with earlier publications,28 the regression analysis suggested that post-2010 publication years represent an independent predictor of high reporting quality.28 This is indicative of an increase in awareness and adoption of the CONSORT statement since it was drafted and revised. This might be partially attributed to the emphasis made on RCTs designs and implementation, and stricter peer-review processes during the recent nine years. However, no correlation was identified between the year of publication and OQS in the STRICTA guidelines evaluation. One possible explanation might be that authors are accustomed to a flexible style for the description of their study due to the diversity in style, the complexity, and specificity of acupuncture manipulation. Compared to the CONSORT statement, the STRICTA checklists are insufficiently emphasized among researchers and journal editors, rendering their popularization and implementation problematic.
Additionally, in agreement with previous reports,33 the analysis of both CONSORT and STRICTA guidelines suggested that clinical trials with funding had better study design and higher reporting quality. This is because they have sufficient financial support and competent members.
Strengths and limitations of the current study
To our knowledge, this study is the first to perform a systematic CONSORT statement and STRICTA guidelines adherence assessment of available RCTs on acupuncture for PHN management. It is the result of an extensive search and rigorous assessments based on both checklists and provides further evidence of the association between the two guidelines OQS and the methodological quality of the study. Such findings are important and provide insight into the complexity of methodological issues in clinical trials, especially those related to acupuncture and pain, considering the occurrence of conflicting findings among RCTs. For example, how can bias produced by subjectivities in pain measurement be reduced, and whether an insignificant outcome has any clinical implications?
This study has several limitations such as: first, articles published in languages other than Chinese or English were not included. Acupuncture is a well-known pain management option and might have been subject to research in various languages. Therefore, whether the inclusion of those published reports would have altered the results of assessment and analysis remains unknown. Second, as mentioned by a previous study,29 equal weights were assumed during the calculation of the overall quality score (OQS) even though those checklist items may have varying weights. Third, according to available studies,22 more factors such as the author’s expertise and the publication language should have been considered in the linear regression model. However, as shown in File 3, no author was identified as having statistics-related expertise, and only two articles were published in English. Nevertheless, this study achieved its preliminary objective by successfully evaluating the reporting quality of RCTs on the use of acupuncture for the management of PNH.
Conclusion
Our study revealed suboptimal reporting qualities for RCTs using acupuncture for PHN management. Most trials failed to mention crucial methodological data, registration information, the rationale behind the choice of acupuncture or comparable treatments, the acupuncturist qualification, and the treatment context. However, the findings indicated higher reporting quality in RCTs with funding sources or published after 2010. Therefore, more effort is needed for strict adherence to the CONSORT statement and STRICTA guidelines.
Acknowledgments
This research was supported by the National Natural Science Foundation of China (grant no. 81574061), the Innovative Research Fund of the First Affiliated Hospital of Guangzhou University of Chinese Medicine (No. 2019QN23) and the Guangdong Science and Technology Commission Foundation (No. 2017A020213019). The funders did not play any role in the study design, the data collection, interpretation, and analysis, the preparation of the manuscript, or the decision to publish.
Disclosure
The authors report no conflicts of interest in this work.
References
- 1.Solomon CG, Johnson RW, Rice AS. Postherpetic neuralgia. N Engl J Med. 2014;371:1526e1533. doi: 10.1056/NEJMoa1410490 [DOI] [PubMed] [Google Scholar]
- 2.Cohen JI. Clinical practice: herpes zoster. N Engl J Med. 2013;369:255e263. doi: 10.1056/NEJMcp1302674 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.US Food and Drug Administration (FDA). FDA Approves New Drug Treatment for Long-Term Pain Relief after Shingles Attacks. MD: Silver Spring; 2009. [Google Scholar]
- 4.Yawn BP, Saddier P, Wollan PC, St Sauver JL, Kurland MJ, Sy LS. A population-based study of the incidence and complication rates of herpes zoster before zoster vaccine introduction. Mayo Clin Proc. 2007;82:1341–1349. doi: 10.4065/82.11.1341 [DOI] [PubMed] [Google Scholar]
- 5.Baron R, Wasner G. Prevention and treatment of postherpetic neuralgia. Lancet. 2006;367:186–188. doi: 10.1016/S0140-6736(06)68010-0 [DOI] [PubMed] [Google Scholar]
- 6.Ghanavatian S, Wie CS, Low RS, et al. Premedication with gabapentin significantly reduces the risk of postherpetic neuralgia in patients with neuropathy. Mayo Clin Proc. 2019;01:1–6. [DOI] [PubMed] [Google Scholar]
- 7.Argoff CE. Review of current guidelines on the care of postherpetic neuralgia. Postgrad Med. 2011;123:134–142. doi: 10.3810/pgm.2011.09.2469 [DOI] [PubMed] [Google Scholar]
- 8.Friesen KJ, Falk J, Alessi-Severini S, Chateau D, Bugden S. Price of pain: population-based cohort burden of disease analysis of medication cost of herpes zoster and postherpetic neuralgia. J Pain Res. 2016;9:543–550. doi: 10.2147/JPR.S107944 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Rice AS, Maton S, Postherpetic Neuralgia Study Group. Gabapentin in postherpetic neuralgia: a randomised, double blind, placebo controlled study. Pain. 2001;94:215–224. [DOI] [PubMed] [Google Scholar]
- 10.Goßrau G. Postherpetic neuralgia. Schmerz. 2014;28:93–102. doi: 10.1007/s00482-013-1346-6 [DOI] [PubMed] [Google Scholar]
- 11.Avijgan M, Hajzargarbashi ST, Kamran A, Avijgan M. Postherpetic neuralgia: practical experiences return to traditional Chinese medicine. J Acupunct Meridian Stud. 2017;10(3):157e164. doi: 10.1016/j.jams.2017.02.003 [DOI] [PubMed] [Google Scholar]
- 12.Toroski M, Nikfar S, Mojahedian MM, Ayati MH. Comparison of the cost-utility analysis of electroacupuncture and nonsteroidal antiinflammatory drugs in the treatment of chronic low back pain. J Acupunct Meridian Stud. 2018;11(2):62–66. doi: 10.1016/j.jams.2018.01.003 [DOI] [PubMed] [Google Scholar]
- 13.Wang Y, Li W, Peng W. Acupuncture for postherpetic neuralgia: systematic review and meta-analysis. Medicine. 2018;97:34. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Son C. Overview for pattern and results of moxibustion-derived clinical trials. J Meridian Acupoint. 2009;26:41–49. [Google Scholar]
- 15.Chung W, Lee KW, Hwang IH, Lee DH, Kim SY. Quality assessment of randomized controlled trials in the journal of the Korean academy of family medicine. Korean J Fam Med. 2009;30:626–631. doi: 10.4082/kjfm.2009.30.8.626 [DOI] [Google Scholar]
- 16.Moher D, Schulz KF, Altman DG. The CONSORT statement: revised recommendations for improving the quality of reports of parallel group randomized trials. BMC Med Res Methodol. 2001;1:2. doi: 10.1186/1471-2288-1-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Schulz KF, Altman DG, Moher D, et al. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c332. doi: 10.1136/bmj.c293 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Park J, Kang K, Choi S. Assessing methodological quality of acupuncture clinical trials of Korea. J Korean Acupunct Moxibust Soc. 2007;24:127–135. [Google Scholar]
- 19.MacPherson H, White A, Cummings M, Jobst K, Rose K, Niemtzow R. Standards for reporting interventions in controlled trials of acupuncture: the STRICTA recommendations. Complement Ther Med. 2001;9:246–249. doi: 10.1054/ctim.2001.0488 [DOI] [PubMed] [Google Scholar]
- 20.MacPherson H, Altman DG, Hammerschlag R, et al. Revised Standards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA): extending the CONSORT statement. PLoS Med. 2010;7:e1000261. doi: 10.1371/journal.pmed.1000261 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Zeng J, Lin G, Lixia L, et al. Assessment of reporting quality in randomised controlled trials of acupuncture for post-stroke rehabilitation using the CONSORT statement and STRICTA guidelines. Acupunct Med. 2016;35:1–7. [DOI] [PubMed] [Google Scholar]
- 22.Jia P, Tang L, Yu J, Liu J, Kang D, Sun X. The quality of reporting in randomized controlled trials of acupuncture for knee osteoarthritis: A cross-sectional survey. PLoS One. 2018;13(4):e0195652. doi: 10.1371/journal.pone.0195652 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Kim KH, Kang JW, Lee MS, et al. Assessment of the quality of reporting in randomised controlled trials of acupuncture in the Korean literature using the CONSORT statement and STRICTA guidelines. BMJ Open. 2014;4:e005068. doi: 10.1136/bmjopen-2014-005068 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.NICE. NICE clinical guideline 96. Neuropathic pain: the pharmacological management of neuropathic pain in adults in non-specialist settings. National Institute for Health and Clinical Excellence Available from: http://www.nice.org.uk/guidance/CG96. Accessed June5, 2010. [PubMed]
- 25.Nalamachu S, Morley-Foster P. Diagnosing and managing postherpetic neuralgia. Drugs Aging. 2012;29:863–869. doi: 10.1007/s40266-012-0014-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Chon TY, Lee MC. Acupuncture. Mayo Clin Proc. 2013;88(10):1141–1146. doi: 10.1016/j.mayocp.2013.06.009 [DOI] [PubMed] [Google Scholar]
- 27.Tang Y, Yin H-Y, Rubini P, et al. Acupuncture-induced analgesia: a neurobiological basis in purinergic signaling. Neuroscientist. 2016;22(6):563–578 [DOI] [PubMed] [Google Scholar]
- 28.Zhuang L, He J, Zhuang X, Lu L. Quality of reporting on randomized controlled trials of acupuncture for stroke rehabilitation. BMC Complement Altern Med. 2014;14:151. doi: 10.1186/1472-6882-14-151 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Wei J-J, Yang W-T, Yin S-B, Wang C, Wang Y, Zheng G-Q. The quality of reporting of randomized controlled trials of electroacupuncture for stroke. BMC Complement Altern Med. 2016;16:512. doi: 10.1186/s12906-016-1497-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Wenting L, Pengqian F. The importance of blinding for patients in randomized controlled trials of interventions for pain: a meta analysis. Chi J Med Manage Sci. 2016;6(4):68–72. [Google Scholar]
- 31.You Y-N, Cho M-R, Kim J-H, et al. Assessing the quality of reports about randomized controlled trials of scalp acupuncture combined with another treatment for stroke. BMC Complement Altern Med. 2017;17:452. doi: 10.1186/s12906-017-1950-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Bondemark L, Abdulraheem S. Intention to treat (ITT) analysis as reported in orthodontic randomized controlled trials-evaluations of methodology and recommendations for the accurate use of ITT analysis and handling dropouts. Eur J Orthod. 201. 8;40(4):409–413. doi: 10.1093/ejo/cjx084 [DOI] [PubMed] [Google Scholar]
- 33.Al-Badriyeh D, Alameri M, Al-Okka R. Cost-effectiveness research in cancer therapy: a systematic review of literature trends, methods and the influence of funding. BMJ Open. 2017;7(1):e012648. doi: 10.1136/bmjopen-2016-012648 [DOI] [PMC free article] [PubMed] [Google Scholar]