Abstract
Introduction
Neck pain is a common problem that severely affects physical and mental health. While musculoskeletal manipulations are recommended as the first-line treatment for adults with neck pain, the comparative effectiveness of different musculoskeletal manipulations remains unclear. This systematic review and network meta-analysis of randomised controlled trials (RCTs) will compare the effectiveness of different types of musculoskeletal manipulations, with the overarching aim of guiding clinical practice.
Methods and analysis
Two independent reviewers will search four English electronic databases (Web of Science, Cochrane Library, EMBASE, PubMed) and three Chinese electronic databases (China National Knowledge Infrastructure, China Science and Technology Journal Database, Wanfang) for relevant RCTs published from 1 January 2013 to 30 April 2023. The Clinical Trials Registry (ClinicalTrials.gov) will be searched for completed but unpublished RCTs. English and Chinese will be used to search English databases and Chinese databases, respectively. RCTs of musculoskeletal manipulations for adults (aged ≥18 years) with neck pain will be considered eligible for inclusion. A pairwise meta-analysis and network meta-analysis will be performed, and pooled risk ratios, standardised mean differences and 95% CIs will be determined.
Ethics and dissemination
Ethics approval is not required as this study is a literature review. The results of this review will be published in peer-reviewed journals or disseminated at conferences.
PROSPERO registration number
CRD42023420775.
Keywords: Randomized Controlled Trial, COMPLEMENTARY MEDICINE, PAIN MANAGEMENT, Meta-Analysis
STRENGTHS AND LIMITATIONS OF THIS STUDY.
By integrating direct and indirect evidence, network meta-analysis will increase the precision of treatment estimates and allow for the ranking of available musculoskeletal manipulations.
Our study will be conducted following the Cochrane Handbook, which will ensure methodological rigour.
The revised Cochrane risk of bias tool (V.2.0) will be used to provide a critical appraisal of the risk of bias for included studies.
We will assess the evidence certainty using the GRADE (Grading of Recommendations Assessment, Development and Evaluation) approach, which will provide essential information for clinical decision-making.
The quality of the studies included in the systematic review will influence the results of the network meta-analysis.
Introduction
Neck pain is a common musculoskeletal disorder and major health burden. Globally, neck pain affects 288.7 million people, with a prevalence of 3551 cases per 100 000 population.1 The number of neck pain cases is expected to increase significantly in the near future, owing to the ageing population and changes in working habits.2 As the fourth most prevalent musculoskeletal disorder,3 neck pain poses a heavy socioeconomic burden and has severe adverse impacts on quality of life and both physical and mental health.4 Therefore, the prevention and treatment of neck pain warrants greater attention.5
Several interventions are available for the treatment of neck pain, including pharmacotherapy, electrotherapy, acupuncture and musculoskeletal manipulations.6 Due to its comparative safety and effectiveness, musculoskeletal manipulations are the recommended first-line treatment method and are widely used in clinical practice.7 A previous Cochrane review of several randomised controlled trials (RCTs) confirmed the effectiveness of musculoskeletal manipulations in patients with neck pain.8 There is currently a wide range of different musculoskeletal manipulations available. Nevertheless, their comparative effectiveness is unclear, and there is a lack of evidence to guide clinicians in the selection of the most effective intervention.
Network meta-analysis (NMA) allows ranking of intervention effectiveness by simultaneously comparing several interventions in a network plot.9 To our knowledge, the comparative effectiveness of different musculoskeletal manipulations has not yet been investigated via NMA. Thus, this NMA aims to systematically evaluate and synthesise the effectiveness of different types of musculoskeletal manipulation in patients with neck pain.
Methods and analysis
Design
The protocol for this review follows the Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols (PRISMA) statement.10 The NMA will be conducted in accordance with the guidelines of the Cochrane Handbook (V.6.3, 2022),11 and reporting will adhere to the guidelines of PRISMA-NMA.12 This protocol has been registered in PROSPERO (CRD42023420775).
Information sources
Four English electronic databases (Web of Science, Cochrane Library, EMBASE and PubMed) and three Chinese electronic databases (China National Knowledge Infrastructure, China Science and Technology Journal Database and Wanfang) will be searched for RCTs published between 1 January 2013 and 30 April 2023. We will also search the Clinical Trials Registry (ClinicalTrials.gov) for completed but unpublished RCTs. Our three-part search strategy includes terms to identify (1) RCTs pertaining, (2) musculoskeletal manipulations and (3) neck pain. The detailed search strategies are presented in online supplemental appendix 1.
bmjopen-2023-077951supp001.pdf (225.1KB, pdf)
Eligibility criteria
RCTs will be included in accordance with the following criteria:
Participants: adults (age ≥18 years) with neck pain. Neck pain is defined as a primary complaint of pain between the occiput and the first thoracic vertebra.
Interventions: any musculoskeletal manipulations, including upper cervical spine and cervicothoracic spine manipulations;
Comparison: any other musculoskeletal manipulations, sham treatment, placebo, no treatment or active control (eg, education, exercise).
Outcomes: the primary outcome is neck pain intensity (measured by various scales, such as Visual Analogue Scale, Numeric Pain Rating Scale); the secondary outcomes include quality of life, flexion, extension and adverse events.
Exclusion criteria
Studies will be excluded if they (1) report primary complaints other than neck pain, such as postconcussion syndrome, headache and migraine; (2) are not published in Chinese or English or (3) musculoskeletal manipulations were only used as adjuvant therapy.
Selection process
All retrieved records will be imported into the literature management software. After the removal of duplicate records, two reviewers will independently screen titles and abstracts. Full texts of records meeting the inclusion criteria will be read, and all reasons for exclusion will be reported. Any disagreements will be discussed and resolved by the two reviewers; a third reviewer will be consulted when necessary. The study selection process will be reported using a PRISMA flow diagram (figure 1).
Figure 1.
Study screening process. RCTs, randomised controlled trials.
Data extraction
The following data for each included study will be extracted by two independent reviewers using a standardised extraction table agreed on by all authors: study identifiers (eg, first author, publication year, country or region, sample size, setting), details of intervention and comparator (eg, components, frequency, duration), patient information (eg, mean age, sex percentage) and outcomes (eg, neck pain scale scores at baseline and after the intervention, measurement tools).
Risk of bias assessment of individual studies
The risk of bias assessment tool used in this review will be the revised Cochrane risk of bias tool for RCTs (V.2.0).13 Studies will be evaluated in five domains: randomisation process, deviations from intended interventions, missing outcome data, measurement of the outcome and selection of the reported result. The overall risk of bias will be considered as ‘low’ if all five domains having the assessment of ‘low risk’; as ‘some concerns’ if at least one domain having the assessment of ‘some concerns’ and as ‘high’ if at least one domain having the assessment of ‘high risk’. The risk of bias assessment will be independently conducted by two reviewers. The third reviewer will resolve any conflicts through discussion, as needed.
Data synthesis
Measures of intervention effect
Dichotomous outcomes will be calculated as the risk ratio (RR) and 95% CI, whereas the standardised mean difference (SMD) and 95% CI will be reported when outcomes are continuous. If the available data are not suitable for meta-analysis, a systematic review will be performed.
Pairwise meta-analysis
Prior to undertaking a pairwise meta-analysis, Cochran’s Q test will be used to qualitatively evaluate whether there is heterogeneity among the RCTs, with p<0.1 indicating significant heterogeneity. I2 values will be used to quantitatively measure the level of heterogeneity, which will be classified as follows: low (<25%), moderate (25%–50%) or high (>50%).14 A random-effects model will be used due to potential heterogeneity between the studies.15 Tables and forest plots will be used to report quantitative data. Publication bias will be assessed using both a funnel plot and the Egger’s test when 10 or more RCTs are included in the analysis.16
Network meta-analysis
NMA will be performed using a frequentist approach, and a random-effects model with maximum likelihood estimation will be used to assess the comparative effectiveness of eligible interventions via STATA (V.14).17 Pooled RR and SMD with 95% CI will be used to assess intervention effects on dichotomous and continuous outcome data, respectively.
An NMA must adhere to the assumptions of transitivity and consistency.18 Transitivity is assessed by comparing clinical and methodological characteristics between RCTs. When these characteristics are similar, transitivity is considered satisfactory.19 Inconsistency includes the global inconsistency and local inconsistency, with each component being evaluated by different methods. The design-by-treatment interaction model is used to detect global inconsistency,20 21 while the node-splitting method is used to evaluate local inconsistency.20 The absence of inconsistency between indirect and direct comparisons is indicated by p>0.05 (for both the overall inconsistency test and local inconsistency test). In such cases, the consistency model will be selected to compare all interventions.22 23
All comparisons in the network will be displayed in a network plot. The results of the interventions in the direct and indirect comparisons will be reported in a league table. The surface under the cumulative ranking curve will be used to rank the effectiveness of the interventions for each outcome.24 Publication bias will be evaluated using a comparison-adjusted funnel plot if at least 10 studies are included.25 A symmetrical distribution of scatter points around the zero line on the funnel plot indicates the absence of publication bias.
Sensitivity analysis
If sufficient RCTs are included, we will perform a sensitivity analysis by excluding RCTs with a high risk of bias.
Assessment of evidence certainty
The evidence certainty in the NMA will be evaluated using the Grading of Recommendations, Assessment, Development and Evaluation guidelines.26 27 First, based on the risk of bias, inconsistency, publication bias and indirectness, the evidence certainty of effect estimates about direct comparisons will be rated as high, moderate, low or very low. Second, the evidence certainty of indirect comparisons will be rated as high, moderate, low or very low based on the higher order loop (loops with the least common comparator connecting the comparison of interest). We will rate down the certainty of the indirect comparison one further level after taking into account intransitivity. Finally, the higher rating between direct and indirect comparison will be identified. And the evidence certainty about network comparisons will be rated after taking into account incoherence and imprecision. A third reviewer will resolve any disagreement until a consensus is reached. Detailed instruction of above-mentioned factors is shown in online supplemental appendix 2.
Patient and public involvement
None.
Discussion
This NMA will provide a comprehensive assessment of the available musculoskeletal manipulations for adults with neck pain. The results of our comparative analysis and assessment of evidence quality will be used to establish a hierarchy of interventions according to effectiveness, thereby guiding the selection of optimal musculoskeletal manipulation in clinical practice. Furthermore, our risk of bias assessment will inform the development of future studies with improved study designs and methodological quality.
Ethics and dissemination
Ethics approval is not required for this study, as it is a literature review and does not involve direct contact with patients or patient privacy issues. The results of this review will be disseminated to national and international scientific communities, healthcare professionals and the general population through publication in a peer-reviewed journal and presentation at scientific conferences.
Supplementary Material
Footnotes
Contributors: ZG (conception and study design, formulation of search strategies, data extraction and analysis, and writing of the manuscript); YG and WL (formulation of search strategies, data acquisition and manuscript revision); SZ, LL and QC (data extraction, analysis and interpretation, as well as manuscript revision); XL, WL and JL (formulation of the search strategies and critical revision of the manuscript). All authors contributed to the research and have agreed to be responsible for all aspects of the work.
Funding: This work was supported by the Science and Technology Innovation Program of Hunan Province (grant number: 2022RC1221) and by the Hunan Provincial Education Department Postgraduate Research Innovation Program (grant number: 2022CX18).
Disclaimer: The funding source will have no role in the study design, execution, analysis and interpretation of data, and reporting of results.
Competing interests: None declared.
Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.
Provenance and peer review: Not commissioned; externally peer reviewed.
Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.
Ethics statements
Patient consent for publication
Not applicable.
References
- 1.Safiri S, Kolahi A-A, Hoy D, et al. Global, regional, and national burden of neck pain in the general population, 1990–2017: systematic analysis of the global burden of disease study 2017. BMJ 2020:m791. 10.1136/bmj.m791 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Kazeminasab S, Nejadghaderi SA, Amiri P, et al. Neck pain: global epidemiology, trends and risk factors. BMC Musculoskelet Disord 2022;23:26. 10.1186/s12891-021-04957-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Vos T, Lim SS, Abbafati C. GBD 2019 diseases and injuries collaborators. global burden of 369 diseases and injuries in 204 countries and territories, 1990-2019: a systematic analysis for the global burden of disease study 2019. Lancet 2020;396:1204–22. 10.1016/S0140-6736(20)30925-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Shin DW, Shin JI, Koyanagi A, et al. Global, regional, and national neck pain burden in the general population, 1990–2019: an analysis of the global burden of disease study 2019. Front Neurol 2022;13:955367. 10.3389/fneur.2022.955367 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Cohen SP, Hooten WM. Advances in the diagnosis and management of neck pain. BMJ 2017;358:j3221. 10.1136/bmj.j3221 [DOI] [PubMed] [Google Scholar]
- 6.Prablek M, Gadot R, Xu DS, et al. Neck pain: differential diagnosis and management. Neurol Clin 2023;41:77–85. 10.1016/j.ncl.2022.07.003 [DOI] [PubMed] [Google Scholar]
- 7.Blanpied PR, Gross AR, Elliott JM, et al. Neck pain: revision 2017. J Orthop Sports Phys Ther 2017;47:A1–83. 10.2519/jospt.2017.0302 [DOI] [PubMed] [Google Scholar]
- 8.Gross A, Langevin P, Burnie SJ, et al. Manipulation and mobilisation for neck pain contrasted against an inactive control or another active treatment. Cochrane Database Syst Rev 2015:CD004249. 10.1002/14651858.CD004249.pub4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Rouse B, Chaimani A, Li T. Network meta-analysis: an introduction for clinicians. Intern Emerg Med 2017;12:103–11. 10.1007/s11739-016-1583-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Shamseer L, Moher D, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ 2015;350:g7647. 10.1136/bmj.g7647 [DOI] [PubMed] [Google Scholar]
- 11.Higgins JPT, Thomas J, Chandler J, et al. Cochrane Handbook for Systematic Reviews of Interventions. 2ed. Chichester, UK: John Wiley & Sons, 2019. [Google Scholar]
- 12.Hutton B, Salanti G, Caldwell DM, et al. The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med 2015;162:777–84. 10.7326/M14-2385 [DOI] [PubMed] [Google Scholar]
- 13.Sterne JAC, Savović J, Page MJ, et al. Rob 2: a revised tool for assessing risk of bias in randomised trials. BMJ 2019;366:l4898. 10.1136/bmj.l4898 [DOI] [PubMed] [Google Scholar]
- 14.Higgins JPT, Thompson SG, Deeks JJ, et al. Measuring inconsistency in meta-analyses. BMJ 2003;327:557–60. 10.1136/bmj.327.7414.557 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Borenstein M, Hedges LV, Higgins JPT, et al. A basic introduction to fixed-effect and random-effects models for meta-analysis. Res Synth Methods 2010;1:97–111. 10.1002/jrsm.12 [DOI] [PubMed] [Google Scholar]
- 16.Peters JL, Sutton AJ, Jones DR, et al. Comparison of two methods to detect publication bias in meta-analysis. JAMA 2006;295:676–80. 10.1001/jama.295.6.676 [DOI] [PubMed] [Google Scholar]
- 17.White IR. Network meta-analysis. Stata J 2015;15:951–85. 10.1177/1536867X1501500403 [DOI] [Google Scholar]
- 18.Riley RD, Jackson D, Salanti G, et al. Multivariate and network meta-analysis of multiple outcomes and multiple treatments: rationale, concepts, and examples. BMJ 2017;358:j3932. 10.1136/bmj.j3932 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Salanti G. Indirect and mixed-treatment comparison, network, or multiple-treatments meta-analysis: many names, many benefits, many concerns for the next generation evidence synthesis tool. Res Synth Methods 2012;3:80–97. 10.1002/jrsm.1037 [DOI] [PubMed] [Google Scholar]
- 20.Dias S, Welton NJ, Caldwell DM, et al. Checking consistency in mixed treatment comparison meta-analysis. Stat Med 2010;29:932–44. 10.1002/sim.3767 [DOI] [PubMed] [Google Scholar]
- 21.Higgins JPT, Jackson D, Barrett JK, et al. Consistency and inconsistency in network meta-analysis: concepts and models for multi-arm studies. Res Synth Methods 2012;3:98–110. 10.1002/jrsm.1044 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Lu G, Ades AE. Combination of direct and indirect evidence in mixed treatment comparisons. Stat Med 2004;23:3105–24. 10.1002/sim.1875 [DOI] [PubMed] [Google Scholar]
- 23.Caldwell DM, Ades AE, Higgins JPT. Simultaneous comparison of multiple treatments: combining direct and indirect evidence. BMJ 2005;331:897–900. 10.1136/bmj.331.7521.897 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Salanti G, Ades AE, Ioannidis JPA. Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial. J Clin Epidemiol 2011;64:163–71. 10.1016/j.jclinepi.2010.03.016 [DOI] [PubMed] [Google Scholar]
- 25.Chaimani A, Higgins JPT, Mavridis D, et al. Graphical tools for network meta-analysis in STATA. PLOS ONE 2013;8:e76654. 10.1371/journal.pone.0076654 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Puhan MA, Schünemann HJ, Murad MH, et al. A GRADE working group approach for rating the quality of treatment effect estimates from network meta-analysis. BMJ 2014;349:g5630. 10.1136/bmj.g5630 [DOI] [PubMed] [Google Scholar]
- 27.Atkins D, Best D, Briss PA, et al. Grading quality of evidence and strength of recommendations. BMJ 2004;328:1490. 10.1136/bmj.328.7454.1490 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
bmjopen-2023-077951supp001.pdf (225.1KB, pdf)

