Table 2.
Phase two revised Scale kappa statistics and intraclass correlation coefficient for NICMAN participants rating two papers.
| Item number | Paper 3 kappa statistic | Paper 4 kappa statistic |
|---|---|---|
| (1) Clearly described population | 0.82 | 1.0 |
|
| ||
| (2) Clearly described intervention | 0.82 | 1.0 |
|
| ||
| (3) Clearly described comparator | 1.0 | 1.0 |
|
| ||
| (4) Clearly described outcome | 0.82 | 1.0 |
|
| ||
| (5) The study design is appropriate for the research question | 0.31 | 0.56 |
|
| ||
| (6) A differential diagnosis (if undertaken) is stated | 0.65 | 0.27 |
|
| ||
| (7) Acupuncture points selected are consistent with chosen treatment principles. A statement is provided stating the acupuncture prescription is consistent with literature review, expert opinion, or text books | 0.35 | 0.56 |
|
| ||
| (8) Needling: depth and manipulation (a) Needle brand and dimension are used consistently across all participants and sessions. We use the term “consistently” to provide an aspect relating to quality rather than focus on reporting (b) Depth of needle insertion is reported and referenced to a standard text or mm or range is stated (c) Needle manipulation is justified (in the absence of needle manipulation justification is provided for the decision not to undertake needle manipulation) (d) Needle sensation was sought and described (e) Electroacupuncture device should be identified and approved in country of use |
0.35 | 0.56 |
|
| ||
| (9) Point location: (a) published standard acupuncture location texts are used as a reference, or (b) location described in anatomical terms and/or an accurate proportional method for locating acupoints is used |
0.35 | 0.31 |
|
| ||
| (10) Number of treatments (a) If it is a chronic condition a minimum of six treatments are administered; if fewer treatments are delivered appropriate justification is documented (b) If it is an acute or subacute condition no minimum number of treatments are specified, but justification is to be provided |
0.82 | 1.0 |
|
| ||
| (11) (a) The acupuncturist administering the intervention is registered with a regulatory authority or meets at least the minimum WHO standard [19] (b) The practitioner undertaking the TCM differential diagnosis is adequately trained, for example, registered with a regulatory authority, or meets at least the minimum WHO standard [19] (if no differential diagnosis √NA) |
0.31 | 1.0 |
|
| ||
| ICC for overall agreement (95% CI) |
0.68 0.37 to 0.89 |
−0.19 −0.45 to 0.29 |