Skip to main content
. 2015 May 11;2015(5):CD010766. doi: 10.1002/14651858.CD010766.pub2

2. Analysis methods planned in our protocol that will be used in updates of this review.

Measures of treatment effect We will analyse dichotomous outcomes by calculating the risk ratio (RR) and the corresponding 95% confidence interval (CI). For continuous data, we will calculate mean difference (MD) and corresponding 95% CI if studies used the same rating scales. As recommended by Higgins 2011, we will focus on final values unless change scores are used in some of the studies. We will combine in the same meta‐analysis studies that reported final values with studies that reported only change scores, provided the studies used the same rating scale (Higgins 2011). A potential problem associated with including change scores is that the standard deviation of changes may not be reported in the original study (Higgins 2011). We will contact trial authors and will attempt to estimate the standard deviation of changes if not reported. We will calculate the standardised mean difference (SMD) with 95% CIs if studies used different scales to measure the same outcomes
Multiple outcomes If studies provided multiple, interchangeable measures of the same construct at the same point in time, we will calculate the average SMD across outcomes and the average estimated variances (Higgins 2011)
Unit of analysis issues When possible, we will obtain mean treatment differences and standard errors for cross‐over trials, and will enter these into RevMan under the generic inverse variance outcome type (Higgins 2011). We will create a single pair‐wise comparison for each identified multi‐arm study by combining all relevant experimental groups into a single group, and by combining all relevant control groups into a single group (Higgins 2011)
Dealing with missing data We will attempt to contact trial investigators to request missing data. If missing data are provided by the trialists, we will conduct meta‐analysis according to intention‐to‐treat principles using all data and keeping participants in the treatment group to which they were originally randomly assigned, regardless of the treatment that they actually received (Higgins 2011). If missing data are not provided, we will analyse only available data, and we will not impute missing data given that symptoms of autism spectrum disorder (ASD) vary greatly. We will document missing data and attrition in the ’Risk of bias’ table, and we will discuss how missing data may affect interpretation of the results
Assessment of heterogeneity We will assess clinical heterogeneity by comparing the between‐trials distribution of participant characteristics (e.g. children vs adults), trial characteristics (e.g. cross‐over vs parallel design) and intervention characteristics (e.g. treatment type, dose). We will evaluate statistical heterogeneity using the I² statistic and the Chi² test of heterogeneity, with statistical significance set at P value < 0.10. We will consider I² values as follows.
  1. 0% to 29% might not be important

  2. 30% to 49% may represent moderate heterogeneity

  3. 50% to 74% may represent substantial heterogeneity

  4. 75% to 100% represents considerable heterogeneity (Higgins 2011)

Assessment of reporting biases If 10 or more studies are found, we will use funnel plots to investigate the relationship between intervention effect and study size. Asymmetry of a funnel plot may indicate, among other things, publication bias or poor methodological quality (Egger 1997). We will explore possible reasons for any asymmetry found
Data synthesis We will synthesise results in a meta‐analysis using a fixed‐effect model when studies are similar enough with regard to the intervention, population and methods to assume that the same treatment effect is estimated. We will synthesise results in a meta‐analysis using a random‐effects model when statistical heterogeneity is found, or when studies differ enough with regard to the intervention, population and methods to assume that different yet related treatment effects are estimated, and when it is deemed to be clinically relevant (Higgins 2011)
Subgroup analysis and investigation of heterogeneity We will conduct the following subgroup analyses
  1. Type of ASD (e.g. autistic disorder vs Asperger’s disorder)

  2. Participant age (e.g. adult vs child, preschool vs school‐age)

  3. Treatment type (e.g. dimercaptosuccinic acid (DMSA) vs other agents)

  4. Treatment dosage (e.g. DMSA dose of 10 mg/kg body weight administered 3 times per day vs higher doses)

  5. Length of follow‐up (e.g. ≤ 3 months vs > 3 months)

Sensitivity analysis We will conduct sensitivity analyses to investigate the effect on overall results of excluding trials when
  1. Allocation concealment or sequence generation was inadequate (selection bias)

  2. Blinding was not done (performance bias)

  3. Outcome data were incomplete (attrition bias)