Vlassov 2008.
Methods | Investigated discrepancies between systematic review abstracts and the main text. | |
Data | N = 100 systematic reviews Inclusion criteria:
Exclusion criteria:
Year(s) of publication of the systematic reviews: 1996 to 2007 Areas of health care addressed by the systematic reviews: Various (not specifically assessed) Methodological quality of systematic reviews: Not assessed Number (proportion) of systematic reviews that only included RCTs: Not assessed Number (proportion) of systematic reviews that are Cochrane Reviews: 100 (100%) Extent of overlap of RCTs included in the systematic reviews in the empirical study: Not assessed, though unlikely to have impacted on the results |
|
Comparisons | Abstract versus main text | |
Outcomes | Prevalence of systematic review abstracts which:
|
|
Notes | Statistical significance defined as P < 0.05. Additional outcomes measured but not included in the review were prevalence of abstracts reporting the magnitude, direction and statistical uncertainty (e.g. P value, 95% CI) of effect estimates (i.e. measures of 'incomplete reporting') Study published as a conference abstract only. Additional unpublished data retrieved from the author. |
|
Risk of bias | ||
Item | Authors' judgement | Description |
Is the empirical study at low risk of selection bias? | Yes | Quote: "It was not a random, but really 'regular' sample: having the DB [database] open in alphabet order I selected first 10 of every 100 abstracts. Reviews without trials found were excluded" (personal communication). Comment: This empirical study included a representative systematic sample of systematic reviews. |
Is the empirical study at low risk of selective reporting bias? | Unclear | Comment: No protocol for the study is available so it is unclear whether all measured and analysed outcomes were reported in the conference abstract. |