Table 3.
Validity assessment for evaluations with studies enabling endorsing versus non-endorsing journal comparison
| Author, year | Relevant studies for assessment (endorsing v non-endorsing) | Year of publication of assessed studies | Journals that published assessed studies | Two or more assessors for completeness of reporting* | No of items assessed as reported in methods section* | Comprehensive search strategy* | Balance of studies per journal in comparison groups*† |
|---|---|---|---|---|---|---|---|
| BMJ economic guidelines, 1996 | |||||||
| Herman, 2005122‡ | 2 v 11 | 2003-04 | 1 v 10 | Unclear | High | Low | High |
| Jefferson, 1998123 | 1 v 5 | 1997-98§ | 1 v 1 | Unclear | Unclear | High | High |
| CONSORT extension for abstracts, 2008 | |||||||
| Ghimire, 2014146 | 74 v 234 | 2010-12 | 2 v 4 | High | Unclear | Low | Low |
| CONSORT extension for harms, 2004 | |||||||
| Haidich, 2011124‡ | 25 v 77 | 2006 | 2 v 3 | High | High | High | Low |
| Turner, 2011125‡ | 5 v 189 | 2009 | 5 v 104 | Low | High | Low | Low |
| Peron, 2013141 | 43 v 282 | 2007-11 | 2 v 8 | Unclear | High | Low | Low |
| Cornelius, 2013142 | 1 v 6 | 2009 | 1 v 5 | High | High | High | High |
| Lee, 2008126 | 1 v 1 | 2005 | 1 v s 1 | High | High | High | High |
| CONSORT extension for herbal interventions, 2006 | |||||||
| Ernst, 2011127 | 1 v 4 | 2009 | 1 v 3 | Unclear | High | Low | High |
| PRISMA, 2009 | |||||||
| Tunis, 2013143‡ | 13 v 48 | 2010-11 | 1 v 8 | High | High | Low | Low |
| Panic, 2013145‡ | 30 v 30 | Jan-Oct 2012 | 6 v 10 | High | High | Low | Unclear |
| Fleming, 2013144‡ | 20 v 2 | 2009-11 v 2010-11 | 2 v 1 | High | High | Low | Low |
| QUOROM, 1999 | |||||||
| Biondi-Zoccai, 2006128 | 1 v 6 | 2004 | 1 v 6 | High | High | Low | High |
| Poolman, 2007130 | 1 v 6 | 2006 v 2005 | 1 v 5 | High | Unclear | Low | High |
| STARD, 2003 | |||||||
| Freeman, 2009131‡ | 3 v 9 | 2004-05 | 2 v 7 | Unclear | High | High | High |
| Mahoney, 2007132‡ | 6 v 20 | 2003-05 | 4 v 13 | High | High | Low | High |
| Selman, 2011133‡ | 14 v 36 | 2003-06 | 6 v 22 | High | Low | Low | Low |
| Smidt, 2006134‡ | 95 v 46 | 2004 | 7 v 5 | High | High | Low | Low |
| Coppus, 2006135 | 8 v 19 | 2004 | 1 v 1 | Low | High | Unclear | High |
| Johnson, 2007136 | 1 v 10 | 2005 | 1 v 4 | High | High | Low | High |
| Krzych, 2009137 | 4 v 21 | 2004-06 | 2 v 16 | Unclear | High | Low | High |
| Paranjothy, 2007138 | 1 v 8 | 2005-06 | 1 v 4 | High | High | Low | High |
| STRICTA, 2002 | |||||||
| Hammerschlag, 2011139‡ | 17 v 130 | 2002-05 | 3 v 64 | Low | High | Low | Unclear |
| STROBE, 2007 | |||||||
| Parsons, 2011147‡ | 9 v 38 | 2008-10 | 2 v 6 | Low | Unclear | Low | Low |
| Delaney, 2010140 | 1 v 4 | 2008 | 1 v 3 | High | Unclear | Low | High |
*High=high validity; low=low validity; unclear=unclear validity.
†Assessed once authors’ data reorganized into comparison groups.
‡Included in quantitative synthesis.
§Estimated based on information provided in article.