Table 3. Transparency, reproducibility, and robustness indicators.
Indicators | Mental Health | Mortality |
---|---|---|
Khan and colleagues [4] | HSC [18], ACS [19] | |
Data available to others | ||
Entirely unrestricted | No | No |
Under specific conditions | Yes (*) | Yes |
Reanalysis performed by others | No | Yes |
Including contrarians | No | Yes |
Results robust in different models | Mostly yes | Mostly yes |
Prespecified protocol | No | Yes, not in full detail |
Prespecified protocol for reanalysis | No | Yes |
*Denmark data are available after approval only to investigators in Denmark. US data are available with payment; it is unclear whether the same exact data set as used by Khan and colleagues can be retrieved because new data continue accruing in IBM MarketScan.
Abbreviations:ACS, American Cancer Society study, HSC, Harvard Six Cities study.