Restoring invisible and abandoned trials: a call for people to publish the findings

Abstract

Unpublished and misreported studies make it difficult to determine the true value of a treatment. Peter Doshi and colleagues call for sponsors and investigators of abandoned studies to publish (or republish) and propose a system for independent publishing if sponsors fail to respond

Well designed and well performed randomised controlled trials are considered to provide the most reliable evidence on the effects of health related interventions. However, the credibility of findings from individual trials and from summaries of trials examining a similar research question (that is, systematic reviews and meta-analyses) has been undermined by numerous reporting biases in the published medical literature.^{1 2 3 4 5 6 7 8 9 10 11 12 13 14} Reporting biases are often difficult to detect, but have the potential to discredit earnest efforts towards evidence based decision making.

Two basic problems of representation are driving growing concerns about relying on published research to reflect the truth.^{10 15} The first is no representation (invisibility), which occurs when a trial remains unpublished years after completion. The second is distorted representation (distortion), which occurs when publications in medical journals present a biased or misleading description of the design, conduct, or results of a trial.^{1 6 10 14} Both go against the fundamental scientific and ethical responsibility that all research on humans be used to advance knowledge and are symptomatic of a general culture of data secrecy. The end result is that the healthcare, biomedical research, and policy communities may, despite best intentions and best practices, end up drawing scientifically invalid conclusions based on only those parts of the evidence base they can see.

A call to publish—or be published

Despite near universal agreement that reporting biases are harmful, efforts to correct the problem have largely focused on forward looking initiatives. Prospective registration of trials has made major strides in ensuring that the biomedical community is aware of trials at their inception, but at best only around half of registered trials on ClinicalTrials.gov were registered before they began enrolling patients.¹⁶ Recent studies have also shown that even when disclosure of study findings is mandated by law, results often remain invisible.^{17 18 19} In addition, trial registration does not address the problems of invisibility and distortion for trials that took place before registers were widely used. Most importantly, those demanding correcting action lacked the data required to actually correct the scientific record. However, with increasing amounts of data entering the public domain, it is now becoming possible to move from words to action and publish (or republish) abandoned trials.

We have access to around 178 000 pages of previously confidential company research documents (table 1, box). For drugs such as paroxetine, quetiapine, and gabapentin, litigation over illegal off-label marketing put thousands of pages of trial reports in the public domain. Other trial reports, such as for oseltamivir and clopidogrel, were obtained through new freedom of information policies at the European Medicines Agency (EMA) that have revolutionised the public’s ability to access trial data.^{20 21 22 23} The documents are a substantial resource of information about trials. We expect that other independent groups will also have access to many additional trial reports.

Table 1.

 Clinical study reports in our possession

Trial identifiers	No of participants	Year completed*	Published	No of pages†	Level of access to trial data
					Trial protocol	IPD	CRFs
Amgen epoetin alfa study 930107	1265	1997§	Yes36 37	289	No	No	No
AstraZeneca quetiapine study 015	331	1995		3459	Yes	No	No
AstraZeneca quetiapine study 041	532	2002		185	No	No	No
AstraZeneca quetiapine study 049	542	2003	Yes66	8027	Yes	Yes	No
AstraZeneca quetiapine study 135	509	2005		1507	No	No	No
AstraZeneca quetiapine study 125	574	2005	Yes67	4582	Yes	Yes	No
AstraZeneca quetiapine study 127	1953	2006		6434	Yes	No	No
AstraZeneca quetiapine study 126	1461	2006		6135	Yes	No	No
Bristol-Myers Squibb clopidogrel study CAPRIE	19185	1996	Yes68	211	Yes	No	No
Bristol-Myers Squibb clopidogrel study CURE	12562	2000	Yes69	110	No	No	No
Bristol-Myers Squibb clopidogrel study CLARITY	3491	2005	Yes70,71	114	No	No	No
Bristol-Myers Squibb clopidogrel study COMMIT	45852	2005	Yes72	56	No	No	No
Bristol-Myers Squibb clopidogrel study PICOLO	92	2006	Yes73	101	No	No	No
Bristol-Myers Squibb aripiprazole study CN138135	480	2006	Yes74	9406	Yes	Yes	No
GSK H5N1 pandemic influenza vaccine studies H5N1-008, H5N1-011 EXT 008	5075	2006	Yes75	208	No	No	No
GSK paroxetine study 329	275	1998	Yes76	6022	Yes	Yes	No
GSK paroxetine study 377	286	1998	Yes77	4659	Yes	Yes	No
GSK paroxetine study 453	339	1998	Yes78	15440	Yes	Yes	No
GSK paroxetine study 511	125	1999	Yes79	400	Yes	Yes	No
GSK paroxetine study 701	206	2001	Yes80	4016	Yes	Yes	No
GSK paroxetine study 704	207	2001	Yes81	3896	Yes	Yes	No
GSK paroxetine study 715	62	2001	Yes82	1260	Yes	Yes	No
GSK paroxetine study 676	322	2001	Yes83	5855	Yes	Yes	No
GSK paroxetine study 716	265	2002	Yes84	5473	Yes	Yes	No
GSK zanamivir study 167-101	319	2000		708	No	No	No
GSK zanamivir study 167T3-11	145	2001		789	No	No	No
GSK zanamivir study JNAI-01	116	1995	Yes85	410	No	No	No
GSK zanamivir study JNAI-04	50	1996		589	No	No	No
GSK zanamivir study JNAI-07	333	1999		1737	No	No	No
GSK zanamivir study NAI30008	525	2000	Yes86	779	No	No	No
GSK zanamivir study NAI30009	471	1999	Yes87	469	No	No	No
GSK zanamivir study NAI30010	1158	1999	Yes88	633	No	No	No
GSK zanamivir study NAI30011	466	2000		358	No	No	No
GSK zanamivir study NAI30012	358	2001		709	No	No	No
GSK zanamivir study NAI30015	588	2001	Yes89	480	No	No	No
GSK zanamivir study NAI30020	334	2001		205	No	No	No
GSK zanamivir study NAI30028	266	2001		207	No	No	No
GSK zanamivir study NAI30031	1291	2001	Yes90	1122	No	No	No
GSK zanamivir study NAI30034	3363	2001	Yes91	467	No	No	No
GSK zanamivir study NAIA2005	220	1995	Yes92	427	No	No	No
GSK zanamivir study NAIA2006	64	1995	Yes93	253	No	No	No
GSK zanamivir study NAIA2010	257	1997	Yes94	200	No	No	No
GSK zanamivir study NAIA3002	777	1998	Yes95	537	No	No	No
GSK zanamivir study NAIA3003	1116	2000	Yes96	376	No	No	No
GSK zanamivir study NAIA3004	489	2000	Yes97	391	No	No	No
GSK zanamivir study NAIA3005	1107	1998	Yes98	355	No	No	No
GSK zanamivir study NAIAB2008	1256	1996	Yes99	527	No	No	No
GSK zanamivir study NAIAB2009	577	1996	Yes100	364	No	No	No
GSK zanamivir study NAIB2005	198	1995	Yes92	372	No	No	No
GSK zanamivir study NAIB2006	115	1995		240	No	No	No
GSK zanamivir study NAIB2007	554	1996		461	No	No	No
GSK zanamivir study NAIB3001	455	1997	Yes101	465	No	No	No
GSK zanamivir study NAIB3002	356	1998	Yes102	454	No	No	No
GSK zanamivir study PE-01	44	1996		392	No	No	No
Merck rofecoxib study 078	1457	2003		392	Yes	No	No
Novartis Fluad study V87P1	486	2007	Yes103	3670	Yes	Yes	No
Novartis Fluad study V87P6	471	2009	Yes104	5483	Yes	Yes	No
Pfizer atorvastatin study 981080	335	1998		518	Yes	Part	No
Pfizer gabapentin study 879-201	87	1988		925	Yes	No	No
Pfizer gabapentin study 945-210**	165	1997	Yes105	1188	Yes	Yes	No
Pfizer gabapentin study 945-209	117	1997	Yes106	231	Yes	Yes	No
Pfizer gabapentin study 945-220	145	1998	Yes107	4166	Yes	Yes	No
Pfizer gabapentin study 945-217	157	1999		4336	Yes	Yes	No
Pfizer gabapentin study 1032-001	483	1999		437	Yes	Yes	No
Pfizer gabapentin study 945-224**	325	1999		3214	Yes	Yes	No
Pfizer gabapentin study 945-306**	307	2000	Yes108	1358	Yes	Yes	No
Pfizer gabapentin study 1035-001	325¶	2000		371	Yes	Yes	No
Pfizer gabapentin study 1032-004	206	2000		463	Yes	Yes	No
Pfizer gabapentin study 1032-002	262	2000		580	Yes	Yes	No
Pfizer gabapentin study 1035-002	200	2000		380	Yes	Yes	No
Pfizer gabapentin study 1032-003	212	2000		228	Yes	Yes	No
Pfizer gabapentin study 945-271**	120	2001	Yes109	111	Yes	No	No
Pfizer gabapentin study 945-411**	339	2001	Yes110	492	Yes	Yes	No
Pfizer gabapentin study 945-276**	121	2002	Yes111	41	No	No	No
Pfizer gabapentin study A945-1008**	389	2003		63	Yes	Yes	No
Pfizer gabapentin study 945-291	42	2004	Yes112	23	No	No	No
Pfizer reboxetine study 9	50	1989		327	Yes	Yes	No
Pfizer reboxetine study 91	56	1990	Yes113	1715	Yes	Part	No
Pfizer reboxetine study 8	258	1991‡		711	Yes	Part	No
Pfizer reboxetine study 32a	50	1991		307	Yes	Yes	No
Pfizer reboxetine study 17	256	1992		1466	Yes	Yes	No
Pfizer reboxetine study 15	339	1992		2096	Yes	Yes	No
Pfizer reboxetine study 13	358	1993		2599	Yes	Yes	No
Pfizer reboxetine study 16	168	1993	Yes114	1186	Yes	Yes	No
Pfizer reboxetine study 35	347	1994		2537	Yes	Yes	No
Pfizer reboxetine study 49	212	1998		65	No	No	No
Pfizer reboxetine study 50	450	1999		148	No	No	No
Pfizer reboxetine study 45	350	1999		89	No	No	No
Pfizer reboxetine study 34	128	2000		2079	Yes	Part	No
Pfizer reboxetine study 47	774	2000	Yes115	133	No	No	No
Pfizer reboxetine study 46	787	2000		112	No	No	No
Pfizer reboxetine study 52	325	2000	Yes116	92	No	No	No
Pfizer reboxetine study 43	359	2001	Yes117	60	No	No	No
Pfizer reboxetine study 32	85	2001		88	No	No	No
Pfizer reboxetine study 96	34	2001		52	No	No	No
Pfizer reboxetine study 71	69	2002		318	No	No	No
Pfizer sertraline study 206	12	1983		721	Yes	Yes	No
Roche oseltamivir studies WV15673 WV15697	1562	1998	Yes118	804	Yes	No	No
Roche oseltamivir study WV15670	726	1998	Yes119	1032	Yes	No	No
Roche oseltamivir study WV15671	629	1998	Yes120	1018	Yes	No	No
Roche oseltamivir study NP15757	59	1998	Yes121	445	Yes	No	No
Roche oseltamivir study WV15730	60	1998		525	Yes	No	No
Roche oseltamivir study WV15708	385	1998		661	Yes	No	No
Roche oseltamivir study WV15707	27	1998		458	Yes	No	No
Roche oseltamivir study M76001	1459	1999		1514	Yes	No	No
Roche oseltamivir study WV15799	962	1999	Yes122	900	Yes	No	No
Roche oseltamivir study WV15825	572	1999	Yes123	875	Yes	No	No
Roche oseltamivir study WV15758	698	1999	Yes124	1126	Yes	No	No
Roche oseltamivir studies WV15812 WV15872	404	1999		683	Yes	No	No
Roche oseltamivir studies WV15759 WV15871	335	1999	Yes125	1121	Yes	No	No
Roche oseltamivir studies WV15876 WV15819 WV15978	741	2000		973	Yes	No	No
Roche oseltamivir study WP16263	400	2000	Yes126	8545	Yes	Yes	No
Roche oseltamivir study WV16193	808	2001	Yes127	894	Yes	No	No
Roche oseltamivir study NV16871	329	2004		614	Yes	No	No
Rowtasha arthronat study MA-CT-10-002	80	2010		4924	Yes	Yes	Part
Takeda pioglitazone study PNFP-001	408	1998	Yes128	2486	Yes	No	No

CSR=clinical study report; CRFs=case report forms; IPD=individual participant data

*Date of last participant follow-up (if known).

†No of pages in our possession. Not all reports were complete.

‡Date of CSR (date of last participant follow up is unknown).

§Scheduled end date documented in the CSR (the trial was stopped early).

¶We also have an addendum comprising 101 patients, completed in March 2000

The documents we have obtained include trial reports for studies that remain unpublished years after completion (such as Roche’s study M76001, the largest treatment trial of oseltamivir, and Pfizer’s study A945-1008, the largest trial of gabapentin for painful diabetic neuropathy). We also have thousands of pages of clinical study reports associated with trials that have been published in scientific journals but shown to contain inaccuracies, such as Roche’s oseltamivir study WV15671, GlaxoSmithKline’s paroxetine study 329, and Pfizer’s gabapentin study 945-291.^{3 12 24 25} We consider these to be examples of abandoned trials: either unpublished trials for which sponsors are no longer actively working to publish or published trials that are documented as misreported but for which authors do not correct the record using established means such as a correction or retraction (which is an abandonment of responsibility) (box 1).²⁵ Because abandonment can lead to false conclusions about effectiveness and safety, we believe that it should be tackled through independent publication and republication of trials.

Box 1: Understanding the evidence iceberg

What’s above the waterline

• Published trial—A trial for which there is a permanent public report that has the individual trial as the central focus and at a minimum presents a summary of the trial protocol and study results. Such reports usually appear in scientific journals. Reports of trials presented with other trials (such as in pooled analyses), do not by themselves confer “published” status

• Misreported trial—A trial that the biomedical literature documents has been erroneously reported or reported in a biased manner, such as with outcome reporting biases. Journal editors will have to decide whether misreporting is serious enough to warrant republication

What’s partly above and partly below the waterline

• Abandoned trial—A trial can become abandoned in two ways. Firstly, a published trial can become abandoned when it is documented to be misreported and its authors do not correct their trial publication. Secondly, an unpublished trial can become abandoned when its sponsors are not working to ensure the trial is published. Detecting this form of abandonment is difficult. Comparing the amount of time that has elapsed since completion of follow-up to other published trials of the same drug and sponsor may help, but confirmation that an unpublished trial is abandoned may require contacting trial sponsors or clinical investigators

What’s (typically) below the waterline

• Clinical study report—A report using a highly structured format for integrated and complete reporting of the planning, execution, results, and analysis of a clinical trial (box 2)

• Individual participant data—Data for each participant in a trial. This contrasts with aggregate or summary data, which is produced by combining data from multiple participants. Individual participant data allows for the replication of all analyses in study reports and exploration of further analyses

• Unpublished data—Data of any type (measurements, analyses, narratives, or judgments) from a trial that have not been published, irrespective of whether the trial is published. Since trial reports in peer reviewed scientific journals typically provide only highly compressed summaries of trial data,^{26 27} large amounts of unpublished data will remain for these trials

• Case report form—The original paper or electronic forms on which individual participants’ data (demographic, efficacy, safety, etc) are recorded during the clinical trial. The forms are typically the most “raw” form of detailed data available for understanding what happened in a clinical trial, and the data they contain are statistically analysed only after they have been entered into an electronic database of individual patient data. Forms can vary in length, from a few pages to hundreds of pages, and each trial can have multiple forms—for example, for different visits or for the different tests or procedures the participant undergoes.

• Trial protocol—A document, written prospectively before recruiting participants into a trial, which records the general rules and intended methods of conducting, analysing, and reporting the trial. Many also include a statistical analysis plan. Trial protocols are tens to hundreds of pages in length. A protocol may be required by the research ethics board, a data and safety monitoring board, or a funding body. Any planned or actual changes from the original written protocol in the conduct should be documented with formal protocol amendments.^{28 29}

• Investigators’ brochure—A document written by a sponsor and intended for clinical investigators interested in becoming involved in a study. It summarises the current body of evidence about an intervention under investigation, typically based on preclinical and human studies. The document is periodically updated in light of new information.

A call to action

We call on institutions that funded and investigators who conducted abandoned trials to publish (in the case of unpublished trials) or formally correct or republish (in the case of misreported trials) their studies within the next year. This should allow sufficient time for manuscript preparation, peer review, and publication. We will email a copy of this article to manufacturers of trials listed in table 1, asking them to signal their intent to publish by sending an electronic response to the article within 30 days. We propose that if anyone who declares an intention to publish or correct does not do so within one year, all available data for such trials should be considered “public access data” that others are allowed to publish.

We are committed to seeing the findings from abandoned trials published and describe here a minimum set of criteria for responsible publication and republication of abandoned studies (box 2). We call this concept restoring invisible and abandoned trials (RIAT). As the concept develops, interested individuals and organisations will ideally work together to develop detailed policies aimed at improving trial publication practices. We see RIAT as a collaborative, global effort, and over the next year we hope to discuss and debate our proposal at appropriate venues.

Box 2: Proposal for restoring invisible and abandoned trials (RIAT)

2. Collect documentation of trial abandonment

• For unpublished trials—No primary publication detected by systematic search of the literature and/or confirmation from original trial sponsor or current responsible party that no publication exists

• For misreported trials—Evidence of misreporting (ideally, published letters or other articles in the scientific literature or documentation of communication with the original trial publication author(s) detailing the misreporting) and a failure to correct the scientific record.

3. Issue a “call to action” by publicly registering your possession of data sufficient for publication

At least initially, this should be by an electronic response to this article and should include, as a minimum, trial identifiers, number of participants, date completed, publication status, pages in your holding, and level of access to trial data. This declaration offers original sponsors and trialists an opportunity to publish or formally correct their studies within the next 365 days. Send a copy of the rapid response by email to trial sponsors (and authors, for published trials), requesting confirmation of receipt.

4. Collect documentation of the need for restoration

Save time stamped copies of all rapid responses to this article (or other relevant websites) to document the time elapsed and consequent need for third party restoration.

5. Presubmission inquiry to RIAT friendly journal

Present editors with documentation from steps 1-4 and seek confirmation of editors’ interest.

6. Prepare and submit manuscript according to RIAT procedures

• Include explanation (with references) in the Introduction of why this trial is being restored

• Provide auditable record of decisions (use RIATAR template), documenting which parts of the clinical study report (page number and paragraph) were used

• Report analyses specified in protocol

• Denote any analyses that were not prespecified

• Make all underlying data available electronically

The concept of publishing trials that we neither participated in, nor paid for, is an extension of what, in certain cases, we currently have in place: public use of epidemiological and clinical trial datasets from government sources^{30 31} and public access to summary trial results on ClinicalTrials.gov.³² Thus the scientific community has already accepted that investigators not associated with the original trial will produce and publish additional or confirmatory analyses. Furthermore, there are precedents for both publishing unpublished studies and republishing distorted studies. Examples include the description of design and findings from unpublished studies on the effects of nicotine on hypothalamic functions by using previously confidential (but now publicly available) company documents,^{33 34} and reports of case studies derived from the clinical observations of neurosurgeon Harvey Cushing.³⁵ More recently, an investigator unconnected to Amgen’s epoetin alfa study 930107 republished this trial, documenting serious distortions in the original publication.^{36 37}

Publishing trials, credibly

The major factor that makes publication of invisible and abandoned trials possible is the existence of clinical study reports (CSRs), documents produced by the pharmaceutical industry that include an unabridged and detailed summary of the planning, conduct, and results of a clinical trial.³⁸ The reports are rigidly structured according to guidelines that industry and regulators agreed to in 1995 (box 3) and are almost always hundreds, if not thousands, of pages long. Manufacturers submit clinical study reports to the US Food and Drug Administration as part of applications for new drugs. In addition, the FDA typically also requires submission of the protocol and individual participant data. The European Medicines Agency does not routinely request individual participant data or clinical study reports.³⁹ Although clinical study reports may be unfamiliar to the academic world, and in our experience are typically not produced for trials sponsored by non-commercial funders, when those in industry or the FDA want to know what occurred in an industry sponsored trial, they may refer to a clinical study report. When industry statisticians wish to carry out further analyses of the data, they can turn to their database of individual participant data. The rest of us, however—doctors, medical and public health researchers, patients, and non-regulatory government agencies including many health technology assessment groups—are left with only what is in the public domain (usually at best, synopses of the trials in the form of journal articles) (figure)..

Box 3: Clinical trials and clinical study reports

Writing clinical study reports is now industry standard practice, but it was not always so. In the middle of the 20th century, the early years of randomised controlled trials, studies were small—initiated, carried out, and reported by a handful of investigators, often in an academic medical centre. Reporting was likewise more concise and simple—something that could be explained in a journal length article, with more detailed datasets available on request.

The 1980s, however, saw a dramatic rise in the complexity of clinical trials. Multisite, international trials funded by industry and use of contract research organisations, became common.^{40 41} Whereas formerly those reporting trials had direct involvement in the conduct of the trial, the involvement of individual investigators in multicentre trials is often limited to a particular centre and a single “principal investigator” may see only the data they collected, not the complete dataset across all trial centres.^{42 43 44 45}

In 1995, US, European, and Japanese regulators along with the respective industry trade organisations established a standardised way to organise a CSR to help simplify the new drug application process across global regulatory regimes.⁴⁶ The CSR’s length and complexity helped fuel the growing industry of paid medical writers, with people who had no involvement in the clinical trial authoring clinical study reports.⁴⁷

The guideline defines a CSR as “an ‘integrated’ full report of an individual study of any therapeutic, prophylactic, or diagnostic agent . . . conducted in patients. The clinical and statistical description, presentations, and analyses are integrated into a single report, incorporating tables and figures into the main text of the report or at the end of the text, with appendices containing such information as the protocol, sample case report forms, investigator-related information, information related to the test drugs/investigational products including active control/comparators, technical statistical documentation, related publications, patient data listings, and technical statistical details such as derivations, computations, analyses, and computer output. The integrated full report of a study should not be derived by simply joining a separate clinical and statistical report.”⁴⁶

Although by definition no journal publication exists for “unpublished trials,” clinical study reports for industry funded trials often do exist for these unpublished trials, but they have been traditionally treated as secret.^{48 49} However, litigation and new freedom of information rules in Europe have helped many clinical study reports to emerge in the public domain, thereby making the restorative authorship possible. In addition, some drug companies have recently pledged to release their reports.^{50 51} Not all of the clinical study reports and other materials we have obtained are complete. However, many contain sufficient detail to form a comprehensive understanding of the trials and would enable someone to produce a journal length manuscript for publication.

We believe it is important to publish unpublished and other abandoned studies, even though they will at best represent a brief synopsis of all the publicly available data. This is because we live in a research and practice environment based on publications, and unpublished trials remain largely invisible. There is still no PubMed-like indexing system for unpublished clinical study reports. Moreover, most researchers will not have the time to sift through hundreds or thousands of pages to understand what occurred in a single clinical trial. We therefore need a shorthand representation, and the best we know of is journal publication.

To avoid a continuation of journal papers with selective reporting, we propose that trial publications adhere to reporting standards that ensure accountability. With a compression factor in some cases well above 1000:1 (table 2), summarising a clinical study report into a journal length manuscript inevitably requires value judgments about which information to include. These decisions should be transparent so that any bias can be identified and discussed. Responsible restorative authorship requires those publishing articles to also make the underlying trial data available simultaneously as an electronic appendix. In addition, there should be public access to an auditable record that documents which parts of the clinical study report (page numbers and paragraphs) were incorporated into the new publication, to help make restorative authors’ value judgments about what to include in the summary explicit and transparent. We have designed the RIAT audit record (RIATAR), a tool to ensure this is done systematically, based on the CONSORT checklist for reporting randomised trials (see web appendix).⁵²

Table 2.

 Compression factor ratio of pages in clinical study reports (CSRs) to published study

Published Trial	Length (pages)		Compression factor
	CSR*	Publication
Oseltamivir study WP16263126	8545	7	1221
Clopidogrel study CAPRIE68	96851	11	8805
Paroxetine study 32976	6022	11	547
Paroxetine study 37777	4659	17	274
Paroxetine study 45378	15440	11	1404
Paroxetine study 51179	400	8	50
Paroxetine study 67683	5855	10	586
Paroxetine study 70180	4016	11	365
Paroxetine study 70481	3896	10	390
Paroxetine study 71582	1260	12	105
Paroxetine study 71684	5473	1	5473

*CSR page totals do not include case report forms, which are unavailable to us.

Providing public access to both source documents and an audit record gives readers a quick way to find (and cross check) the relevant and more detailed information within the original clinical study report. We think that it should apply to all trials published, irrespective of authorship, and follows on from previous calls by journal editors for improved research reporting standards.^{53 54 55 56 57} It would enable independent verification of the accuracy of journal publications and permit better evidence synthesis and other forms of research.^{49 58}

RIAT reports should also provide the context for the study to help the readers understand why the trial is being restored. This means including references to any previous publications of the trial and to details and evidence of the trial’s abandonment. RIAT analyses should follow the analyses specified in the protocol (including any specified in amendments). Any other analyses are discouraged, but if done must be clearly noted as exploratory and not prespecified. At the same time, RIAT authors may wish to critically appraise the trials they report. This can be useful, but the critique should be clearly identifiable and placed in the discussion section.

Important details are still to be worked out (box 4 lists some of them), and we welcome discussion on how to get it right.

Box 4: Issues for further discussion and development

• Should the original trial investigators have the right to join a group of RIAT authors?

• Should RIAT authors contact original investigators for help in interpreting trial documents?

• Should old trials that are going to be subject to RIAT publication be registered in trial registries such as ClinicalTrials.gov (assuming this becomes possible)? Should registration preclude other restorative author teams from using the same data?

• Should RIAT publication related clinical study reports and audit records be stored on the publishing journal’s server or is a publicly available database required?

• Where should the declaration of intent to publish a RIAT trial be published?

• How should RIAT publications be cited? Should restoration be clearly identified in the publication title or the authorship byline? If yes, how?

• What (if any) additional rules or safeguards should RIAT authors apply to ensure patient confidentiality of individual patient data and clinical report forms that are already in the public domain?

• For misreported articles, what level of narrative detail regarding the misreporting should the RIAT publication contain?

• Should RIAT authors seek approval from an appropriate research ethics committee before publishing a trial with unclear prior ethical basis?

Potentially controversial aspects of our proposal

The idea of restorative writing may be seen as taking on responsibility and credit for other people’s actions, regardless of the trial’s sponsor, but it takes on a slightly different cast when trials are funded by commercial sponsors rather than public money. Some people may think that publications based on clinical study reports with which the authors have no connection is equivalent to intellectual property theft, but you cannot steal what is already in the public domain (and only in the public domain because a drug regulator or judge had the documents unconditionally released or the sponsor waived their confidentiality claims over the documents). The considerable discussion about the need for public access to trial data and data ownership has not yet resolved how to handle the thorny but important question of proper scientific credit.^{59 60 61} RIAT authorship will not usurp proper credit for a trial. Rather, it will show how problematic the concepts of authorship and results reporting are in the modern clinical trial. RIAT authors would be able to claim credit for bringing to light what was previously invisible or distorted but not for carrying out the trial.

In the case of the Roche sponsored oseltamivir trials, we have so far identified eight different layers of responsibility, perhaps partially overlapping: those who designed the trial, those who sponsored it, those who conducted it, those who analysed the data, those who wrote or assembled the clinical study report, those who decided the publication policy, those who decided which parts to publish (and in some cases not to publish), those who presented results at meetings or conferences, and, lastly, those who put their names to the published manuscript. None of these roles has a clear thread of accountability and authors of the published trials have confirmed that they did not have access to the underlying study data.^{45 62} In sum, in the context of the modern clinical trial research enterprise, the traditional journal article publication model obscures responsibility more than it illuminates.

Is restorative writing fundamentally different from professional medical writing and “ghost writing”? One important difference is that hired medical writers are paid for their services by those who stand to gain from the publication and restorative authors are not. Restorative authors are also likely to have access to more detailed trial records than medical writers. Another difference is that medical writers are often instructed to insert “key messages” in publication ready manuscripts.^{11 63} Finally, medical writers are often unacknowledged in the publication and so are not accorded any responsibility for the work they produce. By contrast, RIAT authors will take full responsibility for publishing abandoned studies, although we will refer to RIAT to make it clear that the article is a work of restoration, not primary authorship. We are also contemplating how best to document RIAT authorship in our CVs: at a minimum, such publications need to be listed under a separate heading, identifying them as such.

Recently, a group of drug manufacturers and medical journal editors published “ten recommendations for closing the credibility gap in reporting industry-sponsored clinical research,” aimed at eliminating reporting biases.⁶⁴ Their recommendations do not go far enough to address the problems. They do not mention publishing abandoned trials and ignore responsibility for correcting reporting biases persisting in existing trial publications. Furrthermore, their recommendation to “make public all data” refers to publication of journal article length manuscripts rather than the full clinical study reports, individual participant data, investigators’ brochures, case report forms, and many other of the semi-secret documents that would help people to understand a trial and its place in the research or regulatory approval programme—meaning the published results would have to be taken on trust without the possibility of verification.

Will the publication of detailed clinical study reports enable subsequent ill intentioned or otherwise misleading analyses by others (such as spurious findings from data dredging)? We challenge readers to provide an example of open clinical trial data sharing that has led to major public health harm. If RIAT evokes the spectre of data mining, it is important to remember that we currently have no way to judge the fidelity of the process of synthesising thousands of pages of a clinical study report into a journal publication. RIAT publication is important even for poorly conducted or unethical studies that many editors may not feel merit publication. Without public documentation that a trial was poorly done, researchers will be left guessing about the value of the study. A very brief trial report (without results if they would be misleading) may suffice.

Finally, some people may argue that RIAT republication of a misreported study is muddying the published record for dubious gain, especially with older trials. We believe that correcting the scientific record is preferable to ignoring inaccuracies. If the accompanying data support what is reported in the RIAT republication, doubts about which publication is correct should not be a problem.

Call for restorative authors and participating journals

The data we have obtained (table 1) relate to only a small fraction of the masses of abandoned clinical trials. We call on others to join us, to contribute trial documents they have obtained from public sources that need publishing or republishing, and to help us with the writing. We need volunteers to act in place of those who should have but did not make trial reports visible and accessible.

Litigation and freedom of information promise to usher increasing amounts of clinical trial documents into the public domain. This reality necessitates an urgent discussion about what constitutes this new public commons and how it should function. Should there be a central repository for once secret trial documents and, if so, who should or can responsibly house, index, and maintain a public database of documents that span regulatory and legal boundaries? The tens of millions of pages of internal tobacco industry documents released in 1998 illustrate the enormity and importance of rising to the challenge.⁶⁵

Endorsement of the concept of restorative authorship by medical journal editors will help the effort to complete and correct the scientific record. Journals can signal their willingness to accept RIAT publications by including details in their “instructions for authors.” We suggest that journals ask restorative authors to provide documentation of a trial’s status as abandoned, the provenance of data on which the RIAT publication is written (to ensure it is in the public domain), and to agree to submit the clinical study report and all other data used to write the manuscript as well as an audit record documenting what data were used. We suggest that to reduce wasted time on behalf of both authors and editors, authors submit a presubmission inquiry to discuss their case.

Our declaration to publish will be the first step towards public and open debate on an issue that affects everyone and has for too long been the preserve of people acting behind closed doors.

Cite this as: BMJ 2013;346:f2865