Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2013 Jan 1.
Published in final edited form as: Am J Public Health. 2011 Nov 28;102(1):72–80. doi: 10.2105/AJPH.2011.300187

PHARMACEUTICAL-INDUSTRY SPONSORED RESEARCH: PROMOTING TRANSPARENCY

Joseph S Ross a,b, Cary P Gross a,c, Harlan M Krumholz b,d
PMCID: PMC3319748  NIHMSID: NIHMS366518  PMID: 22095335

Abstract

Strong, evidence-based practice requires that objective, unbiased research is available to inform individual clinical decisions, systematic reviews, meta-analyses, and expert guideline recommendations. Seeding trials, publication planning, messaging, and ghostwriting, as well as selective publication and reporting of trial outcomes have been used by industry to distort the medical literature and undermine clinical trial research, explicitly by obscuring information that is relevant to patients and physicians. Policies that promote transparency into the clinical trial research process, through improved and expanded disclosure of investigator contributions and funding, comprehensive publicly-available trial registration, and independent analysis of clinical trial data, have the potential to address these subversive practices by improving accountability among industry and investigators. Minimizing the impact of marketing on clinical trial research, and strengthening the science, will protect both the integrity of the medical literature as well as the public’s health.


Evidence-based medical practice requires that objective, unbiased research is readily available to clinicians, investigators, and regulators, which can be used to inform individual clinical decisions and for systematic reviews, meta-analyses, and expert guideline recommendations. However, there is increasing awareness and concern about the role of industry in clinical research and its impact on the medical literature, partially driven by research demonstrating a positive relationship between sponsorship and findings. For instance, a meta-analysis of 1140 original research studies found that industry-sponsored trials had 3.5 times greater odds of reporting pro-industry conclusions.1 Subsequent meta-analyses confirmed this finding among both medical and surgical2 and recent major cardiovascular randomized controlled trials.3

Collaborations between academic physicians and industry are essential to advancing scientific knowledge and improving the care of patients. However, there have been a number of recent exposés describing problems with industry-sponsored trials, including issues related to withholding of trial data, involvement of marketing, inappropriate authorship, and lack of accountability. These and related concerns remain a dominant issue in public and professional discourse.48 In this commentary, we review several practices that have been used by industry to distort the medical literature and undermine clinical trial research, explicitly by obscuring information that is relevant to patients and physicians. We subsequently describe the value of promoting transparency to address these practices, specifically describing the need for improved disclosure and registration practices and independent analysis of clinical trial data.

DISTORTION OF THE MEDICAL LITERATURE

A wide variety of research practices have been previously described as being used to distort the medical literature in favor of a clinical trial sponsor’s pharmaceutical intervention,913 although many are less common due to the larger role institutional review boards (IRBs) and information technology now play in clinical trial research. For instance, comparing a drug to a less effective active control was described among trials of antifungals for infected cancer patients with neutropenia14 and of various anti-hypertensives.15 Similarly, comparing a drug to a high-dose active control, at a dose high enough likely to lead to greater adverse side effects, was described among trials of selective serotonin reuptake inhibitors for depression and anti-psychotics for schizophrenia.16 However, IRBs make these practices less common today. As another example, “salami slicing,”17 publishing separate, but similar, articles that rely on the same set of data, has been described among trials of nonsteroidal anti-inflammatory drugs (NSAIDs) for rheumatoid arthritis,18 of risperdone for psychosis,19 and most recently, of duloxetine for depression.17 However, the increased use of the internet and PubMed, the on-line MEDLINE search engine managed by the National Library of Medicine (NLM), makes this practice less common as well.

Nevertheless, several related practices remain common and three deserve further discussion: (1) seeding trials; (2) publication planning; and (3) selective publication and reporting (Table 1). Each undermines the clinical trial research process through acts of commission or omission, obscuring information from physicians and the public and distorting the medical literature. We will describe each practice, using illustrative examples, and then discuss the potential for greater transparency to address each.

Table 1.

Practices that industry has used to obscure relevant information from patients and physicians, undermining clinical trial research and distorting the medical literature.

Practice Definition
Seeding Trials Clinical trials of a drug or device among human subjects that are conducted for the purpose of promoting the drug or device and encouraging its use directly to physicians under the guise of their participating as an investigator in a clinical trial, without disclosing the marketing objectives to patients, physicians, regulators, or Institutional Review Board members.
Publication Planning Organizational and practical work of shaping pharmaceutical companies’ data and turning it into medical journal articles to derive the maximum commercial value from clinical research through carefully constructed and placed articles, both by targeting high-profile journals for high market-impact findings as well as by publishing numerous, strategically-related, market-focused papers within lower-profile journals.
Key Messaging Identification of key messages or themes that are expected to promote drug sales, with subsequent planning of publications around these messages and themes.
Ghostwriting Failure to designate an individual, in this case an industry employee or an external medical writer, who has made a substantial contribution to the research or writing of a manuscript as an author.
Guest Authorship Designation of an individual, in this case an academic investigator not employed by industry, who does not meet authorship criteria as an author to confer external objectivity.
Selective Publication The delayed publication or non-publication of clinical trials that have findings not supportive of a drug or device or that may decrease the commercial value of the product.
Selective Reporting The partial or incomplete reporting of clinical trial findings that are not supportive of a drug or device or that may decrease the commercial value of the product.
Ambiguous Reporting The reporting of clinical trial findings that are not supportive of a drug or device or that may decrease the commercial value of the product in a way that is misleading or less likely to attract public attention.

Seeding Trials

Clinical trials designed by industry to promote the use of pharmacotherapies are known as marketing or seeding trials.2024 Although they are deceptively designed to appear to be answering a scientific question, seeding trials primarily pursue marketing objectives, promoting a medication or device and encouraging its use directly to prescribers under the guise of their participating as an investigator in a clinical trial. Seeding trials tend to study medications that were recently approved or are currently under review by the Food and Drug Administration (FDA), influencing prescribers as the company puts their product in the hands of practicing physicians, hoping that the experience treating patients with the study drug and a pleasant, even profitable, interaction with the company will result in more loyal physicians who prescribe the drug.21

Seeding trials undermine the clinical trial research process in several ways. First, the true objective of the trial, to market and promote a new drug to physicians, is not disclosed to patients, physicians, or IRB members. This non-disclosure prevents patients from making fully informed consent decisions about participation, but also affects the physician investigators, who are the actual study subjects as companies systematically examine the impact of participating as a trial investigator on subsequent prescribing.24, 25 Second, these trials may be less likely to be published, since they are designed and conducted by marketing, a problem we will discuss below. Finally, these trials are often redundant and examine scientific questions that have already been formally investigated by the company.

As an example, we reviewed documents produced as a part of litigation against Merck related to rofecoxib, a cyclo-oxygenase-2 inhibitor used to treat osteoarthritis, finding clear evidence that Merck had conducted a seeding trial to promote the prescription of Vioxx by physicians that coincided with the FDA’s approval and the availability of the product on the market.25 The objectives of this trial,26 as described by marketing executives, were “to provide product trial among a key physician group to accelerate uptake of VIOXX as the second entrant in a highly competitive new class … and was designed and executed in the spirit of the Merck marketing principles”.25 Further clarifying the true purpose of the trial, executives summarized by saying:

“Finally, the results of the trial are being carefully tracked. An analysis at 6 months post [market availability] demonstrated significantly higher level of prescribing for VIOXX among primary care [trial] investigators compared to a control group of prescribers. Feedback from the field [pharmaceutical representatives] has been overwhelmingly positive about the ability to access key customers and the influence that being involved in the trial has had on [prescribers’] perception of VIOXX and Merck.”25

Two other litigation document reviews, in this case examining documents produced as part of litigation against Pfizer and Parke-Davis, Division of Warner-Lambert Company, related to gabapentin, an anti-epileptic medication that is also commonly used to treat neuropathic pain, similarly showed that a large clinical trial was used for marketing by encouraging “key customers” (i.e., neurologists) to participate in research, to advance promotional themes, and to build market share.24, 27

Publication Planning

Publication planning involves the organizational and practical work of shaping industry trial data and turning it into medical journal articles, a practice that goes beyond routine plans for dissemination of science because plans are designed to explicitly create and communicate information to support productmarketing.2831 The primary objective is to derive the maximum commercial value from clinical research through carefully constructed and placed articles,30 both by targeting high-profile journals for high market-impact findings as well as by publishing numerous, strategically-related, market-focused papers within lower-profile journals.

Publication planning undermines the clinical trial research process in several ways, as marketing interests influence the research process at multiple different times: during decisions over which trials to conduct, trial design, analytic approach, writing of manuscripts, and whether or not to publish trial findings. However, these decisions are not observable and publication planning is akin to a “ghostly” hand behind the scenes managing and shaping the medical literature.29

The earliest exposition of publication planning came from litigation against Pfizer related to sertraline, a selective-serotonin reuptake inhibitor (SSRI) used to treat depression. Documents were identified that suggested the company was tracking and coordinating 85 drafts of manuscripts with the assistance of a medical education and communications company (MECC), including submission dates, journal revision requests, and expected publication dates.28 Upon publication, few articles disclosed Pfizer’s or the MECC’s involvement, although documents clearly indicated that authors were not acting independently. This publication planning strategy had great impact as these 85 articles composed the majority of the literature for sertraline and were uniformly positive in their discussion of the medication.28 Other examples of publication planning have been described among the clinical research strategies for rofecoxib32 and gabapentin.27

Key Messaging

Publication planning is notable not only for managing and shaping the medical literature, but also the eventual message conveyed by the article or series of articles.29 Often understood as “key messaging,” company marketing departments, often in collaboration with MECCs, identify messages or themes that are expected to promote sales and then plan publications around these themes. Such plans include determination of target audiences, tailoring key scientific and clinical communication points, or messages, and timing their release so that the number of articles produced by a publication planning team peaks as the product launches, ensuring that medical professionals are familiarized with the product at a commercially optimal time.31 The continued rise in the number of MECCs offering “strategic communication planning,”33 and their close relationship with the pharmaceutical industry,34 suggests this practice is common.

Ghostwriting and Guest Authorship

Another feature of publication planning is the use of ghostwriting and guest authorship. Guest authoring has been defined as the designation of an individual who does not meet authorship criteria as an author,35, 36 whereas ghostwriting is the failure to designate an individual who has made a substantial contribution to the research or writing of a manuscript as an author.35 Both practices undermine the clinical trial research process, crediting investigators with a role in the study not commensurate with their actions in an attempt to convey academic objectivity on a trial. Of note, these external authors rarely have access to the trial data for independent analysis and are only included after the manuscript has been first drafted, when key decisions in the presentation of the data have already been made, including which analyses to present. These practices go beyond investigators being given editorial assistance in drafting a manuscript or managing the references and involve the preparation of a fully drafted manuscript with the data, tables and figures already selected for inclusion.

As an example, we reviewed documents produced as a part of litigation against Merck related to rofecoxib and found that clinical trial manuscripts related to rofecoxib were often authored by employees but often attributed first authorship to academically-affiliated investigators who did not always disclose industry financial support.32 Similarly, review manuscripts were often prepared by unacknowledged authors and subsequently attributed authorship to academically-affiliated investigators who often did not disclose industry support.32 Many other recent examples of ghostwriting and guest authorship of clinical trial manuscripts have been recently described, including among Prempro (conjugated estrogen/medroxyprogesterone) manuscripts sponsored by Wyeth,37 paroxetine manuscripts sponsored by GlaxoSmithKline through its case study publications for peer review (CASPPER) program,38 sertraline manuscripts sponsored by Pfizer,28 gabapentin manuscripts sponsored by Pfizer and Parke-Davis,27 and warfarin manuscripts sponsored by AstraZeneca.39

Selective Publication and Reporting

Selective publication and reporting, which includes ambiguous reporting, undermines the clinical trial research process through the suppression or distortion of trial results. Because industry remains the largest sponsor of clinical trial research, a company’s decision to selectively publish trials or report outcomes from a trial has substantial potential to distort the medical literature. These practices are often engaged in to serve marketing interests and enabled by industry ownership of the trial data. Industry decides which clinical trial findings to submit for publication, if any, and the final content of the manuscript, including which analyses. In fact, even among the research contracts between pharmaceutical companies and academic institutions, where academic autonomy is expected, 50% allow industry to draft the manuscript, making content decisions, and 24% give industry the right to use their data tables for a manuscript, as opposed to academic researcher-constructed data tables.40

Selective Publication

The practice of not publishing clinical trial results is known as selective publication and can include both delayed publication and non-publication of completed trials. Many prior studies have documented low publication rates of clinical trials, suggestive of selective publication, particularly among industry-sponsored trials.4152 For instance, a comparison of published trial articles with trial reports submitted for FDA review found that 31% of antidepressant trials were not published.43 Another of trial reports submitted to the FDA within new drug applications found 22% of trials were unpublished 5 years after submission and that published trials were more likely to have favorable primary outcomes and less likely to include unfavorable outcomes in published reports.52 Our examination of completed clinical trials that had been registered in ClinicalTrials.gov, the publicly-accessible, internet-based registry of clinical trials managed by the NLM, found that fewer than half had been published, with the lowest rates of publication among trials primarily sponsored by industry.51

Fewer studies have attempted to document delayed publication. One example is the Ezetimibe and Simvastatin in Hypercholesterolemia Enhances Atherosclerosis Regression [ENHANCE] trial,53 which compared the effects of simvastatin with those of simvastatin plus ezetimibe among patients with familial hypercholesterolemia on the progression of atherosclerosis. This trial was completed in April 2006, although the findings, which were negative, were not made public until January 2008, when released in the news media.20 The trial was not formally published until March 2008,53 but its delayed publication permitted the continued rapid adoption of ezetimimibe54 without requiring physicians to take into account new, non-supportive evidence.

Selective Reporting

Selective reporting, which involves the partial or incomplete reporting of all clinical trial findings, includes both partial reporting of results from protocol-defined analyses and reporting a secondary outcome as the primary outcome post-hoc. These practices have been previously described as both common and biased.41, 42, 50 There have been several illustrative examples of selective reporting after litigation uncovered previously unavailable clinical trial reports.55 For instance, the published report of study 329 in adolescents sponsored by GlaxoSmithKline claimed that paroxetine was generally well tolerated and effective for major depression.56 By contrast, internal documents revealed that in study 329, paroxetine was not significantly effective for depression for any of the eight protocol-specific outcomes and was associated with harm.57 Similarly, a recent comparison of internal company documents obtained during litigation with published reports of 20 trials of gabapentin for off-label indications funded by Pfizer and Warner-Lambert’s subsidiary, Parke-Davis, found numerous examples of selective outcome reporting.58 Critically, trials that presented findings that were not significant for the protocol-defined primary outcome in the internal documents either were not published in full or were published with a changed primary outcome.

Other examples of selective reporting have been described without the use of litigation. For instance, a comparison of published trial articles with trial reports submitted for FDA review for 12 antidepressants found that 37 of 38 studies viewed by the FDA as having positive results were published, whereas, with 3 exceptions, studies viewed by the FDA as having negative or questionable results were, with 3 exceptions, either not published (22 studies) or published in a way that conveyed a positive outcome (11 studies).43

Ambiguous Reporting

Ambiguous reporting, which involves the full reporting of relevant findings, but in a way that is misleading, has been received far less attention. Two examples from rofecoxib trials are illustrative. First, Psaty and Kronmal described contradictory representations ofmortality outcomes in two clinical trials of rofecoxib for patients with Alzheimer’s disease or cognitive impairment after reviewing the published articles59, 60 along with internal company analyses made available during litigation.61 The published articles reported the number of deaths among both subject arms (9 vs. 2 and 41 vs. 20 for rofecoxib and placebo, respectively) without providing statistical analysis and concluded rofecoxib was “well tolerated.” In contrast, as is clear from this data, an internal analysis conducted at least three years prior to publication of either trial found 3-fold increased risk of mortality among rofecoxib subjects.

Second, the VIGOR trial,62 which compared upper GI event incidence among patients with rheumatoid arthritis randomized to rofecoxib or naproxen, also published misleading findings. When presenting pain scores and GI event outcomes, rofecoxib was consistently “handled” as the intervention treatment, such that outcomes were described as rofecoxib users relative to naproxen users. However, when presenting general and cardiovascular safety outcomes, the risk ratios were “flipped” and outcomes were described as naproxen relative to rofecoxib.63 The risk for myocardial infarction was described as “less common in the naproxen group than in the rofecoxib group (0.1 percent vs. 0.4 percent; … relative risk, 0.2; 95 percent confidence interval, 0.1 to 0.7)”, as opposed to, more accurately, a relative risk in excess of 4.64 Unfortunately, this “flipping” of the efficacy and safety end points was only one of many problems in the conduct and publication of the VIGOR trial, for which the company, academic collaborators, and medical journal editors all bear some responsibility. The trial lacked a standard operating procedure for collecting cardiovascular adverse events, permitted financial conflicts of interest among scientific advisory board members, and used several methods to obscure the increased risk identified in the trial, such as excluding three cardiovascular events from analyses, performing a misleading post-hoc sub analysis among patients with “indications for aspirin”, and offering substantial speculation about the “naproxen hypothesis”.63

PROMOTING TRANSPARENCY

The practices reviewed highlight the potentially subversive role of industry in clinical trial research, wherein information that is relevant to patients and physicians is obscured, raising concerns about the integrity of the science and the potential for a distorted medical literature. To address these practices, there is a need for policies that promote transparency into the clinical trial research process, so that all relevant information is disclosed to the public, including patients, physicians, regulators, and policymakers, to at least partially mitigate industry’s undue influence. Broadly speaking, greater transparency is the process of making public the decisions or actions that were previously made out of the public eye. Three policies hold the greatest promise, but require thorough implementation and oversight: (1) complete public disclosure of research objectives and investigator roles, including study design and authorship contributions, as well as financial relationships; (2) public registration of clinical trials, including study enrollment, main outcomes, and study design; and (3) independent, objective analysis of clinical trial data (Table 2).

Table 2.

Policies that promote transparency and disclosure of all relevant information to the public, including patients, physicians, regulators, and policymakers, attenuating industry’s practices that undermine clinical trial research and distort the medical literature.

Policy Purpose
Uniform and complete disclosure of clinical trial investigator relationships and support from industry, along with industry sponsorship of clinical trial research. Provide comprehensive information for physicians, patients, and regulators about potential conflicts of interest and sources of bias for consideration when evaluating the clinical trial design, conduct, and findings.
Uniform and complete disclosure of clinical trial investigator contributions to trial design, conduct, and dissemination, for all investigators, regardless of industry affiliation. Provide comprehensive information for physicians, patients, and regulators about investigator roles and sources of bias for consideration when evaluating the clinical trial design, conduct, and findings.
Public registration of all human subject clinical trials, including registration of the study design and intervention, enrollment targets and sample size calculation, subject inclusion and exclusion criteria, primary and secondary outcomes, and pre-specified primary, secondary, and subgroup analyses. Identify trials that had previously been conducted but never published, as well as trials that deviate from protocol, reporting a secondary outcome as primary or not reporting certain outcomes, to include and inform systematic reviews and evidence-based practice guidelines.
Making participant-level clinical trial data available for independent analysis. Independent investigation that complements or validates key findings reported by industry or academic clinical trial researchers, as well as promotion of public use of data collected in the spirit of science that contributes to public knowledge, to improve public understanding of drug or device efficacy and safety.

Complete Disclosure

Full and complete public disclosure of individuals’ and industry’s roles and responsibilities in the clinical trial research process, as well as sponsorship of research, is critical for ensuring accountability and responsibility. Progress has already been made toward promoting transparency of investigator relationships and support from industry chiefly through actions of medical journal editors. During publication, disclosure has gradually intensified from requiring investigators to name industry sponsors of their research, to requiring disclosure of all potential financial conflicts of interest by naming companies from which they received payments related to research, consulting or other services, to the International Committee for Medical Journal Editors (ICMJE) recently adopting a uniform form for the disclosure of potential conflicts of interest65 that simplifies and standardizes financial disclosures. This standardization was particularly useful given the variability among journals in what information was required for disclosure and in what was published. However, in the past decade, other sources of information on financial payments from industry to physicians have materialized. First, individual states, such as Minnesota, Vermont, and Massachusetts, enacted legislation requiring pharmaceutical companies to disclose payments to physicians related to research, consulting, education and other work.66 Second, initially as a consequence of litigation settlements, pharmaceutical and medical device companies began publicly-disclosing these same payments, most often for service on speakers bureaus or educational honoraria. Finally, as part of the recently enacted Patient Protection and Affordable Care Act, the Physician Payment Sunshine provision requires drug, device, biologic and medical supply manufacturers to publicly report gifts and payments made to physicians and hospitals beginning in 2013. Although this information will provide the most comprehensive information to date with respect to physician payments from industry, one major limitation of the legislation is that payments related to clinical trials or product development are allowed a public disclosure delay of four years or until product approval, whichever comes first. Similarly, product development agreements for “new applications” are also allowed this delay. Therefore, the value of this legislation for promoting transparency with respect to investigator relationships and support from industry will need to be monitored.

Despite recent advances in disclosure of investigator relationships and support from industry, less progress has been made in requiring disclosure of contributions of all investigators, either industry-affiliated or not, who played a role in the design, conduct, and dissemination of a clinical trial. While some of the most prominent medical journals require investigator contributions to be disclosed, and publish this information, many other journals do not. Ideally, a standardized, uniform form, similar to the ICMJE’s form for the disclosure of potential conflicts of interest65, would be developed, widely adopted, and made publicly available for the disclosure of investigator contributions. Moreover, this disclosure should be adopted not only by medical journal editors, but also by any venue where clinical trial work is submitted or disseminated, including scientific conferences and media releases, as well as IRBs, the National Institute of Health (NIH) or other funders, FDA, and clinical trial registrations. To address the more thorny issues of ghostwriting and guest authorship, all authors should consistently, and explicitly, describe contributions to the research process for all manuscripts, regardless of a journal’s requirements. Authors who “sign-off” on or “edit” original publications or reviews should, at a minimum, offer full authorship disclosure, such as, ‘drafting of the manuscript was done by representatives from XYZ, Inc.; the authors were responsible for critical revisions of the manuscript for important intellectual content.’ A uniform and coordinated strategy, adopted by the ICMJE, FDA, NIH and others will be necessary to be successful.

Complete public disclosure of individuals’ and industry’s roles and responsibilities in the clinical trial research process, as well as in the sponsorship of research, will clarify investigator roles, potential conflicts of interest or sources of bias, and provide more comprehensive information for physicians, patients, and IRBs to consider when evaluating the research. Moreover, more comprehensive disclosure appeals to a sense of professionalism and ethical practice. However, additional work is needed to identify ways to improve the disclosure process. Social sciences research suggests that disclosure actually attenuates skepticism of research conduct, as opposed to raising concerns, when there are potential sources of conflict of interest.67 At this time, there is no evidence to suggest how disclosure of author contributions or financial conflicts of interest can be most effective. Perhaps disclosures need only be available on the medical journal website, or perhaps published at the end of every article, or perhaps published within an article’s abstract. Similarly, there is no evidence to suggest whether disclosure of financial conflicts of interest is sufficient, or if providing additional information is more effective, such as the amount of dollars paid to the investigator or the exact services provided, which may range from Advisory Board service to providing promotional talks.

Clinical Trial Registration

Public registration of clinical trials, including registration of the study design and intervention, enrollment targets and sample size calculation, subject inclusion and exclusion criteria, primary and secondary outcomes, and pre-specified primary, secondary, and subgroup analyses, is critical to ensure that the entire clinical trial research process can be publicly known. Through public registration, trials that had previously been conducted but never published can be found and included in systematic reviews. Moreover, trials that deviate from protocol, reporting a secondary outcome as primary or not reporting certain outcomes, can be identified. Over the past 15 years, several pieces of legislation have required increasingly more information about clinical trials to be publicly registered. First, Section 113 of the 1997 FDA Modernization Act was enacted in the United States in order to provide the public access to information about ongoing clinical trials in which they may be able to participate. The Act required the creation of a public resource for information on studies of drugs, including biological drug products, which treat “serious or life-threatening” diseases and conditions conducted under the FDA’s investigational new drug regulations and mandated the collection of specific descriptive information pertaining to each clinical trial. In response, the NLM established ClinicalTrials.gov, a Web-based registry, in 2000 to provide a publicly-available, easily-searchable, on-line source of information for all registered trials, including trials located domestically within the U.S. and internationally.

Then, in September 2007, the FDA Amendments Act (FDAAA) in the United States substantially expanded the registry by now requiring the sponsors of all drug, biologic, and device trials to register their studies, at inception, in ClinicalTrials.gov (with the exception of Phase I clinical trials). Moreover, it required updating the registry with information on participants and trial results for approved drugs and devices within 12 months of study completion (24 months if the studied drug is currently under review at the FDA); specifically, investigators must report the primary and principal secondary outcome results as well as safety results to ClinicalTrials.gov for inclusion within the publicly-available registry.

Public registration of clinical trials, which will allow comparison of protocol-specified primary and secondary outcomes and planned analyses with published trial findings holds great promise to minimize selective reporting of results. Furthermore, by simply requiring public registration of all trials, selective publication will be more easily identified. However, this legislation only requires registration of trials conducted within the United States or by U.S. investigators and could be circumvented by moving trials to sites outside of the U.S. Furthermore, penalties for not registering trials have yet to be issued. The success of public registration is dependent upon thorough oversight with significant penalties for non-compliance.

Independent Trial Data Analysis

Independent analysis of clinical trial data from publicly-sponsored trials or of approved drugs and devices is necessary not only to validate key findings, but also to ensure objectivity and promote public use of data collected in the spirit of science that contributes to public knowledge. Substantial amounts of clinical trial data routinely collected through industry (and non-industry) supported clinical trials have not been published or have only published selective findings. This vast repository of data could be used to improve public understanding of drug or device efficacy and safety.6870

While post-market summary-level meta-analyses have been conducted for decades, making participant-level clinical trial data available for independent analysis offers several key methodological advantages. First, most clinical trials are conducted expressly to examine drug efficacy for approval or a new indication. However, safety outcomes, as well as other data, are routinely collected within these trials but rarely independently examined. Participant-level data permits the pooling of several trials to analyze rare outcomes. Second, participant-level data allows for greater analytical flexibility, permitting the use of statistical methods to manage trial heterogeneity, as well as the investigation of specific subgroups of subjects. Finally, participant-level data enables pre-specification and re-definition of outcomes, including time-to-event analysis.71

Making this data available so that it can be used by independent investigators to complement and corroborate post-market pharmaceutical surveillance done by the FDA and industry will go a long way toward improving the public’s health. To promote a central repository for all of this information, this data could be stored and accessed through ClinicalTrials.gov, which is already being expanded to include registration of all trials, as well as trial results, through FDAAA. Data availability plans would need to be negotiated among all trial sponsors, including how much time after study completion until the data could be publicly-accessed. One possibility would be a data application process that would be reviewed by an independent board similar to the Patient-Centered Outcomes Research Institute, with seats for industry, academics, and government officials. In addition, the NIH promotes access to data collected through large awards72 and several NIH-sponsored observational studies, such as the Health and Retirement Study and the Cardiovascular Health Study, permit public-access to study data, providing a blue print for the creation of similar access to clinical trial data. To be clear, our proposal goes beyond the current debate taking place within the medical journal community about whether industry-sponsored clinical trials need to be independently analyzed prior to publication. We are suggesting that all trial data be made available for public scrutiny, regardless of whether or where the findings are published.

The importance of independent analysis is illustrated by a cumulative pooled analysis we recently conducted using participant-level data of published and unpublished placebo-controlled trials of rofecoxib produced as a part of litigation.73 We were interested in whether the drug’s cardiovascular risk could have been identified before its withdrawal, despite there being three previously-conducted company-sponsored meta-analyses demonstrating no increased risk.7476 We found that pooling clinical trial data demonstrated progressively increased cardiovascular risk as early as December 2000 and reached a P value of 0.05 by June 2001, nearly 3 and a half years before the manufacturer’s voluntary market withdrawal.73 This issue is similarly illustrated by the recent controversy surrounding oseltamavir (Tamiflu). In the process of updating Cochrane Collaborative systematic review, several important research data inconsistencies were found. The drug’s manufacturer, Roche Pharmaceutical, although initially declined to share the requested data to resolve these inconsistencies, eventually provided select files that did not fully address concerns.77 The editors of the British Medical Journal write, “In being less than forthcoming with the raw data, Roche has does nothing wrong by current standards. It has done exactly what the current system allows.”77 They later conclude “When vast quantities of public money, and large amount of public trust, are placed in drugs, the full data must be accessible for scrutiny by the scientific community.”77

Conclusion

Physicians and the public deserve to be in a position to make informed choices about drug and device risks and benefits. Strong, evidence-based practice requires that objective, unbiased research is available to inform individual clinical decisions, systematic reviews, meta-analyses, and expert guideline recommendations. Seeding trials, publication planning, messaging, and ghostwriting, as well as selective publication and reporting of trial outcomes have been used by industry to distort the medical literature and undermine clinical trial research, explicitly by obscuring information that is relevant to patients and physicians. Policies that promote transparency into the clinical trial research process, through improved and expanded disclosure of investigator contributions and funding, comprehensive publicly-available trial registration, and independent analysis of clinical trial data, have the potential to address, at least partially, these subversive practices. These policies will improve accountability among industry and investigators for clinical trial research practice, minimizing the impact of marketing objectives while strengthening the science, which will in turn protect both the integrity of the medical literature as well as the public’s health.

Acknowledgments

Funding/Support: This manuscript was supported by a $1000 stipend from the Institute on Medicine as a Profession in New York, NY. Dr. Ross is currently supported by the National Institute on Aging (K08AG032886) and the American Federation of Aging Research through the Paul B. Beeson Career Development Award Program.

Footnotes

Financial Disclosures: Drs. Ross and Krumholz were consultants at the request of plaintiffs in litigation against Merck and Co., Inc. related to rofecoxib in the United States from 2006–2007. Dr. Gross served as an expert witness in a case involving disclosure of financial ties in the research setting at the request of a plaintiff in 2007. Dr. Krumholz has had research contracts with the American College of Cardiology and the Colorado Foundation for Medical Care; has previously served on the advisory boards of Alere and Amgen, and currently serves on one with UnitedHealthcare; is a scientific advisor for Centegen; has been a subject expert for VHA, Inc.; has received speakers’ compensation from the American College of Cardiology; and is Editor-in-Chief of Circulation: Cardiovascular Quality and Outcomes, and Journal Watch Cardiology of the Massachusetts Medical Society.

Contributor Statement

All authors were responsible for the conception and design of the manuscript as well as for critical revision of the manuscript for important intellectual content. Dr. Ross was also responsible for drafting of the manuscript.

Human Participant Protection: n/a

References

  • 1.Bekelman JE, Li Y, Gross CP. Scope and impact of financial conflicts of interest in biomedical research: a systematic review. JAMA. 2003 Jan 22–29;289(4):454–465. doi: 10.1001/jama.289.4.454. [DOI] [PubMed] [Google Scholar]
  • 2.Bhandari M, Busse JW, Jackowski D, et al. Association between industry funding and statistically significant pro-industry findings in medical and surgical randomized trials. CMAJ. 2004 Feb 17;170(4):477–480. [PMC free article] [PubMed] [Google Scholar]
  • 3.Ridker PM, Torres J. Reported outcomes in major cardiovascular clinical trials funded by for-profit and not-for-profit organizations: 2000–2005. JAMA. 2006 May 17;295(19):2270–2274. doi: 10.1001/jama.295.19.2270. [DOI] [PubMed] [Google Scholar]
  • 4.Davidoff F. Between the lines: navigating the uncharted territory of industry-sponsored research. Health Aff (Millwood) 2002 Mar–Apr;21(2):235–242. doi: 10.1377/hlthaff.21.2.235. [DOI] [PubMed] [Google Scholar]
  • 5.Davidoff F, DeAngelis CD, Drazen JM, et al. Sponsorship, authorship, and accountability. JAMA. 2001 Sep 12;286(10):1232–1234. doi: 10.1001/jama.286.10.1232. [DOI] [PubMed] [Google Scholar]
  • 6.Institute of Medicine. Conflict of interest in medical research, education, and practice. Washington, DC: National Academy Press; 2009. [PubMed] [Google Scholar]
  • 7.Angell M. The Truth About the Drug Companies: How They Deceive Us and What To Do About It. New York: Random House; 2004. [Google Scholar]
  • 8.Kassirer JP. On The Take: How America’s Complicity With Big Business Can Endanger Your Health. New York: Oxford University Press; 2004. [Google Scholar]
  • 9.Als-Nielsen B, Chen W, Gluud C, Kjaergard LL. Association of funding and conclusions in randomized drug trials: a reflection of treatment effect or adverse events? JAMA. 2003 Aug 20;290(7):921–928. doi: 10.1001/jama.290.7.921. [DOI] [PubMed] [Google Scholar]
  • 10.Djulbegovic B, Lacevic M, Cantor A, et al. The uncertainty principle and industry-sponsored research. Lancet. 2000 Aug 19;356(9230):635–638. doi: 10.1016/S0140-6736(00)02605-2. [DOI] [PubMed] [Google Scholar]
  • 11.Kjaergard LL, Als-Nielsen B. Association between competing interests and authors’ conclusions: epidemiological study of randomised clinical trials published in the BMJ. BMJ. 2002 Aug 3;325(7358):249. doi: 10.1136/bmj.325.7358.249. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Rennie D. Fair conduct and fair reporting of clinical trials. JAMA. 1999 Nov 10;282(18):1766–1768. doi: 10.1001/jama.282.18.1766. [DOI] [PubMed] [Google Scholar]
  • 13.Sismondo S. How pharmaceutical industry funding affects trial outcomes: causal structures and responses. Soc Sci Med. 2008 May;66(9):1909–1914. doi: 10.1016/j.socscimed.2008.01.010. [DOI] [PubMed] [Google Scholar]
  • 14.Johansen HK, Gotzsche PC. Problems in the design and reporting of trials of antifungal agents encountered during meta-analysis. JAMA. 1999 Nov 10;282(18):1752–1759. doi: 10.1001/jama.282.18.1752. [DOI] [PubMed] [Google Scholar]
  • 15.Psaty BM, Weiss NS, Furberg CD. Recent trials in hypertension: compelling science or commercial speech? JAMA. 2006 Apr 12;295(14):1704–1706. doi: 10.1001/jama.295.14.1704. [DOI] [PubMed] [Google Scholar]
  • 16.Safer DJ. Design and reporting modifications in industry-sponsored comparative psychopharmacology trials. J Nerv Ment Dis. 2002 Sep;190(9):583–592. doi: 10.1097/00005053-200209000-00002. [DOI] [PubMed] [Google Scholar]
  • 17.Spielmans GI, Biehn TL, Sawrey DL. A case study of salami slicing: pooled analyses of duloxetine for depression. Psychother Psychosom. 2010;79(2):97–106. doi: 10.1159/000270917. [DOI] [PubMed] [Google Scholar]
  • 18.Gotzsche PC. Multiple publication of reports of drug trials. Eur J Clin Pharmacol. 1989;36(5):429–432. doi: 10.1007/BF00558064. [DOI] [PubMed] [Google Scholar]
  • 19.Huston P, Moher D. Redundancy, disaggregation, and the integrity of medical research. Lancet. 1996 Apr 13;347(9007):1024–1026. doi: 10.1016/s0140-6736(96)90153-1. [DOI] [PubMed] [Google Scholar]
  • 20.Greenland P, Lloyd-Jones D. Critical lessons from the ENHANCE trial. JAMA. 2008 Feb 27;299(8):953–955. doi: 10.1001/jama.299.8.953. [DOI] [PubMed] [Google Scholar]
  • 21.Kessler DA, Rose JL, Temple RJ, Schapiro R, Griffin JP. Therapeutic-class wars--drug promotion in a competitive marketplace. N Engl J Med. 1994 Nov 17;331(20):1350–1353. doi: 10.1056/NEJM199411173312007. [DOI] [PubMed] [Google Scholar]
  • 22.Stephens MD. Marketing aspects of company-sponsored postmarketing surveillance studies. Drug Saf. 1993 Jan;8(1):1–8. doi: 10.2165/00002018-199308010-00001. [DOI] [PubMed] [Google Scholar]
  • 23.Psaty BM, Rennie D. Clinical trial investigators and their prescribing patterns: another dimension to the relationship between physician investigators and the pharmaceutical industry. JAMA. 2006 Jun 21;295(23):2787–2790. doi: 10.1001/jama.295.23.2787. [DOI] [PubMed] [Google Scholar]
  • 24.Krumholz SD, Egilman DS, Ross JS. STEPS: A Narrative Account of a Gabapentin Seeding Trial. Arch Intern Med. doi: 10.1001/archinternmed.2011.241. In press. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Hill KP, Ross JS, Egilman DS, Krumholz HM. The ADVANTAGE seeding trial: a review of internal documents. Ann Intern Med. 2008 Aug 19;149(4):251–258. doi: 10.7326/0003-4819-149-4-200808190-00006. [DOI] [PubMed] [Google Scholar]
  • 26.Lisse JR, Perlman M, Johansson G, et al. Gastrointestinal tolerability and effectiveness of rofecoxib versus naproxen in the treatment of osteoarthritis: a randomized, controlled trial. Ann Intern Med. 2003 Oct 7;139(7):539–546. doi: 10.7326/0003-4819-139-7-200310070-00005. [DOI] [PubMed] [Google Scholar]
  • 27.Steinman MA, Bero LA, Chren MM, Landefeld CS. Narrative review: the promotion of gabapentin: an analysis of internal industry documents. Ann Intern Med. 2006 Aug 15;145(4):284–293. doi: 10.7326/0003-4819-145-4-200608150-00008. [DOI] [PubMed] [Google Scholar]
  • 28.Healy D, Cattell D. Interface between authorship, industry and science in the domain of therapeutics. Br J Psychiatry. 2003 Jul;183:22–27. [PubMed] [Google Scholar]
  • 29.Sismondo S. Ghost management: how much of the medical literature is shaped behind the scenes by the pharmaceutical industry? PLoS Med. 2007 Sep;4(9):e286. doi: 10.1371/journal.pmed.0040286. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Sismondo S. Ghosts in the machine: publication planning in the medical sciences. Soc Stud Sci. 2009 Apr;39(2):171–198. doi: 10.1177/0306312708101047. [DOI] [PubMed] [Google Scholar]
  • 31.Sismondo S, Nicholson SH. Publication planning 101. J Pharm Pharm Sci. 2009;12(3):273–279. doi: 10.18433/j3ww2r. [DOI] [PubMed] [Google Scholar]
  • 32.Ross JS, Hill KP, Egilman DS, Krumholz HM. Guest authorship and ghostwriting in publications related to rofecoxib: a case study of industry documents from rofecoxib litigation. JAMA. 2008 Apr 16;299(15):1800–1812. doi: 10.1001/jama.299.15.1800. [DOI] [PubMed] [Google Scholar]
  • 33.Golden GA, Parochka JN, Overstreet KM. Medical education and communication companies: an updated in-depth profile. J Contin Educ Health Prof. 2002 Winter;22(1):55–62. doi: 10.1002/chp.1340220107. [DOI] [PubMed] [Google Scholar]
  • 34.Ross JS, Lurie P, Wolfe S. Medical Education Service Suppliers (MESS): A threat to physician education (HRG Publication #1530) [Accessed January 17, 2011.]; http://www.citizen.org/publications/publicationredirect.cfm?ID=7142.
  • 35.Rennie D, Flanagin A. Authorship! Authorship! Guests, ghosts, grafters, and the two-sided coin. JAMA. 1994 Feb 9;271(6):469–471. doi: 10.1001/jama.271.6.469. [DOI] [PubMed] [Google Scholar]
  • 36.Rennie D, Yank V, Emanuel L. When authorship fails. A proposal to make contributors accountable. JAMA. 1997 Aug 20;278(7):579–585. doi: 10.1001/jama.278.7.579. [DOI] [PubMed] [Google Scholar]
  • 37.Ghostwriting: the dirty little secret of medical publishing that just got bigger. PLoS Med. 2009 Sep;6(9):e1000156. doi: 10.1371/journal.pmed.1000156. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.SmithKline Beecham Pharmaceuticals. [Accessed January 17, 2011.];Re: Paxil, Case Study Publications for Peer Review. http://i.bnet.com/blogs/par000570546-59-caspper-case-study-pub-for-peer-review.pdf?tag=content;selector-perfector.
  • 39.Fugh-Berman A. The corporate coauthor. J Gen Intern Med. 2005 Jun;20(6):546–548. doi: 10.1111/j.1525-1497.2005.05857.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Mello MM, Clarridge BR, Studdert DM. Academic medical centers’ standards for clinical-trial agreements with industry. N Engl J Med. 2005 May 26;352(21):2202–2210. doi: 10.1056/NEJMsa044115. [DOI] [PubMed] [Google Scholar]
  • 41.Chan AW, Hrobjartsson A, Haahr MT, Gotzsche PC, Altman DG. Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA. 2004 May 26;291(20):2457–2465. doi: 10.1001/jama.291.20.2457. [DOI] [PubMed] [Google Scholar]
  • 42.Chan AW, Krleza-Jeric K, Schmid I, Altman DG. Outcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research. CMAJ. 2004 Sep 28;171(7):735–740. doi: 10.1503/cmaj.1041086. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R. Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med. 2008 Jan 17;358(3):252–260. doi: 10.1056/NEJMsa065779. [DOI] [PubMed] [Google Scholar]
  • 44.Dickersin K, Min YI, Meinert CL. Factors influencing publication of research results. Follow-up of applications submitted to two institutional review boards. JAMA. 1992 Jan 15;267(3):374–378. [PubMed] [Google Scholar]
  • 45.Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR. Publication bias in clinical research. Lancet. 1991 Apr 13;337(8746):867–872. doi: 10.1016/0140-6736(91)90201-y. [DOI] [PubMed] [Google Scholar]
  • 46.Ioannidis JP. Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. JAMA. 1998 Jan 28;279(4):281–286. doi: 10.1001/jama.279.4.281. [DOI] [PubMed] [Google Scholar]
  • 47.Krzyzanowska MK, Pintilie M, Tannock IF. Factors associated with failure to publish large randomized trials presented at an oncology meeting. JAMA. 2003 Jul 23;290(4):495–501. doi: 10.1001/jama.290.4.495. [DOI] [PubMed] [Google Scholar]
  • 48.Misakian AL, Bero LA. Publication bias and research on passive smoking: comparison of published and unpublished studies. JAMA. 1998 Jul 15;280(3):250–253. doi: 10.1001/jama.280.3.250. [DOI] [PubMed] [Google Scholar]
  • 49.Stern JM, Simes RJ. Publication bias: evidence of delayed publication in a cohort study of clinical research projects. BMJ. 1997 Sep 13;315(7109):640–645. doi: 10.1136/bmj.315.7109.640. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Dwan K, Altman DG, Arnaiz JA, et al. Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PLoS ONE. 2008;3(8):e3081. doi: 10.1371/journal.pone.0003081. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Ross JS, Mulvey GK, Hines EM, Nissen SE, Krumholz HM. Trial publication after registration in ClinicalTrials.Gov: a cross-sectional analysis. PLoS Med. 2009 Sep;6(9):e1000144. doi: 10.1371/journal.pmed.1000144. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Rising K, Bacchetti P, Bero L. Reporting bias in drug trials submitted to the food and drug administration: review of publication and presentation. PLoS Med. 2008 Nov 25;5(11):e217. doi: 10.1371/journal.pmed.0050217. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Kastelein JJ, Akdim F, Stroes ES, et al. Simvastatin with or without ezetimibe in familial hypercholesterolemia. N Engl J Med. 2008 Apr 3;358(14):1431–1443. doi: 10.1056/NEJMoa0800742. [DOI] [PubMed] [Google Scholar]
  • 54.Jackevicius CA, Tu JV, Ross JS, Ko DT, Krumholz HM. Use of ezetimibe in the United States and Canada. N Engl J Med. 2008 Apr 24;358(17):1819–1828. doi: 10.1056/NEJMsa0801461. [DOI] [PubMed] [Google Scholar]
  • 55.Kesselheim AS, Avorn J. The role of litigation in defining drug risks. JAMA. 2007 Jan 17;297(3):308–311. doi: 10.1001/jama.297.3.308. [DOI] [PubMed] [Google Scholar]
  • 56.Keller MB, Ryan ND, Strober M, et al. Efficacy of paroxetine in the treatment of adolescent major depression: a randomized, controlled trial. J Am Acad Child Adolesc Psychiatry. 2001 Jul;40(7):762–772. doi: 10.1097/00004583-200107000-00010. [DOI] [PubMed] [Google Scholar]
  • 57.Jureidini JN, McHenry LB, Mansfield PB. Clinical trials and drug promotion: selective reporting of study 329. Int J Risk Saf Med. 2008;20:73–81. [Google Scholar]
  • 58.Vedula SS, Bero L, Scherer RW, Dickersin K. Outcome reporting in industry-sponsored trials of gabapentin for off-label use. N Engl J Med. 2009 Nov 12;361(20):1963–1971. doi: 10.1056/NEJMsa0906126. [DOI] [PubMed] [Google Scholar]
  • 59.Reines SA, Block GA, Morris JC, et al. Rofecoxib: no effect on Alzheimer’s disease in a 1-year, randomized, blinded, controlled study. Neurology. 2004 Jan 13;62(1):66–71. doi: 10.1212/wnl.62.1.66. [DOI] [PubMed] [Google Scholar]
  • 60.Thal LJ, Ferris SH, Kirby L, et al. A randomized, double-blind, study of rofecoxib in patients with mild cognitive impairment. Neuropsychopharmacology. 2005 Jun;30(6):1204–1215. doi: 10.1038/sj.npp.1300690. [DOI] [PubMed] [Google Scholar]
  • 61.Psaty BM, Kronmal RA. Reporting mortality findings in trials of rofecoxib for Alzheimer disease or cognitive impairment: a case study based on documents from rofecoxib litigation. JAMA. 2008 Apr 16;299(15):1813–1817. doi: 10.1001/jama.299.15.1813. [DOI] [PubMed] [Google Scholar]
  • 62.Bombardier C, Laine L, Reicin A, et al. Comparison of upper gastrointestinal toxicity of rofecoxib and naproxen in patients with rheumatoid arthritis. VIGOR Study Group. N Engl J Med. 2000 Nov 23;343(21):1520–1528. 1522. doi: 10.1056/NEJM200011233432103. following 1528. [DOI] [PubMed] [Google Scholar]
  • 63.Krumholz HM, Ross JS, Presler AH, Egilman DS. What have we learnt from Vioxx? BMJ. 2007 Jan 20;334(7585):120–123. doi: 10.1136/bmj.39024.487720.68. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Curfman GD, Morrissey S, Drazen JM. Expression of concern: Bombardier et al., “Comparison of upper gastrointestinal toxicity of rofecoxib and naproxen in patients with rheumatoid arthritis,” N Engl J Med 2000;343:1520–8. N Engl J Med. 2005 Dec 29;353(26):2813–2814. doi: 10.1056/NEJMe058314. [DOI] [PubMed] [Google Scholar]
  • 65.Drazen JM, Van Der Weyden MB, Sahni P, et al. Uniform format for disclosure of competing interests in ICMJE journals. CMAJ. 2009 Oct 27;181(9):565. doi: 10.1503/cmaj.091691. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Ross JS, Lackner JE, Lurie P, Gross CP, Wolfe S, Krumholz HM. Pharmaceutical company payments to physicians: early experiences with disclosure laws in Vermont and Minnesota. JAMA. 2007 Mar 21;297(11):1216–1223. doi: 10.1001/jama.297.11.1216. [DOI] [PubMed] [Google Scholar]
  • 67.Cain DM, Loewenstei G, Moore DA. The Dirt on Coming Clean: Perverse effects of disclosing conflicts of interest. Journal of Legal Studies. 2005 January;34(1):1–25. [Google Scholar]
  • 68.Hrynaszkiewicz I, Norton ML, Vickers AJ, Altman DG. Preparing raw clinical data for publication: guidance for journal editors, authors, and peer reviewers. BMJ. 2010 February 6;340:304–307. doi: 10.1136/bmj.c181. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.Hrynaszkiewicz I, Altman DG. Towards agreement on best practice for publishing raw clinical trial data. Trials. 2009 March 18;10:17. doi: 10.1186/1745-6215-10-17. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Vickers AJ. Whose data set is it anyway? Sharing raw data from randomized trials. Trials. 2006 May 16;7:15. doi: 10.1186/1745-6215-7-15. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Riley RD, Lambert PC, Abo-Zaid G. Meta-analysis of individual participant data: rationale, conduct, and reporting. BMJ. 2010;340:c221. doi: 10.1136/bmj.c221. [DOI] [PubMed] [Google Scholar]
  • 72.National Institutes of Health. [Accessed January 17, 2011.];NIH Grants Policy Statement, Part II: Terms and Conditions of NIH Grant Awards, Subpart A: General, Section 8: Administrative Requirements, 8.2.3.1 Data Sharing Policy. 2010 October 15; http://grants.nih.gov/grants/policy/nihgps_2010/nihgps_ch8.htm#_Toc271264950.
  • 73.Ross JS, Madigan D, Hill KP, Egilman DS, Wang Y, Krumholz HM. Pooled analysis of rofecoxib placebo-controlled clinical trial data: lessons for postmarket pharmaceutical safety surveillance. Arch Intern Med. 2009 Nov 23;169(21):1976–1985. doi: 10.1001/archinternmed.2009.394. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Konstam MA, Weir MR, Reicin A, et al. Cardiovascular thrombotic events in controlled, clinical trials of rofecoxib. Circulation. 2001 Nov 6;104(19):2280–2288. doi: 10.1161/hc4401.100078. [DOI] [PubMed] [Google Scholar]
  • 75.Reicin AS, Shapiro D, Sperling RS, Barr E, Yu Q. Comparison of cardiovascular thrombotic events in patients with osteoarthritis treated with rofecoxib versus nonselective nonsteroidal anti-inflammatory drugs (ibuprofen, diclofenac, and nabumetone) Am J Cardiol. 2002 Jan 15;89(2):204–209. doi: 10.1016/s0002-9149(01)02201-9. [DOI] [PubMed] [Google Scholar]
  • 76.Weir MR, Sperling RS, Reicin A, Gertz BJ. Selective COX-2 inhibition and cardiovascular effects: a review of the rofecoxib development program. Am Heart J. 2003 Oct;146(4):591–604. doi: 10.1016/S0002-8703(03)00398-3. [DOI] [PubMed] [Google Scholar]
  • 77.Godlee F, Clarke M. Why don’t we have all the evidence on oseltamivir? BMJ. 2009;339:b5351. doi: 10.1136/bmj.b5351. [DOI] [PubMed] [Google Scholar]

RESOURCES