Skip to main content
European Respiratory Review logoLink to European Respiratory Review
editorial
. 2018 Sep 26;27(149):180080. doi: 10.1183/16000617.0080-2018

Randomised controlled trials and real-life studies: two answers for one question

Sergio Harari 1
PMCID: PMC9488996  PMID: 30257909

Real-life studies have become increasingly important in the scientific world in recent years. Although they have numerous limitations, they have the advantage of better representing the population with which we normally have to deal in our everyday clinical practice. Randomised controlled trials (RCTs) remain the most effective form of evaluation of the efficacy of a therapeutic intervention to date, but their selection criteria limit the recruitment of patients in upper or lower age ranges or suffering from multiple comorbidities. These are individuals who are suffering from severe medical conditions and take several different medications, and these are the subjects we meet and we take care of when taking charge of the general population. This is so true that in some RCTs the screening failure rate has exceeded 70% of patients [1]. Therefore, integrating RCTs with real-life studies is increasingly important, as is deepening the discussion of the selection criteria used in the registration studies, so that they better reflect the true situation of our patients. Moving from the ideal world to the real world may represent a hazardous shock that in the past has caused both surprises and bitter disappointments [2].

Short abstract

Real-life studies have a place alongside randomised controlled trials http://ow.ly/7S5Q30lCiYN


Real-life studies have become increasingly important in the scientific world in recent years. Although they have numerous limitations, they have the advantage of better representing the population with which we normally have to deal in our everyday clinical practice. Randomised controlled trials (RCTs) remain the most effective form of evaluation of the efficacy of a therapeutic intervention to date, but their selection criteria limit the recruitment of patients in upper or lower age ranges or suffering from multiple comorbidities. These are individuals who are suffering from severe medical conditions and take several different medications, and these are the subjects we meet and we take care of when taking charge of the general population. This is so true that in some RCTs the screening failure rate has exceeded 70% of patients [1]. Therefore, integrating RCTs with real-life studies is increasingly important, as is deepening the discussion of the selection criteria used in the registration studies, so that they better reflect the true situation of our patients. Moving from the ideal world to the real world may represent a hazardous shock that in the past has caused both surprises and bitter disappointments [2].

Recently, an article in Nature highlighted these problems, noting that: “Nearly 20% of publicly funded cancer clinical trials in the United States fail because investigators are unable to enrol enough participants” [3]. The author, quoting some American researchers, recalls HIV as an example of questionable selection criteria: “People with HIV, for example, were once excluded from trials because of their poor prognosis. Now, with treatment, they often live as long as people without the virus and should be included in many cancer trials”. The same source also questions the age for participation in clinical trials: is the age of 18 years an appropriate limit, even though the metabolism of drugs is already mature long before this time? The same could apply to upper age limits. This article also indicates that: “A joint project by the FDA [US Food and Drug Administration], the American Society of Clinical Oncology (ASCO) in Alexandria, Virginia, and the advocacy group Friends of Cancer Research in Washington DC has found that five common criteria for cancer-trial eligibility often could be amended without harming participants or the integrity of the trial” [4].

These are all legitimate questions that can be used to encourage a debate, which today has not yet yielded precise answers but which should be further explored, without prejudice to the fundamental role of the RCTs. Real-life studies have several limitations and should be interpreted cautiously, although they can fill the important gap between efficacy and effectiveness: efficacy meaning proof in a carefully controlled trial, and effectiveness meaning success in the circumstances of everyday life [2]. However, even today, these studies are considered by the scientific community to be of lesser dignity, while the possibility of their being published in prestigious journals remains very limited; and yet, effectiveness is what interests us the most.

Footnotes

Provenance: Submitted article, peer reviewed.

Conflict of interest: S. Harari has relationships with drug companies. In addition to being investigator in trials involving these companies, relationships include lectures and membership of scientific advisory boards.

References

  • 1.King TE Jr, Bradford WZ, Castro-Bernardini S, et al. . A phase 3 trial of pirfenidone in patients with idiopathic pulmonary fibrosis. N Engl J Med 2014; 370: 2083–2092. [DOI] [PubMed] [Google Scholar]
  • 2.Harari S, Caminati A. Idiopathic pulmonary fibrosis: from clinical trials to real-life experiences. Eur Respir Rev 2015; 24: 420–427. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Ledford H. Cancer researchers push to relax rules for clinical trials. Nature 2018; 556: 12–13. [DOI] [PubMed] [Google Scholar]
  • 4.Kim ES, Bruinooge SS, Roberts S, et al. . Broadening eligibility criteria to make clinical trials more representative: American Society of Clinical Oncology and Friends of Cancer Research Joint Research Statement. J Clin Oncol 2017; 35: 3737–3744. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from European Respiratory Review are provided here courtesy of European Respiratory Society

RESOURCES