Skip to main content
American Journal of Respiratory and Critical Care Medicine logoLink to American Journal of Respiratory and Critical Care Medicine
editorial
. 2014 Apr 15;189(8):875–877. doi: 10.1164/rccm.201402-0362ED

Understanding and Improving Clinical Trial Outcome Measures in Acute Respiratory Failure

Dale M Needham 1
PMCID: PMC4098102  PMID: 24735026

The critical care community conducts significant research, with over 850 trials in the National Institutes of Health registry (1). To facilitate the synthesis and interpretation of findings across these studies, and effectively and efficiently advance clinical research toward improved patient outcomes, randomized controlled trials (RCTs) must be performed using valid and comparable outcome measures.

The Call for Standardization of Outcome Measures in RCTs

RCTs demonstrate substantial variability in outcome measures across many different clinical specialties (2). Within critical care medicine, there has been relatively little critical evaluation of outcome measures used in clinical research. This finding has led to recommendations from a number of national and international groups, including Roundtable conferences (1, 3), two workshops of the National Heart, Lung, and Blood Institute (NHLBI) (4, 5), the Society of Critical Care Medicine (6), and the Multisociety Task Force for Critical Care Research (7). These recommendations call for researchers to critically evaluate outcome measures, and use valid, appropriate, standardized measures across studies.

Outcome Measures in Trials of Patients with Acute Respiratory Failure

In this issue of the Journal, Blackwood and colleagues (pp. 886–893) (8) and Contentin and colleagues (pp. 998–1002) (9) each publish reports critically evaluating mechanical ventilation–related outcome measures from trials published in high-impact journals. Findings from these reports are consistent, demonstrating that no more than 25% of mechanical ventilation trials reported a definition for mechanical ventilation duration, and approximately 65% reported a definition of ventilator-free days. Among those reporting definitions, importantly, there was substantial variability in both the definition used and the time point of evaluation. Furthermore, the report by Contentin and colleagues (9) provides a detailed description of seven items requiring consideration when defining and calculating mechanical ventilation duration and ventilator-free days as outcome measures.

In addition to standardizing definitions, important issues remain regarding appropriate, standardized timing of outcome assessments and the associated methods for patient follow-up over this time period. This issue of timing is important, because interventions in critically ill patients may have benefits or harms well beyond hospital discharge or 28-day follow up (10, 11), and inferences regarding the effect of critical care interventions may change with longer durations of follow up (12, 13). Determining the optimal duration of follow-up will depend on the specific intervention and outcome being evaluated, and requires additional empirical research to understand patients’ typical trajectories of recovery after critical illness (14).

Even after considering issues of definitions and timing, there is a need for greater recognition that, even without an effect on mortality or mechanical ventilation duration, interventions in the intensive care unit may have important effects on survivors’ long-term functional outcomes (15). These functional outcomes fall across a wide range of domains, including aspects of physical, cognitive, and mental health (6). Recent RCTs of patients with acute respiratory failure provide examples of successful evaluation of these important functional outcomes over 6- to 12-month follow-up periods (16, 17).

In evaluating functional outcomes after hospital discharge, additional methodological considerations arise. Issues such as loss to follow up and censoring due to death may bias study results. More specifically, loss to follow up contributes to missing data and selection bias, whereas censoring due to death can bias the estimated effect of an intervention when there is differential mortality between treatment groups (18).

The Way Forward to Improving Outcome Measurement

Across clinical specialties, there is an international effort for reaching consensus on outcome measures and establishing “core outcome sets” that represent agreed-upon, standardized collections of outcome measures that will be reported in all trials within a clinical area (19). A well established example of work in this area comes from rheumatology, where, for more than 20 years, the Outcome Measures for Rheumatology Clinical Trials collaboration has been working to establish core outcome sets (20). Moreover, across clinical specialties, there is the Core Outcome Measures in Effectiveness Trials (COMET) initiative (http://www.comet-initiative.org/) that has an active database with more than 490 references of work planned, in process, or completed with respect to core outcome sets.

For trials of critically ill patients, plans for moving forward are developing (Figure 1). For instance, within the COMET initiative, there are at least three projects in the planning or execution phases that focus on core outcome sets in the areas of: (1) mechanical ventilation outcomes; (2) rehabilitation outcomes; and (3) long-term functional outcomes. In addition, the NHLBI has recently funded a new 5-year, investigator-initiated, national resource–related research project (R24HL111895) to create and disseminate resources related to: (1) establishing core outcome sets for long-term physical, cognitive, and mental health outcomes in survivors of acute respiratory failure and acute respiratory distress syndrome; (2) maximizing cohort retention in long-term, longitudinal research studies; and (3) developing statistical methods and programs for addressing censoring due to death in evaluation of long-term functional outcomes.

Figure 1.

Figure 1.

An approach to understanding and improving clinical trial outcome measures in acute respiratory failure.

The methodological work and efforts to establish core outcome set projects have potential for international input and uptake via the existing International Forum for Acute Care Trialists (InFACT; http://www.infactglobal.org) group. InFACT is a global collaboration of more than 20 investigator-led clinical research consortia. InFACT’s Outcomes Measurement Group, with representation from these research consortia, is actively working in this area.

In summary, there are clear recommendations for greater standardization of outcome measures in clinical trials evaluating patients with acute respiratory failure, and objective data in this issue of the Journal support these recommendations. With recent initiatives, collaborations, and NHLBI funding, there are exciting new opportunities to make progress in understanding and improving clinical trial outcome measures in acute respiratory failure.

Footnotes

Supported by National Heart, Lung, and Blood Institute/National Institutes of Health grant R24HL111895.

Author disclosures are available with the text of this article at www.atsjournals.org.

References

  • 1.Angus DC, Mira JP, Vincent JL. Improving clinical trials in the critically ill. Crit Care Med. 2010;38:527–532. doi: 10.1097/CCM.0b013e3181c0259d. [DOI] [PubMed] [Google Scholar]
  • 2.Dinan MA, Compton KL, Dhillon JK, Hammill BG, Dewitt EM, Weinfurt KP, Schulman KA. Use of patient-reported outcomes in randomized, double-blind, placebo-controlled clinical trials. Med Care. 2011;49:415–419. doi: 10.1097/MLR.0b013e3182064aa2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Angus DC, Carlet J 2002 Brussels Roundtable Participants. Surviving intensive care: a report from the 2002 Brussels Roundtable. Intensive Care Med. 2003;29:368–377. doi: 10.1007/s00134-002-1624-8. [DOI] [PubMed] [Google Scholar]
  • 4.Spragg RG, Bernard GR, Checkley W, Curtis JR, Gajic O, Guyatt G, Hall J, Israel E, Jain M, Needham DM, et al. Beyond mortality: future clinical research in acute lung injury. Am J Respir Crit Care Med. 2010;181:1121–1127. doi: 10.1164/rccm.201001-0024WS. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Lieu TA, Au D, Krishnan JA, Moss M, Selker H, Harabin A, Taggart V, Connors A Comparative Effectiveness Research in Lung Diseases Workshop Panel. Comparative effectiveness research in lung diseases and sleep disorders: recommendations from the National Heart, Lung, and Blood Institute workshop. Am J Respir Crit Care Med. 2011;184:848–856. doi: 10.1164/rccm.201104-0634WS. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Needham DM, Davidson J, Cohen H, Hopkins RO, Weinert C, Wunsch H, Zawistowski C, Bemis-Dougherty A, Berney SC, Bienvenu OJ, et al. Improving long-term outcomes after discharge from intensive care unit: report from a stakeholders’ conference. Crit Care Med. 2012;40:502–509. doi: 10.1097/CCM.0b013e318232da75. [DOI] [PubMed] [Google Scholar]
  • 7.Deutschman CS, Ahrens T, Cairns CB, Sessler CN, Parsons PE Critical Care Societies CollaborativeUSCIITG Task Force on Critical Care Research. Multisociety Task Force for Critical Care Research: key issues and recommendations. Crit Care Med. 2012;40:254–260. doi: 10.1097/CCM.0b013e3182377fdd. [DOI] [PubMed] [Google Scholar]
  • 8.Blackwood B, Clarke M, McAuley DF, McGuigan PJ, Marshall JC, Rose L. How outcomes are defined in clinical trials of mechanically ventilated adults and children. Am J Respir Crit Care Med. 2014;189:886–893. doi: 10.1164/rccm.201309-1645PP. [DOI] [PubMed] [Google Scholar]
  • 9.Contentin L, Ehrmann S, Giraudeau B. Heterogeneity in the definition of mechanical ventilation duration and ventilator-free days. Am J Respir Crit Care Med. 2014;189:998–1002. doi: 10.1164/rccm.201308-1499LE. [DOI] [PubMed] [Google Scholar]
  • 10.Needham DM, Colantuoni E, Mendez-Tellez PA, Dinglas VD, Sevransky JE, Dennison Himmelfarb CR, Desai SV, Shanholtz C, Brower RG, Pronovost PJ. Lung protective mechanical ventilation and two year survival in patients with acute lung injury: prospective cohort study. BMJ. 2012;344:e2124. doi: 10.1136/bmj.e2124. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Zeiher BG, Artigas A, Vincent JL, Dmitrienko A, Jackson K, Thompson BT, Bernard G STRIVE Study Group. Neutrophil elastase inhibition in acute lung injury: results of the STRIVE study. Crit Care Med. 2004;32:1695–1702. doi: 10.1097/01.ccm.0000133332.48386.85. [DOI] [PubMed] [Google Scholar]
  • 12.Papazian L, Forel JM, Gacouin A, Penot-Ragon C, Perrin G, Loundou A, Jaber S, Arnal JM, Perez D, Seghboyan JM, et al. ACURASYS Study Investigators. Neuromuscular blockers in early acute respiratory distress syndrome. N Engl J Med. 2010;363:1107–1116. doi: 10.1056/NEJMoa1005372. [DOI] [PubMed] [Google Scholar]
  • 13.Angus DC, Laterre PF, Helterbrand J, Ely EW, Ball DE, Garg R, Weissfeld LA, Bernard GR PROWESS Investigators. The effect of drotrecogin alfa (activated) on long-term survival after severe sepsis. Crit Care Med. 2004;32:2199–2206. doi: 10.1097/01.ccm.0000145228.62451.f6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Iwashyna TJ. Trajectories of recovery and dysfunction after acute illness, with implications for clinical trial design. Am J Respir Crit Care Med. 2012;186:302–304. doi: 10.1164/rccm.201206-1138ED. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Cooper DJ, Rosenfeld JV, Murray L, Arabi YM, Davies AR, D’Urso P, Kossmann T, Ponsford J, Seppelt I, Reilly P, et al. DECRA Trial Investigators; Australian and New Zealand Intensive Care Society Clinical Trials Group. Decompressive craniectomy in diffuse traumatic brain injury. N Engl J Med. 2011;364:1493–1502. doi: 10.1056/NEJMoa1102077. [DOI] [PubMed] [Google Scholar]
  • 16.Needham DM, Dinglas VD, Bienvenu OJ, Colantuoni E, Wozniak AW, Rice TW, Hopkins RO NIH NHLBI ARDS Network. One year outcomes in patients with acute lung injury randomised to initial trophic or full enteral feeding: prospective follow-up of EDEN randomised trial. BMJ. 2013;346:f1532. doi: 10.1136/bmj.f1532. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Peek GJ, Mugford M, Tiruvoipati R, Wilson A, Allen E, Thalanany MM, Hibbert CL, Truesdale A, Clemens F, Cooper N, et al. CESAR Trial Collaboration. Efficacy and economic assessment of conventional ventilatory support versus extracorporeal membrane oxygenation for severe adult respiratory failure (CESAR): a multicentre randomised controlled trial. Lancet. 2009;374:1351–1363. [Google Scholar]
  • 18.Hayden D, Pauler DK, Schoenfeld D. An estimator for treatment comparisons among survivors in randomized trials. Biometrics. 2005;61:305–310. doi: 10.1111/j.0006-341X.2005.030227.x. [DOI] [PubMed] [Google Scholar]
  • 19.Williamson PR, Altman DG, Blazeby JM, Clarke M, Devane D, Gargon E, Tugwell P. Developing core outcome sets for clinical trials: issues to consider. Trials. 2012;13:132. doi: 10.1186/1745-6215-13-132. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Tugwell P, Boers M, Brooks P, Simon L, Strand V, Idzerda L. OMERACT: an international initiative to improve outcome measurement in rheumatology. Trials. 2007;8:38. doi: 10.1186/1745-6215-8-38. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from American Journal of Respiratory and Critical Care Medicine are provided here courtesy of American Thoracic Society

RESOURCES