Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2022 Apr 1.
Published in final edited form as: JAMA Oncol. 2019 Aug 1;5(8):1226. doi: 10.1001/jamaoncol.2019.1187

Survivorship Bias in Analyses of Immune Checkpoint Inhibitor Trials

Sarah C Conner 1, Ludovic Trinquart 1
PMCID: PMC8974512  NIHMSID: NIHMS1789128  PMID: 31169896

To the Editor

In a retrospective analysis of 137 patients with advanced non–small cell lung cancer treated with nivolumab or pembrolizumab monotherapy, Toi et al1 observed larger progression-free survival and overall survival probabilities among 66 patients who developed immune-related adverse events (irAEs) compared with 71 who did not. It is possible that the comparison is biased. The 2 groups are compared with regard to survival from the start of treatment, but the occurrence of irAEs is obviously not determined at baseline but later during follow-up. Patients with irAEs must have survived from treatment initiation to the time of the irAE, but there is no such requirement for patients without irAEs. Toi et al1 reported a median onset of irAEs of 4.7 weeks. By design, the survival curves will be more favorable to patients with irAEs and less favorable to those without irAEs. This survivorship bias is identical to the time-to-response bias in oncology studies comparing responders and nonresponders.24

Other statistical methods are needed to conduct an unbiased comparison. For example, the landmark method involves a priori selection of a time point, or landmark time, for the classifying criteria and outcomes.24In the present case, one could ignore all irAEs after the specified time point and all progressions of disease or death before the specified time point. Kaplan-Meier curves can still be used to display survival conditional on the occurrence of an irAE. Alternative approaches are the Cox proportional hazards model with a time-varying covariate or a marginal structural Cox model.5 These methods would address the time-varying group membership of patients with and without irAEs. A limitation of the landmark method is the exclusion of patients, although the Cox models would retain all patients.

We would like to know if differences in survival are still apparent when addressing this bias.

Conflict of Interest Disclosures:

Ms Conner was supported by the National Institute of General Medical Sciences Interdisciplinary Training Grant for Biostatisticians (T32GM74905-14). No other disclosures were reported.

References

  • 1.Toi Y, Sugawara S, Sugisaka J, et al. Profiling preexisting antibodies in patients treated with anti–PD-1 therapy for advanced non–small cell lung cancer [published online December 27, 2018]. JAMA Oncol. doi: 10.1001/jamaoncol.2018.5860 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Anderson JR, Cain KC, Gelber RD. Analysis of survival by tumor response. J Clin Oncol. 1983;1(11):710–719. doi: 10.1200/JCO.1983.1.11.710 [DOI] [PubMed] [Google Scholar]
  • 3.Dafni U Landmark analysis at the 25-year landmark point. Circ Cardiovasc Qual Outcomes. 2011;4(3):363–371. doi: 10.1161/CIRCOUTCOMES.110.957951 [DOI] [PubMed] [Google Scholar]
  • 4.Anderson JR, Cain KC, Gelber RD. Analysis of survival by tumor response and other comparisons of time-to-event by outcome variables. J Clin Oncol. 2008; 26(24):3913–3915. doi: 10.1200/JCO.2008.16.1000 [DOI] [PubMed] [Google Scholar]
  • 5.Hernán MA, Brumback B, Robins JM. Marginal structural models to estimate the joint causal effect of nonrandomized treatments. J Am Stat Assoc. 2001; 96(454):440–448. doi: 10.1198/016214501753168154 [DOI] [Google Scholar]

RESOURCES