To the Editor
We read with interest the article by Fu et al1 and were struck by their strong statements regarding the validity of survival analysis and their dismissal of multiple imputation as a statistical tool in observational studies with missing data. We were most concerned by their assertion that survival analysis is not impacted by missing data while multiple imputation leads to biased results. Both multiple imputation and survival analysis (eg, Kaplan-Meier estimates or a proportional hazards model) rely on the missing at random assumption,2 according to which the probability that an observation is missing can be predicted from the observed data. In both types of analyses, results may be biased if missingness is related to patient characteristics that have not been observed. In the survival context, this amounts to assuming that censored patients (eg, patients who discontinued treatment or were lost to follow-up) had the same outcome risk as noncensored patients.3 When this noninformative missingness assumption is violated, both survival analysis and multiple imputation can lead to biased estimates. Patients with neovascular age-related macular degeneration with poor vision outcomes are more likely to discontinue treatments and medical visits. This may lead to missing visual acuity (VA) data.4 This form of right censoring clearly violates the missing at random assumption and may have induced bias in the study by Fu et al.1 Additionally, no censoring criteria were described in the authors’ Methods section, suggesting that patients who had prolonged intervals with multiple missed visits or injections were still included in the study. An advantage of longitudinal modeling, with or without multiple imputation, is the ability to flexibly incorporate assessments conducted at variable length intervals. In contrast, such an irregular observation scheme results in interval-censored data in a survival analysis because precise event times are unknown. Because missed visits and therefore longer intervals between observations have been shown to be associated with worse VA outcomes,5 this becomes an important consideration that survival analysis has no mechanism to address without multiple imputation.
We think survival analysis and longitudinal modeling with multiple imputation for missing data are different approaches that answer different questions, each with their own benefits and limitations. Fu et al1 are correct that survival analysis is advantageous in dealing with differential length of follow-up, a common issue in observational studies. However, this approach limits the ability to model the dynamic change of VA during treatment for age-related macular degeneration. The authors’ survival analysis, which censored the data at the first occurrence of a good VA outcome (eg, 20/40 or better), ignores the frequent occurrence of VA worsening later on. Their survival curves, with a plateau for VA outcome of 20/40 or better, represent the anticipated early VA gain from anti-vascular endothelial growth factor treatment, but the article is silent on the later VA loss. Longitudinal modeling with multiple imputation is advantageous in this situation because it captures the dynamic changes of VA. No single statistical method is perfect; out-right dismissal of one form of analysis limits our ability to fully understand the data.
Conflict of Interest Disclosures:
Dr Hubbard reports grants from Pfizer, Merck, and Johnson & Johnson. No other disclosures were reported.
Contributor Information
Brian L. VanderBeek, Scheie Eye Institute, University of Pennsylvania, Philadelphia.
Gui-Shuang Ying, Center for Preventive Ophthalmology and Biostatistics, University of Pennsylvania, Philadelphia.
Rebecca A. Hubbard, Department of Biostatistics, Epidemiology & Informatics, University of Pennsylvania, Philadelphia.
References
- 1.Fu DJ, Keenan TD, Faes L, et al. Insights from survival analyses during 12 years of anti-vascular endothelial growth factor therapy for neovascular age-related macular degeneration. JAMA Ophthalmol. 2021;139(1):57–67. doi: 10.1001/jamaophthalmol.2020.5044 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Little RJA, Rubin DB. Statistical Analysis With Missing Data. 3rd ed. John Wiley & Sons Inc; 2019. [Google Scholar]
- 3.Klebanoff MA, Cole SR. Use of multiple imputation in the epidemiologic literature. Am J Epidemiol. 2008;168(4):355–357. doi: 10.1093/aje/kwn071 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Gillies M, Arnold J, Bhandari S, et al. Ten-year treatment outcomes of neovascular age-related macular degeneration from two regions. Am J Ophthalmol. 2020;210:116–124. doi: 10.1016/j.ajo.2019.10.007 [DOI] [PubMed] [Google Scholar]
- 5.Ramakrishnan MS, Yu Y, VanderBeek BL. Association of visit adherence and visual acuity in patients with neovascular age-related macular degeneration: secondary analysis of the Comparison of Age-Related Macular Degeneration Treatment Trial. JAMA Ophthalmol. 2020;138(3):237–242. doi: 10.1001/jamaophthalmol.2019.4577 [DOI] [PMC free article] [PubMed] [Google Scholar]