We thank Haneuse et al. (1) for their generous and insightful commentary on our article (2). Here, we offer additional perspective on 3 topics: namely, 1) interpretation of single- and dual-outcome hazard rates, 2) the value added by including dual-outcome analyses for mechanistic studies and clinical decision-making, and 3) multivariate failure-time outcome data displays.
First, a couple of statistical modeling points: The dual-outcome hazard rates that we consider condition only on lack of prior occurrence for the outcome pair under investigation (and covariates), giving hazard rate estimators that have a marginal population-averaged interpretation. This is in contrast to long-standing counting process intensity models that condition on the subject’s entire preceding failure-time history (3). The new methods allow censoring rates to differ among the multiple outcomes under analysis. In addition, the single- and dual-outcome hazard rates we consider implicitly condition on the continued survival of the study subject and therefore differ from those typically targeted in the semicompeting risk literature mentioned by Haneuse et al. (1) for the joint analysis of a nonterminal outcome and death. The latter literature primarily targets the marginal distribution of the nonterminal outcome under the strong additional assumption that dying individuals would never develop the nonterminal outcome had their deaths somehow been averted (4). In comparison, our marginal methods allow joint survival functions to be estimated for the 2 outcomes without further assumption, and they do so with positive dual-outcome hazard rates only when the follow-up time for death is equal to or greater than that for the nonterminal event.
The potential value of dual-outcome hazard rate analyses, beyond single-outcome analyses, includes mechanistic studies to elucidate treatment or exposure effects. For example, our dual-outcome analysis of gallbladder disease and breast cancer (2), which includes higher dual-outcome hazard ratios when the gallbladder disease precedes the breast cancer diagnosis, raises the hypothesis that poor estrogen metabolizers may be at elevated risk for gallbladder disease and may therefore not realize the breast cancer benefits that would otherwise accrue from conjugated equine estrogens alone. As noted by Haneuse et al. (1), these analyses may also contribute to clinical decision-making, which routinely requires consideration of multiple outcomes simultaneously. For example, our analyses of the dual outcome of hypertension and death (2) may suggest evaluating continuation of conjugated equine estrogens plus medroxyprogesterone acetate among patients undergoing treatment who develop hypertension. Similarly, dual-outcome analyses allowed us to conclude, using intention-to-treat analyses between randomized groups, that a previously noted hazard ratio reduction in a low-fat diet intervention group (6) for the dual outcome of breast cancer followed by death was primarily due to survival improvement following breast cancer diagnosis (5).
With regard to multivariate outcome data displays: Kaplan-Meier curves, cumulative hazard rate estimators, and Cox regression hazard rate and ratio estimators provide major tools for the display of univariate failure-time regression data. These same tools can be considered for bivariate failure-time regression data. For example, single- and dual-outcome empirical hazard rates combine to estimate bivariate survival function estimators (5, 7), and cumulative single- and dual-outcome hazard rate estimators are readily obtained. These hazard rate estimators are appropriate even when the modeled covariate includes “internal” time-dependent covariates. Single- and dual-outcome hazard ratio displays include the usual single failure-time hazard ratios across treatments/covariates, as well as dual-outcome “platter plots,” as shown in our paper (2). It will be valuable to develop additional displays that incorporate estimated absolute hazard rate comparisons. In addition, in some contexts patients may frequently experience several outcomes, which supports the value of hazard ratio modeling for trivariate and higher-dimensional time-to-response outcomes (5, 7).
ACKNOWLEDGMENTS
Author affiliations: Public Health Sciences Division, Fred Hutchinson Cancer Research Center, Seattle, Washington (Ross L. Prentice, Aaron K. Aragaki, Garnet L. Anderson); Division of Medical Oncology/Hematology, Los Angeles Biomedical Institute at Harbor-UCLA Medical Center, Torrance, California (Rowan T. Chlebowski); Biostatistics and Computational Biology Branch, National Institute of Environmental Health Sciences, Research Triangle Park, North Carolina (Shanshan Zhao); Division of Cardiovascular Sciences, National Heart, Lung, and Blood Institute, Bethesda, Maryland (Jacques E. Rossouw); Department of Epidemiology, College of Public Health, University of Iowa, Iowa City, Iowa (Robert Wallace); Department of Epidemiology and Environmental Health, School of Public Health and Health Professions, State University of New York at Buffalo, Buffalo, New York (Hailey Banack); Department of Family Medicine and Public Health, School of Medicine, University of California, San Diego, San Diego, California (Aladdin H. Shadyab); Department of Public Health Sciences, School of Medicine, University of California, Davis, Davis, California (Lihong Qi); Department of Biostatistics and Data Science, Wake Forest School of Medicine, Wake Forest University, Winston-Salem, North Carolina (Beverly M. Snively); North American Menopause Society, Mayfield Heights, Ohio (Margery Gass); and Brigham and Women’s Hospital, Harvard Medical School, Boston, Massachusetts (JoAnn E. Manson).
This work was supported by the National Cancer Institute (grants R01 CA119171 and R01 CA210921) and by the National Heart, Lung and Blood Institute, which supports the infrastructure of the Women’s Health Initiative (contracts HHSN268201100046C, HHSN268201600001C, HHSN268201600002C, HHSN268201600003C, HHSN268201600004C, and HHSN271201600004C).
R.T.C. reports consulting arrangements with Novartis International AG (Basel, Switzerland), AstraZeneca AB (Cambridge, United Kingdom), Amgen, Inc. (Thousand Oaks, California), Immunomedics (Morris Plains, New Jersey), Puma Biotechnology, Inc. (Los Angeles, California), and Genentech, Inc. (South San Francisco, California). The other authors have no pertinent disclosures.
REFERENCES
- 1. Haneuse S, Schrag D, Nevo D. Invited commentary: opportunities that come with studying the co-occurrence of multiple outcomes. Am J Epidemiol. 2020;189(9):982–984. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Prentice RL, Aragaki AK, Chlebowski RT, et al. Dual-outcome intention-to-treat analyses in the Women’s Health Initiative randomized controlled hormone therapy trials. Am J Epidemiol. 2020;189(9):972–981. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Andersen PK, Gill RD. Cox’s regression model for counting processes: a large sample study. Ann Stat. 1982;10(4):1100–1120. [Google Scholar]
- 4. Fine JP, Gray RJ. A proportional hazards model for the subdistribution of a competing risk. J Am Stat Assoc. 1999;94(446):496–509. [Google Scholar]
- 5. Prentice RL, Zhao S. Regression models and multivariate life tables [published online ahead of print February 18, 2020] J Am Stat Assoc. (doi: 10.1080/01621459.2020.1713792). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Chlebowski RT, Aragaki AK, Anderson GL, et al. Low-fat dietary pattern and breast cancer mortality in the Women’s Health Initiative randomized controlled trial. J Clin Oncol. 2017;35(25):2919–2926. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Prentice RL, Zhao S. The Statistical Analysis of Multivariate Failure Time Data: A Marginal Modeling Approach. Boca Raton, FL: Chapman & Hall/CRC Press; 2019. [Google Scholar]
