Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2016 Jul 1.
Published in final edited form as: JAMA Oncol. 2015 Jul 1;1(4):441–447. doi: 10.1001/jamaoncol.2015.0828

A Clinical Prediction Model to Assess Risk for Chemotherapy-Related Hospitalization in Patients Initiating Palliative Chemotherapy

Gabriel A Brooks 1, Ankit J Kansagra 1, Sowmya R Rao 1, James I Weitzman 1, Erica A Linden 1, Joseph O Jacobson 1
PMCID: PMC4576342  NIHMSID: NIHMS690788  PMID: 26181251

Abstract

IMPORTANCE

Chemotherapy-related hospitalizations in patients with advanced cancer are common, distressing, and costly. Methods to identify patients at high risk of chemotherapy toxic effects will permit development of targeted strategies to prevent chemotherapy-related hospitalizations.

OBJECTIVE

To demonstrate the feasibility of using readily available clinical data to assess patient-specific risk of chemotherapy-related hospitalization.

DESIGN, SETTING, AND PARTICIPANTS

Nested case-control study conducted from January 2003 through December 2011 at the Mass General/North Shore Cancer Center, a community-based cancer center in north eastern Massachusetts. The parent cohort included 1579 consecutive patients with advanced solid-tumor cancer receiving palliative-intent chemotherapy. Case patients (n = 146) included all patients from the parent cohort who experienced a chemotherapy-related hospitalization. Controls (n = 292) were randomly selected from 1433 patients who did not experience a chemotherapy-related hospitalization.

EXPOSURES

Putative risk factors for chemotherapy-related hospitalization—including patient characteristics, treatment characteristics, and pretreatment laboratory values—were abstracted from medical records. Multivariable logistic regression was used to model the patient-specific risk of chemotherapy-related hospitalization.

MAIN OUTCOMES AND MEASURES

Chemotherapy-related hospitalization, as adjudicated by the oncology clinical care team within a systematic quality-assessment program.

RESULTS

A total of 146 (9.2%) of 1579 patients from the parent cohort experienced a chemotherapy-related hospitalization. In multivariate regression, 7 variables were significantly associated with chemotherapy-related hospitalization: age, Charlson comorbidity score, creatinine clearance, calcium level, below-normal white blood cell and/or platelet count, polychemotherapy (vs monotherapy), and receipt of camptothecin chemotherapy. The median predicted risk of chemotherapy-related hospitalization was 6.0% (interquartile range [IQR], 3.6%–11.4%) in control patients and 14.7% (IQR, 6.8%–22.5%) in case patients. The bootstrap-adjusted C statistic was 0.71 (95% CI, 0.66–0.75). At a risk threshold of 15%, the model exhibited a sensitivity of 49% (95% CI, 41%–57%) and a specificity of 85% (95% CI, 81%–89%) for predicting chemotherapy-related hospitalization.

CONCLUSIONS AND RELEVANCE

In patients initiating palliative chemotherapy for cancer, readily available clinical data were associated with the patient-specific risk of chemotherapy-related hospitalization. External validation and evaluation in the context of a clinical decision support tool are warranted.


In patients with advanced cancer, hospitalization is a common and costly adverse event.13 While most hospitalizations in this patient population are precipitated by cancer-related symptoms, approximately 30% are triggered by adverse effects of chemotherapy.46 Hospitalizations related to chemotherapy adverse effects are a plainly undesirable outcome, particularly when the goals of chemotherapy are palliative.

When making chemotherapy treatment plans, oncologists use many indicators to identify patients at risk for adverse effects. Performance status, a clinical estimate of functional status, is the most important of these indicators, and patients with poor performance status (eg, an Eastern Cooperative Oncology Group [ECOG]7 performance status >2) are generally considered to face more risks than benefits from chemotherapy. Beyond performance status, additional factors (including organ function, comorbidity, and frailty) are also known to influence the risk of chemotherapy toxic effects.5,8 Nevertheless, decision making about chemotherapy in current practice is based on the oncologist’s “gestalt” assessment at the time of treatment initiation.

A number of studies have sought to develop more discriminative approaches for assessing the risk of chemotherapy toxic effects in individual patients.811 These studies have focused on different patient populations, predictors, and toxic effect outcomes, but they all showed that model-based approaches can improve risk stratification for chemotherapy toxic effects. We sought to build on these efforts to devise an efficient method for estimating the patient-specific risk of severe toxic effects from chemotherapy that could be applied to a broad population of patients receiving palliative chemotherapy for cancerous solid tumors. In this report, we describe a clinical prediction model using routinely collected clinical data to estimate the patient-specific risk of chemotherapy-related hospitalization (CRH), a surrogate for severe chemotherapy toxic effects. We derive our model in a population of patients initiating palliative chemotherapy at a community cancer center. The ability to better identify patients at elevated risk for chemotherapy toxic effects has potential to improve patient outcomes at many levels. Specifically, better risk assessment for chemotherapy toxic effects would improve the chemotherapy informed-consent process, allow for modification of treatment regimens to reduce the risk of toxic effects, and identify patients who may benefit from aggressive supportive care around the time of chemotherapy initiation.

Methods

Design

We conducted our study using a clinical registry of adult patients (age ≥18 years) initiating first-line palliative chemotherapy for malignant solid tumors between January 2003 and December2011 (parent cohort) at the Mass General/North Shore Cancer Center (a community cancer center in northeastern Massachusetts). Malignant solid tumors were defined to exclude hematologic cancers (eg, leukemia, lymphoma, and multiple myeloma). Palliative treatment intent was documented by the treating oncologist at the time of chemotherapy initiation. The definition of chemotherapy treatment included receipt of any intravenous or oral cytotoxic or anticancer biological agent but not endocrine therapy alone.

All patients in the registry were followed up for hospitalization after initiation of chemotherapy as part of an institutional quality-assessment program.5,12 Among patients receiving chemotherapy who were subsequently hospitalized, all hospitalizations were discussed at monthly clinical meetings by a team of oncology care clinicians, including representatives from medical oncology, nursing, and pharmacy. After discussion, hospitalizations were attributed to either chemotherapy toxic effects or to causes unrelated to chemotherapy. Hospitalization was considered chemotherapy related when admission occurred within 30 days of the most recent chemotherapy administration and was judged to be definitely, probably, or possibly a result of chemotherapy treatment. Hospitalizations that were attributed to both chemotherapy toxic effects and cancer symptoms were considered to be chemotherapy-related in this analysis. Attributions were consensus based, accounting for the perspectives of all clinicians in attendance at each meeting.

We used a case-control design to structure our analysis. Case patients included all patients experiencing a CRH during first-line chemotherapy. Controls were randomly selectedfrom1433 patients who did not experience a chemotherapy-related hospitalization. Demographic information and data regarding putative CRH risk factors were collected retrospectively from clinical records of case and control patients. The nested case-control design was used to increase the efficiency of retrospective data collection. Data points for laboratory results and other time-varying risk factors were collected on or shortly before the date of chemotherapy initiation. The study was approved by the North Shore Medical Center institutional review board, which waived written informed consent.

Analysis

We first assessed the association between CRH and each of the individual putative CRH risk factors. Demographic and clinical variables included age (continuous), sex, ECOG performance status7 (0, 1, or ≥2), Charlson comorbidity score13 (0, 1, or ≥2, excluding points for metastatic cancer), primary cancer site, body mass index (BMI; calculated as weight in kilograms divided by height in meters squared) (<18.5, 18.5–24.9, 25.0–29.9, or ≥30.0), number of chemotherapy drugs (monotherapy vs polytherapy), and chemotherapy regimen dosing (full vs reduced). Exposure to specific chemotherapy agents was defined nonexclusively as exposure to any chemotherapy agent from 1 or more of the 5 most common chemotherapy classes in our cohort, including platinums, taxanes, fluoropyrimidines, camptothecins (irinotecan or topotecan), and/or gemcitabine.

Laboratory values were assessed as either threshold or continuous variables. Threshold variables were dichotomized by the relevant upper or lower limit of the normal range, including white blood cell count (categorized as <3800/µL or >3800/µL), absolute neutrophil count (<1800/µL or >1800/µL), hemoglobin (<12 or >12 g/dL), platelet count (<150 000/µL or >150 000/µL), and levels of aspartate aminotransferase (<46 or >46 IU/L), alkaline phosphatase (<118 or >118 IU/L), and lactate dehydrogenase (<250 or >250 IU/L). Continuous laboratory variables included creatinine clearance, albumin, and calcium level. Creatinine clearance was calculated using the Cockcroft-Gault formula,14 and values for creatinine clearance exceeding 120 mL/min were adjusted down to a ceiling value of 120 mL/min (consistent with prior analysis10). Two-sided χ2 tests were used to assess relationships between CRH and categorical variables, and 2-sided t tests were used for continuous variables. Odds ratios (ORs) and 95% CIs were obtained from logistic regression models.

We then built a multivariable logistic regression model, with CRH as the dependent variable. All multivariable analyses used weights to recapitulate the overall CRH rate observed in the parent cohort; these weights represented the inverse of the probability of selection for control patients. The initial multivariable logistic regression model included all variables from the univariate analyses that were associated with CRH at a level of P < .10. In addition, age and ECOG performance status were retained in the initial multivariable model owing to their perceived clinical significance. Platelet count and white blood cell count were collapsed into a single combination variable (indicating the presence of below-normal platelet count, below-normal white blood cell count, or both) because both leucopenia and thrombocytopenia are markers of limited bone-marrow reserve. After imputation of missing data, all cases and controls were used to derive the final multivariable prediction model. Missing values for the Charlson comorbidity score (24 patients) were imputed using a multiple imputation protocol for categorical variables. Mean imputation was used for missing values of creatinine clearance (2 patients) and calcium level (2 patients).

To reduce overfitting, we built amore parsimonious prediction model from7 of the 15 risk factors identified in the univariate screen. We used a “supervised” backward selection approach to select the predictors for the final model, driven by multivariable statistical significance (P > .05).Backward selection was influenced by clinical considerations; for example, when predictor pairs were clinically related (such as receipt of polychemotherapy and receipt of platinum chemotherapy), the order of predictor elimination was influenced by clinical reasoning in addition to multivariable statistical significance. We then tested for interaction effects between predictors retained in the final model. A significant interaction (P < .05) was identified between the Charlson comorbidity score and the combination variable for below-normal platelet count and/or below-normal white blood cell count; this interaction was added to the model.

The discrimination of the final model was evaluated by the bootstrap-adjusted C statistic, which provides a form of internal validation.15We generated 200 bootstrap samples from the data set of 438 patient records using unrestricted random sampling with replacement. A new model was fitted to each bootstrap sample, and we then calculated the C statistic for each bootstrap model. The bootstrap-adjusted C statistic was then calculated as the crude C statistic minus the mean model optimism, where model optimism is the mean of the differences between the crude C statistic and each of the 200 bootstrap-derived C indices. Model calibration was assessed with a calibration plot. All analyses were performed using SAS software, version 9.4 (SAS Institute Inc).

Results

The study population for this nested case-control study was selected from 1579 patients initiating first-line palliative chemotherapy for malignant solid tumors between 2003 and 2011 (Figure 1). We found CRH in 9.2% of patients from the parent cohort. Case patients in this analysis included all 146 patients who experienced CRH, and control patients included 292 randomly selected patients without CRH. The median time from chemotherapy initiation to hospitalization was 30 days among case patients, and 73% of CRHs occurred within 60 days of treatment initiation. The most common toxic effects leading to CRH were gastrointestinal (54%), infectious (27%), and hematologic (13%); multiple toxic effects were recorded for 10% of CRHs.

Figure 1. Flowchart of Population Study Entry.

Figure 1

CRH indicates chemotherapy-related hospitalization.

The demographic and clinical characteristics of case and control patients are summarized in Table 1. The median age was similar in the 2 groups (68 vs 67 years), and the most common diagnoses were cancers of the lung, gastrointestinal tract, and breast. Univariate analysis showed that CRH was significantly associated with the Charlson comorbidity score, the number of chemotherapy drugs (monotherapy vs polytherapy), and receipt of platinum, fluoropyrimidine, and/or camptothecin chemotherapy. Pretreatment clinical laboratory results are listed in Table 2. Test results were significantly associated with CRH for low white blood cell count, low platelet count, low creatinine clearance, and low levels of hemoglobin, aspartate aminotransferase, albumin, and calcium.

Table 1.

Demographic and Clinical Characteristics for Patients With and Without Chemotherapy-Related Hospitalizationa

Characteristic Cases
(n = 146)
Controls
(n = 292)
OR (95% CI)b P Value
Age, median, y 68 67 1.00 (0.98–1.01) .55
Sex
  Female 79 (54) 157 (54) 1 [Reference] .95
  Male 67 (46) 135 (46) 1.01 (0.68–1.51)
ECOG performance status
  0 28 (19) 74 (25) 1 [Reference] .23
  1 87 (60) 174 (60) 1.37 (0.83–2.27)
  ≥2 31 (21) 44 (15) 1.74 (0.92–3.30)
Charlson comorbidity scorec
  0 44 (30) 137 (51) 1 [Reference] <.001
  1 33 (23) 55 (21) 1.87 (1.08–3.24)
  ≥2 69 (47) 76 (28) 2.83 (1.77–4.53)
Primary cancer site
  Lung 49 (34) 110 (38) 1 [Reference] .13
  Gastrointestinal 47 (32) 65 (22) 1.62 (0.98–2.69)
  Breast 16 (11) 39 (13) 0.92 (0.47–1.80)
  Genitourinary 7 (5) 25 (9) 0.63 (0.26–1.55)
  Gynecological 7 (5) 25 (9) 0.63 (0.26–1.55)
  Head and neck 9 (6) 11 (4) 1.84 (0.72–4.72)
  Other 11 (8) 17 (6) 1.45 (0.63–3.33)
BMI
  <18.5 10 (7) 18 (6) 1.24 (0.54–2.88) .44
  18.5–24.9 51 (35) 114 (40) 1 [Reference]
  25.0–29.9 54 (37) 85 (30) 1.42 (0.88–2.28)
  ≥30 31 (21) 70 (24) 0.99 (0.58–1.69)
Chemotherapy drugs, No
  Monotherapy 42 (29) 129 (44) 1 [Reference] .002
  Polytherapy 104 (71) 163 (56) 1.96 (1.28–3.00)
Chemotherapy regimen dosing
  Full 108 (74) 229 (80) 1 [Reference] .19
  Reduced 37 (26) 57 (20) 1.38 (0.86–2.21)
Chemotherapy classd
  Platinum 87 (60) 135 (46) 1.71 (1.15–2.57) .01
  Taxane 43 (29) 95 (33) 0.87 (0.56–1.33) .51
  Fluoropyrimidine 39 (27) 53 (18) 1.64 (1.03–2.64) .04
  Camptothecin 18 (12) 21 (7) 1.81 (0.93–3.52) .08
  Gemcitabine 17 (12) 31 (11) 1.11 (0.59–2.08) .75

Abbreviation: BMI, body mass index (calculated as weight in kilograms divided by height in meters squared); ECOG, Eastern Cooperative Oncology Group7; OR, odds ratio.

a

Unless otherwise noted, data are number (percentage) of patients.

b

Univariate analysis.

c

No points were assigned for metastatic cancer.

d

Column percentages exceed 100% because patients could receive agents from multiple classes concurrently.

Table 2.

Pretreatment Laboratory Values for Patients With and Without Chemotherapy-Related Hospitalizationa

Laboratory Variable Cases
(n = 146)
Controls
(n = 292)
OR (95% CI)b P Value
White blood cell count, ×1000/µL
  ≥3.8 134 (92) 283 (97) 1 [Reference] .02
  <3.8 12 (8) 9 (3) 2.82 (1.16–6.85)
Absolute neutrophil count, ×1000/µL
  ≥1.8 141 (97) 286 (98) 1 [Reference] .26
  <1.8 5 (3) 5 (2) 2.03 (0.58–7.12)
Hemoglobin, g/dL
  ≥12 75 (51) 181 (62) 1 [Reference] .03
  <12 71 (49) 111 (38) 1.54 (1.03–2.31)
Platelet count,, ×1000/µL
  ≥150 127 (87) 277 (95) 1 [Reference] .004
  <150 19 (13) 15 (5) 2.76 (1.36–5.61)
Aspartate aminotransferase, IU/L
  ≤46 119 (82) 260 (89) 1 [Reference] .03
  >46 26 (18) 31 (11) 1.83 (1.04–3.22)
Alkaline phosphatase, IU/L
  ≤118 106 (73) 216 (74) 1 [Reference] .80
  >118 39 (27) 75 (26) 1.06 (0.68–1.66)
Lactate dehydrogenase, IU/L
  ≤250 107 (75) 228 (84) 1 [Reference] .05
  >250 35 (25) 45 (16) 1.66 (1.01–2.73)
Creatinine clearancec
  10 mL/min increase NA NA 0.93 (0.87–0.99) .03
Albumin
  1 g/dL increase NA NA 0.61 (0.42–0.89) .01
Calcium
  1 mg/dL increase NA NA 0.51 (0.34–0.77) .001

Abbreviations: NA, not applicable; OR, odds ratio.

a

Unless otherwise noted, data are number (percentage) of patients.

b

Univariate analysis.

c

Creatinine clearance was estimated by the Cockcroft-Gault equation; values were capped at a maximum of 120 mL/min.

The final parsimonious multivariable model included 7 independent predictors of CRH (Table 3). Predictors included younger age, higher Charlson comorbidity score, lower creatinine clearance, lower calcium level, below-normal white blood cell and/or platelet count, receipt of multiple chemotherapy agents, and receipt of camptothecin chemotherapy. The receiver operating characteristic (ROC) curve is shown in eFigure 1 in the Supplement, and the crude model C statistic (the area under the ROC curve) was 0.73. The bootstrap-adjusted C statistic, which estimates the internally validated model discrimination, was 0.71 (95% CI, 0.66–0.75). The Nagelkerke pseudo r2, which describes the proportion of outcome variation explained by the model, was 0.23. The β coefficients for the final multivariable model are listed in the eTable in the Supplement.

Table 3.

Multivariable Regression Model to Predict Chemotherapy-Related Hospitalization

Variable OR (95% CI)a P Value
Age, 1-y increase 0.96 (0.94–0.98) <.001
Creatinine clearance, 10 mL/min increase 0.87 (0.82–0.93) <.001
Calcium, 1 mg/dL increase 0.47 (0.33–0.67) <.001
Low platelet and/or WBC countb 5.02 (2.25–11.24) <.001
CCS
  0 1 [Reference] NA
  1 2.79 (1.63–4.75) <.001
  ≥2 3.67 (2.23–6.03) <.001
Polychemotherapy 1.80 (1.21–2.66) .003
Camptothecin chemotherapy 2.02 (1.14–3.57) .02
Interaction terms
  Low platelet and/or WBC count × CCS 1 0.15 (0.03–0.71) .02
  Low platelet and/or WBC count × CCS ≥2 0.48 (0.16–1.39) .18

Abbreviations: CCS, Charlson comorbidity score; NA, not applicable; OR, odds ratio; WBC, white blood cell.

a

ORs are not directly interpretable for variables with interaction terms.

b

Platelet count lower than 150 000/µL and/or WBC count lower than 3800/µL.

The median predicted risk of CRH was 6.0% (interquartile range [IQR], 3.6%–11.4%) in control patients and 14.7% (IQR, 6.8%–22.5%) in case patients. The model-predicted risk distributions for case and control patients are shown in eFigure 2 in the Supplement. Model calibration is shown in the calibration plot in Figure 2. Using a CRH risk threshold of 15%, the risk prediction model identified patients experiencing CRH with a sensitivity of 49% (95% CI, 41%–57%) and a specificity of 85% (95% CI, 81%–89%). Sensitivity and specificity under alternative risk thresholds can be assessed from the ROC curve in eFigure 1 in the Supplement.

Figure 2. Calibration Plot of Predicted and Observed Risk of Chemotherapy-Related Hospitalization.

Figure 2

Data points represent overlapping strata of predicted risk.

Discussion

Studying acommunity-based cohort of patients receiving first-line palliative chemotherapy for malignant solid tumors, we created a prediction model to identify the patient-specific risk of CRH at the time of chemotherapy initiation. We found a baseline CRH risk of 9.2%; however, approximately 1 in 6 patients from the parent cohort were projected to have a CRH risk of 15% or higher. All variables in our model (including age, Charlson comorbidity score, creatinine clearance, white blood cell count, platelet count, calcium level, polychemotherapy, and exposure to camptothecin chemotherapy) are routinely collected in the course of clinical care and readily identifiable within a high-functioning electronic medical record.

A number of prior studies have presented models for predicting the risk of chemotherapy toxic effects in patients with cancer.811Hurria et al8 studied elderly patients (≥65 years) with malignant solid tumors and showed that a multivariable model including geriatric assessment variables was a better predictor of toxic effects from chemotherapy than the Karnofsky performance status alone. This approach was externally validated in a population of elderly patients with lung cancer.16 Similarly, Extermann etal9 focused on elderly patients with cancer (>70years) and developed separate models to predict hematologic and non-hematologic toxic effects from chemotherapy. Lyman and coauthors11 built a model using laboratory data and treatment characteristics to predict neutropenic complications. Finally, Hymanet al10 developed a model to identify patients with cancer participating in phase 1 clinical trials who were at high risk for serious drug-related toxic effects.

Most of these studies defined chemotherapy toxic effects in the context of the Common Terminology Criteria for Adverse Events (CTCAE).17 While the CTCAE framework defines the gold standard for adverse event reporting in clinical trials, the patient centeredness of this instrument is debatable.18 In fact, many toxic effects defined as grade 3 by the CTCAE may be entirely asymptomatic (eg, stage 2 hypertension or absolute neutrophil count <1000/µL in the absence of fever). We used a simpler and potentially more patient-centered surrogate to assess severe toxic effects from chemotherapy: CRH, an event clearly undesirable for patients and one representing an adverse event of sufficient severity and acuity to justify hospitalization. Policy makers also have a stake in reducing CRHs because acute hospitalization accounts for 48% of the cost of medical care in patients with advanced cancer.19

A number of the predictors included in our model have been previously identified as risk factors for chemotherapy toxic effects: polychemotherapy, decreased creatinine clearance, and low blood cell counts have all been included in previous toxic effects prediction models.811 While these risk factors may appear to be clinically self-evident, our findings reinforce that even modest deficits in renal or bone-marrow function confer measurably increased risk for toxic effects from chemotherapy. Furthermore, inclusion of multiple predictors in a single risk model can help clinicians to appreciate the combined effect of these risk factors, each of which may appear to be of negligible salience individually.

Anticipated associations of CRH with poor ECOG performance status and full-dose (vs reduced-dose) chemotherapy were not found to be statistically significant. This should not be interpreted to suggest that performance status and chemotherapy dose are not associated with the risk for chemotherapy toxic effects. Rather, our findings suggest that oncologists are already incorporating performance status and chemotherapy dose intensity into decisions about chemotherapy treatment in ways that limit toxic effects. In addition, our model showed an inverse association between age and CRH risk. This finding seems to belie the presumption that age is positively associated with the risk for chemotherapy toxic effects. However, this association must be interpreted in the context of the multivariable analytic approach, under the assumption that other risk factors are held constant with advancing age. In actuality, many of the risk factors in the model (particularly comorbidity, renal function, and bone-marrow function) are them selves associated with age. As such, individual coefficients of the multivariable model should be interpreted with caution.

Our study has limitations. We used a qualitative consensus review process to distinguish CRHs from hospitalizations attributable to other causes, which complicates replication of our approach. Nevertheless, we found that CRHs generally occurred within 60 days of chemotherapy initiation, supporting a cause-and-effect relationship between chemotherapy administration and clinician-adjudicated CRH. Our findings are subject to time-window bias, whereby patients with longer duration of chemotherapy would be more likely to eventually experience CRH.20 Exposure to this bias is reduced by the observation that nearly three-quarters of the CRHs in our study occurred within 60 days of chemotherapy initiation. Our study included patients with solid tumors initiating first-line palliative chemotherapies but may not generalize well to patients initiating later-line palliative chemotherapy or to patients with malignant hematologic conditions. We did not include geriatric assessment variables in our study, although other investigators have demonstrated that measures of frailty from geriatric assessment are associated with increased risk of chemotherapy toxic effects.8,9,16,21 However, geriatric assessments are not commonly performed in many clinical practices, most likely owing to perceived resource and time constraints. Finally, the model-building process was subjective, incorporating both clinical reasoning and multivariable statistical significance. Alternative model-building approaches would likely lead to different model specifications.

Strategies to harness the latent power of routinely collected clinical data have been proposed as an efficient and cost-effective way to improve health care quality.22,23 Because our model used data that are available from within structured fields in electronic health records, our approach could be used to create an automated clinical decision support tool at the point of chemotherapy order entry, without requiring additional data entry. In this context, an externally validated prediction model could be used by physicians to counsel patients about their individual-level risk of CRH during shared decision making around initiation of chemotherapy. In addition, physicians could use CRH risk estimates to justify modification of chemotherapy regimens to reduce the risk of toxic effects. Patients at substantially elevated risk of CRH could be enrolled in case management programs to more effectively deliver aggressive supportive care to those most likely to benefit from such services.

Conclusions

In conclusion, we sought to develop a prediction model to estimate the risk of CRH in patients receiving palliative chemotherapy. Using routinely collected clinical data, our model identified a subpopulation of patients at substantially elevated risk for CRH. Model discrimination, characterized by an internally validated C statistic of 0.71, was comparable to the discrimination of previously developed models that required collection of nonstandard data elements.8,9 Our approach shows promise for developing a tool that can help patients and clinicians reduce the risk of chemotherapy toxic effects (and hospitalizations) in an individualized and patient-centered fashion. We are currently pursuing opportunities for further development of the CRH prediction model.

Supplementary Material

Supplemental files

At a Glance.

  • Among 1433 patients receiving palliative chemotherapy for solid tumors, 9.2% experienced a chemotherapy-related hospitalization (CRH).

  • Independent predictors of CRH included age, Charlson comorbidity score, creatinine clearance, calcium level, low white blood cell count and/or platelet count, number of chemotherapy agents, and receipt of camptothecin chemotherapy.

  • The median predicted risk of hospitalization was 14.7% among patients who experienced a CRH, and 6.0% among patients who did not experience a CRH.

Acknowledgments

Funding/Support: This research was supported by a grant from the Read Family Trust. Dr Brooks was supported by a Young Investigator Award from the Conquer Cancer Foundation of the American Society of Clinical Oncology and by program grant R25CA09220 from the National Cancer Institute of the National Institutes of Health.

Role of the Funder/Sponsor: The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; or preparation, review, or approval of the manuscript.

Footnotes

Author Contributions: Drs Brooks and Jacobson had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. Drs Brooks and Kansagra contributed equally to this article.

Study concept and design: Kansagra, Linden, Jacobson.

Acquisition, analysis, or interpretation of data: Brooks, Kansagra, Rao, Weitzman, Linden, Jacobson.

Drafting of the manuscript: Brooks, Kansagra, Rao, Linden,

Critical revision of the manuscript for important intellectual content: Brooks, Kansagra, Rao, Weitzman, Linden, Jacobson.

Statistical analysis: Brooks, Kansagra, Rao, Linden,

Obtained funding: Linden, Jacobson.

Administrative, technical, or material support: Kansagra,Weitzman, Linden, Jacobson.

Study supervision: Weitzman, Linden, Jacobson.

Conflict of Interest Disclosures: None reported.

Disclaimer: Contents of this publication are the sole responsibility of the authors, and do not necessarily represent the official views of the National Cancer Institute, the National Institutes of Health, the Department of Veterans Affairs, or the American Society of Clinical Oncology.

Previous Presentation: This research was presented at the American Society of Clinical Oncology Quality Care Symposium; November 1 and 2, 2013; San Diego, California.

REFERENCES

  • 1.Yabroff KR, Lamont EB, Mariotto A, et al. Cost of care for elderly cancer patients in the United States. J Natl Cancer Inst. 2008;100(9):630–641. doi: 10.1093/jnci/djn103. [DOI] [PubMed] [Google Scholar]
  • 2.Morden NE, Chang CH, Jacobson JO, et al. End-of-life care for Medicare beneficiaries with cancer is highly intensive overall and varies widely. Health Aff (Millwood) 2012;31(4):786–796. doi: 10.1377/hlthaff.2011.0650. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Hassett MJ, O’Malley AJ, Pakes JR, Newhouse JP, Earle CC. Frequency and cost of chemotherapy-related serious adverse effects in a population sample of women with breast cancer. J Natl Cancer Inst. 2006;98(16):1108–1117. doi: 10.1093/jnci/djj305. [DOI] [PubMed] [Google Scholar]
  • 4.Brooks GA, Abrams TA, Meyerhardt JA, et al. Identification of potentially avoidable hospitalizations in patients with GI cancer. J Clin Oncol. 2014;32(6):496–503. doi: 10.1200/JCO.2013.52.4330. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Hassett MJ, Rao SR, Brozovic S, et al. Chemotherapy-related hospitalization among community cancer center patients. Oncologist. 2011;16(3):378–387. doi: 10.1634/theoncologist.2010-0354. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Kolodziej M, Hoverman JR, Garey JS, et al. Benchmarks for value in cancer care: an analysis of a large commercial population. J Oncol Pract. 2011;7(5):301–306. doi: 10.1200/JOP.2011.000394. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Oken MM, Creech RH, Tormey DC, et al. Toxicity and response criteria of the Eastern Cooperative Oncology Group. Am J Clin Oncol. 1982;5(6):649–655. [PubMed] [Google Scholar]
  • 8.Hurria A, Togawa K, Mohile SG, et al. Predicting chemotherapy toxicity in older adults with cancer: a prospective multicenter study. J Clin Oncol. 2011;29(25):3457–3465. doi: 10.1200/JCO.2011.34.7625. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Extermann M, Boler I, Reich RR, et al. Predicting the risk of chemotherapy toxicity in older patients: the Chemotherapy Risk Assessment Scale for High-Age Patients (CRASH) score. Cancer. 2012;118(13):3377–3386. doi: 10.1002/cncr.26646. [DOI] [PubMed] [Google Scholar]
  • 10.Hyman DM, Eaton AA, Gounder MM, et al. Nomogram to predict cycle-one serious drug-related toxicity in phase I oncology trials. J Clin Oncol. 2014;32(6):519–526. doi: 10.1200/JCO.2013.49.8808. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Lyman GH, Kuderer NM, Crawford J, et al. Predicting individual risk of neutropenic complications in patients receiving cancer chemotherapy. Cancer. 2011;117(9):1917–1927. doi: 10.1002/cncr.25691. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Krzyzanowska MK, Treacy J, Maloney B, Lavino A, Jacobson JO. Development of a patient registry to evaluate hospital admissions related to chemotherapy toxicity in a community cancer center. J Oncol Pract. 2005;1(1):15–19. doi: 10.1200/jop.2005.1.1.15. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40(5):373–383. doi: 10.1016/0021-9681(87)90171-8. [DOI] [PubMed] [Google Scholar]
  • 14.Cockcroft DW, Gault MH. Prediction of creatinine clearance from serum creatinine. Nephron. 1976;16(1):31–41. doi: 10.1159/000180580. [DOI] [PubMed] [Google Scholar]
  • 15.Harrell FE, Jr, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15(4):361–387. doi: 10.1002/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4. [DOI] [PubMed] [Google Scholar]
  • 16.Nie X, Liu D, Li Q, Bai C. Predicting chemotherapy toxicity in older adults with lung cancer. J Geriatr Oncol. 2013;4(4):334–339. doi: 10.1016/j.jgo.2013.05.002. [DOI] [PubMed] [Google Scholar]
  • 17.National Cancer Institute. Common Terminology Criteria for Adverse Events v3.0 (CTCAE) [Accessed March 12, 2014]; http://ctep.cancer.gov/protocolDevelopment/electronic_applications/docs/ctcaev3.pdf.
  • 18.Basch E, Iasonos A, McDonough T, et al. Patient versus clinician symptom reporting using the National Cancer Institute Common Terminology Criteria for Adverse Events: results of a questionnaire-based study. Lancet Oncol. 2006;7(11):903–909. doi: 10.1016/S1470-2045(06)70910-X. [DOI] [PubMed] [Google Scholar]
  • 19.Brooks GA, Li L, Uno H, Hassett MJ, Landon BE, Schrag D. Acute hospital care is the chief driver of regional spending variation in Medicare patients with advanced cancer. Health Aff (Millwood) 2014;33(10):1793–1800. doi: 10.1377/hlthaff.2014.0280. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Suissa S, Dell’aniello S, Vahey S, Renoux C. Time-window bias in case-control studies: statins and lung cancer. Epidemiology. 2011;22(2):228–231. doi: 10.1097/EDE.0b013e3182093a0f. [DOI] [PubMed] [Google Scholar]
  • 21.Aparicio T, Jouve J-L, Teillet L, et al. Geriatric factors predict chemotherapy feasibility: ancillary results of FFCD 2001–02 phase III study in first-line chemotherapy for metastatic colorectal cancer in elderly patients. J Clin Oncol. 2013;31(11):1464–1470. doi: 10.1200/JCO.2012.42.9894. [DOI] [PubMed] [Google Scholar]
  • 22.Bates DW, Saria S, Ohno-Machado L, Shah A, Escobar G. Big data in health care: using analytics to identify and manage high-risk and high-cost patients. Health Aff (Millwood) 2014;33(7):1123–1131. doi: 10.1377/hlthaff.2014.0041. [DOI] [PubMed] [Google Scholar]
  • 23.Shadmi E, Flaks-Manov N, Hoshen M, Goldman O, Bitterman H, Balicer RD. Predicting 30-day readmissions with preadmission electronic health record data. Med Care. 2015;53(3):283–289. doi: 10.1097/MLR.0000000000000315. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplemental files

RESOURCES