Key Points
The Khorana score did risk-stratify cancer patients according to 6-month risk of VTE, but only for some cancer types.
Absolute risk estimates were lower than previously reported, questioning the benefit of ambulatory thromboprophylaxis in cancer patients.
Visual Abstract
Abstract
The Khorana score is recommended for guiding primary venous thromboembolism (VTE) prophylaxis in cancer patients, but its clinical utility overall and across cancer types remains debatable. Also, some previous validation studies have ignored the competing risk of death, hereby potentially overestimating VTE risk. We identified ambulatory cancer patients initiating chemotherapy without other indications for anticoagulation using Danish health registries and estimated 6-month cumulative incidence of VTE stratified by Khorana levels. Analyses were conducted with and without considering death as a competing risk using the Kaplan-Meier method vs the cumulative incidence function. Analyses were performed overall and stratified by cancer types. Of 40 218 patients, 35.4% were categorized by Khorana as low risk (score 0), 53.6% as intermediate risk (score 1 to 2), and 10.9% as high risk (score ≥3). Considering competing risk of death, the corresponding 6-month risks of VTE were 1.5% (95% confidence interval [CI], 1.3-1.7), 2.8% (95% CI, 2.6-3.1), and 4.1% (95% CI, 3.5-4.7), respectively. Among patients recommended anticoagulation by guidelines (Khorana score ≥2), the 6-month risk was 3.6% (95% CI, 3.3-3.9). Kaplan-Meier analysis overestimated incidence up to 23% compared with competing risk analyses. Using the guideline-recommended threshold of ≥2, the Khorana score did not risk-stratify patients with hepatobiliary or pancreatic cancer, lung cancer, and gynecologic cancer. In conclusion, the Khorana score was able to stratify ambulatory cancer patients according to the risk of VTE, but not for all cancer types. Absolute risks varied by methodology but were lower than in key randomized trials. Thus, although certain limitations with outcome identification using administrative registries apply, the absolute benefit of implementing routine primary thromboprophylaxis in an unselected cancer population may be smaller than seen in randomized trials.
Introduction
Cancer incidence is rising, and venous thromboembolism (VTE) remains a common and potentially fatal complication among patients with cancer.1,2 Cancer-associated VTE poses a burden on health care systems, disrupts cancer treatment, and contributes to emotional distress and physical discomfort.3,4 Patients with VTE also carry a substantial risk of recurrence.5
Primary prophylaxis with low-molecular-weight heparin reduces the risk of VTE, but the associated bleeding risk and burden of daily injections have hampered its implementation into routine clinical practice.6 Risk stratification tools have therefore been developed aiming to identify individuals at high risk of VTE, among whom the risk-benefit ratio is favorable.7 The most widely recommended is the Khorana score, originally designed to assess the risk of VTE in patients initiating chemotherapy.8 It is a simple, point-based risk score attributing points to certain cancer types, routine laboratory test values, and body mass index (see supplemental Table 1 for details). The Khorana score is widely recommended by guidelines and has been used to define 2 randomized trial populations investigating the role of direct oral anticoagulants vs placebo for primary prevention of VTE in ambulatory cancer patients.9,10 Both studies demonstrated a reduction in the incidence of VTE but with a higher risk of major bleeding. Accordingly, the net clinical benefit of anticoagulation for primary VTE prophylaxis continues to be debated, and the optimal treatment decision threshold for anticoagulation when using the Khorana score is not well defined.11,12 Some guidelines recommend using a Khorana score of ≥3 as a potential indication for anticoagulation,13 while most recommend a score threshold of ≥2 as used in the randomized trials.9,10,14-16 Indeed, cumulative incidences of VTE vary widely for similar score levels when compared across validation studies, cancer types, and cancer therapies, indicating a need for further validation or refinement of the Khorana score.17 Also, some previous studies have ignored competing risk of death, which may lead to an overestimation of VTE risk and subsequently overoptimistic claims about the possible absolute risk reduction in a real-world setting.9,10,18-20
We aimed to assess the clinical potential of using the Khorana score to stratify an unselected sample of Danish ambulatory cancer patients initiating chemotherapy according to the risk of incident VTE, both overall and by cancer subtypes. We also aimed to quantify the impact of ignoring competing risk of death when estimating absolute risk.
Methods
Study design and setting
This is a register-based cohort study of Danish ambulatory cancer patients initiating chemotherapy. Administrative nationwide health registries were used to characterize patients and identify outcomes.21 Information was obtained using a unique personal identification number given to all Danish residents at birth or immigration. This study included data from 1) the Civil Registration System, storing information about age, sex, vital and migration status,21 2) the National Patient Register containing information on discharge diagnosis for hospitalized patients since 1977,22 3) the National Prescription Registry, which holds information on all reimbursed prescriptions from Danish pharmacies since 1995,23 and 4) the Register of Laboratory Results for Research database, which contains laboratory values for most regions in Denmark.24 Codes used to define the study population, covariates, and outcomes are available in supplemental Table 2.
Study population
The study population consisted of ambulatory patients initiating chemotherapy for cancer at Danish hematology or oncology departments in Denmark from 2010 through mid-2018. In accordance with the original Khorana derivation cohort, patients were followed from the day of initiation of chemotherapy.8 Patients who had claimed a prescription for any anticoagulant drug within 1 year or who had an existing potential indication for anticoagulation (previous atrial fibrillation, VTE, or mechanical heart valves) were excluded. Chemotherapy was defined using Danish examination and procedure codes registered in the National Patient Register, codes which have a positive predictive value of 95%.25,26 The type of cancer was defined by the specific cancer diagnosis registered in combination with the procedure code for chemotherapy. If patients had more than 1 cancer diagnosis in relation to the procedure code for chemotherapy, preference was given to the most high-risk diagnosis as defined by the Khorana score. If patients had no cancer diagnosis prior to chemotherapy, inclusion in the study population was allowed only if they were registered with a cancer diagnosis within 30 days after chemotherapy. Patients with primary brain cancer and myeloma were also excluded since they were not included in the original Khorana study.8 Not all Danish regions reported laboratory values to the Register of Laboratory Results for Research database throughout the entire study period, and patients with no laboratory values available were therefore excluded.24
Khorana score
The Khorana score is a guideline-recommended point-based risk score used to estimate the risk of incident VTE in ambulatory cancer patients.8 Points are attributed according to cancer type (stomach or pancreas [2 points], lung, lymphoma, gynecologic, bladder, or testicular cancer [1 point]), platelet count ≥350 × 109/L (1 point), hemoglobin level <10 g/dL (equivalent to <6.21 mmol/L) or using erythrocyte growth factors (1 point), leukocyte count >11 × 109/L (1 point), and body mass index ≥35 kg/m2 (1 point). Laboratory values were pretreatment values obtained prior to medical cancer treatment. Information on cancer type was obtained using the National Patient Register. Body mass index ≥35 kg/m2 was defined using the International Classification of Diseases (ICD) 10 codes. Data on height and weight were also extracted from the regional VARiS MedOncology database, which stores information about ambulatory cancer patients treated at the North Region Denmark center for oncology based at Aalborg University Hospital. This was done to evaluate the magnitude of underestimation of patients with BMI ≥35 kg/m2 using ICD codes alone.27 Platelet, hemoglobin, and leukocyte count were extracted from the Register of Laboratory Results for Research database.24 Information on erythropoiesis-stimulating agents was extracted by treatment codes in the National Patient Registry. Information on anticoagulation use was obtained from the National Prescription Registry.
Outcome
Patients were followed until the occurrence of VTE (pulmonary embolism or deep vein thrombosis, both proximal and distal, as ICD codes do not permit a clear distinction), emigration, death, or end-of-follow-up, whichever occurred first. VTE was defined as a primary or secondary in- or outpatient diagnosis given in combination with a relevant imaging procedure, ensuring a positive predictive value of approximately 91%.28 Information on death and emigration was obtained from the Civil Registration System. Patients were followed for a maximum period of 6 months in the primary analysis to align with guideline recommendations and follow-up from randomized clinical trials.9,10,29 As a secondary sensitivity outcome, we defined a broad definition of VTE comprising pulmonary embolism, deep vein thrombosis, thrombophlebitis, and thrombosis located in the retinal, cerebral, portal, caval, or renal vein, and without requiring an imaging procedure in combination with the diagnosis.
Statistical analyses
The Khorana score was evaluated in 3 different versions: 1) according to the original categorization of low risk (score 0), intermediate risk (score 1 to 2) and high risk (score ≥3),8 2) by individual score levels, and 3) according to the threshold used to define the populations in the AVERT and CASSINI trials (score ≥2), which also reflects the treatment threshold recommended by most guidelines.9,10,29 Baseline characteristics were presented overall and stratified according to Khorana score levels, with proportions for categorical values and median and interquartile range for continuous variables. The number of outcome events was reported overall and by Khorana score levels and categories. The 6-month cumulative incidence of VTE was calculated using the cumulative incidence function, which takes into account the competing risk of death.30 Incidence curves are presented graphically both overall and by Khorana risk score levels.
The associations between the individual score components and combinations thereof with the outcomes were evaluated using a competing risk model taking into account competing risk of death, the Fine and Gray method, and presented as subdistribution hazard ratios.31
The performance of the Khorana score was assessed across a priori defined cancer types since concerns have been raised about the usefulness in some types.32 These included gastrointestinal tract, hepatobiliary or pancreatic, lung, breast, urologic, gynecologic, and hematologic cancer.
The cumulative incidence of VTE was also estimated using the Kaplan-Meier function to assess the degree of overestimation of risk compared with the more appropriate cumulative incidence function considering death as a competing event.33
In another sensitivity analysis, patients were censored if diagnosed with atrial fibrillation or if claiming a prescription for an anticoagulant drug during follow-up. A sensitivity analysis restricting the latest study inclusion to mid-2016 was also performed. This was done to evaluate whether low-molecular-weight heparin used from 2017 (where primary outpatient thromboprophylaxis was first mentioned in Danish guidelines) had contributed to artificially low risk estimates. Many patients were excluded due to missing laboratory values, and the overall risk of VTE was reported to evaluate whether those excluded were systematically different from the study population.
Discrimination was evaluated by C-statistics specifically for competing risk data.34 Analyses were performed using Stata version 16 and R statistical software version 3.5.2.
Results
We identified 40 218 patients initiating chemotherapy from 2010 through July 2018 who met the study inclusion criteria (see Figure 1). Baseline characteristics are presented in Table 1. The median age was 65 years, and the majority were females (55.4%). When categorized according to the original Khorana classification, 35.4% were considered low risk (Khorana score 0), 53.6% intermediate risk (Khorana score 1 to 2), and 10.9% as high risk (Khorana score ≥3). Among the cancer types attributed points in the Khorana score, the predominant type was lung cancer (16.3%) and the least prevalent testicular cancer (0.9%). Most patients had a cancer type not assigned points in the Khorana score (59.3%). The proportions of solid and hematologic cancers were 88.0% and 12.0%, respectively.
Table 1.
Khorana risk score category | ||||
---|---|---|---|---|
All, n (%) | 0: low, n (%) | 1-2: intermediate, n (%) | ≥3: High, n (%) | |
Patients | 40 218 (100) | 14 250 (35.4) | 21 565 (53.6) | 4 403 (10.9) |
Sex, female | 22 290 (55.4) | 8 338 (58.5) | 11 568 (53.6) | 2 384 (54.1) |
Age (y), median (IQR) | 65.0 (55.0-72.0) | 63.0 (53.0-71.0) | 66.0 (57.0-73.0) | 66.0 (58.0-72.0) |
Age <50 y | 5 711 (14.2) | 2 534 (17.8) | 2 692 (12.5) | 485 (11.0) |
Age 50-69 y | 20 814 (51.8) | 7 503 (52.7) | 10 989 (51.0) | 2 322 (52.7) |
Age ≥70 y | 13 693 (34.0) | 4 213 (29.6) | 7 884 (36.6) | 1 596 (36.2) |
Khorana score | ||||
0 | 14 250 (35.4) | |||
1 | 12 856 (32.0) | |||
2 | 8 709 (21.7) | |||
3 | 3 623 (9.0) | |||
4 | 717 (1.8) | |||
5-6* | 63 (.02) | |||
Cancer type | ||||
Stomach | 1 250 (3.1) | 0 (0.0) | 685 (3.2) | 565 (12.8) |
Pancreatic | 1 671 (4.2) | 0 (0.0) | 843 (3.9) | 828 (18.8) |
Lung | 6 556 (16.3) | 0 (0.0) | 5 123 (23.8) | 1 433 (32.5) |
Lymphoma | 3 095 (7.7) | 0 (0.0) | 2 617 (12.1) | 478 (10.9) |
Gynecologic | 2 728 (6.8) | 0 (0.0) | 2 188 (10.1) | 540 (12.3) |
Bladder | 767 (1.9) | 0 (0.0) | 619 (2.9) | 148 (3.4) |
Testicular | 347 (0.9) | 0 (0.0) | 326 (1.5) | 21 (0.5) |
Other | 23 804 (59.3) | 14 250 (100) | 9 164 (42.5) | 390 (8.9) |
Hemoglobin level <10 g/dL or use of erythropoiesis-stimulating agent | 3 452 (8.6) | 0 (0.0) | 2 137 (9.9) | 1 315 (29.9) |
Platelet count ≥350 × 109/L | 13 241 (32.9) | 0 (0.0) | 9 301 (43.1) | 3 940 (89.5) |
Leukocyte count >11 × 109/L | 7 830 (19.5) | 0 (0.0) | 4 586 (21.3) | 3 244 (73.7) |
Body mass index ≥35 kg/m2 | 470 (1.2) | 0 (0.0) | 321 (1.5) | 149 (3.4) |
Percentages may not add up to 100 due to rounding.
Categories collapsed to avoid violations of data protection regulations imposed by the Danish Health Data Authority.
In the unselected cohort of patients who have undergone medical cancer treatment in the North Region of Denmark and therefore registered in the VARiS MedOncology database, 5.7% of patients had a body mass index >35 kg/m2. Using ICD codes alone, we identified 1.2%, indicating that approximately 4.5% of the cohort may have had their Khorana score underestimated by 1 point.
Six-month cumulative incidence and discriminatory capacity
Cumulative incidences of VTE are presented in Table 2 and Figure 2. During 6 months of follow-up, 1000 VTE events occurred. In the same period, 5016 patients died, corresponding to a 6-month mortality of 12.5%. Across Khorana score levels and cancer types, 6-month mortality ranged from 1.4% among those with breast cancer and low Khorana scores to 39.8% among patients with lung cancer and Khorana score ≥3. No patients were lost to follow-up due to emigration.
Table 2.
Patients, n | Events, n | Cumulative incidence, % (95% CI)* | |
---|---|---|---|
Overall | 40 218 | 1 000 | 2.5 (2.3-2.6) |
Khorana risk category | |||
0: low risk | 14 250 | 210 | 1.5 (1.3-1.7) |
1-2: intermediate risk | 21 565 | 610 | 2.8 (2.6-3.1) |
≥3: high risk | 4 403 | 180 | 4.1 (3.5-4.7) |
Khorana score level | |||
1 | 12 856 | 318 | 2.5 (2.2-2.8) |
2 | 8 709 | 291 | 3.3 (3.0-3.7) |
3 | 3 623 | 141 | 3.9 (3.3-4.6) |
4 | 717 | 34 | 4.7 (3.4-6.5) |
5-6 | 63 | 5 | 7.9 (2.9-16.2) |
Guideline threshold | |||
Score 0-1 | 27 106 | 529 | 2.0 (1.8-2.1) |
Score ≥2 | 13 112 | 471 | 3.6 (3.3-3.9) |
Based on the cumulative incidence function considering death as competing risk.
The overall cumulative incidence of VTE considering competing risk of death was 2.5% (95% CI, 2.3-2.6) and increased according to Khorana score levels and categories.
Among patients eligible for anticoagulation according to guidelines (Khorana score ≥2), the 6-month cumulative incidence of VTE was 3.6% (95% CI, 3.3-3.9). Of 1000 VTE events, 47.1% occurred among patients with Khorana scores ≥2.
The 6-month C-statistic for the Khorana score was 0.60 (95% CI, 0.58-0.62), meaning the probability was 60% that the baseline Khorana score level was higher for patients experiencing VTE than for those who did not experience the event (ie, who were event-free and either died within or survived the 6 months).35
Cumulative incidence below and above the guideline-recommended treatment threshold of Khorana score ≥2 stratified by cancer type are presented in Figure 3. The capacity of this score threshold for separating patients into risk strata was limited for patients with hepato-biliary or pancreatic cancer, lung cancer, and gynecologic cancer. Among patients with gastrointestinal, urologic, and hematologic cancer, a clear visual separation of patients into lower and higher risk categories was evident. Patients with breast cancer with a Khorana score ≥2 were too few to present stratified cumulative incidence curves. For the entire breast cancer group, the 6-month risk was 0.7% (95% CI, 0.5-0.9), and the subdistribution hazard ratio for those with Khorana score ≥2 vs 0 to 1 was 2.39 (0.86-6.67). Among the remaining patients with Khorana scores ≥2, the 6-month risk was highest in patients with urologic cancer (5.8% [95% CI, 3.9-8.2]) and lowest in patients with breast cancer (1.5% [95% CI, 0.5-3.5]). Cumulative incidences by cancer subtype stratified by the original Khorana categorization are available in supplemental Table 3.
Fine and Gray regression analysis
Associations between individual components of the Khorana score and the risk of VTE are presented in Table 3. A higher Khorana score level was associated with an increasingly higher risk of VTE. After adjustment for other Khorana score components, all individual components except for high platelet count were numerically associated with a higher risk of VTE, although confidence intervals were wide for some components.
Table 3.
Subdistribution hazard ratios* | ||
---|---|---|
Crude | Adjusted† | |
Khorana component | ||
Pancreas | 2.06 (1.64-2.59) | 2.05 (1.63-2.58) |
Stomach | 2.23 (1.74-2.87) | 2.25 (1.76-2.89) |
Lung | 1.36 (1.17-1.59) | 1.26 (1.08-1.48) |
Lymphoma | 1.13 (0.91-1.41) | 1.10 (0.88-1.37) |
Gynecologic | 1.18 (0.94-1.49) | 1.19 (0.94-1.50) |
Bladder | 2.17 (1.58-2.98) | 2.12 (1.55-2.92) |
Testis | 1.04 (0.54-2.01) | 1.12 (0.58-2.15) |
Hemoglobin level <10 g/dL or use of erythropoiesis-stimulating agents | 1.19 (0.97-1.46) | 1.13 (0.91-1.39) |
Platelet count ≥350 × 109/L | 1.15 (1.01-1.31) | 0.94 (0.82-1.08) |
Leukocyte count >11 × 109/L | 1.73 (1.51-1.99) | 1.63 (1.41-1.88) |
Body mass index ≥35 kg/m2 | 1.30 (0.78-2.17) | 1.33 (0.79-2.22) |
Khorana score level | ||
0 | Ref. | |
1 | 1.69 (1.42-2.01) | |
2 | 2.29 (1.92-2.74) | |
3 | 2.68 (2.17-3.32) | |
4 | 3.29 (2.28-4.72) | |
5-6 | 5.66 (2.30-13.93) |
Based on the Fine and Gray regression model using time since initiation of chemotherapy as underlying time scale.
Adjusted for other Khorana score components.
Impact of outcome definition and methodological approach
Estimated cumulative incidence using the Kaplan-Meier function resulted in a relative overestimation compared with the competing risk model (see Figure 4). In the overall population, the overestimation was negligible in the low Khorana score levels, but up to 19.1% in the Khorana score level with the highest competing mortality risk. When stratified by cancer type, the largest overestimation by Kaplan-Meier was seen among patients with urological cancer and Khorana scores ≥3, which was 23.0% compared with estimates considering competing risk of death. The cumulative incidence with the Kaplan-Meier estimator among patients with Khorana score ≥2 was 4.0% vs 3.6% in the competing risk analysis.
Implementation of a broad definition of VTE resulted in higher cumulative incidences compared with the strict definition (see supplemental Table 4 for details).
Sensitivity analyses
Censoring patients diagnosed with atrial fibrillation or claiming a prescription for an anticoagulant drug during follow-up yielded similar 6-month VTE risk estimates as in the main analysis, with risks of 1.5% for low-risk, 2.7% for intermediate-risk, and 4.0% for high-risk patients.
Risk estimates were also similar when limiting the observation period to before 2017, with risks of 1.4%, 2.7%, and 4.1% for low-, intermediate-, and high-risk categories, respectively.
The overall 6-month risk of VTE was identical among those included in the study population and those excluded due to missing laboratory values (both 2.5%).
Discussion
In a large, unselected population of ambulatory cancer patients, the Khorana score was able to risk-stratify patients according to the 6-month risk of incident VTE, but only for patients with certain cancer subtypes. In general, absolute risks of VTE were lower than reported in previous validation studies and randomized trials. We also observed that the choice of statistical methodology had a substantial impact on estimated risk.
There is mounting evidence supporting that anticoagulation, either low-molecular-weight heparin or direct oral anticoagulants, has the capacity to prevent VTE in ambulatory cancer patients.6,9,10,36 The benefit of primary prophylaxis differs for patients with moderate- (2) or high-risk (≥3) Khorana scores, with the highest benefit for highest risk patients.37 The effectiveness and safety are consistent regardless of whether patients have newly diagnosed or recurrent cancer and for those with and without metastatic disease.38,39 However, due to uncertainties about the net clinical benefit, mainly related to bleeding risk, guideline recommendations remain vague, and primary thromboprophylaxis is therefore rarely used in clinical practice.40-43
The Khorana score has been validated previously. However, the present study was larger than previous validation studies reporting 6-month incidence combined, allowing for stratified analyses with consistent methodology across cancer subgroups.17,44 A comprehensive meta-analysis of Khorana validation studies demonstrated that the weighted 6-month incidence of VTE in cancer patients was 11% among patients with Khorana scores ≥3, which was substantially higher than the 4.1% in the present study.17 Importantly, risk estimates of the included studies ranged from 0% to 44.4%, showing that the Khorana score is far from a well-calibrated risk score.17,45 Of note, the meta-analysis did not report how the cumulative incidences were calculated, including whether competing risk models were used. Several studies have depicted or reported cumulative incidence by Khorana levels using the Kaplan-Meier function, including the pivotal randomized trials,9,10,18-20 but failing to account for competing risk of death may overestimate incidence.46 In the present study, we demonstrated that inappropriate use of the Kaplan-Meier method overestimated risk estimates up to 23% among those with the highest competing mortality risk. Overestimation of risk also leads to lower numbers needed to treat and consequently overoptimistic claims of the expected absolute benefit of treatment.47 For example, assuming a 50% relative risk reduction among patients with Khorana score ≥2 as approximately reported in the AVERT trial, the number needed to treat to prevent 1 VTE event in the present study would be 50 based on the Kaplan-Meier estimate and 56 based on the cumulative incidence function. Nevertheless, the reported cumulative incidences from the present study should also be interpreted with caution, as also discussed below in the “Strengths and limitations” section.
The C-statistic for the Khorana score in this study was poor at 0.60, but it must be interpreted in the context of its limitations as a measure of overall risk score performance when the purpose of the score is guiding treatment decisions in relation to a given score threshold.48 In this case, calibration (ie, how well the observed risk estimates are consistent with estimates from previous studies) is of higher clinical relevance. Absolute risk estimates in the present study were markedly lower than in previous studies. In the AVERT trial, the reported 6-month risk of VTE in the placebo arm was 10.2%, and the corresponding estimate in CASSINI was 8.8%.9,10 Even when applying a broad outcome definition and calculating absolute risks using the Kaplan-Meier function, the corresponding absolute risks in this study were substantially lower than in the trial populations. Of note, inclusion criteria in the present study and the randomized trials were not identical (eg, we excluded patients with a history of VTE who may carry higher risks of future VTE).49 Methodologic limitations associated with using administrative registries for outcome identification may also have contributed to the difference in risk estimates compared with the randomized trials. Mortality was lower in the present study than in the trials, likely reflecting different distributions of patients receiving chemotherapy with curative and palliative intent. However, guidelines for thromboprophylaxis do not consider the indication for chemotherapy, and VTE risk has also been reported to be substantial for patients undergoing curatively intended treatment.50
Importantly, the net clinical benefit and number needed to treat to prevent 1 event depend on the absolute risk of VTE.6,36,37 It has been estimated that patients with a 6-month cumulative incidence <8% are unlikely to benefit from primary prophylaxis based on post hoc data from the AVERT trial.18 In the present study, only 0.2% of patients with Khorana scores ≥5 had 6-month risks exceeding this threshold.
While the reductionist design of the Khorana score supports its applicability into clinical practice, it also ignores other potential prognostic factors for incident VTE in cancer patients (eg, cancer stage, type of anticancer treatment, history of other cancer, and biomarkers).7,51 Ultimately, the complexity of a risk score should not hamper clinical implementation. The results from this and previous studies do not support the use of a universal Khorana score threshold for all cancer patients since it provided no clinically relevant stratification in several cancer subgroups (see Figure 3). Other studies also found a limited clinical value of the Khorana score in patients with lung cancer, indicating the need for considering other risk markers for this subgroup.52,53 Indeed, refined risk stratification to guide primary prevention of VTE remains an unmet need among cancer patients. Cancer-specific Khorana score thresholds or development of cancer-specific risk scores are needed for improving individualized risk assessment while also considering patient preferences.41,54 Several alternative risk scores already exist but are not recommended in guidelines.7 Future studies with a focus on risk stratification should ensure consistent and appropriate methodology to optimize opportunities for between-study comparisons and to avoid overestimation of risk when ignoring competing risk of death. Comparative effectiveness studies of anticoagulation vs placebo, whether randomized or observational, would benefit from estimating the net clinical benefit (eg, using the number needed to treat for net effect measure).55 Also, bleeding risk likely differs markedly across cancer types, but no formal bleeding risk assessment tools are recommended in current guidelines, underlining another important evidence gap.29,55
Strengths and limitations
The large sample size minimized random variation and allowed for stratified analyses across several cancer types.
The number of patients with body mass index >35 was underestimated based on ICD-10 identification alone, but the resulting minor misclassification of Khorana score levels is unlikely to have impacted the results substantially.27 The validity of a diagnosis of VTE given in combination with a relevant imaging procedure is high (>90%) and unlikely to be associated with Khorana score levels. Information bias is therefore not a likely explanation of the observed differences in risk across Khorana levels. We also applied different methodology and outcome definitions to explore the potential scope of variation in risk estimates. The sensitivity of ICD codes for identifying VTE is not known, and some events may not have been coded by the treating physicians, thus contributing to underestimation of risk.
We aimed to assess VTE risk in a population free from anticoagulation. Nonetheless, some patients could theoretically have been treated with low-molecular-weight heparin, which is not traceable in registries since it is handed out directly from the hospital departments. This would cause artificially low risk estimates. However, we excluded all patients with a recent history of a claimed prescription of an anticoagulant drug as well as with potential comorbidity, which could trigger an indication for low-molecular-weight heparin. An option for primary outpatient thromboprophylaxis with low-molecular-weight heparin was introduced in Danish guidelines in 2017 but is not used in clinical practice.40,42,56 Restricting the study period to before 2017 also revealed similar risk estimates, indicating that the use of low-molecular-weight heparin in the most recent years did not contribute to lowering risk estimates.
Patients were followed in administrative registries with virtually complete follow-up. Some deaths could be due to undiagnosed pulmonary embolism. Previous studies have reported a 5% to 10% prevalence of pulmonary embolism in autopsied cancer patients.57,58 Such deaths due to VTE would have been misclassified as competing risk mortality instead of counting as a VTE event, potentially leading to underestimation of the incidence of VTE.
We were unable to describe bleeding risk, another key determinant of the benefit of anticoagulation, since primary thromboprophylaxis in ambulatory patients is not routinely used in Denmark.
Conclusions
The Khorana score was able to risk-stratify ambulatory cancer patients initiating chemotherapy according to the risk of VTE, but only for selected cancer types, challenging the universal application of the Khorana score for guiding decisions on primary thromboprophylaxis. Reported risk estimates varied substantially depending on the choice of methodology. Also, absolute risks of VTE for patients eligible for anticoagulation in guidelines were lower than observed in previous studies. Thus, the absolute benefit of implementing routine primary thromboprophylaxis in an unselected cancer population may be smaller than anticipated by randomized trial data.
Supplementary Material
The full-text version of this article contains a data supplement.
Acknowledgments
The authors wish to thank Annette Juul Madsen for assisting with data extraction from the VARiS MedOncology database.
The study was supported by North Denmark Region’s Fund for Health Sciences Research.
Authorship
Contribution: T.F.O. conceived the study idea, analyzed the data, and wrote the paper; F.S. also analyzed the data; F.S., P.B.N., A.G.O., I.L.G., M.T.S., I.E.A., and T.B.L. contributed with substantial contributions to the study design, interpretation of data for the work, and revised the paper critically for important intellectual content; A.K.V., G.P., and S.N. contributed to the interpretation of data and revised the manuscript critically for important intellectual content; and all authors gave final approval of the version to be published.
Conflict-of-interest disclosure: P.B.N. Personal fees from Boehringer Ingelheim, grants and personal fees from Daiichi-Sankoy, grants from BMS/Pfizer, and grants and personal fees from Bayer outside the submitted work. G.P. Research grant support from Bristol Myers Squibb/Pfizer Alliance, Janssen, Boston Scientific Corporation, Bayer, Amgen, and Portola. S.N. Speaker bureau for Leo Pharma, BMS/Pfizer, and Bayer, and grant support from Leo Pharma. I.E.A. speaking fees from Pfizer and Bayer. T.B.L. Consulting fees from BMS/Pfizer, Bayer, and MSD, speaker bureau for BMS/Pfizer, Bayer, and MSD, and grant support from Bayer and Daiichi-Sankoy. F.S. Consulting fees from Bayer. All other authors declare no competing financial interests.
Correspondence: Thure Filskov Overvad, Aalborg Hospital Science and Innovation Centre, Søndre Skovvej 15, 9000 Aalborg, Denmark; e-mail: t.overvad@rn.dk.
References
- 1.Bray F, Jemal A, Grey N, Ferlay J, Forman D. Global cancer transitions according to the Human Development Index (2008-2030): a population-based study. Lancet Oncol. 2012;13(8):790-801. [DOI] [PubMed] [Google Scholar]
- 2.Ording AG, Skjøth F, Søgaard M, et al. Increasing incidence and declining mortality after cancer-associated venous thromboembolism: a nationwide cohort study. Am J Med. 2021;134(7):868-876.e5. [DOI] [PubMed] [Google Scholar]
- 3.Khalil J, Bensaid B, Elkacemi H, et al. Venous thromboembolism in cancer patients: an underestimated major health problem. World J Surg Oncol. 2015;13(1):204. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Alam AU, Karkhaneh M, Sun HL, Wu C. Survival patterns among venous thromboembolism patients with hematologic malignancies in Alberta, Canada from 2003 to 2015. Thromb Res. 2021;199:59-66. [DOI] [PubMed] [Google Scholar]
- 5.Albertsen IE, Nielsen PB, Søgaard M, et al. Risk of recurrent venous thromboembolism: a Danish nationwide cohort study. Am J Med. 2018; 131(9):1067-1074.e4. [DOI] [PubMed] [Google Scholar]
- 6.Rutjes AW, Porreca E, Candeloro M, Valeriani E, Di Nisio M. Primary prophylaxis for venous thromboembolism in ambulatory cancer patients receiving chemotherapy. Cochrane Database Syst Rev. 2020;12(12):CD008500. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Gerotziafas GT, Mahé I, Lefkou E, et al. Overview of risk assessment models for venous thromboembolism in ambulatory patients with cancer. Thromb Res. 2020;191(suppl 1):S50-S57. [DOI] [PubMed] [Google Scholar]
- 8.Khorana AA, Kuderer NM, Culakova E, Lyman GH, Francis CW. Development and validation of a predictive model for chemotherapy-associated thrombosis. Blood. 2008;111(10):4902-4907. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Khorana AA, Soff GA, Kakkar AK, et al. ; CASSINI Investigators . Rivaroxaban for thromboprophylaxis in high-risk ambulatory patients with cancer. N Engl J Med. 2019;380(8):720-728. [DOI] [PubMed] [Google Scholar]
- 10.Carrier M, Abou-Nassar K, Mallick R, et al. ; AVERT Investigators . Apixaban to prevent venous thromboembolism in patients with cancer. N Engl J Med. 2019;380(8):711-719. [DOI] [PubMed] [Google Scholar]
- 11.Carrier M. Debate: thromboprophylaxis should be considered in all patients with cancer - Yes. Thromb Res. 2020;191:142-144. [DOI] [PubMed] [Google Scholar]
- 12.van Es N. Debate: thromboprophylaxis should be considered in all patients with cancer - No. Thromb Res. 2020;191:34-35. [DOI] [PubMed] [Google Scholar]
- 13.Angelini D, Ashrani A, Bockenstedt PL, et al. NCCN Guidelines Version 1. 2019 Cancer-Associated Venous Thromboembolic Disease. 2019.
- 14.Key NS, Khorana AA, Kuderer NM, et al. Venous thromboembolism prophylaxis and treatment in patients with cancer: ASCO clinical practice guideline update. J Clin Oncol. 2020;38(5):496-520. [DOI] [PubMed] [Google Scholar]
- 15.Farge D, Frere C, Connors JM, et al. ; International Initiative on Thrombosis and Cancer (ITAC) advisory panel . 2019 international clinical practice guidelines for the treatment and prophylaxis of venous thromboembolism in patients with cancer. Lancet Oncol. 2019;20(10):e566-e581. [DOI] [PubMed] [Google Scholar]
- 16.Wang TF, Zwicker JI, Ay C, et al. The use of direct oral anticoagulants for primary thromboprophylaxis in ambulatory cancer patients: guidance from the SSC of the ISTH. J Thromb Haemost. 2019;17(10):1772-1778. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Mulder FI, Candeloro M, Kamphuisen PW, et al. ; CAT-prediction collaborators . The Khorana score for prediction of venous thromboembolism in cancer patients: a systematic review and meta-analysis. Haematologica. 2019;104(6):1277-1287. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Kumar V, Shaw JR, Key NS, et al. D-Dimer enhances risk-targeted thromboprophylaxis in ambulatory patients with cancer. Oncologist. 2020; 25(12):1075-1083. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Khorana AA, Kuderer NM, McCrae K, et al. Cancer associated thrombosis and mortality in patients with cancer stratified by khorana score risk levels. Cancer Med. 2020;9(21):8062-8073. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Ay C, Dunkler D, Marosi C, et al. Prediction of venous thromboembolism in cancer patients. Blood. 2010;116(24):5377-5382. [DOI] [PubMed] [Google Scholar]
- 21.Schmidt M, Pedersen L, Sørensen HT. The Danish Civil Registration System as a tool in epidemiology. Eur J Epidemiol. 2014;29(8):541-549. [DOI] [PubMed] [Google Scholar]
- 22.Lynge E, Sandegaard JL, Rebolj M. The Danish National Patient Register. Scand J Public Health. 2011;39(suppl 7):30-33. [DOI] [PubMed] [Google Scholar]
- 23.Kildemoes HW, Sørensen HT, Hallas J. The Danish National Prescription Registry. Scand J Public Health. 2011;39(suppl 7):38-41. [DOI] [PubMed] [Google Scholar]
- 24.Arendt JFH, Hansen AT, Ladefoged SA, Sørensen HT, Pedersen L, Adelborg K. Existing data sources in clinical epidemiology: laboratory information system databases in Denmark. Clin Epidemiol. 2020;12:469-475. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.SKS-browser, version 4.05. Copyright: the Danish Health and Medicines Authority.
- 26.Broe MO, Jensen PB, Mattsson TO, Pottegård A. Validity of antineoplastic procedure codes in the Danish National Patient Registry: the case of colorectal cancer. Epidemiology. 2020;31(4):599-603. [DOI] [PubMed] [Google Scholar]
- 27.Gribsholt SB, Pedersen L, Richelsen B, Thomsen RW. Validity of ICD-10 diagnoses of overweight and obesity in Danish hospitals. Clin Epidemiol. 2019;11:845-854. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Sundbøll J, Adelborg K, Munch T, et al. Positive predictive value of cardiovascular diagnoses in the Danish National Patient Registry: a validation study. BMJ Open. 2016;6(11):e012832. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Streiff MB, Abutalib SA, Farge D, Murphy M, Connors JM, Piazza G. Update on guidelines for the management of cancer‐associated thrombosis. Oncologist. 2021;26(1):e24-e40. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Coviello V, Boggess M. Cumulative incidence estimation in the presence of competing risks. Stata J. 2004;4(2):103-112. [Google Scholar]
- 31.Austin PC, Fine JP. Practical recommendations for reporting Fine-Gray model analyses for competing risk data. Stat Med. 2017;36(27): 4391-4400. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.van Es N, Ventresca M, Di Nisio M, et al. ; IPDMA Heparin Use in Cancer Patients Research Group . The Khorana score for prediction of venous thromboembolism in cancer patients: an individual patient data meta-analysis. J Thromb Haemost. 2020;18(8):1940-1951. [DOI] [PubMed] [Google Scholar]
- 33.Wolbers M, Koller MT, Witteman JCM, Steyerberg EW. Prognostic models with competing risks: methods and application to coronary risk prediction. Epidemiology. 2009;20(4):555-561. [DOI] [PubMed] [Google Scholar]
- 34.Blanche P. Time-Dependent ROC Curve and AUC for Censored Survival Data. R Package “timeROC” Version 0.4. 2019.
- 35.Blanche P, Dartigues JF, Jacqmin-Gadda H. Estimating and comparing time-dependent areas under receiver operating characteristic curves for censored event times with competing risks. Stat Med. 2013;32(30):5381-5397. [DOI] [PubMed] [Google Scholar]
- 36.Schünemann HJ, Ventresca M, Crowther M, et al. Evaluating prophylactic heparin in ambulatory patients with solid tumours: a systematic review and individual participant data meta-analysis. Lancet Haematol. 2020;7(10):e746-e755. [DOI] [PubMed] [Google Scholar]
- 37.Bosch FTM, Mulder FI, Kamphuisen PW, et al. Primary thromboprophylaxis in ambulatory cancer patients with a high Khorana score: a systematic review and meta-analysis. Blood Adv. 2020;4(20):5215-5225. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Zhang J, Atalla M, Mallick R, Wells PS, Carrier M. Thromboprophylaxis for patients with newly diagnosed vs. recurrent cancers: a post-hoc analysis of the avert trial. J Thromb Thrombolysis. 2021;51(3):720-724. [DOI] [PubMed] [Google Scholar]
- 39.Knoll W, Mallick R, Wells PS, Carrier M. Safety and efficacy of apixaban thromboprophylaxis in cancer patients with metastatic disease: a post-hoc analysis of the AVERT trial. Thromb Res. 2021;197:13-15. [DOI] [PubMed] [Google Scholar]
- 40.Højen AA, Overvad TF, Nybo M, et al. Management of cancer-associated venous thrombosis: a nationwide survey among Danish oncologists. TH Open. 2021;5(2):e188-e194. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Mulder FI, Bosch FTM, van Es N. Primary thromboprophylaxis in ambulatory cancer patients: Where do we stand? Cancers (Basel). 2020;12(2):367. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Martin KA, Molsberry R, Khan SS, Linder JA, Cameron KA, Benson A III. Preventing venous thromboembolism in oncology practice: use of risk assessment and anticoagulation prophylaxis. Res Pract Thromb Haemost. 2020;4(7):1211-1215. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Lyman GH, Carrier M, Ay C, et al. American Society of Hematology 2021 guidelines for management of venous thromboembolism: prevention and treatment in patients with cancer [published correction appears in Blood Adv. 2022;5(7):1953]. Blood Adv. 2021;5(4):927-974. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.van Es N, Ventresca M, Di Nisio M, et al. ; IPDMA Heparin Use in Cancer Patients Research Group . The Khorana score for prediction of venous thromboembolism in cancer patients: an individual patient data meta-analysis. J Thromb Haemost. 2020;18(8):1940-1951. [DOI] [PubMed] [Google Scholar]
- 45.Van Calster B, McLernon DJ, van Smeden M, Wynants L, Steyerberg EW; Topic Group ‘Evaluating diagnostic tests and prediction models’ of the STRATOS initiative . Calibration: the Achilles heel of predictive analytics. BMC Med. 2019;17(1):230. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Abdel-Qadir H, Fang J, Lee DS, et al. Importance of considering competing risks in time-to-event analyses: application to stroke risk in a retrospective cohort study of elderly patients with atrial fibrillation. Circ Cardiovasc Qual Outcomes. 2018;11(7):e004580. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Gouskova NA, Kundu S, Imrey PB, Fine JP. Number needed to treat for time-to-event data with competing risks. Stat Med. 2014;33(2):181-192. [DOI] [PubMed] [Google Scholar]
- 48.Cook NR. Use and misuse of the receiver operating characteristic curve in risk prediction. Circulation. 2007;115(7):928-935. [DOI] [PubMed] [Google Scholar]
- 49.Yu YB, Gau JP, Liu CY, et al. A nation-wide analysis of venous thromboembolism in 497,180 cancer patients with the development and validation of a risk-stratification scoring system. Thromb Haemost. 2012;108(2):225-235. [DOI] [PubMed] [Google Scholar]
- 50.Di Nisio M, Candeloro M, Rutjes AWS, Porreca E. Venous thromboembolism in cancer patients receiving neoadjuvant chemotherapy: a systematic review and meta-analysis. J Thromb Haemost. 2018;16(7):1336-1346. [DOI] [PubMed] [Google Scholar]
- 51.Gade IL, Severinsen MT, Kragholm KH, Kristensen SR, Torp-Pedersen C, Riddersholm SJ. Epidemiology of venous thromboembolism after second cancer. Clin Epidemiol. 2020;12:377-386. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Noble S, Alikhan R, Robbins A, Macbeth F, Hood K. Predictors of active cancer thromboembolic outcomes: validation of the Khorana score among patients with lung cancer: comment. [comment] J Thromb Haemost. 2017;15(3):590-591. [DOI] [PubMed] [Google Scholar]
- 53.Roopkumar J, Poudel SK, Gervaso L, et al. Risk of thromboembolism in patients with ALK- and EGFR-mutant lung cancer: a cohort study [published correction appears in J Thromb Haemost. 2021;19(11):2902]. J Thromb Haemost. 2021;19(3):822-829. [DOI] [PubMed] [Google Scholar]
- 54.Overvad TF, Larsen TB, Søgaard M, et al. Cancer-associated venous thromboembolism and the non-vitamin K antagonist oral anticoagulants: a review of clinical outcomes and patient perspectives. Expert Rev Cardiovasc Ther. 2020;18(11):791-800. [DOI] [PubMed] [Google Scholar]
- 55.Li G, Lip GYH, Marcucci M, Thabane L, Tian J, Levine MAH. The number needed to treat for net effect (NNTnet) as a metric for measuring combined benefits and harms. J Clin Epidemiol. 2020;125:100-107. [DOI] [PubMed] [Google Scholar]
- 56.Guideline by Danish Society of Thrombosis and Haemostasis and Danish Society of Clinical Oncology [Danish]. Cancer and Venous Thromboembolism. 2017.
- 57.Gimbel IA, Mulder FI, Bosch FTM, et al. Pulmonary embolism at autopsy in cancer patients. J Thromb Haemost. 2021;19(5):1228-1235. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Valerio L, Turatti G, Klok FA, et al. Prevalence of pulmonary embolism in 127 945 autopsies performed in cancer patients in the United States between 2003 and 2019. J Thromb Haemost. 2021;19(6):1591-1593. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.