Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2025 Jul 1.
Published in final edited form as: Am J Hematol. 2024 Apr 23;99(7):1230–1239. doi: 10.1002/ajh.27335

Thrombosis Risk Prediction in Lymphoma Patients: a Multi-Institutional, Retrospective Model Development and Validation Study

Shengling Ma 1,#, Jennifer La 2,3,#, Kaitlin N Swinnerton 2, Danielle Guffey 4, Raka Bandyo 5, Giordana De Las Pozas 6, Katy Hanzelka 7, Xiangjun Xiao 4, Cristhiam Rojas Hernandez 8, Christopher I Amos 4,9, Vipul Chitalia 2,10,11, Katya Ravid 10, Kelly W Merriman 6, Christopher R Flowers 12, Nathanael R Fillmore 2,3,*, Ang Li 1,*
PMCID: PMC11166507  NIHMSID: NIHMS1984969  PMID: 38654461

Abstract

Venous thromboembolism (VTE) poses significant risk to cancer patients receiving systemic therapy. The generalizability of pan-cancer models to lymphomas is limited. Currently, there are no reliable risk prediction models for thrombosis in patients with lymphoma. Our objective was to create a risk assessment model (RAM) specifically for lymphomas. We performed a retrospective cohort study to develop Fine and Gray subdistribution hazard model for VTE and pulmonary embolism (PE)/ lower extremity deep vein thrombosis (LE-DVT) respectively in adult lymphoma patients from the Veterans Affairs national healthcare system (VA). External validations were performed at the Harris Health System (HHS) and the MD Anderson Cancer Center (MDACC). Time-dependent c-statistic and calibration curves were used to assess discrimination and fit. There were 10,313 (VA), 854 (HHS), and 1,858 (MDACC) patients in the derivation and validation cohorts with diverse baseline. At 6 months, the VTE incidence was 5.8% (VA), 8.2% (HHS), and 8.8% (MDACC), respectively. The corresponding estimates for PE/LE-DVT were 3.9% (VA), 4.5% (HHS), and 3.7% (MDACC), respectively. The variables in the final RAM included lymphoma histology, body mass index, therapy type, recent hospitalization, history of VTE, history of paralysis/immobilization, and time to treatment initiation. The RAM had c-statistics of 0.68 in the derivation and 0.69 and 0.72 in the two external validation cohorts. The two models achieved a clear differentiation in risk stratification in each cohort. Our findings suggest that easy-to-implement, clinical-based model could be used to predict personalized VTE risk for lymphoma patients.

Keywords: Venous Thromboembolism, Pulmonary Embolism, Venous Thrombosis, Lymphoma, Prediction model, External validation

Graphical Abstract

graphic file with name nihms-1984969-f0002.jpg

Introduction

Patients with cancer undergoing systemic treatment are at higher risk of experiencing venous thromboembolism (VTE), especially pulmonary embolism (PE) and lower extremity deep vein thrombosis (LE-DVT), compared with the general population.1, 2 VTE significantly elevates risks of morbidity and mortality.3

There have been various attempts to predict and prevent VTE among the general cancer population. However, the generalizability of pan-cancer models is questioned in lymphoma settings since multiple studies indicate that risk factors for VTE in patients with lymphoma are different from risk factors in patients with solid tumors.49 For example, the Khorana Score categorizes all subtypes of lymphomas as intermediate-risk cancer types with c-statistics 0.51, 0.50, and 0.60 in external lymphoma validation cohorts.6, 10, 11, 12 These limitations underscore a need for a VTE risk assessment model (RAM) specifically for lymphoma. Antic et al.6 proposed the ThroLy Score for lymphoma patients which incorporated lymphoma-specific factors like extranodal disease and mediastinal involvement; however, it did not validate well in external cohorts (c-statistic 0.55 and 0.57).11, 13 Two other recently derived risk prediction models still require external validation. Dharmavaram et al.6 incorporated only diffuse large B-cell lymphoma (DLBCL) and follicular lymphoma (FL), while TiC-LYMPHO11 was derived based on genetic variables, which could be less convenient to use in general patients. Moreover, most of the current models did not incorporate nuanced histologic subtypes of lymphoma with external validation or death as a competing event for VTE.

The current study built upon recently published cohort studies that combined data from cancer registries and electronic data warehouses (EDW) from multiple institutions in the United States (U.S.) with improved phenotyping for VTE.14, 15 Our study aimed to derive and validate a simplified VTE RAM tailored specifically to lymphoma patients based on individual clinical and laboratory attributes to identify those at risk for thromboembolic events.

Methods

Study Design, Population

We developed and externally validated the VTE RAM using retrospective data from three separate U.S. healthcare systems (Supplemental Figure 1). Patients from incident diagnosis of lymphoma 2006–2021 from the national Veterans Affairs healthcare system (VA) formed the derivation cohort. Independent lymphoma patients from the Harris Health System (HHS) 2011–2020 and MD Anderson Cancer Center (MDACC) 2017–2020 formed the validation cohorts. VA is an integrated healthcare network with 171 medical centers and 1,113 outpatient clinics dedicated to veterans. In these integrated systems, patients are highly likely to receive continuous oncologic care with consistent long-term follow-up. HHS is a safety-net health care system featuring two medical centers and 18 outpatient clinics, serving patients of varied racial and ethnic origins in the Houston metropolitan region. MDACC is one of the largest comprehensive cancer centers in the US.

Patient selection followed the same inclusion and exclusion criteria as our previous studies.14, 15 In summary, patients were included if they had newly diagnosed lymphoma and underwent first-line systemic therapy within one year of diagnosis. Patients were excluded if they had recent diagnosis of acute VTE within the last 6 months or were prescribed anticoagulant within 30 days before the index date. The index date was the day systemic therapy was initiated, and all covariates were extracted on or before the index date (Supplemental Table 1).

Outcome definition

Overall VTE was defined as a radiologically verified PE, LE-DVT, or proximal or distal deep vein thrombosis in the upper extremity (UE-DVT).16 We selected the 6-month cumulative risk of VTE as our primary endpoint and PE/LE-DVT as the secondary endpoint.17, 18 Outcomes were ascertained using our published, institution-specific ICD-10-CM and natural language processing (NLP) radiology algorithms with a positive predictive value (PPV) of 91% at the VA health care system, 98% at HHS, and 95% at MDACC.14, 15

Risk factor definition

Thirty candidate predictors were initially chosen based on clinical relevance and data availability (Supplemental Table 1). The definitions for most variables were detailed in our previous publications.14, 15 Lymphoma subtypes were defined in Supplemental Table 2 and additional covariates added for the current study included laboratory variables (red cell distribution width, LDH, albumin, and calcium).

Statistical Analysis

For the RAM derivation, we mandated the classification of lymphoma subtypes based on the logistic regression odds ratios (ORs) of VTE at 6 months. We used the Least Absolute Shrinkage and Selection Operator (LASSO) regression for parsimonious feature selection beyond lymphoma subtypes.1921 We then constructed a Fine and Gray subdistribution hazard model using the final selected variables to predict the cumulative incidence with death as competing events. The native subdistribution hazard models and beta coefficients were saved and shared on GitHub for subsequent external validation. Model discrimination and fit were assessed with time-dependent c-statistics14, 22 and calibration plots at 6 months for VTE or PE/LE-DVT. Internal validation was conducted using nonparametric bootstrapping. External validation was conducted by direct application of models estimates in the external cohorts without model refitting. Missing values were imputed via random forest chained imputation23 for the initial feature selection process. Only complete cases were used for model derivation and validations. To determine risk group assignment, a pre-determined threshold of 7% for VTE at 6 months from the predicted probability was used to stratify high vs. low-risk groups.24 All statistical analyses were performed with R 4.2.2 (R Foundation for Statistical Computing, Vienna, Austria).

Results

Baseline patient characteristics

There were 10,313 (VA), 854 (HHS), and 1,858 (MDACC) patients in the derivation and validation cohorts with unique demographics, disease characteristics, treatment patterns, and comorbidities (Table 1). Patients from VA were older (median age 67), more likely to be male (96.6%), non-Hispanic White (77.8%) and non-Hispanic Black (13.5%), and had a higher proportion of small/chronic lymphocytic lymphoma/leukemia (SLL/CLL) diagnosis (12.3%). Patients from HHS were younger (median age 51), more likely to be Hispanic (57.1%) and Non-Hispanic Black (22.8%), uninsured (79.7%) with prolonged hospitalization (74.2%), and had a higher proportion of diffuse large B cell lymphoma (DLBCL, 40.5%) and classical Hodgkin lymphoma (CHL, 20.3%) requiring cytotoxic chemotherapy (95.0%). Finally, patients from MDACC had a median age of 59, were more likely to be non-Hispanic White (67.3%) and Hispanic (15.6%), insured (88.2% private insurance or Medicare), and more likely to receive targeted monotherapy (25.9%).

Table 1.

Baseline patient characteristics in derivation and validation cohorts

Characteristic VA N=10,313 HHS N=854 MDACC N=1,858
Age, median (Q1, Q3) 67 (61, 74) 51 (40, 60) 59 (45, 69)
Male sex, N (%) 9,958 (96.6%) 500 (58.5%) 1,099 (59.1%)
Body mass index, median (Q1, Q3) 28.5 (25.1, 32.6) 27.1 (23.2, 30.8) 27.8 (24.4, 32.3)
Race/ethnicity, N (%)
 Non-Hispanic White 8,024 (77.8%) 128 (15.0%) 1,251 (67.3%)
 Non-Hispanic Black 1,392 (13.5%) 195 (22.8%) 118 (6.4%)
 Non-Hispanic Asian Pacific Islander 211 (2.0%) 37 (4.3%) 110 (5.9%)
 Hispanic 583 (5.7%) 488 (57.1%) 290 (15.6%)
 Unknown 103 (1.0%) 6 (0.7%) 89 (4.8%)
Primary insurance, N (%)
 Private/commercial
 Medicare
 Medicaid
 Other/unknown
 Uninsured
 Tricare/VA

0
0
0
0
0
10,313 (100%)

35 (4.1%)
27 (3.2%)
100 (11.7%)
11 (1.3%)
681 (79.7%)
0

1,053 (57.8%)
564 (30.4%)
20 (1.1%)
132 (7.1%)
63 (3.4%)
26 (1.4%)
Lymphoma histology, N (%)
 B-cell prolymphocytic leukemia 18 (0.2%) 2 (0.2%) 0 (0.0%)
 Burkitt lymphoma/leukemia 95 (0.9%) 49 (5.7%) 21 (1.1%)
 Classical Hodgkin lymphoma 767 (7.4%) 173 (20.3%) 261 (14.0%)
 Small/chronic lymphocytic lymphoma/leukemia 1,269 (12.3%) 38 (4.4%) 113 (6.1%)
 Cutaneous T cell lymphoma a 258 (2.5%) 2 (0.2%) 25 (1.3%)
 Diffuse large B cell lymphoma b 3189 (30.9%) 346 (40.5%) 594 (32.0%)
 Follicular lymphoma 1,432 (13.9%) 63 (7.4%) 273 (14.7%)
 Hairy cell leukemia 170 (1.6%) 3 (0.4%) 22 (1.2%)
 Lymphoplasmacytic lymphoma c 348 (3.4%) 6 (0.7%) 27 (1.5%)
 Lymphoid neoplasm, NOS 1,044 (10.1%) 63 (7.4%) 26 (1.4%)
 Mantle cell lymphoma 627 (6.1%) 14 (1.6%) 235 (12.6%)
 Marginal zone lymphoma 530 (5.1%) 27 (3.2%) 62 (3.3%)
 Nodular lymphocyte predominant Hodgkin lymphoma 43 (0.4%) 3 (0.4%) 22 (1.2%)
 Primary central nervous system (CNS) large B cell lymphoma 80 (0.8%) 19 (2.2%) 33 (1.8%)
 Precursor non-Hodgkin lymphoma d 20 (0.2%) 8 (0.9%) 33 (1.8%)
 Systemic T cell lymphoma 423 (4.1%) 38 (4.4%) 111 (6.0%)
Stage, N (%)
 I 1241 (12.0%) 103 (12.1%) 227 (12.2%)
 II 1123 (10.9%) 137 (16.0%) 294 (15.8%)
 III 1753 (17.0%) 126 (14.8%) 239 (12.9%)
 IV 4382 (42.5%) 424 (49.6%) 1075 (57.9%)
 Unknown/unstageable 1814 (17.6%) 64 (7.5%) 23 (1.2%)
Treatment (first-line), N (%)
 Time to first treatment (months), median (Q1, Q3) 1.2 (0.7, 2.4) 1.0 (0.4, 2.0) 1.2 (0.7, 1.9)
 Cytotoxic chemotherapy 8,547 (82.9%) 811 (95.0%) 1,336 (71.9%)
 Targeted therapy 1,727 (16.7%) 43 (5.0%) 482 (25.9%)
 Other therapy 39 (0.4%) 0 (0.0%) 40 (2.2%)
Complete blood count, median (Q1, Q3)
 White blood cell count, ×109/L 7.5 (5.6, 10.5) 7.2 (5.3, 10.3) 7.2 (5.5, 9.8)
 Hemoglobin, g/dL 12.4 (10.4, 13.9) 10.9 (9.0, 12.5) 12.9 (11.1, 14.2)
 Platelet count, ×109/L 203 (145, 272) 249 (179, 342) 232 (171, 303)
Other comorbidities, N (%)
 History of VTE lifetime 404 (3.9%) 5 (0.6%) 6 (0.3%)
 History of hospitalization last 90d 3,837 (37.2%) 634 (74.2%) 651 (35.0%)
a

Including Mycosis fungoides/Sezary syndrome

b

Including primary mediastinal large B-cell lymphoma, primary effusion lymphoma, and intravascular large B-cell lymphoma.

c

Including Waldenstrom macroglobulinemia.

d

Including blastic plasmacytoid dendritic cell neoplasm.

Abbreviations: VA, Veterans Affairs. HHS, Health and Human Services. MDACC, MD Anderson Cancer Center. VTE, Venous Thromboembolism.

The median follow-up durations for continuous VTE assessment—censored if no clinical encounter occurred for more than 90 days—were 21.2 months at VA (IQR, 8.8–44.5), 11.5 months at HHS (IQR, 6.9–20.7), and 8.2 months at MDACC (IQR, 4.8–13.8). At 6 months post-treatment, VTE incidence in the overall cohort was 5.8% at VA, 8.2% at HHS, and 8.8% at MDACC. The corresponding figures for PE/LE-DVT were 3.9%, 4.5%, and 3.7%, respectively. The median follow-up for overall survival assessment were 26.8 months at VA (IQR, 9.4–60.1), 27.8 months at HHS (IQR, 11.3–58.3), and 10.9 months at MDACC (IQR, 4.8–13.8). At 6 months post-treatment, the number of patients who died without VTE were 1,157 (11.2%) at VA, 47 (5.5%) at HHS, and 74 (4.0%) at MDACC.

Model derivation

From an initial pool of 30 candidate predictors, 7 covariates beyond lymphoma histology met the LASSO variable selection threshold in the VA derivation cohort (Table 2, Supplemental Table 1, Supplemental Figure 2). There was a strong association between individual lymphoma histology subtype and VTE risk (Supplemental Table 3). In the final multivariable competing risk models, indolent lymphoma histology subtypes including SLL/CLL, marginal zone lymphoma (MZL), lymphoplasmacytic lymphoma (LPL), and nodular lymphocyte predominant Hodgkin Lymphoma (NLPHL) were associated with the lowest risk of VTE. Clinically heterogeneous histology subtypes including follicular lymphoma (FL), mantle cell lymphoma (MCL), and various other rare histology (B-cell prolymphocytic leukemia, Hairy cell leukemia, cutaneous T cell lymphoma) formed the intermediate cancer risk group (SHR 1.18 [95% CI, 0.97 to 1.43]). Aggressive lymphomas such as DLBCL, CHL, systemic T cell lymphoma, precursor non-Hodgkin lymphoma, and Burkitt lymphoma/leukemia were included in the high-risk group (SHR 1.58 [95% CI, 1.31 to 1.92]). Finally, primary central nervous system lymphoma (PCNSL) formed the very high-risk group (SHR 2.81 [95% CI, 1.70 to 4.63]). Other significant risk factors included pre-treatment BMI ≥35 (SHR, 1.29 [95% CI, 1.11 to 1.50]), administration of cytotoxic chemotherapy vs. targeted monotherapy (e.g. CD20 monoclonal antibody) (SHR, 1.40 [95% CI, 1.15 to 1.72]), recent hospitalization >3 days (SHR, 1.24 [95% CI, 1.09 to 1.41]), history of VTE (SHR, 2.63 [95% CI, 2.14 to 3.23]), history of paralysis or immobility (SHR, 2.63 [95% CI, 1.58 to 4.35]). Time to systemic treatment initiation was an additional protective factor (SHR, 0.96 [95% CI, 0.93 to 0.99]). These covariates maintained comparable magnitudes and significance levels when assessing the PE/LE-DVT outcome instead of the overall VTE (Table 2). The final Fine and Gray competing risk models incorporating these 7 covariates had a derivation c-statistic of 0.68 (95% CI, 0.67–0.69) for overall VTE and 0.68 (95% CI, 0.66–0.71) for PE/LE-DVT. An online calculator of the model is available at https://dynamicapp.shinyapps.io/Lymph-CAT/.

Table 2.

Final lymphoma VTE risk model in the derivation cohort

Risk factors Total N=10,310a SHR for VTE (95% CI) SHR for PE/LE-DVT (95% CI)
Lymphoma histology
 SLL/CLL, MZL, LPLb, NLPHL 2189 (21.2%) 1 1
 FL, MCL, other histologyc 3548 (34.4%) 1.18 (0.97–1.43) 1.14 (0.90–1.41)
 DLBCLd, CHL, Systemic T cell lymphoma, Precursor NHLe, BL 4493 (43.6%) 1.58 (1.31–1.92) 1.51 (1.21–1.88)
 PCNSL 80 (0.8%) 2.81 (1.70–4.63) 2.97 (1.68–5.26)
Body mass index (BMI) ≥35 1619 (15.7%) 1.29 (1.11–1.50) 1.36 (1.14–1.62)
Cytotoxic chemotherapy 8546 (82.9%) 1.40 (1.15–1.72) 1.30 (1.03–1.63)
History of VTE 404 (3.9%) 2.63 (2.14–3.23) 2.78 (2.20–3.51)
History of prolonged hospitalization 3837 (37.2%) 1.24 (1.09–1.41) 1.18 (1.02–1.37)
History of paralysis/immobilization 60 (0.6%) 2.63 (1.58–4.35) 2.98 (1.67–5.30)
Time to first treatment (months), median (Q1, Q3) 1.2 (0.7, 2.4) 0.96 (0.93–0.99) 0.95 (0.91–0.99)
a

Complete case analysis

b

Including Waldenstrom macroglobulinemia.

c

This category includes B-cell prolymphocytic leukemia, Cutaneous T cell lymphoma (including Mycosis fungoides/Sezary syndrome), Hairy cell leukemia, Lymphoid neoplasm, NOS.

d

Including primary mediastinal large B-cell lymphoma, primary effusion lymphoma, and intravascular large B-cell lymphoma.

e

Including blastic plasmacytoid dendritic cell neoplasm.

Abbreviations: SHR, subdistribution hazard ratio. SLL/CLL, Small Lymphocytic Lymphoma/Chronic Lymphocytic Leukemia. MZL, Marginal Zone Lymphoma. LPL, Lymphoplasmacytic Lymphoma. NLPHL, Nodular lymphocyte predominant Hodgkin lymphoma. FL, Follicular Lymphoma. MCL, Mantle Cell Lymphoma. DLBCL, Diffuse large B cell lymphoma. PCNSL, Primary Central Nervous System Lymphoma. CHL, Classic Hodgkin Lymphoma. Precursor NHL, Precursor non-Hodgkin lymphoma. BL, Burkitt lymphoma/leukemia. VTE, Venous Thromboembolism. PE/LE-DVT, Pulmonary Embolism/ Lower Extremity Deep Vein Thrombosis

Covariate distribution and model validation

Due to the inherent differences in the healthcare system for the derivation and validation cohorts, the outcome and covariate distribution in the 3 cohorts were expectedly different (Supplemental Table 4). While the derivation and validation cohorts had similar PE/LE-DVT incidence at 6 months (3.9%, 4.5%, 3.7%), the overall VTE was lower in the VA derivation cohort (5.8%, 8.2%, 8.8%). The cancer histology risk group was also significantly different. The VA derivation cohort had more low-risk subtypes (21.2% vs. 8.7% at HHS and 12.1% at MDACC) and fewer high-risk subtypes (43.6% vs. 71.9% at HHS and 54.9% at VA). Patients in the VA derivation cohort had the highest incidence of a history of VTE. As a result of increased high-risk cancer subtypes, patients from the HHS validation cohort also had the highest hospitalization rate (74.2% vs. 37.2% at VA and 35.0% at MDACC) and need for upfront chemotherapy (95.0% vs. 82.9% at VA and 71.9% at MDACC).

The Fine and Gray models derived in the VA cohort were tested in the two external cohorts. In the HHS cohort, the c-statistics were 0.69 (95% CI, 0.64–0.79) for overall VTE and 0.72 (95% CI, 0.65–0.79) for PE/LE-DVT. In the MDACC cohort, the c-statistics were 0.72 (95% CI, 0.68–0.75) for overall VTE and 0.69 (95% CI, 0.63–0.73) for PE/LE-DVT. The calibration plots for both outcomes correspond closely with the 45-degree line in the derivation dataset (Supplemental Figure 3 A, D). The external model calibrations for PE/LE-DVT appeared adequate without systemic bias (Supplemental Figure 3 E-F). However, there were more observed overall VTE events than predicted in the very high-risk strata (Supplemental Figure 3 B-C).

Stratified analyses and comparisons with other models

When stratified into risk groups using the 7% overall VTE threshold, the cumulative incidence showed promising discrimination between risk groups (Figure 1). In the VA derivation cohort, 27.7% of patients were high-risk with 10.1% VTE, while 72.3% were low-risk with 4.2% VTE at 6 months (Table 3). In the HHS validation cohort, 56.7% were high-risk with 11.7% VTE and 43.3% were low-risk with 3.6% VTE at 6 months. In the MDACC validation cohort, 31.5% were high-risk with 16.8% VTE, while 68.5% were low-risk with 5.1% VTE at 6 months.

Figure 1.

Figure 1.

VTE incidence (A-C) and PE/LE-DVT incidence (D-F) by new lymphoma risk assessment model in derivation and validation cohorts

Table 3.

Performance of the novel thrombosis risk assessment model in patients with treated lymphoma

VTE PE/LE-DVT
Dataset Classificationa 6-month incidence Time-dependent C-statistic (95% CI) 6-month incidence Time-dependent C-statistic (95% CI)
New model Li 2023 Khorana 2008 New model Li 2023 Khorana 2008
VA derivation Low risk (n=7458) 4.2% 5.8% 0.68 (0.67–0.69) 0.65 (0.62–0.67) 0.57 (0.54–0.58) 2.7% 3.9% 0.68 (0.66–0.71) 0.65 (0.64–0.66) 0.56 (0.53–0.59)
High risk (n=2852) 10.1% 7.2%
HHS validation Low risk (n=370) 3.6% 8.2% 0.69 (0.64–0.79) 0.65 (0.58–0.71) 0.55 (0.48–0.60) 0.8% 4.5% 0.72 (0.65–0.79) 0.64 (0.56–0.72) 0.54 (0.45–0.62)
High risk (n=484) 11.7% 7.3%
MDACC validation Low risk (n=1272) 5.1% 8.8% 0.72 (0.68–0.75) 0.67 (0.63–0.70) 0.55 (0.50–0.60) 2.3% 3.7% 0.69 (0.63–0.73) 0.67 (0.62–0.75) 0.56 (0.49–0.62)
High risk (n=586) 16.8% 6.9%
a

We dichotomized the risk groups based on a predetermined clinical threshold of 7% overall VTE at 6 months.

Abbreviations: VTE, Venous Thromboembolism. PE/LE-DVT, Pulmonary Embolism/ Lower Extremity Deep Vein Thrombosis. VA, Veterans Affairs. HHS, Health and Human Services.

When compared to previous models, the newly developed RAMs showed improved discrimination and risk stratification for lymphoma patients.12, 14 The improvement in c-statistic was 0.03–0.08 compared with the modified Khorana Score,14 while the improvement was 0.11–0.18 compared with the Khorana Score12 (Table 3). The prediction performance showed similar improvement for PE/LE-DVT. The time-to-event comparisons of various models are shown in Supplemental Figures 3-4.

Discussion

Using independent datasets from three diverse cancer cohorts in the U.S., we developed and validated a novel clinical RAM for incident VTE in lymphoma patients at the time of systemic therapy initiation. Among numerous clinical and laboratory parameters tested, the final models included lymphoma subtype risk group, treatment regimen, BMI≥35, recent hospitalization, history of VTE, history of paralysis/immobility, and time to systemic treatment as the 7 covariates. The new RAM grouped patients into a high-risk category with a 10.1–16.8% VTE risk (6.9–7.3% for PE/LE-DVT) at 6 months and a low-risk category with a 3.6%−5.1% VTE risk (0.8%−2.7% for PE/LE-DVT). Despite significant differences in patient populations in the derivation and two validation cohorts, the consistent results in discrimination (0.69 to 0.72) indicated the robustness, reliability, and generalizability of the models. The RAM also had better discrimination than most other published risk scores for VTE risk assessment in ambulatory patients with lymphoma.

Our refined RAM for VTE should be interpreted in the context of pan-cancer setting and lymphoma-specific setting. The Khorana score remains the current clinical benchmark for VTE prediction in cancer patients according to several national cancer guidelines.25, 26 While it has reasonable performance for solid tumor patients, its discrimination in lymphoma has been sub-optimal because lymphoma is classified into the same intermediate risk group despite the diversity of histologic subtypes ranging from very indolent to very aggressive disease.12, 27, 28 Furthermore, risk factors such as leukocyte count generally reflect increased neutrophils in solid tumor malignancies but lymphocytes in certain lymphoma subtypes; therefore, it is unlikely to have the same predictiveness. While we attempted to divide lymphoma into aggressive and indolent subtypes in our previous pan-cancer risk prediction model in the same populations,14 it was difficult to estimate the attributable risk of each histologic subtype when mixed with a variety of solid tumor malignancies. In the current study, we carefully created 16 histologic subgroups based on the latest SEER lymphoid malignancy classification recommendations29 (Supplemental Table 3) to create a lymphoma-specific RAM. When assessed concurrently with other clinical risk factors, we found that the lymphoma subtype along with history of VTE and history of paralysis/immobilization provided the most appreciable VTE risks in this patient population.

The risk predictors in the current VTE RAM are intuitive and consistent with the previously published literature. The modification of lymphoma subtype risk was concordant but more comprehensive when compared with previous studies.6, 8, 14, 30 Dharmavaram et al.6 assigned −1.025 for patients with FL, and 0 for DLBCL as the risk scores in their model for the two types of lymphomas. Lund et al.8 reported that patients with peripheral T-cell lymphomas (SHR = 2.05, 95% CI: 1.27, 3.30), DLBCL (SHR= 1.79, 95% CI: 1.31, 2.43), or CHL (SHR=1.64, 95% CI: 1.08, 2.48) were in higher risks compared with indolent lymphoma. Similarly, Santi et al. showed that DLBCL patients had a higher risk of experiencing VTE (SHR: 3.42 [1.32–8.84]; p = 0.011) compared to those with FL.30 VTE history was confirmed as prognostic factors in comparable lymphoma studies.7, 3133 Recent hospitalization and history of paralysis/immobility were other well-known predictors for VTE,14, 3436 but they have not been explored in the lymphoma setting. Also, the differential risk associated with chemotherapy versus targeted therapy has not been systematically incorporated into lymphoma-specific RAMs, although several studies have reported the increased VTE risk associated with cytotoxic therapy,7, 31, 37, 38 while one study has reported a lower incidence of VTE among patients receiving ibrutinib.39 Finally, concordant with previous studies,8, 28, 40, 41 time to treatment initiation was also a key risk factor for VTE, likely a proxy feature associated with the tumor burden and aggressiveness of the disease.

Several aspects of our study deserve consideration. Firstly, our lymphoma-VTE RAM exclusively utilized clinical predictors with broad applicability across diverse clinical settings; however, factors such as ECOG performance status, immunohistochemical, or tumor mutational profiling could not be included in the current study. Secondly, despite the modest discrimination of the novel RAM and reasonable calibration for PE/LE-DVT outcomes in external validation, the RAM underestimated the risk of overall VTE in the predicted higher strata. Given this discrepancy was most likely driven by the under-capture of UE-DVT in the VA derivation cohort, our RAM likely underestimated unique risk factors for UE-DVT. In addition, given that treatment protocols evolve over time and can influence thrombotic risk, the temporal discrepancy between derivation cohort (2006–2021) and validation cohorts (2011–2020, 2017–2020) could contribute to the imperfect calibrations observed in the current study. Furthermore, to ensure uniformity of initial diagnosis and staging, the cohort inclusion mandated patients to have a histologic diagnosis of lymphoma and have started systemic therapy within 1 year of diagnosis. Thus, patients with indolent lymphomas who started initial therapy many years after observation would be excluded from the cohort. Finally, due to the retrospective nature of our cohorts, inherent biases including selection and information bias could be introduced. Since we relied on the cancer registry to determine accurate information on original cancer diagnosis date, cancer subtype (ICD-O-3) and initial staging, the potential delay in data collection and reporting by the cancer registry can lead to challenges of applying the model prospectively. Further informatics work is needed to translate and validate the above information to ICD-10-CM codes used in the electronic health records. While our computable phenotype algorithm combining ICD codes and NLP radiology reports achieved excellent precision and recall in all cohorts to prevent significant misclassification,14, 15 the outcome capture was not as robust as prospective cohort studies with independent adjudication.

In summary, we derived and externally validated a novel RAM for VTE in patients with lymphoma initiating systemic therapy. The models contained only clinical predictors that were assessable without specialized biomarker testing. The RAM outperformed other existing pan-cancer and lymphoma-specific RAMs. We are confident that our enhanced models for lymphoma-associated thrombosis can better guide the selection of patients for individualized thromboprophylaxis across a broad spectrum of lymphoma patient groups. We have provided details of our model (Lymph-CAT) derivation and application (https://github.com/Shenglinggithub/Lymph-CAT-calculator) and we encourage additional external validations from researchers and collaborators.

Supplementary Material

Supinfo

Acknowledgements:

A.L., a CPRIT Scholar in Cancer Research, is supported by the Cancer Prevention and Research Institute of Texas (RR190104), the National Heart, Lung, and Blood Institute (K23 HL159271), and the National Institute of Health AIM-AHEAD (1OT2-OD032581). C.R.F., a CPRIT Scholar in Cancer Research, is supported by the Cancer Prevention and Research Institute of Texas (RR190079). J.L., K.R., V.C., and N.R.F. are supported by AHA Cardio-oncology SFRN CAT-HD Center grant 857078, V.C and K.R. are supported by the National Heart, Lung, and Blood Institute (1R01HL166608), J.L. and N.R.F. were supported by the VA Cooperative Studies Program.

Funding statement:

A.L., a CPRIT Scholar in Cancer Research, is supported by the Cancer Prevention and Research Institute of Texas (RR190104), the National Heart, Lung, and Blood Institute (K23 HL159271), and the National Institute of Health AIM-AHEAD (1OT2-OD032581). C.R.F., a CPRIT Scholar in Cancer Research, is supported by the Cancer Prevention and Research Institute of Texas (RR190079). J.L., K.R., V.C., and N.R.F. are supported by AHA Cardio-oncology SFRN CAT-HD Center grant 857078, V.C and K.R. are supported by the National Heart, Lung, and Blood Institute (1R01HL166608), J.L. and N.R.F. were supported by the VA Cooperative Studies Program.

Conflict of Interest Disclosures:

None of the co-author conflicts is directly relevant to the current manuscript. CRH: Anthos Therapeutics: Research Funding. CRF: Adaptimmune: Research Funding; Cellectis: Research Funding; Iovance: Research Funding; Beigene: Consultancy; Allogene: Research Funding; Guardant: Research Funding; Xencor: Research Funding; Eastern Cooperative Oncology Group: Research Funding; Takeda: Research Funding; TG Therapeutics: Research Funding; Sanofi: Research Funding; Abbvie: Consultancy, Research Funding; V Foundation: Research Funding; Kite: Research Funding; Morphosys: Research Funding; Nektar: Research Funding; Novartis: Research Funding; Pfizer: Research Funding; Pharmacyclics: Research Funding; Ziopharm: Research Funding; Burroghs Wellcome Fund: Research Funding; Celgene: Consultancy, Research Funding; Denovo Biopharma: Consultancy; Foresight Diagnostics: Consultancy, Current holder of stock options in a privately-held company; Genentech Roche: Consultancy, Research Funding; Genmab: Consultancy; Gilead: Consultancy, Research Funding; Karyopharm: Consultancy; N-Power Medicine: Consultancy, Current holder of stock options in a privately-held company; Pharmacyclics Jansen: Consultancy; SeaGen: Consultancy; Spectrum: Consultancy; 4D: Research Funding; Acerta: Research Funding; Jannsen Pharmaceuticals: Research Funding; Cancer Prevention and Research Institute of Texas: Research Funding; Amgen: Research Funding; National Cancer Institute: Research Funding; CPRIT Scholar in Cancer Research: Research Funding; Bayer: Consultancy, Research Funding.

Data Sharing Statement:

Since our datasets are from 3 separate hospital systems, each governed by its own IRB and DUA, data sharing can only be made available with appropriate regulatory approval from each participating site. For original data, please contact ang.li2@bcm.edu

References

  • 1.BLOM JW, Vanderschoot J, Oostindier M, OSANTO S, Van Der Meer F, Rosendaal F. Incidence of venous thrombosis in a large cohort of 66 329 cancer patients: results of a record linkage study. Journal of Thrombosis and Haemostasis 2006; 4(3): 529–535. [DOI] [PubMed] [Google Scholar]
  • 2.Sørensen HT, Mellemkjær L, Olsen JH, Baron JA. Prognosis of cancers associated with venous thromboembolism. New England Journal of Medicine 2000; 343(25): 1846–1850. [DOI] [PubMed] [Google Scholar]
  • 3.Chew HK, Wun T, Harvey D, Zhou H, White RH. Incidence of venous thromboembolism and its effect on survival among patients with common cancers. Archives of internal medicine 2006; 166(4): 458–464. [DOI] [PubMed] [Google Scholar]
  • 4.Lim SH, Woo S-y, Kim S, Ko YH, Kim WS, Kim SJ. Cross-sectional study of patients with diffuse large B-cell lymphoma: assessing the effect of host status, tumor burden, and inflammatory activity on venous thromboembolism. Cancer Research and Treatment: Official Journal of Korean Cancer Association 2016; 48(1): 312–321. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Antic D, Milic N, Nikolovski S, Todorovic M, Bila J, Djurdjevic P et al. Development and validation of multivariable predictive model for thromboembolic events in lymphoma patients. American journal of hematology 2016; 91(10): 1014–1019. [DOI] [PubMed] [Google Scholar]
  • 6.Dharmavaram G, Cao S, Sundaram S, Ayyappan S, Boughan K, Gallogly M et al. Aggressive lymphoma subtype is a risk factor for venous thrombosis. Development of lymphoma-specific venous thrombosis prediction models. American journal of hematology 2020; 95(8): 918–926. [DOI] [PubMed] [Google Scholar]
  • 7.Sanfilippo KM, Wang TF, Gage BF, Luo S, Riedell P, Carson KR. Incidence of venous thromboembolism in patients with non-Hodgkin lymphoma. Thrombosis Research 2016; 143: 86–90. doi: 10.1016/j.thromres.2016.05.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Lund JL, Østgård LS, Prandoni P, Sørensen HT, de Nully Brown P. Incidence, determinants and the transient impact of cancer treatments on venous thromboembolism risk among lymphoma patients in Denmark. Thrombosis research 2015; 136(5): 917–923. [DOI] [PubMed] [Google Scholar]
  • 9.Martin KA, Lyleroehr MJ, Cameron KA. Barriers and facilitators to preventing venous thromboembolism in oncology practice. Thrombosis research 2022; 220: 21–23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Rupa-Matysek J, Gil L, Kaźmierczak M, Barańska M, Komarnicki M. Prediction of venous thromboembolism in newly diagnosed patients treated for lymphoid malignancies: validation of the Khorana Risk Score. Medical Oncology 2018; 35: 1–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Bastos-Oreiro M, Ortiz J, Pradillo V, Salas E, Marínez-Laperche C, Muñoz A et al. Incorporating genetic and clinical data into the prediction of thromboembolism risk in patients with lymphoma. Cancer Medicine 2021; 10(21): 7585–7592. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Khorana AA, Kuderer NM, Culakova E, Lyman GH, Francis CW. Development and validation of a predictive model for chemotherapy-associated thrombosis. Blood, The Journal of the American Society of Hematology 2008; 111(10): 4902–4907. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Rupa-Matysek J, Brzeźniakiewicz-Janus K, Gil L, Krasiński Z, Komarnicki M. Evaluation of the ThroLy score for the prediction of venous thromboembolism in newly diagnosed patients treated for lymphoid malignancies in clinical practice. Cancer Med 2018; 7(7): 2868–2875. e-pub ahead of print 20180515; doi: 10.1002/cam4.1540 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Li A, La J, May SB, Guffey D, da Costa WL Jr., Amos CI et al. Derivation and Validation of a Clinical Risk Assessment Model for Cancer-Associated Thrombosis in Two Unique US Health Care Systems. J Clin Oncol 2023; 41(16): 2926–2938. e-pub ahead of print 20230110; doi: 10.1200/jco.22.01542 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Li A, De Las Pozas G, Andersen CR, Nze CC, Toale KM, Milner EM et al. External validation of a novel electronic risk score for cancer-associated thrombosis in a comprehensive cancer center. Am J Hematol 2023; 98(7): 1052–1057. e-pub ahead of print 20230417; doi: 10.1002/ajh.26928 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Carrier M, Khorana AA, Zwicker JI, Lyman GH, Le Gal G, Lee AY. Venous thromboembolism in cancer clinical trials: recommendation for standardized reporting and analysis. J Thromb Haemost 2012; 10(12): 2599–2601. doi: 10.1111/jth.12028 [DOI] [PubMed] [Google Scholar]
  • 17.Carrier M, Abou-Nassar K, Mallick R, Tagalakis V, Shivakumar S, Schattner A et al. Apixaban to Prevent Venous Thromboembolism in Patients with Cancer. N Engl J Med 2019; 380(8): 711–719. e-pub ahead of print 20181204; doi: 10.1056/NEJMoa1814468 [DOI] [PubMed] [Google Scholar]
  • 18.Khorana AA, Soff GA, Kakkar AK, Vadhan-Raj S, Riess H, Wun T et al. Rivaroxaban for Thromboprophylaxis in High-Risk Ambulatory Patients with Cancer. N Engl J Med 2019; 380(8): 720–728. doi: 10.1056/NEJMoa1814630 [DOI] [PubMed] [Google Scholar]
  • 19.Tibshirani R. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society Series B: Statistical Methodology 1996; 58(1): 267–288. [Google Scholar]
  • 20.Luo N, Sun X, Ma S, Li X, Zhu W, Fu M et al. Development of a Novel Prognostic Model of Glioblastoma Based on m6A-Associated Immune Genes and Identification of a New Biomarker. Front Oncol 2022; 12: 868415. e-pub ahead of print 20220720; doi: 10.3389/fonc.2022.868415 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Wang M, Ma S, Shi W, Zhang Y, Luo S, Hu Y. Surgery shows survival benefit in patients with primary intestinal diffuse large B-cell lymphoma: A population-based study. Cancer Med 2021; 10(10): 3474–3485. e-pub ahead of print 20210501; doi: 10.1002/cam4.3882 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Heagerty PJ, Lumley T, Pepe MS. Time-dependent ROC curves for censored survival data and a diagnostic marker. Biometrics 2000; 56(2): 337–344. doi: 10.1111/j.0006-341x.2000.00337.x [DOI] [PubMed] [Google Scholar]
  • 23.Casiraghi E, Wong R, Hall M, Coleman B, Notaro M, Evans MD et al. A method for comparing multiple imputation techniques: a case study on the US National COVID Cohort Collaborative. arXiv preprint arXiv:2206.06444 2022. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Di Nisio M, Porreca E, Ferrante N, Otten HM, Cuccurullo F, Rutjes AW. Primary prophylaxis for venous thromboembolism in ambulatory cancer patients receiving chemotherapy. Cochrane Database Syst Rev 2012; (2): Cd008500. e-pub ahead of print 20120215; doi: 10.1002/14651858.CD008500.pub2 [DOI] [PubMed] [Google Scholar]
  • 25.Lyman GH, Carrier M, Ay C, Di Nisio M, Hicks LK, Khorana AA et al. American Society of Hematology 2021 guidelines for management of venous thromboembolism: prevention and treatment in patients with cancer. Blood advances 2021; 5(4): 927–974. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Key NS, Khorana AA, Kuderer NM, Bohlke K, Lee AY, Arcelus JI et al. Venous thromboembolism prophylaxis and treatment in patients with cancer: ASCO guideline update. Journal of Clinical Oncology 2023; 41(16): 3063–3071. [DOI] [PubMed] [Google Scholar]
  • 27.Antic D, Jelicic J, Vukovic V, Nikolovski S, Mihaljevic B. Venous thromboembolic events in lymphoma patients: actual relationships between epidemiology, mechanisms, clinical profile and treatment. Blood Reviews 2018; 32(2): 144–158. [DOI] [PubMed] [Google Scholar]
  • 28.Mahajan A, Wun T, Chew H, White RH. Lymphoma and venous thromboembolism: influence on mortality. Thrombosis research 2014; 133: S23–S28. [DOI] [PubMed] [Google Scholar]
  • 29.Institute NC. Lymphoid Neoplasm Recode 2021 Revision. In, 2021. [Google Scholar]
  • 30.Santi RM, Ceccarelli M, Bernocco E, Monagheddu C, Evangelista A, Valeri F et al. Khorana score and histotype predicts incidence of early venous thromboembolism in non-Hodgkin lymphomas. A pooled-data analysis of 12 clinical trials of Fondazione Italiana Linfomi (FIL). Thromb Haemost 2017. e-pub ahead of print 20170427; doi: 10.1160/th16-11-0895 [DOI] [PubMed] [Google Scholar]
  • 31.Park LC, Woo S-y, Kim S, Jeon H, Ko YH, Kim SJ et al. Incidence, risk factors and clinical features of venous thromboembolism in newly diagnosed lymphoma patients: results from a prospective cohort study with Asian population. Thrombosis research 2012; 130(3): e6–e12. [DOI] [PubMed] [Google Scholar]
  • 32.Gangaraju R, Davis ES, Bhatia S, Kenzik KM. Venous-thromboembolism and associated health care utilization in elderly patients with diffuse large B cell lymphoma. Cancer 2022; 128(12): 2348–2357. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Borg IH, Bendtsen MD, Bøgsted M, Madsen J, Severinsen MT. Incidence of venous thromboembolism in patients with diffuse large B-cell lymphoma. Leukemia & Lymphoma 2016; 57(12): 2771–2776. [DOI] [PubMed] [Google Scholar]
  • 34.Darzi AJ, Karam SG, Charide R, Etxeandia-Ikobaltzeta I, Cushman M, Gould MK et al. Prognostic factors for VTE and bleeding in hospitalized medical patients: a systematic review and meta-analysis. Blood, The Journal of the American Society of Hematology 2020; 135(20): 1788–1810. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Heit JA. Epidemiology of venous thromboembolism. Nature Reviews Cardiology 2015; 12(8): 464–474. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Avery J, Guffey D, Ma S, Basom R, Lee SJ, Garcia D et al. Risks factors and outcomes for isolated catheter-related deep venous thrombosis in patients undergoing allogeneic hematopoietic stem cell transplantation. Thromb Res 2023; 229: 1–6. e-pub ahead of print 20230616; doi: 10.1016/j.thromres.2023.06.017 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Mahajan A, Brunson A, Keegan THM, Rosenberg A, Wun T. High incidence of venous thromboembolism and major bleeding in patients with primary CNS lymphoma. Leuk Lymphoma 2020; 61(11): 2605–2613. e-pub ahead of print 20200623; doi: 10.1080/10428194.2020.1780584 [DOI] [PubMed] [Google Scholar]
  • 38.Zhou X, Teegala S, Huen A, Ji Y, Fayad L, Hagemeister FB et al. Incidence and risk factors of venous thromboembolic events in lymphoma. The American journal of medicine 2010; 123(10): 935–941. [DOI] [PubMed] [Google Scholar]
  • 39.Kander EM, Zhao Q, Bhat SA, Hirsch J, Byrd JC, Ooka L et al. Venous and arterial thrombosis in patients with haematological malignancy during treatment with ibrutinib. Br J Haematol 2019; 187(3): 399–402. e-pub ahead of print 20190918; doi: 10.1111/bjh.16209 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Blom JW, Doggen CJ, Osanto S, Rosendaal FR. Malignancies, prothrombotic mutations, and the risk of venous thrombosis. Jama 2005; 293(6): 715–722. [DOI] [PubMed] [Google Scholar]
  • 41.Alcalay A, Wun T, Khatri V, Chew HK, Harvey D, Zhou H et al. Venous thromboembolism in patients with colorectal cancer: incidence and effect on survival. Journal of Clinical Oncology 2006; 24(7): 1112–1118. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supinfo

Data Availability Statement

Since our datasets are from 3 separate hospital systems, each governed by its own IRB and DUA, data sharing can only be made available with appropriate regulatory approval from each participating site. For original data, please contact ang.li2@bcm.edu

RESOURCES