Abstract
Background:
Race/ethnicity-related differences in rates of cancer surgery and cancer mortality have been observed for gastrointestinal (GI) cancers. This study aims to estimate the extent to which differences in receipt of surgery explain racial/ethnic disparities in cancer survival.
Methods:
The National Cancer Database (NCDB) was used to obtain data for patients diagnosed with stage 1–3 mid-esophageal, distal esophagus/gastric cardia (DEGC), non-cardia gastric, pancreatic, and colorectal cancer in years 2004–2015. Mediation analysis was used to identify variables influencing the relationship between race/ethnicity and mortality, including surgery.
Results:
A total of 600,063 patients were included in the study: 3.5% mid esophageal, 12.4% DEGC, 4.9% noncardia gastric, 17.0% pancreatic, 40.1% colon, and 22.0% rectal cancers. The operative rates for Black patients were low relative to White patients, with absolute differences of 21.0%, 19.9%, 2.3%, 8.3%, 1.6% and 7.7%. Adjustment for age, stage and comorbidities revealed even lower odds of receiving surgery for Black patients compared to White patients. The observed hazard ratios for Black patients compared to White patients ranged from 1.01 to 1.42. Mediation analysis showed that receipt of surgery and socioeconomic factors had greatest influence on the survival disparity.
Conclusions:
The results of this study indicate that Black patients appear to be under-treated compared to White patients for GI cancers. The disproportionately low operative rates contribute to the known survival disparity between Black and White patients.
Impact:
Interventions to reduce barriers to surgery for Black patients should be promoted to reduce disparities in GI cancer outcomes
Keywords: quality, surgical disparities, operative rate, gastrointestinal cancer, pancreatic cancer, colon cancer, rectal cancer, gastric cancer
Introduction
Reducing racial disparities in health outcomes in the United States has been recognized as a national priority by the US Agency for Healthcare Research and Quality (AHRQ), among others.1–5 Pronounced disparities in outcomes have been identified for patients with cancer. For example, the American Cancer Society reported in 2017 that the cancer-specific death rate for Black men and women is 24% and 14% higher, respectively, as compared to White men and women. Similar trends hold for gastrointestinal cancers; there is an association between race and survival.1
Broad statistical analyses have been previously performed for multiple cancers based on the National Cancer Database (NCDB) or other registries, and significant contributors to survival disparities have included socioeconomic factors and underutilization of treatment, including surgery.6–9 Black patients do not receive surgery as frequently as White patients for multiple cancer and non-cancer diagnoses, such as pancreatic cancer,10–13 colorectal cancer,14–17 acute limb ischemia18–20 and gallstone pancreatitis.21 Since surgical resection is often the most important step in treatment for GI cancer, it is plausible that the measured outcome disparities are partially attributable to failure of our system to deliver surgical care equitably. Differences in underlying perioperative risk including patient medical factors,22 later presentation,23 and higher rates of refusal24 among minorities are also thought to contribute to the disparity in receipt of surgery and outcomes.25 With so many interconnected factors, it is a conceptual and analytical challenge to measure the impact of each factor, and no study has provided fully adjusted estimates of effects that surgery and other factors have on outcomes in GI cancer.
This study uses the NCDB to fill this gap in the literature and provide a statistical basis for conceptual models of surgical disparities in GI cancers. We measure racial survival disparities in esophageal, gastric, pancreatic and colorectal cancers with and without adjustment for surgery, stage, patient medical factors, socioeconomic factors and institutional factors. We then use mediation analysis (or decomposition methods) to estimate the contributions that each of these categories have to the disparity.26 Lastly, we evaluate the given reasons that patients did not receive surgery (a variable in the NCDB) in terms of other variables in the model.
Materials and Methods
Data Source & Variables
Patients were drawn from the National Cancer Database (NCDB), including years 2004–2014.27 NCDB is a nationwide, facility-based, comprehensive clinical surveillance resource that captures 70% of newly diagnosed US malignancies. ICD-O-3 diagnosis codes were used to identify patients with cancers of the middle third of the esophagus, distal esophagus/gastric cardia (DEGC), non-cardia stomach, pancreas, colon and rectum. Tumors included were limited to carcinomas.
The variables of critical interest for this study were race/ethnicity, receipt of surgery, and survival. Race and ethnicity were combined such that all people (including those of Black race/ethnicity) listed as ethnically Hispanic were classified as of Latinx race/ethnicity. Other categories were White, Black, Asian/Pacific Islander (API), and other. Surgery was based on the variable “RX_SUMM_PRIM_SITE” and included all resections, regardless of the treatment sequence (whether or not neoadjuvant therapies were given). Survival in months was extracted from the database as well.
Other factors included stage, patient medical factors, socioeconomic factors, and hospital/geographical factors. Patient medical factors were considered separately from stage in the analysis. Patient factors extracted included patient age, sex, Charlson/Deyo Comorbidity score28 grade, and histology. Histology was divided into squamous versus adenocarcinoma for the esophagus and DEGC; lintitis plastica, signet ring and diffuse carcinoma vs all other carcinoma of the stomach, and signet ring vs all other carcinoma for the colon and rectum. Socioeconomic factors included ZIP income quartile and insurance. ZIP income quartile is the income quartile for the patient’s ZIP code (the main postal code in the US), among all US ZIP codes. Hospital/geographical factors extracted included region (Northeast, South, Midwest and West), patient urban context (metro county, adjacent to metro county, rural or unknown), and cancer center type (community cancer program (CCP), comprehensive CCP, academic center, or integrated network program). The patient urban context variable is a simplified version of the 9-value item in the NCDB and was classified with hospital factors rather than socioeconomics in order to focus the latter on financial aspects. Algorithmically created hospital variables included per-organ yearly operative rates and percentiles and per-cancer hospital volume percentiles. The year of diagnosis and reason for not receiving surgery as provided in the NCDB were also extracted.
Analysis
The analysis can be divided into 6 parts: descriptive statistics, initial Cox regression for survival, generalized linear modeling (GLM) of receipt of surgery, mediation analysis via Cox regression, GLM of reasons for not receiving surgery, and sensitivity analyses. First, descriptive statistics were calculated by organ and by race. Survival and operative rates were compared by organ and race. The primary analysis was limited to non-metastatic cancer, although metastatic and unknown stage are considered in sensitivity analyses.
Second, Cox regression was conducted to establish the relationship between race/ethnicity and survival with and without multivariable adjustment, and to establish the relationship between receipt of surgery and survival. The proportional hazards assumptions were assessed for the adjusted models.
Third, GLM was used to examine the relationship between race and receipt of surgery with adjustment for stage, patient medical factors, SES and hospital factors. GLM was chosen for easy incorporation of random effects modeling in sensitivity analyses, described below.
Fourth, mediation analysis with Cox proportional hazard modeling was then used to estimate the magnitude of potential mediators’ contributions to disparities in survival.26 The “difference of coefficients” method of mediation analysis29 was used; the magnitude of the contributions was estimated by two methods: the change in HR with (1) the addition of each variable of interest to a model only adjusted by age and year (unadjusted multiple mediation analysis), and (2) the removal of each variable of interest (or group of variables) from a multivariate model that included all variables (adjusted multiple mediation analysis). The ‘total effect’ is the size of the raw relationship (HR) between race and survival. The ‘unexplained effect’ (also known as ‘direct effect’) is the size of the persistent relationship between race and survival after controlling for all factors in the model. Portions of the ‘total effect’ that are attributable to individual variables are called ‘specific indirect effects’. We assessed interactions among paired groups of variables by removing both from the multivariable model and assessing whether more of the disparity was attributable to both than either individually.30,31 Factors with minimal impact on unadjusted analysis were left out of the adjusted analysis.
Fifth, an analysis was conducted to characterize the ‘reason no surgery was performed’ variable found in the NCDB. Generalized linear mixed modeling was used for this task. The most common given reasons for non-receipt of surgery – that surgery was not part of the first course of treatment, that surgery was contraindicated due to patient comorbidities, and that the patient refused surgery – were compared for Black and White patients. The Black/White odds of these responses were compared by race with and without adjustment for age and year; age, year, comorbidities, histology, and stage; and all variables.
Lastly, three sensitivity analyses were performed to see whether changes in variables or inclusions affected the relationship between receipt of surgery and the disparity. First, the receipt of surgery variable was replaced with one that reflected receipt of surgery and whether diagnosis and surgery took place on the same day (a marker for an emergent operation). Second, the mediation analysis was re-performed in stage IV and unknown clinical stage cohorts. Lastly, the mediation analysis was re-performed in the stage I-III cohort using random effects modeling by hospital ID to adjust for potential clustering by hospital.
Results
A total of 600,063 patients with stage 1–3 cancer diagnoses were included in the study: 3.5% mid esophageal, 12.4% DEGC, 4.9% non-cardia gastric, 17.0% pancreatic, 40.1% colon, and 22.0% rectal cancers (Table 1). Type of surgery was examined, but not included in the final model as it was not a significant predictor. An additional 323,106 stage IV patients were included in the sensitivity analyses. Including all primary sites of cancer, the cohort studied was 79.4% White, 10.7% Black, 5.2% Latinx, 3.1% (API), and 1.6% other. Black and Latinx patients were more likely to be from poorer areas and be younger than other patients. Black patients were more likely to have squamous histology (per-cancer details are given in the Supplemental Tables 1 and 2).
Table 1:
Descriptive statistics
| Race/Ethnicity | N | |||||
|---|---|---|---|---|---|---|
| White | Black | Latinx | API | Other | ||
| White | 100.0 | . | . | . | . | 476721 |
| Black | . | 100.0 | . | . | . | 64228 |
| Latinx | . | . | 100.0 | . | . | 31005 |
| API | . | . | . | 100.0 | . | 18325 |
| Other | . | . | . | . | 100.0 | 9784 |
| Mid Esophagus | 3.3 | 5.6 | 2.5 | 3.4 | 3.5 | 20852 |
| DEGC | 14.0 | 5.1 | 7.4 | 6.1 | 12.0 | 74427 |
| Stomach | 3.4 | 9.0 | 12.6 | 17.4 | 6.7 | 29583 |
| Pancreas | 17.0 | 18.4 | 15.4 | 14.9 | 18.2 | 102225 |
| Colon | 40.0 | 44.6 | 38.2 | 34.5 | 35.9 | 240832 |
| Rectum | 22.4 | 17.3 | 23.9 | 23.8 | 23.7 | 132144 |
| <55 | 17.7 | 24.9 | 29.4 | 24.6 | 24.4 | 116526 |
| 55–64 | 23.3 | 28.5 | 25.7 | 25.1 | 26.2 | 144307 |
| 65–74 | 27.5 | 25.4 | 24.6 | 25.7 | 26.0 | 162339 |
| 75+ | 31.5 | 21.2 | 20.3 | 24.6 | 23.4 | 176891 |
| Stage 1 | 40.6 | 40.7 | 37.2 | 40.7 | 41.1 | 242494 |
| Stage 2 | 32.7 | 31.5 | 32.8 | 31.2 | 32.1 | 195328 |
| Stage 3 | 26.7 | 27.8 | 30.0 | 28.1 | 26.9 | 162241 |
| Adenocarcinoma | 95.9 | 90.1 | 92.5 | 89.4 | 93.8 | 569245 |
| Esophagus: squamous carcinoma; gastric: lintitis plastica/diffuse, colorectal: signet cell | 4.1 | 10.0 | 7.5 | 10.6 | 6.2 | 30818 |
| No radiation | 65.7 | 70.9 | 68.6 | 68.0 | 68.4 | 399166 |
| Radiation given | 33.6 | 28.2 | 30.4 | 30.9 | 30.1 | 196267 |
| Unknown | 0.7 | 0.9 | 1.0 | 1.1 | 1.5 | 4630 |
| No Chemotherapy | 48.8 | 49.5 | 44.2 | 46.2 | 49.1 | 291325 |
| Chemotherapy given | 48.5 | 46.9 | 51.8 | 49.9 | 45.3 | 290861 |
| Unknown | 2.7 | 3.6 | 4.0 | 4.0 | 5.6 | 17877 |
| Grade 1 | 8.8 | 8.8 | 8.4 | 8.0 | 7.7 | 52317 |
| Grade 2 | 46.9 | 46.3 | 45.6 | 46.2 | 43.5 | 280361 |
| Grade 3 | 20.1 | 18.1 | 22.4 | 23.2 | 20.8 | 120430 |
| Grade 4 | 1.4 | 0.9 | 1.3 | 1.3 | 1.4 | 7852 |
| Unknown | 22.9 | 26.0 | 22.4 | 21.2 | 26.6 | 139103 |
| Surgery given | 75.7 | 70.0 | 74.8 | 76.9 | 72.7 | 450008 |
| Surgery day of diagnosis | 20.2 | 21.9 | 19.2 | 18.7 | 21.4 | 121684 |
| Male sex | 57.3 | 50.4 | 57.0 | 55.0 | 58.4 | 339031 |
| No Comorbidities | 70.7 | 67.5 | 71.4 | 76.0 | 74.8 | 423888 |
| 1 Comorbidity | 21.2 | 23.3 | 21.6 | 18.8 | 18.9 | 128114 |
| 2 Comorbidities | 5.8 | 6.2 | 4.8 | 3.6 | 4.4 | 33962 |
| 3 Comorbidities | 2.3 | 3.0 | 2.3 | 1.6 | 1.8 | 14099 |
| Operative Rate 0–25th %ile | 23.4 | 30.5 | 35.7 | 24.3 | 27.6 | 149530 |
| 25–75%ile | 50.4 | 47.5 | 44.6 | 52.0 | 43.8 | 298593 |
| 75–90%ile | 15.8 | 14.3 | 11.2 | 14.4 | 16.1 | 92342 |
| 90+%ile | 10.3 | 7.7 | 8.5 | 9.4 | 12.5 | 59598 |
| Community cancer program (CCP) | 10.9 | 8.0 | 7.8 | 10.9 | 7.5 | 62204 |
| Comprehensive CCP | 43.3 | 33.6 | 35.4 | 33.7 | 27.8 | 248070 |
| Academic program | 34.1 | 43.9 | 39.7 | 44.8 | 50.4 | 216414 |
| Integrated network cancer program | 10.0 | 12.0 | 12.0 | 7.3 | 11.2 | 61307 |
| Other | 1.7 | 2.5 | 5.0 | 3.4 | 3.1 | 12068 |
| Hospital Volume 0–25th %ile | 25.6 | 21.9 | 21.9 | 22.4 | 18.0 | 148734 |
| 25–75%ile | 49.8 | 52.2 | 51.4 | 48.5 | 46.1 | 300490 |
| 75–90%ile | 14.6 | 15.4 | 14.8 | 18.3 | 22.6 | 89801 |
| 90+%ile | 9.9 | 10.4 | 11.9 | 10.9 | 13.4 | 61038 |
| 2004–2007 | 22.5 | 20.9 | 19.4 | 19.9 | 23.9 | 132619 |
| 2008–2011 | 37.6 | 38.0 | 36.7 | 34.6 | 36.9 | 225024 |
| 2012–2015 | 39.9 | 41.1 | 43.9 | 45.5 | 39.2 | 242420 |
| Northeast | 22.9 | 17.7 | 20.1 | 21.0 | 24.2 | 132995 |
| Midwest | 27.6 | 20.9 | 8.7 | 11.4 | 23.0 | 152153 |
| South | 33.7 | 54.1 | 36.5 | 15.9 | 27.4 | 212081 |
| West | 14.1 | 4.8 | 29.7 | 48.4 | 22.3 | 90766 |
| Unknown | 1.7 | 2.5 | 5.0 | 3.4 | 3.1 | 12068 |
| Zip Income Quartile: Bottom | 13.9 | 43.6 | 26.3 | 7.2 | 17.8 | 105616 |
| Second | 24.0 | 22.3 | 24.0 | 14.3 | 20.5 | 140844 |
| Third | 27.8 | 18.3 | 26.8 | 25.8 | 26.0 | 159608 |
| Top Quartile | 33.3 | 14.9 | 22.2 | 51.8 | 34.5 | 188102 |
| Unknown | 1.0 | 0.9 | 0.8 | 0.9 | 1.2 | 5893 |
| No Insurance | 2.1 | 5.8 | 9.6 | 4.6 | 3.2 | 17743 |
| Private Insurance | 34.8 | 32.2 | 33.7 | 40.1 | 37.8 | 208121 |
| Medicaid | 3.5 | 10.9 | 14.1 | 11.7 | 6.8 | 31050 |
| Medicare | 56.4 | 47.4 | 38.5 | 41.0 | 42.1 | 322945 |
| Other Government | 1.2 | 1.3 | 0.7 | 0.9 | 4.1 | 7275 |
| Unknown | 2.0 | 2.4 | 3.4 | 1.7 | 6.0 | 12929 |
| Urban County | 79.0 | 88.6 | 92.7 | 94.8 | 79.0 | 487498 |
| Adjacent to Urban County | 12.2 | 7.5 | 3.4 | 1.2 | 10.4 | 65399 |
| Rural County | 5.6 | 1.8 | 1.7 | 1.2 | 7.4 | 29279 |
| Unknown | 3.1 | 2.2 | 2.2 | 2.8 | 3.3 | 17887 |
Race/ethnicity, survival and receipt of surgery
Strong relationships between (a) race and survival, (b) receipt of surgery and survival, and (c) race and receipt of surgery were observed and are shown in Figure 1. Unadjusted 1-year and 5-year survival differences between Black and White patients were seen in esophageal cancer (1-year: 50 vs 61%) and DEGC (1-year: 71 vs 60%). Substantial differences were also observed between patients who did and did not receive surgery (such as colon 1-year: 88 vs 41%). Differences in unadjusted operative rates were most pronounced between Black and White patients for the proximal cancers (esophageal cancer: 38% vs 17%) (Supplemental Figure 1). With only age adjustment, significant survival differences were identified for most cancers (Figure 1, precise values given in Supplemental Table 3). Black patients had the lowest survival relative to White patients (HR and 95% CI for cancers of the mid esophagus 1.42, 1.36–1.48, DEGC 1.37, 1.31–1.43, stomach 1.01, 0.97–1.05; pancreas 1.12, 1.10–1.15; colon 1.22 1.19–1.25; rectum 1.36, 1.31–1.40). API patients had the highest survival compared to White patients.
Figure 1:

Surgery delivery and survival disparities: ratio estimates with confidence intervals, vs White patients
Receipt of surgery was among the strongest adjusted predictors of survival, with HRs ranging from 2.25 (95% CI 2.15–2.35) for mid-esophageal cancer to 4.06 (95% CI 3.95–4.18) for colon cancer. Multivariable adjustment accounts for much of the Black-White survival disparity, although the disparities are not completely accounted for in colorectal cancer.
The observed Black-White difference in receipt of surgery persists on multivariable adjustment via GLM with aORs of 0.87 (050 – 0.64) for esophagus, 0.53 (0.48–0.57) for DEGC, 0.79 (0.74–0.86) for stomach, 0.64 (0.60–0.68) for pancreas, 0.78 (0.73–0.83) for colon and 0.71 (0.70–0.88) for rectum cancers.
Mediation analysis
Figures 2 and 3 quantify the effect of variables on disparate outcomes observed in Black compared to Whites patients (all numeric effect values are given in the Supplemental Table 4). Unadjusted specific indirect effects comparing API and Latinx patients to White patients are displayed in Supplemental Figures 2 and 3. On assessment of the proportional hazards assumptions, we found that some variables had variation in the HR over time, but that none crossed 1.0. Further assessment of the meaning of this result is described below under the heading ‘additional analyses.’ Receipt of surgery is the strongest single mediator of the difference between Black and White patients in survival for all GI cancers except colon (unadjusted specific indirect effects (ΔHRs) for mid-esophagus: 0.27, DEGC: 0.25, stomach: 0.08, pancreas: 0.13, colon: 0.06 and rectum: 0.12). The proportions of the survival disparity attributable to lower operative rates in Black patients for mid-esophagus, DEGC, pancreas, colon and rectum cancer were 64%, 67%, 100%, 25%, and 32%, respectively, prior to adjustment for other factors. Stage at presentation was also a contributor to the disparity for proximal cancers. Figure 2 is abridged in that factors that had a minimal impact on the disparity are excluded; facility type, region, urban/rural context, chemotherapy, radiation, grade, and sex are left out. All specific indirect effects are given in Supplemental Table 4.
Figure 2:

Unadjusted Mediation Analysis: Black vs White patients. Effects of selected variables on survival disparity, reported as change in HR with addition of variable to model and percent of baseline disparity (total effect) explained. Direct effect labeled as ‘fully adjusted’. All other values are specific indirect effects.
Figure 3:

Adjusted mediation analysis: effects of grouped variables on disparity after mutual adjustment. Total effects (black outline), direct effects (purple outline), and individual contributions of variable groups are displayed. Paired contributions are also displayed (when effect could be attributed to either of two variable groups, but no other). Data labels correspond to the percent of the total effect attributable to the specific indirect effect. API: Asians/Pacific Islanders. DEGC: distal esophagus/gastric cardia
Figure 3 depicts the adjusted specific indirect effects of the individual variables on the HR. For Black patients, receipt of surgery was again the strongest mediator of the survival disparity for gastric, pancreatic and rectal cancer (adjusted specific indirect effects or ΔHRs: 0.06 for mid-esophagus, 0.09 for DEGC 0.07 for gastric, 0.06 for pancreas, 0.03 for colon, and 0.06 for rectum). Receipt of surgery and ZIP income quartile were among the most important mediators for all cancers; the adjusted proportion of disadvantage attributable to surgery and SES ranged from 14–48% and 16–34%, excluding gastric cancer. For gastric cancer, although Black patients have no disadvantage in overall outcomes, they do appear to have a disadvantage in receipt of surgery that is associated with higher mortality than they could experience otherwise, compared to White patients. Histology contributed to the disparity substantially in esophageal and DEGC cancers, but Black patients had advantageous histology compared to White patients in gastric cancer. There were substantial interactions and overlaps among the variables, especially for esophageal and DEGC cancer; more than half of the disparity could be attributed to 2 or more factors for these segments. In contrast to Black patients, Latinx and Asian patients were observed to have survival advantages for all cancer types compared to White patients. Latinx patients appear to be disadvantaged by most of the measured variables in the model, but experience survival advantages nonetheless. The API population was not consistently disadvantaged by any factor in the model.
Analysis of given reason for non-operative management
Table 2 shows the percent of patients who received surgery and the reasons listed for patients not having received surgery. Black patients were more likely to be classified as having refused surgery, having medical contraindications to surgery, or as surgery not being the first course of their treatment. Adjustment for the factors that should underlie these classifications – age, stage, and comorbidities – revealed an even larger disparity between Black and White patients for many cancers. Controlling for all factors in the multivariable logistic model similarly identified disproportionate, unexplained likelihood that Black patients would be classified as not receiving surgery for the above reasons (Table 2).
Table 2:
Reasons for non-operative management
| Surgery receipt/given reason for not receiving surgery | Given reasons for no surgery by race | Adjusted logistic models, Black vs White OR | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| White | Black | Latinx | API | Other | Unadjusted | +Age and year | +Charlson, histology and stage | All variables | ||
| % | % | % | % | % | OR | aOR | aOR | aOR | ||
| Mid Esophagus | Received surgery | 38% | 17% | 30% | 27% | 34% | 0.33 | 0.27 | 0.41 | 0.57 |
| Surgery not first course | 50% | 68% | 57% | 57% | 53% | 1.19 | 1.37 | 1.16 | 1.16 | |
| Too sick for surgery | 7% | 8% | 6% | 9% | 3% | 2.18 | 2.46 | 1.79 | 1.33 | |
| Refused | 2% | 3% | 1% | 3% | 3% | 1.34 | 1.54 | 1.46 | 1.43 | |
| DEGC | Received surgery | 57% | 38% | 52% | 52% | 60% | 0.45 | 0.35 | 0.45 | 0.52 |
| Surgery not first course | 31% | 49% | 36% | 35% | 27% | 1.21 | 1.42 | 1.25 | 1.17 | |
| Too sick for surgery | 5% | 7% | 5% | 6% | 5% | 2.13 | 2.59 | 2.01 | 1.63 | |
| Refused | 2% | 3% | 2% | 3% | 2% | 1.50 | 1.77 | 1.77 | 1.70 | |
| Stomach | Received surgery | 68% | 66% | 71% | 79% | 68% | 0.90 | 0.77 | 0.77 | 0.80 |
| Surgery not first course | 22% | 23% | 21% | 15% | 21% | 1.06 | 1.25 | 1.21 | 1.22 | |
| Too sick for surgery | 5% | 5% | 3% | 2% | 2% | 1.05 | 1.17 | 1.18 | 1.11 | |
| Refused | 2% | 3% | 1% | 2% | 2% | 1.44 | 1.94 | 1.92 | 1.89 | |
| Pancreas | Received surgery | 39% | 30% | 36% | 36% | 35% | 0.69 | 0.59 | 0.59 | 0.63 |
| Surgery not first course | 48% | 54% | 52% | 52% | 50% | 1.26 | 1.35 | 1.29 | 1.25 | |
| Too sick for surgery | 9% | 11% | 7% | 8% | 7% | 1.29 | 1.42 | 1.38 | 1.21 | |
| Refused | 2% | 2% | 1% | 2% | 2% | 0.99 | 1.24 | 1.29 | 1.12 | |
| Colon | Received surgery | 96% | 94% | 95% | 96% | 95% | 0.70 | 0.55 | 0.55 | 0.79 |
| Surgery not first course | 2% | 3% | 3% | 2% | 4% | 1.23 | 1.76 | 1.71 | 1.25 | |
| Too sick for surgery | 1% | 1% | 1% | 1% | 1% | 1.41 | 1.64 | 1.65 | 1.13 | |
| Refused | 1% | 1% | 0% | 0% | 0% | 1.59 | 2.66 | 2.60 | 1.89 | |
| Rectum | Received surgery | 85% | 77% | 80% | 85% | 81% | 0.60 | 0.54 | 0.54 | 0.72 |
| Surgery not first course | 10% | 14% | 13% | 9% | 12% | 1.50 | 1.85 | 1.81 | 1.60 | |
| Too sick for surgery | 1% | 2% | 1% | 1% | 1% | 1.55 | 1.67 | 1.68 | 1.19 | |
| Refused | 2% | 3% | 1% | 2% | 2% | 1.83 | 2.15 | 2.15 | 2.00 | |
Additional Analyses
Sensitivity analyses for use of random effects modeling to manage potential clustering among hospitals and controlling for receipt of surgery on the same day as diagnosis did not alter the contributions of differences in receipt of surgery to outcome disparities (Supplemental Table 5). For stage IV esophagus, gastric and pancreatic cancer, there is no contribution of receipt of surgery to a survival disparity. In order to better assess the proportional hazards assumptions over time, the mediation analysis was repeated with GLM for survival to years 1, 2, 3 and 5. The specific indirect effects of surgery on survival were measured at each of these intervals. For the upper GI cancers, surgery had a larger contribution to the disparity in later years than at year 1, while for colorectal cancer the contribution of surgery to disparities diminished over time (Figure 4).
Figure 4:

Contribution of receipt of surgery to Black/White disparity over time: mediation analysis based on generalized linear regression for 1, 2, 3 and 5-year survival. The degree of mediation does change over time but not in a way that would affect our primary finding.
Discussion
This study found that in all cancers evaluated except gastric cancer, a difference in receipt of surgery contributes a substantial proportion of the survival disparity observed for Black patients compared to White patients. For mid-esophageal and proximal gastric cancer, more than half of the disparity can be attributed to gaps in delivery of surgery. Another significant contributor was socioeconomic status as measured by ZIP income quartile and insurance. Histology and stage had a substantial impact for the proximal GI cancers, but not others. Numerous other factors – urban/rural geography, hospital factors, and patient comorbidities – had relatively little influence.
Other studies have emphasized the roles of patient, social and hospital factors in mediating the relationship between race and survival. One recent study used a mediation analysis to evaluate contributors to disparities for multiple cancers in a California-based registry and identified stage at presentation as a leading factor, although their methodology did not include adjustment of stage’s contributions for any other factor.9 Differences in socioeconomic status7,32 and insurance among racial groups33,34 have been found to explain the disparities in part. Other factors, particularly age, bias raw mortality rates from cancer in favor of minorities, since the median age of the US Black population is 34, compared to 40 for the White population.35 Furthermore, discrimination, itself, can lead to worse cancer outcomes through biological mechanisms, such as stress-induced immunosuppression.36,37 Our findings are consistent with these patterns, but additionally we found that receipt of surgery is a prominent mediator of the disparity after adjustment for these factors.
Included in our findings is a robust evaluation of interactions among paired groups of variables. In our case, this method clarified considerable overlap among variables. For example, in the esophageal cancers, patient factors of histology and comorbidities appear to influence the disparity in part through influencing surgical decisions (since we do not expect surgical decisions to influence these baseline patient factors).
As a target for intervention, receipt of surgery may be a practical option to address cancer outcomes disparities, compared to addressing pervasive differences in socioeconomic status. To improve access to surgery, some authors have recommended expansion of access via public insurance, intensified use of explicit treatment algorithms, alignment of hospital incentives with elimination of disparities, and improving patient-centered tools for navigation of health and hospital systems.38 In particular, governmental interventions directed at extending insurance coverage (such as state-level expansions of Medicaid, versus states that had not at the time) have been associated with measurable decreases in cancer disparities over time.39,40 Statewide efforts to ensure that Black patients, specifically, receive surgery41 have also led to measurable reductions in survival disparities. One example of an algorithm apparently affecting a disparity is that addition of MELD scoring to a liver transplantation algorithm resulted in elimination of a pre-MELD racial disparity in both receipt of transplant and survival.42
A part of the Black/White disparity in receipt of surgery is also attributable to disproportionate rates of “refusal”. As has been recognized previously for lung43 and colorectal cancer,44 Black patients are more likely to be recorded as refusing surgery. However, the underlying cause of this difference is not well-understood. We cannot simply assume that Black patients’ deeply-held values would justify a disproportionate rate of refusal of life-saving surgery; to do so would be to arbitrarily dismiss, without investigation, the likely roles of discrimination and systemic racism. Deficiencies in the medical community’s ability to establish patient-physician trust (given previous and ongoing, valid reasons for patient distrust)45 or physician cultural competency may also be considered as possibly contributing to refusal.46 Numerous interventions have been developed to improve mutual understanding among patients and physicians, but effects on outcomes have not yet been thoroughly studied.47
Although we have found that the gap in receipt of surgery contributes to mortality differences, we also observed that part of the gap in receipt of surgery between minority and White patients remains unexplained. This study anticipates and rules out many commonly-offered explanations for the Black/White differences. In particular, to the extent that patient medical factors are captured by stage, histology and comorbidities and sex, medical factors cannot explain the disparate delivery of surgical care. However, we do not provide a positive identification of the cause of the disparate rates of surgery, so we are left to speculate about variables not included in the NCDB, such as frailty or social support.
Setting aside the differences in operative rates, the unexplained disparities in outcomes are even more pronounced between White patients and Asian/Pacific Islander or Latinx patients. Possible contributors include the so-called healthy immigrant effect, which is a complex conglomeration of differences in socioeconomic status, selective immigration, and possibly genetic, cultural or environmental factors.48 Although ancestry-related genetic differences are increasingly recognized in breast49,50 and prostate51 tumors, genetic ancestry and the social construction of race are often scientifically incongruous categorizations. The fact that sub-populations within the colloquial racial groups can have distinct genetic risk profiles emphasizes that variation within groups can be even more scientifically significant than variation among people of different skin colors.52 However, given the field’s historical missteps into racist pseudoscience,53–55 claims of genetic differences among racial/ethnic groups should be held to the highest level of scientific rigor, or even replaced with more scientifically valid groupings.56
Ultimately, to clarify the underlying causes of disparities due to differences in receipt of surgery, an institution-level study is needed where patients and physicians can be interviewed. Alternatively, interventions could be planned where physicians and practice groups are monitored and then informed of their disparate operative rates, and given the opportunity to reflect on, explain and correct them. In this way, the treatment-related disparity can be handled in the via the same interventional strategies as we use to handle other measure of quality. Previous attempts to improve the quality of care received by minority patients have improved adherence to the standard of care for all patients,41 and some studies have shown that treatment disparities disappear in an equal-access system (i.e. the military).57
This study has limitations. The NCDB data on the socioeconomic status of patients is limited to ZIP-code-level income quartile, which lacks the specificity of more granular measures such as census-block level factors. Adjustment for more detailed measures of socioeconomic factors and psychosocial stressors could have an effect on our findings. The NCDB captures the majority of cancer diagnoses in the United States, but those it does not capture are less likely to be urban academic centers, and this fact could bias our findings. We did not obtain enough statistical power to perform meaningful analyses on disparities affecting Native Americans. The proportional hazards assumption limits the precision of our model as a predictor of patient-level outcomes over time. On this point, we postulate that the best approach in the future will involve artificial intelligence-assisted model development. Since this is a database study, we were unable to verify the reasons for non-operative management via chart review or interviews. We did not perform significance testing or construct confidence intervals for the changes in HRs because our aim was primarily to obtain a qualitative grasp of receipt of surgery’s influence on racial disparities in survival.
Conclusion
Cancer mortality disparities between Black and White patients from esophageal, pancreatic, colon and rectum cancer are partially attributable to differences in operative rates. The differences in operative rates are not explained by hospital factors, stage at presentation, comorbidities, or any other factor available in the NCDB. Further studies are needed to identify the underlying causes of these differences in rates of surgery and to develop and administer interventions to correct them.
Supplementary Material
Acknowledgements
Effort by HI was supported by NIH-NCI grant 2K12 CA132783-06 (Paul Calabresi Career Development Award) and NIH-NCI grant 2UG1CA189859-06 (Minority-Based Community Oncology Research Program). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Meeting Presentation:
A previous version of this project was presented at AACR 11th Annual meeting on the Science of Cancer Disparities in New Orleans, LA, 2018
Funding: Effort by HI was supported by NIH-NCI grant 2K12 CA132783-06 (Paul Calabresi Career Development Award) and NIH-NCI grant 2UG1CA189859-06 (Minority-Based Community Oncology Research Program). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Abbreviations:
- API
Asian/Pacific Islander
- NCDB
National Cancer Database
Footnotes
Disclosure: The authors have no disclosures to report. The authors report no proprietary or commercial interest in any product mentioned or concept discussed in this article.
Duplicate publishing: This work has never appeared in print nor has it been submitted to a journal for publication.
References
- 1.Society AC. Cancer Facts and Figures: 2017. 2017. [Google Scholar]
- 2.Hanlon C RJ, and Hinkle L. State Documentation of Racial andEthnic Health Disparities to Inform Strategic Action. [Google Scholar]
- 3.Quality AfHRa. National Healthcare Disparities Report. Agency for Healthcare Research and Quality, Rockville, MD. 2003. [Google Scholar]
- 4.Statement on health care disparities. Bulletin of the American College of Surgeons. 2010;95(11):34–35. [PubMed] [Google Scholar]
- 5.Groman R, Ginsburg J. Racial and ethnic disparities in health care: a position paper of the American College of Physicians. Ann Intern Med. 2004;141(3):226–232. [DOI] [PubMed] [Google Scholar]
- 6.Torain MJ, Maragh-Bass AC, Dankwa-Mullen I, et al. Surgical Disparities: A Comprehensive Review and New Conceptual Framework. J Am Coll Surg. 2016;223(2):408–418. [DOI] [PubMed] [Google Scholar]
- 7.Swords DS, Mulvihill SJ, Brooke BS, Firpo MA, Scaife CL. Size and Importance of Socioeconomic Status-Based Disparities in Use of Surgery in Nonadvanced Stage Gastrointestinal Cancers. Ann Surg Oncol. 2019. [DOI] [PubMed] [Google Scholar]
- 8.Swords DS, Mulvihill SJ, Brooke BS, Skarda DE, Firpo MA, Scaife CL. Disparities in utilization of treatment for clinical stage I-II pancreatic adenocarcinoma by area socioeconomic status and race/ethnicity. Surgery. 2019;165(4):751–759. [DOI] [PubMed] [Google Scholar]
- 9.Ellis L, Canchola AJ, Spiegel D, Ladabaum U, Haile R, Gomez SL. Racial and Ethnic Disparities in Cancer Survival: The Contribution of Tumor, Sociodemographic, Institutional, and Neighborhood Characteristics. Journal of clinical oncology : official journal of the American Society of Clinical Oncology. 2018;36(1):25–33. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Murphy MM, Simons JP, Ng SC, et al. Racial Differences in Cancer Specialist Consultation, Treatment, and Outcomes for Locoregional Pancreatic Adenocarcinoma. Annals of Surgical Oncology. 2009;16(11):2968–2977. [DOI] [PubMed] [Google Scholar]
- 11.Shah A, Chao KS, Ostbye T, et al. Trends in racial disparities in pancreatic cancer surgery. Journal of gastrointestinal surgery : official journal of the Society for Surgery of the Alimentary Tract. 2013;17(11):1897–1906. [DOI] [PubMed] [Google Scholar]
- 12.Riall TS, Townsend CM Jr., Kuo Y-F, Freeman JL, Goodwin JS Dissecting racial disparities in the treatment of patients with locoregional pancreatic cancer: a 2-step process. Cancer. 2010;116(4):930–939. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Shavers VL, Harlan LC, Jackson M, Robinson J. Racial/ethnic patterns of care for pancreatic cancer. Journal of palliative medicine. 2009;12(7):623–630. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Morris AM. Racial Disparities in Rectal Cancer Treatment. Archives of Surgery. 2004;139(2):151. [DOI] [PubMed] [Google Scholar]
- 15.Esnaola NF, Stewart AK, Feig BW, Skibber JM, Rodriguez-Bigas MA. Age-, race-, and ethnicity-related differences in the treatment of nonmetastatic rectal cancer: a patterns of care study from the national cancer data base. Ann Surg Oncol. 2008;15(11):3036–3047. [DOI] [PubMed] [Google Scholar]
- 16.Cooper GS, Yuan Z, Landefeld CS, Rimm AA. Surgery for colorectal cancer: Race-related differences in rates and survival among Medicare beneficiaries. Am J Public Health. 1996;86(4):582–586. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Esnaola NF, Gebregziabher M, Finney C, Ford ME. Underuse of surgical resection in black patients with nonmetastatic colorectal cancer: location, location, location. Ann Surg. 2009;250(4):549–557. [DOI] [PubMed] [Google Scholar]
- 18.Hughes K, Boyd C, Oyetunji T, et al. Racial/Ethnic Disparities in Revascularization for Limb Salvage: An Analysis of the National Surgical Quality Improvement Program Database. Vascular and Endovascular Surgery. 2014;48(5–6):402–405. [DOI] [PubMed] [Google Scholar]
- 19.Hughes K, Seetahal S, Oyetunji T, et al. Racial/ethnic disparities in amputation and revascularization: a nationwide inpatient sample study. Vasc Endovascular Surg. 2014;48(1):34–37. [DOI] [PubMed] [Google Scholar]
- 20.Regenbogen SE, Gawande AA, Lipsitz SR, Greenberg CC, Jha AK. Do differences in hospital and surgeon quality explain racial disparities in lower-extremity vascular amputations? Ann Surg. 2009;250(3):424–431. [DOI] [PubMed] [Google Scholar]
- 21.Nguyen GC, Tuskey A, Jagannath SB. Racial disparities in cholecystectomy rates during hospitalizations for acute gallstone pancreatitis: a national survey. Am J Gastroenterol. 2008;103(9):2301–2307. [DOI] [PubMed] [Google Scholar]
- 22.Ruterbusch JJ, Ali-Fehmi R, Olson SH, et al. The influence of comorbid conditions on racial disparities in endometrial cancer survival. American journal of obstetrics and gynecology. 2014;211(6):627.e621–627.e6279. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Lai Y, Wang C, Civan JM, et al. Effects of Cancer Stage and Treatment Differences on Racial Disparities in Survival From Colon Cancer: A United States Population-Based Study. Gastroenterology. 2016;150(5):1135–1146. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Eloubeidi MA, Desmond RA, Wilcox CM, et al. Prognostic factors for survival in pancreatic cancer: a population-based study. American journal of surgery. 2006;192(3):322–329. [DOI] [PubMed] [Google Scholar]
- 25.de Jager E, Levine AA, Udyavar NR, et al. Disparities in Surgical Access: A Systematic Literature Review, Conceptual Model, and Evidence Map. J Am Coll Surg. 2019;228(3):276–298. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.MacKinnon DP, Fairchild AJ, Fritz MS. Mediation analysis. Annual review of psychology. 2007;58:593–614. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Bilimoria KY, Stewart AK, Winchester DP, Ko CY. The National Cancer Data Base: a powerful initiative to improve cancer care in the United States. Ann Surg Oncol. 2008;15(3):683–690. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Deyo RA, Cherkin DC, Ciol MA. Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. Journal of clinical epidemiology. 1992;45(6):613–619. [DOI] [PubMed] [Google Scholar]
- 29.MacKinnon DP, Lockwood CM, Hoffman JM, West SG, Sheets V. A comparison of methods to test mediation and other intervening variable effects. Psychological methods. 2002;7(1):83–104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Imai K, Keele L, Tingley D. A general approach to causal mediation analysis. Psychol Methods. 2010;15(4):309–334. [DOI] [PubMed] [Google Scholar]
- 31.Hayes AF. Introduction to mediation, moderation, and conditional process analysis. (2nd Ed.). New York: Guilford Press; 2018. [Google Scholar]
- 32.Erhunmwunsee L, Gulack BC, Rushing C, Niedzwiecki D, Berry MF, Hartwig MG. Socioeconomic Status, Not Race, Is Associated With Reduced Survival in Esophagectomy Patients. Ann Thorac Surg. 2017;104(1):234–244. [DOI] [PubMed] [Google Scholar]
- 33.Haider AH, Scott VK, Rehman KA, et al. Racial Disparities in Surgical Care and Outcomes in the United States: A Comprehensive Review of Patient, Provider, and Systemic Factors. Journal of the American College of Surgeons. 2013;216(3):482–492.e412. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Esnaola NF, Ford ME. Racial differences and disparities in cancer care and outcomes: where’s the rub? Surgical oncology clinics of North America. 2012;21(3):417-viii. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Census Bureau PD U.S.. Annual Estimates of the Resident Population by Sex, Age, Race, and Latinx Origin for the United States and States: April 1, 2010 to July 1, 2017 In:2018. [Google Scholar]
- 36.Saini G, Ogden A, McCullough LE, Torres M, Rida P, Aneja R. Disadvantaged neighborhoods, and racial disparity in breast cancer outcomes: the biological link. Cancer Causes Control 2019;30(7):677–86 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Hebert JR, Braun KL, Kaholokula JK, Armstead CA, Burch JB, Thompson B. Considering the role of stress in populations of high-risk, underserved Community Networks Program Centers. Prog Comm Health Partnerships 2015;9(Suppl):71–82 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Morris AM, Rhoads KF, Stain SC, Birkmeyer JD. Understanding Racial Disparities in Cancer Treatment and Outcomes. Journal of the American College of Surgeons. 2010;211(1):105–113. [DOI] [PubMed] [Google Scholar]
- 39.Chen J, Vargas-Bustamante A, Mortensen K, Ortega AN. Racial and Ethnic Disparities in Health Care Access and Utilization Under the Affordable Care Act. Med Care. 2016;54(2):140–146. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Cooper GS, Kou TD, Dor A, Koroukian SM, Schluchter MD. Cancer preventive services, socioeconomic status, and the Affordable Care Act. Cancer. 2017;123(9):1585–1589. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Grubbs SS, Polite BN, Carney J, et al. Eliminating Racial Disparities in Colorectal Cancer in the Real World: It Took a Village. Journal of Clinical Oncology. 2013;31(16):1928–1930. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Moylan CA, Brady CW, Johnson JL, Smith AD, Tuttle-Newhall JE, Muir AJ. Disparities in liver transplantation before and after introduction of the MELD score. Jama. 2008;300(20):2371–2378. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Lathan CS, Neville BA, Earle CC. The Effect of Race on Invasive Staging and Surgery in Non–Small-Cell Lung Cancer. Journal of Clinical Oncology. 2006;24(3):413–418. [DOI] [PubMed] [Google Scholar]
- 44.Demissie K, Oluwole OO, Balasubramanian BA, Osinubi OO, August D, Rhoads GG. Racial differences in the treatment of colorectal cancer: a comparison of surgical and radiation therapy between Whites and Blacks. Annals of epidemiology. 2004;14(3):215–221. [DOI] [PubMed] [Google Scholar]
- 45.Halbert CH, Armstrong K, Gandy OH Jr., Shaker L. Racial differences in trust in health care providers. Archives of internal medicine. 2006;166(8):896–901. [DOI] [PubMed] [Google Scholar]
- 46.Amal Khoury; Anthony Charles Cultural Competence: Why Surgeons Should Care. American College of Surgeons Bulletin 2012; http://bulletin.facs.org/2012/03/cultural-competence-why-surgeons-should-care/#printpreview. Accessed 2/25/19. [PubMed] [Google Scholar]
- 47.Hisam B, Zogg CK, Chaudhary MA, et al. From understanding to action: interventions for surgical disparities. J Surg Res. 2016;200(2):560–578. [DOI] [PubMed] [Google Scholar]
- 48.Hamilton TG. The healthy immigrant (migrant) effect: In search of a better native-born comparison group. Social science research. 2015;54:353–365. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Zhang B, Chen MY, Shen YJ, et al. A Large-Scale, Exome-Wide Association Study of Han Chinese Women Identifies Three Novel Loci Predisposing to Breast Cancer. Cancer research. 2018;78(11):3087–3097. [DOI] [PubMed] [Google Scholar]
- 50.Feng Y, Rhie SK, Huo D, et al. Characterizing Genetic Susceptibility to Breast Cancer in Women of African Ancestry. Cancer epidemiology, biomarkers & prevention : a publication of the American Association for Cancer Research, cosponsored by the American Society of Preventive Oncology. 2017;26(7):1016–1026. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Giri VN, Egleston B, Ruth K, et al. Race, genetic West African ancestry, and prostate cancer prediction by prostate-specific antigen in prospectively screened high-risk men. Cancer prevention research (Philadelphia, Pa). 2009;2(3):244–250. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Tian C, Chen Z, Ma X, et al. Comparison of Genetic Variants in Cancer-Related Genes between Chinese Hui and Han Populations. PLoS One. 2015;10(12):e0145170. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Grodin MA, Miller EL, Kelly JI. The Nazi Physicians as Leaders in Eugenics and “Euthanasia”: Lessons for Today. Am J Public Health. 2018;108(1):53–57. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Pow S, Stahnisch FW. Eugenics ideals, racial hygiene, and the emigration process of German-American neurogeneticist Franz Josef Kallmann (1897–1965). Journal of the history of the neurosciences. 2016;25(3):253–274. [DOI] [PubMed] [Google Scholar]
- 55.Weiss KM, Lambert BW. When the time seems ripe: eugenics, the annals, and the subtle persistence of typological thinking. Annals of human genetics. 2011;75(3):334–343. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Yudell M, Roberts D, DeSalle R, Tishkoff S. SCIENCE AND SOCIETY. Taking race out of human genetics. Science (New York, NY). 2016;351(6273):564–565. [DOI] [PubMed] [Google Scholar]
- 57.Gill AA, Enewold L, Zahm SH, et al. Colon cancer treatment: are there racial disparities in an equal-access healthcare system? Dis Colon Rectum. 2014;57(9):1059–1065. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
