Skip to main content
Journal of Clinical Medicine logoLink to Journal of Clinical Medicine
. 2021 Apr 18;10(8):1762. doi: 10.3390/jcm10081762

Patterns, Predictors, and Prognostic Value of Skeletal Muscle Mass Loss in Patients with Locally Advanced Head and Neck Cancer Undergoing Cisplatin-Based Chemoradiotherapy

Najiba Chargi 1, Inge Wegner 2, Navid Markazi 1, Ernst Smid 3, Pim de Jong 4, Lot Devriese 5, Remco de Bree 1,*
Editor: Jack Phan
PMCID: PMC8074083  PMID: 33919607

Abstract

Low skeletal muscle mass (SMM) is associated with toxicities and decreased survival in head and neck cancer (HNC). Chemoradiotherapy (CRT) may exaggerate loss of SMM. We investigated the changes in SMM, their predictors, and prognostic impact of SMM in patients treated with CRT between 2012 and 2018. Skeletal muscle area (SMA) segmentation was performed on pre- and post-CRT imaging. Observed changes in SMM were categorized into: (I) Stable, (II) moderate gain (III), moderate loss, (IV) large gain, and (V) large loss. In total, 235 HNC patients were included, of which 39% had stable SMM, 55% moderate loss, 13% moderate gain, 0.4% large loss, and 0.4% large gain of SMM. After CRT, SMA decreased compared to pre-CRT (31.6 cm2 versus 33.3 cm2, p < 0.01). The key predictor was a body mass index (BMI) of ≥30 kg/m2 (OR 3.6, 95% CI 1.4–9.3, p < 0.01). Low SMM at diagnosis (HR 2.1; 95% CI 1.1–4.1, p = 0.03) and an HPV-positive oropharyngeal tumor (HR 0.1; 95% CI 0.01–0.9, p = 0.04) were prognostic for overall survival. Changes in SMM were not prognostic for survival. Loss of SMM is highly prevalent after CRT and a high BMI before treatment may aid in identifying patients at risk.

Keywords: sarcopenia, head and neck cancer, body composition, skeletal muscle mass, muscle wasting, chemoradiotherapy, image-based analysis

1. Introduction

Head and neck cancer (HNC) accounts worldwide for approximately 550,000 cases annually [1]. Locally advanced HNC (LA-HNC) is the most prevailing clinical manifestation of HNC and has poor prognosis with a 5-year disease-free survival (DFS) of approximately 40–50%. Although the addition of the cytotoxic compound cisplatin to radiotherapy (RT) improved 5-year PFS from 36% to 47% and 5-year overall survival (OS) from 40% to 53%, it also caused a significant increase in severe functional mucosal adverse effects from 21% to 40% [2]. Due to the increased risk of side-effects, full compliance of chemoradiotherapy (CRT) is seen in only about two-thirds of the initially eligible patients [3,4,5]. Ongoing research evaluates and compares different systemic treatment regimens and novel therapeutic approaches with consideration of potential patient-related (i.e., HPV status) and treatment-related factors (i.e., dose regimen) in order to improve treatment tolerance and survival in LA-HNC patients.

An emerging patient-related predictive and prognostic factor in the management of HNC is patients’ skeletal muscle mass (SMM). SMM quantification can be easily performed with the use of computed tomography (CT) or magnetic resonance imaging (MRI) images, which are routinely performed in the diagnostic work-up prior to treatment. Low SMM is common in HNC and especially in LA-HNC patients [6]. Patients with LA-HNC frequently experience dysphagia due to tumor site and adverse effects caused by CRT. This leads to weight loss and nutritional deficiencies which are the major contributors to low SMM.

Low SMM has been shown to be a significant predictive factor for failure of the treatment plan due to toxicities in various types of cancer [7,8,9,10]. In addition, in LA-HNC patients, low SMM at diagnosis has been shown to be predictive for platinum dose-limiting toxicities [11,12]. Moreover, previous studies suggest that chemotherapy itself may induce SMM loss, also referred to as muscle wasting, in patients with cancer by increasing lipolysis and fatty acid B-oxidation [13]. It has also been suggested that patients with low SMM have higher blood levels of cytotoxic agents compared to patients without low SMM, which together with the previous mentioned mechanism may cause a vicious circle of muscle wasting [12]. In addition, various studies in other types of cancers have shown that loss of SMM during systemic chemotherapy is prognostic for decreased survival in patients with several types of cancer including colorectal and pancreatic cancer [14,15,16,17].

For HNC, several studies have shown that low SMM at diagnosis is prognostic for decreased survival [18,19,20,21]. However, little is known about the patterns and prognostic impact of changes in SMM after cisplatin-based CRT in LA-HNC patients. In HNC, one previous study investigated the prognostic impact of changes in SMM after (C)RT in patients with nasopharyngeal carcinoma and showed that loss of SMM was associated with decreased OS [22]. Nasopharyngeal carcinoma is, however, a distinctive entity in HNC. Furthermore, patients were treated with different treatment strategies (induction CRT as well as concurrent CRT) and SMM segmentation was performed on CT scans with a wide time interval (median: 110 days, range 41–1083 days). Regarding squamous cell carcinomas of other anatomical head and neck subsites, no evidence has been published yet. If loss of SMM after CRT is indeed a prognostic factor, it could be used as an objective measurement tool for decision making and it may offer the opportunity for timely therapeutic intervention to potentially reverse muscle wasting.

Therefore, this study evaluated the patterns and predictors of changes in SMM in LA-HNC patients treated with cisplatin-based CRT. In addition, the aim of this study was to determine if low SMM before CRT or loss of SMM after CRT have a prognostic impact on OS and DFS in LA-HNC patients.

2. Material and Methods

2.1. Ethical Approval

The design of this study was approved by the Medical Ethical Research Committee of the University Medical Center Utrecht, METC ID: 17–365/C, date of approval: January 2019. The requirement for informed consent from patients was waived because of its retrospective design.

2.2. Study Design

A retrospective cohort study was conducted. All patients diagnosed with LA-HNC and treated with cisplatin-based CRT in primary or postoperative setting between 2012 and 2018 in our tertiary referral center were screened for inclusion. Inclusion criteria for this study required that patients had CT or MRI imaging of the head and neck area within 1 month before CRT and follow-up CT or MRI imaging within 1 year after completion of CRT. Relevant demographic and clinical variables were retrieved from patients’ electronic medical records.

2.3. Therapy

Chemotherapy regimen consisted of three cycles of intravenous cisplatin-based chemotherapy on days 1, 22, and 43 of CRT. Chemotherapy dose was 100 mg/m2. CRT was given in a primary setting for patients with (technical or functional) irresectable LA-HNC and in a postoperative setting in case of positive resection margins and/or in the presence of extranodal tumor extension in resected lymph node metastases. Radiotherapy was administered in 35 fractions of 2 Gy to make a total dose of 70 Gy (primary setting), and in 33 fractions of 2 Gy to make a total dose of 66 Gy (postoperative setting).

2.4. Skeletal Muscle Measurements

Skeletal muscle area (SMA) was segmented using the Slice-O-matic software. Patients’ SMA was segmented on pre-CRT imaging and post-CRT imaging. At the level of the third cervical vertebra (C3), a single slice was used for SMA segmentation. The first slide to completely show the entire vertebral arc when scrolling through the C3 vertebra in caudal to cephalic direction was selected. For CT imaging, muscle area was defined as the pixel area between the radiodensity range of −29 and +150 Hounsfield units (HU), which is specific for muscle tissue [23]. For MRI, muscle area was manually segmented, and fatty tissue was manually excluded. The overall intraclass correlation coefficient (ICC) for the muscle SMA obtained by CT and MRI has shown to be excellent (ICC 0.9, p < 0.01) [24], and can therefore be used interchangeably for measuring CSA at the level of C3. The SMA was calculated as the sum of the delineated areas of the paravertebral muscles and both sternocleidomastoid muscles. When measurement of SMA of one musculus sternocleidomastoideus was not possible, due to, e.g., lymph node invasion or radical neck dissection, we calculated the SMA of the other sternocleidomastoid muscle and multiplied this by two. SMA at the level of C3 was first converted to SMA at the level of L3 using a previously published formula [25]. The SMA at the level of L3 was corrected for patients’ squared height to obtain the lumbar skeletal muscle mass index (LSMI).

The LSMI cutoff value for the diagnosis of low SMM chosen in this study was determined by calculating the log likelihood using a statistical method previously described by Williams et al. [26]. The cutoff value best associated with survival (lowest log-likelihood) was a LSMI ≤ 46.6 cm2/m2.

2.5. Skeletal Muscle Mass Changes

Relative changes of SMM were calculated by using the following formula:

Relative change of SMM = (SMA after CRT–SMA before CRT) / (SMA before CRT) × 100%.

Hereafter, the standard deviation (SD) of the relative changes in SMM was calculated as previously described by Brown et al. [27] in order to derive five categories of changes in SMM in the fifth to ninety-fifth percentiles:

  1. Stable changes in SMM: No change ±1 SD from baseline;

  2. Moderate gain in SMM: ≥1 SD to <2 SD of gain from baseline;

  3. Moderate loss in SMM: ≥1 SD to <2 SD of loss from baseline;

  4. Large gain in SMM: ≥2 SD from baseline;

  5. Large loss in SMM: ≥2 SD from baseline.

2.6. Survival

OS was defined as the time between the date of histologic diagnosis of LA-HNC and death, or date of last follow-up. DFS was defined as the time between the date of histologic diagnosis of LA-HNC and the date of pathologic confirmed recurrence or date of last follow-up, whichever occurred first.

2.7. Statistical Analysis

Data analysis was performed using IBM SPSS statistics 25. Demographic and clinical data were reported for the included patients. Baseline measures for these groups were described using descriptive statistics. Normally distributed variables were shown as means ± standard deviation (SD); non-normally distributed variables were shown as medians with an interquartile range (IQR). Normality was investigated using the Kolmogorov–Smirnov test. Independent sample Student’s t-tests were used to compare the means of normally distributed continuous variables with regard to presence or absence of low SMM. Categorical variables were described as frequencies with corresponding percentages. The Fisher exact test and Chi-square test were used, when appropriate, for analyzing differences between the frequencies of each categorical variable with regard to the presence or absence of low SMM and of muscle changes.

A logistic regression model was used for univariate and multivariate analysis of the predictors for loss of SMM (including patients from the groups of moderate and large loss of SMM) and a cox-proportional hazard model was used for the prognostic impact of low SMM at baseline and a loss of SMM (including patients from the groups of moderate and large loss of SMM) after CRT on OS and DFS. The time interval chosen in the Cox proportional hazard model was the time between pre-CRT and follow-up imaging for estimating the predictors for loss of SMM and the time interval between diagnosis and the date of the event (death, recurrence) for estimating the prognostic impact of SMM on OS and DFS. Covariates used in the multivariate analysis were selected based on clinical relevance and if the p-value in the univariate analysis was <0.05 or near significance <0.1. Clinical relevance was determined based on literature and expert opinion. Furthermore, the relationship between survival and SMM and change in SMM was visualized using Kaplan–Meier survival curves, including log-rank tests.

Statistical significance was evaluated at the 0.05 level using 2-tailed tests.

3. Results

3.1. Patients’ Characteristics

In total, 235 LA-HNC patients were identified who received cisplatin-based CRT between 2012 and 2018 and had evaluable pre-CRT and follow-up imaging of the head and neck area within 1 year. The median time between follow-up imaging and pre-CRT imaging was 6 months (IQR 5–9). The follow-up period of the included patients ranged from November 2012 until May 2019.

The clinical and demographic characteristics of the study population prior to initiation of CRT are presented in Table 1. The majority of patients was male (70%). Mean age at diagnosis was 59 years (SD 8) and the mean body mass index (BMI) was 24.5 kg/m2. Nearly half of the patients (49%) had mild comorbidities as evaluated by the Adult Comorbidity Evaluation 27 (ACE-27) score. Most patients were current/former smokers (82%) and/or consumed alcohol (83%), and 75% of patients had combined tobacco and alcohol use. Most patients had an Eastern Cooperative Oncology Group (ECOG) performance status of 1 (47%). The mean serum albumin levels of the included patients at diagnosis were 39.8 g/L (SD 4.6). Most patients had either a tumor located in the oral cavity (35%) or oropharynx (31%) of which the majority (60%) was not associated with human papillomavirus. A majority of the patients (83%) was diagnosed with a tumor, node, metastasis (TNM) stage IV tumor, and underwent CRT in a primary setting (71%).

Table 1.

Study population characteristics.

Characteristics Total (n = 235) Low SMM (n = 185) Without low SMM (n = 50) p-Value
N (%) N (78.7%) N (21.3%)
Gender
Male
Female

164 (69.8)
71 (30.2)

115 (62.2)
70 (37.8)

49 (98)
1 (2)
<0.01
Age diagnosis (years)
(mean, SD)

58.6 (8.0)

59.1 (7.9)

56.8 (8.2)

0.07
BMI (kg/m2)
<18.5
18.5–24.9
25.0–29.9
≥30

21 (8.9)
117 (49.8)
65 (27.7)
32 (13.6)

21 (11.4)
113 (61.1)
40 (21.6)
11 (5.9)

0 (0)
4 (8)
25 (50)
21 (42)

<0.01
ACE-27 score
None
Mild
Moderate
Severe

50 (21.3)
115 (48.9)
53 (22.6)
17 (7.2)

42 (22.7)
87 (47)
43 (23.2)
13 (7)

8 (16)
28 (56)
10 (20)
4 (8)

0.64
Performance status
ECOG 0
ECOG 1
ECOG ≥ 2
Missing

63 (26.8)
111 (47.2)
27 (11.5)
34 (14.5)

49 (26.5)
89 (48.1)
21 (11.4)
26 (14.1)

14 (28)
22 (44)
6 (12)
8 (16)
0.96
Smoker
No
Current/former

43 (18.3)
192 (81.7)

30 (16.2)
155 (83.8)

13 (26)
37(74)

0.15
Alcohol use
No
Yes
Smoker and alcohol use
No
Yes

40 (17)
195 (83)

60 (25.5)
175 (74.5)

32 (17.3)
153 (82.7)

44 (23.8)
141 (76.2)

8 (16)
42 (84)

16 (32)
34 (68)

0.84


0.27
Albumin (g/L)
(mean, SD)

39.8 (4.6)

40.0 (4.7)

39.8 (4.6)

0.8
Tumor site
Oral cavity
Oropharynx
HPV–
HPV+
HPV unknown
Nasopharynx
Hypopharynx
Larynx
Paranasal sinus
Unknown primary

83 (35.3)
73 (31.1)
44 (60.3)
21 (28.8)
8 (11.0)
19 (8.1)
32 (13.6)
10 (4.3)
10 (4.3)
8 (3.4)

66 (35.7)
57 (30.8)
36 (63.2)
14 (24.6)
7 (12.3)
14 (7.6)
27 (14.6)
8 (4.3)
7 (3.8)
6 (3.2)

17 (34)
16 (32)
8 (50.0)
7 (9.6)
1 (6.3)
5 (10)
5 (10)
2 (4)
3 (6)
2 (4)
0.98
TNM stage
III
IV

40 (17.0)
195 (83.0)

31 (16.8)
154 (83.2)

9 (18.0)
41 (82)
0.84
CRT setting
Primary
Adjuvant

166 (70.6)
69 (29.4)

126 (68.1)
59 (31.9)

40 (80)
10 (20.0)

0.12

p-Values printed in bold were significant at a 0.05 level, p-values printed in italics were near statistical significance at a 0.05 level, SMM: Skeletal muscle mass, BMI: Body mass index, ACE-27: Adult Comorbidity Evaluation 27, ECOG: Easter Cooperative Oncology Group, HPV: Human papilloma virus, TNM: Tumor, node, metastasis, CRT: Chemoradiotherapy.

At pre-CRT imaging, 141 patients (60%) had low SMM. As is shown in Table 1, patients with low SMM were significantly more likely to be female, to be of older age, to be (current/former) smokers, to have combined tobacco and alcohol use, and to have a BMI < 18.5 kg/m2.

At follow-up imaging, 149 patients (63%) were diagnosed with low SMM. Mean SMA at follow-up imaging (31.62 cm2, SD 8.69) was significantly lower than mean SMA at pre-CRT imaging (33.34 cm2, SD 9.11) (p < 0.01). Table 2 shows the SMM changes that occurred in the study population. Only 91 patients (39%) had stable SMM compared to pre-CRT. A rather large proportion of the study population (n = 129, 55%) had moderate loss in SMM compared to pre-CRT SMM and only 13 (6%) patients showed moderate gain in SMM compared to pre-CRT SMM. A minority of patients experienced large loss in SMM (n = 1, 0.4%) or large gain in SMM (n = 1, 0.4%).

Table 2.

Changes in SMM after CRT.

Stable Moderate Loss Moderate Gain Large Loss Large gain
Change in SD ±1 SD ≥1 SD to <2 SD ≥1 SD to <2 SD ≥2 SD ≥2 SD
SMA range (cm2) >24.33 to <42.45 ≤24.33 to >18.22 ≥42.45 to <51.56 ≤18.22 ≥51.56
n (%) 91 (38.7) 129 (54.9) 13 (5.5) 1 (0.4) 1 (0.4)

SMM: Skeletal muscle mass, CRT: Chemoradiotherapy, SD: Standard deviation, SMA: Skeletal muscle area.

Table 3 shows the characteristics of patients with stable SMM versus patients with loss in SMM (moderate and large loss) and gain in SMM (moderate and large gain). Patients with loss in SMM were more likely to have a BMI ≥ 25 kg/m2 compared to patients with stable SMM (p < 0.01).

Table 3.

Characteristics of patients with stable SMM versus patients with loss and gain of SMM.

Characteristics Stable
n = 91
41.2%
Muscle Loss
n = 130
90.3%
Muscle Gain
n = 14
9.7%
p-Value
n (%) n (%) n (%)
Gender
Male
Female

63 (69.2)
28 (30.8)

89 (68.5)
41 (31.5)

12 (85.7)
2 (14.3)

0.4
Age > 60 years
No
Yes
BMI (kg/m2)
<18.5
18.5–24.9
25.0–29.9
≥30
ACE-27 score
None
Mild
Moderate
Severe
Performance
ECOG 0
ECOG 1
ECOG ≥ 2
Unknown
Smoking
No
Former
Current
Alcohol
No
Current/former

45 (49.5)
46 (50.5)

14 (15.4)
50 (54.9)
19 (20.9)
8 (8.8)

18 (19.8)
48 (52.7)
19 (20.9)
6 (6.6)

24 (26.4)
48 (52.7)
8 (8.8)
11 (12.1)

18 (19.8)
25 (27.5)
48 (52.7)

18 (19.8)
73 (80.2)

72 (55.4)
58 (44.6)

6 (4.6)
60 (46.2)
40 (30.8)
24 (18.5)

29 (22.3)
64 (49.2)
30 (23.1)
7 (5.4)

37 (28.5)
53 (40.8)
19 (14.6)
21 (16.2)

24 (18.5)
37 (28.5)
69 (53.1)

2 (14.3)
12 (85.7)

7 (50)
7 (50)

7 (50)
1 (7.1)
6 (42.9)
0 (0)

3 (21.4)
3 (21.4)
4 (28.6)
4 (28.6)

2 (14.3)
10 (71.4)
0 (0)
2 (14.3)

1 (7.1)
3 (21.4)
10 (71.4)

20 (15.4)
110 (84.6)
0.7



0.01


0.7




0.2




0.7



0.7
Tumor site
Oral cavity
Oropharynx
Nasopharynx
Hypopharynx
Larynx
Paranasal sinus
Unknown primary
TNM stage
III
IV

30 (33)
22 (24.2)
9 (9.9)
16 (17.6)
4 (4.4)
3 (3.3)
7 (7.7)

14 (15.4)
77 (84.6)

46 (35.4)
46 (35.4)
10 (7.7)
14 (10.8)
6 (4.6)
7 (5.4)
1 (0.8)
26 (20)

104 (80)

7 (50)
5 (35.7)
0 (0)
2 (14.3)
0 (0)
0 (0)
0 (0)

0 (0)
14 (100)
0.2







0.3

p-Values printed in bold were significant at a 0.05 level. SMM: Skeletal muscle mass, BMI: Body mass index, ACE-27: Adult Comorbidity Evaluation 27, ECOG: Easter Cooperative Oncology Group, HPV: Human papilloma virus, TNM: Tumor, node, metastasis.

3.2. Predictors of Loss in Skeletal Muscle Mass

Table 4 shows the logistic regression analysis of the predictors for loss of SMM. In univariate regression analysis, significant predictors for loss of SMM were a BMI ≥ 30 kg/m2 (odds ratio (OR) 2.9, 95% confidence interval (CI) 1.2–6.9), and an unknown primary tumor (OR 0.1, 95% CI 0.01–0.9). In multivariate logistic regression analysis, a BMI ≥ 30 kg/m2 (HR 3.6, 95% CI 1.4–9.3) remained a significant predictor for loss of SMM after CRT.

Table 4.

Logistic regression analysis: Predictors for SMM loss.

Univariate Analysis Multivariate Analysis
OR (95% CI) p-Value OR (95% CI) p-Value
Age (years) 1.0 (1.0–1.0) 0.8
Gender
Female
Male

Ref.
0.9 (0.5–1.5)


0.6
BMI (kg/m2)
18.5–24.9
<18.5
25–29.9
≥30
Smoking
No
Yes
Alcohol use
No
Yes
Performance status
ECOG 0
ECOG 1
ECOG ≥ 2
Unknown
Albumin (mmol/L)

Ref.
0.4 (0.1–1.0)
1.5 (0.8–2.8)
2.9 (1.2–6.9)

Ref.
1.0 (0.5–1.9)

Ref.
1.3 (0.7–2.6)

Ref.
0.6 (0.3–1.2)
1.7 (0.6–4.4)
1.1 (0.5–2.7)
1.1 (1.0–1.1)


0.06
0.2
0.02


0.9



0.5

0.2
0.3
0.8
0.2
Ref.
0.4 (0.1–2.0)
1.3 (0.7–2.5)
3.6 (1.4–9.3)

0.1
0.4
<0.01
ACE-27
None
Mild
Moderate
Severe
Tumor localization
Oral cavity
Oropharynx
Nasopharynx
Hypopharynx
Larynx
Paranasal sinus
Unknown primary
HPV status
Negative
Positive
Unknown
CRT setting
Primary
Adjuvant
Dose-limiting toxicity
No
Yes
Cumulative chemotherapy dose
<300 mg
≥300 mg
Weight loss during CRT
None
<10%
≥10%

Ref.
1.0 (0.6–1.8)
0.9 (0.4–2.1)
0.5 (0.2–1.5)

Ref.
1.4 (0.7–2.6)
0.9 (0.3–2.4)
0.6 (0.3–1.4)
1.2 (0.3–4.6)
1.9 (0.5–7.8)
0.1 (0.01–0.9)

Ref.
0.8 (0.3–2.2)
1.7 (0.3–9.5)

Ref.
1.2 (0.7–2.1)

Ref.
1.2 (0.7–2.0)

Ref.
0.9 (0.5–1.6)

Ref.
1.4 (0.7–2.5)
2.8 (0.9–8.8)


0.8
0.9
0.2


0.4
0.8
0.3
0.8
0.4
0.047


0.6
0.5


0.6


0.5


0.6


0.3
0.08






Ref.
1.7 (0.9–1.4)
0.9 (0.3–2.6)
0.7 (0.3–1.7)
0.9 (0.2–3.6)
1.9 (0.4–8.4)
0.1 (0.1–1.0)














Ref.
1.3 (0.7–2.4)
2.6 (0.8–8.5)







0.1
0.8
0.5
0.9
0.4
0.05















0.5
0.1

p-Values printed in bold were significant at a 0.05 level. SMM: Skeletal muscle mass, HR: Hazard ratio, SD: Standard deviation, BMI: Body mass index, ACE-27: Adult Comorbidity Evaluation 27, ECOG: Easter Cooperative Oncology Group, HPV: Human papilloma virus, TNM: Tumor, node, metastasis, CRT: Chemoradiotherapy.

3.3. Survival: Overall Survival and Disease-Free Survival

During the follow-up period from November 2011 until May 2019, 86 (37%) patients died, and 72 (31%) patients developed a recurrence. The median OS was 22 months (IQR 12–39) and the median DFS was 19 months (IQR 9–35). Of the patients that died, 43 (50%) patients experienced a loss in SMM, 36 (42%) patients had stable SMM changes, and 7 (8%) patients gained SMM after treatment. Of the patients that developed a recurrence during follow-up, 36 (50%) patients had a loss in SMM, 31 (43%) patients had stable SMM changes, and 5 (7%) patients gained SMM. Although half of the patients who died or had a recurrence during follow-up experienced a loss in SMM, in univariate Cox regression analysis, no prognostic value of loss in SMM for OS nor DFS were found. Using stable or gain in SMM changes as the reference group, HRs for SMM loss were 0.9 (95% CI 0.6–1.4) and 0.8 (95% CI 0.5–1.3), respectively. Figure 1 shows the Kaplan–Meier OS and DFS curves for patients with loss in SMM versus no loss in SMM (stable SMM and muscle gain (moderate and large)).

Figure 1.

Figure 1

Kaplan–Meier OS (A) and DFS (B) curves of patients with stable SMM versus muscle changes (muscle loss and muscle gain) showed no significant differences in OS (log-rank Chi-square 0.1, p = 0.8) nor DFS (log-rank Chi-square 0.5, p = 0.5).

As shown in Table 5, in univariate Cox regression analysis, low SMM prior to initiation of CRT (HR 2.1; 95% CI 1.1–4.1, p = 0.03) and an HPV-positive oropharyngeal tumor (HR 0.1; 95% CI 0.01–0.9, p = 0.04) were prognostic for OS. No significant prognostic impact of low SMM for DFS was seen (HR 1.4; 95% CI 0.9–2.3). Low SMM after treatment showed no prognostic value for OS (HR 1.4; 95% CI 0.9–2.2) nor DFS (HR 1.3; 95% CI 0.8–2.2). Figure 2 shows the Kaplan–Meier OS and DFS curves for patients with low SMM before CRT.

Table 5.

Proportional Cox regression analysis: Prognostic factors for overall survival.

Univariate Analysis Multivariate Analysis
HR (95% CI) p-Value HR (95% CI) p-Value
Age (years) 1.0 (1.0–1.0) 0.2
Low SMM
No
Yes

Ref.
2.1 (1.1–4.1)


0.03

Ref.
4.3 (0.6–32.6)


0.2
Gender
Female
Male

Ref.
1.1 (0.7–1.7)


0.7
BMI (kg/m2)
18.5–24.9
<18.5
25–29.9
≥30

Ref.
1.1 (0.5–2.2)
0.7 (0.4–1.1)
0.9 (0.5–1.7)


0.9
0.1
0.7
ACE–27
None
Mild
Moderate
Severe

Ref.
1.1 (0.6–1.8)
1.5 (0.8–2.8)
1.1 (0.4–2.6)


1.0
0.2
0.9
Tumor localization
Oral cavity
Oropharynx
Nasopharynx
Hypopharynx
Larynx
Paranasal sinus
Unknown primary

Ref.
1.1 (0.7–1.9)
0.6 (0.2–1.5)
1.2 (0.7–2.2)
0.6 (0.2–2.1)
0.2 (0.03–1.4)
1.1 (0.3–4.6)


0.7
0.3
0.5
0.5
0.1
0.9
HPV status
Negative
Positive
Unknown

Ref.
0.1 (0.01–0.9)
0.3 (0.04–2.2)


0.04
0.2

Ref.
0.1 (0.02–1.0)
0.4 (0.05–2.7)


0.06
0.3
CRT setting
Primary
Adjuvant

Ref.
1.3 (0.9–2.1)


0.2

p-Values printed in bold were significant at a 0.05 level. SMM: Skeletal muscle mass, HR: Hazard ratio, BMI: Body mass index, ACE-27: Adult Comorbidity Evaluation 27, HPV: Human papilloma virus, TNM: Tumor, node, metastasis, CRT: Chemoradiotherapy.

Figure 2.

Figure 2

Kaplan–Meier OS (A) and DFS (B) curves of patients with low SMM at diagnosis showed decreased OS (log-rank Chi-square 5.1, p = 0.02) and DFS (log-rank Chi-square 2.0, p = 0.2) compared to patients without low SMM, although this finding was only statistically significant for OS and not DFS.

4. Discussion

This study is the first to evaluate the patterns of changes in SMM in LA-HNC patients treated with cisplatin-based CRT. After CRT, the majority of the patients (n = 129, 55%) had moderate loss of SMM and one patient (0.4%) had large loss of SMM after CRT. A minority of the patients (n = 13, 6%) had moderate gain of SMM after CRT, and one patient (0.4%) had large gain of SMM after CRT. Of the 235 LA-HNC patients who underwent CRT, only 91 patients (39%) had stable SMM. The mean SMA at follow-up (31.62 cm2, SD 8.69) was significantly lower than mean SMA at the initiation of CRT (33.34 cm2, SD 9.11). Although this finding was statistically significant, further research should be done to investigate its clinical significance and its relationship with BMI changes. The prevalence of low SMM before treatment was 78.7%.

Previous research has shown that low SMM is a significant negative prognostic factor for survival [19,21]. As reported in these studies, this study showed that low SMM prior to initiation of CRT was a negative prognostic factor for overall survival in univariate analysis, but this finding was not statistically significant when the HPV status was included in multi-variate analysis. An explanation for why we did not find a prognostic impact for overall survival in multivariate analysis might be that tumor stage and HPV status as prognostic factors outweigh the prognostic impact of low SMM. In a previous study in elderly HNC patients, we also showed that low SMM had prognostic impact in patients with stage I–III HNC, but lost its prognostic impact in patients with stage IV HNC [21]. In this study, we included patients with LA-HNC, stages III–IV, and it is possible that low SMM does not have a prognostic impact in this group of patients. The mechanism underlying the relation between low SMM and decreased survival is yet to be elucidated. Low SMM may impact survival by causing treatment-related toxicities, which may lead to ineffective cancer treatment. In a previous study, although low SMM was not prognostic for the whole group of HNC patients treated with primary CRT, patients who experienced cisplatin dose-limiting toxicity, significantly more frequently observed in patients with low SMM, had a worse prognosis [12]. Moreover, malignancies also cause a state of hyper catabolism and inflammation which negatively impacts SMM, causing a negative vicious circle [28].

The loss of SMM after treatment, also referred to as muscle wasting, is the net result of a combination of an imbalance between protein synthesis and protein degradation, cell death of muscle cells, and a decrease in the muscle’s capability of regenerating new muscle cells. Previous research also underlines the role of oxidative stress and inflammation in the development of muscle wasting [29].

In this study, being obese at diagnosis showed to be a significant predictive factor for loss of SMM in our study population. Although this may feel counterintuitive, BMI may mask an underlying unfavorable body composition, i.e., a patient may be overweight by a surplus of fatty tissue and still have low SMM. This combination of low SMM and a surplus of fatty tissue is also referred to in the literature as sarcopenic obesity. Sarcopenic obesity has been shown to carry the cumulative risk of low SMM and high fat mass [30]. In clinical practice, the start of nutritional support in cancer patients is mainly guided by their body weight at presentation and loss of body weight prior to treatment rather than body composition, i.e., the amount of SMM and fat mass. This approach may result in underdiagnosis of patients in need of nutritional support.

Although previous studies have shown that loss of SMM in patients who received cancer treatment [14,15,16,31] had significant prognostic impact on survival, in this study, a loss in SMM showed no prognostic impact for OS nor DFS. This difference may be explained by the heterogeneity in the definition of muscle mass changes, the timing of the follow-up imaging, and the type and stage of cancer and its type of treatment. Another explanation might be that in HNC dietician guidance is incorporated earlier into standard care practice than in non-HNC due to the high risk of malnutrition in patients with HNC.

The median time between follow-up imaging and pre-CRT imaging in our study was 6 months (range 5–9). In previous studies conducted in non-HNC cancer patients in which loss of SMM showed to have prognostic value, this interval ranged between 9–27 months [27] and 9–18 weeks [15]. In addition to the difference in time interval between this study and previous studies, there was also a difference in the investigated study population. In this study, we included patients who received cisplatin-based CRT in a curative setting. In a previous study, a prognostic impact of loss of SMM after CRT for decreased survival was also demonstrated in the palliative setting [14]. Timing of baseline and follow-up SMM assessment may influence the prognostic value of loss of SMM. Nevertheless, this study and the previous studies conducted on muscle wasting in cancer patients all underline the finding of significant SMM changes, which itself is an interesting finding which needs more standardized and prospective research to evaluate its value for treatment outcomes and prognosis in patients with cancer.

For patients with HNC, the frequent use of CT and MRI imaging for staging, evaluation, and surveillance provides the opportunity to measure SMM without additional patient burden or costs. SMM assessments can serve as an objective and clinical measure of patient nutritional status and physical vulnerability and can be used to predict treatment outcomes in patients with cancer. SMM can be objectively and reliably measured and is a potentially modifiable risk factor. An increased understanding of the underlying mechanisms of the negative prognostic effects of low SMM in patients with cancer is crucial in order to innovate and to improve current treatment strategies and eventually treatment outcomes. Commonly proposed strategies include combination of high-protein nutritional support, exercise, and pharmacological interventions. Use of an intervention program, which includes nutrition support and high-intensity exercise, is probably an ideal option for patients with low SMM [31,32].

Our study had some limitations. Firstly, due to the retrospective design of the study, not all information on potential confounding variables could be retrieved, such as life-style measures including nutritional support and physical exercise. Nutritional support during CRT may influence the observed changes in SMM and their prognostic value. Secondly, we used routinely performed baseline and follow-up imaging and the time between the baseline and follow-up imaging therefore varied between patients. This may have inherently led to bias of the results. Thirdly, muscle function and muscle strength were not measured in this study. However, these measures are also important in functional depletion and should be investigated further. Another limitation is that due to the discrepancy of males and females in this study, 71 females and 164 males respectively, we did not calculate gender-specific cutoff values for low SMM. SMM may however differ between males and females. Further studies should be performed to determine standardized gender-specific cutoff values for low SMM in patients with head and neck cancer.

In conclusion, this study is the first to evaluate longitudinal SMM changes in patients with LA-HNC treated with cisplatin-based CRT and the first to identify risk factors for loss of SMM. Loss of SMM after CRT occurs in majority of LA-HNC patients. Obese patients were at increased risk for experiencing loss of SMM.

Abbreviations

LA-HNC Locally advanced head and neck cancer
SMA Skeletal muscle area
SMM Skeletal muscle mass
LSMI Lumbar skeletal muscle index
C3 Third cervical vertebra
L3 Third lumbar vertebra
HU Hounsfield unit
BMI Body mass index
CT Computed tomography
MRI Magnetic resonance imaging
ICC Intraclass correlation coefficient
SD Standard deviation
IQR Interquartile range
ACE–27 Adult Comorbidity Evaluation 27
ECOG Eastern Cooperative Oncology Group
TNM Tumor, node, metastasis
CI Confidence interval
HR Hazard ratio

Author Contributions

Conceptualization, R.d.B.; data curation, N.C.; formal analysis, N.C. and I.W.; investigation, N.C. and N.M.; methodology, N.C. and I.W.; resources, E.S. and P.d.J.; supervision, L.D. and R.d.B.; writing—original draft, N.C.; writing—review and editing, I.W., E.S., P.d.J., L.D., and R.d.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Medical Ethical Research Committee of the University Medical Center Utrecht, METC ID: 17–365/C, date of approval: January 2019.

Informed Consent Statement

The requirement for informed consent from patients was waived because of its retrospective design.

Conflicts of Interest

The authors declare no conflict of interest.

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Global Burden of Disease Cancer Collaboration. Fitzmaurice C., Allen C., Barber R.M., Barregard L., Bhutta Z.A., Brenner H., Dicker D.J., Chimed-Orchir O., Dandona R., et al. Global, regional, and national cancer incidence, mortality, years of life lost, years lived with disability, and disability-adjusted life-years for 32 cancer groups, 1990 to 2015: A Systematic Analysis for the Global Burden of Disease Study Global Burden of Disease Cancer Collaboration. JAMA Oncol. 2017;3:524–548. doi: 10.1001/jamaoncol.2016.5688. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Bernier J., Domenge C., Ozsahin M., Matuszewska K., Lefèbvre J.-L., Greiner R.H., Giralt J., Maingon P., Rolland F., Bolla M., et al. Postoperative Irradiation with or without Concomitant Chemotherapy for Locally Advanced Head and Neck Cancer. N. Engl. J. Med. 2004;350:1945–1952. doi: 10.1056/NEJMoa032641. [DOI] [PubMed] [Google Scholar]
  • 3.Helfenstein S., Riesterer O., Meier U.R., Papachristofilou A., Kasenda B., Pless M., Rothschild S.I. 3-weekly or weekly cisplatin concurrently with radiotherapy for patients with squamous cell carcinoma of the head and neck—A multicentre, retrospective analysis. Radiation Oncology. 2019;14:32. doi: 10.1186/s13014-019-1235-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Muzumder S., Srikantia N., Vashishta G.D., Udayashankar A.H., Raj J.M., Sebastian M.G.J., Kainthaje P.B. Compliance, toxicity and efficacy in weekly versus 3-weekly cisplatin concurrent chemoradiation in locally advanced head and neck cancer. J. Radiother. Pract. 2019;18:26–31. doi: 10.1017/S1460396918000341. [DOI] [Google Scholar]
  • 5.Schüttrumpf L., Marschner S., Scheu K., Hess J., Rietzler S., Walch A., Baumeister P., Kirchner T., Ganswindt U., Zitzelsberger H., et al. Definitive chemoradiotherapy in patients with squamous cell cancers of the head and neck—Results from an unselected cohort of the clinical cooperation group “personalized Radiotherapy in Head and Neck Cancer”. Radiat. Oncol. 2020;15:7. doi: 10.1186/s13014-019-1452-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Hua X., Liu S., Liao J.-F., Wen W., Long Z.-Q., Lu Z.-J., Guo L., Lin H.-X. When the Loss Costs Too Much: A Systematic Review and Meta-Analysis of Sarcopenia in Head and Neck Cancer. Front. Oncol. 2020;9:1561. doi: 10.3389/fonc.2019.01561. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Kurk S., Peeters P., Stellato R., Dorresteijn B., De Jong P., Jourdan M., Creemers G., Erdkamp F., De Jongh F., Kint P., et al. Skeletal muscle mass loss and dose-limiting toxicities in metastatic colorectal cancer patients. J. Cachexia Sarcopenia Muscle. 2019;10:803–813. doi: 10.1002/jcsm.12436. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Ali R., Baracos V.E., Sawyer M.B., Bianchi L., Roberts S., Assenat E., Mollevi C., Senesse P. Lean body mass as an independent determinant of dose-limiting toxicity and neuropathy in patients with colon cancer treated with FOLFOX regimens. Cancer Med. 2016;5:607–616. doi: 10.1002/cam4.621. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Sjøblom B., Benth J.Š., Grønberg B.H., Baracos V.E., Sawyer M.B., Fløtten Ø., Hjermstad M.J., Aass N., Jordhøy M. Drug Dose Per Kilogram Lean Body Mass Predicts Hematologic Toxicity From Carboplatin-Doublet Chemotherapy in Advanced Non–Small-Cell Lung Cancer. Clin. Lung Cancer. 2017;18:e129–e136. doi: 10.1016/j.cllc.2016.09.008. [DOI] [PubMed] [Google Scholar]
  • 10.Shachar S.S., Deal A.M., Weinberg M., Nyrop K.A., Williams G.R., Nishijima T.F., Benbow J.M., Muss H.B. Skeletal muscle measures as predictors of toxicity, hospitalization, and survival in patients with metastatic breast cancer receiving taxane-based chemotherapy. Clin. Cancer Res. 2017;23:658–665. doi: 10.1158/1078-0432.CCR-16-0940. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Sealy M.J., Dechaphunkul T., van der Schans C.P., Krijnen W.P., Roodenburg J.L., Walker J., Jager-Wittenaar H., Baracos V.E. Low muscle mass is associated with early termination of chemotherapy related to toxicity in patients with head and neck cancer. Clin. Nutr. 2020;39:501–509. doi: 10.1016/j.clnu.2019.02.029. [DOI] [PubMed] [Google Scholar]
  • 12.Wendrich A.W., Swartz J.E., Bril S.I., Wegner I., De Graeff A., Smid E.J., De Bree R., Pothen A.J. Low skeletal muscle mass is a predictive factor for chemotherapy dose-limiting toxicity in patients with locally advanced head and neck cancer. Oral Oncol. 2017;71:26–33. doi: 10.1016/j.oraloncology.2017.05.012. [DOI] [PubMed] [Google Scholar]
  • 13.Garcia J.M., Scherer T., Chen J.-A., Guillory B., Nassif A., Papusha V., Smiechowska J., Asnicar M., Buettner C., Smith R.G. Inhibition of cisplatin-induced lipid catabolism and weight loss by ghrelin in male mice. Endocrinology. 2013;154:3118–3129. doi: 10.1210/en.2013-1179. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Daly L.E., Ní Bhuachalla É.B., Power D.G., Cushen S.J., James K., Ryan A.M. Loss of skeletal muscle during systemic chemotherapy is prognostic of poor survival in patients with foregut cancer. J. Cachexia Sarcopenia Muscle. 2018;9:315–325. doi: 10.1002/jcsm.12267. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Kurk S.A., Peeters P.H.M., Dorresteijn B., De Jong P.A., Jourdan M., Creemers G.-J.M., Erdkamp F.L.G., De Jongh F.E., Kint P.A.M., Poppema B.J., et al. Loss of skeletal muscle index and survival in patients with metastatic colorectal cancer: Secondary analysis of the phase 3 CAIRO3 trial. Cancer Med. 2020;9:1033–1043. doi: 10.1002/cam4.2787. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.De Nardi P., Salandini M., Chiari D., Pecorelli N., Cristel G., Damascelli A., Ronzoni M., Massimino L., De Cobelli F., Braga M. Changes in body composition during neoadjuvant therapy can affect prognosis in rectal cancer patients: An exploratory study. Curr. Probl. Cancer. 2020;44:100510. doi: 10.1016/j.currproblcancer.2019.100510. [DOI] [PubMed] [Google Scholar]
  • 17.Basile D., Corvaja C., Caccialanza R., Aprile G. Sarcopenia: Looking to muscle mass to better manage pancreatic cancer patients. Curr. Opin. Support. Palliat. Care. 2019;13:279–285. doi: 10.1097/SPC.0000000000000455. [DOI] [PubMed] [Google Scholar]
  • 18.Stone L., Olson B., Mowery A., Krasnow S., Jiang A., Li R., Schindler J., Wax M.K., Andersen P., Marks D., et al. JAMA Otolaryngology—Head and Neck Surgery. Volume 145. American Medical Association; Chicago, IL, USA: 2019. Association between Sarcopenia and Mortality in Patients Undergoing Surgical Excision of Head and Neck Cancer; pp. 647–654. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Chargi N., Bril S., Swartz J., Wegner I., Willems S., de Bree R. Skeletal muscle mass is an imaging biomarker for decreased survival in patients with oropharyngeal squamous cell carcinoma. Oral Oncol. 2020;101 doi: 10.1016/j.oraloncology.2019.104519. [DOI] [PubMed] [Google Scholar]
  • 20.Ansari E., Chargi N., van Gemert J., van Es R., Dieleman F., Rosenberg A., Van Cann E., de Bree R. Low skeletal muscle mass is a strong predictive factor for surgical complications and a prognostic factor in oral cancer patients undergoing mandibular reconstruction with a free fibula flap. Oral Oncol. 2020;101 doi: 10.1016/j.oraloncology.2019.104530. [DOI] [PubMed] [Google Scholar]
  • 21.Chargi N., Bril S.I., Emmelot-Vonk M.H., De Bree R. Sarcopenia is a prognostic factor for overall survival in elderly patients with head-and-neck cancer. Eur. Arch. Oto-Rhino-Laryngology. 2019;276:1475–1486. doi: 10.1007/s00405-019-05361-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Huang X., Ma J., Li L., Zhu X. Severe muscle loss during radical chemoradiotherapy for non-metastatic nasopharyngeal carcinoma predicts poor survival. Cancer Med. 2019;8:6604–6613. doi: 10.1002/cam4.2538. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Mitsiopoulos N., Baumgartner R.N., Heymsfield S.B., Lyons W., Gallagher D., Ross R. Cadaver Validation of Skeletal Muscle Measurement by Magnetic Resonance Imaging and Computerized Tomography. J. Appl. Physiol. 1998;85:115–122. doi: 10.1152/jappl.1998.85.1.115. [DOI] [PubMed] [Google Scholar]
  • 24.Chargi N., Ansari E., Huiskamp L., Bol G., De Bree R. Agreement between skeletal muscle mass measurements using computed tomography imaging and magnetic resonance imaging in head and neck cancer patients. Oral Oncol. 2019;99:104341. doi: 10.1016/j.oraloncology.2019.06.022. [DOI] [PubMed] [Google Scholar]
  • 25.Swartz J.E., Pothen A.J., Wegner I., Smid E.J., Swart K.M., de Bree R., Leenen L.P., Grolman W. Feasibility of using head and neck CT imaging to assess skeletal muscle mass in head and neck cancer patients. Oral Oncol. 2016;62:28–33. doi: 10.1016/j.oraloncology.2016.09.006. [DOI] [PubMed] [Google Scholar]
  • 26.Williams B.A., Mandrekar J.N., Mandrekar S.J., Cha S.S., Furth A.F. Finding Optimal Cutpoints for Continuous Covariates with Binary and Time-to-Event Outcomes. Division of Biostatistics, Mayo Clinic; Rochester, MN, USA: 2006. [Google Scholar]
  • 27.Brown J.C., Caan B.J., Meyerhardt J.A., Weltzien E., Xiao J., Feliciano E.M.C., Kroenke C.H., Castillo A., Kwan M.L., Prado C.M. The deterioration of muscle mass and radiodensity is prognostic of poor survival in stage I-III colorectal cancer: A population-based cohort study (C-SCANS) J. Cachexia Sarcopenia Muscle. 2018;9:664–672. doi: 10.1002/jcsm.12305. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Feliciano E.M.C., Kroenke C.H., Meyerhardt J.A., Prado C.M., Bradshaw P.T., Kwan M.L., Xiao J., Alexeeff S., Corley D., Weltzien E., et al. Association of Systemic Inflammation and Sarcopenia With Survival in Nonmetastatic Colorectal Cancer Results From the C SCANS Study Supplemental content. JAMA Oncol. 2017;3:172319. doi: 10.1001/jamaoncol.2017.2319. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Cole C.L., Kleckner I.R., Jatoi A., Schwarz E., Dunne R.F. The Role of Systemic Inflammation in Cancer-Associated Muscle Wasting and Rationale for Exercise as a Therapeutic Intervention. JCSM Clin. Rep. 2018;3 doi: 10.17987/jcsm-cr.v3i2.65. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Prado C.M., Lieffers J.R., McCargar L.J., Reiman T., Sawyer M.B., Martin L., Baracos V.E. Prevalence and clinical implications of sarcopenic obesity in patients with solid tumours of the respiratory and gastrointestinal tracts: A population-based study. Lancet Oncol. 2008;9:629–635. doi: 10.1016/S1470-2045(08)70153-0. [DOI] [PubMed] [Google Scholar]
  • 31.Faithfull S., Turner L., Poole K., Joy M., Manders R., Weprin J., Winters-Stone K., Saxton J. Prehabilitation for adults diagnosed with cancer: A systematic review of long-term physical function, nutrition and patient-reported outcomes. Eur. J. Cancer Care. 2019;28 doi: 10.1111/ecc.13023. [DOI] [PubMed] [Google Scholar]
  • 32.Palma S., Hasenoehrl T., Jordakieva G., Ramazanova D., Crevenna R. High-intensity interval training in the prehabilitation of cancer patients—a systematic review and meta-analysis. Support. Care Cancer. 2021;29:1781–1794. doi: 10.1007/s00520-020-05834-x. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of Clinical Medicine are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES