Abstract
Background
The application and better understanding of traditional and new breast tumor biomarkers and prognostic factors are increasing due to the fact that they are able to identify individuals at high risk of breast cancer, who may benefit from preventive interventions. Also, biomarkers can make possible for physicians to design an individualized treatment for each patient. Previous studies showed that trace elements (TEs) determined by X-Ray Fluorescence (XRF) techniques are found in significantly higher concentrations in neoplastic breast tissues (malignant and benign) when compared with normal tissues. The aim of this work was to evaluate the potential of TEs, determined by the use of the Energy Dispersive X-Ray Fluorescence (EDXRF) technique, as biomarkers and prognostic factors in breast cancer.
Methods
By using EDXRF, we determined Ca, Fe, Cu, and Zn trace elements concentrations in 106 samples of normal and breast cancer tissues. Cut-off values for each TE were determined through Receiver Operating Characteristic (ROC) analysis from the TEs distributions. These values were used to set the positive or negative expression. This expression was subsequently correlated with clinical prognostic factors through Fisher’s exact test and chi-square test. Kaplan Meier survival curves were also evaluated to assess the effect of the expression of TEs in the overall patient survival.
Results
Concentrations of TEs are higher in neoplastic tissues (malignant and benign) when compared with normal tissues. Results from ROC analysis showed that TEs can be considered a tumor biomarker because, after establishing a cut-off value, it was possible to classify different tissues as normal or neoplastic, as well as different types of cancer.
The expression of TEs was found statistically correlated with age and menstrual status. The survival curves estimated by the Kaplan-Meier method showed that patients with positive expression for Cu presented a poor overall survival (p < 0.001).
Conclusions
This study suggests that TEs expression has a great potential of application as a tumor biomarker, once it was revealed to be an effective tool to distinguish different types of breast tissues and to identify the difference between malignant and benign tumors. The expressions of all TEs were found statistically correlated with well-known prognostic factors for breast cancer. The element copper also showed statistical correlation with overall survival.
Background
Today, diagnosis and therapeutic approach for breast cancer is based on predictive and prognostic factors which are well-established for this disease. Prognostic factors such as tumor size, lymph nodal status, TNM staging information, histological grade and type, mitotic figure counts and hormone receptor status have proven to be of prognostic importance and useful in clinical patient management [1]. Other prognostic factors have been extensively studied biologically and clinically, but their importance remains to be validated in statistically robust studies, including c-erbB-2 (Her2-neu) [2], VEGF [3], p53 expression [4], among others [1]. The combination of two or more parameters in order to define the prognosis of the disease can be of considerable importance, since it makes it possible to define the risk and to indicate the potential value or not of a certain treatment [5].
Several prognostic and predictive factors can act as tumor biomarkers, depending on the given treatment. Biomarkers are any type of measurable element which is able to demonstrate the presence of malignancy or malignant potential, or to predict the behaviour of the tumor, the prognosis or the treatment response [6]. A better understanding and application of traditional tumor biomarkers and the identification of new markers is essential since they improve the patients quality of life by sparing them from going under toxic treatments that are unlikely to benefit them, and also by making it possible to establish an appropriate individualized treatment for each type of tumor, avoiding unnecessary treatment [5,6].
In recent years, the analysis of trace elements in human tissues has gained great interest due to the role that these elements play in biochemical and physiological processes. Although trace elements constitute a minor part of living tissues, they are important for vital processes [7]. Some metals, usually present in proteins, enzymes and cellular membranes, are essential for the normal physiological function [8-10]. However, when in abnormal expression, they seem to contribute in several pathological processes, including tumor growth, invasion and metastasis [11-13]. Individually, these elements seem to contribute to various pathological processes, although all the roles of these metals in carcinogenesis are still unknown [14-20]. Previous publications of our group highlighted the study of some elements, such as calcium, iron, copper and zinc, by determining the concentrations of these elements in breast tissue by X-Ray Fluorescence (XRF) techniques [7,21-23]. These studies showed, in agreement with others [7,21,22,24-30], that these trace elements are found in significantly higher concentrations in neoplastic breast tissues (malignant and benign) when compared to normal tissues.
X-Ray Fluorescence (XRF) is a representative multielement technique for the analysis of trace elements [7,21,22,28,30-43]. This technique is based on exciting the atoms in a material by applying an X-ray beam with appropriate energy and subsequent detection of the characteristic radiation emitted, which in turn is proportional to the concentration of atoms in the material [44]. XRF has many advantages, such as a simple and rapid procedure of analysis in a large number of samples, high sensitivity and low detection limits, enabling the determination of elements concentrations in trace and ultra-trace levels [45,46]. The XRF technique has some variations depending on, among others, excitation and detection setup [46]. Basically, if excitation is performed under small angles relative to the sample, the technique is called Total Reflection X-Ray Fluorescence (TXRF), if incident beam is too small (order of microns), the technique is called Micro-X Ray Fluorescence (μ-XRF). If detection is performed in terms of wavelength or energy of radiation, the technique is called Wavelength Dispersive X-Ray Fluorescence (WDXRF) or Energy Dispersive X-Ray Fluorescence (EDXRF), respectively [46].
Therefore, the aim of this study was to evaluate the potential of trace elements as biomarkers and evaluate their prognostic value through EDXRF. To our knowledge, this is the first study to evaluate the potential of trace elements determined by X-ray fluorescence techniques as biomarkers and prognostic factors in breast cancer.
Methods
Patients
A total of 81 patients with normal, malignant and benign breast tissues diagnosed between 2003 and 2006 were randomly chosen from the files of the Department of Pathology of Ribeirão Preto Medical School in the University of São Paulo, at the Ribeirão Preto General Teaching Hospital (HCFMRP/USP). Clinical data and important prognostic information, such as age, menstrual status, tumor size, histological grade, staging, lymph node involvement, estrogen and progesterone receptors and HER-2 status were obtained from 59 available medical records. The study was approved by the local ethics committee (Research Ethics Committee of HCRP and FMRP-USP - Process 4308/2009) and followed the ethical guidelines of 1975 Helsinki Declaration.
Breast tissue samples
Breast tissue samples were provided by the Department of Pathology at HCFMRP/USP. The collected material was residual tissue obtained from routine surgical procedures of mastectomy and mastoplasty. Pathological information was available for all samples. After surgery, samples were stored in formalin 10% until analysis. The patients were selected randomly to represent different aspects of breast tissues. The casuistic consisted of 38 samples of normal breast tissues (used as control group), 9 benign tumors (fibroadenoma) and 34 samples of malignant tumors (both in situ and infiltrating ductal carcinomas). In 25 of these 34 samples of malignant tumors, normal adjacent tissues were taken 2 cm away from tumors.
To perform XRF measurements, each sample was cut in 1 cm-thick and 1 cm-long sections, and placed in a specific sample holder, covered by Kapton® film, widely used in XRF experiments.
X-ray fluorescence measurements
Energy Dispersive X-Ray Fluorescence (EDXRF) experiments were performed at the Laboratory of Radiation Physics and Dosimetry, at the University of São Paulo (USP/Ribeirão Preto). A beam with energy of 17.44 keV emitted from an X-ray tube coupled with a graphite monochromator was used to excite simultaneously several trace elements in breast tissues. Samples were placed at a 45° angle to the incident beam in order to minimize attenuation effects [45]. For each sample, three datasets were collected from different regions of the sample to reduce the influence of a possible sample inhomogeneity. The acquisition time was fixed at 1000 s, maintaining the statistical uncertainty below 4%. Fluorescent signals emitted from trace elements were detected with a semiconductor detector Si(Li) (energy resolution of 165 eV at 5.89 keV), and placed at a 90° angle to the incident beam. Figure 1 shows a typical spectrum of EDXRF for a benign breast sample. One can observe the presence of several elements such as Ca, Fe, Cu and Zn. Trace elements concentrations were quantified by the external standard method associated with the scattered intensity method [7,45]. Detection limits were determined and the values range was between 0.2 mg.kg-1 (for heavier elements such as Zn) and 3.5 mg.kg−1 (for lighter elements such as Ca). A reference material (IAEA-V10) [47] with certified concentrations of several trace elements was used to test the method accuracy. Results revealed that differences between certified and obtained values were lower than 7% for all elements analyzed in the reference material, validating the quantification procedure.
Receiver operating characteristics (ROC) analysis
In order to obtain decision threshold values (cut-off values) for each trace element, ROC curve analysis was employed [48]. The gold standard was based on histological diagnosis made by an experienced breast pathologist (ARS). ROC curves were generated based on concentration data of two types of tissues at a time. Table 1 summarizes the groups of tissues analyzed.
Table 1.
Group analyzed | Tissue established as disease present | Tissue established as disease absent |
---|---|---|
Group 1 (paired samples) |
Malignant |
Normal Adjacent |
Group 2 |
Malignant |
Normal |
Group 3 |
Benign |
Normal |
Group 4 | Benign | Malignant |
The cut-off values for the concentration of trace elements chosen in this work corresponded to the point where the sensitivity and specificity were simultaneously higher [49,50]. Based on the cut-off value for each element, all trace elements concentration values were dichotomized in 0 or 1 (without or with tumor, respectively), transforming the distribution of the trace elements concentrations in a discrete variable (trace element expression).
Evaluation of trace elements as tumor biomarker
The area under the ROC curve summarizes the performance of the test and the higher the discriminatory ability of the test, the more the area under the curve approaches to 1 [48]. In this work, the accuracy was considered excellent when the area under the curve was equal to or greater than 0.8 [26,50].
Evaluation of trace elements as prognostic factors
Trace element expression (positive, 1, or negative, 0) was correlated with clinicopathological data using the Fisher’s exact test in the case of 2 variables and the chi-square test for three or more variables. The prognostic factors assessed were age, menstrual status, tumor size, histological grade, staging, lymph node involvement, estrogen and progesterone receptors, and also HER-2 status. The categorization of each prognostic factor was based on previous works described in the literature [51,52]. Correlation between trace elements and tumor size was performed only for malignant and benign breast tissues. Correlation between trace elements and histological grade, TNM staging, and lymph node status was conducted only for malignant tissues.
Survival curves
The survival curves estimated by the Kaplan-Meier method were applied to study the isolated effect of trace element expression on the prognosis and to describe the cumulative proportions of deaths (overall survival) of patients [53]. These curves were built based on the expression of trace elements as independent variables and overall survival as the dependent variable. The time of diagnosis was considered the initial date and the event or failure was considered the occurrence of death. In this study, all cases of death were due to the presence of breast cancer. The cases that were not followed up until death were censored according to the Kaplan-Meier method [54]. The results were then compared using the log-rank test in order to determine statistically significant differences between the obtained curves. Statistical significance was based on confidence intervals of 95%.
The statistical analyses of data were performed using the Software SPSS® 13.0.
Results and discussion
Patients
In a total of 81 patients, 46.9% were diagnosed with normal breast tissue, 41.9% with malignant tumor and 11.2% with benign tumor. All patients were women, with a mean age of 50 years (range, 17 to 88 years of age). The mean size of the tumors was of 3.6 cm (range, 0.5 to 15 cm). Clinical features obtained from available medical records are reported in Table 2, according to tissue type.
Table 2.
Normal tissues | Malignant tissues | Benign tissues | |
---|---|---|---|
Age (years) |
|
|
|
≤ 30 |
2 |
0 |
4 |
30–50 |
14 |
14 |
5 |
50–70 |
2 |
9 |
1 |
≥ 70 |
1 |
8 |
0 |
Menstrual status |
|
|
|
Premenopausal |
17 |
15 |
7 |
Postmenopausal |
2 |
16 |
3 |
Tumor size (cm) |
|
|
|
≤ 2 |
− |
4 |
1 |
2–5 |
− |
20 |
7 |
≥ 5 |
− |
7 |
1 |
Histologic Grading |
|
|
|
(Bloom and Richardson) |
|
|
|
G1 |
− |
6 |
− |
G 2 |
− |
12 |
− |
G 3 |
− |
8 |
− |
Pathologic staging |
|
|
|
I |
− |
0 |
− |
II |
− |
10 |
− |
III |
− |
9 |
− |
IV |
− |
1 |
− |
Lymph nodes |
|
|
|
Negative |
− |
11 |
− |
1–3 |
– |
4 |
– |
≥ 3 |
– |
15 |
– |
Death |
|
|
|
Yes |
0 |
10 |
0 |
No |
19 |
21 |
9 |
Estrogen receptor |
|
|
|
Negative |
– |
12 |
– |
Positive |
– |
21 |
– |
Progesterone receptor |
|
|
|
Negative |
– |
13 |
– |
Positive |
– |
20 |
– |
HER2 |
|
|
|
0 |
– |
12 |
– |
1+ |
– |
7 |
– |
2+ |
– |
8 |
– |
3+ | – | 6 | – |
Trace elements concentrations
Trace elements concentrations data, determined by EDXRF, based on descriptive parameters (range, median, lower quartile, and upper quartile) are shown in Table 3. From this table it is possible to note that trace elements distributions are large, a common feature in biological parameters [55]. These variations in concentration may result from several factors, such as differences in diet, age, genetics and especially due to different disease stages [7,34,56]. Data in Table 3 also show that concentrations of trace elements are higher in neoplastic tissues (malignant and benign) than in normal tissues. Although the role of trace elements has not yet been well established in literature, the increase in tumor tissues may be related to metabolic and structural aspects [17,29,57-60], which indicates its potential as a tumor biomarker.
Table 3.
Element | Normal | Normal Adjacent | Malignant | Benign |
---|---|---|---|---|
Calcium |
|
|
|
|
Mean |
130.7 |
283.1 |
668.9 |
1770.3 |
Median |
105.7 |
225.2 |
635.2 |
1320.3 |
Range |
16.1–483.2 |
19.6–722.8 |
62.7–3572.5 |
300.9–4040.8 |
1st and 3rd quartile |
68.9/186.6 |
154.5/342.0 |
271.0/793.8 |
795.5/2734.9 |
Iron |
|
|
|
|
Mean |
15.6 |
15.8 |
33.0 |
15.1 |
Median |
11.8 |
11.4 |
21.0 |
15.3 |
Range |
3.6–87.9 |
4.9–103.4 |
8.7–166.9 |
5.5–26.6 |
1st and 3rd quartile |
6.4/20.2 |
7.3/16.0 |
12.8/42.6 |
11.2/18.7 |
Copper |
|
|
|
|
Mean |
3.3 |
0.6 |
1.0 |
2.1 |
Median |
0.4 |
0.5 |
0.7 |
1.6 |
Range |
0.1–103.0 |
0.1–1.7 |
0.2–5.4 |
0.9–6.7 |
1st and 3rd quartile |
0.2/0.7 |
0.3/0.9 |
0.5/1.3 |
1.7/1.9 |
Zinc |
|
|
|
|
Mean |
2.1 |
2.8 |
7.1 |
12.2 |
Median |
1.5 |
2.3 |
6.6 |
11.1 |
Range |
0.1–9.7 |
0.3–8.8 |
1.6–30.0 |
4.5–21.1 |
1st and 3rd quartile | 0.4/3.2 | 1.7/3.5 | 3.9/8.4 | 6.9/15.5 |
First and third quartiles correspond to the 25th and 75th percentiles respectively. All values are in mg/kg.
Table 3 also shows that, except for Fe, all elements concentrations are higher in benign tumors than in malignant tumors. This finding is in agreement with other authors [7,21,27,30,33,34] and may be associated with structural [59,61,62] and metabolic aspects [18,19,63-67] as well as tumor development [68,69].
Cut-off determination
Figure 2 shows the ROC curves obtained for all elements studied in this work, comparing different types of tissues. In the same way that areas under the ROC curves provided a measure of accuracy of the test (diagnostic), the coordinates of sensitivity and specificity are also important because they provide information to assist in the decision of the cut-off value used to determine the outcome of the trial. Table 4 describes the sensitivity and specificity associated with the cut-off value chosen, as well as the values of the areas under the curves and the asymptotic significance in area determination. The cut-off limits were selected based on the highest sum of sensitivity and specificity [49].
Table 4.
Group 1: Malignant (1) and normal adjacent tissues (0)-paired samples | |||||
---|---|---|---|---|---|
Element |
Best cut-off (mg.kg-1) |
Sensitivity (%) |
Specificity (%) |
Area under ROC curve |
p |
Ca |
580.9 |
55.2 |
93.1 |
0.757 |
0.001 |
Fe* |
19.3 |
69.0 |
93.1 |
0.837 |
<0.001 |
Cu |
1.0 |
55.2 |
82.8 |
0.740 |
0.002 |
Zn* |
4.0 |
72.4 |
82.8 |
0.824 |
<0.001 |
Group 2: Malignant (1) and normal tissues (0) | |||||
Ca* |
212.6 |
70.7 |
86.4 |
0.838 |
<0.001 |
Fe |
12.6 |
78.0 |
63.6 |
0.743 |
<0.001 |
Cu |
0.8 |
53.7 |
81.8 |
0.707 |
0.001 |
Zn* |
3.4 |
75.6 |
86.4 |
0.874 |
<0.001 |
Group 3: Benign (1) and normal tissues (0) | |||||
Ca* |
288.8 |
100.0 |
93.2 |
0.992 |
<0.001 |
Fe |
12.8 |
66.7 |
63.6 |
0.616 |
0.276 |
Cu* |
0.9 |
100.0 |
86.3 |
0.947 |
<0.001 |
Zn* |
4.4 |
100.0 |
93.1 |
0.985 |
<0.001 |
Group 4: Benign (1) and malignant tissues (0)/Δ Benign (0) and malignant tissues(1) | |||||
Ca* |
794.6 |
77.8 |
80.5 |
0.816 |
0.003 |
Fe Δ |
20.7 |
48.7 |
88.8 |
0.675 |
0.103 |
Cu* |
0.9 |
100.0 |
56.1 |
0.808 |
0.004 |
Zn | 4.4 | 100.0 | 46.3 | 0.759 | 0.016 |
The values 1 and 0 used in graphs construction represent tissues considered with presence and absence of disease, respectively. Elements highlight by * show area under the ROC curve higher than 0.8.
Trace elements as tumor biomarkers and prognostic factors
From Table 4 it is possible to observe that for each test, some elements (highlight by *) show the area under the ROC curve higher than 0.8. Concentrations distribution of these elements and respective cut-off values are shown in Figure 3 through box plot graphs, which makes it possible to represent the distribution of concentrations of trace elements based on descriptive parameters such as range, median and quartile range [70]. From Figure 3 (a) it is possible to identify that the cut-off values for the elements Fe and Zn are used to classify normal adjacent and malignant tissues with high sensitivity and specificity (values on Table 4). Figures 3(b)3(c) and 3(d) illustrate the distributions of concentrations and their respective cut-off values for other trace elements which made it possible to classify other groups of breast tissues. It is also observed in Table 4 that all trace elements may be considered as tumor biomarkers once they show areas under ROC curve near 0.8. However, these elements could distinguish breast tumors with a lower accuracy.
The assigned value to each variable (0 or 1), based on the cut-off value, allowed us to assess the expression of trace elements, and correlate them with clinicopathological data, with the results shown in Table 5. In this table, it is possible to note that the expression of all trace elements is correlated with the type of tissue. These findings emphasize that there is a possibility of using these elements as tumor biomarkers.
Table 5.
|
Calcium status |
Iron status |
Copper status |
Zinc status |
||||
---|---|---|---|---|---|---|---|---|
− | + | − | + | − | + | − | + | |
Breast Tissue |
|
|
|
|
|
|
|
|
Normal |
33 |
5 |
22 |
16 |
29 |
9 |
31 |
7 |
Malignant |
7 |
27 |
6 |
28 |
17 |
17 |
7 |
27 |
Benign |
0 |
9 |
3 |
6 |
0 |
9 |
0 |
9 |
Normal Adjacent |
11 |
14 |
13 |
12 |
16 |
9 |
17 |
8 |
p |
<0.001 |
0.005 |
<0.001 |
<0.001 |
||||
Age (years) |
|
|
|
|
|
|
|
|
< 30 |
0 |
6 |
4 |
2 |
0 |
6 |
0 |
6 |
30–50 |
17 |
16 |
11 |
22 |
22 |
11 |
17 |
16 |
50–70 |
3 |
9 |
2 |
10 |
6 |
6 |
4 |
8 |
> 70 |
1 |
8 |
0 |
9 |
4 |
5 |
0 |
9 |
p |
0.019 |
0.028 |
0.023 |
0.007 |
||||
Menstrual status |
|
|
|
|
|
|
|
|
Premenopausal |
17 |
22 |
17 |
22 |
26 |
13 |
17 |
22 |
Postmenopausal |
4 |
17 |
0 |
21 |
6 |
15 |
4 |
17 |
p |
0.050 |
<0.001 |
0.005 |
0.05 |
||||
Death |
|
|
|
|
|
|
|
|
Yes |
17 |
33 |
17 |
33 |
30 |
20 |
19 |
31 |
No |
4 |
6 |
0 |
10 |
2 |
8 |
2 |
8 |
p |
0.490 |
0.025 |
0.024 |
0.239 |
||||
Tumor size (cm) |
|
|
|
|
|
|
|
|
≤ 2 |
1 |
4 |
1 |
4 |
2 |
3 |
1 |
4 |
2–5 |
5 |
22 |
5 |
22 |
10 |
17 |
5 |
22 |
≤ 5 |
1 |
7 |
2 |
6 |
4 |
4 |
1 |
7 |
p |
0.914 |
0.922 |
0.806 |
0.914 |
||||
Histologic Grading (Bloom and Richardson) |
|
|
|
|
|
|
|
|
G1 |
1 |
5 |
1 |
5 |
5 |
1 |
2 |
4 |
G 2 |
1 |
11 |
0 |
12 |
5 |
7 |
1 |
11 |
G 3 |
3 |
5 |
2 |
6 |
5 |
3 |
4 |
4 |
p |
0.264 |
0.208 |
0.228 |
0.111 |
||||
Pathologic staging |
|
|
|
|
|
|
|
|
II |
4 |
6 |
1 |
9 |
3 |
7 |
4 |
6 |
III |
3 |
6 |
2 |
7 |
3 |
6 |
2 |
7 |
IV |
0 |
1 |
0 |
1 |
0 |
1 |
1 |
0 |
p |
0.719 |
0.69 |
0.788 |
0.271 |
||||
Lymph nodes |
|
|
|
|
|
|
|
|
Negative |
2 |
9 |
2 |
9 |
8 |
3 |
2 |
9 |
1–3 |
0 |
4 |
0 |
4 |
2 |
2 |
0 |
4 |
≥ 3 |
5 |
10 |
3 |
12 |
6 |
9 |
5 |
10 |
p |
0.330 |
0.626 |
0.253 |
0.33 |
||||
Estrogen receptor |
|
|
|
|
|
|
|
|
Negative |
3 |
9 |
2 |
10 |
6 |
6 |
2 |
10 |
Positive |
5 |
16 |
3 |
18 |
12 |
9 |
6 |
15 |
p |
0.627 |
0.612 |
0.486 |
0.373 |
||||
Progesterone receptor |
|
|
|
|
|
|
|
|
Negative |
2 |
11 |
2 |
11 |
7 |
6 |
2 |
11 |
Positive |
6 |
14 |
3 |
17 |
11 |
9 |
6 |
14 |
p |
0.299 |
0.669 |
0.614 |
0.299 |
||||
HER2 |
|
|
|
|
|
|
|
|
score 0 |
3 |
9 |
3 |
9 |
10 |
2 |
5 |
7 |
score 1+ |
2 |
5 |
0 |
7 |
3 |
4 |
1 |
6 |
score 2+ |
1 |
7 |
0 |
8 |
2 |
6 |
1 |
7 |
score 3+ |
2 |
4 |
2 |
4 |
3 |
3 |
1 |
5 |
p | 0.814 | 0.163 | 0.064 | 0.369 |
(−) and (+) represents negative and positive expression respectively. The values of significance for Fisher and chi-square tests are represented by p.
Table 5 also shows that the trace elements expression is statistically correlated with age and menstrual status. Regarding the menstrual status of the patients, our results indicate that most post-menopause women have a positive correlation with the expression of trace elements. There were no statistically significant correlations for the other factors evaluated. However, the number of patients in each group of prognostic factors may have been too small to detect a statistically significant correlation. Furthermore, since prognostic factors evaluated in Table 5 are independent [1,2,51,71-75], the correlation with the tissue type, age and menopausal status suggests that expression of trace elements may be considered a prognostic factor.
Survival curves estimated by the Kaplan-Meier method, used to examine the expression of trace elements as a function of overall survival of patients diagnosed with malignant tumors, and the values of the log-rank tests are presented in Figure 4. Figure 4 (a) shows that patients with positive expression for Cu presented a poor overall survival (p < 0.001). Indeed, studies report that copper has a crucial role in the angiogenic mechanism, and tumors that become angiogenic exhibit a high metastatic potential, a major cause of mortality in patients with breast cancer [18,76]. In addition, in order to confirm this hypothesis, it would be interesting in future studies to examine the presence of angiogenic vessels in these cases.
Even without showing statistically significant difference for the other elements, the graphs in Figures 4(b) and 4(c) indicate that the positive expression for Fe and Zn is associated with an increased risk of death. Data in Figure 4b show that there were no deaths among patients with negative expression for Fe, thus the overall survival did not need to be recalculated at any time and only censored data are presented.
Calcium (Figure 4 (d)) presents an opposite trend. This opposite association of calcium with poor survival can be associated with the presence of microcalcifications in tissue, once differences in the structures of microcalcifications may be inversely associated with the degree of malignancy [14,61,62].
The results of this work revealed that the concentrations of trace elements, determined by EDXRF, are important objects of study to be established as prognostic factors in the near future, since the larger the number of biomarkers, the higher the number of possible combinations that can help the physician to establish the appropriate therapy for each case, providing a more individualized therapeutic management and improving the selection of patients for adjuvant therapy.
Conclusions
In this work, Energy Dispersive X-Ray Fluorescence technique was employed to determine Ca, Fe, Cu, and Zn concentrations in normal and neoplastic breast tissues. Cut-off values, obtained by ROC analysis, allowed us to distinguish different types of breast tissues, including malignant and benign. In addition, the correlations between trace elements expression and tissue type suggest that trace elements can be used as tumor biomarkers.
The prognostic value of the trace elements was demonstrated through the correlation between their expression and parameters such as age and menstrual status. Moreover, patients with positive copper expression showed a poorer survival. The greater the number of prognostic factors, the greater the number of possible combinations that can help doctors identify patients with very aggressive tumors and institute appropriate therapy for each case. In addition, doctors may also consider the effectiveness of different treatment alternatives and the cost-benefit to the patient.
The results in this work suggest that the expression of trace elements is a clinically relevant potential tool that could be integrated in decision-making, making it possible to individualize the treatment and to develop target therapies based on trace elements expression.
Misc
Marina P Silva, Danilo F Soave, Alfredo Ribeiro-Silva and Martin E Poletti contributed equally to this work
Authors’ contributions
MEP coordinated the x-ray fluorescence measurements and the study design. MPS conducted the sample collection, the x-ray fluorescence measurements, the computations and the statistical analysis, the collection of patients’ clinical data and the manuscript drafting. DFS contributed with collection of patients’ clinical data. ARS contributed with study design, analysis and data interpretation. All authors read and approved the final manuscript.
Competing interests
The authors declare that they have no competing interests.
Contributor Information
Marina P Silva, Email: marinaness@yahoo.com.
Danilo F Soave, Email: dsoave@usp.br.
Alfredo Ribeiro-Silva, Email: arsilva@fmrp.usp.br.
Martin E Poletti, Email: poletti@ffclrp.usp.br.
Acknowledgements
Authors want to acknowledgement financial support from Brazilian agencies Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES), Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq) and Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP). Also, authors want acknowledgement to Jonas Rodrigues for technical help.
References
- Fitzgibbons PL, Page DL, Weaver D, Thor AD, Allred C, Clark GM, Ruby SC, O’Malley F, Sinpson LF, Connolly JL. et al. Prognostic factors in breast cancer-College of American Pathologists Consensus Statement 1999. Arch Pathol Lab Med. 2000;124(7):966–978. doi: 10.5858/2000-124-0966-PFIBC. [DOI] [PubMed] [Google Scholar]
- Slamon DJ, Clark GM, Wong SG, Levin WJ, Ullrich A, McGuire WL. Human-Breast Cancer-Correlation of Relapse and Survival with Amplification of the Her-2 Neu Oncogene. Science. 1987;235(4785):177–182. doi: 10.1126/science.3798106. [DOI] [PubMed] [Google Scholar]
- Gasparini G. Prognostic Value of Vascular Endothelial Growth Factor in Breast Cancer. Oncologist. 2000;5(suppl 1):37–44. doi: 10.1634/theoncologist.5-suppl_1-37. [DOI] [PubMed] [Google Scholar]
- Thor AD, Moore DH, Edgerton SM, Kawasaki ES, Reihsaus E, Lynch HT, Marcus JN, Schwartz L, Chen LC, Mayall BH. et al. Accumulation of P53 Tumor Suppressor Gene Protein-an Independent Marker of Prognosis in Breast Cancers. J Natl Cancer Inst. 1992;84(11):845–855. doi: 10.1093/jnci/84.11.845. [DOI] [PubMed] [Google Scholar]
- Dowsett M, Dunbier AK. Emerging Biomarkers and New Understanding of Traditional Markers in Personalized Therapy for Breast Cancer. Clin Cancer Res. 2008;14(24):8019–8026. doi: 10.1158/1078-0432.CCR-08-0974. [DOI] [PubMed] [Google Scholar]
- Hinestrosa MC, Dickersin K, Klein P, Mayer M, Noss K, Slamon D, Sledge G, Visco FM. Opinion-Shaping the future of biomarker research in breast cancer to ensure clinical relevance. Nat Rev Cancer. 2007;7(4):309–315. doi: 10.1038/nrc2113. [DOI] [PubMed] [Google Scholar]
- Silva MP, Tomal A, Perez CA, Ribeiro-Silva A, Poletti ME. Determination of Ca, Fe, Cu and Zn and their correlations in breast cancer and normal adjacent tissues. X-Ray Spectrom. 2009;38(2):103–111. doi: 10.1002/xrs.1126. [DOI] [Google Scholar]
- Rose J. Trace Elements in Health. Butterworth-Heinemann, London; 1983. [Google Scholar]
- Prasad AS, Oberleas D. Trace Elements in Human Health and Disease. Academic, New York; 1976. [Google Scholar]
- Prasad A. Trace Elements and iron in human metabolism. J. Wiley, New York; 1978. [Google Scholar]
- Sigel H. Metal Ions in Biological Systems: Carcinogenicity and Metal Ions. Marcel Dekker, Inc., New York; 1980. [Google Scholar]
- Santoliquido PM, Southwick HW, Olwin JH. Trace-Metal Levels in Cancer of Breast. Surg Gynecol Obstet. 1976;142(1):65–70. [PubMed] [Google Scholar]
- Rizk SL, Skypeck HH. Comparison between Concentrations of Trace-Elements in Normal and Neoplastic Human-Breast Tissue. Cancer Res. 1984;44(11):5390–5394. [PubMed] [Google Scholar]
- Morgan MP, Cooke MM, McCarthy GM. Microcalcifications associated with breast cancer: An epiphenomenon or biologically significant feature of selected tumors? J Mammary Gland Biol Neoplasia. 2005;10(2):181–187. doi: 10.1007/s10911-005-5400-6. [DOI] [PubMed] [Google Scholar]
- Morgan MP, Cooke MM, Christopherson PA, Westfall PR, McCarthy GM. Calcium hydroxyapatite promotes mitogenesis and matrix metalloproteinase expression in human breast cancer cell lines. Mol Carcinog. 2001;32(3):111–117. doi: 10.1002/mc.1070. [DOI] [PubMed] [Google Scholar]
- Weinberg ED. Iron and Neoplasia. Biological Trace Element Research. 1981;3(1):55–80. doi: 10.1007/BF02789123. [DOI] [PubMed] [Google Scholar]
- Konemann S, Bolling T, Matzkies F, Willich N, Kisters K, Micke O. Iron and iron-related parameters in oncology. Trace Elem Electrolytes. 2005;22(2):142–149. [Google Scholar]
- Nasulewiez A, Mazur A, Opolski A. Role of copper in tumour angiogenesis-clinical implications. J Trace Elem Med Biol. 2004;18(1):1–8. doi: 10.1016/j.jtemb.2004.02.004. [DOI] [PubMed] [Google Scholar]
- Kabat GC, Rohan TE. Does excess iron play a role in breast carcinogenesis? an unresolved hypothesis. Cancer Causes Control. 2007;18(10):1047–1053. doi: 10.1007/s10552-007-9058-9. [DOI] [PubMed] [Google Scholar]
- Toyokuni S. Iron-induced carcinogenesis: The role of redox regulation. Free Radic Biol Med. 1996;20(4):553–566. doi: 10.1016/0891-5849(95)02111-6. [DOI] [PubMed] [Google Scholar]
- da Silva MP, Zucchi O, Ribeiro-Silva A, Poletti ME. Discriminant analysis of trace elements in normal, benign and malignant breast tissues measured by total reflection X-ray fluorescence. Spectroc Acta Pt B-Atom Spectr. 2009;64(6):587–592. doi: 10.1016/j.sab.2009.05.026. [DOI] [Google Scholar]
- Poletti ME, Goncalves OD, Perez CA, Magalhaes SD. A preliminary study of the distribution of trace elements in healthy and neoplastic breast tissues with synchrotron radiation X-ray fluorescence. Radiat Phys Chem. 2004;71(3–4):975–976. [Google Scholar]
- Silva AR, Silva MP, Poletti ME. Benign and malignant breast tissue classification using trace elements concentration determined by X ray fluorescence. Histopathology. 2010;57:28–28. [Google Scholar]
- Al-Ebraheem A, Farquharson MJ, Ryan E. The evaluation of biologically important trace metals in liver, kidney and breast tissue. Appl Radiat Isot. 2009;67(3):470–474. doi: 10.1016/j.apradiso.2008.06.018. [DOI] [PubMed] [Google Scholar]
- Carvalho ML, Brito J, Barreiros MA. Study of trace element concentrations in human tissues by EDXRF spectrometry. X-Ray Spectrom. 1998;27(3):198–204. doi: 10.1002/(SICI)1097-4539(199805/06)27:3<198::AID-XRS265>3.0.CO;2-B. [DOI] [Google Scholar]
- Farquharson MJ, Al-Ebraheem A, Theodorakou C, Ryan E, Bradley DA, Gurusamy K, Davidson B. Measurement of K, Fe, Cu and Zn levels in secondary colorectal liver cancer and surrounding normal liver tissue, and their potential as a tissue classifier. X-Ray Spectrom. 2009;38(2):81–88. doi: 10.1002/xrs.1121. [DOI] [Google Scholar]
- Geraki K, Farquharson MJ, Bradley DA. X-ray fluorescence and energy dispersive x-ray diffraction for the quantification of elemental concentrations in breast tissue. Phys Med Biol. 2004;49(1):99–110. doi: 10.1088/0031-9155/49/1/007. [DOI] [PubMed] [Google Scholar]
- Magalhaes T, Becker M, Carvalho ML, von Bohlen A. 12th International Conference on Total Reflection X-Ray Fluorescence Analysis and Related Methods: Jun 18–22 2007. Pergamon-Elsevier Science Ltd, Trento, ITALY; 2007. Study of Br, Zn, Cu and Fe concentrations in healthy and cancer breast tissues by TXRF; pp. 1473–1479. [Google Scholar]
- Raju GJN, Sarita P, Kumar MR, Murty G, Reddy BS, Lakshminarayana S, Vijayan V, Lakshmi P, Gavarasana S, Reddy SB. Trace elemental correlation study in malignant and normal breast tissue by PIXE technique. Nuclear Instruments & Methods in Physics Research Section B-Beam Interactions with Materials and Atoms. 2006;247(2):361–367. doi: 10.1016/j.nimb.2006.02.007. [DOI] [Google Scholar]
- Siddiqui MKJ, Jyoti, Singh S, Mehrotra PK, Singh K, Sarangi R. Comparison of some trace elements concentration in blood, tumor free breast and tumor tissues of women with benign and malignant breast lesions: An Indian study. Environment International. 2006;32(5):630–637. doi: 10.1016/j.envint.2006.02.002. [DOI] [PubMed] [Google Scholar]
- Carvalho ML, Magalhaes T, Becker M, von Bohlen A. Trace elements in human cancerous and healthy tissues: A comparative study by EDXRF, TXRF, synchrotron radiation and PIXE. Spectroc Acta Pt B-Atom Spectr. 2007;62:1004–1011. doi: 10.1016/j.sab.2007.03.030. [DOI] [Google Scholar]
- Ebrahim AM, Eltayeb MAH, Shaat MK, Mohmed MA, Eltayeb EA, Ahmed AY. Study of selected trace elements in cancerous and non-cancerous human breast tissues from Sudanese subjects using instrumental neutron activation analysis. Sci Total Environ. 2007;383:52–58. doi: 10.1016/j.scitotenv.2007.04.047. [DOI] [PubMed] [Google Scholar]
- Geraki K, Farquharson MJ, Bradley DA. Concentrations of Fe, Cu and Zn in breast tissue: a synchrotron XRF study. Phys Med Biol. 2002;47(13):2327–2339. doi: 10.1088/0031-9155/47/13/310. [DOI] [PubMed] [Google Scholar]
- Majewska U, Banas D, Braziewicz J, Gozdz S, Kubala-Kukus A, Kucharzewski M. Trace element concentration distributions in breast, lung and colon tissues. Phys Med Biol. 2007;52(13):3895–3911. doi: 10.1088/0031-9155/52/13/016. [DOI] [PubMed] [Google Scholar]
- Millos J, Costas-Rodriguez M, Lavilla I, Bendicho C. Multielemental determination in breast cancerous and non-cancerous biopsies by inductively coupled plasma-mass spectrometry following small volume microwave-assisted digestion. Anal Chim Acta. 2008;622(1–2):77–84. doi: 10.1016/j.aca.2008.05.066. [DOI] [PubMed] [Google Scholar]
- Garg AN, Singh V, Weginwar RG, Sagdeo VN. An Elemental Correlation Study in Cancerous and Normal Breast-Tissue with Successive Clinical Stages by Neutron-Activation Analysis. Biological Trace Element Research. 1994;46(3):185–202. doi: 10.1007/BF02789296. [DOI] [PubMed] [Google Scholar]
- Poletti ME, Goncalves OD, Mazzaro I. Measurements of X-ray scatter signatures for some tissue-equivalent materials. Nuclear Instruments & Methods in Physics Research Section B-Beam Interactions with Materials and Atoms. 2004;213:595–598. [Google Scholar]
- Szoboszlai N, Polgari Z, Mihucz VG, Zaray G. Recent trends in total reflection X-ray fluorescence spectrometry for biological applications. Anal Chim Acta. 2009;633(1):1–18. doi: 10.1016/j.aca.2008.11.009. [DOI] [PubMed] [Google Scholar]
- Streli C. Recent advances in TXRF. Appl Spectrosc Rev. 2006;41(5):473–489. doi: 10.1080/10543400600809318. [DOI] [Google Scholar]
- Klockenkamper R, Vonbohlen A. Total Reflection X-Ray-Fluorescence-an Efficient Method for Microanalysis, Trace and Surface-Layer Analysis. J Anal At Spectrom. 1992;7(2):273–279. doi: 10.1039/ja9920700273. [DOI] [Google Scholar]
- Zucchi O, Dias AD, Nascimento VF, Salvador MJ. Characterization of two medicinal plants by X-ray spectrometry. Journal of Trace and Microprobe Techniques. 2000;18(3):441–450. [Google Scholar]
- Farquharson MJ, Geraki K, Falkenberg G, Leek R, Harris A. The localisation and micro-mapping of copper and other trace elements in breast tumours using a synchrotron micro-XRF system. Appl Radiat Isot. 2007;65(2):183–188. doi: 10.1016/j.apradiso.2006.08.013. [DOI] [PubMed] [Google Scholar]
- Barroso RC, Lopes RT, de Jesus EFO, Oliveira LF. X-ray diffraction microtomography using synchrotron radiation. Nuclear Instruments & Methods in Physics Research Section a-Accelerators Spectrometers Detectors and Associated Equipment. 2001;471(1–2):75–79. [Google Scholar]
- Janssens K. X-ray based methods of analysis. Non-Destructive Micro Analysis of Cultural Heritage Materials. 2004;42:129–226. [Google Scholar]
- Tertian R, Claisse M. Principles of quantitative x-ray fluorescence analysis. Ed. Heyden, London; 1982. [Google Scholar]
- Potts PJ, Ellis AT, Kregsamer P, Streli C, Vanhoof C, West M, Wobrauschek P. Atomic spectrometry update-X-ray fluorescence spectrometry. J Anal At Spectrom. 2006;21(10):1076–1107. doi: 10.1039/b611269m. [DOI] [Google Scholar]
- Pszonicki L. Hanna AN: Report on the Intercomparison V-10 of the Determination of Trace Elements in Hay Powder. IAEA, In. Vienna; 1985. [Google Scholar]
- Fawcett T. An introduction to ROC analysis. Pattern Recognit Lett. 2006;27(8):861–874. doi: 10.1016/j.patrec.2005.10.010. [DOI] [Google Scholar]
- Rodrigues JA, Hug I, Diniz MB, Lussi A. Performance of fluorescence methods, radiographic examination and ICDAS II on occlusal surfaces in vitro. Caries Research. 2008;42(4):297–304. doi: 10.1159/000148162. [DOI] [PubMed] [Google Scholar]
- Obuchowski NA. Receiver operating characteristic curves and their use in radiology. Radiology. 2003;229(1):3–8. doi: 10.1148/radiol.2291010898. [DOI] [PubMed] [Google Scholar]
- Kroman N, Jensen MB, Wohlfahrt J, Mouridsen HT, Andersen PK, Melbye M. Factors influencing the effect of age on prognosis in breast cancer: population based study. Br Med J. 2000;320(7233):474–478. doi: 10.1136/bmj.320.7233.474. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ribeiro-Silva A, Garcia SB, Chahud F, Zucoloto S. Prognostic impact of BRCA1 immunohistochemistry expression in sporadic breast carcinomas. Jornal Brasileiro de Patologia e Medicina Laboratorial. 2005;41(3):197–203. [Google Scholar]
- Kaplan EL, Meier P. Nonparametric-Estimation from Incomplete Observations. J Am Stat Assoc. 1958;53(282):457–481. [Google Scholar]
- Bland JM, Altman DG. Statistics notes-Survival probabilities (the Kaplan-Meier method) Br Med J. 1998;317(7172):1572–1572. doi: 10.1136/bmj.317.7172.1572. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dawson-Saunders B, Trapp RG. Basic and clinical biostatistics. Appleton & Lange, Conneticut: Norwalk; 1994. [Google Scholar]
- Ng KH, Bradley DA, Looi LM. Elevated trace element concentrations in malignant breast tissues. Br J Radiol. 1997;70(832):375–382. doi: 10.1259/bjr.70.832.9166074. [DOI] [PubMed] [Google Scholar]
- Tapia L, Suazo M, Hodar C, Cambiazo V, Gonzalez M. Copper exposure modifies the content and distribution of trace metals in mammalian cultured cells. BioMetals. 2003;16(1):169–174. doi: 10.1023/A:1020766932605. [DOI] [PubMed] [Google Scholar]
- Le NTV, Richardson DR. The role of iron in cell cycle progression and the proliferation of neoplastic cells. Biochim Biophys Acta-Rev Cancer. 2002;1603(1):31–46. doi: 10.1016/s0304-419x(02)00068-9. [DOI] [PubMed] [Google Scholar]
- Frappart L, Boudeulle M, Boumendil J, Lin HC, Martinon I, Palayer C, Mallet-Guy Y, Raudrant D, Bremond A, Rochet Y. et al. Structure and composition of microcalcifications in benign and malignant lesions of the breast: Study by light microscopy, transmission and scanning electron microscopy, microprobe analysis, and X-ray diffraction. Hum Pathol. 1984;15(9):880–889. doi: 10.1016/S0046-8177(84)80150-1. [DOI] [PubMed] [Google Scholar]
- Brem SS, Zagzag D, Tsanaclis AMC, Gately S, Elkouby MP, Brien SE. Inhibition of Angiogenesis and Tumor-Growth in the Brain-Suppression of Endothelial-Cell Turnover by Penicillamine and the Depletion of Copper, an Angiogenic Cofactor. Am J Pathol. 1990;137(5):1121–1142. [PMC free article] [PubMed] [Google Scholar]
- Baker R, Rogers KD, Shepherd N, Stone N. New relationships between breast microcalcifications and cancer. Br J Cancer. 2010;103(7):1034–1039. doi: 10.1038/sj.bjc.6605873. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Haka AS, Shafer-Peltier KE, Fitzmaurice M, Crowe J, Dasari RR, Feld MS. Identifying microcalcifications in benign and malignant breast lesions by probing differences in their chemical composition using Raman spectroscopy. Cancer Res. 2002;62(18):5375–5380. [PubMed] [Google Scholar]
- La Rosa S, Sessa F, Colombo L, Tibiletti MG, Furlan D, Capella C. Expression of acidic fibroblast growth factor (aFGF) and fibroblast growth factor receptor 4 (FGFR4) in breast fibroadenomas. J Clin Pathol. 2001;54(1):37–41. doi: 10.1136/jcp.54.1.37. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lowndes SA, Harris AL. The role of copper in tumour angiogenesis. J Mammary Gland Biol Neoplasia. 2005;10(4):299–310. doi: 10.1007/s10911-006-9003-7. [DOI] [PubMed] [Google Scholar]
- Anandappa SY, Winstanley JHR, Leinster S, Green B, Rudland PS, Barraclough R. Comparative Expression of Fibroblast Growth-Factor Messenger-Rnas in Benign and Malignant Breast Disease. Br J Cancer. 1994;69(4):772–776. doi: 10.1038/bjc.1994.146. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Penaultllorca F, Bertucci F, Adelaide J, Parc P, Coulier F, Jacquemier J, Birnbaum D, Delapeyriere O. Expression of Fgf and Fgf Receptor Genes in Human Breast-Cancer. Int J Cancer. 1995;61(2):170–176. doi: 10.1002/ijc.2910610205. [DOI] [PubMed] [Google Scholar]
- Yoshimura N, Sano H, Hashiramoto A, Yamada R, Nakajima H, Kondo M, Oka T. The expression and localization of fibroblast growth factor-1 (FGF-1) and FGF receptor-1 (FGFR-1) in human breast cancer. Clin Immunol Immunopathol. 1998;89(1):28–34. doi: 10.1006/clin.1998.4551. [DOI] [PubMed] [Google Scholar]
- Nguyen M, Arkell J, Jackson CJ. Human endothelial gelatinases and angiogenesis. Int J Biochem Cell Biol. 2001;33(10):960–970. doi: 10.1016/S1357-2725(01)00007-3. [DOI] [PubMed] [Google Scholar]
- Solai F, Nardo T, Patrizi G, Annessi M, Santulli M, Amabile MI, Vasaturo F. Comparison of plasma matrix metalloproteases 2, 3, 9 in breast carcinomas and fibroadenomas. G Chir. 2010;31(8–9):365–367. [PubMed] [Google Scholar]
- Conover W. Practical Nonparametric Statistic. John Whiley & Sons, New York; 1980. [Google Scholar]
- Barnes DM, Harris WH, Smith P, Millis RR, Rubens RD. Immunohistochemical determination of oestrogen receptor: Comparison of different methods of assessment of staining and correlation with clinical outcome of breast cancer patients. Br J Cancer. 1996;74(9):1445–1451. doi: 10.1038/bjc.1996.563. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Finek J, Holubec L, Topolcan O, Elgrova L, Skalova A, Pecen L. The importance of prognostic factors in premenopausal women with breast cancer. Anticancer Research. 2007;27(4A):1893–1896. [PubMed] [Google Scholar]
- Henson DE, Ries L, Freedman LS, Carriaga M. Relationship among Outcome, Stage of Disease, and Histologic Grade for 22,616 Cases of Breast-Cancer-the Basis for a Prognostic Index. Cancer. 1991;68(10):2142–2149. doi: 10.1002/1097-0142(19911115)68:10<2142::AID-CNCR2820681010>3.0.CO;2-D. [DOI] [PubMed] [Google Scholar]
- Soerjomataram I, Louwman MWJ, Ribot JG, Roukema JA, Coebergh JWW. An overview of prognostic factors for long-term survivors of breast cancer. Breast Cancer Res Treat. 2008;107(3):309–330. doi: 10.1007/s10549-007-9556-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Veronesi U, Galimberti V, Zurrida S, Merson M, Greco M, Luini A. Prognostic significance of number and level of axillary node metastases in breast cancer. Breast. 1993;2(4):224–228. doi: 10.1016/0960-9776(93)90004-Y. [DOI] [Google Scholar]
- Pan Q, Kleer CG, van Golen KL, Irani J, Bottema KM, Bias C, De Carvalho M, Mesri EA, Robins DM, Dick RD. et al. Copper deficiency induced by tetrathiomolybdate suppresses tumor growth and angiogenesis. Cancer Res. 2002;62(17):4854–4859. [PubMed] [Google Scholar]