Abstract
Radiation therapy (RT) is used to treat approximately 50% of all cancer patients. However, RT causes a wide range of adverse late effects that can affect a patient’s quality of life. There are currently no predictive assays in clinical use to identify patients at risk of normal tissue radiation toxicity. This study aimed to investigate the potential of Fourier transform infrared (FTIR) spectroscopy for monitoring radiotherapeutic response. Blood plasma was acquired from 53 prostate cancer patients at five different time points: prior to treatment, after hormone treatment, at the end of radiotherapy, two months post radiotherapy and eight months post radiotherapy. FTIR spectra were recorded from plasma samples at all time points and the data was analysed using MATLAB software. Discrimination was observed between spectra recorded at baseline versus follow up time points, as well as between spectra from patients showing minimal and severe acute and late toxicity using principal component analysis. A partial least squares discriminant analysis model achieved sensitivity and specificity rates ranging from 80% to 99%. This technology may have potential to monitor radiotherapeutic response in prostate cancer patients using non-invasive blood plasma samples and could lead to individualised patient radiotherapy.
Keywords: radiotherapy, toxicity, prostate cancer, blood plasma, high throughput, Fourier transform infrared spectroscopy
1. Introduction
Prostate cancer is the second most frequently diagnosed cancer and the third most common cause of death from cancer in men [1]. Treatment options for prostate cancer are based on factors including the patient’s life expectancy, tumour characteristics including tumour stage, tumour aggressiveness and prostate specific antigen (PSA) level. Generally, low-risk prostate cancer patients are treated with radical prostatectomy, low-dose-rate brachytherapy and active surveillance, and high-risk prostate cancer patients are treated with a combination of hormone therapy and radiotherapy [2]. In the high-risk group of patients, combined treatment with hormone therapy and radiotherapy (RT) produces a therapeutic gain [3]. However, this combination of treatment also results in serious side effects which may affect the patient’s quality of life. These side effects include acute and late radiation toxicity. Acute side effects develop during the treatment phase and generally last for a few weeks after treatment is completed. Late side effects begin months to years after radiation therapy, are generally irreversible and can continue for several years after completion. Late toxicities of radiation treatment in prostate cancer patients include sexual dysfunction, persistent bowel problems (such as intermittent rectal bleeding, tenesmus and loose stools) and urinary obstructive symptoms [4]. The known causes of radiation toxicity include radiation dose, diabetes, concurrent chemotherapy and intrinsic radiosensitivity [5]. However, the radiation response varies from patient to patient, and to date no markers are in clinical use for the prediction of normal tissue toxicity or treatment outcome.
The development of predictive assays for normal tissue radiosensitivity has been a focus of research for several years and to date no assay has been translated into the clinical setting. In this study, radiosensitivity was not measured directly. Rather, the patient’s response to radiation treatment was measured, though these are related. The first gold-standard in vitro technique for measuring radiosensitivity was the clonogenic assay. The clonogenic assay determines the ability of a cell line to multiply indefinitely, in a way that retains its reproductive ability by forming a colony [6]. This assay is generally labour intensive and time consuming because the formation of colonies can take several weeks to months [7]. Streffer et al. developed a test for assessing radiosensitivity based on micronuclei formation after irradiation [8]. Micronuclei formation assays measure the ratio of the number of S phase cells to the total number of cells with micronuclei. The limitation of this assay is that the formation of micronuclei varies for different cell types due to the different tolerances for genetic loss [9]. The G2 chromosomal assay is one of the most used predictive cytogenetic based radiosensitivity assays. The assay is a positive predictor of radiosensitivity and corresponds well with cancer predisposition [10]. The G2 chromosomal radiosensitivity assay can be performed on patient blood samples and has been shown to be reliable for predicting patient radiosensitivity. This assay is relatively time consuming with some observer subjectivity. DNA damage assays have been used to predict radiosensitivity. The most commonly used DNA damage assay is the γH2AX foci assay which gives a quick read-out of DNA damage. Although Bourton et al. showed excellent potential for distinguishing patients with toxicity compared to normal patient reactions, the γH2AX assay was not sensitive enough to distinguish patients with extreme sensitivity or patients with a moderate severity of toxicity [11].
More recently, several radiogenomics studies have reported the development of radiotoxicity due to single nucleotide polymorphisms (SNPs) in candidate genes such as TGFB1, XRCC3, XRCC1, ATM [12] results which have been replicated in recent large-scale studies [13,14]. The preliminary results of genome wide association studies (GWAS) show evidence of an association between common genetic variants and a patient’s risk of developing radiation toxicity [15,16,17]. GWAS have successfully identified several common, modest risk variants for many widespread complex diseases [18,19,20,21,22] but have been unsuccessful for other phenotypes. The main limitations of genomic assays are their relatively high cost and that they are labour intensive.
The present study proposes a novel approach based on FTIR spectroscopy for the detection of radiation induced toxicity using liquid biopsies. FTIR spectroscopy is based on the interaction of infrared light with a molecular species, providing a non-destructive, label-free method for studying molecular composition and structure either in isolation or within complex biological systems such as cells, tissues and biofluids. FTIR spectroscopy has proved its potential to detect and classify various diseases and cancers including galactosemia [23], Alzheimer’s disease [24], hepatic fibrosis [25], ovarian cancer [26], gastrointestinal cancers [27] and breast cancer [28] using blood plasma and serum samples. Recently, FTIR spectroscopy has also been applied to radiobiological analysis. FTIR spectroscopy has been demonstrated to be sensitive to molecular events occurring in cells and tissue after exposure to ionising radiation. These applications include retrospective biological dosimetry [29], the analysis of both targeted and non-targeted effects of ionising radiation [30] and the prediction of DNA damage levels after in vitro irradiation [31].
In the present study, infrared spectra were acquired from plasma samples obtained from patients before radiotherapy (baseline) and at follow up. Changes in spectral profiles as a result of hormone treatment and radiotherapy in prostate cancer patients were investigated. Significant spectral differences were observed between the plasma samples of patients at baseline, post hormone therapy, post radiotherapy and at two and eight-month follow ups. Similarly, significant spectral differences were observed in the patients showing minimal and severe acute and late toxicity. The acquired infrared spectra were also analysed by principal component analysis (PCA) and partial least squares discriminant analysis (PLS-DA). The PLS-DA classifier was able to discriminate these patient groups with sensitivity and specificity rates ranging from 80% to 99%. This is the first study which explores the feasibility of FTIR spectroscopy for monitoring radiotherapeutic response in prostate cancer patients using minimally invasive blood plasma samples.
2. Results
2.1. Monitoring Treatment Progression
2.1.1. Changes in the Spectral Features with Patient Treatment Progression
Figure 1 shows the comparison of mean plasma spectra of different patient groups. To explain the differences between each group, difference spectra were computed by subtracting the mean spectra of plasma from the patients at different treatment time points from their mean spectra at baseline (Figure 2). Similarly, to explain the differences between the plasma from patients post hormone treatment and post radiotherapy, difference spectra were computed by subtracting the mean spectra of plasma from the patients at different time points post radiotherapy from their mean spectra post hormone treatment (Figure 3). Statistically significant differences (p < 0.001) were observed between the patient groups. Differences in the form of intensity related variations were observed across these mean spectra: in the regions around 1024 and 1050 cm−1 (C−O stretching and bending vibrations of glycogen) [32], 1070–1090 cm−1 (symmetric stretching of PO2−, nucleic acids, phospholipids and saccharides) [33], 1120–1170 cm−1 (stretching vibrations of (C−O) and ν(C−O−C) of carbohydrates) [23], 1230–1330 cm−1 (amide III) [34], 1400 cm−1 (stretching vibrations of COO−, amino acids) [23], 1450 cm−1 (CH2 scissoring, proteins) [33], 1545 cm−1 (amide II) [33], 1656 cm−1 (amide I) [33], 1740–1760 cm−1 (stretching vibrations of (C=O) of fatty acids, triglycerides and cholesterol esters) [33], 2800–2960 cm−1 (stretching vibrations of (CH2/CH3) of lipids, fatty acids, triglycerides and proteins) [33], 3300 cm−1 (amide A) [23], and 3400–3600 cm−1 (hydroxyl (OH) stretch of carboxylic acids) [35] between patients at baseline and patients at other treatment stages.
2.1.2. PCA
PCA was performed on second derivative mean spectra using the wavenumber range of 3500−1000 cm−1. For clarity, only the mean spectra are represented for each patient. PCA was carried out with 10 principal components (PCs) in which the first four PCs accounted for ∼80% of the total percentage. The first two PCs were used to visualise the classification between the groups (Figure 4A).
2.1.3. Classification of Plasma Spectra of Patients during Treatment with Respect to Baseline by PLS-DA
Classifications of plasma spectra from patients at baseline against various treatment stages were performed using PLS-DA to investigate whether the patient groups could be discriminated based on the observed spectral features. The classification sensitivities and specificities are provided in Table 1 and are calculated for the cross validated PLS-DA model. An example of the cross-validation performance of the PLS-DA model is shown in Figure 5.
Table 1.
Time Point | Number of Latent Variables (LVs) | Sensitivity | Specificity |
---|---|---|---|
Post hormone therapy | 10 | 78.7% | 80% |
Post radiotherapy | 11 | 89.3% | 89.1% |
2 months follow up | 10 | 91.4% | 91.5% |
8 months follow up | 13 | 98.4% | 99.1% |
2.2. Analysis of Patient Toxicity after Radiotherapy
2.2.1. Changes in the Spectral Features with the Onset of Acute and Late Toxicity
All patients suffered from either acute grade 1 (mild) or grade 2 or higher (severe) toxicities immediately following completion of radiotherapy. A grade 0 level to toxicity implies no toxicity. At eight months post radiotherapy toxicity in some patients was resolved, while in others late toxicity developed for the first time. Table 2 shows the number of prostate cancer patients showing acute toxicity immediately following completion of radiotherapy and late toxicity at eight months post radiotherapy.
Table 2.
Toxicity | Number of Patients |
---|---|
Acute grade 0−1 toxicity | 24 |
Acute grade 2+ toxicity | 19 |
Late grade 0−1 toxicity | 24 |
Late grade 2+ toxicity | 11 |
In this study, difference spectra between those measured pre-therapy at baseline and those measured immediately after completion of radiotherapy and at 8 months follow up from patients with grade 0−1 and grade 2+ acute and late toxicity were calculated to examine the changes in spectral features at various toxicity levels (Figure 6). Major changes were observed in the regions around 1020−1090 cm−1 (glycogen, nucleic acids), 1330−1430 cm−1 (amide III), 1545 cm−1 (amide II), 1656 cm−1 (amide I), 1740−1760 cm−1 (fatty acids, triglycerides and cholesterol esters), 2800−2950 cm−1 (lipids, triglycerides, fatty acids and proteins), 3300 cm−1 (amide A) and 3400−3600 cm−1 (OH stretch) between the plasma spectra from patients showing grade 0−1 and grade 2+ acute and late toxicity.
2.2.2. PCA
PCA was performed on second derivative mean spectra with the same conditions as mentioned earlier. Figure 7 shows the scatter plot and loading plot of the PCA classification of acute grade 0–1 and acute grade 2+ toxicity plasma spectra. Figure 8 shows the scatter plot and loading plot of the PCA classification of late grade 0–1 and late grade 2+ toxicity plasma spectra. In both cases, the first four PCs accounted for ∼93% of the total percentage variance and the first two PCs were used to visualise the classification between the groups.
2.2.3. PLS−DA
Classifications of plasma spectra from patients showing acute and late toxicity were performed to investigate if the two patient groups could be discriminated. PLS-DA models were developed as described earlier. The resulting sensitivities and specificities are provided in Table 3.
Table 3.
Patients | Number of LVs | Sensitivity | Specificity |
---|---|---|---|
Grade 0−1 vs Grade 2+ acute toxicity | 10 | 80.8% | 81.6% |
Grade 0−1 vs Grade 2+ late toxicity | 10 | 81.4% | 81.5% |
3. Discussion
In the first part of the study, FTIR spectra acquired from blood plasma samples from patients at baseline, post hormone, post radiotherapy and at follow up were used to monitor the changes with treatment progression (Figure 2). The following hormone therapy increases were observed in the regions around 1000−1090 cm−1, 1120−1170 cm−1, 1230−1330 cm−1, 1520 cm−1, 1590 cm−1, 1656 cm−1, 1740−1760 cm−1, 2800−2960 cm−1 and 3300 cm−1, and decreases were observed in the region around 3400−3600 cm−1 in the spectra of plasma. The increase in the regions around 1230−1330 cm−1, 1520 cm−1, 1590 cm−1, 1656 cm−1 and 3300 cm−1 suggests an increase in the protein levels after hormone therapy. The increased 1740−1760 cm−1 and 2800−2960 cm−1 regions indicate the elevated lipid profile after hormone therapy. The increase in lipid content can occur as a result of a decrease in testosterone levels after androgen deprivation therapy [36]. The increased levels of triglycerides and total cholesterol in the serum of prostate cancer patients after androgen deprivation therapy have been reported previously [37]. The increases in the regions around 1020−1090 cm−1 and 1120−1170 cm−1 are associated with saccharides and carbohydrates. Increased levels of HbAlc (hemoglobin bound to glucose) in blood has been previously observed in prostate cancer patients treated with androgen deprivation therapy [38].
The increase in protein and lipid content observed after hormone therapy resolved after the course of radiotherapy. Decreases in the regions from 1230−1330 cm−1, 1545 cm−1, 1656 cm−1, 1740−1760 cm −1, 2800−2960 cm−1 and 3300 cm−1 suggests a decrease in protein, lipid and fatty acid content. A decline in lipid concentration in the serum of prostate cancer patients after radiotherapy has been reported previously [39]. The increased vibrations in the 1000−1100 cm−1 region suggests an increase in glycogen and nucleic acids after radiotherapy. The increase in nucleic acids after radiotherapeutic treatment suggests an increase in the levels of circulating DNA. The elevated plasma levels of tumoural cell free DNA was observed in non-small cell lung cancer patients after radiotherapy [40]. The decreased OH stretch band (3400–3600 cm−1) observed after hormone therapy was increased after radiotherapy.
The decrease in fatty acid (1740–1760 cm−1) and lipid content (2800–2960 cm−1) observed after radiation therapy increased after two and eight months RT. Jelonek et al. [41] reported a significant decrease in serum lipids immediately after radiotherapy and then an increase in levels of lipids in serum samples at follow up. The decrease in the vibrations at 1230–1330 cm−1, 1545 cm−1, 1656 cm−1 and 3300 cm−1 and increase in the vibrations at 3400–3600 cm−1 at eight months post therapy are consistent with the changes observed immediately following radiotherapy. The decreased vibrations in the regions 1020–1090 cm−1 were also observed in the plasma spectra of patients at two and eight months post RT.
Similar spectral differences were observed when plasma from patients post hormone treatment and from patients post radiotherapy (Figure 3) were compared. However, decreases in glycogen, nucleic acid (1000–1100 cm−1) and lipid content (2800–2960 cm−1) were observed in the patients post radiotherapy and at follow up compared to the patients post hormone treatment.
The PCA analysis showed minimally overlapping clusters between the analysed groups (Figure 4A). PC-1 explains of 51.7% of total variance. The PC-1 loading plot shows positive bands at 1560 cm−1 and 1656 cm−1 and negative bands at 1747 cm−1, 2854 cm−1, 2873 cm−1, 2930 cm−1, 2960 cm−1 and 3013 cm−1. The positive bands in PC-1 are assigned to proteins and the negative bands are assigned to lipids, fatty acids and triglycerides. PC-2 explains 15.6% of total variance and the PC-2 loading plot shows positive bands related to proteins and lipids (1560 cm−1, 1634 cm−1, 1644 cm−1, 2851 cm−1 and 2870 cm−1) and negative bands related lipid and fatty acids (2946 cm−1). The PCA analysis confirms that protein, lipids, fatty acids and triglycerides are the main discriminating features in spectra from plasma of patients at baseline and those at follow up time points.
The optimised PLS-DA model was able to discriminate baseline/post hormone therapy, baseline/post radiotherapy, baseline/two months after RT and baseline/eight months after RT with sensitivity and specificity rates ranging from 80% to 99%. The classification rate increased with the progression of treatment (Table 1) and to explain this classification trend, prostate specific antigen (PSA) levels at baseline and at each treatment time point were compared (Table 4). The PSA levels decreased significantly after hormone therapy and a slight decrease in PSA level was observed after radiotherapy. The PSA levels at follow up were similar to those observed immediately after radiotherapy. Thus, the classification trend did not correlate with the observed PSA levels. The increase in the classification with treatment progression may be associated with the development of acute and late toxicity after radiotherapy.
Table 4.
Patients | PSA Level Mean (SD) |
---|---|
Baseline (n = 37) | 14.4 (13.9) ng/mL |
Post hormone (n = 36) | 0.72 (1.71) ng/mL |
Post radiotherapy (n = 43) | 0.08 (0.11) ng/mL |
2 months post RT (n = 37) | 0.07 (0.09) ng/mL |
8 months post RT (n = 35) | 0.09 (0.11) ng/mL |
In the second part of the study, FTIR spectra of plasma from prostate cancer patients suffering from acute and late toxicity after radiotherapy were used to monitor the changes with the progression of toxicity (Figure 6). For patients showing acute grade 0−1 toxicity, an increase in glycogen, nucleic acids (1020–1090 cm−1) and OH stretch (3400–3600 cm−1), and a decrease in amide III (1330–1430 cm−1), amide II (1545 cm−1), amide I (1656 cm−1), fatty acids/triglycerides (1740–1760 cm−1), amide A (3300 cm−1) and lipids/proteins (2800–2950 cm−1) were observed. Patients suffering with acute grade 2+ toxicity showed an increase in glycogen and nucleic acid bands (1020–1090 cm−1) compared to the patients suffering with acute grade 0−1 toxicity. Similar increases were also observed in patients with late grade 2+ toxicity compared to patients with late grade 0–1 toxicity. In both acute and late toxicity, a decrease in protein bands (1330–1430 cm−1, 1545 cm−1, 1656 cm−1 and 3300 cm−1) and an increase in the OH stretch band was observed. The decrease in the protein content might be due to the oxidation of proteins after RT. Oxidation of protein induced by free radicals produced by RT is a major cause of healthy tissue damage [42]. In patients showing late grade 0−1 and grade 2+ toxicity, an increase in fatty acids/triglycerides (1740–1760 cm−1) and lipids (2800–2960 cm−1) was observed compared to patients showing acute toxicity and this increase was significant in patients showing late grade 2+ toxicity. This may suggest that an increase in lipids and fatty acids/triglycerides contributes to the development of late toxicity. An association between alterations in the serum lipidome and the development of treatment toxicity has been previously observed [41].
The PCA analysis showed clear discrimination between the plasma spectra from patients showing acute grade 0–1 and grade 2+ toxicity (Figure 7A). PC-1 and PC-2 explain 70.2% and 14.7% of the total variance respectively. PC-1 showed positive bands at 1040 cm−1, 1067 cm−1, 1090 cm−1, 1120 cm−1, 1640 cm−1, 1691 cm−1, 2853 cm−1, 2874 cm−1 and 2963 cm−1, and a negative band at 1659 cm−1. PC-2 showed positive bands at 1040 cm−1, 1067 cm−1, 1090 cm−1, 1120 cm−1, 1418 cm−1, 1656 cm−1, 1736 cm−1, 2853 cm−1 and 2926 cm−1, and a negative band at 1632 cm−1. The loading plot reveals that the prominent discriminating features between the plasma spectra from patients showing acute grade 0–1 and grade 2+ toxicity are associated with saccharides, DNA, RNA (1040 cm−1, 1067 cm−1, 1090 cm−1 and 1123 cm−1), amide I (1640 cm−1, 1656 cm−1 and 1691 cm−1), fatty acids, triglycerides and lipids (1736 cm−1, 2874 cm−1, 2853 cm−1, 2926 cm−1 and 2963 cm−1).
The PCA analysis showed minimally overlapped clusters between the plasma spectra from patients showing late grade 0−1 and late grade 2+ toxicity (Figure 8A). PC-1 explains 65% of total variance and showed positive bands at 1032 cm−1, 1080 cm−1, 1516 cm−1, 1632m−1, 1747 cm−1, 2853 cm−1, 2874 cm−1 and 2963 cm−1, and negative bands at 1545 cm−1 and 1655 cm−1. PC-2 explains 16% of total variance and showed positive bands at 1042 cm−1, 1067 cm−1, 1090 cm−1, 1123m−1, 1640 cm−1, 2855 cm−1 and 2926 cm−1, and negative bands at 1516 cm−1, 1550 cm−1 and 1624 cm−1. The loading plot reveals that the major discriminating features between the plasma spectra from patients showing late grade 0−1 and grade 2+ toxicity includes the vibrations of saccharides, DNA, RNA (1032 cm−1, 1067 cm−1, 1080 cm−1, 1090 cm−1 and 1123 cm−1), amide I (1624 cm−1, 1632 cm−1, 1640 cm−1 and 1655 cm−1), amide II (1516 cm−1, 1545 cm−1 and 1550 cm−1), fatty acids, triglycerides and lipids (1747 cm−1, 2855 cm−1, 2874 cm−1, 2926 cm−1 and 2963 cm−1).
The PLS-DA model classified plasma spectra from patients showing grade 0–1 and grade 2+ acute toxicity with a sensitivity and specificity of 80.8% and 81.6%, respectively. The model classified plasma spectra from patients showing grade 0–1 and grade 2+ late toxicity with a sensitivity and specificity of 81.4% and 81.5%, respectively.
However, it is acknowledged that this is a small study cohort and a larger sample size would be required to validate the findings. In addition, all patients in the study received hormone therapy and there was no radiotherapy alone group. Although our study focused on gastrointestinal (GI) and genitourinary (GU) toxicity and did not include specific hormonal toxicities, further work should include patients treated with radiotherapy only. Future work should also involve biological assays showing protein, lipid, fatty acid and circulating DNA levels to corroborate these findings.
4. Materials and Methods
4.1. Ethical Approval
Blood samples were obtained from prostate cancer patients enrolled in a trial detailed in the section following.
The translational research study was approved by the St Luke’s Radiation Oncology Network Research Ethics Committee and all research was performed in accordance with relevant guidelines and regulations. Informed consent was obtained from all participants. Fresh whole blood was drawn into Li-heparin tubes at St. Luke‘s Radiation Oncology Network, St. Luke’s Hospital (SLRON SLH), in Dublin, and were coded before being transferred to the Technological University (TU) Dublin laboratory.
4.2. Patients
The prostate cancer patients for this study were recruited from the Cancer Trials Ireland (formerly All Ireland Cooperative Oncology Research Group, ICORG) trial 08−17 which is entitled “A Prospective Phase II Dose Escalation Study Using intensity modulated radiotherapy (IMRT) for High Risk N0 M0 Prostate Cancer (NCT00951535)”. The primary endpoint is to determine if dose escalation up to 81 Gy using IMRT for high risk localised prostate cancer can provide prostate specific antigen (PSA) relapse-free survival similar to that previously reported [43]. All patients were prescribed either six months or three years of neo-adjuvant/adjuvant hormone therapy using non−steroidal anti androgens (NSAA) and luteinizing hormone releasing hormone (LHRH). After the neoadjuvant hormone therapy, patients were treated with radiation therapy, where dose escalation was allowed up to a maximum of 81 Gy from a baseline 75.6 Gy, with treatment delivered by intensity modulated radiotherapy. PSA levels and gastrointestinal and genitourinary (GI/GU) toxicities were recorded prior to treatment, during treatment and at follow up using the National Cancer Institute Common Terminology Criteria for Adverse Events (NCI−CTCAE) grading system, version 3. Patients are followed up regularly at two months post radiation therapy (RT), eight months post RT, six-monthly thereafter until Year 5, and annually thereafter until Year 9. For this translational study, a total of 53 prostate cancer patients were enrolled and of these patients, plasma samples were collected from patients at baseline (n = 37), post hormone therapy (n = 36), post radiotherapy (n = 43), two months after RT (n = 37) and eight months after RT (n = 35). A summary of clinical features of the prostate cancer patients is given in Table 5.
Table 5.
Age (years) | |
Mean | 69.26 |
Median | 70.5 |
Range | 57−85 |
PSA (ng/mL) | |
Mean | 17.22 |
Median | 9.4 |
T Stage | |
T2a to T2c | 11 (25%) |
T3a | 23 (53%) |
T3b | 08 (18%) |
T4a | 01 (2%) |
Gleason score | |
7 | 14 (33%) |
8 | 16 (37%) |
9 | 13 (30%) |
Planned duration of hormones | |
6 months | 05 (12%) |
36 months | 38 (88%) |
RT Dose/fractions | |
81.0/45 | 43 (100%) |
4.3. Plasma Separation
Whole blood was drawn into Lithium−heparin tubes. Plasma was isolated from these blood samples by centrifugation at 3600 g for 5 min at 18 °C. The samples were subsequently stored at −80 °C prior to FTIR acquisition.
4.4. FTIR Spectroscopy
Plasma samples stored at −80° C were thawed at room temperature and were diluted threefold in physiological water. A volume of 4 μL diluted plasma sample was deposited on a 384−well silicon plate (Bruker Optics GmbH, Ettlingen, Germany), and air-dried at room temperature. For each sample, 10 spots were used giving 10 instrumental replicates. The plate was then inserted into a high-throughput module (HTS−XT, Bruker Optics GmbH) attached to an FTIR spectrometer (Tensor 27, Bruker Optics GmbH). FTIR spectra were acquired in the transmission mode using the OPUS v6.5 software (Bruker Optics GmbH) in the wavenumber range from 4000 to 400 cm−1, using a spectral resolution of 4 cm−1 and 32 co-additions. FTIR spectra were then subjected to a quality test (OPUS v6.5) and details of this test are fully described in reference [23,44]. Spectra that passed the quality test were pre-processed and processed in the wavenumber range from 800 to 4000 cm−1. A summary of the high throughput (HT)-FTIR methodology for analysis of blood plasma samples is presented in Figure 9.
4.5. Data Analysis
4.5.1. Pre-Processing
Pre-processing of raw spectra is important to enhance the accuracy and stability of spectra for later analysis [45]. Pre-processing includes baseline correction, calculation of second derivative spectra and vector normalisation. Baseline correction was performed using the rubberband baseline subtraction [46]. Second derivative spectra were calculated using the Savitzky–Golay algorithm [47] and a window length of night points. Second derivative spectra allow more distinct identification of small and adjacent lying absorption peaks which are not clearly discernable in the original spectrum. Prior to analysis, all spectra were standardized using vector normalization.
4.5.2. PCA
PCA is a form of unsupervised multivariate analysis, which has become a standard processing technique for Raman and FTIR spectral data. Mainly, PCA is a feature selection process that enables the user to identify variances in the data set that may be used to classify objects into certain groups. PCA explains the variance in the data by finding combinations of the original dimensions that describe the largest variance between the data sets where the output is in the form of a complementary set of scores and loading plots termed principal components (PCs) [48]. PCA is performed by subtracting the mean of the data set to obtain a mean centered matrix, calculating the covariance matrix and then the eigenvectors and eigenvalues of the covariance matrix. The eigenvector with the largest eigenvalue describes the largest source of variance across all the spectra. The eigenvector with the largest source of variance is also called the first principal component [49]. The second principal component is the eigenvector with the next largest eigenvalue and describes the second largest source of variance. The results are presented using the scores of the most explained PCs. Since PCA is a tool for data visualisation and trends, subsequent PLS-DA was also carried out for classification of plasma spectra of different patient groups.
4.5.3. PLS-DA
PLS-DA is one of the generally applied classification technique in chemometrics [50]. PLS-DA is a discriminant analysis approach derived from partial least squares regression [51] and involves the production of regression model between the data matrix and the discrete spectral class [50]. The aim of PLS-DA is to achieve maximum covariance between the predictor variables (i.e., FTIR spectra) and response variables (i.e., class label of corresponding spectra) of a multidimensional dataset by determining a feature subspace that differentiates the multidimensional feature space into two discrete regions, with as negligible an error as achievable. This new feature subspace enables the prediction of dependent variables using fewer factors referred to as latent variables (LVs) [52]. These factors explain the behavior of the response variables and populate the new feature subspace onto which the predictor variables are superimposed [52]. PLS-DA gives various statistics like loading weight and regression coefficient which can be employed for the identification of most important variables [53,54]. It also gives a visual interpretation of complicated datasets through an easily illustratable scores plot that explains the separation between different groups [55].
PLS-DA classification was applied on the pre-processed second derivative FTIR spectra of plasma collected from prostate cancer patient groups. To find the optimal number of LVs, PLS-DA was executed with a variable number of LVs, . For each LV(s), 20 rounds of PLS-DA cross validation were performed. The PLS-DA model at each round was built and trained using the spectra of 90% of patients, which were randomly selected from each patient group. The remaining spectra of 10% of the patients were used for validating the trained model. The sensitivities and specificities of each PLS-DA of LVs were then averaged through 20 rounds of PLS-DA applications.
5. Conclusions
This is the first biofluid based FTIR spectroscopy study that explores the discrimination between blood plasma at various radiotherapeutic treatment stages, as well as the discrimination between plasma spectra with treatment outcome, here measured as treatment toxicity. Spectral discrimination was demonstrated between infrared spectra of plasma samples from prostate cancer patients at each treatment stage and follow-up time point, as well as between spectra from patients showing both acute and late toxicity and toxicity grade. The PLS-DA model classified the patient groups with high sensitivity and specificity. Biofluid based FTIR spectroscopy is reagent free, label free, cost effective and rapid; this research has demonstrated that it may also provide a useful adjunct to radiotherapy treatment planning and monitoring within the clinical workflow.
Acknowledgments
The authors are very grateful to the patients who participated in the CT-IE 08−17 study and donated blood samples for this translational research study.
Author Contributions
F.M.L. and A.D.M. conceived and initiated the study. A.D.M. and G.D.S. designed the experiments. J.A. was Chief Investigator in the CTRIAL-IE (ICORG) 08−17 study. A.M.S., as sponsor representative for the CTRIAL-IE (ICORG) 08−17 study, provided 08−17 project management, protocol development and monitoring, patient information leaflet and CRF development, ethics application and amendments. E.N. and S.B. provided co-ordination of the trial according to the GCP guidelines. M.D. contributed to the statistical aspects of the design. J.A., M.D., M.F., E.N., S.B. acquired patient data. D.K.R.M., J.B. and D.C. collected and processed blood samples. D.K.R.M. and V.U. carried out the experiments and generated the results. D.K.R.M. and T.N.Q.N. analysed the data. D.K.R.M., A.D.M. and F.M.L. interpreted the results. D.K.R.M. wrote the manuscript with input from all co-authors. All authors approved the manuscript prior to submission.
Funding
This research was funded by an Irish Research Council Postgraduate Award, COST Action (BM1401) Short Term Scientific Mission Award, Irish Research Council Ulysses Award (Grant Number PJ29007), EU FP7 Network of Excellence DoReMi (Grant Number 249689) and Science Foundation Ireland (11/RFP.1/BMT/3317).
Conflicts of Interest
The authors declare no conflicts of interest.
References
- 1.Ferlay J., Soerjomataram I., Dikshit R., Eser S., Mathers C., Rebelo M., Parkin D.M., Forman D., Bray F. Cancer Incidence and Mortality Worldwide: Sources, Methods and Major Patterns in GLOBOCAN 2012. Int. J. Cancer. 2015;136:E359–E386. doi: 10.1002/ijc.29210. [DOI] [PubMed] [Google Scholar]
- 2.Keyes M., Crook J., Morton G., Vigneault E., Usmani N., Morris W.J. Treatment Options for Localized Prostate Cancer. Can. Fam. Physician. 2013;59:1269–1274. [PMC free article] [PubMed] [Google Scholar]
- 3.Milecki P., Martenka P., Antczak A., Kwias Z. Radiotherapy Combined with Hormonal Therapy in Prostate Cancer: The State of the Art. Cancer Manag. Res. 2010;2:243–253. doi: 10.2147/CMAR.S8912. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Chen R.C., Clark J.A., Talcott J.A. Individualizing Quality-of-Life Outcomes Reporting: How Localized Prostate Cancer Treatments Affect Patients with Different Levels of Baseline Urinary, Bowel, and Sexual Function. J. Clin. Oncol. 2009;27:3916–3922. doi: 10.1200/JCO.2008.18.6486. [DOI] [PubMed] [Google Scholar]
- 5.West C.M., Barnett G.C. Genetics and Genomics of Radiotherapy Toxicity: Towards Prediction. Genome Med. 2011 doi: 10.1186/gm268. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Franken N.A., Rodermond H.M., Stap J., Haveman J., van Bree C. Clonogenic Assay of Cells in Vitro. Nat. Protoc. 2006;1:2315–2319. doi: 10.1038/nprot.2006.339. [DOI] [PubMed] [Google Scholar]
- 7.West C.M., Davidson S.E., Roberts S.A., Hunter R.D. Intrinsic Radiosensitivity and Prediction of Patient Response to Radiotherapy for Carcinoma of the Cervix. Br. J. Cancer. 1993;68:819–823. doi: 10.1038/bjc.1993.434. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Streffer C., van Beuningen D., Gross E., Schabronath J., Eigler F.W., Rebmann A. Predictive Assays for the Therapy of Rectum Carcinoma. Radiother. Oncol. 1986;5:303–310. doi: 10.1016/S0167-8140(86)80179-7. [DOI] [PubMed] [Google Scholar]
- 9.Joiner M., Van der Kogel A. Basic Clinical Radiobiology. 4th ed. Hodder Arnold; London, UK: 2009. [DOI] [Google Scholar]
- 10.Baria K., Warren C., Roberts S.A., West C.M., Scott D. Chromosomal Radiosensitivity as a Marker of Predisposition to Common Cancers? Br. J. Cancer. 2001;84:892–896. doi: 10.1054/bjoc.2000.1701. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Bourton E.C., Plowman P.N., Smith D., Arlett C.F., Parris C.N. Prolonged Expression of the γ-H2AX DNA Repair Biomarker Correlates with Excess Acute and Chronic Toxicity from Radiotherapy Treatment. Int. J. Cancer. 2011;129:2928–2934. doi: 10.1002/ijc.25953. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Herskind C., Talbot C.J., Kerns S.L., Veldwijk M.R., Rosenstein B.S., West C.M.L. Radiogenomics: A Systems Biology Approach to Understanding Genetic Risk Factors for Radiotherapy Toxicity? Cancer Lett. 2016 doi: 10.1016/j.canlet.2016.02.035. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Talbot C.J., Tanteles G.A., Barnett G.C., Burnet N.G., Chang-Claude J., Coles C.E., Davidson S., Dunning A.M., Mills J., Murray R.J.S., et al. A Replicated Association between Polymorphisms near TNFα and Risk for Adverse Reactions to Radiotherapy. Br. J. Cancer. 2012 doi: 10.1038/bjc.2012.290. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Seibold P., Behrens S., Schmezer P., Helmbold I., Barnett G., Coles C., Yarnold J., Talbot C.J., Imai T., Azria D., et al. XRCC1 Polymorphism Associated with Late Toxicity after Radiation Therapy in Breast Cancer Patients. Int. J. Radiat. Oncol. Biol. Phys. 2015 doi: 10.1016/j.ijrobp.2015.04.011. [DOI] [PubMed] [Google Scholar]
- 15.Barnett G.C., Thompson D., Fachal L., Kerns S., Talbot C., Elliott R.M., Dorling L., Coles C.E., Dearnaley D.P., Rosenstein B.S., et al. A Genome Wide Association Study (GWAS) Providing Evidence of an Association between Common Genetic Variants and Late Radiotherapy Toxicity. Radiother. Oncol. 2014 doi: 10.1016/j.radonc.2014.02.012. [DOI] [PubMed] [Google Scholar]
- 16.Fachal L., Gómez-Caamaño A., Barnett G.C., Peleteiro P., Carballo A.M., Calvo-Crespo P., Kerns S.L., Sánchez-García M., Lobato-Busto R., Dorling L., et al. A Three-Stage Genome-Wide Association Study Identifies a Susceptibility Locus for Late Radiotherapy Toxicity at 2q24.1. Nat. Genet. 2014 doi: 10.1038/ng.3020. [DOI] [PubMed] [Google Scholar]
- 17.Kerns S.L., Dorling L., Fachal L., Bentzen S., Pharoah P.D.P., Barnes D.R., Gómez-Caamaño A., Carballo A.M., Dearnaley D.P., Peleteiro P., et al. Meta-Analysis of Genome Wide Association Studies Identifies Genetic Markers of Late Toxicity Following Radiotherapy for Prostate Cancer. EBioMedicine. 2016;10:150–163. doi: 10.1016/j.ebiom.2016.07.022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Easton D.F., Pooley K.A., Dunning A.M., Pharoah P.D.P., Thompson D., Ballinger D.G., Struewing J.P., Morrison J., Field H., Luben R., et al. Genome-Wide Association Study Identifies Novel Breast Cancer Susceptibility Loci. Nature. 2007 doi: 10.1038/nature05887. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Mohlke K.L., Boehnke M., Abecasis G.R. Metabolic and Cardiovascular Traits: An Abundance of Recently Identified Common Genetic Variants. Hum. Mol. Genet. 2008 doi: 10.1093/hmg/ddn275. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Easton D.F., Eeles R.A. Genome−Wide Association Studies in Cancer. Hum. Mol. Genet. 2008 doi: 10.1093/hmg/ddn287. [DOI] [PubMed] [Google Scholar]
- 21.Lettre G., Rioux J.D. Autoimmune Diseases: Insights from Genome-Wide Association Studies. Hum. Mol. Genet. 2008 doi: 10.1093/hmg/ddn246. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Eeles R.A., Kote-Jarai Z., Giles G.G., Al Olama A.A., Guy M., Jugurnauth S.K., Mulholland S., Leongamornlert D.A., Edwards S.M., Morrison J., et al. Multiple Newly Identified Loci Associated with Prostate Cancer Susceptibility. Nat. Genet. 2008 doi: 10.1038/ng.90. [DOI] [PubMed] [Google Scholar]
- 23.Lacombe C., Untereiner V., Gobinet C., Zater M., Sockalingum G.D., Garnotel R. Rapid Screening of Classic Galactosemia Patients: A Proof-of-Concept Study Using High-Throughput FTIR Analysis of Plasma. Analyst. 2015;140:2280–2286. doi: 10.1039/C4AN01942C. [DOI] [PubMed] [Google Scholar]
- 24.Carmona P., Molina M., Calero M., Bermejo-Pareja F., Martínez-Martín P., Toledano A. Discrimination Analysis of Blood Plasma Associated with Alzheimer’s Disease Using Vibrational Spectroscopy. J. Alzheimers Dis. 2013;34:911–920. doi: 10.3233/JAD-122041. [DOI] [PubMed] [Google Scholar]
- 25.Scaglia E., Sockalingum G.D., Schmitt J., Gobinet C., Schneider N., Manfait M., Thiéfin G. Noninvasive Assessment of Hepatic Fibrosis in Patients with Chronic Hepatitis C Using Serum Fourier Transform Infrared Spectroscopy. Anal. Bioanal. Chem. 2011;401:2919–2925. doi: 10.1007/s00216-011-5402-8. [DOI] [PubMed] [Google Scholar]
- 26.Gajjar K., Trevisan J., Owens G., Keating P.J., Wood N.J., Stringfellow H.F., Martin-Hirsch P.L., Martin F.L. Fourier−Transform Infrared Spectroscopy Coupled with a Classification Machine for the Analysis of Blood Plasma or Serum: A Novel Diagnostic Approach for Ovarian Cancer. Analyst. 2013;138:3917–3926. doi: 10.1039/c3an36654e. [DOI] [PubMed] [Google Scholar]
- 27.Wan Q.S., Wang T., Zhang K.H. Biomedical Optical Spectroscopy for the Early Diagnosis of Gastrointestinal Neoplasms. Tumor Biol. 2017 doi: 10.1177/1010428317717984. [DOI] [PubMed] [Google Scholar]
- 28.Elmi F., Movaghar A.F., Elmi M.M., Alinezhad H., Nikbakhsh N. Application of FT−IR Spectroscopy on Breast Cancer Serum Analysis. Spectrochim. Acta Part A Mol. Biomol. Spectrosc. 2017 doi: 10.1016/j.saa.2017.06.021. [DOI] [PubMed] [Google Scholar]
- 29.Meade A.D., Clarke C., Byrne H.J., Lyng F.M. Fourier Transform Infrared Microspectroscopy and Multivariate Methods for Radiobiological Dosimetry. Radiat. Res. 2010 doi: 10.1667/RR1836.1. [DOI] [PubMed] [Google Scholar]
- 30.Meade A.D., Howe O., Unterreiner V., Sockalingum G.D., Byrne H.J., Lyng F.M. Vibrational Spectroscopy in Sensing Radiobiological Effects: Analyses of Targeted and Non−Targeted Effects in Human Keratinocytes. Faraday Discuss. 2016;187:213–234. doi: 10.1039/C5FD00208G. [DOI] [PubMed] [Google Scholar]
- 31.Meade A.D., Maguire A., Bryant J., Cullen D., Medipally D., White L., McClean B., Shields L., Armstrong J., Dunne M., et al. Prediction of DNA Damage and G2 Chromosomal Radio−Sensitivity Ex Vivo in Peripheral Blood Mononuclear Cells with Label-Free Raman Micro-Spectroscopy. Int. J. Radiat. Biol. 2018 doi: 10.1080/09553002.2018.1451006. [DOI] [PubMed] [Google Scholar]
- 32.Maziak D.E., Do M.T., Shamji F.M., Sundaresan S.R., Perkins D.G., Wong P.T.T. Fourier-Transform Infrared Spectroscopic Study of Characteristic Molecular Structure in Cancer Cells of Esophagus: An Exploratory Study. Cancer Detect. Prev. 2007 doi: 10.1016/j.cdp.2007.03.003. [DOI] [PubMed] [Google Scholar]
- 33.Staniszewska-Slezak E., Fedorowicz A., Kramkowski K., Leszczynska A., Chlopicki S., Baranska M., Malek K. Plasma Biomarkers of Pulmonary Hypertension Identified by Fourier Transform Infrared Spectroscopy and Principal Component Analysis. Analyst. 2015 doi: 10.1039/C4AN01864H. [DOI] [PubMed] [Google Scholar]
- 34.Bonnier F., Baker M.J., Byrne H.J. Vibrational Spectroscopic Analysis of Body Fluids: Avoiding Molecular Contamination Using Centrifugal Filtration. Anal. Methods. 2014 doi: 10.1039/c4ay00891j. [DOI] [Google Scholar]
- 35.Chisanga M., Muhamadali H., Ellis D.I., Goodacre R. Surface-Enhanced Raman Scattering (SERS) in Microbiology: Illumination and Enhancement of the Microbial World. Appl. Spectrosc. 2018 doi: 10.1177/0003702818764672. [DOI] [PubMed] [Google Scholar]
- 36.Saylor P.J., Smith M.R. Adverse Effects of Androgen Deprivation Therapy: Defining the Problem and Promoting Health among Men with Prostate Cancer. J. Natl. Compr. Cancer Netw. 2010;8:211–223. doi: 10.6004/jnccn.2010.0014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Roayaei M., Ghasemi S. Effect of Androgen Deprivation Therapy on Cardiovascular Risk Factors in Prostate Cancer. J. Res. Med. Sci. 2013;18:580–582. [PMC free article] [PubMed] [Google Scholar]
- 38.Keating N.L., Liu P.H., O’Malley A.J., Freedland S.J., Smith M.R. Androgen−Deprivation Therapy and Diabetes Control among Diabetic Men with Prostate Cancer. Eur. Urol. 2014 doi: 10.1016/j.eururo.2013.02.023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Wolny-Rokicka E., Tukiendorf A., Wydmański J., Brzezniakiewicz-Janus K., Zembroń-Łacny A. The Effect of Radiotherapy on the Concentration of Plasma Lipids in Elderly Prostate Cancer Patients. Am. J. Mens Heal. 2019;13 doi: 10.1177/1557988319846328. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Kageyama S., Nihei K., Karasawa K., Sawada T., Koizumi F., Yamaguchi S., Kato S., Hojo H., Motegi A., Tsuchihara K., et al. Radiotherapy Increases Plasma Levels of Tumoral Cell−Free DNA in Non−Small Cell Lung Cancer Patients. Oncotarget. 2018;9:19368–19369. doi: 10.18632/oncotarget.25053. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Jelonek K., Pietrowska M., Ros M., Zagdanski A., Suchwalko A., Polanska J., Marczyk M., Rutkowski T., Skladowski K., Clench M.R., et al. Radiation-Induced Changes in Serum Lipidome of Head and Neck Cancer Patients. Int. J. Mol. Sci. 2014;15:6609. doi: 10.3390/ijms15046609. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Daly M.J. Death by Protein Damage in Irradiated Cells. DNA Repair. 2012;11:12–21. doi: 10.1016/j.dnarep.2011.10.024. [DOI] [PubMed] [Google Scholar]
- 43.Alicikus Z.A., Yamada Y., Zhang Z., Pei X., Hunt M., Kollmeier M., Cox B., Zelefsky M.J. Ten-Year Outcomes of High-Dose, Intensity-Modulated Radiotherapy for Localized Prostate Cancer. Cancer. 2011;117:1429–1437. doi: 10.1002/cncr.25467. [DOI] [PubMed] [Google Scholar]
- 44.Helm D., Labischinski H., Naumann D. Elaboration of a Procedure for Identification of Bacteria Using Fourier−Transform IR Spectral Libraries: A Stepwise Correlation Approach. J. Microbiol. Methods. 1991 doi: 10.1016/0167-7012(91)90042-O. [DOI] [Google Scholar]
- 45.Shaver J. Chemometrics for Raman Spectroscopy. In: Lewis I.R., Edwards H., editors. Handbook of Raman Spectroscopy: From the Research Laboratory to the Process Line. Marcel Dekker Inc.; New York, NY, USA: 2001. pp. 275–306. [Google Scholar]
- 46.Opus 5 Reference Manual. Bruker OPTIK GmbH; Ettlingen, Germany: 2004. [Google Scholar]
- 47.Savitzky A., Golay M.J.E. Smoothing and Differentiation of Data by Simplified Least Squares Procedures. Anal. Chem. 1964 doi: 10.1021/ac60214a047. [DOI] [PubMed] [Google Scholar]
- 48.Krafft C., Steiner G., Beleites C., Salzer R. Disease Recognition by Infrared and Raman Spectroscopy. J. Biophotonics. 2009;2:13–28. doi: 10.1002/jbio.200810024. [DOI] [PubMed] [Google Scholar]
- 49.Meade A.D., Byrne H.J., Lyng F.M. Spectroscopic and Chemometric Approaches to Radiobiological Analyses. Mutat. Res. 2010;704:108–114. doi: 10.1016/j.mrrev.2010.01.010. [DOI] [PubMed] [Google Scholar]
- 50.Brereton R.G., Lloyd G.R. Partial Least Squares Discriminant Analysis: Taking the Magic Away. J. Chemom. 2014 doi: 10.1002/cem.2609. [DOI] [Google Scholar]
- 51.Wold S., Sjöström M., Eriksson L. PLS−Regression: A Basic Tool of Chemometrics. Chemom. Intell. Lab. Syst. 2001;58:109–130. doi: 10.1016/S0169-7439(01)00155-1. [DOI] [Google Scholar]
- 52.Gromski P.S., Muhamadali H., Ellis D.I., Xu Y., Correa E., Turner M.L., Goodacre R. A Tutorial Review: Metabolomics and Partial Least Squares−Discriminant Analysis—A Marriage of Convenience or a Shotgun Wedding. Anal. Chim. Acta. 2015 doi: 10.1016/j.aca.2015.02.012. [DOI] [PubMed] [Google Scholar]
- 53.Mehmood T., Martens H., Sæbø S., Warringer J., Snipen L. A Partial Least Squares Based Algorithm for Parsimonious Variable Selection. Algorithms Mol. Biol. 2011 doi: 10.1186/1748-7188-6-27. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Krishnan A., Williams L.J., McIntosh A.R., Abdi H. Partial Least Squares (PLS) Methods for Neuroimaging: A Tutorial and Review. Neuroimage. 2011 doi: 10.1016/j.neuroimage.2010.07.034. [DOI] [PubMed] [Google Scholar]
- 55.Worley B., Halouska S., Powers R. Utilities for Quantifying Separation in PCA/PLS-DA Scores Plots. Anal. Biochem. 2013;433:102–104. doi: 10.1016/j.ab.2012.10.011. [DOI] [PMC free article] [PubMed] [Google Scholar]