Skip to main content
Cancers logoLink to Cancers
. 2023 Mar 16;15(6):1797. doi: 10.3390/cancers15061797

Chemoresistive Nanosensors Employed to Detect Blood Tumor Markers in Patients Affected by Colorectal Cancer in a One-Year Follow Up

Michele Astolfi 1,2, Giorgio Rispoli 3,*, Gabriele Anania 4, Giulia Zonta 1,2, Cesare Malagù 1,2
Editors: Therese Becker, Yafeng Ma
PMCID: PMC10046137  PMID: 36980683

Abstract

Simple Summary

Since colorectal cancer represents one of the most diffused pathologies worldwide, usually lacking specific symptoms, it is crucial to develop and validate innovative low-invasive techniques to detect it. Here, a device based on an array of nanostructured gas sensors has been employed to analyze and discriminate the exhalations of blood samples collected from colorectal cancer-affected patients at different stages of their pre- and post-surgery therapeutic path. The device was clearly able to distinguish between the pre-surgery samples, where the tumor was present, and the one-year post-surgery ones, following the tumor removal. These results raise high hopes for the device’s clinical validation and its future use in clinical follow-up protocols, patient health status monitoring, and to detect possible post-treatment relapses.

Abstract

Colorectal cancer (CRC) represents 10% of the annual tumor diagnosis and deaths occurring worldwide. Given the lack of specific symptoms, which could determine a late diagnosis, the research for specific CRC biomarkers and for innovative low-invasive methods to detect them is crucial. Therefore, on the basis of previously published results, some volatile organic compounds (VOCs), detectable through gas sensors, resulted in particularly promising CRC biomarkers, making these sensors suitable candidates to be employed in CRC screening devices. A new device was employed here to analyze the exhalations of blood samples collected from CRC-affected patients at different stages of their pre- and post-surgery therapeutic path, in order to assess the sensor’s capability for discriminating among these samples. The stages considered were: the same day of the surgical treatment (T1); before the hospital discharge (T2); after one month and after 10–12 months from surgery (T3 and T4, respectively). This device, equipped with four different sensors based on different metal–oxide mixtures, enabled a distinction between T1 and T4 with a sensitivity and specificity of 93% and 82%, respectively, making it suitable for clinical follow-up protocols, patient health status monitoring and to detect possible post-treatment relapses.

Keywords: chemoresistivity, gas sensor, nanotechnology, VOCs, blood, colorectal cancer, follow-up, preventive screening

1. Introduction

Colorectal cancer (CRC) is the second most common diagnosed tumor in women (after breast cancer) and the third one in men (after lung and prostate cancers), representing about 10% of all the annual tumors diagnosed and deaths occurring worldwide. Thus, CRC is a very serious public health issue, in particular in the most developed countries [1] (e.g., Italy [2], where this study was performed). Given the lack of specific symptoms which could lead to a late clinical diagnosis, the planning of organized screening campaigns [3] is crucial for the identification of precancerous lesions before their malignant degeneration, and for their early treatment with proper therapies [4,5]. In Italy and in other countries, the most commonly adopted preventive screening technique for CRC is the fecal occult blood test (FOBT) in its two main versions: gFOBT (guaiac-based FOBT) and FIT (Fecal Immunochemical Test). In the case of a FOBT positive result, the patient undergoes colonoscopy afterwards, despite its invasiveness and dangerousness (it could cause a parietal lesion or even perforation). This technique is currently considered as the gold-standard for CRC diagnosis, because it allows a direct visualization of the colic mucous, the biopsy collection from suspect lesions and the eventual excision of small polyps [6,7]. On the other hand, the oncological five-year follow-up program for patients who have already ended CRC treatment is currently attained with a periodical clinical monitoring that however decreases the CRC-related mortality no more than 7–13% [8,9]. Based on the recommendation of the American Cancer Society and of the guidelines of the Associazione Italiana Oncologia Medica (CRC 2020 AIOM), the follow-up protocols, consisting in diverse progressive and invasive steps (e.g., antigen dosage sub-ministrations, abdomen computed tomography (CT), and colonoscopy [10]), are complex and very expensive, inducing a low subjects’ adherence to these examinations (about 50% [11]). On this basis, the research for specific CRC biomarkers and for an innovative method to detect them with low invasiveness is crucial to raise the patient adherence to oncological screening and monitoring programs [12]. It has been demonstrated that the cancer cells, because of their altered metabolism [13,14,15], discharge peculiar organic compounds into the blood stream that are volatile because of their high vapor pressure (called VOCs in the following) [16,17,18]. These VOCs originate by several processes occurring during the neoplastic degeneration such as cellular membrane peroxidation [13,14,15], an accelerated glycolysis activity [19], etc., and they could be therefore used as reliable tumoral markers. Currently, the VOCs’ detection and analysis have therefore a huge potential in the clinical practice, because they allow the development of effective screening and follow up in vitro techniques (with no or minimal invasiveness) for tumor prevention and monitoring [20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39]. To this aim, some studies employing gas chromatography–mass spectrometry (GC-MS), identified some VOCs with a good reliability which resulted in particularly promising CRC biomarkers [20,21,22,23,24]. Although the GC-MS technique is extremely powerful in detecting the single molecules composing the VOCs, allowing the identification of a cancer VOCs’ spectrum, it consists in a very expensive and bulky setup, hardly applicable in clinical practice, requiring a complicated data analysis and highly trained personnel [25]. In addition, the usage of the GC-MS has so far been limited to breath analysis [22,33,34,35,36,37] rather than on other human samples (such as blood, feces, etc.), according to the literature. Chemoresistive semiconductor gas sensors, realized at the Sensor Laboratory (SL) of the Department of Physics and Earth Sciences of the University of Ferrara (UNIFE), could be promising candidates to be employed in medical devices for CRC screening and monitoring. Based on many previous studies, these sensors have been demonstrated to be suitable for detecting VOCs at extremely low concentrations (up to ten parts per billion), in different human fluids and samples (such as stools, blood, intestinal tissues, etc.) [26,27,28,29,30]. The device employed here, called SCENT B2 in the following sections, is an upgraded version (in the electronics and in the management software) of two patented devices (SCENT A1 and SCENT B1 [40]), manufactured by the company SCENT S.r.l. [41] in a long-lasting collaboration with the SL. SCENT devices were able to detect the VOC pattern differences between the CRC-affected patients and the healthy controls, by examining blood, feces, biopsy and cell culture samples [26,27,28,29,30]. In particular, a previous feasibility study conducted using SCENT B1 provided very encouraging results in discriminating the blood samples collected from CRC-affected patients and the ones collected from presumed healthy subjects [27]. Given these promising results, the purpose of this study is to employ SCENT B2 to analyze the VOCs exhaled by blood samples collected from CRC-affected patients, at different stages of their pre- and post-surgery therapeutic paths [42].

2. Materials and Methods

2.1. The Sensors and the Device

A thick-film metal-oxide gas sensor was constructed of four independent parts: a sensing film, a substrate, a heater and a connector (here, a TO-39 socket). The first one consisted of a semiconductor film with a size of 1000 × 1000 × 30 µm, made of an interconnected network of nanograins (metal-oxide or sulfides) screen-printed (with serigraphic technology) onto an alumina substrate (the second part; 2.5 × 2.5 mm2), which had the dual function of electric insulator and mechanical support for the sensor. The sensing film can be synthesized by means of various approaches: here the sol–gel technique (which allows for the synthesis of nanostructures with the desired features, such as grain size, resistivity, etc., by choosing the proper process parameters) was employed to synthesize the sensing material [43,44]. The heater consists in a platinum coil printed on the substrate backside that heats the sensor to the optimal working temperature (called WT in the following; usually within 400–650 °C). Finally, the connector is a four pin TO-39 socket: two pins (Ø ≈ 0.06 mm) are welded to the heater and the others to the film through two gold comb-shaped electrodes previously printed on the substrate (an expanded view of the sensor is outlined in Figure 1). The welds were performed by thermo-compression, using a bonding machine.

Figure 1.

Figure 1

Sketch of a sensor. The film reacting with the gas is screen-printed onto the alumina substrate, endowed with gold comb-shaped electrodes; the heater is placed on the alumina substrate backside. Inset on the left: SEM image of the nanostructured shape of the sensing film material (scale bar is 2 μm); inset on the right: photo of a real sensor compared with a EUR 5 cent coin.

The working principle of this sensor type consists in the variation in the sensing film resistivity as a consequence of the chemical redox reactions occurring between its surface and the gaseous molecules of the surrounding atmosphere (Figure 2) [45,46].

Figure 2.

Figure 2

Working principle of an n-type sensor. Upper panel, the sensor grains (blue circles) placed in a reference atmosphere (here, dry air) interacting with the oxygen ions and/or molecules (green circles), which entrap the electrons (red circles) at the sensor grain surface (the external border of the light blue annulus), subtracting them from the grain bulk (blue circle), enlarging the depletion region (light blue annulus) and consequently increasing the grain–grain potential barrier (BB). Lower panel, sensor exposed to CO (C is light brown circles): the oxygen atoms adsorbed at the grain surface reacts with CO, releasing CO2 in the environment and giving back electrons to the bulk CB, reducing the BB effect.

2.2. Chemical Section

2.2.1. Sol–Gel Technique

The nanostructures at the basis of thick film MOX sensors consist in an interconnected network of nanograins with a size ranging between 50 and 200 nm. They improve sensibly the sensor performances (such as sensitivity, detection limit, recovery time, etc.) by maximizing the sensor active material surface to volume ratio, so promoting its interaction with the surrounding gaseous compounds. In order to obtain these nanostructures the sol–gel chemical process has been adopted for its many advantages in respect to other synthesis methods [43,47,48,49]. Besides the high costs of the raw starting materials, the main advantages of sol–gel are: low procedure costs, the possibility of obtaining homogeneous, stable and pure final products (also through low temperature treatments) and the full control of the final material’s features (such as nanostructures’ size, porosity, and so on) by carefully setting the process parameters. The sol–gel technique consists in the following four main steps:

  • The hydrolysis of the precursor (as silicon or metal alkoxides) in water or alcohol solution (named “SOL”); to incentivize the SOL step; usually, some other chemicals (as acids, etc.) are added to the solution, in order to reach a colloidal suspension;

  • The metal-oxide particles’ aggregation (or condensation), that occurs because of the water or alcohol removal from the solution and the metal–oxide bridging process arises. This phenomenon leads to the formation of a colloidal and viscous network of nanoparticles, but in a liquid phase, named “GEL”. At this stage, the solution alkoxide precursor and pH were the two main influencing parameters of the colloidal product; they can be carefully controlled in order to obtain nanoparticles with the desired size and cross-linking;

  • The aging process, lasting up to a couple of days, during which several changes in the GEL structure and properties could occur (as the polycondensation). During this stage, the colloidal particle thickness increases while their porosity decreases. This is another sol–gel controllable parameter, in order to obtain a final product characterized by a certain porosity and grain size;

  • The drying and calcination of the colloidal solution. Here, the GEL is dried at about 100 °C and then calcinated at higher temperatures (usually 400–800 °C). This step is crucial for the complete removal of the solvent residuals and/or of other chemical additives. During this process, the temperature and the relative humidity greatly influenced the quality of the final MOX nanopowder.

Finally, this nanopowder is converted in a printable viscous paste by adding a small amount of different organic vehicles (such as α-terpineol) and a glass frit (a glassy silicon oxides’ mixture). It is then deposited in form of a thick film (square 250 × 250 µm shape with a thickness of about 25–30 µm), on an alumina substrate between the two gold contacts by means of a screen-printing machine (mod. C920; Aurel s.p.a., Forlì-Cesena, Italy). The printed material is then again dried at about 100 °C and subjected to a firing treatment (usually from 650 to 850 °C).

Since the detectable gas spectrum of a single sensor is very wide, it is crucial to combine two or more different sensors into the same device (array) to significantly increase its selectivity (see Figure 2, Figures S1 and S2 (Supplementary Materials)). Based on the work carried out so far, the sensors selected for the present study, all heated to a WT of 450 °C, were:

  • ST25 + 1%Au (or ST25): a mixture of tin and titanium oxide with the addition of 1% of gold nanoparticles (details about their synthesis and use are in [26,27,28,29,47]);

  • SmFeO3: samarium and iron oxides [50];

  • STN: tin, titanium and niobium oxides [51,52];

  • TiTaV: titanium, tantalum and vanadium oxides [53].

2.2.2. Sensor–Gas Interaction

The thick-film sensors based on the nanostructures synthesized with the sol–gel technique described above, are able to sense the gaseous compounds through the chemoresistive principle up to tens of ppb. This phenomenon requires firstly the sensor’s thermal activation (through thermionic effect), to maximize the number of electrons populating the conduction band, and thus the number of them able to overcome the grain–grain potential barrier (Band Bending, BB, in Figure 2). The other crucial role of the thermo-activation is the ionization of gaseous molecules in the atmosphere surrounding the sensor, promoting their adsorption on its surface. Hence, it is necessary to heat the sensor to an appropriate working temperature (WT), through the heater, usually selected on the basis of the best compromise between sensor response amplitude and its repeatability [52]. The MOX sensor works as follows: once it is placed in a reference atmosphere (i.e., pure dry air, pure CO, etc.), the surrounding oxygen ions and/or molecules (ionized at the WT) are adsorbed on the surface of each sensor grain. Then, the adsorbed oxygen ions, because of their electronegativity, act as acceptor surface states, trapping the conduction band (CB in Figure 2) electrons at the grain surface, affecting the sensor conductivity. As soon as the oxygen coverage ratio of the grain surface reaches the chemical equilibrium (i.e., when the number of adsorbed oxygens per unit of time is equal to the desorbed ones), the film conductivity becomes constant; this condition is called the baseline. For instance, in the case of an n-type sensor (based on n-doped semiconductor MOX material), the surface oxygen adsorption enlarges the grain “depleted shell” (i.e., the grain region lacking free charges), increasing the BB effect and consequently reducing the sensor conductivity. At this point, by subjecting the n-type sensor to a reducing gas (such as CO), the latter reacts with the previously adsorbed oxygen ions, releasing CO2 molecules in the atmosphere, freeing the trapped CB electrons: this decreases the grain–grain potential barrier (BB), increasing the sensor film’s conductivity (Figure 2). Once the reaction rate achieves a new equilibrium, the resulting constant film conductivity is the sensor signal in the gas presence and it is used to calculate the sensor response according to Equation (2). Finally, re-exposing the sensor to the initial reference atmosphere, the baseline condition is achieved in a so-called recovery time, which depends on a multitude of parameters, such as the sensor type, its WT, the tested gas kind and concentration, etc. The return of the sensor’s conductivity to its starting (reference) value demonstrates the full reversibility of the chemical reactions occurring on the grain surface [45,54,55].

2.3. The Sensor Response

The electronic circuitry connected to a sensor comprises the sensor heating and the sensor signal managing and acquisition. The first one adjusts the WT by controlling the voltage applied to the sensor heater and the current flowing through it [27,28,29]. The second one employs an operational amplifier in inverting configuration (Figure S3) returning a voltage VO (Equation (1)) as a function of time inversely proportional to the sensor film resistance:

VO=RfRsVi  (1)

where Rf is the feedback resistor and Rs is the sensor resistance. The sensor response R is calculated as the ratio between the voltage in the presence of a sample gas (VGas) and the one in the presence of a clean airflow (VAir):

R=VGasVAir  (2)

R is therefore dimensionless and is independent from the measured physical quantity and the baseline amplitude (in general, different for each sensor) [29,56].

2.4. Blood Samples Collection and Analysis

This study is based on a wide observational, single center and prospective study, approved by the Ethics Committee on 13 July 2017 at the Surgery Department of Azienda Ospedaliero-Universitaria di Sant’Anna di Cona (Ferrara, Italy) with number 170,484. Thirty patients with a confirmed CRC diagnosis were recruited in the period between October 2020 and May 2022 at the S. Anna Hospital of Ferrara. The CRC-affected patients were randomly enrolled (i.e., regardless by sex, CRC stage, age, etc., as detailed in Table 1), after signing an informed consent for clinical data collection.

Table 1.

The composition of the randomized enrolled population. AVE. AGE is the average population age; BMI is the body mass index.

Enrolled Population
Sex Male 19 63%
Female 11 37%
Ave. Age Male/Female 69 47–87
BMI >30 9 30%
<30 21 70%
Tumor
Localization
Ascending Colon 18 60%
Transverse Colon 3 10%
Descending Colon 3 10%
Sigmoid 3 10%
Rectum 3 10%
Stage I 3 10%
II 13 43%
III 13 43%
IV 1 3%

The patients’ inclusion criteria were:

  • Age over 18 years old;

  • CRC removal through laparoscopic or laparotomic elective surgery.

The patients’ exclusion criteria were:

  • Pregnant women;

  • Emergency surgical treatment.

Blood samples were gathered at different moments of the patients’ therapeutic path at the Hospital S. Anna as follows:

  • T1: the same day, but before the surgical treatment;

  • T2: before the hospital discharge (with non-standardized timings, depending upon the patient clinical course);

  • T3: after at least one month after surgery (organizing a return of the patients to the hospital);

  • T4: after 10–12 months from surgery (organizing a second return of the patients to the hospital).

2.5. Experimental Section

Blood samples were collected at the Ferrara Hospital (S. Anna, Cona) and stored at room temperature in 7 cc vials containing the anticoagulant agent K3-EDTA, in order to inhibit blood clotting and to guarantee their correct conservation. The samples were then transferred within one hour of storage to the Electrophysiology Laboratories of the Department of Neurosciences and Rehabilitation of UNIFE for the VOC pattern analysis with the sensing device SCENT B2. The clean and dry air flux (see Device in Supplementary Materials) was initially conveyed directly to the sensors to set a stable baseline. Once it was ensured that the baseline was stable, the blood vial was poured in a reusable Teflon container (previously washed with ultrapure water and dried with a sterilized air flux) and placed immediately in the SCENT B2 sample box by the operator (Figure S2D). This procedure was executed as rapidly as possible in order to minimize external air contamination and possible VOCs’ loss. At this point, by turning the three-way-valve, the clean and dry air flux was directed through the sample box (thus gathering the headspace chemicals exhaled by the blood sample) before reaching the sensors; the latter, interacting with VOCs, generated the responses. Once the sensor signals attained a plateau, the three-way-valve was turned to the initial position to convey the air flux toward the sensors, in order to return their signals to the initial baseline. Finally, the blood sample was properly disposed of and the Teflon container meticulously washed with bleach and several times with ultrapure water, and finally dried with a sterilized air flux. The data stored as .txt files were also plotted off line as the response R in function of time (Equation (2) and Figure S4) and further processed through different statistical techniques, such as principal components analysis (PCA) and Receiver Operating Characteristic (ROC). The accuracy of discrimination between two sample types of each sensor and of the entire device was evaluated through their sensitivity (i.e., the ability to recognize true positives), and their specificity (i.e., the ability to recognize true negatives).

3. Results and Discussion

3.1. Ensemble Statistical Analysis and After-Surgery Follow-Up

The blood of thirty CRC patients was collected at four different stages of their surgical clinical path: the same day or one day before surgery (T1); just before the patient discharge (T2); after one month from surgery (T3); and after 10–12 months from surgery (T4), for a total of 109 blood samples (instead of 120, because some patients were not able to provide all the four samples for several reasons such as early dehospitalization, death, etc.). Surprisingly, T2 gave larger responses than T1 (Figure 3 and Table 2), probably because of the patients’ increased catabolism following the surgery, and of the VOCs that can be potentially produced by drugs and anesthetics used during the surgery or VOCs produced by their metabolites. Indeed, it has been found that the sensor responses to the blood collected from all the patients (but unfortunately only four of them) just before the surgery were always significantly smaller than the one collected after the anesthesia, but before the tumor removal. Moreover, another limitation in the T2 analysis is given by the unavoidable non-standard collection time of the blood samples, due to the different patient discharge times. Finally, many patients were subjected to adjuvant therapies, which may contaminate the blood exhalation and detected by the sensors.

Figure 3.

Figure 3

Average sensor responses (R) to the blood collected during patient follow-up. Response R averaged on all patients and relative standard error (reported numerically in Table 1) of each sensor at the different blood collection times (red, T1, n = 30; green, T2, n = 22; yellow, T3, n = 29; blue, T4, n = 28).

Table 2.

Average responses R ± their standard error of the four sensors to T1, T2, T3 and T4 of Figure 3.

ST25+1%Au SmFeO3 STN TiTaV
R¯T1 1.49 ± 0.04 1.22 ± 0.02 1.64 ± 0.05 1.19 ± 0.02
R¯T2 1.85 ± 0.12 1.29 ± 0.03 1.92 ± 0.10 1.30 ± 0.06
R¯T3 1.54 ± 0.07 1.24 ± 0.01 1.64 ± 0.06 1.18 ± 0.02
R¯T4 1.26 ± 0.02 1.14 ± 0.01 1.31 ± 0.02 1.09 ± 0.01

For all the above reasons, and because this study was focused on the patient follow-up after surgery, to evaluate the sensor performance in distinguishing the exhalations of a blood sample collected from a patient affected by tumor (T1) and the ones after one year from its surgical removal (T4), the statistical analysis was focused on T1 and T4 only. The sensor responses R to the blood samples at T1 and T4 for 28 out of 30 patients enrolled in this study are reported in Figure 4 (unfortunately, two patients provided the T1 sample only because they could not return for the annual control, when the T4 was collected). None of the patients was subjected to neoadjuvant therapies (i.e., chemotherapy, radiotherapy, etc.) and adjuvant radiotherapy, but adjuvant chemotherapy was performed on eleven out of twenty-eight patients. Since these therapies could affect the sensor’s response reliability and repeatability (due to possible chemotherapy compounds and/or their metabolites discharged in the blood stream), the homogeneity was assessed (i.e., if two data groups belong to the same statistical distribution, according to the null hypothesis for which the averages of the two populations are the same) of the two T4 groups of sensor responses: the samples collected from patients subjected to adjuvant chemotherapy (nu=17) and the untreated ones (nt=11). This homogeneity was assessed by performing a unpaired two-sample Student’s t-test on the two independent sample groups: the Student’s t-test was chosen because of the number of data, n=28, and the unknown population variances. The test variable t for each sensor resulted to be: 0.189, 0.467, 0.017 and −0.420 for the ST25, SmFe, STN and TiTaV sensor, respectively. Since the critical value tc(a,g)=3.067 (significance level: α = 0.01; degrees of freedom: g=nu+nt2), retrieved from the Student’s t-test bilateral distribution table, was much larger than the above t-test variables (related to the sensor responses), then they fell into the area of the Student’s t distribution in between tc and +tc. Therefore, the null hypothesis was confirmed and consequently the T4 dataset was independent from the adjuvant chemotherapy treatment.

Figure 4.

Figure 4

After-surgery follow-up of 28 patients. The four upper panels show the R amplitudes for each sensor at T1 and T4 times for each patient. The bottom panel shows the R percentage reductions in T4 in respect to T1 for each sensor and patient. The numbers in abscissa in all panels represent the randomized patient numbers; the patients n. 16 and n. 19 of the bottom panel are absent because they provided the T1 sample only (see text).

The sensor responses R to the T4 samples were generally smaller than the T1 ones (Figure 4, four upper panels), as is more clearly shown by the R percentage reduction in T4 in respect to T1 for each sensor and patient (Figure 4, bottom panel). This result is expected, since the surgical removal of the tumoral mass would eliminate the cancer cell VOCs dumped in the blood stream.

A clear statistical difference between T1 and T4 readily emerged in the average response of all sensors: in particular, it decreased by 21% for STN (that demonstrates to be the most suitable sensor here), 16% for ST25 − 1%Au, 8% for TiTaV and 7% for SmFeO3 (Figure 5). The suitability of the STN sensor was expected on the basis of previous results obtained by our research team in feasibility studies on blood samples [27,30]. To assess the statistical significance differences between T1 and T4 for each sensor, a paired two-sample t-test (α = 0.01; g = 26) was performed. By comparing the t variables (that resulted: 4.458, 4.317, 6.004, and 5.588 for ST25, SmFeO3, STN and TiTaV, respectively) with the tc retrieved from the Student’s t bilateral table, it results in clear statistical differences between the T1 and T4 for all sensors (p-values < 0.001 for ST25 and SmFeO3, and p-values < 0.0001 for STN and TiTaV; Figure 5).

Figure 5.

Figure 5

Average sensor responses (R) to the blood collected just before surgery and after about one year of follow-up. Response R averaged on all patients and relative standard error (reported numerically in Table 1) of each sensor at the two blood collection times (red, T1; blue, T4). The statistically significant differences between T1 and T4, for each sensor, have been calculated with a significance level α = 0.01 (*** p < 0.001; **** p < 0.0001).

This difference is further highlighted by the significant statistical separation between the T1 and T4 populations by the confidence interval analysis performed by using the Student’s t distribution (n = 30 for T1 and n = 28 for T4) with a 95% confidence interval (significance level: α=0.05; Figure 6).

Figure 6.

Figure 6

Confidence interval analysis. The statistical discrimination between T1 and T4 was evaluated by computing the confidence intervals by using the Student’s t-test (n = 30 for T1 and n = 28 for T4).

3.2. Sensor Accuracy Evaluation

In order to evaluate the accuracy of each sensor in discriminating T1 and T4, the sensitivity and the specificity parameters were computed as follows:

Sens.=TPTP+FN ; Spec.=TNTN+FP (3)

where TP, TN, FP and FN are the number of true positives, true negatives, false positives and false negatives, respectively. An extensively used methodology to evaluate the accuracy of a medical screening test is provided by the ROC (Receiver Operating Characteristic) analysis [57,58], consisting in the plot of Sens. vs. 1-Spec. (Figure 7). The sensitivity, the specificity, the AUC and the cut-off amplitude for each sensor are reported in Table 3.

Figure 7.

Figure 7

Evaluation of the sensor sensitivity and specificity in discriminating between T1 and T4. Plots of the ROC curves of the four sensors resulting from 1000 iterations.

Table 3.

Main parameters characterizing the sensor and the device performances. The first four columns shows the AUC, cut-off, sensibility and specificity for each of the four sensors calculated from the ROC curves of Figure 7; the last column shows the parameters derived from the ROC curve (calculated on the basis of the PC1 data projection of Figure 8) globally characterizing the new device equipped with the four sensors (Figure 9).

ST25 SmFeO3 STN TiTaV PC1
AUC 0.87 0.84 0.94 0.93 0.93
Cut-Off 1.29 1.18 1.39 1.11 0.84
Sensitivity 87% 60% 90% 83% 93%
Specificity 75% 89% 89% 86% 82%

3.3. Sensor Discrimination Power

To better assess the discriminating power between T1 and T4 of the four sensors, their responses were further analyzed with the Principal Component Analysis (PCA) [59]. The four eigenvectors of the covariance matrix (PC1, PC2, PC3, PC4), calculated starting from the four-dimensional plot of the sensor responses, were plotted one vs. the other to construct the two-dimensional score (or dispersion) plots.

The fraction of variance (in percent) of the datasets projected on the PCs were: 96% for PC1, 2.4% for PC2, 1.4% for PC3 and 0.2% for PC4. Since the PC1 vs. PC2 plot contains most of the dataset information, having the largest fraction of the total variance (about 98.4%), PC3 and PC4 (having a total variance of 1.6%) were neglected. The distribution of the red points (T1) and the blue ones (T4) are enough discriminated, giving a small discrepancy between the T1 and the T4 data (Figure 8). The ROC curve calculated on the PC1 projected dataset (i.e., the dataset space direction where its variance is maximized) is characterized by an AUC and a cut-off amplitude of 0.93 and 0.84, respectively (Figure 9 and Table 3). The latter values arise from the contribution of all the four sensors and not from a single one (as reported in Figure 7); therefore, they represent the performance of the device as a whole, making it suitable for a future use in the clinical practice.

Figure 8.

Figure 8

PCA of sensor responses. Score plot of PC1 vs. PC2 (red points: T1; blue points: T4) constructed with the responses (n = 58) of the four sensors.

Figure 9.

Figure 9

Evaluation of the sensitivity and specificity of the device in discriminating between T1 and T4 samples. ROC curve calculated on the PC1 projected dataset resulting from 1000 iterations.

4. Conclusions

The SCENT B2 equipped with STN, TiTaV, ST25 − 1%Au and SmFeO3 sensors, reliably discriminates the blood VOC pattern changes between T1 (collected just before surgery) and T4 (collected after 10–12 months from surgery) with a sensitivity of 93% and a specificity of 82%. This excellent performance makes SCENT B2 a very suitable candidate for its future development as a medical device to be used in clinical follow-up, to test the patient’s health status, and to detect possible future relapses after the surgical treatment. The future goals are:

  • The recruitment of a larger number of patients in order to validate SCENT B2 as a medical device;

  • The further development of SCENT B2 to embed the host computer in the device by using a Raspberry Pi board;

  • The improvement of the sensor technology in order to better detect the CRC stages and to extend the use of this device to other tumor types;

  • The undertaking of a clinical trial in order to validate the device as a diagnostic equipment.

5. Patents

C. Malagù, S. Gherardi, G. Zonta, N. Landini, A. Giberti, B. Fabbri, A. Gaiardo, G. Anania, G. Rispoli, L. Scagliarini, Combinazione di materiali semiconduttori nanoparticolati per uso nel distinguere cellule normali da cellule tumorali (2015), National #: 102015000057717.

Acknowledgments

Financial support was provided by Casa di cura Quisisana s.r.l. and partially by grants from the Project FAR (Fondo di Ateneo per la Ricerca, University of Ferrara) 2017–2021 to G.R. Many thanks to Sandro Gherardi and Andrea Margutti for invaluable technical assistance; Francesca Pucci, Samantha Babini, Giulia Ghirardini, and Francesca Saviano helped with the experiments and provided all blood samples.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/cancers15061797/s1, Figure S1: Microphotograph of a sensor connected in between the voltage source and the operational amplifier in inverting configuration; Figure S2: The SCENT B2; Figure S3: Internal details of SCENT B2; Figure S4: Sensor output plot.

Author Contributions

Conceptualization, M.A., G.R. and G.A.; methodology, M.A. and G.A.; software, M.A.; validation, M.A., G.Z. and G.R.; formal analysis, M.A.; investigation, M.A. and G.R.; resources, G.A.; data curation, M.A.; writing—original draft preparation, M.A., G.Z. and G.R.; writing—review and editing, M.A. and G.R.; visualization, M.A.; supervision, C.M.; project administration, M.A. and C.M.; funding acquisition, C.M. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board (or Ethics Committee) of the Surgery Department of Azienda Ospedaliero-Universitaria di Sant’Anna di Cona, Ferrara, Italy (protocol code: 170484 and date of approval: 13 July 2017).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data are available under request.

Conflicts of Interest

The authors declare no conflict of interest.

Funding Statement

This research received no external funding.

Footnotes

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

References

  • 1.Siegel R.L., Miller K.D., Fuchs H.E., Jemal A. Cancer statistics, 2022. CA. Cancer J. Clin. 2022;72:7–33. doi: 10.3322/caac.21708. [DOI] [PubMed] [Google Scholar]
  • 2.Cancer Figures in Italy. [(accessed on 23 January 2023)]. Available online: https://www.aiom.it/en/cancer-figures-in-italy/
  • 3.Strul H., Arber N. Screening Techniques for Prevention and Early Detection of Colorectal Cancer in the Average-Risk Population. Gastrointest. Cancer Res. GCR. 2007;1:98–106. [PMC free article] [PubMed] [Google Scholar]
  • 4.Steele R.J.C., McClements P.L., Libby G., Black R., Morton C., Birrell J., Mowat N.A.G., Wilson J.A., Kenicer M., Carey F.A., et al. Results from the first three rounds of the Scottish demonstration pilot of FOBT screening for colorectal cancer. Gut. 2009;58:530–535. doi: 10.1136/gut.2008.162883. [DOI] [PubMed] [Google Scholar]
  • 5.Bretthauer M. Colorectal cancer screening. J. Intern. Med. 2011;270:87–98. doi: 10.1111/j.1365-2796.2011.02399.x. [DOI] [PubMed] [Google Scholar]
  • 6.Pox C.P., Altenhofen L., Brenner H., Theilmeier A., Von Stillfried D., Schmiegel W. Efficacy of a nationwide screening colonoscopy program for colorectal cancer. Gastroenterology. 2012;142:1460–1467.e2. doi: 10.1053/j.gastro.2012.03.022. [DOI] [PubMed] [Google Scholar]
  • 7.Kaminski M.F., Regula J., Kraszewska E., Polkowski M., Wojciechowska U., Didkowska J., Zwierko M., Rupinski M., Nowacki M.P., Butruk E. Quality indicators for colonoscopy and the risk of interval cancer. N. Engl. J. Med. 2010;362:1795–1803. doi: 10.1056/NEJMoa0907667. [DOI] [PubMed] [Google Scholar]
  • 8.El-Shami K., Oeffinger K.C., Erb N.L., Willis A., Bretsch J.K., Pratt-Chapman M.L., Cannady R.S., Wong S.L., Rose J., Barbour A.L., et al. American Cancer Society Colorectal Cancer Survivorship Care Guidelines. CA Cancer J. Clin. 2015;65:428–455. doi: 10.3322/caac.21286. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Primrose J.N., Perera R., Gray A., Rose P., Fuller A., Corkhill A., George S., Mant D. FACS Trial Investigators Effect of 3 to 5 years of scheduled CEA and CT follow-up to detect recurrence of colorectal cancer: The FACS randomized clinical trial. JAMA. 2014;311:263–270. doi: 10.1001/jama.2013.285718. [DOI] [PubMed] [Google Scholar]
  • 10.Linee Guida Tumori Del Colon. [(accessed on 23 January 2023)]. Available online: https://www.aiom.it/linee-guida-aiom-2021-tumori-del-colon/
  • 11.Inadomi J.M., Vijan S., Janz N.K., Fagerlin A., Thomas J.P., Lin Y.V., Muñoz R., Lau C., Somsouk M., El-Nachef N., et al. Adherence to colorectal cancer screening: A randomized clinical trial of competing strategies. Arch. Intern. Med. 2012;172:575–582. doi: 10.1001/archinternmed.2012.332. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Kew G.S., Koh C.J. Strategies to Improve Persistent Adherence in Colorectal Cancer Screening. Gut Liver. 2020;14:546–552. doi: 10.5009/gnl19306. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Jang M., Kim S.S., Lee J. Cancer cell metabolism: Implications for therapeutic targets. Exp. Mol. Med. 2013;45:e45. doi: 10.1038/emm.2013.85. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Van der Paal J., Neyts E.C., Verlackt C.C.W., Bogaerts A. Effect of lipid peroxidation on membrane permeability of cancer and normal cells subjected to oxidative stress. Chem. Sci. 2015;7:489–498. doi: 10.1039/C5SC02311D. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Masotti L., Casali E., Gesmundo N., Sartor G., Galeotti T., Borrello S., Piretti M.V., Pagliuca G. Lipid peroxidation in cancer cells: Chemical and physical studies. Ann. N. Y. Acad. Sci. 1988;551:47–57. doi: 10.1111/j.1749-6632.1988.tb22319.x. discussion 57–58. [DOI] [PubMed] [Google Scholar]
  • 16.Schmidt K., Podmore I. Current Challenges in Volatile Organic Compounds Analysis as Potential Biomarkers of Cancer. J. Biomark. 2015;2015:981458. doi: 10.1155/2015/981458. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Wang C., Li P., Lian A., Sun B., Wang X., Guo L., Chi C., Liu S., Zhao W., Luo S., et al. Blood volatile compounds as biomarkers for colorectal cancer. Cancer Biol. Ther. 2014;15:200–206. doi: 10.4161/cbt.26723. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Amann A., Mochalski P., Ruzsanyi V., Broza Y.Y., Haick H. Assessment of the exhalation kinetics of volatile cancer biomarkers based on their physicochemical properties. J. Breath Res. 2014;8:016003. doi: 10.1088/1752-7155/8/1/016003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Bratulic S., Limeta A., Dabestani S., Birgisson H., Enblad G., Stålberg K., Hesselager G., Häggman M., Höglund M., Simonson O.E., et al. Noninvasive detection of any-stage cancer using free glycosaminoglycans. Proc. Natl. Acad. Sci. USA. 2022;119:e2115328119. doi: 10.1073/pnas.2115328119. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Altomare D.F., Di Lena M., Porcelli F., Trizio L., Travaglio E., Tutino M., Dragonieri S., Memeo V., de Gennaro G. Exhaled volatile organic compounds identify patients with colorectal cancer. Br. J. Surg. 2013;100:144–150. doi: 10.1002/bjs.8942. [DOI] [PubMed] [Google Scholar]
  • 21.Di Lena M., Porcelli F., Altomare D.F. Volatile organic compounds as new biomarkers for colorectal cancer: A review. Color. Dis. 2016;18:654–663. doi: 10.1111/codi.13271. [DOI] [PubMed] [Google Scholar]
  • 22.Markar S.R., Chin S.-T., Romano A., Wiggins T., Antonowicz S., Paraskeva P., Ziprin P., Darzi A., Hanna G.B. Breath Volatile Organic Compound Profiling of Colorectal Cancer Using Selected Ion Flow-tube Mass Spectrometry. Ann. Surg. 2019;269:903–910. doi: 10.1097/SLA.0000000000002539. [DOI] [PubMed] [Google Scholar]
  • 23.Lubes G., Goodarzi M. GC-MS based metabolomics used for the identification of cancer volatile organic compounds as biomarkers. J. Pharm. Biomed. Anal. 2018;147:313–322. doi: 10.1016/j.jpba.2017.07.013. [DOI] [PubMed] [Google Scholar]
  • 24.Probert C.S.J., Ahmed I., Khalid T., Johnson E., Smith S., Ratcliffe N. Volatile organic compounds as diagnostic biomarkers in gastrointestinal and liver diseases. J. Gastrointest. Liver Dis. JGLD. 2009;18:337–343. [PubMed] [Google Scholar]
  • 25.Nishiumi S., Suzuki M., Kobayashi T., Matsubara A., Azuma T., Yoshida M. Metabolomics for Biomarker Discovery in Gastroenterological Cancer. Metabolites. 2014;4:547–571. doi: 10.3390/metabo4030547. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Zonta G., Anania G., Astolfi M., Feo C., Gaiardo A., Gherardi S., Alessio G., Guidi V., Landini N., Palmonari C., et al. Chemoresistive sensors for colorectal cancer preventive screening through fecal odor: Double-blind approach. Sens. Actuators B Chem. 2019;301:127062. doi: 10.1016/j.snb.2019.127062. [DOI] [Google Scholar]
  • 27.Astolfi M., Rispoli G., Anania G., Artioli E., Nevoso V., Zonta G., Malagù C. Tin, Titanium, Tantalum, Vanadium and Niobium Oxide Based Sensors to Detect Colorectal Cancer Exhalations in Blood Samples. Molecules. 2021;26:466. doi: 10.3390/molecules26020466. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Astolfi M., Rispoli G., Anania G., Nevoso V., Artioli E., Landini N., Benedusi M., Melloni E., Secchiero P., Tisato V., et al. Colorectal Cancer Study with Nanostructured Sensors: Tumor Marker Screening of Patient Biopsies. Nanomater. Basel Switz. 2020;10:606. doi: 10.3390/nano10040606. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Astolfi M., Rispoli G., Benedusi M., Zonta G., Landini N., Valacchi G., Malagù C. Chemoresistive Sensors for Cellular Type Discrimination Based on Their Exhalations. Nanomater. Basel Switz. 2022;12:1111. doi: 10.3390/nano12071111. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Landini N., Anania G., Astolfi M., Fabbri B., Guidi V., Rispoli G., Valt M., Zonta G., Malagù C. Nanostructured Chemoresistive Sensors for Oncological Screening and Tumor Markers Tracking: Single Sensor Approach Applications on Human Blood and Cell Samples. Sensors. 2020;20:1411. doi: 10.3390/s20051411. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Chandrapalan S., Arasaradnam R.P. Urine as a biological modality for colorectal cancer detection. Expert Rev. Mol. Diagn. 2020;20:489–496. doi: 10.1080/14737159.2020.1738928. [DOI] [PubMed] [Google Scholar]
  • 32.Hanai Y., Shimono K., Oka H., Baba Y., Yamazaki K., Beauchamp G.K. Analysis of volatile organic compounds released from human lung cancer cells and from the urine of tumor-bearing mice. Cancer Cell Int. 2012;12:7. doi: 10.1186/1475-2867-12-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Mangler M., Freitag C., Lanowska M., Staeck O., Schneider A., Speiser D. Volatile organic compounds (VOCs) in exhaled breath of patients with breast cancer in a clinical setting. Ginekol. Pol. 2012;83:730–736. [PubMed] [Google Scholar]
  • 34.Wang C., Ke C., Wang X., Chi C., Guo L., Luo S., Guo Z., Xu G., Zhang F., Li E. Noninvasive detection of colorectal cancer by analysis of exhaled breath. Anal. Bioanal. Chem. 2014;406:4757–4763. doi: 10.1007/s00216-014-7865-x. [DOI] [PubMed] [Google Scholar]
  • 35.Filipiak W., Filipiak A., Sponring A., Schmid T., Zelger B., Ager C., Klodzinska E., Denz H., Pizzini A., Lucciarini P., et al. Comparative analyses of volatile organic compounds (VOCs) from patients, tumors and transformed cell lines for the validation of lung cancer-derived breath markers. J. Breath Res. 2014;8:027111. doi: 10.1088/1752-7155/8/2/027111. [DOI] [PubMed] [Google Scholar]
  • 36.Peng G., Hakim M., Broza Y.Y., Billan S., Abdah-Bortnyak R., Kuten A., Tisch U., Haick H. Detection of lung, breast, colorectal, and prostate cancers from exhaled breath using a single array of nanosensors. Br. J. Cancer. 2010;103:542–551. doi: 10.1038/sj.bjc.6605810. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Haick H., Broza Y.Y., Mochalski P., Ruzsanyi V., Amann A. Assessment, origin, and implementation of breath volatile cancer markers. Chem. Soc. Rev. 2014;43:1423–1449. doi: 10.1039/C3CS60329F. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Tan B., Qiu Y., Zou X., Chen T., Xie G., Cheng Y., Dong T., Zhao L., Feng B., Hu X., et al. Metabonomics identifies serum metabolite markers of colorectal cancer. J. Proteome Res. 2013;12:3000–3009. doi: 10.1021/pr400337b. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.De Meij T.G., Larbi I.B., van der Schee M.P., Lentferink Y.E., Paff T., Terhaar Sive Droste J.S., Mulder C.J., van Bodegraven A.A., de Boer N.K. Electronic nose can discriminate colorectal carcinoma and advanced adenomas by fecal volatile biomarker analysis: Proof of principle study. Int. J. Cancer. 2014;134:1132–1138. doi: 10.1002/ijc.28446. [DOI] [PubMed] [Google Scholar]
  • 40.Malagù C., Gherardi S., Zonta G., Landini N., Giberti A., Fabbri B., Gaiardo A., Anania G., Rispoli G., Scagliarini L. SCENT B1. No. 102015000057717. Italian Patent. 2015 October 2;
  • 41.SCENT. [(accessed on 23 January 2023)]. Available online: https://www.scent-srl.it/#loaded.
  • 42.Colorectal Cancer: Follow-Up Care. [(accessed on 23 January 2023)]. Available online: https://www.cancer.net/cancer-types/colorectal-cancer/follow-care.
  • 43.Dutta M., Mridha S., Basak D. Effect of sol concentration on the properties of ZnO thin films prepared by sol–gel technique. Appl. Surf. Sci. 2008;254:2743–2747. doi: 10.1016/j.apsusc.2007.10.009. [DOI] [Google Scholar]
  • 44.Chiorino A., Ghiotti G., Prinetto F., Carotta M.C., Malagù C., Martinelli G. Preparation and characterization of SnO2 and WOx–SnO2 nanosized powders and thick films for gas sensing. Sens. Actuators B Chem. 2001;78:89–97. doi: 10.1016/S0925-4005(01)00795-X. [DOI] [Google Scholar]
  • 45.Band Bending in Semiconductors: Chemical and Physical Consequences at Surfaces and Interfaces | Chemical Reviews. [(accessed on 23 January 2023)]. Available online: https://pubs.acs.org/doi/10.1021/cr3000626. [DOI] [PubMed]
  • 46.Bârsan N., Hübner M., Weimar U. Conduction mechanisms in SnO2 based polycrystalline thick film gas sensors exposed to CO and H2 in different oxygen backgrounds. Sens. Actuators B Chem. 2011;157:510–517. doi: 10.1016/j.snb.2011.05.011. [DOI] [Google Scholar]
  • 47.Carotta M.C., Gherardi S., Guidi V., Malagu’ C., Martinelli G., Vendemiati B., Sacerdoti M., Ghiotti G., Morandi S., Bismuto A., et al. (Ti, Sn)O2 binary solid solutions for gas sensing: Spectroscopic, optical and transport properties. Sens. Actuators B Chem. 2008;130:38–45. doi: 10.1016/j.snb.2007.07.112. [DOI] [Google Scholar]
  • 48.Navas D., Fuentes S., Castro-Alvarez A., Chavez-Angel E. Review on Sol-Gel Synthesis of Perovskite and Oxide Nanomaterials. Gels Basel Switz. 2021;7:275. doi: 10.3390/gels7040275. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Nguyen C.M., Rao S., Yang X., Dubey S., Mays J., Cao H., Chiao J.-C. Sol-gel deposition of iridium oxide for biomedical micro-devices. Sensors. 2015;15:4212–4228. doi: 10.3390/s150204212. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Gaiardo A., Zonta G., Gherardi S., Malagù C., Fabbri B., Valt M., Vanzetti L., Landini N., Casotti D., Cruciani G., et al. Nanostructured SmFeO3 Gas Sensors: Investigation of the Gas Sensing Performance Reproducibility for Colorectal Cancer Screening. Sensors. 2020;20:5910. doi: 10.3390/s20205910. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Gherardi S., Zonta G., Astolfi M., Malagù C. Humidity effects on SnO2 and (SnTiNb)O2 sensors response to CO and two-dimensional calibration treatment. Mater. Sci. Eng. B. 2021;265:115013. doi: 10.1016/j.mseb.2020.115013. [DOI] [Google Scholar]
  • 52.Astolfi M., Rispoli G., Gherardi S., Zonta G., Malagù C. Reproducibility and Repeatability Tests on (SnTiNb)O2 Sensors in Detecting ppm-Concentrations of CO and Up to 40% of Humidity: A Statistical Approach. Sensors. 2023;23:1983. doi: 10.3390/s23041983. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Carotta M.C., Guidi V., Malagù C., Vendemiati B., Zanni A., Martinelli G., Sacerdoti M., Licoccia S., Vona M.L.D., Traversa E. Vanadium and tantalum-doped titanium oxide (TiTaV): A novel material for gas sensing. Sens. Actuators B Chem. 2005;108:89–96. doi: 10.1016/j.snb.2004.11.070. [DOI] [Google Scholar]
  • 54.Bârsan N., Weimar U. Understanding the fundamental principles of metal oxide based gas sensors; the example of CO sensing with SnO2 sensors in the presence of humidity. J. Phys. Condens. Matter. 2003;15:R813. doi: 10.1088/0953-8984/15/20/201. [DOI] [Google Scholar]
  • 55.Dey A. Semiconductor metal oxide gas sensors: A review. Mater. Sci. Eng. B. 2018;229:206–217. doi: 10.1016/j.mseb.2017.12.036. [DOI] [Google Scholar]
  • 56.Zonta G., Astolfi M., Casotti D., Cruciani G., Fabbri B., Gaiardo A., Gherardi S., Guidi V., Landini N., Valt M., et al. Reproducibility tests with zinc oxide thick-film sensors. Ceram. Int. 2020;46:6847–6855. doi: 10.1016/j.ceramint.2019.11.178. [DOI] [Google Scholar]
  • 57.Obuchowski N.A., Bullen J.A. Receiver operating characteristic (ROC) curves: Review of methods with applications in diagnostic medicine. Phys. Med. Biol. 2018;63:07TR01. doi: 10.1088/1361-6560/aab4b1. [DOI] [PubMed] [Google Scholar]
  • 58.Obuchowski N.A., Lieber M.L., Wians F.H. ROC curves in clinical chemistry: Uses, misuses, and possible solutions. Clin. Chem. 2004;50:1118–1125. doi: 10.1373/clinchem.2004.031823. [DOI] [PubMed] [Google Scholar]
  • 59.Jolliffe I.T., Cadima J. Principal component analysis: A review and recent developments. Philos. Trans. R. Soc. Math. Phys. Eng. Sci. 2016;374:20150202. doi: 10.1098/rsta.2015.0202. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Data Availability Statement

Data are available under request.


Articles from Cancers are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES