Abstract
This work introduces a refractometric sensor based on multiple cascaded Michelson interferometers fabricated with long-period fiber gratings to classify different commercial brands of paracetamol as well as to measure solutions with different paracetamol concentrations. The operating principle is based on the interaction of light with the fiber–medium interface, such that variations in the refractive index provoke changes in the spectrum profile that can be measured at the output of the device. The brands used were Medley, Mejoral 500, Tempra, Tylenol, and excipient-free paracetamol (EFP). A support vector machine (SVM) classifier was used to recognize each brand with an F1-score of 92%. Also, using a projection to latent structures regression (PLSR), it was possible to quantify the paracetamol concentration with the best limit of detection (LOD) of 1.58 g/kg for the Mejoral brand.
Keywords: refractometric sensor, cascaded Michelson interferometers, optical fiber, paracetamol, projection to latent structures, support vector machine, projection to latent structures regression
1. Introduction
Nowadays, it is important to investigate the quality of widely used medicines, as well as those that, due to their specific characteristics, may have adverse effects on human health. Several studies have been conducted on paracetamol tablets due to their easy access and increased use, for example, during the COVID-19 pandemic. There are different studies such as the uniformity of unit doses by weight variation, in which the variability of weight per tablet was measured, studies of the solubility of different paracetamol tablets using standard methods in solvents such as distilled water, ethanol, propylene glycol, and glycerin, as well as degradation kinetics using high-performance liquid chromatography, where notable variations were observed as a result of different excipient compositions in the formulas and pharmaceutical technology [1,2,3,4,5,6,7]. In addition, methods have been developed to crystallize the active pharmaceutical ingredients (APIs) of paracetamol for isolation and purification [8,9,10]. Many of these studies have been performed using optical fiber sensors [11,12,13].
On the other hand, refractometric sensors based on long-period fiber gratings (LPFGs) represent a promising technology for detection in various applications, as they offer advantages in terms of sensitivity, size, flexibility, and durability. These types of sensors have been used to detect the salinity level of water, urea, pH, glucose, ammonia, E. coli, the crystallization process of paracetamol, among others [14,15,16,17,18]. LPFGs are intrinsically sensitive to changes in the surrounding refractive index, which has enabled their use in the development of sensors based on Michelson and Mach–Zehnder interferometers, widely recognized for their high precision and versatility in multiple applications. In the literature, some works have been reported that employ LPFG-based interferometric sensors for sensing changes in refractive index and detecting chemical compounds in liquid solutions, demonstrating their high sensitivity and stability. For instance, Swart et al. demonstrated the feasibility of using the LPFG-based Michelson interferometer to measure the refractive index and concentration of glycerin mixtures, as well as the immersion depth of the sensor in a liquid and its temperature sensitivity, while Zhuo et al. and Kim et al. used a similar configuration to measure different concentrations in glycerin and glucose solutions, respectively, achieving high system resolution [19,20,21,22]. Moreover, Murphy et al. [23] demonstrated that it is possible to multiplex independent LPFG-based Mach–Zehnder interferometers by observing the phase changes in the fringe patterns due to changes in the refractive index and temperature of Cargille oil. In a previous work [24], we showed the effectiveness of this type of sensor for detecting acetone, which is a biomarker of diabetes mellitus. However, to the best of our current knowledge, the application of LPFG-based sensors for measuring concentration in paracetamol solutions has not been previously reported. Furthermore, machine learning (ML) techniques have not been explored enough for processing the data obtained with LPFG-based sensors. The tools provided by ML for analyzing information are mathematical models that transform complex information into easy-to-interpret data, finding hidden relationships in the original information and discriminating between relevant elements within the data [25,26]. In particular, different ML approaches have been applied to spectral data processing, including methods such as projection to latent structures (PLS), PLS regression (PLSR), support vector machines (SVM) and artificial neural networks (ANN), which have shown usefulness in tasks of classification, prediction and quantitative analysis of such spectral data [27,28,29,30,31,32]. In previous works, we have also shown the effectiveness of SVM applied to this kind of sensor [33,34].
In this study, a smart refractometric LPFG sensor was developed to identify four commercial pharmaceutical brands and to determine (by regression) the API and/or excipient concentration in a solution created using 500 mg tablets for each pharmaceutical brand. The commercial pharmaceutical brands analyzed were Medley, Mejoral 500, Tempra, and Tylenol, as well as excipient-free paracetamol (EFP). This refractometric sensor consisted of four Michelson interferometers in series with different arm lengths and based on four different LPFGs as splitter devices. The interferometric output signal allowed us to observe notable variations in the measured spectral profiles due to the different concentrations and compositions of paracetamol and excipients in the brands studied, respectively. The data were analyzed using PLS as a technique for dimensionality reduction and feature extraction. The use of this technique was necessary to perform the recognition of the different brands, taking advantage of the information contained in the complete spectrum, a task that is not possible to achieve with the traditional demodulation technique. The excipient and paracetamol concentrations were quantified using regressions (PLSR) with the selected latent structures (LSs). The SVM algorithm was used for the recognition task. The results from this sensor showed that it was possible to recognize each brand of paracetamol with an F1-score of 92%, while the best quantification of paracetamol concentration was achieved with an LOD of 1.58 g/kg for the Mejoral brand and an LOD of 1.93 mg for the quantification of the excipient in the Tempra brand.
2. Theory
2.1. Michelson Interferometer
An optical fiber refractometer sensor is an optical device designed to measure changes in the refractive index of a medium [35,36]. Its operating principle is based on the interaction of light with the fiber-medium interface, such that variations in the refractive index provoke changes in the intensity, phase, or wavelength of the detected optical signal [35], which means a change in the spectrum profile that can be measured at the output of the device. These kinds of sensors are widely used in chemical, biomedical, and environmental applications due to their high sensitivity, immunity to electromagnetic interference, and potential for integration into optical fiber systems [37,38]. In this work, we propose the use of a Michelson interferometer in an optical fiber by using an LPFG as a beam splitter [21,39] as shown in Figure 1. The system works as follows: the fundamental mode of the core travels through the LPFG, which couples part of the energy to a cladding mode, resulting in two beams, one traveling essentially in the core and the other one in the cladding [40]. Both beams are reflected at the fiber tip (boundary with the external medium) due to the difference in refractive indices [21]. These beams travel again through the LPFG in backward propagation in the core (solid and dotted lines), generating interference [39]. The circulator was used to direct these beams toward the optical spectrum analyzer (OSA).
Figure 1.
Michelson interferometer based on LPFG.
A simple estimation of the interference spectrum can be given as follows: the amplitude of the reflected waves depends on Fresnel reflection (Equation (1)) at the monitored fiber–solution interface [13].
| (1) |
where corresponds to the effective refractive index of the core and cladding of the optical fiber, respectively, and corresponds to the refractive index of liquid solutions with different concentrations of paracetamol and/or excipient content.
On the other hand, an LPFG is a wavelength-selective filter whose transmission spectra exhibit several resonance peaks resulting from the coupling between the core mode and the different co-propagating cladding modes at wavelengths that obey the resonance condition of Equation (2) [35].
| (2) |
where represents the resonance wavelengths, the grating period, and and are the effective refractive indices of the core and -th cladding modes, respectively. The electric field intensity at the circulator output can be evaluated as the superposition of two waves whose intensity can be evaluated using Equation (3) [39].
| (3) |
where represents the phases of each beam. The phase difference can be evaluated as in Equation (4) [39].
| (4) |
where is the wavelength, is the length of the interferometer arms, and is the effective index of the -th cladding mode, which must also be affected by variations in the refractive index of the external medium. In this way, the interference pattern can be affected by amplitude (Equation (1)) and phase variations (Equation (4)). The term increases the sensitivity of the sensor based on this interferometer. Furthermore, it is possible to place another interferometer of this type by placing another LPFG, with a different period, in cascade with the first one and at a different distance . If we add more interferometers, we should consider the interference of beams [39] where is the number of interferometers. However, since in our case the LPFGs are different, for simplicity we considered that the total intensity was the simple superposition of patterns of the type in Equation (3), and we would expect a new pattern with a more complex profile. Figure 2a shows the ideal interference pattern for a single interferometer, while Figure 2b shows the intensity pattern of the superposition of two patterns with different values. The profile of the latter must change in a more complex way than the former in function of changes in the refractive index of the external medium.
Figure 2.
Interferometric intensity as a function of wavelength . (a) Ideal intensity pattern for a single interferometer. (b) Ideal intensity pattern for two different interferometers.
In general, we can expect an interference pattern with an intensity described by Equation (5).
| (5) |
In this work, we propose a sensor consisting of four Michelson interferometers () formed by different LPFGs in cascade with different lengths (see Figure 3), to generate a complex interference pattern, which would be a particular fingerprint for each commercial pharmaceutical brand that allows the recognition and quantification of the paracetamol brands.
Figure 3.
General diagram of the refractometer sensor head with four different LPFGs.
2.2. Machine Learning Techniques
To analyze the interferometric patterns, PLS was used, which is a supervised multivariate analysis method used to model the relationship between a set of predictor variables and one (or several) sets of response variables . PLS reduces the dimensionality of the data using latent variables, constructed in such a way as to maximize the covariance between and , which makes it particularly useful when there are many variables with high collinearity and a limited number of samples [41,42]. Particularly, in the present work, the PLS-NIPALS algorithm was used, whose steps are shown below [41]:
a. We defined a starting vector , that in our case was a vector with the API (or excipient) concentrations measured related to the respective spectrum, which was also equal to , as shown in Equation (6).
| (6) |
b. Then, the weights of the matrix were calculated using Equation (7).
| (7) |
These vectors are intended to help to find the LSs that are most correlated with the values of .
c. The next step was to project the matrix onto the vector to generate the first LS, of , as shown in Equation (8).
| (8) |
d. From the vectors , the weights of the matrix were calculated from Equation (9).
| (9) |
e. The vector was updated as shown in Equation (10).
| (10) |
f. Then the convergence verification was performed, i.e., the current LS was compared with the LS calculated in the last iteration.
| (11) |
where commonly has a value between and . If this relationship is not fulfilled, it is necessary to go back to step until it is satisfied.
g. The and matrices were deflated, and they were used as and to calculate the following structure.
| (12) |
| (13) |
where is the -loading vector, defined in Equation (14).
| (14) |
h. Each time a useful vector was found, it was defined as the new LS and stored in a matrix . Similarly, the weight vector , and the load vector , were stored in matrices and respectively. This process was repeated until the desired number of LSs was reached.
Once the necessary LS has been chosen, a regression can be performed with this LS (PLSR) to quantify the independent variable (). On the other hand, with the same LSs, a classification algorithm can be used to recognize the analyzed brands.
SVM is a supervised learning method widely used in classification problems. The general idea behind SVM is to construct a hyperplane to split a set of data [43,44]. The hyperplane is written as Equation (15).
| (15) |
where (a vector with elements) and constant are the hyperplane parameters and is a vector with features values . For simplicity, Figure 4 shows a graphical representation of the SVM with two different cases of hyperplanes that separate two different kinds of data sets . As can be seen, the blue margin width determines the SVM performance to correctly classify each class. The main target of SVM is to optimize (a vector normal to the hyperplane) and values to maximize the margin width; it can be shown that this optimization can be reached when is minimum and subject to , where is the class label (−1 or 1), for each class respectively [45].
Figure 4.
Graphical representation of the SVM showing the separation of two different data classes by a hyperplane (). (a) Optimum value, (b) non-optimum value.
Classification could be done by just evaluating the sign of the hyperplane:
| (16) |
The vectors that determine the boundaries of the margin are called the support vectors. Another interesting characteristic of SVM classifiers is the possibility to use the so-called kernel trick. When data are not linearly separable, it is still possible to perform classification if some high-dimensional information is added to the original data. Figure 5 shows a graphical representation of the separation of data using the kernel trick for the case when Data in the original space are not linearly separable, however, in the space this separation is possible by the hyperplane shown on the figure. All this can be done without changing the original optimization strategy and this is one of the reasons why SVM is a successful machine learning algorithm.
Figure 5.
Non-linearly separable data in 2D . The kernel trick allows classification by including new dimensions .
To quantify the performance of the SVM model, a confusion matrix was used, in which true positives/negatives (TP/TN) and false positives/negatives (FP/FN) were recorded graphically. Based on these values, it is possible to calculate metrics such as accuracy, precision, recall, specificity and F1-score, which allow an objective quantification of the SVM model’s ability to correctly classify data.
For multi-class classification, the metrics defined for binary problems cannot be applied directly. The confusion matrix for multiple classes has a dimension, where corresponds to the number of classes . In this context, the traditional definition of TP, TN, FP, FN loses its overall meaning, so the analysis must focus on each class individually, following the characterization shown in Figure 6. Using this approach, it is possible to obtain metrics per class and then combine them appropriately to obtain overall indicators of model performance [46].
Figure 6.
Multiclass confusion matrix.
Here, the rows correspond to the predicted class, and the columns correspond to the true class. The cells on the diagonal correspond to measurements that have been classified correctly (TP, green square). The cells outside the diagonal correspond to incorrectly classified measurements. In particular, the row of one of the classes (except for the cell on the diagonal) represents the FP (blue squares) of the classifier, as it indicates the measurements that were predicted to belong to that class, but whose true class is different. The column represents FN (yellow squares), i.e., observations whose true class is that class but were classified as another. TN (white squares) are obtained by considering measurements that do not belong to that class and were not classified as such. Taking these quantities into account, it is possible to calculate the model performance metrics as shown in Table 1.
Table 1.
Metrics for class and global metrics of the SVM model.
| Metrics per Class | Equation | Global Metrics | Equation |
|---|---|---|---|
To quantify concentration levels, PLSR was used, which is a specific application of PLS focused on regression problems. In PLSR, the latent variables obtained through PLS are used directly to make a regression model capable of predicting one or more response variables. In this way, PLSR combines dimensionality reduction and regression model estimation in a single procedure, maintaining its robustness against collinearity and noise in the data [41].
Figure 7 shows the general scheme for brand recognition and quantification of paracetamol and/or excipient present in a solution, which is divided into three stages: (1) The use of PLS for dimensionality reduction and extraction of relevant features from the spectra; an appropriate number of LSs was chosen. (2) Recognition of the drug brand: with the selected LSs, an SVM algorithm was trained to recognize the drug brand under analysis. Finally, (3) the use of PLSR for the quantification of the concentration of paracetamol. Once the drug brand has been determined, the corresponding PLSR model was used to quantify the concentration of paracetamol and/or excipient.
Figure 7.
Diagram of the system for recognizing the brand and quantifying the concentration of paracetamol (or excipient) in a solution.
2.3. Experimental Setup to Record LPFGs
Figure 8 shows the experimental setup to record LPFGs. A single-mode optical fiber (SMF-28) with a total length of 80 cm was used. The central section of 10 cm of fiber was stripped and cleaned with ethanol to remove any residue or contaminants. One end of the fiber was then spliced to a superluminescent diode (SLD1450S, Thorlabs, Newton, NJ, USA), which operates in the spectral range from 1430 nm to 1530 nm. The other end of the fiber was spliced to an optical spectrum analyzer (OSA, Ando AQ6315A model 9057 F/8, Tokyo, Japan) to measure the transmission spectrum. A linear actuator (TLA28A, Zaber, Newton, NJ, USA) with a resolution of 1 µm was used for the LPFG recording process. The arc of a splicer was used to generate variations in the refractive index of the fiber, which we call a point. Four LPFGs of 15 points each were recorded with different periods (separation between points). The LPFGs were recorded with a separation of 2 cm and modulation periods of 450 µm, 475 µm, 500 µm, and 525 µm, respectively. The tip of the fiber was cleaved using an optical fiber cutter to ensure reflection.
Figure 8.
Experimental setup for the LPFGs recording.
In Figure 9a, we show the raw data of the experimental reflection spectrum of the constructed sensor, and in the inset we show the spectrum of the superluminescent diode as the light source. The normalized reflection spectrum without the source spectrum contribution is shown in Figure 9b. From this figure, we can note that the spectrum resembles the one shown in Figure 2b with a complex profile, which, as was mentioned before, can be used to identify the fingerprints for each commercial pharmaceutical brand analyzed in this work.
Figure 9.
Experimental reflection spectrum of the sensor: (a) raw data (the source spectrum is shown in the inset), (b) without the light source contribution.
2.4. Paracetamol Solutions Preparation
The procedure for preparing the solutions was carried out to obtain concentrations of 150, 200, 250, and 300 g/kg for the commercial brands Medley, Mejoral, Tempra, Tylenol, and EFP. According to the information provided by the manufacturers, each tablet of these brands contains 500 mg of API, with an undetermined amount of excipient.
First, an analytical balance was used to determine the individual mass of each tablet and, subsequently, the total mass of the groups corresponding to each concentration. Assuming a content of 500 mg of API per tablet, it was possible to estimate the amount of excipient present, denoted as .
Next, each group of tablets was pulverized in a ceramic mortar, and the resulting powder was transferred to the container used to prepare the solution. The results obtained are summarized in Table 2.
Table 2.
Mass used in each solution for each commercial pharmaceutical brand of paracetamol.
| Brand | Concentration (g/kg) | (mg) | API (mg) | Excipient (mg) |
|---|---|---|---|---|
| Medley | 150 | 1646 | 1500 | 146 |
| 200 | 2208 | 2000 | 208 | |
| 250 | 2751 | 2500 | 251 | |
| 300 | 3293 | 3000 | 293 | |
| Mejoral | 150 | 1753 | 1500 | 253 |
| 200 | 2335 | 2000 | 335 | |
| 250 | 2942 | 2500 | 442 | |
| 300 | 3513 | 3000 | 513 | |
| Tempra | 150 | 1699 | 1500 | 199 |
| 200 | 2237 | 2000 | 237 | |
| 250 | 2824 | 2500 | 324 | |
| 300 | 3373 | 3000 | 373 | |
| Tylenol | 150 | 1817 | 1500 | 317 |
| 200 | 2419 | 2000 | 419 | |
| 250 | 3042 | 2500 | 542 | |
| 300 | 3634 | 3000 | 634 |
The solutions with and without paracetamol were prepared at room temperature. A mixture of distilled water and ethanol in a ratio of 60%/40% (m/m) was added to the solute. Considering a total solvent mass of 10 g, this is equivalent to 6 g of water and 4 g of ethanol. The resulting mixture was stirred for 10 min to promote homogenization, obtaining, for example, a solution with a concentration of 1500 mg/10 g (solute/solvent), equivalent to 150 g/kg.
For control solutions, i.e., those prepared without paracetamol, the same proportions of distilled water/ethanol and the same stirring time were used. The purpose was to verify the sensor’s ability to distinguish between samples with and without paracetamol and, additionally, to facilitate the removal of any residue accumulated on the sensor after each measurement.
In the case of EFP (purchased from Sigma-Aldrich (St. Louis, MO, USA), CAS: 103-90-2, with a purity level of 99%), the required amount of API was measured directly using the analytical balance. The solutions with and without paracetamol were prepared using the same proportions of distilled water/ethanol and under the same experimental conditions applied to the commercial brands, following the process described above.
2.5. Solutions Measurement
Once the sensor was fabricated, it was integrated into an experimental setup for paracetamol/control solution measurement. The experimental setup consisted of an SLD connected to the first port of an optical circulator; the second port was connected to the sensor head, and the third port was connected to an OSA, for measuring the reflectance spectra of each solution prepared for all brands studied in this work (see Figure 10).
Figure 10.
Experimental setup to measure the reflection spectrum of the sensor head for paracetamol/control solution.
Once the experimental setup was ready and the solutions were prepared, the sensor head was placed inside a solution with a concentration of 150 g/kg for a period of 20 min. During this interval, the OSA acquired one reflection spectrum per minute. At the end of the measurement, the sensor was immersed in a control solution under the same experimental conditions, again obtaining one spectrum per minute for 20 min. This allowed the sensor response to be verified in the absence of paracetamol and, at the same time, facilitated the removal of any residues that may have accumulated on the sensor head during the previous measurement. This procedure was repeated for each of the concentrations evaluated (200 g/kg, 250 g/kg, and 300 g/kg), reusing the sensor in each of the measurements, obtaining a set of three measurements per concentration (240 spectra for each brand) and other set of three measurements corresponding to their respective controls (1200 spectra), giving a total of 2400 spectra.
3. Results and Discussion
Figure 11 shows an example of the output spectra for the Tempra brand sample at different paracetamol concentrations, together with the spectral responses of all brands at the same concentration. Figure 11a displays three measurements for each concentration over time, one per minute for 20 min (240 spectra). In the figure, some changes in the spectra can be seen as a function of concentration, which may be used to predict concentrations from a single spectrum; however, this task is not straightforward with these raw signals because it is not clear which information should be used since there are intensity variations and wavelength shifts. On the other hand, Figure 11b presents the sensor response spectra when exposed to a solution with a paracetamol concentration of 250 g/kg (240 spectra) and the corresponding excipient from all brands, as well as EFP (60 spectra) at the same concentration. From this figure, it can be observed that there are differences among the spectral profiles, suggesting the possibility of identifying the drug brand in the solvent. We can take advantage of this condition to recognize different paracetamol brands with the help of an ML-based classification algorithm.
Figure 11.
Refractometric sensor response. (a) Spectra response for Tempra paracetamol with different concentrations and (b) all brand spectra for 250 g/kg concentration.
Before applying the classification algorithm, as previously mentioned, PLS was used as a dimensionality reduction technique to simplify the model and increase its robustness. In addition, a feature scaling (Min–Max) [34] process was performed to highlight the relevant information in the measured spectra. Figure 12 shows the PLS results using only two latent structures (LS1 and LS2) for each brand and for the different paracetamol concentrations, from the range of 150 to 300 g/kg; EFP is also shown. Each point on this figure corresponds to a complete spectrum, three different measurements of the same concentration, measured within 20 min, each minute (60 spectra for each concentration). As can be seen from the figure, in general, all commercial brands show a common trend: measurements with low concentrations (150 g/kg, red circles) predominantly start in the third quadrant (III), while at the next concentration level data (200 g/kg, green circles) are now in the second quadrant (II). This behavior is maintained at the following concentration values (250 and 300 g/kg, blue and magenta circles); they clustered together in the fourth (IV) and first quadrants (I), respectively. Figure 12e shows that PLS for the EFP does not follow this trend, which may be attributed to the crystallization of the dissolved drug on the surface of the sensor head, as will be discussed in the next paragraph.
Figure 12.
PLS using 2 LSs with different concentrations from 150 to 300 g/kg for the brands: (a) Medley, (b) Mejoral, (c) Tempra, (d) Tylenol and (e) EFP.
Crystallization of paracetamol is quite a common phenomenon [8,9,10], Figure 13a,b show the sensor head after 20 min measurement in Tylenol and EFP solutions both at a concentration of 300 g/kg, respectively. Figure 13c,d show the sensor head section after 20 min rinsing with the control solution for both cases, where we can observe that the crystals were removed. From this figure, it can be noted that the main difference between measurements is the abundance of crystals, which is larger in the EFP case than in the Tylenol solution. We think that crystallization can decrease the contact area of the sensor head with the EFP solution, complicating the measurement and, as a result, its recognition.
Figure 13.
(a,b) Sensor head after 20 min in Tylenol and EFP 300 g/kg paracetamol solution, respectively. (c,d) Sensor head after rinsing with the control solution, respectively, showing crystallization removal.
The complication in recognizing different concentrations because of the crystallization phenomenon can also be noticed from raw data of the sensor shown in Figure 14, where the spectra look similar for any concentration. However, as is shown in Figure 12e, PLS is still capable of distinguishing the different concentrations. However, we believe that this behavior is not relevant, since paracetamol is usually accessed through drugs that do not contain it in its pure form, and as will be seen later, even with this behavior, it is still possible to estimate its concentration in a suitable manner.
Figure 14.
Raw data for the sensor response to the different EFP concentrations.
Figure 15a shows the PLS for all paracetamol brands. This figure shows that there are clusters for each brand with partial overlaps, but they can still be recognized. Moreover, more LSs can be included to improve the classification. Figure 15b shows the PLS results with three LSs. This figure shows that brands with lower excipient content (see Table 2) are closer to EFP, while those with higher excipient content appear more separated. However, the Tempra brand data cluster is the farthest despite not having the highest amount of excipient. We think this is due to the nature of the excipient recipe used by this brand, which may not be like the other brands included in this study. Nevertheless, there was a notable improvement in the separation of the data clusters, although it is still possible to observe partial overlaps between each group, which makes it difficult to correctly classify each brand. It is still possible to further improve this separation by using a larger number of LSs; however, it is also possible to fall into overfitting, where the classifier correctly classifies the training data, but with new data (not present in the training set) performance could become poor. To determine the appropriate number of LSs, a cross-validation strategy was used in which two data sets were generated, one for training (measurement 1 and 2, 1600 spectra) and one for validation (measurement 3, 800 spectra), using k-fold strategy (k = 5) and a gaussian kernel with auto-scale in the SVM training, which means training the model with 80% of the data and performing validation with the remaining 20%. This process was performed with the latent structures obtained with the PLS over all the experimental spectra, starting with one LS until 10 LSs, increasing one by one and recording the F1-score each time.
Figure 15.
PLS for all brands and EFP using (a) 2 LSs and (b) 3 LSs.
Figure 16 shows the evolution of the SVM model performance (learning curve) for the F1-score of the training and validation data as the number of LSs increases. The x-axis shows the number of LSs used, while the y-axis shows the average F1-score calculated from the confusion matrix at each stage of the learning curve. This graph shows that, starting with the fourth LS, the validation F1-score no longer changes significantly, even when this value continues increasing in the training set. Thus, the optimal number of LSs to use was four, since using a larger number of LSs could potentially lead to overfitting.
Figure 16.
Learning curve of the SVM classifier (F1-score) as a function of the number of LSs.
Figure 17 shows the results of the confusion matrix for the SVM model using four LSs. The model was trained to identify six different classes: Control, Medley, Mejoral, EFP, Tempra, and Tylenol. The SVM was trained with a Gaussian kernel with auto-scaling and k-fold cross-validation with k = 5. The figure shows two numbers in each square; the numbers above represent the total number of correct or incorrect classifications of the measurements, while the numbers below are the percentages relative to the total number of trained measurements. On the other hand, the percentages in the last column correspond to the precision for each class (percentage in green) and the false discovery rate (percentage in red). The information in the last row corresponds to the recall metric (green) and the false negative rate (red).
Figure 17.
Multivariable confusion matrix using four LSs for the trained SVM to recognize the four paracetamol brands, EFP and control.
The results showed that for the control, 1182 predictions were made correctly (representing a precision of 97.8%, while the predictions for Medley, Mejoral, Tempra, Tylenol, and EFP were 211, 219, 223, 199, and 198 correct predictions (92.1%, 92%, 93.3%, 90.5%, and 87.6%) precision, respectively. Table 3 shows a summary of the classifier performance metrics. The Medley brand was the best (highest F1-score) in the classification (94%) among those measurements with the paracetamol/excipient mixture, while the Tylenol brand obtained the lowest F1-score (86.5%), which contains the highest concentration of excipient. On the other hand, EFP had an F1-score of 88.8%, which is quite low, probably due to the crystallization effect of paracetamol, as was mentioned before. In general, the performance of the multi-class SVM classifier has a global F1-score of 92% when identifying between different brands of paracetamol, EFP and control signals.
Table 3.
Class and global metrics of the classifier using four LSs.
| Class | Precision | Recall | Specificity | Accuracy | F1-Score |
|---|---|---|---|---|---|
| Control | 97.8% | 98.5% | 97.8% | 98.1% | 98.2% |
| Medley | 92.1% | 95.9% | 99.2% | 98.9% | 94.0% |
| Mejoral | 92.0% | 91.3% | 99.1% | 98.3% | 91.6% |
| EFP | 87.6% | 90.0% | 98.7% | 97.9% | 88.8% |
| Tempra | 93.3% | 92.9% | 99.2% | 98.6% | 93.1% |
| Tylenol | 90.5% | 82.9% | 99.0% | 97.4% | 86.5% |
| Global | 92.2% | 91.9% | 98.8% | 94.6% | 92.0% |
Once the classification task (brand identification) has been completed, it was possible to quantify the concentration of paracetamol and/or excipient present in the solution using PLSR. Figure 18 shows the relationship between experimental concentrations and the predicted concentrations using the PLSR model with only three LSs (one less LS was chosen to further reduce possible overfitting). The proximity of the points to the ideal prediction line showed high predictive power, accompanied by low dispersion with values above 0.99. These regressions were performed using data from minute 20th, when it was considered that the system had reached steady state. One parameter to evaluate the performance of the sensors is LOD, which was defined using the standard deviation between the experimental concentration values and the predicted ones (assuming SNR = 1). From these graphs, the regression for the Mejoral brand data had the lowest LOD (1.58 g/kg), while the Medley brand had the highest LOD (2.93 g/kg). In any case, the results showed a high resolution of the sensor for the different brands analyzed.
Figure 18.
PLSR of concentration using three LSs for (a) Medley, (b) Mejoral, (c) Tempra, (d) Tylenol and (e) EFP.
On the other hand, Figure 19 shows the comparison between the experimental excipient content and that predicted by the PLSR model, again using three LSs. As in the concentration analysis, the model was evaluated considering only the data at minute 20. For simplicity, all measurements are shown in a single graph. The regression model with the best LOD in the estimation of the excipient by brand was for Tempra (1.93 mg), while the highest was for Tylenol (5.12 mg). In any case, the results showed that the proposed sensor could not only estimate the concentration of paracetamol but was also able to predict the amount of excipient present in each solution.
Figure 19.
PLSR of the excipient using three LSs for the four paracetamol brands. The solid line represents the ideal prediction.
Table 4 shows a summary of the regression models for predicting paracetamol and excipient concentrations by brand, as well as the corresponding LOD. In all cases, the first three LSs were used.
Table 4.
Regression models for paracetamol and excipient concentration. The LOD for each model by brand is shown.
| Brand | Concentration Model Regression () |
LOD (g/kg) |
|---|---|---|
| Medley | 2.93 | |
| Mejoral | 1.58 | |
| EFP | 1.99 | |
| Tempra | 1.85 | |
| Tylenol | 2.45 | |
|
Excipient Model Regression () |
(mg) | |
| Medley | 2.75 | |
| Mejoral | 2.99 | |
| EFP | NA | NA |
| Tempra | 1.93 | |
| Tylenol | 5.12 |
4. Conclusions
In this work, a refractometric sensor was developed based on four cascaded Michelson interferometers with LPFGs of different periods (450, 475, 500, and 525 μm). The spectral responses of the sensor were analyzed with PLS for dimension reduction. SVM algorithm and PLSR were used to determine the brand and paracetamol/excipient content of four commercial brands of paracetamol: Medley, Mejoral, Tempra, and Tylenol, respectively, and the paracetamol concentration of EFP solutions. The results obtained showed that it was possible to determine the brand of the medication with an overall F1-score performance of the SVM classifier of 92%. On the other hand, the estimation of the concentration of paracetamol with the PLSR models for the brands had LODs of 2.93, 1.58, 1.85, and 2.45 g/kg, respectively, while for the excipient concentrations the LODs were 2.75, 2.99, 1.93, and 5.12 mg, respectively. The best LODs were Mejoral and Tempra for paracetamol and excipient concentration, respectively.
In addition, the results showed that the proposed method was sensitive to differences in composition between brands. We can also mention that the spectral response generated by the sensor contained sufficient information for both recognition and quantitative prediction. The use of multiple LPFG-based cascade interferometers is an innovative aspect of the work, as it increased the spectral complexity of the response and thus enriched the features available for ML-based analysis. Moreover, the study supports the potential of combining refractometric sensing with fiber optic and ML techniques for pharmaceutical analysis.
Finally, the standard pharmaceutical quality control methods, such as weight variation, content uniformity, and solution testing, could be complemented by the proposed sensor as a useful tool for preliminary analysis and discrimination between brands. On the other hand, compared to chromatographic techniques such as HPLC or conventional spectroscopic methods such as UV-Visible spectroscopy, the refractometric sensor has potential advantages in terms of operational simplicity and relatively shorter measurement times.
Acknowledgments
We thank Salvador Cortés Barragán for support in the experimental setup.
Abbreviations
The following abbreviations are used in this manuscript:
| EFP | Excipient-free paracetamol |
| SVM | Support vector machine |
| PLSR | Projection to latent structures regression |
| LOD | Limit of detection |
| API | Active pharmaceutical ingredient |
| LPFG | Long-period fiber grating |
| ML | Machine learning |
| PLS | Projection to latent structures |
| LS | Latent structures |
| TP | True positive |
| TN | True negative |
| FP | False positive |
| FN | False negative |
| OSA | Optical spectrum analyzer |
| SLD | Superluminescent diode |
Author Contributions
Conceptualization, C.P.-T., J.C.-M., S.M.-A. and G.B.-P.; methodology, C.P.-T., J.C.-M., S.M.-A. and G.B.-P.; validation, C.P.-T., J.C.-M., S.M.-A. and G.B.-P.; formal analysis, C.P.-T., J.C.-M., S.M.-A. and G.B.-P.; investigation, C.P.-T., J.C.-M., S.M.-A. and G.B.-P.; resources, S.M.-A. and G.B.-P.; data Curation, C.P.-T. and J.C.-M.; writing—original draft preparation, C.P.-T., J.C.-M., S.M.-A. and G.B.-P.; writing—review and editing, C.P.-T., J.C.-M., S.M.-A. and G.B.-P.; visualization, C.P.-T., J.C.-M., S.M.-A. and G.B.-P.; project administration, S.M.-A. and G.B.-P.; funding acquisition, S.M.-A. and G.B.-P. All authors have read and agreed to the published version of the manuscript.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
The data sets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.
Conflicts of Interest
The authors declare no conflicts of interest.
Funding Statement
This research was funded by SECIHTI grant number CBF-2025-G-91, VIEP grant number ID-CVIEP 00049, and SEP-CONACYT, CIENCIA BÁSICA-2016 grant number 286647.
Footnotes
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
References
- 1.Abebe K., Beressa T.B., Yimer B.T. In-Vitro Evaluations of Quality Control Parameters of Paracetamol Tablets Marketed in Gondar City, Northwest Ethiopia. Drug Healthc. Patient Saf. 2020;12:273–279. doi: 10.2147/DHPS.S282420. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Vandy A., Conteh E., Lahai M., Kolipha-Kamara M., Marah M., Marah F., Suma K.M., Mattia S.C., Tucker K.D.S., Wray V.S.E., et al. Physicochemical Quality Assessment of Various Brands of Paracetamol Tablets Sold in Freetown Municipality. Heliyon. 2024;10:e25502. doi: 10.1016/j.heliyon.2024.e25502. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Bianconi A., Zauli E., Biagiotti C., Calò G.L., Cioni G., Imperiali G., Orazi V., Acuti Martellucci C., Rosso A., Fiore M. Paracetamol Use and COVID-19 Clinical Outcomes: A Meta-Analysis. Healthcare. 2024;12:2309. doi: 10.3390/healthcare12222309. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Granberg R.A., Rasmuson Å.C. Solubility of Paracetamol in Pure Solvents. J. Chem. Eng. Data. 1999;44:1391–1395. doi: 10.1021/je990124v. [DOI] [Google Scholar]
- 5.Romdhani A., Martínez F., Chiappetta D.A., Peña Á., Jouyban A. Equilibrium Solubility of Acetaminophen in Ternary Mixtures as a Tool for Design of Concentrated Parenteral Medications. J. Solut. Chem. 2024;53:506–523. doi: 10.1007/s10953-023-01347-3. [DOI] [Google Scholar]
- 6.García-Oseguera A., Pérez-Martínez A., Alfaro-Ponce M., Chairez I., Reyes E. Kinetic Analysis of pH Effect on the Paracetamol Degradation by an Ozonation–Blast Furnace Slags Coupled System by Neural Network Approximation. Water. 2025;17:1364. doi: 10.3390/w17091364. [DOI] [Google Scholar]
- 7.Feng X., Zhang Q., Cong P., Zhu Z. Determination of the Paracetamol Degradation Process with Online UV Spectroscopic and Multivariate Curve Resolution-Alternating Least Squares Methods: Comparative Validation by HPLC. Anal. Methods. 2013;5:5286. doi: 10.1039/c3ay40747k. [DOI] [Google Scholar]
- 8.Sibik J., Sargent M.J., Franklin M., Zeitler J.A. Crystallization and Phase Changes in Paracetamol from the Amorphous Solid to the Liquid Phase. Mol. Pharm. 2014;11:1326–1334. doi: 10.1021/mp400768m. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Yeh K.-L., Lee H.-L., Lee T. Crystallization of Form II Paracetamol with the Assistance of Carboxylic Acids toward Batch and Continuous Processes. Pharmaceutics. 2022;14:1099. doi: 10.3390/pharmaceutics14051099. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Nguyen Thi Y., Rademann K., Emmerling F. Direct Evidence of Polyamorphism in Paracetamol. CrystEngComm. 2015;17:9029–9036. doi: 10.1039/C5CE01583A. [DOI] [Google Scholar]
- 11.Soares L., Novais S., Ferreira A., Frazão O., Silva S. Detection of the Crystallization Process of Paracetamol with a Multi-Mode Optical Fiber in a Reflective Configuration. Sensors. 2020;20:87. doi: 10.3390/s20010087. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Soares L., Perez-Herrera R.A., Novais S., Ferreira A., Silva S., Frazão O. Linear Fiber Laser Configurations for Optical Concentration Sensing in Liquid Solutions. Photonics. 2024;11:393. doi: 10.3390/photonics11050393. [DOI] [Google Scholar]
- 13.Soares L., Pérez-Herrera R.A., Novais S., Ferreira A., Silva S., Frazão O. Measurement of Paracetamol Concentration Using an Erbium-Doped Fiber Ring Cavity. Photonics. 2023;10:50. doi: 10.3390/photonics10010050. [DOI] [Google Scholar]
- 14.Cai J., Liu Y., Shu X. Long-Period Fiber Grating Sensors for Chemical and Biomedical Applications. Sensors. 2023;23:542. doi: 10.3390/s23010542. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Du C., Zhao S., Wang Q., Jia B., Zhao M., Zhang L., Cui L., Chen S., Deng X. A Seawater Salinity Sensor Based on Optimized Long Period Fiber Grating in the Dispersion Turning Point. Sensors. 2023;23:4435. doi: 10.3390/s23094435. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Yang R.-Z., Dong W.-F., Meng X., Zhang X.-L., Sun Y.-L., Hao Y.-W., Guo J.-C., Zhang W.-Y., Yu Y.-S., Song J.-F., et al. Nanoporous TiO2/Polyion Thin-Film-Coated Long-Period Grating Sensors for the Direct Measurement of Low-Molecular-Weight Analytes. Langmuir. 2012;28:8814–8821. doi: 10.1021/la301445h. [DOI] [PubMed] [Google Scholar]
- 17.Korposh S., Selyanchyn R., Yasukochi W., Lee S.-W., James S.W., Tatam R.P. Optical Fibre Long Period Grating with a Nanoporous Coating Formed from Silica Nanoparticles for Ammonia Sensing in Water. Mater. Chem. Phys. 2012;133:784–792. doi: 10.1016/j.matchemphys.2012.01.094. [DOI] [Google Scholar]
- 18.Tripathi S.M., Bock W.J., Mikulic P., Chinnappan R., Ng A., Tolba M., Zourob M. Long Period Grating Based Biosensor for the Detection of Escherichia Coli Bacteria. Biosens. Bioelectron. 2012;35:308–312. doi: 10.1016/j.bios.2012.03.006. [DOI] [PubMed] [Google Scholar]
- 19.Swart P.L. Long-Period Grating Michelson Refractometric Sensor. Meas. Sci. Technol. 2004;15:1576–1580. doi: 10.1088/0957-0233/15/8/025. [DOI] [Google Scholar]
- 20.Van Brakel A., Swart P.L. Temperature-Compensated Optical Fiber Michelson Refractometer. Opt. Eng. 2005;44:020504. doi: 10.1117/1.1850746. [DOI] [Google Scholar]
- 21.Zhou X., Chen K., Mao X., Peng W., Yu Q. High-Resolution Optical Refractometer Based on a Long-Period Grating Michelson Interferometer Using a Cross-Correlation Signal-Processing Method. Opt. Eng. 2015;54:126108. doi: 10.1117/1.OE.54.12.126108. [DOI] [Google Scholar]
- 22.Kim D.W., Zhang Y., Cooper K.L., Wang A. In-Fiber Reflection Mode Interferometer Based on a Long-Period Grating for External Refractive-Index Measurement. Appl. Opt. 2005;44:5368. doi: 10.1364/AO.44.005368. [DOI] [PubMed] [Google Scholar]
- 23.Murphy R.P., James S.W., Tatam R.P. Multiplexing of Fiber-Optic Long-Period Grating-Based Interferometric Sensors. J. Light. Technol. 2007;25:825–829. doi: 10.1109/JLT.2006.889670. [DOI] [Google Scholar]
- 24.Hernández-Guerrero L.D., Castillo-Mixcóatl J., Muñoz-Aguirre S., Rodríguez-Torres M., Ramírez-Sánchez E., Beltrán-Pérez G. Projection to Latent Structures Regression and Its Application to Mach–Zehnder Interferometer Optical Fiber Sensors for Acetone Detection. Opt. Lasers Eng. 2025;184:108689. doi: 10.1016/j.optlaseng.2024.108689. [DOI] [Google Scholar]
- 25.Ha N., Xu K., Ren G., Mitchell A., Ou J.Z. Machine Learning-Enabled Smart Sensor Systems. Adv. Intell. Syst. 2020;2:2000063. doi: 10.1002/aisy.202000063. [DOI] [Google Scholar]
- 26.Talaei Khoei T., Kaabouch N. Machine Learning: Models, Challenges, and Research Directions. Future Internet. 2023;15:332. doi: 10.3390/fi15100332. [DOI] [Google Scholar]
- 27.Zifarelli A., Giglio M., Menduni G., Sampaolo A., Patimisco P., Passaro V.M.N., Wu H., Dong L., Spagnolo V. Partial Least-Squares Regression as a Tool to Retrieve Gas Concentrations in Mixtures Detected Using Quartz-Enhanced Photoacoustic Spectroscopy. Anal. Chem. 2020;92:11035–11043. doi: 10.1021/acs.analchem.0c00075. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Han L., Liu F., Zhang L. An Improved Sub-Model PLSR Quantitative Analysis Method Based on SVM Classifier for ChemCam Laser-Induced Breakdown Spectroscopy. Symmetry. 2021;13:319. doi: 10.3390/sym13020319. [DOI] [Google Scholar]
- 29.Chang L., Wang J., Woodgate W. Analysing Spectroscopy Data Using Two-Step Group Penalized Partial Least Squares Regression. Environ. Ecol. Stat. 2021;28:445–467. doi: 10.1007/s10651-021-00496-2. [DOI] [Google Scholar]
- 30.Coe J.V., Allen H.C., Skarda S.A., Orr T.D., Wilson A.L., II, Wilson D.G., Kalliantas S., Nystrom S.V., Bradley R.C., Li R., et al. IR Spectroscopy and Linear Support Vector Machine Analysis of Colorectal Liver Metastasis. J. Phys. Chem. B. 2026;130:1798–1809. doi: 10.1021/acs.jpcb.5c07859. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Sarkar S., Basak J.K., Moon B.E., Kim H.T. A Comparative Study of PLSR and SVM-R with Various Preprocessing Techniques for the Quantitative Determination of Soluble Solids Content of Hardy Kiwi Fruit by a Portable Vis/NIR Spectrometer. Foods. 2020;9:1078. doi: 10.3390/foods9081078. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Képeš E., Vrábel J., Brázdil T., Holub P., Pořízka P., Kaiser J. Interpreting Convolutional Neural Network Classifiers Applied to Laser-Induced Breakdown Optical Emission Spectra. Talanta. 2024;266:124946. doi: 10.1016/j.talanta.2023.124946. [DOI] [PubMed] [Google Scholar]
- 33.González-León K., Delgado-Macuil R.J., Vertti-Cervantes B., Muñoz-Aguirre S., Castillo-Mixcóatl J., García-Juárez M., Montes-Narvaez O., Ramírez-Sánchez E., Beltrán-Pérez G. Application of Support Vector Machine Technique to Optical Fiber Biosensors for Neuroprotector (IL-10) Detection in Serum Samples of Murine Model. Opt. Laser Technol. 2025;186:112629. doi: 10.1016/j.optlastec.2025.112629. [DOI] [Google Scholar]
- 34.Bandala-Daniel R.I., Ocelotl-Zayas L., Delgado-Macuil R., González-León K., García-Juárez M., Muñoz-Aguirre S., Castillo-Mixcóatl J., Beltrán-Pérez G. Use of the Feature Scaling and Machine Learning Techniques on Optical Fiber Biosensors for the Detection of Neuroprotector IL-10 in Serum of a Murine Model with Cerebral Ischemia. Sensors. 2026;26:1174. doi: 10.3390/s26041174. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Urrutia A., Del Villar I., Zubiate P., Zamarreño C.R. A Comprehensive Review of Optical Fiber Refractometers: Toward a Standard Comparative Criterion. Laser Photonics Rev. 2019;13:1900094. doi: 10.1002/lpor.201900094. [DOI] [Google Scholar]
- 36.Chiavaioli F., Gouveia C., Jorge P., Baldini F. Towards a Uniform Metrological Assessment of Grating-Based Optical Fiber Sensors: From Refractometers to Biosensors. Biosensors. 2017;7:23. doi: 10.3390/bios7020023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Rodriguez-Ramirez D.A., Martinez-Angulo J.R., Filoteo-Razo J.D., Elizondo-Leal J.C., Diaz-Manriquez A., Jauregui-Vazquez D., Lauterio-Cruz J.P., Saldivar-Alonso V.P. Review of Optical Fiber Sensors: Principles, Classifications and Applications in Emerging Technologies. Photonics. 2025;13:40. doi: 10.3390/photonics13010040. [DOI] [Google Scholar]
- 38.Gao S., Yang X., Wang S., Chu C., Teng P., Tian F., Zhang Y., Liu Z., Yang X. Review of Optical Fiber Optofluidic Chemical Sensors and Biosensors. Photonic Sens. 2025;15:250134. doi: 10.1007/s13320-024-0710-8. [DOI] [Google Scholar]
- 39.Caldas P., Rego G. Optical Fiber Interferometers Based on Arc-Induced Long Period Gratings at INESC TEC. Sensors. 2021;21:7400. doi: 10.3390/s21217400. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Singh A. Study of Modeling Aspects of Long Period Fiber Grating Using Three-Layer Fiber Geometry. Photonic Sens. 2015;5:32–42. doi: 10.1007/s13320-014-0188-x. [DOI] [Google Scholar]
- 41.Wold S., Sjöström M., Eriksson L. PLS-Regression: A Basic Tool of Chemometrics. Chemom. Intell. Lab. Syst. 2001;58:109–130. doi: 10.1016/S0169-7439(01)00155-1. [DOI] [Google Scholar]
- 42.Galindo-Prieto B., Mudway I.S. A Review of the Applications and Challenges of Applying Partial Least Squares (PLS) to Exposomics Research. Anal. Chim. Acta. 2026;1383:344826. doi: 10.1016/j.aca.2025.344826. [DOI] [PubMed] [Google Scholar]
- 43.Amaya-Tejera N., Gamarra M., Vélez J.I., Zurek E. A Distance-Based Kernel for Classification via Support Vector Machines. Front. Artif. Intell. 2024;7:1287875. doi: 10.3389/frai.2024.1287875. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Du K.-L., Jiang B., Lu J., Hua J., Swamy M.N.S. Exploring Kernel Machines and Support Vector Machines: Principles, Techniques, and Future Directions. Mathematics. 2024;12:3935. doi: 10.3390/math12243935. [DOI] [Google Scholar]
- 45.Cortes C., Vapnik V. Support-Vector Networks. Mach. Learn. 1995;20:273–297. doi: 10.1023/A:1022627411411. [DOI] [Google Scholar]
- 46.Markoulidakis I., Rallis I., Georgoulas I., Kopsiaftis G., Doulamis A., Doulamis N. Multiclass Confusion Matrix Reduction Method and Its Application on Net Promoter Score Classification Problem. Technologies. 2021;9:81. doi: 10.3390/technologies9040081. [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The data sets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.



















