Skip to main content
PMC home page
Frontiers in Bioengineering and Biotechnology logoLink to Frontiers in Bioengineering and Biotechnology
. 2021 Oct 6;9:752681. doi: 10.3389/fbioe.2021.752681

A Paper-Based IL-6 Test Strip Coupled With a Spectrum-Based Optical Reader for Differentiating Influenza Severity in Children

Sheng-Wen Lin 1,†, Ching-Fen Shen 2,3,†, Ching-Chuan Liu 2,4,*, Chao-Min Cheng 1,*
PMCID: PMC8527092  PMID: 34692664

Abstract

Influenza virus infection is a major worldwide public health problem. Influenza virus infections are associated with a high hospitalization rate in children between the ages of 5 and 14. The predominant reason for poor influenza prognosis is the lack of any effective means for early diagnosis. Early diagnosis of severe illness is critical to improving patient outcome, and could be especially useful in areas with limited medical resources. Accurate, inexpensive, and easy-to-use diagnostic tools could improve early diagnosis and patient outcome, and reduce overall healthcare costs. We developed an interleukin-6 paper-based test strip that used colloidal gold-conjugated antibodies to detect human interleukin-6 protein. These complexes were captured on a paper-based test strip patterned with perpendicular T lines that were pre-coated with anti-human interleukin-6 antibodies. Applied serum samples interacted with these antibodies and presented as colored bands that could be read using a spectrum-based optical reader. The full-spectrum of the reflected light interleukin-6 protein signal could be obtained from the spectral optics module, and the standard could be used to quantitatively analyze interleukin 6 level in serum. We retrospectively evaluated 10 children (23 serum samples) with severe influenza virus infections, 26 children (26 serum samples) with mild influenza virus infections, and 10 healthy children (10 serum samples). Our system, the combined use of a paper-based test strip and a spectrum-based optical reader, provided both qualitative and quantitative information. When used with the optical reader, the detection limit was improved from a qualitative, naked-eye level of 400 pg/ml to a quantitative, optical reader level of 76.85 pg/ml. After monitoring serum interleukin-6 level via our system, we found a high correlation between our system results and those obtainable using a conventional sandwich enzyme-linked immunosorbent assay method (Rho = 0.706, p < 0.001). The sensitivity and specificity for differentiating between severe and mild influenza using our combined method (test strip coupled with optical reader) were 78.3 and 50.0%, respectively. When interleukin-6 was combined with serum C-reaction protein, the sensitivity and specificity were 85.7 and 95.5%, and the receiver operating characteristic area-under-the-curve was quite high (AUC = 0.911, p < 0.001). The potential advantages of our system, i.e., a paper-based test strip coupled with a spectrum-based optical reader, are as follows: 1) simple user operation; 2) rapid turnaround times–within 20 min; 3) high detection performance; and, 4) low-cost fabrication.

Keywords: influenza infection, interleukin-6, point-of-care testing, paper-based test strip, spectrum-based optical reader, children

Introductions

Influenza virus infection is a major worldwide public health problem. Seasonal infections with the common influenza virus strains (e.g., H1N1) are frequently resolved, but still cause high mortality. The annual morbidity rate caused by influenza is the highest in children, where morbidity is usually >30% (Diseases CoI, 2020; Hurwitz et al., 2000a). Children are also considered to be the main spreaders of influenza in the community (Hurwitz et al., 2000b; Reichert et al., 2001; Neuzil et al., 2002a). Studies have shown that the rate of hospitalization for influenza-related illnesses in infants and young children without underlying diseases is comparable to that of high-risk adults (Izurieta et al., 2000; Neuzil et al., 2002b; Chiu et al., 2002). In addition, it has been reported that influenza virus infection with a high hospitalization rate occurred in children between the ages of 5 and 14 years. A small percentage of these patients could develop more complicated and severe symptoms, e.g., elevated fever, violent dry cough, pneumonia, and acute respiratory distress syndrome, that require admission to an intensive care unit (Kamigaki and Oshitani, 2009; Hasegawa et al., 2010). The predominant reason for poor influenza prognosis is the lack of any effective means for early diagnosis. Early diagnosis of severe illness is critical to improving patient outcome, and could be especially useful in areas with limited medical resources. Accurate, inexpensive, and easy-to-use diagnostic tools could improve early diagnosis and patient outcome, and reduce overall healthcare costs.

Inflammation is a rapid and non-specific host defense mechanism that is strictly regulated by a network of inflammatory mediators. Inflammatory mediators include cytokines, such as interleukin-6 (IL-6) (Ryan and Majno, 1977; Feghali and Wright, 1997; Rouse and Sehrawat, 2010). IL-6 is a pleiotropic cytokine, which is significantly related to all aspects of the immune response, including inflammation. IL-6 is the main mediator of acute-phase reactions and fever (Gabay and Kushner, 1999). IL-6 is also associated with many pathogenic inflammatory states: increased levels of IL-6 are associated with sepsis severity and mortality (Dama et al., 1992), and IL-6 has been implicated in the cytokine storm following infection with avian influenza A H5N1 and severe responses to infection such as severe acute respiratory syndrome infection (Zhang et al., 2004; Huang et al., 2005; De Jong et al., 2006). Contrastingly, studies have also shown that IL-6 may play a role in regulating and limiting inflammation (Xing et al., 1998). Within the lung, IL-6 promotes lung inflammation, and IL-6 levels are related to the severity of acute respiratory distress syndrome as well as mortality (Headley et al., 1997; Lin et al., 2010). IL-6 levels have also been associated with symptom duration and severity in cases of seasonal influenza infection (Gentile et al., 1998; Fritz et al., 1999; Skoner et al., 1999). Thus, the role of IL-6 for diagnosing the progression of influenza warrants special attention.

Although conventional methods to gain information via the use of biomarkers are common, most examinations must be performed in hospitals and require time, expensive/complex equipment, and well-trained professionals to facilitate inspection and analysis. Based on current global medical trends, we predict that the future medical ecosystem will provide an increasing number of opportunities for improvement via the use of point-of-care (POC) tools at the bench and at bedside (Hudspeth and Morse, 2017; Nayak et al., 2017; Wang et al., 2020a; Hung et al., 2021). Rapid diagnostic tests are needed to help clinicians distinguish between critically ill and mildly ill influenza patients in a timely manner. To appropriately meet the requirements and demands of POC devices, these diagnostic devices must meet the following factors: 1) low sample consumption; 2) minimized user intervention; 3) rapid turnaround times; 4) extended storage and shelf life of reagents; 5) high sensor performance; and, 6) low fabrication cost. Further, the use of portable readout devices, cell-phone-based systems, and equipment-free systems are popular in developing countries and other resource-poor environments.

Here, we discuss the design, prototyping, and testing of a paper-based test strip that can detect IL-6 via lateral flow immunoassay (LFA), and can be qualitatively read with the naked eye (detection limit of 400 pg/ml). To increase the detection limit of the test strip, a small, light, and easy-to-use spectrum-based optical reader, a collaborative effort with SpectroChip Inc. in Taiwan, was integrated into the methodology in order to capture the reflection spectrum on the test strip for analysis. This research and our perspectives could provide options and impetus for the development of a POC device for influenza diagnosis with an eye toward easy, early diagnosis as a means of improving patient outcome. Our results may also be useful for the development and implementation of methods for determining influenza severity and optimizing treatment, which would be especially useful if applied to a pediatric population.

Materials and Methods

Patients and Samples

Patients with virologically confirmed influenza infection visiting National Cheng Kung University Hospital, Taiwan were recruited. Influenza infection was defined as having clinical presentation of acute respiratory disease, plus virological evidence of influenza infection, either through positive influenza viral antigen test (Flu A + B Rapid Antigen Test, BD Veritor™ Plus System, United States of America) or influenza virus isolated from respiratory specimens. The influenza infection cases were then further classified into mild or severe cases. Mild cases included those with only fever and respiratory symptoms, and severe cases presented lower respiratory tract infection, acute respiratory distress, hemodynamic instability, or severe extrapulmonary manifestation (myositis, encephalitis, seizure, or myocarditis). Children without fever, respiratory symptoms or any sign of acute infection within 1 week were enrolled as healthy controls. Serum samples from another infectious disease cohort, including patients with dengue virus, enterovirus, and Mycoplasma pneumoniae infections, were only used for correlation analysis between our IL-6 test strip protocol and ELISA methodology (n = 24; n = 83 with influenza infection cases). The protocol for this study was reviewed and approved by the Institutional Review Board (IRB) of National Cheng Kung University Hospital (IRB No: B-ER-102-345). Informed consent was obtained from each participating patient or the patient’s parents or guardian.

Cytokine Assay

Soluble IL-6 concentration in serum samples was determined using monoclonal antibody enzyme-linked immunosorbent assay (ELISA) kits (D6050, R&D systems, United States). The minimum detectable concentration was 3.1 pg/ml. The intra- and interassay coefficients were less than 7%. The ELISA reader brand was Tecan (SunriseTM | Absorbance Microplate Reader). The experiment protocol and analyzing method all follow the standard protocol of the ELISA kit. We measured IL-6 concentration in all 83 serum samples.

Lateral Flow Immunoassay

This paper test strip (created in cooperation with Taiwan Hygeia Touch Inc.) used colloidal gold-conjugated anti-IL-6 antibody (ARG21446, arigo Biolaboratories Corp. Hsinchu, Taiwan) to detect human IL-6 antigen. Based on the colorimetric analysis of each test combination, an optimization test was performed to determine the most suitable IL-6 concentration and gold nanoparticle size for conjugation. The test strip was pre-coated with capture reagent and sprayed to generate vertical lines containing anti-IL-6 antibody (ARG21444, arigo Biolaboratories Corp. Hsinchu, Taiwan) bound to 15 nm-diameter gold colloid. The C line of the nitrocellulose strips was also coated with mouse anti-human IgG antibody (ARG21957, arigo Biolaboratories Corp. Hsinchu, Taiwan) and an equal amount of quality control antibody. When the applied sample flowed along the strip, the human IL-6 antigen present in the sample formed an antigen complexed with the colloidal gold-labeled anti-IL-6 antibody. These complexes are then captured in the vertical T-line of the test strip, where they appeared as colored strips.

Reflectance Spectral Analysis

The spectrum analyzer (in cooperation with Taiwan SpectroChip Inc.; Taiwan FDA: MD (I)-008090 and US FDA: 3017810861) was equipped with a cassette tape designed to accept the paper-based test strip and could detect the IL-6 antigen reflectance spectrum from the test paper. This device provided continuous spectrum results and captured high-resolution reflectance spectrum values from the test strip test line (T line). The spectrum reader provided high resolution (3–5 nm) results over a wide spectral range (300–1,100 nm). The principle of machine detection is to scan with white light. When the red line was scanned, the colloidal gold absorbed the spectrum between 430 and 600 nm and reflected the remaining light that was not absorbed by the colloidal gold. Colloidal gold does not absorb 650 nm light, so the red lines of different shades produced little change at 650 nm, which is approximately equal to 1.

The main reflection wavelengths detected by this spectrum reader were 430 and 600 nm (for samples with lower IL-6 concentration), and the main reference wavelength was 650 nm. The ratio of the minimum reflectance to the spectrum at the reference wavelength was used to calculate the α value: α = Reflectance (650 nm)/Reflectance (the minimum value in the range of 430–600 nm).

In this formula, α refers to the color reflection value of the optical scanning IL-6 antigen rapid screening test strip. The higher the α value, the stronger the reflection color intensity of the IL-6 complex coupled with the colloidal gold antibody, which indicated higher the IL-6 concentration.

Limit of Detection and Limit of Quantification

The LOD and LOQ were estimated based on the average of the blank α value, the standard deviation of the blank α value, the slope of the calibration curve (analytical sensitivity) and the defined confidence factor, using the following calculations:

LOD = Blank (mean) + 3 x Blank (standard deviation)
LOQ = Blank (mean) + 10 x Blank (standard deviation)

In this calculation, the average blank α value was 1.00395, the standard deviation of the blank α value was 0.00278, the blank coefficient of variation was 0.27%, and the 95% confidence interval was 99.6–100%. LOD was estimated by using the average value of blank α value plus 3 times the standard deviation of the average value of blank α value, using the following equation in Figure 1: y = 0.0597x + 1.0077 (y, α value; x, IL-6 concentration). Therefore, the α value of LOD was equal to 1.0122,881, and the concentration of LOD was 76.85 pg/ml. The same calculation was applied to determine LOQ.

FIGURE 1.

FIGURE 1

Open in a new tab

The IL-6 paper-based test strip and spectrum-based optical reader. (A) The IL-6 test strips loaded with pre-determined amounts of purified IL-6 protein. (B) Spectrum-based optical reader and mobile-phone which could connect to the reader (in collaboration with SpectroChip Inc., Taiwan; Taiwan FDA: MD (I)-008090 and U.S. FDA: 3017810861). (C) The reflectance spectra of the predetermined amounts of purified IL-6 protein in standard scale. (D) Linear regression for the α value of IL-6 protein at concentrations of 0, 0.1, 0.2, 0.4 pg/ml to determine the limit of detection (LOD) and limit of quantification (LOQ), Y-axis; α value, X-axis; IL-6 concentration based on test strip coupled with optical reader, *p < 0.05, ***p < 0.001.

Statistical Analysis

The Wilcoxon rank sum test and the Wilcoxon signed rank test were used to check data and distinguish severe cases, mild cases, and healthy controls. A p-value less than 0.05 was considered statistically significant. The receiver operating characteristic (ROC) area under the curve (AUC) were used to evaluate the diagnostic ability of IL-6. In order to evaluate the correlation between this paper-based test strip/optical reader combination and ELISA, we used Spearman’s rank correlation coefficient and the Bland-Altman chart.

Results

Clinical Characteristics of Study Cohort

A total of 36 influenza infected patients (10 severe cases/23 serum samples, and 26 mild cases/26 serum samples) and 10 healthy individuals (10 serum samples) were recruited. The clinical characteristics and investigative findings are provided in Supplementary Table S1. Among the influenza patients, two of them had serial serum samples collected during the course of their illness. Most patients with mild disease characteristics only visited the outpatient clinic or the emergency department, but two of them were hospitalized. Among the severe influenza patients, most required intensive care, except one pneumonia case, which was cared for in the general ward. Age and gender were not significantly different across disease severity levels.

The Spectrum-Based Optical Reader Provided High-Performance Spectral Analysis for the Influenza IL-6 Test Strip

As shown in Figure 1A, there were bands on the control (C) line on all test strips, verifying the test for various IgG concentrations. The band intensity of the IL-6 (T) line decreased as the concentration of purified recombinant IL-6 protein decreased, and the band became almost invisible on test strips loaded with IL-6 at a concentration lower than 0.4 ng/ml. Figure 1B provides a picture of a spectrum-based optical reader that can be activated through a mobile APP. In this quantitative platform system, a spectrometer was used to analyze LFA test color intensity, where the presence of IL-6 was based on the cutoff value of the spectral intensity. The LOD needed to be determined to evaluate the performance of the platform system. To this end, the IL-6 test strip was loaded with various predetermined purified amounts of IL-6 in the serum (0, 0.1, 0.2, and 0.4 ng/ml) to obtain continuous reflectance spectra (from wavelength 430–600 nm), and the data from six replicates were combined for analysis.

The percentage of the reflectance spectrum is negatively correlated with the number of antibody-antigen complexes, so it decreases as IL-6 concentration increased. Here, we found that the reflectance spectrum of IL-6 was well separated at about 540 nm (Figure 1C). The reflectance spectrum was used to obtain the α value, which was used to construct the IL-6 concentration standard curve of the reflectance. As shown in Figure 1D, after fitting the α values for each concentration, the linear regression provided an R 2 value of 0.9507. Based on this regression model, the LOD and limit of quantification (LOQ) were 76.85 pg/ml and 402.71 pg/ml, respectively. Based on these results, the platform provides an excellent analytical sensitivity (i.e., the limit of detection) for the detection of trace levels of human IL-6 protein.

Correlation Between the IL-6 Test Strip System and Conventional ELISA Methodology

We selected 83 patients, all of which were children that had different illness severities. We then measured each patient’s serum IL-6 concentration using two tests: 1) the IL-6 test strip coupled with a spectrum-based optical reader; and, 2) enzyme-linked immunosorbent assay (ELISA). As shown in Figure 2A, the correlation between the IL-6 concentration results based on our test strip system and the concentration based on ELISA methodology were highly relevant and statistically significant (Rho = 0.706, p < 0.001).

FIGURE 2.

FIGURE 2

Open in a new tab

(A) Comparison of paper-based test strip and ELISA for IL-6 assays using serum from patients, including influenza, enterovirus, Mycoplasma, dengue, n = 83. Y-axis; IL-6 concentration measured by test strip. X-axis; IL-6 concentration measured by ELISA. (B) Bland and Altman plot of log-transformed data. The differences between the IL-6 based on test strip and ELISA (log transformation) in relation to the mean of the two measurements (log transformation), n = 83. Green lines indicate the limits of agreement (±1.96 SD).

To validate the agreement between these two assays, we used the Bland-Altman analysis to assess any deviations between the mean differences and estimate the interval of agreement (95%) between the test strip system and ELISA. The Bland-Altman diagram simply represents the comparison of each difference between the two pairing methods with the measured average, as shown in Figure 2B. After logarithmically transforming the original data of the concentration of IL-6 based on test strip and ELISA results, the Shapiro-Wilk test was used to determine normality (p = 0.46) (Euser et al., 2008; Giavarina, 2015). The mean difference of the two assays was 0.277, and the limits of agreement ( ± 1.96 standard deviation) were 1.219 and -0.665. The width of the limits of agreement was 1.884, which included most of the data points. There was no trend between the difference and the mean, but the difference between the two methods was more variable during the mean from 1.5 to 2.5.

Capacity of the IL-6 Test Strip to Distinguish Influenza Severity

Based on the IL-6 level as determined by test strip assay (Figure 3A), severe influenza cases tended to have higher IL-6 level compared to mild cases, but the difference did not reach statistical significance (p = 0.071). The IL-6 level results provided by the conventional sandwich ELISA method (Figure 3B) displayed a similar trend, however, IL-6 level among severe cases was significant higher compared to that of healthy controls (p < 0.05). Although there was no significant difference in IL-6 level between severe and mild influenza cases, two cases with serial serum samples demonstrated that IL-6 level correlated with disease progression (Figure 3C and Supplementary Figure S1). The first patient was a 4 year-old boy who developed bilateral bacterial pneumonia, respiratory failure, and shock during hospitalization. He was intubated for ventilation support and received inotropic agents for hemodynamic instability on the first day when his measured IL-6 level exceeded 700 pg/ml. After treatment, the patient discontinued inotropic treatment on day 4, and was extubated on day 6. During this period, IL-6 level declined to 150–200 pg/ml. When the patient was stabilized and further transferred to the general ward, IL-6 level dropped to 0–50 pg/ml. The second patient, an 8 year-old boy, developed necrotizing pneumonia with pleural effusion and respiratory failure. This patient demonstrated rapidly deteriorated respiratory condition and was intubated on the first day, when his IL-6 level reached 1,500 pg/ml. Following chest tube drainage of pleural effusion and antimicrobial treatment, this patient’s IL-6 level dropped on days 2 and 3. This patient’s IL-6 level rose temporally after video-assisted thoracotomy debridement for his empyema, but then further declined gradually after his condition stabilized. Two days before transferal to the general ward, his IL-6 level dropped to below 20 pg/ml.

FIGURE 3.

FIGURE 3

Open in a new tab

IL-6 levels in severe cases and mild cases of influenza in children based on test strip and ELISA. (A) IL-6 (test strip) concentration between different groups: severe influenza (n = 23), mild influenza (n = 26), health control (n = 10). (B) IL-6 (ELISA) concentration between different groups: severe influenza (n = 23), mild influenza (n = 26), health control (n = 10). There was a statistically significant difference between severe cases and healthy controls (p < 0.05). (C) Follow-up IL-6 test strip concentrations compared to number of days in the hospital for two patients. (D) ROC curve of IL-6 concentration (test strip), AUC = 0.69, p = 0.026. (E) ROC curve of IL-6 concentration (ELISA), AUC = 0.64,p = 0.092. (F) ROC curve of IL-6 concentration (test strip) combined with CRP, AUC = 0.911, p = 0.00. (G) ROC curve of IL-6 concentration (ELISA) combined with CRP, AUC = 0.654, p = 0.085.

The Receiver Operating Characteristic Curve

The ROC curve could be useful for summarizing the performance of each classifier into a single measure. It shows the trade-off between sensitivity (or TPR) and specificity (1–FPR). As shown in Figures 3D,E, the area under the curve (AUC) values for both the test strip and ELISA assays were 0.69 and 0.64 (p < 0.05 and p > 0.05), respectively. The cut-off value according to the test strip ROC curve was 140.4 pg/ml, and the sensitivity and specificity were 78.26 and 50.0% (Table 1). We calculated several cutoff values suggested by studies (Oh et al., 2002; Sato et al., 2009; Chiaretti et al., 2013), such as 100 and 150 pg/ml, and found that the sensitivity and specificity were 78.26, 65.22, 55.56, and 63.89%, respectively. According to the ELISA ROC curve, the cut-off value was 60.78 pg/ml, and the sensitivity and specificity were 78.26 and 63.89%. The cutoff values, 100 and 150 pg/ml, suggested by ELISA studies do not seem to be very good, and respective sensitivity and specificity were 65.22, 52.17, 69.44, and 69.44%, respectively. In addition to examining IL-6 alone, we looked at the combination of IL-6 and serum C-reactive protein (CRP) to assess influenza severity. As shown in Figures 3F,G & Supplementary Figure S2, the AUC measured using the test strip and ELISA were 0.911 and 0.664 (p < 0.05 and p > 0.05). Combining IL-6 with CRP provided a high AUC in the ROC curve for the test strip results. The sensitivity and specificity for IL-6, when combined with CRP, were 85.71 and 95.45%; the sensitivity and specificity for IL-6, when combined with CRP, were 71.43 and 63.64%. Of the other available clinical information, i.e., the number of days in the hospital, the number of days in the ICU, and highest body temperature, the first two values (number of days in the hospital and the number of days in the ICU) correlated with test-strip IL-6 concentration (statistically significant; p < 0.05 and p < 0.01) (Table 2).

TABLE 1.

Charecteristics of tests based on different cutt-off values.

Cutt-off value Sensitivity (%) Specificity (%) PPV NPV
IL-6 (Test strip) 100 pg/ml 78.26 55.56 52.94 80.00
140.4 pg/ml 78.26 50.00 58.06 72.22
150 pg/ml 65.22 63.89 53.57 74.19
IL-6 (ELISA) 60.78 pg/ml 78.26 63.89 58.06 82.14
100 pg/ml 65.22 69.44 57.69 75.76
140.4 pg/ml 52.17 69.44 52.17 69.44
150 pg/ml 52.17 69.44 52.17 69.44
CRP 30.85 pg/ml 80.77 95.24 95.45 80.00
IL-6 (Test strip) + CRP 140.4 pg/ml + 30.85 pg/ml 85.71 95.45 94.74 87.50
IL-6 (ELISA) + CRP 60.78 pg/ml + 30.85 pg/ml 71.43 63.64 65.22 70.00
Open in a new tab

TABLE 2.

Correlation between IL-6 and other clinical information based on both test strip and ELISA results.

Correlation CRP Total number of days in hospital Total number of days in ICU Highest temperature
IL-6 (Test strip) Rho = 0.179 (n = 43) Rho = 0.433** (n = 36) Rho = 0.396* (n = 35) Rho = 0.275 (n = 35)
IL-6 (ELISA) Rho = 0.211 (n = 43) Rho = 0.302 (n = 36) Rho = 0.301 (n = 35) Rho = 0.24 (n = 35)
Open in a new tab

*The correlation is significant at the 0.05 level (two-tailed). **The correlation is significant at the 0.01 level (two-tailed).

The Workflow of a Paper-Based Test Strip Coupled With a Spectrum-Based Optical Reader

In order to provide a rapid, simple, precise, and inexpensive device, we designed an easy-to-use POC system. As shown in Figures 4A–D, the principle of the paper-based test strip to detect the IL-6 was a lateral flow immunoassay that provided visible, qualitative results after 20 min. Scanning the test strip with a light and small optical reader facilitated the acquisition of quantitative results. This reader was activated using a mobile phone APP (Figures 4E,F).

FIGURE 4.

FIGURE 4

Open in a new tab

The IL-6 test strip workflow coupled with a spectrum-based optical reader. This new spectrum analyzer platform system requires only 0.1 ml of blood serum to be added to the test strip, and provides results in 15 min. The test strip is placed in a spectrometer for quantitative spectral analysis. This scan takes approximately 3 min to complete. Automatic scanning of the rapid test strip is activated with an APP. Full-spectrum antibody reflex optical signals are acquired from the spectral optical module to analyze IL-6 full-spectrum antibody distribution and concentration with standard quantification.

Discussion

More than half (55%) of all children hospitalized for influenza have underlying respiratory diseases, including asthma (27%) (Xu et al., 2019). When a patient arrives in the emergency room with influenza-like symptoms and these underlying diseases appear, in addition to detecting the type of influenza, it is even more critical to perform diagnostic POC tests as soon as possible to predict the potential process of the influenza to promote rapid and accurate clinical decision-making. In addition, the symptoms and severity of flu vary widely. Some patients show no signs of illness, while others require hospitalization. The IL-6 test strip system may be used to inform diagnostic and treatment decisions for patients in clinical settings, including whether to prescribe antiviral medications. In periods of peak demand, the timely implementation of infection control and treatment of influenza, can significantly reduce the impact on hospital resources and patient management. Therefore, there is a great need for serological testing methods that can be widely distributed and detect current/past infections. Among a series of potential serological testing methods, lateral flow immunoassay is ideal for large-scale screening and POC testing. However, the readings from such devices are mostly qualitative (yes or no) and are generally considered not sensitive enough to diagnose serious infections such as influenza. In order to provide sensitive quantitative capabilities for lateral flow immunoassays, we integrated a newly designed spectrum-based optical reader into our IL-6 test strip program. Using this analysis platform, the detection limit of human IL-6 protein can reach 76.85 ng/ml. Although the limit of detection of the IL-6 test strip system is not as sensitive as the ELISA used in this study (3.1 pg/ml), it is sufficient to distinguish between the mild and severe influenza cases in children.

In this study, compared with mildly affected patients, severely affected patients had higher IL-6 concentrations, but the difference was not statistically significant. There may be some other factors we need to discuss, for example, the number of days that a patient had a fever before admission might affect the process of the disease, the immune system of children is not mature, and there are different type of influenza, etc. (Oh et al., 2002; Sato et al., 2009; Simon et al., 2015) In the future, to make the entire study more complete, we still have some areas for improvement, such as large-scale collection of patient samples to verify sensitivity and specificity, comparing various ELISA brands with our platform to determine whether different brands of ELISA will affect the result. We could also combine the commercially available CRP test strip (Brouwer and van Pelt, 2015; Lin et al., 2016; Eley et al., 2018; Althaus et al., 2019; How, 2020; Tsounidi et al., 2021) with our IL-6 test strip system. This combination would be a more practical approach, which not only improves the diagnostic sensitivity and specificity while using two biomarkers instead of using single biomarkers, but also reduces the entire test time and cost.

IL-6 may be considered a potentially useful biomarker for influenza testing, and its significance as a biomarker may be further underscored by its associated rise in patients with encephalopathy (Aiba et al., 2001; Oh et al., 2002; Chiaretti et al., 2013). To date, several chemiluminescence immunoassay analyzers can be used for influenza diagnosis. Although these products may be better at detecting the presence or absence of influenza, they are not suitable for predicting the course or severity of the disease. In addition, gold nanoparticles have a high affinity for sulfhydryl (-SH) groups, so they can easily combine to various proteins (including antibodies). The use of gold nanoparticles can also improve the stability of the antigen and extend the shelf life. Moreover, our spectrum-based optical reader is small and light, it is more available to be installed in each clinic or ward to monitor and track of the disease process. The most important thing is that it is also less expensive. Furthermore, several optical readers based on smartphones have been previously reported for the quantification of lateral flow immunoassays (Hsu et al., 2014; Yang et al., 2016; Jalal et al., 2017; Mathaweesansurn et al., 2017; Xiao et al., 2018). Most test strip readers use image analysis, which can only scan the intensity for quantification; our reader is a spectrometer that can scan out colloidal nanogold reflectance spectrum and use the characteristic wave of the spectrum for quantification. Both approaches provide quantified results, but the spectrometer can also provide qualitative results and can better distinguish false positives caused by non-colloidal gold. Hence, our platform is not only easy to operate, but also highly sensitive for detecting of human IL-6 protein. We believe that our system could be used to help clinicians make influenza treatment decisions, and could potentially be used for guiding treatment for COVID-19 (Wang et al., 2020b; Gao et al., 2020; Han et al., 2020; Liu et al., 2020; Yang et al., 2020).

Summary

To conclude, the advantages of our system, i.e., a paper-based analytical device coupled with a spectrum-based optical reader, are as follows: 1) simple user operation; 2) rapid turnaround times–within 20 min; 3) high detection performance; 4) low-cost fabrication; and, 5) small size, which saves workbench space and facilitates use in any medical environment. In addition, our system may contribute the following to the medical arena: 1) promotion of effective patient management; 2) assistance in targeted antiviral therapy and antibiotic management; 3) facilitation of immediate infection control measures; and, 4) reliable early-stage disease detection that could reduce overall medical costs (Bonner et al., 2003).

Acknowledgments

The authors also appreciated Dr. Chitsung Hong from SpectroChip Inc., Taiwan (associated with the support from the Ministry of Science and Technology, Taiwan; MOST 110-2218-E-011-008) and Dr. Chung-Yao Yang from Hygeia Touch Inc., Taiwan for their valuable technical discussions.

Data Availability Statement

The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found in the article/Supplementary Material.

Ethics Statement

The studies involving human participants were reviewed and approved by Institutional Review Board of National Cheng Kung University Hospital. Written informed consent to participate in this study was provided by the participants’ legal guardian/next of kin.

Author Contributions

Conceptualization, C-MC and C-FS; methodology, C-MC and S-WL; validation andamp; investigation, C-MC, C-FS, S-WL, and C-CL; resources, C-MC. C-FS. and C-CL; data curation, S-WL, C-FS, and C-CL; writing—original draft preparation, S-WL; writing—review andamp; editing, C-MC, C-FS, and C-CL; visualization, S-WL; supervision, C-MC, and C-CL; project administration, C-MC, and C-CL; funding acquisition, C-MC, and C-FS All authors reviewed the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This study is funded by research grants from the Ministry of Science and Technology, Taiwan (MOST 110-2628-E-007-003 and MOST 110-2923-B-006-001-MY4), and Institute of Clinical Medicine, National Cheng Kung University Hospital, Taiwan (NCKU11002017).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fbioe.2021.752681/full#supplementary-material

Click here for additional data file. (150.8KB, DOCX)

References

  1. Aiba H., Mochizuki M., Kimura M., Hojo H. (2001). Predictive Value of Serum Interleukin-6 Level in Influenza Virus-Associated Encephalopathy. Neurology 57 (2), 295–299. 10.1212/wnl.57.2.295 [DOI] [PubMed] [Google Scholar]
  2. Althaus T., Greer R. C., Swe M. M. M., Cohen J., Tun N. N., Heaton J., et al. (2019). Effect of point-of-care C-Reactive Protein Testing on Antibiotic Prescription in Febrile Patients Attending Primary Care in Thailand and Myanmar: an Open-Label, Randomised, Controlled Trial. Lancet Glob. Health 7 (1), e119–e131. 10.1016/S2214-109X(18)30444-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Bonner A. B., Monroe K. W., Talley L. I., Klasner A. E., Kimberlin D. W. (2003). Impact of the Rapid Diagnosis of Influenza on Physician Decision-Making and Patient Management in the Pediatric Emergency Department: Results of a Randomized, Prospective, Controlled Trial. Pediatrics 112 (2), 363–367. 10.1542/peds.112.2.363 [DOI] [PubMed] [Google Scholar]
  4. Brouwer N., van Pelt J. (2015). Validation and Evaluation of Eight Commercially Available point of Care CRP Methods. Clinica Chim. Acta 439, 195–201. 10.1016/j.cca.2014.10.028 [DOI] [PubMed] [Google Scholar]
  5. Chiaretti A., Pulitanò S., Barone G., Ferrara P., Romano V., Capozzi D., et al. (2013). IL-1 β and IL-6 Upregulation in Children with H1N1 Influenza Virus Infection. Mediators Inflamm. 2013, 495848. 10.1155/2013/495848 [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Chiu S. S., Lau Y. L., Chan K. H., Wong W. H. S., Peiris J. S. M. (2002). Influenza-related Hospitalizations Among Children in Hong Kong. N. Engl. J. Med. 347 (26), 2097–2103. 10.1056/nejmoa020546 [DOI] [PubMed] [Google Scholar]
  7. Dama P., Ledoux D., Nys M., Vrindts Y., Groote D. D., Franchimont P., et al. (1992). Cytokine Serum Level during Severe Sepsis in Human IL-6 as a Marker of Severity. Ann. Surg. 215 (4), 356–362. 10.1097/00000658-199204000-00009 [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. De Jong M. D., Simmons C. P., Thanh T. T., Hien V. M., Smith G. J. D., Chau T. N. B., et al. (2006). Fatal Outcome of Human Influenza A (H5N1) Is Associated with High Viral Load and Hypercytokinemia. Nat. Med. 12 (10), 1203–1207. 10.1038/nm1477 [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Diseases CoI (2020). Recommendations for Prevention and Control of Influenza in Children, 2020–2021. Pediatrics 146 (4), e2020024588. 10.1542/peds.2020-024588 [DOI] [PubMed] [Google Scholar]
  10. Eley C. V., Sharma A., Lecky D. M., Lee H., McNulty C. A. M. (2018). Qualitative Study to Explore the Views of General Practice Staff on the Use of point-of-care C Reactive Protein Testing for the Management of Lower Respiratory Tract Infections in Routine General Practice in England. BMJ Open 8 (10), e023925. 10.1136/bmjopen-2018-023925 [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Euser A. M., Dekker F. W., le Cessie S. (2008). A Practical Approach to Bland-Altman Plots and Variation Coefficients for Log Transformed Variables. J. Clin. Epidemiol. 61 (10), 978–982. 10.1016/j.jclinepi.2007.11.003 [DOI] [PubMed] [Google Scholar]
  12. Feghali C. A., Wright T. M. (1997). Cytokines in Acute and Chronic Inflammation. Front. Biosci. 2 (1), d12–26. 10.2741/a171 [DOI] [PubMed] [Google Scholar]
  13. Fritz R. S., Hayden F. G., Calfee D. P., Cass L. M. R., Peng A. W., Alvord W. G., et al. (1999). Nasal Cytokine and Chemokine Responses in Experimental Influenza A Virus Infection: Results of a Placebo‐Controlled Trial of Intravenous Zanamivir Treatment. J. Infect. Dis. 180 (3), 586–593. 10.1086/314938 [DOI] [PubMed] [Google Scholar]
  14. Gabay C., Kushner I. (1999). Acute-phase Proteins and Other Systemic Responses to Inflammation. N. Engl. J. Med. 340 (6), 448–454. 10.1056/nejm199902113400607 [DOI] [PubMed] [Google Scholar]
  15. Gao Y., Li T., Han M., Li X., Wu D., Xu Y., et al. (2020). Diagnostic Utility of Clinical Laboratory Data Determinations for Patients with the Severe COVID‐19. J. Med. Virol. 92 (7), 791–796. 10.1002/jmv.25770 [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Gentile D., Doyle W., Whiteside T., Fireman P., Hayden F. G., Skoner D. (1998). Increased Interleukin-6 Levels in Nasal Lavage Samples Following Experimental Influenza A Virus Infection. Clin. Diagn. Lab. Immunol. 5 (5), 604–608. 10.1128/cdli.5.5.604-608.1998 [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Giavarina D. (2015). Understanding Bland Altman Analysis. Biochem. Med. 25 (2), 141–151. 10.11613/BM.2015.015 [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Han H., Ma Q., Li C., Liu R., Zhao L., Wang W., et al. (2020). Profiling Serum Cytokines in COVID-19 Patients Reveals IL-6 and IL-10 Are Disease Severity Predictors. Emerging Microbes & Infections 9 (1), 1123–1130. 10.1080/22221751.2020.1770129 [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Hasegawa M., Hashimoto K., Morozumi M., Ubukata K., Takahashi T., Inamo Y. (2010). Spontaneous Pneumomediastinum Complicating Pneumonia in Children Infected with the 2009 Pandemic Influenza A (HINI) Virus. Clin. Microbiol. Infect. 16 (2), 195–199. 10.1111/j.1469-0691.2009.03086.x [DOI] [PubMed] [Google Scholar]
  20. Headley A. S., Meduri G. U., Tolley E. (1997). Infections and the Inflammatory Response in Acute Respiratory Distress Syndrome. Chest 111 (5), 1306–1321. 10.1378/chest.111.5.1306 [DOI] [PubMed] [Google Scholar]
  21. How C. (2020). CRP Tells about the Severity of Acute Respiratory Infection. Also in COVID-19. [Google Scholar]
  22. Hsu M.-Y., Yang C.-Y., Hsu W.-H., Lin K.-H., Wang C.-Y., Shen Y.-C., et al. (2014). Monitoring the VEGF Level in Aqueous Humor of Patients with Ophthalmologically Relevant Diseases via Ultrahigh Sensitive Paper-Based ELISA. Biomaterials 35 (12), 3729–3735. 10.1016/j.biomaterials.2014.01.030 [DOI] [PubMed] [Google Scholar]
  23. Huang K.-J., Su I.-J., Theron M., Wu Y.-C., Lai S.-K., Liu C.-C., et al. (2005). An Interferon-?-Related Cytokine Storm in SARS Patients. J. Med. Virol. 75 (2), 185–194. 10.1002/jmv.20255 [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Hudspeth J., Morse M. (2017). Health Information and Global Health Inequity: Point-of-Care Knowledge Systems as a Foundation for Progress. J. Gen. Intern. Med. 32 (5), 572–575. 10.1007/s11606-016-3909-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Hung K.-F., Hung C.-H., Hong C., Chen S.-C., Sun Y.-C., Wen J.-W., et al. (2021). Quantitative Spectrochip-Coupled Lateral Flow Immunoassay Demonstrates Clinical Potential for Overcoming Coronavirus Disease 2019 Pandemic Screening Challenges. Micromachines 12 (3), 321. 10.3390/mi12030321 [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Hurwitz E. S., Haber M., Chang A., Shope T., Teo S., Ginsberg M., et al. (2000). Effectiveness of Influenza Vaccination of Day Care Children in Reducing Influenza-Related Morbidity Among Household Contacts. Jama 284 (13), 1677–1682. 10.1001/jama.284.13.1677 [DOI] [PubMed] [Google Scholar]
  27. Hurwitz E. S., Haber M., Chang A., Shope T., Teo S. T., Giesick J. S., et al. (2000). Studies of the 1996-1997 Inactivated Influenza Vaccine Among Children Attending Day Care: Immunologic Response, Protection against Infection, and Clinical Effectiveness. J. Infect. Dis. 182 (4), 1218–1221. 10.1086/315820 [DOI] [PubMed] [Google Scholar]
  28. Izurieta H. S., Thompson W. W., Kramarz P., Shay D. K., Davis R. L., DeStefano F. (2000). Influenza and the Rates of Hospitalization for Respiratory Disease Among Infants and Young Children. N. Engl. J. Med. 342 (4), 232–239. 10.1056/nejm200001273420402 [DOI] [PubMed] [Google Scholar]
  29. Jalal U. M., Jin G. J., Shim J. S. (2017). Paper-Plastic Hybrid Microfluidic Device for Smartphone-Based Colorimetric Analysis of Urine. Anal. Chem. 89 (24), 13160–13166. 10.1021/acs.analchem.7b02612 [DOI] [PubMed] [Google Scholar]
  30. Kamigaki T., Oshitani H. (2009). Epidemiological Characteristics and Low Case Fatality Rate of Pandemic (H1N1) 2009 in Japan. Plos Curr. 1, RRN1139. 10.1371/currents.RRN1139 [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Lin S.-C., Tseng C.-Y., Lai P.-L., Hsu M.-Y., Chu S.-Y., Tseng F.-G., et al. (2016). Paper-based CRP Monitoring Devices. Sci. Rep. 6 (1), 38171. 10.1038/srep38171 [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Lin W.-C., Lin C.-F., Chen C.-L., Chen C.-W., Lin Y.-S. (2010). Prediction of Outcome in Patients with Acute Respiratory Distress Syndrome by Bronchoalveolar Lavage Inflammatory Mediators. Exp. Biol. Med. (Maywood) 235 (1), 57–65. 10.1258/ebm.2009.009256 [DOI] [PubMed] [Google Scholar]
  33. Liu F., Li L., Xu M., Wu J., Luo D., Zhu Y., et al. (2020). Prognostic Value of Interleukin-6, C-Reactive Protein, and Procalcitonin in Patients with COVID-19. J. Clin. Virol. 127, 104370. 10.1016/j.jcv.2020.104370 [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Mathaweesansurn A., Maneerat N., Choengchan N. (2017). A mobile Phone-Based Analyzer for Quantitative Determination of Urinary Albumin Using Self-Calibration Approach. Sensors Actuators B: Chem. 242, 476–483. 10.1016/j.snb.2016.11.057 [DOI] [Google Scholar]
  35. Nayak S., Blumenfeld N. R., Laksanasopin T., Sia S. K. (2017). Point-of-care Diagnostics: Recent Developments in a Connected Age. Anal. Chem. 89 (1), 102–123. 10.1021/acs.analchem.6b04630 [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Neuzil K. M., Hohlbein C., Zhu Y. (2002). Illness Among Schoolchildren during Influenza Season. Arch. Pediatr. Adolesc. Med. 156 (10), 986–991. 10.1001/archpedi.156.10.986 [DOI] [PubMed] [Google Scholar]
  37. Neuzil K. M., Zhu Y., Griffin M. R., Edwards K. M., Thompson J. M., Tollefson S. J., et al. (2002). Burden of Interpandemic Influenza in Children Younger Than 5 years: A 25‐Year Prospective Study. J. Infect. Dis. 185 (2), 147–152. 10.1086/338363 [DOI] [PubMed] [Google Scholar]
  38. Oh J.-W., Lee H.-B., Park I.-K., Kang J.-O. (2002). Interleukin-6, Interleukin-8, Interleukin-11, and Interferon-γ Levels in Nasopharyngeal Aspirates from Wheezing Children with Respiratory Syncytial Virus or Influenza A Virus Infection. Pediatr. Allergy Immunol. 13 (5), 350–356. 10.1034/j.1399-3038.2002.02018.x [DOI] [PubMed] [Google Scholar]
  39. Reichert T. A., Sugaya N., Fedson D. S., Glezen W. P., Simonsen L., Tashiro M. (2001). The Japanese Experience with Vaccinating Schoolchildren against Influenza. N. Engl. J. Med. 344 (12), 889–896. 10.1056/nejm200103223441204 [DOI] [PubMed] [Google Scholar]
  40. Rouse B. T., Sehrawat S. (2010). Immunity and Immunopathology to Viruses: what Decides the Outcome. Nat. Rev. Immunol. 10 (7), 514–526. 10.1038/nri2802 [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Ryan G. B., Majno G. (1977). Acute Inflammation. A Review. Am. J. Pathol. 86 (1), 183–276. [PMC free article] [PubMed] [Google Scholar]
  42. Sato M., Hosoya M., Wright P. F. (2009). Differences in Serum Cytokine Levels between Influenza Virus A and B Infections in Children. Cytokine 47 (1), 65–68. 10.1016/j.cyto.2009.05.003 [DOI] [PubMed] [Google Scholar]
  43. Simon A. K., Hollander G. A., McMichael A. (2015). Evolution of the Immune System in Humans from Infancy to Old Age. Proc. R. Soc. B. 282 (1821), 20143085. 10.1098/rspb.2014.3085 [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Skoner D. P., Gentile D. A., Patel A., Doyle W. J. (1999). Evidence for Cytokine Mediation of Disease Expression in Adults Experimentally Infected with Influenza A Virus. J. Infect. Dis. 180 (1), 10–14. 10.1086/314823 [DOI] [PubMed] [Google Scholar]
  45. Tsounidi D., Koukouvinos G., Christianidis V., Legaki E., Giogli V., Panagiotopoulou K., et al. (2021). Development of a Point-of-Care System Based on White Light Reflectance Spectroscopy: Application in CRP Determination. Biosensors 11 (8), 268. 10.3390/bios11080268 [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Wang C., Fei D., Li X., Zhao M., Yu K. (2020). IL-6 May Be a Good Biomarker for Earlier Detection of COVID-19 Progression. Intensive Care Med. 46, 1475–1476. 10.1007/s00134-020-06065-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Wang Y. C., Lee Y. T., Yang T., Sun J. R., Shen C. F., Cheng C. M. (2020). Current Diagnostic Tools for Coronaviruses-From Laboratory Diagnosis to POC Diagnosis for COVID-19. Bioeng. Transl Med. 5 (3), e10177. 10.1002/btm2.10177 [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Xiao W., Huang C., Xu F., Yan J., Bian H., Fu Q., et al. (2018). A Simple and Compact Smartphone-Based Device for the Quantitative Readout of Colloidal Gold Lateral Flow Immunoassay Strips. Sensors Actuators B: Chem. 266, 63–70. 10.1016/j.snb.2018.03.110 [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Xing Z., Gauldie J., Cox G., Baumann H., Jordana M., Lei X. F., et al. (1998). IL-6 Is an Antiinflammatory Cytokine Required for Controlling Local or Systemic Acute Inflammatory Responses. J. Clin. Invest. 101 (2), 311–320. 10.1172/jci1368 [DOI] [PMC free article] [PubMed] [Google Scholar]
  50. Xu X., Blanton L., Elal A. I. A., Alabi N., Barnes J., Biggerstaff M., et al. (2019). Update: Influenza Activity in the United States during the 2018-19 Season and Composition of the 2019-20 Influenza Vaccine, MMWR Morb. Mortal. Wkly. Rep. 68(24), 544–551. 10.15585/mmwr.mm6824a3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Yang P., Ding Y., Xu Z., Rui Pu., Li Ping., Jin Yan. (2020). Epidemiological and Clinical Features of COVID-19 Patients with and without Pneumonia in Beijing, China. New York: Medrxiv. 10.1101/2020.02.28.20028068 [DOI] [Google Scholar]
  52. Yang X., Wang Y., Liu W., Zhang Y., Zheng F., Wang S., et al. (2016). A Portable System for On-Site Quantification of Formaldehyde in Air Based on G-Quadruplex Halves Coupled with A Smartphone Reader. Biosens. Bioelectron. 75, 48–54. 10.1016/j.bios.2015.08.020 [DOI] [PubMed] [Google Scholar]
  53. Zhang Y., Li J., Zhan Y., Wu L., Yu X., Zhang W., et al. (2004). Analysis of Serum Cytokines in Patients with Severe Acute Respiratory Syndrome. Infect. Immun. 72 (8), 4410–4415. 10.1128/iai.72.8.4410-4415.2004 [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Click here for additional data file. (150.8KB, DOCX)

Data Availability Statement

The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found in the article/Supplementary Material.

Articles from Frontiers in Bioengineering and Biotechnology are provided here courtesy of Frontiers Media SA

RESOURCES