Abstract
Although mass spectrometry (MS) of metabolites has the potential to provide real‐time monitoring of patient status for diagnostic purposes, the diagnostic application of MS is limited due to sample treatment and data quality/reproducibility. Here, the generation of a deep stabilizer for ultra‐fast, label‐free MS detection and the application of this method for serum metabolic diagnosis of coronary heart disease (CHD) are reported. Nanoparticle‐assisted laser desorption/ionization‐MS is used to achieve direct metabolic analysis of trace unprocessed serum in seconds. Furthermore, a deep stabilizer is constructed to map native MS results to high‐quality results obtained by established methods. Finally, using the newly developed protocol and diagnosis variation characteristic surface to characterize sensitivity/specificity and variation, CHD is diagnosed with advanced accuracy in a high‐throughput/speed manner. This work advances design of metabolic analysis tools for disease detection as it provides a direct label‐free, ultra‐fast, and stabilized platform for future protocol development in clinics.
Keywords: deep learning, diagnostics, coronary heart diseases, mass spectrometry, metabolites
Mass spectrometry (MS) based metabolic analysis has the potential to provide real‐time monitoring of patient status for diagnostic purposes, whereas the diagnostic application is limited due to sample treatment and data quality/reproducibility. Here, the generation of a deep stabilizer is developed for ultra‐fast, label‐free MS detection in serum metabolic diagnosis of coronary heart disease.
1. Introduction
Diagnostics is the key to precision medicine in the customization of healthcare for optimal treatment decisions,[ 1 ] and two‐thirds of clinical diagnoses rely on in vitro diagnostics (IVD).[ 2 ] Compared to the traditional analytical approaches (e.g., nuclear magnetic resonance (NMR) and biochemical methods), mass spectrometry (MS) demonstrates advantages of molecular identification capability and high analytical speed. Conventionally, NMR[ 3 ] measures atomic species by their electromagnetic response from specific atoms in the interaction with magnetic fields and biochemical methods[ 4 ] require enzymes or antibodies for targeted molecular recognition based selective reaction,[ 4, 5 ] both of which usually need relatively long detection time due to the relaxation or recognition/reaction. For comparison, MS can directly record the mass‐to‐charge ratio (m/z) of molecules and their fragments, affording enhanced molecular identification capability and high analytical speed.
Notably, two major ionization mechanisms for MS are in clinical use: electrospray ionization (ESI) and laser desorption/ionization (LDI). These two mechanisms rely on ion or electron transfer in the primary ion formation during ionization,[ 6 ], for example, absorption of photons with matrix for solid‐to‐gas transition in LDI.[ 7 ] However, both of these types of MS require sample treatment that restricts the real‐world applications. Specifically, most clinical MS approaches require rigorous multi‐step chromatography and derivatization procedures to reduce sample complexity and enrich target molecules,[ 8 ] but these procedures bring trade‐offs in terms of decreased speed/efficiency and increased sample consumption. Moreover, isotope‐labeling is commonly used as a sample pretreatment, inevitably increasing the expense (≈$2000/g) and expert labor/time (days per isotope synthesis and hours per isotope labeling) required for the diagnostic use of MS. The development of nanotechnology, enhancing charge transfer and decreasing heat dissipation for photon‐induced desorption/ionization of analytes in primary formation with nanomaterials as matrix,[ 7, 9 ] has shed light on MS ionization mechanisms (especially for LDI‐MS), and may offer high performance in a label‐free manner without sample treatment. The rational design of a nanoparticle‐assisted MS method would serve as a potential ground‐breaking solution for IVD.[ 10 ]
The clinical use of MS depends on high data quality (referring to high‐reproducibility on diagnosis, indicated by diagnostic coefficient of variation (CV) < 10% (CV of predicted labels). Notably, a large number of technical replicates are needed to ensure high data quality and reproducibility.[ 11 ] Whereas, to ensure high data quality and reproducibility for deep matrix‐assisted LDI‐MS, millions of laser shots are required.[ 12 ] The acquisition of high‐quality results in this manner is expensive, time‐consuming, and labor‐intensive, which limits the large‐scale clinical applicability of this method. Data quality can be significantly enhanced by machine learning, particularly deep learning. Due to the task‐oriented learning strategy to encode features and intrinsic data representations via nonlinear modules,[ 13 ] deep learning has been successfully applied to complex signal reconstruction tasks,[ 14 ] such as low‐dose to normal‐dose computed tomography (CT) images transfer and magnetic resonance images to CT images transfer.[ 15 ] Yet, despite recent successes in the high‐quality prediction of tandem MS (MS/MS) data,[ 16 ] the applications of deep learning in MS is very limited in terms of both the acquisition of high‐quality MS data and subsequent diagnostic application.
We developed and applied our deep learning method in the context of disease diagnosis using serum metabolic profiles (SMPs), serum blueprints extracted from LDI‐MS results for distinguishing patients from controls. Metabolic disorder is associated with a majority of diseases, including coronary heart disease (CHD), which accounts for half of cardiovascular‐related deaths.[ 17 ] CHD includes myocardial infarction (MI), which exhibits the highest mortality among CHD cases (47.8%), resulting in millions of deaths worldwide per year.[ 17 ] Notably, speed is critical in the early detection of MI for emergency use to save patient lives and improve quality of life. The high‐sensitivity cardiac troponin I/T (cTnI/T) test is applied to almost every CHD patient with suspected MI. Despite its near ubiquitous use, the troponin assay requires the serial cTnI measurements (up to 9 h) and one measurement demands at least 15–30 min for the antibody–antigen recognition on which the method depends to occur.[ 4, 18 ] Furthermore, for non‐MI CHD, troponin does not provide any valuable diagnostic information, and angiography plus electrocardiogram (the gold standard diagnostic method) is used instead, which can be invasive and is thus not practical for general screening.[ 19 ] Therefore, improved methods to detect CHD, particularly both MI and non‐MI, are needed.
To address the major challenges described above, we applied generated ferrous nanoparticles (NPs) and a deep stabilizer and used them to develop an ultra‐fast, label‐ and antibody‐free MS‐based method for a stabilized metabolic diagnosis with trace serum. This method was verified by assessing its performance in diagnosing CHD (both MI and non‐MI CHD) and found to exhibit advantages over existing methods. Nanoparticle‐assisted LDI‐MS may represent a revolution in the detection of metabolic disorders and contribute to improving health care.
2. Results and Discussion
2.1. Metabolic Analysis of Trace Serum by Nanoparticle‐Assisted LDI‐MS
We performed ultra‐fast serum metabolic analysis by NP‐assisted LDI‐MS, with high‐throughput/speed solid phase ionization (solid‐to‐gas transition) enhanced by orders of magnitude over liquid phase ionization (liquid‐to‐gas transition) by ESI. LDI‐MS incorporated label‐free sample preparation and MS detection in 30 s, for an overall experimental time < 1 min per sample. Ferrous NPs were selected as the matrix for LDI‐MS, due to its low‐cost and straightforward synthesis procedure for large‐scale use.[ 10d ] We prepared ferrous NPs by wet chemistry, which yielded ≈0.83 g of product per batch (from three independent batches, Figure S1a, Supporting Information), a yield sufficient for 1,660,000 tests (0.5 µg/test). The ferrous NPs, where its ferrous oxide composition was indicated by energy‐dispersive X‐ray spectrum (Figure S1b, Supporting Information), had a rough surface (Figure S1c, Supporting Information) and crystalline structure (Figure S1d–f, Supporting Information), according to scanning electron microscopy, transmission electron microscopy, and selected area diffraction images. In addition, the ferrous NPs strongly absorbed light for transferring laser energy (Figure S1g, h, Supporting Information), and had good water dispersity adequate for their use as a matrix (Figure S1i, Supporting Information) and a negatively charged surface for cation adduction (Figure S1j, Supporting Information), as summarized in Figure S1k, Supporting Information. All the above characteristics, including low costs, rough surface, and related parameters, would be beneficial for LDI‐MS analysis.
In the absence of sample treatment, the successful metabolic analysis of a small volume of serum (0.5 µL) requires good salt and protein tolerance. Therefore, to assess the salt tolerance of ferrous NP‐assisted LDI‐MS detection, we first analyzed a mixture of three metabolites (valine, lysine, and glucose, see Figure S2a–c, Supporting Information, for standards) after cation adduction in 0.5 µL of highly concentrated solutions of NaCl (0.5 m, Figure S2d, Supporting Information) and KCl (0.5 m, Figure S2e, Supporting Information). In each case, we identified molecular peaks characteristic of the metabolites examined. Then, to assess the protein tolerance of ferrous NP‐assisted LDI‐MS detection, we analyzed the same three metabolites combined with bovine serum albumin at a high concentration (5 mg mL−1) and again obtained molecular peaks characteristic of the three metabolites (Figure S2f, Supporting Information). In addition, we performed the LDI MS detection results using the conventional organic matrices (α‐cyano‐4‐hydroxycinnamic acid (Figure S3a, Supporting Information) and 2,5‐dihydroxybenzoic (Figure S3b, Supporting Information)), showing both strong interference in low mass range[ 10, 20 ] and limited sensitivity/selectivity[ 10, 21 ] in the analysis of glucose (1 ng nL−1), compared to ferrous NPs (Figure S3c, Supporting Information). The above results highlighted the advantages of NP‐assisted LDI MS. Notably, our method allows a large number of tests (1000–2000) to be carried out in a very low analyte volume (≈µL), unlike conventional methods, which require a large volume (≈mL) and yield only a small number of tests (< 10).[ 3, 8, 22 ] Moreover, the detection limits (≈µm, the lowest concentration can be detected) toward standard metabolites were of high sensitivity (Table S1, Supporting Information) considering the concentrations of metabolites in human serum (≈mm–µm).[ 23 ] We therefore conclude that our ferrous NP‐assisted LDI‐MS achieved selective and sensitive LDI for diagnostic use.
Notably, clinical MS relies on rigorous multi‐step chromatography and derivatization procedures with slow analytical speed (up to hours per sample) and large sample volumes (on the order of milliliters) in order to reduce sample complexity by desalting and the removal of highly abundant proteins,[ 8, 22 ] and thus enrich target molecules (see Table S2, Supporting Information, for a comparison among techniques). In contrast, NP‐assisted LDI‐MS requires no sample pretreatment, is fast (taking 30 s for analysis), and requires only a small sample volume (0.5 µL of serum as optimized, Figure S4, Supporting Information); both its analytical speed and required sample volume represent improvements of over one order of magnitude compared to clinical MS. Also, for sample storage, serum samples were stored at −80 degree in biobank for repeating use in diagnostics. Our methods may improve the reusability (0.5 µL per test) by 1–2 orders of magnitude affording minimum storage volume (≈µL), compared to prevailing diagnostic methods which requires large storage volume (≈mL).[ 3, 8, 22 ] Therefore, our method addresses sample treatment, the key challenge to the universal use of clinical MS, as it requires no pretreatment procedures and only a very small sample volume.
2.2. Validation of Nanoparticle‐Assisted LDI‐MS via Diagnosis of MI and Non‐MI Patients Using SMPs
Considering the global demand of a speedy and non‐invasive tool for precision diagnosis of CHD toward efficient treatment, we conducted direct label‐free metabolic analysis of serum for CHD patients (CHDs, including MI and non‐MI) and healthy controls (HCs) in Figure 1. All CHD patients, including MI and non‐MI patients, had a specific diagnosis by angiography and electrocardiography, and all clinical information for each case was reviewed by two pathologists without knowledge of the clinical course of the patient. For MI patients, 99th percentile cTnI levels were recorded by high‐sensitivity chemiluminescence immunoassay. Serum samples were also collected from the HCs, who had no clinical evidence of cardiovascular disease or other major diseases. Power analysis (a universal method to obtain the optimal sample size within a significant level of confidence) was performed on a pilot dataset of 16 samples (8/8, CHD/control) to compute the minimum sample number required for the meaningful machine learning (Figure S5, Supporting Information).[ 24 ] Based on the result of power analysis, the minimum number of samples was 160 (80/80, CHD/control) for achieving the predicted power of > 0.8, which is significant to conclude the statistical meaningful results according to previous references.[ 10, 25 ] Finally, 517 individuals were enrolled (414 individuals as the discovery cohort and 103 individuals as the validation cohort), of which 261 were HCs and 256 were CHD patients (137 MI patients and 119 non‐MI patients, Table 1 and Table S3, Supporting Information). There was no significant difference in age or sex between the HCs and CHD patients (Table S3, Supporting Information). Typical MS spectra obtained from a MI patient and non‐MI CHD patient and a HC are shown in Figure 1a, with differences hardly recognized by naked eyes.
Table 1.
Patient categorya) | Deep stabilizerb) | CV/AUCc) | CV/sensitivityc) | CV/specificityc) | Thresholdd) | Sensitivityd) |
---|---|---|---|---|---|---|
CHD | N | 12%/0.86 | 13%/0.81 | 14%/0.80 | 23rd | 0.98 |
D | 3%/0.95 | 5%/0.91 | 5%/0.89 | 70th | 0.98 | |
MI | N | 12%/0.85 | 13%/0.82 | 13%/0.79 | 22nd | 0.98 |
D | 4%/0.95 | 5%/0.93 | 7%/0.88 | 69th | 0.98 | |
non‐MI | N | 12%/0.86 | 14%/0.83 | 14%/0.81 | 24th | 0.98 |
D | 3%/0.95 | 5%/0.93 | 6%/0.89 | 70th | 0.98 |
Patient category comprised coronary heart disease patients (denoted CHD), CHD patients with myocardial infarction (denoted MI), and CHD patients without myocardial infarction (denoted non‐MI).
Deep stabilizer column indicated whether native MS results were deep‐stabilized (denoted D) or no stabilization (denoted N).
CV referred to the coefficient of variation, which was calculated as the ratio of the standard deviation to the mean. AUC referred to the area under the receiver operating characteristic curve. Sensitivity referred to the ratio of the number of true positives to the total number of patients. Specificity referred to the ratio of the number of true negatives to the total number of controls. Sensitivity and specificity were determined by the upper‐left point in ROC plot based on machine learning.
Threshold referred to the cut‐off for diagnosis, represented by the nth percentile upper reference probability of HCs, equivalent to specificity. Sensitivity was determined at CV of 10% according to the DVC‐derived thresholds.
We constructed label‐free SMPs (Figure 1b) for machine learning in a step‐wise manner (Figure S6, Supporting Information). Data processing consisted of four main steps: signal extraction by preprocessing, feature selection by signal‐to‐noise ratio (S/N), profile recognition by machine learning, and biomarker screening by multiple restrictions. In the initial signal extraction step, we performed preprocessing using the local maximum method to decrease the complexity of native MS results from ≈80,000 data points per spectrum before extraction) to 273 metabolite peaks after extraction. In the second step—feature selection—we excluded features with background S/N ≤ 3, and found 35 m/z features comprising the SMPs. In the third data processing step—profile recognition—we used machine learning to differentiate the SMPs from different groups, including CHD/MI/non‐MI. Finally, for biomarker screening, we used multiple restrictions (with a hit frequency > 60, mean intensity > 25, and p < 0.001) to choose the features in the SMP and identify m/z features that might represent metabolic biomarkers (Table S4, Supporting Information).
In the profile recognition step, we studied the diagnostic performance of two major machine learning algorithms: orthogonal projections to latent structures discriminant analysis (OPLS‐DA, a combined multivariate analysis as universally used in metabolic analysis) and elastic net analysis (a form of sparse learning) in Figure 1c and Table S5, Supporting Information.[ 10, 26 ] For conventional OPLS‐DA, the diagnostic performance in distinguishing CHD patients from HCs was unsatisfactory (area under the curve, AUC < 0.9),[ 27 ] with AUC/sensitivity/specificity values of 0.84 (0.80–0.88 at a 95% confidential interval (CI))/0.73/0.78 in the discovery cohort and 0.82 (0.74–0.90 at a 95% CI)/0.77/0.68 in the validation cohort (Figure 1c and Table S5, Supporting Information). In contrast, the sparse learning performed much better, with AUC/sensitivity/specificity values of 0.97 (0.95–0.98 at a 95% CI)/0.91/0.88 in the discovery cohort and 0.93 (0.88–0.98 at a 95% CI)/0.85/0.87 in the validation cohort (Figure 1c, Table S5, and Figure S8g, j, Supporting Information). Notably, we demonstrated similarly high diagnostic performance for distinguishing both MI (AUC of 0.97/0.92 for discovery/validation cohort) and non‐MI (AUC of 0.96/0.94 for discovery/validation cohort) patients from HCs (Figure S8, Supporting Information). We further performed precision‐recall curve (PRC) analysis[ 28 ] on the diagnostic performances of sparse learning and OPLS‐DA. Based on the result of PRC, elastic net achieved higher area under PRC (AUPRC), with AUPRC increasing from 0.79/0.78 to 0.97/0.91 in the discovery/validation cohort for CHD diagnosis, respectively (Figure 1d and Figure S8d–f, Supporting Information).
To exclude the overfitting effects, we performed five‐fold cross‐validation (Figure S7, Supporting Information) and permutation test (Figure S9, Supporting Information). We performed the cross‐validation process in the discovery cohort and the independent validation cohort was used for blind test (Figure S7a, Supporting Information). Based on the diagnostic model with cross‐validation, no significant difference of AUC was found between cross‐validation and testing in every round according to the independent‐samples t‐test (p of 0.07–0.89, Table S6, Supporting Information). For permutation test, the classifier showed no overfitting effect with p < 0.05 from the distribution of the AUC calculated using the uninformative data obtained by random permutation (Figure S9, Supporting Information), which is universally employed to estimate overfitting.[ 29 ] In addition, the consistency of diagnostic performance in both validation cohort (AUC of 0.91, blind test dataset in classifier testing) and discovery cohort (AUC of 0.93, cross‐validation in classifier training) further guaranteed a robust model without overfitting, according to previous reports.[ 30 ]
The superior performance of sparse learning over that of conventional OPLS‐DA may be due to two major factors. First, the MS data exhibits intrinsic sparsity; only a few biomarkers are potentially useful for diagnosis,[ 10c–f ] reflected in the finding that only six metabolite peaks were hit stably (hit frequency > 60) and were of significant intensity (p value less than 0.001, Table S4 and Figure S6b, Supporting Information). The second factor is that sparse regularization allows the classification contributions of these metabolite peaks to be gauged and high weights to be assigned to a limited number of biomarkers with relatively high importance.
2.3. Generation of a Deep Stabilizer for Enhanced MS Data and Diagnosis
We observed performance variation that affected the diagnostic sensitivity and specificity, thus sought to develop a method to improve accuracy and stabilize performance (Figure 2a). To establish how this variation might affect the method's diagnostic use, we conducted 10 independent technical replicates on one sample from each of the 517 individuals in the two cohorts, with 1000 laser shots per replicate (Table 1). We observed a high level of variation in the data, with a CV of 12–14% for AUC, sensitivity, and specificity among the 10 replicates (Table 1). For example, in 100 blinded inter‐replication combinations of groups for the discovery and validation cohorts, the AUC ranged from 0.58 to 0.99—this unsatisfactory reproducibility (CV > 10%) would limit its practical use (Table 1 and Tables S7 and S8, Supporting Information). Notably, the overall AUC reached 0.98 across 10 replicates (corresponding to 10,000 laser shots per individual, Figure S6a, Supporting Information), which could enhance data quality and reduce variation.[ 12 ] These results revealed the existence of variation in native MS data and demonstrated that high‐quality MS data were obtained through replication.
Due to the infeasible time and expense of replication in real‐case application, deep learning can produce high‐quality data with the task‐oriented learning strategy, to encode features and intrinsic data representations via nonlinear modules in a practical manner. Accordingly, we constructed a deep stabilizer to reduce variation in the MS data and thereby increase the accuracy of CHD diagnosis. Using the deep stabilizer, we mapped native MS data obtained from a small number of tests (200–1000 shots) to high‐quality data corresponding to a large number of tests (up to 10,000 shots; Figure 2a and Figure S10, Supporting Information). The deep stabilizer network consisted of two branches: one reconstructed high‐quality MS output from the low‐quality MS input, and the other acted as an attention mechanism that refined the signal peaks (Figure S11, Supporting Information). In order to control the diagnostic variation caused by the non‐predictable LDI process of complicated ionization models as involved, for example, lucky survivor model,[ 31 ] and because a large number of tests can deliver high‐quality results for diagnosis, the stabilizer is expected to transform native MS data obtained from a low number of laser shots to enhanced MS data equivalent to that obtained from a large number of shots and thus stabilize the diagnostic performance.
Next, we tested the performance of the deep stabilizer by comparison of diagnostic variations. After processing with the deep stabilizer, the CVs for AUC, sensitivity, and specificity in the diagnosis of CHD were significantly (p < 0.0001) decreased to 3–5% (Figure 2b, Table 1, and Table S11, Supporting Information), while the mean AUC and sensitivity/specificity increased to 0.95 and 0.91/0.89 in the validation cohort, respectively. For comparison, in the same data before processing with the deep stabilizer, we observed CVs of 12–14% in the AUC and sensitivity/specificity, which reached only 0.86 and 0.81/0.80, respectively. Accordingly, we observed that the CV of predicted probabilities for each individual was significantly decreased for both MI and non‐MI patients in the validation cohort (Figure 2c), from 8 to 5%, after stabilizing. We observed consistent results in the discovery cohort (Figure S12 and Table S12, Supporting Information). We also studied the diagnostic performance with different numbers of laser shots when data were obtained with the deep stabilizer (Figure S13, Supporting Information). These data demonstrated enhanced diagnostic performance that was increased with an increasing number of laser shots with the deep stabilizer due to increased accuracy. Consequently, the deep stabilizer delivered remarkable performance in reducing the CV for the deep‐stabilized data.
We also investigated in detail the effect of data stabilization on the detection of metabolic biomarkers from the SMPs. For instance, in data that had not been processed with the deep stabilizer, there was no significant difference between the HCs and CHD patients in 1‐methylpyrrole level, which correlated with CHD (p = 0.87, Figure 2d and Table S4, Supporting Information). In contrast, after deep stabilization, we observed a significant difference between these participant groups (p < 0.0001), reflecting the upregulation of 1‐methylpyrrole in CHD patients that were in accord with results in Table S4, Supporting Information. More importantly, we newly screened 5 m/z features including lactic acid (LA), methylimidazoleacetic acid (MIAA), cis‐aconitic acid (cis‐AC), diacylglycerol (14:1/24:1), and diacylglycerol (24:1/20:4) as potential metabolic biomarkers, which showed significant differences only after deep stabilization (Figure 2e and Table S13, Supporting Information). Therefore, based on these data, we conclude that reconstruction of the biomarkers in the SMPs enhanced diagnostic performance, validating the effect of the deep stabilizer in detail.
2.4. Construction of Diagnosis Variation Characteristic Surface (Mengji‐Kun Surface)
Considering the enhanced diagnostic performance (reduced CV and improved AUC) in CHD screening brought by the deep stabilizer, we sought to construct a novel tool to evaluate diagnostic sensitivity, specificity, and variation simultaneously. We established a diagnostic model for CHD by building a novel diagnosis variation characteristic (DVC) surface (also named as the Mengji‐Kun (MK) surface) using the SMPs and deep stabilizer (Figure 3a and Table 1). The model building consisted of three major procedures: threshold identification with the threshold representing the percentile to distinguish CHDs from HCs, accuracy calculation with the accuracy referring to the probability variation among a series of technical replicates at the given threshold, and performance correlation with the performance including CV of probability as a function of sensitivity and specificity (Figure 3a).
Specifically, for threshold identification, we screened the nth percentile (from 1st to 100th percentile with a step of one percentile) upper reference predicted probability of the HC cohort as the threshold. The predicted probability of the HC cohort was obtained from the SMPs by sparse learning and the percentile was equivalent to specificity. For accuracy calculation, we measured the predicted probabilities of each CHD patient using 100 models, considering variation among inter‐replications. The nth percentile was applied in 100 models as the threshold to obtain 100 predicted labels for accuracy calculation. For performance correlation, we plotted the CV of probability as a function of diagnostic performance (sensitivity/specificity), generating a 3D model representing the MK surface. In this 3D model, the optimized diagnostic tool is expected to afford the minimum volume under the surface (VUS), indicating maximum accuracy and precision.
By applying this 3D model to the discovery cohort, we obtained a VUS of 1.14 using the deep stabilizer, but a less favorable VUS of 2.67 without the deep stabilizer (Figure 3b). Specifically, given a CV of < 10%, as recommended in the current guidelines for CHD diagnosis,[ 11 ] the diagnostic performance with data stabilization reached the threshold for 74th percentile (Figure 3c and Figure S14a, Supporting Information) with a sensitivity of 0.98 (Figure 3d), a threshold that is superior to that of that obtained without data stabilization (43rd percentile with a sensitivity of 0.98, Figure S14b, Supporting Information). Similarly, in the validation cohort, we observed a VUS of 1.66 using the deep stabilizer and a VUS of 6.01 without the data stabilizer (Figure 3e), and the use of the data stabilizer enhanced the diagnostic performance threshold (from the 23rd to the 70th percentile) (Figure 3f and Figure S15, Supporting Information) with a sensitivity of 0.98 using deep‐stabilized data (Figure 3g) at a given CV of < 10%. Therefore, using the MK surface and VUS to evaluate diagnostic performance, we successfully validated our diagnostic protocol for CHD using the SMPs and deep stabilizer.
2.5. Establishment of a New Diagnostic Protocol for CHD
We have developed a novel protocol for the diagnosis of CHD using the SMP and novel data stabilizer (Figure 4). Importantly, our serum metabolic approach has several advantages over the universal gold standard methods for the diagnosis of CHD (MI/non‐MI) patients (troponin assays, electrocardiography, and angiography).[ 19, 32 ] The application of troponin assays is limited to CHD patients with MI, and fails to identify early‐stage CHD; in addition, each assay test requires at least 15–30 min for completion of the antibody reaction.[ 4, 18 ] Electrocardiography requires slight visual changes in the electrocardiogram to be interpreted, and thus it can only be performed by experts with years of experience and it suffers from inter‐observer variability.[ 32, 33 ] Finally, angiography is invasive and complicated to perform, prohibiting its use for general screening.[ 32 ] In contrast to these procedures, our metabolic approach 1) achieved high diagnostic performance (including AUC, sensitivity, and specificity) in distinguishing CHD patients (both MI and non‐MI patients) from HCs; 2) facilitated ultra‐fast and label‐ and antibody‐free detection in seconds, with an experimental time less than 1 min toward on‐site and real‐time diagnosis; and 3) was minimally invasive with the use of blood samples. Therefore, NP‐assisted LDI‐MS could easily be applied on a large scale and make changes in cardiovascular clinics.
Typically, the establishment of a novel protocol is the key for a diagnostic assay that serves as a breakthrough and its universal clinical application. State‐of‐the‐art analytical tools for the diagnosis of CHD have evolved from blood glucose to cardiac troponin assays;[ 11, 32, 33, 34 ] these assays were still in wide use and have had a large impact by efficiently reducing the morbidity and mortality of patients with CHD. For cardiac troponin assays, the diagnostic protocol affords the 99th percentile as the threshold for positivity with a sensitivity of 0.93–1.00 at the given CV of < 10%, but this assay cannot be applied to non‐MI CHD patients, as it detects elevated cTnI levels, which arise from impaired cardiac muscle due to MI.[ 18, 32 ] Meanwhile, the blood glucose assay is applied to nearly every suspected CHD patient, but the diagnostic application of this assay is limited because glucose levels can also be elevated in many other circumstances, such as in response to diet in general and common diseases concurrent with CHD (e.g., diabetes).[ 34, 35 ] Finally, blood lipoprotein levels, which form the basis of another typical CHD assay, are poorly specific and heritable, and thus vary widely among individuals.[ 34, 36 ] Importantly, all the above assays require a certain number (≈4–8) of serial measurements (up to 9 h) to improve the sensitivity and the threshold used to diagnose CHD, while biomarker concentrations are measured.[ 18, 35 ]
The information given by the detection of SMPs using our deep stabilization method is more systematic than that obtained by these standard assays, providing a more comprehensive indication of an individual's disease status. Indeed, the desirable sensitivity and specificity of SMP detection allow the diagnosis of CHD (both MI and non‐MI). Furthermore, our protocol for the diagnosis of CHD (both MI and non‐MI) affords the 74th percentile as the threshold for positivity with a sensitivity of 0.98 and CV < 10%, due to deep‐stabilization of data reducing the CV and improving the specificity. Accordingly, our newly defined MK surface and the VUS can be used with our protocol to study diagnostic performance toward other disease detection to evaluate its performance, including the sensitivity, specificity, and CV. Hence, our protocol based on deep stabilization to obtain SMPs may function as a next‐generation diagnostic tool for CHD, similar to the use of cardiac troponin assays for the diagnosis of MI.
As a work of artificial intelligence assisting the screening of CHD, we expected two major research directions to be explored following this work, toward both medical science and computer science. For medical science, more CHD subtypes and control diseases would be included to demonstrate the universal application of our approach. For computer science, database construction would be desirable to maximize the overall performance of selected algorithms.
3. Conclusion
In summary, we generated ferrous NPs and applied them in NP‐assisted LDI‐MS, and further constructed a deep stabilizer to generate high‐quality MS results relating to SMPs from which biomarkers can be identified, toward better understanding of pathological process for early prevention, in‐time detection, and efficient control; these SMPs and the deep stabilizer were used to construct a novel method for the enhanced diagnosis of CHD. Our work represents several advances over currently available diagnostic protocols, for example, high analytical speed, antibody‐ and label‐free process, and detection of non‐MI patients, which cannot be achieved by traditional assays like troponin tests.
Our work will not only facilitate precision medicine for the diagnosis of CHD, but also lead to the development of personalized diagnostic tools for other metabolic diseases in the near future. Compared to conventional metabolic analytical approaches,[ 2, 3, 22 ] our method may achieve millions of tests in common laboratory conditions by single mass spectrometer per year at low cost and high throughput, with advanced performance to study huge cohorts in large‐scale translational medicine.
Conflict of Interest
The authors declare competing financial interest. The authors have filed patents for both the technology and the use of the technology to detect bio‐samples.
Supporting information
Acknowledgements
The authors are grateful for the financial support from National Key R&D Program of China (2018YFC1312802), Project 2017YFE0124400 by Ministry of Science and Technology of China, Project 81771983 and 81971771 by National Natural Science Foundation of China, and Innovation Group Project of Shanghai Municipal Health Commission (2019CXJQ03). This work was also sponsored by Shanghai Rising‐Star Program (19QA1404800), Innovation Research Plan by the Shanghai Municipal Education Commission (ZXWF082101), Project 2021‐01‐07‐00‐02‐E00083 by Shanghai Institutions of Higher Learning, and the Program for Professor of Special Appointment (Eastern Scholar). All the investigation protocols in this study were approved by the institutional ethical committees of the Shanghai Chest Hospital and the School of Biomedical Engineering, Shanghai Jiao Tong University (KS(P)1703 and KS1736). Written informed consent was provided from all individuals participating in the study, and the use of their biological samples for analysis was approved for analysis in accordance with the Declaration of Helsinki.
Zhang M., Huang L., Yang J., Xu W., Su H., Cao J., Wang Q., Pu J., Qian K., Ultra‐Fast Label‐Free Serum Metabolic Diagnosis of Coronary Heart Disease via a Deep Stabilizer. Adv. Sci. 2021, 8, 2101333. 10.1002/advs.202101333
Data Availability Statement
The data that support the findings of this study are available from the corresponding author upon reasonable request.
References
- 1.a) Aronson S. J., Rehm H. L., Nature 2015, 526, 336; [DOI] [PMC free article] [PubMed] [Google Scholar]; b) Sanghvi V. R., Leibold J., Mina M., Mohan P., Berishaj M., Li Z., Miele M. M., Lailler N., Zhao C., de Stanchina E., Viale A., Akkari L., Lowe S. W., Ciriello G., Hendrickson R. C., Wendell H.‐G., Cell 2019, 178, 807; [DOI] [PMC free article] [PubMed] [Google Scholar]; c) Huang L., Qian K., Small Methods 2020, 4, 1900717. [Google Scholar]
- 2.a) Zenobi R., Science 2013, 342, 1243259; [DOI] [PubMed] [Google Scholar]; b) Rohr U.‐P., Binder C., Dieterle T., Giusti F., Messina C. G. M., Toerien E., Moch H., Schaefer H. H., PLoS One 2016, 11, e0149856; [DOI] [PMC free article] [PubMed] [Google Scholar]; c) Gootenberg J. S., Abudayyeh O. O., Kellner M. J., Joung J., Collins J. J., Zhang F., Science 2018, 360, 439; [DOI] [PMC free article] [PubMed] [Google Scholar]; d) Song H., Zhu Y., VIEW 2020, 1, e5. [Google Scholar]
- 3.Beckonert O., Keun H. C., Ebbels T. M. D., Bundy J. G., Holmes E., Lindon J. C., Nicholson J. K., Nat. Protoc. 2007, 2, 2692. [DOI] [PubMed] [Google Scholar]
- 4.a) Huang L., Gurav D. D., Wu S., Xu W., Vedarethinam V., Yang J., Su H., Wan X., Fang Y., Shen B., Price C.‐A. H., Velliou E., Liu J., Qian K., Matter 2019, 1, 1669; [Google Scholar]; b) Liu W., Sun S., Huang Y., Wang R., Xu J., Liu X., Qian K., Chem. ‐ Asian J. 2020, 15, 56; [DOI] [PubMed] [Google Scholar]; c) Gao W., Wen D., VIEW 2021, 20200124; [Google Scholar]; d) Xu W., Wang L., Zhang R., Sun X., Huang L., Su H., Wei X., Chen C.‐C., Lou J., Dai H., Qian K., Nat. Commun. 2020, 11, 1654; [DOI] [PMC free article] [PubMed] [Google Scholar]; e) Geng W.‐C., Zheng Z., Guo D.‐S., VIEW 2021, 2, 20200059. [Google Scholar]
- 5.a) Nolan T., Hands R. E., Bustin S. A., Nat. Protoc. 2006, 1, 1559; [DOI] [PubMed] [Google Scholar]; b) Liu X., Liu J., VIEW 2021, 2, 20200102; [Google Scholar]; c) Zhang R., Rejeeth C., Xu W., Zhu C., Liu X., Wan J., Jiang M., Qian K., Anal. Chem. 2019, 91, 7078; [DOI] [PubMed] [Google Scholar]; d) Zhang R., Le B., Xu W., Guo K., Sun X., Su H., Huang L., Huang J., Shen T., Liao T., Liang Y., Zhang J. X. J., Dai H., Qian K., Small Methods 2019, 3, 1800474; [Google Scholar]; e) Liu J., Cai C., Wang Y., Liu Y., Huang L., Tian T., Yao Y., Wei J., Chen R., Zhang K., Liu B., Qian K., Adv. Sci. 2020, 7, 1903730. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.a) Fenn J. B., Mann M., Meng C. K., Wong S. F., Whitehouse C. M., Science 1989, 246, 64; [DOI] [PubMed] [Google Scholar]; b) Aebersold R., Mann M., Nature 2016, 537, 347. [DOI] [PubMed] [Google Scholar]
- 7.a) Tanaka K., Waki H., Ido Y., Akita S., Yoshida Y., Yoshida T., Matsuo T., Rapid Commun. Mass Spectrom. 1988, 2, 151; [Google Scholar]; b) Sun S., Liu W., Yang J., Wang H., Qian K., Angew. Chem., Int. Ed. 2021, 60, 11310. [DOI] [PubMed] [Google Scholar]
- 8.a) Yuan M., Kremer D. M., Huang H., Breitkopf S. B., Ben‐Sahra I., Manning B. D., Lyssiotis C. A., Asara J. M., Nat. Protoc. 2019, 14, 313; [DOI] [PMC free article] [PubMed] [Google Scholar]; b) Gowers G. O. F., Chee S. M., Bell D., Suckling L., Kern M., Tew D., McClymont D. W., Ellis T., Nat. Commun. 2020, 11, 868. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Chen S., Xiong C., Liu H., Wan Q., Hou J., He Q., Badu‐Tawiah A., Nie Z., Nat. Nanotechnol. 2015, 10, 176. [DOI] [PubMed] [Google Scholar]
- 10.a) Huang L., Wan J., Wei X., Liu Y., Huang J., Sun X., Zhang R., Gurav D. D., Vedarethinam V., Li Y., Chen R., Qian K., Nat. Commun. 2017, 8, 220; [DOI] [PMC free article] [PubMed] [Google Scholar]; b) Sun X., Huang L., Zhang R., Xu W., Huang J., Gurav D. D., Vedarethinam V., Chen R., Lou J., Wang Q., Wan J., Qian K., ACS Cent. Sci. 2018, 4, 223; [DOI] [PMC free article] [PubMed] [Google Scholar]; c) Cao J., Shi X., Gurav D. D., Huang L., Su H., Li K., Niu J., Zhang M., Wang Q., Jiang M., Qian K., Adv. Mater. 2020, 32, 2000906; [DOI] [PubMed] [Google Scholar]; d) Huang L., Wang L., Hu X., Chen S., Tao Y., Su H., Yang J., Xu W., Vedarethinam V., Wu S., Liu B., Wan X., Lou J., Wang Q., Qian K., Nat. Commun. 2020, 11, 3556; [DOI] [PMC free article] [PubMed] [Google Scholar]; e) Yang J., Wang R., Huang L., Zhang M., Niu J., Bao C., Shen N., Dai M., Guo Q., Wang Q., Wang Q., Fu Q., Qian K., Angew. Chem., Int. Ed. 2020, 59, 1703; [DOI] [PubMed] [Google Scholar]; f) Su H., Li X., Huang L., Cao J., Zhang M., Vedarethinam V., Di W., Hu Z., Qian K., Adv. Mater. 2021, 33, 2007978; [DOI] [PubMed] [Google Scholar]; g) Xiang H., Chen Y., VIEW 2020, 1, 20200016; [Google Scholar]; h) Chen K., Han H., Tuguntaev R. G., Wang P., Guo W., Huang J., Gong X., Liang X.‐J., VIEW 2021, 2, 20200091; [Google Scholar]; i) Xu W., Lin J., Gao M., Chen Y., Cao J., Pu J., Huang L., Zhao J., Qian K., Adv. Sci. 2020, 7, 2002021; [DOI] [PMC free article] [PubMed] [Google Scholar]; j) Vedarethinam V., Huang L., Zhang M., Su H., Hu H., Xia H., Liu Y., Wu B., Wan X., Shen J., Xu L., Liu W., Ma J., Qian K., Adv. Funct. Mater. 2020, 30, 2002791. [Google Scholar]
- 11.Wu A. H. B., Christenson R. H., Greene D. N., Jaffe A. S., Kavsak P. A., Ordonez‐Llanos J., Apple F. S., Clin. Chem. 2018, 64, 645. [DOI] [PubMed] [Google Scholar]
- 12.a) Röder H., Asmellash S., Allen J., Tsypin M., 2013;; b) O'Rourke M. B., Djordjevic S. P., Padula M. P., Mass Spectrom. Rev. 2018, 37, 217. [DOI] [PubMed] [Google Scholar]
- 13.LeCun Y., Bengio Y., Hinton G., Nature 2015, 521, 436. [DOI] [PubMed] [Google Scholar]
- 14.a) Dong C., Loy C. C., He K., Tang X., IEEE Trans. Pattern Anal. Mach. Intell. 2016, 38, 295; [DOI] [PubMed] [Google Scholar]; b) Zhu B., Liu J. Z., Cauley S. F., Rosen B. R., Rosen M. S., Nature 2018, 555, 487. [DOI] [PubMed] [Google Scholar]
- 15.a) Xiang L., Wang Q., Nie D., Zhang L., Jin X., Qiao Y., Shen D., Med. Image Anal. 2018, 47, 31; [DOI] [PMC free article] [PubMed] [Google Scholar]; b) Shan H., Padole A., Homayounieh F., Kruger U., Khera R. D., Nitiwarangkul C., Kalra M. K., Wang G., Nat. Mach. Intell. 2019, 1, 269. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.a) Gessulat S., Schmidt T., Zolg D. P., Samaras P., Schnatbaum K., Zerweck J., Knaute T., Rechenberger J., Delanghe B., Huhmer A., Reimer U., Ehrlich H.‐C., Aiche S., Kuster B., Wilhelm M., Nat. Methods 2019, 16, 509; [DOI] [PubMed] [Google Scholar]; b) Hieu T. N., Qiao R., Xin L., Chen X., Liu C., Zhang X., Shan B., Ghodsi A., Li M., Nat. Methods 2019, 16, 63. [DOI] [PubMed] [Google Scholar]
- 17.Benjamin E. J., Blaha M. J., Chiuve S. E., Cushman M., Das S. R., Deo R., de Ferranti S. D., Floyd J., Fornage M., Gillespie C., Isasi C. R., Jimenez M. C., Jordan L. C., Judd S. E., Lackland D., Lichtman J. H., Lisabeth L., Liu S., Longenecker C. T., Mackey R. H., Matsushita K., Mozaffarian D., Mussolino M. E., Nasir K., Neumar R. W., Palaniappan L., Pandey D. K., Thiagarajan R. R., Reeves M. J., Ritchey M., Rodriguez C. J., Roth G. A., Rosamond W. D., Sasson C., Towfighi A., Tsao C. W., Turner M. B., Virani S. S., Voeks J. H., Willey J. Z., Wilkins J. T., Wu J. H. Y., Alger H. M., Wong S. S., Muntner P., American Heart Association Statistics Committee , Stroke Statistics Subcommittee , Circulation 2017, 135, E146. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.a) Sandoval Y., Smith S. W., Thordsen S. E., Bruen C. A., Carlson M. D., Dodd K. W., Driver B. E., Jacoby K., Johnson B. K., Love S. A., Moore J. C., Sexter A., Schulz K., Scott N. L., Nicholson J., Apple F. S., Clin. Chem. 2017, 63, 1594; [DOI] [PubMed] [Google Scholar]; b) Pickering J. W., Young J. M., George P. M., Watson A. S., Aldous S. J., Troughton R. W., Pemberton C. J., Richards A. M., Cullen L. A., Than M. P., JAMA Cardiol. 2018, 3, 1108; [DOI] [PMC free article] [PubMed] [Google Scholar]; c) Thygesen K., Alpert J. S., Jaffe A. S., Chaitman B. R., Bax J. J., Morrow D. A., White H. D., ESC Scientific Document Group , Eur. Heart J. 2019, 40, 237. [Google Scholar]
- 19.Reichlin T., Hochholzer W., Bassetti S., Steuer S., Stelzig C., Hartwiger S., Biedert S., Schaub N., Buerge C., Potocki M., Noveanu M., Breidthardt T., Twerenbold R., Winkler K., Bingisser R., Mueller C., N. Engl. J. Med. 2009, 361, 858. [DOI] [PubMed] [Google Scholar]
- 20.a) Bergman N., Shevchenko D., Bergquist J., Anal. Bioanal. Chem. 2014, 406, 49; [DOI] [PubMed] [Google Scholar]; b) Abdelhamid H. N., TrAC, Trends Anal. Chem. 2017, 89, 68; [Google Scholar]; c) Samarah L. Z., Vertes A., VIEW 2020, 1, 20200063; [Google Scholar]; d) Rana M. S., Xu L., Cai J., Vedarethinam V., Tang Y., Guo Q., Huang H., Shen N., Di W., Ding H., Huang L., Qian K., Small 2020, 16, 2003902. [DOI] [PubMed] [Google Scholar]
- 21.Abdelhamid H. N., Microchim. Acta 2019, 186, 682. [DOI] [PubMed] [Google Scholar]
- 22.Zheng F., Zhao X., Zeng Z., Wang L., Lv W., Wang Q., Xu G., Nat. Protoc. 2020, 15, 2519. [DOI] [PubMed] [Google Scholar]
- 23.a) Danaei G., Finucane M. M., Lu Y., Singh G. M., Cowan M. J., Paciorek C. J., Lin J. K., Farzadfar F., Khang Y.‐H., Stevens G. A., Rao M., Ali M. K., Riley L. M., Robinson C. A., Ezzati M., Global Burden of Metabolic Risk Factors of Chronic Diseases Collaborating Group (Blood Glucose) , Lancet 2011, 378, 31;21705069 [Google Scholar]; b) Longo N., Harding C. O., Burton B. K., Grange D. K., Vockley J., Wasserstein M., Rice G. M., Dorenbaum A., Neuenburg J. K., Musson D. G., Gu Z., Sile S., Lancet 2014, 384, 37. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.a) Chong J., Wishart D. S., Xia J., Curr. Protoc. Bioinform. 2019, 68, e86; [DOI] [PubMed] [Google Scholar]; b) Chong J., Soufan O., Li C., Caraus I., Li S., Bourque G., Wishart D. S., Xia J., Nucleic Acids Res. 2018, 46, W486. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Li Z., Wang C., Wang Z., Zhu C., Li J., Sha T., Ma L., Gao C., Yang Y., Sun Y., Wang J., Sun X., Lu C., Difiglia M., Mei Y., Ding C., Luo S., Dang Y., Ding Y., Fei Y., Lu B., Nature 2019, 575, 203. [DOI] [PubMed] [Google Scholar]
- 26.Holmes E., Loo R. L., Stamler J., Bictash M., Yap I. K. S., Chan Q., Ebbels T., De Iorio M., Brown I. J., Veselkov K. A., Daviglus M. L., Kesteloot H., Ueshima H., Zhao L., Nicholson J. K., Elliott P., Nature 2008, 453, 396. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Gerszten R. E., Wang T. J., Nature 2008, 451, 949. [DOI] [PubMed] [Google Scholar]
- 28.Moudgil A., Wilkinson M. N., Chen X., He J., Cammack A. J., Vasek M. J., Lagunas T., Qi Z., Lalli M. A., Guo C., Morris S. A., Dougherty J. D., Mitra R. D., Cell 2020, 182, 992. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.a) Ma S., Huang J., Bioinformatics 2005, 21, 4356; [DOI] [PubMed] [Google Scholar]; b) Nau M., Navarro Schröder T., Frey M., Doeller C. F., Nat. Commun. 2020, 11, 3247. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.a) Moen E., Bannon D., Kudo T., Graf W., Covert M., Van Valen D., Nat. Methods 2019, 16, 1233; [DOI] [PMC free article] [PubMed] [Google Scholar]; b) Dorfman H. M., Gershman S. J., Nat. Commun. 2019, 10, 5826; [DOI] [PMC free article] [PubMed] [Google Scholar]; c) Ransohoff D. F., Nat. Rev. Cancer 2004, 4, 309. [DOI] [PubMed] [Google Scholar]
- 31.Karas M., Krüger R., Chem. Rev. 2003, 103, 427. [DOI] [PubMed] [Google Scholar]
- 32.Wolk M. J., Brindis R. G., J. Am. Coll. Cardiol. 2014, 63, 380.24355759 [Google Scholar]
- 33.Amsterdam E. A., Kirk J. D., Bluemke D. A., Diercks D., Farkouh M. E., Garvey J. L., Kontos M. C., McCord J., Miller T. D., Morise A., Newby L. K., Ruberg F. L., Scordo K. A., Thompson P. D., Council Cardiovasc N., Interdisciplinary Council Q., Circulation 2010, 122, 1756. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.a) Hoogwerf B. J., Sprecher D. L., Pearce G. L., Acevedo M., Frolkis J. P., Foody J. M., Cross J. A., Pashkow F. J., Robinson K., Vidt D. G., Am. J. Cardiol. 2002, 89, 596; [DOI] [PubMed] [Google Scholar]; b) Waldeyer C., Makarova N., Zeller T., Schnabel R. B., Brunner F. J., Jorgensen T., Linneberg A., Niiranen T., Salomaa V., Jousilahti P., Yarnell J., Ferrario M. M., Veronesi G., Brambilla P., Signorini S. G., Iacoviello L., Costanzo S., Giampaoli S., Palmieri L., Meisinger C., Thorand B., Kee F., Koenig W., Ojeda F., Kontto J., Landmesser U., Kuulasmaa K., Blankenberg S., Eur. Heart J. 2017, 38, 2490. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.DeFronzo R. A., Tripathy D., Schwenke D. C., Banerji M., Bray G. A., Buchanan T. A., Clement S. C., Henry R. R., Hodis H. N., Kitabchi A. E., Mack W. J., Mudaliar S., Ratner R. E., Williams K., Stentz F. B., Musi N., Reaven P. D., Study A. N., N. Engl. J. Med. 2011, 364, 1104. [DOI] [PubMed] [Google Scholar]
- 36.López S., Buil A., Ordoñez J., Souto J. C., Almasy L., Lathrop M., Blangero J., Blanco‐Vaca F., Fontcuberta J., Soria J. M., Eur. J. Hum. Genet. 2008, 16, 1372. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The data that support the findings of this study are available from the corresponding author upon reasonable request.