Abstract
Background: Autism spectrum disorder (ASD) is a developmental disorder characterized by deficits in social interaction, restricted interest and repetitive behavior. Oxidative stress in response to environmental exposure plays a role in virtually every human disease and represents a significant avenue of research into the etiology of ASD. The aim of this study was to explore the diagnostic utility of four urinary biomarkers of oxidative stress. Methods: One hundred and thirty-nine (139) children and adolescents with ASD (89% male, average age = 10.0 years, age range = 2.1 to 18.1 years) and 47 healthy children and adolescents (49% male, average age 9.2, age range = 2.5 to 20.8 years) were recruited for this study. Their urinary 8-OH-dG, 8-isoprostane, dityrosine and hexanoil-lisine were determined by using the ELISA method. Urinary creatinine was determined with the kinetic Jaffee reaction and was used to normalize all biochemical measurements. Non-parametric tests and support vector machines (SVM) with three different kernel functions (linear, radial, polynomial) were used to explore and optimize the multivariate prediction of an ASD diagnosis based on the collected biochemical measurements. The SVM models were first trained using data from a random subset of children and adolescents from the ASD group (n = 70, 90% male, average age = 9.7 years, age range = 2.1 to 17.8 years) and the control group (n = 24, 45.8% male, average age = 9.4 years, age range = 2.5 to 20.8 years) using bootstrapping, with additional synthetic minority over-sampling (SMOTE), which was utilized because of unbalanced data. The computed SVM models were then validated using the remaining data from children and adolescents from the ASD (n = 69, 88% male, average age = 10.2 years, age range = 4.3 to 18.1 years) and the control group (n = 23, 52.2% male, average age = 8.9 years, age range = 2.6 to 16.7 years). Results: Using a non-parametric test, we found a trend showing that the urinary 8-OH-dG concentration was lower in children with ASD compared to the control group (unadjusted p = 0.085). When all four biochemical measurements were combined using SVMs with a radial kernel function, we could predict an ASD diagnosis with a balanced accuracy of 73.4%, thereby accounting for an estimated 20.8% of variance (p < 0.001). The predictive accuracy expressed as the area under the curve (AUC) was solid (95% CI = 0.691–0.908). Using the validation data, we achieved significantly lower rates of classification accuracy as expressed by the balanced accuracy (60.1%), the AUC (95% CI = 0.502–0.781) and the percentage of explained variance (R2 = 3.8%). Although the radial SVMs showed less predictive power using the validation data, they do, together with ratings of standardized SVM variable importance, provide some indication that urinary levels of 8-OH-dG and 8-isoprostane are predictive of an ASD diagnosis. Conclusions: Our results indicate that the examined urinary biomarkers in combination may differentiate children with ASD from healthy peers to a significant extent. However, the etiological importance of these findings is difficult to assesses, due to the high-dimensional nature of SVMs and a radial kernel function. Nonetheless, our results show that machine learning methods may provide significant insight into ASD and other disorders that could be related to oxidative stress.
Keywords: autism spectrum disorder, oxidative stress, urine biomarkers
1. Introduction
Autism spectrum disorder (ASD) is a developmental disorder that affects social communication and behavior. People with ASD have (1) difficulty communicating and interacting with other people, (2) restricted interests and repetitive behaviors, and (3) their symptoms impact their ability to function properly in school, work, and other life domains. ASD occurs in all ethnic, racial, and socioeconomic groups and represents in the vast majority of cases a lifelong disorder. In the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV) and the International Classification of Mental and Behavioral Disorders (ICD-10), autism was part of the Pervasive Developmental Disorders diagnostic category (Pervasive Developmental Disorders, PDD) and was characterized by a severe and pervasive impairment in social interaction, behavior, and communication [1]. The Diagnostic and Statistical Manual of Mental Disorders, 5th Revision (DSM-5) defines autism spectrum disorder (ASD) as a neurodevelopmental disorder with a spectrum of qualitative impairments in social interaction, qualitative impairments in communication, and restricted and stereotyped patterns of behavior, interests, and activities [2]. A diagnosis of ASD is given based solely on clinical features. At present, there are consistently validated biomarkers for diagnostic and/or screening purposes [3].
Increased vulnerability to oxidative stress by endogenous or environmental pro-oxidants in conjunction with genetic susceptibility factors may lead to the development and clinical manifestations of autism.
The shift in the balance between oxidants and antioxidants in favor of the former is termed oxidative stress (OS) [4].
OS is a pathological condition which is due to an abnormal increase of reactive species (RS), called free radicals, and a concomitant reduction of antioxidant defenses against free radicals. It is widely accepted that an excess of RS is toxic and damages essential cell components such as nucleic acids, proteins and lipids, leading to cell death. RS can lead to the oxidation of amino acid side chains, the formation of protein–protein cross-linkages, and the oxidation of the protein backbone resulting in protein fragmentation. The body produces a defined amount of RS due to the physiological cell metabolism. RS are dangerous because they have the spontaneous tendency to oxidize molecules due to their capacity to capture an electron or a hydrogen atom from any substance that gets in contact with them. An imbalance in the oxidant/antioxidant relationship such as an overproduction of RS can become toxic to neurons by inducing DNA methylation [5] and damage to various tissues [6]. One of the most common mechanisms by which RS attack molecules of our body is the generation of so-called “hydroperoxides” or ROOH. RS are neutralized by anti-oxidants, which are used by the body to protect it from the damaging effects of free radicals. Anti-oxidant enzymes represent a wide range of enzymes that transform RS into harmless substances. Oxidative damage produced by reactive oxygen species (ROS) has been implicated in the etiology and pathology of many health conditions, including a large number of chronic diseases.
A number of studies have reported evidence of OS in individuals with ASD [7,8,9,10,11,12,13,14], implicating OS a contributory factor in the development of ASD. Its impact on individuals with ASD may be caused by a range of RS. RS could come from external sources (e.g., environmental pollution, metabolism of xenobiotics) or could be generated in the body by NADPH oxidases [12,13,15,16]. RS includes superoxide (O2●−), hydroxyl, peroxyl, alcoxy, and nitric oxide (NO) free radicals.
Biomarkers of OS are measured in the blood/plasma, urine, and saliva, with urinary biomarkers representing the least invasive way to assess OS in the individual patient. Urinary biomarkers of oxidative status present a great opportunity to study redox balance in human populations. In addition, specimen collection is non-invasive, and urine offers a better matrix than blood/plasma since it contains a lower organic and inorganic metal content. Also, urinary levels of the biomarkers present intergraded indices of redox balance over a longer period of time compared to blood levels.
The most common oxidative markers of protein oxidation are protein carbonyls and protein nitrates. The common markers of lipid peroxidation by free radicals are malonyldialdehyde (MDA), 4-hydroxynonenal (HNE), and F2-isoprostanes. The nucleic acid oxidation products that are frequently used for measurement of oxidative stress are 8-hydroxy deoxyguanosine for DNA, and 8-hydroxyguanosine for RNA.
Although extensive studies have been carried out on autism, there are still controversies regarding its underlying mechanisms. Evidence of neurodegeneration has been seen in some cases of children with ASD who experienced a progressive loss of neurological function, with signs of elevated 8-oxoguanine levels, which could be evidence of oxidative stress [17]. In our study, we focused on four relevant biochemical markers of OS.
1.1. 8-Hydroxy-2′-Deoxyguanosine (8-OH-dG)
Lipids of cellular membranes, proteins, and DNA are regularly damaged by ROS. While studying their impact on cellular biomolecules, major efforts have been devoted to understanding how RS attack and modify DNA [18,19,20], including ROS’s induction of aberrant DNA methylation [21]. Among the most studied topics in this respect is 8-hydroxy-2’-deoxyguanosine (8-OH-dG) [20], a product of oxidatively damaged DNA formed by hydroxy radicals, singlet oxygen and direct photodynamic action. 8-OH-dG can be detected in tissues, serum, urine and other biomaterials. 8-OH-dG has been validated as a biomarker for oxidative stress in animal models, but so far, this has not been shown in human studies. Previous research has validated it as a sensitive biomarker of DNA damage due to oxidative stress [22,23]. The impact of inter-individual variability in DNA repair capacity on the levels of 8-OH-dG in urine remains unknown. Intra-individual variability is also uncertain. However, this biomarker can be useful as a monitoring tool.
1.2. F2-Isoprostanes
F2-isoprostanes are formed during the non-enzymatic oxidation of arachidonic acid by different types of free radicals [24]. F2-isoprostanes and their metabolites, excreted in the urine, are chemically stable compounds [24] and are not sensitive to the dietary intake of lipids [25]. Among them, 8-isoPGF2α is an especially reliable indicator of lipid peroxidation, due to its stability. The measurement of F2-isoprostanes in bodily fluids is regarded as a trustworthy biomarker for the in vivo determination of lipid peroxidation by free radical pathways [24,25,26,27]. This is a well-studied and validated biomarker of oxidative status, with known inter- and intra-individual variations [28]. However, there is some concern that inter-individual variation in F2-isoprostane hydrolysis form esterified lipids could contribute to the differences in their steady-state urinary levels.
1.3. Dityrosine (DT)
Tyrosine is one of the major targets of protein oxidation. DT is a tyrosine dimer, derived from tyrosyl radicals, which is formed by RS, metal-catalyzed oxidation, ultraviolet irradiation, and peroxidases. DT has previously been proposed to be a good indicator of protein oxidation [15,29]. When measured in urine, it is sensitive to pathological conditions associated with oxidative stress [30,31,32,33]. Promising understudied biomarkers, such as dityrosine, reflect oxidative protein damage. The addition of this biomarker to the panel of validated indices of oxidative status diversifies the existing tools in studying the role of oxidative status in human health and disease.
1.4. Hexanoyl-Lysine (HEL)
Hexanoyl-lysine (HEL) adduct is a novel lipid hydroperoxide-modified lysine residue. HEL is formed by oxidative modification by oxidized omega-6 fatty acids such as linoleic acid or arachidonic acid. HEL can be a useful biomarker for initial stages of lipid peroxidation [34]. Urinary levels of HEL were also found to be elevated in children with ASD [35], with a recent study by Yui et al. showing that increased HEL is associated with decreased antioxidant capacity in children with ASD [36].
The aim of the present study was to examine the levels of OS markers in the urine of children and adolescents with ASD in comparison to their healthy peers. We also wanted to examine if differences in OS markers could be used in combination to differentiate both groups using modern machine learning methods, in part replicating earlier efforts by Anwar et al. [37] to use support vector machines (SVMs) to predict the presence of ASD based on different biomarkers.
2. Subjects and Methods
2.1. Patients
Our group of patients was composed of 139 children and adolescents with autism spectrum disorder (ASD). The children and adolescents were diagnosed previously in a tertiary out-patient clinic by a developmental pediatrician or psychiatrist and psychologist. Children and adolescents were diagnosed with ASD based on four behavioral criteria: (1) deficits in social communication and interaction (including social-emotional reciprocity, nonverbal communication, and development/maintenance of relationships); (2) restricted, repetitive patterns of behavior, interests, or activities (such as movements like arm flapping, excessive adherence to routine or rituals, resistance to change, obsessive fixations, and sensory sensitivity); (3) presentation of symptoms during early childhood; and (4) impairment of everyday functioning [1].
The diagnosis was made using a multidisciplinary approach that combined a clinical evaluation along with a psychological assessment. Children were grouped according to the criteria detailed and summarized by DSM-5 [38]. Additional behavioral ratings were based on a standardized classification of behavior for children with ASD developed by the local educational authority for providing additional school support [39]. Ratings were given for two separate dimensions: a) presence of deficits in social communication and social interaction, and b) presence of deficits in behavioral flexibility and of limited interests and activities. Each child in the ASD group received a rating on each of the two dimensions on a three-point rating scale (1: mild deficit; 2: moderate deficit; 3: severe deficit). Children in the control groups received a rating of 0 for both dimensions.
A group of children and adolescents (47) without any neurological problems or any other known acute or chronic disease was used as a control group. Before inclusion of the children and adolescents, we obtained written permission from their parents.
The demographic characteristics of participating children and adolescents are given in Table 1. The design of our study was approved by the National Medical Ethics Committee (0120-201/2016-2 KME 78/03/16).
Table 1.
Characteristics | ASD | Control |
---|---|---|
N | 139 | 47 |
Male | 89% | 48% |
Mean age (in years) | 10.0 | 9.1 |
Age range (in years) | 2.1–18.1 | 2.5–20.8 |
Deficits in social communication | ||
Mild | 47% | / |
Moderate | 47% | / |
Severe | 6% | / |
Deficits in behavioral flexibility | ||
Mild | 48% | / |
Moderate | 43% | / |
Severe | 9% | / |
2.2. Methods
We obtained a second-morning urine specimen from all participants. Urine samples were aliquoted immediately after their collection and frozen to a temperature of −80 °C until they were analyzed. Before analysis, urine was defrosted and centrifuged.
For the determination of three of the four biochemical parameters, we used commercial ELISA lits: 8-OH-dG Check ELISA, HEL ELISA and the DT ELISA kit provided by the Japanese Institute for the Control of Aging (JaICA, Japan). 8-izoprostane was determined using a kit from IBL International (Hamburg, Germany). Urinary creatinine was obtained using the Roche reagent kit on a Roche Modular P analyzer (Roche Diagnostics GmbH, Mannheim, Germany). All tests were performed following the instructions of the kit provider.
3. Statistical and Machine Learning Analysis
All statistical analyses were done using the R+ language for statistical computing [40]. As part of the descriptive statistical analysis, we described the expression of our four biochemical markers normalized by urinary creatinine levels (8-OH-dG, 8-isoprostane, dityrosine, HEL) by calculating their median and inter-quartile range in our ASD in control groups, respectively. We then compared their distribution across both groups using the non-parametric two-sample Wilcoxon test.
In the second step of our analyses, we used support vector machines (SVMs) to predict an ASD diagnosis based on the expression of the four chosen biomarkers. We did this using the “caret” R+ package [41]. We examined the predictive power of three types of SVMs, with each type using either a linear, radial or polynomial (up to 3rd-degree polynomial) kernel function. We optimized the model hyper-parameters on a random subset of our data. This random subset of data represented the training data for the SVMs. It included 70 children and adolescents from the ASD group (90% male, average age = 9.7 years, age range = 2.1 to 17.8 years) and 24 from the control group (45.8% male, average age = 9.4 years, age range = 2.5 to 20.8 years). In order to tune our SVMs to the training data, we used the optimism bootstrap estimator (1000 samples per SVM) with the default grid search settings and accounted for the unequal numbers of participants across our research groups by using the synthetic minority over-sampling technique (SMOTE) [42].
We evaluated the predictive performance of our SVMs in the context of the training data by looking at the achieved balanced accuracy (combined estimate of true positives and true negatives) and the Cohen’s Kappa coefficient. In addition, we estimated the explained variance (R2) based on the Spearman rho correlation coefficient and performed significance testing for the estimated correlation coefficient [43]. To ascertain the importance of individual variables, we also looked the variable importance metric (VI), which ranges from 0 to 100 [44]. Finally, we depicted the predictive accuracy of the SVMs using ROC curves and estimating the 95% confidence interval for the area under the curve (AUC). We then repeated these analyses for SVM prediction accuracy using an independent validation sample, which was composed of 69 children and adolescents from the ASD (88% male, average age = 10.2 years, age range = 4.3 to 18.1 years) and 23 from the control group (52.2% male, average age = 8.9 years, age range = 2.6 to 16.7 years), who were not among those whose data was included in the training dataset. This provided a crucial test of the reproducibility of our results on data not previously seen by our SVMs.
Finally, to further validate our findings, we examined the correlation between the predicted probability of having an ASD diagnosis based on the SVM models and the ratings of deficits in the domains of social communication and behavioral flexibility. These correlations were estimated by calculating the Spearman correlation coefficient.
4. Results
Our univariate analyses indicated a somewhat higher variability of biomarker expression in the ASD group. The only trend towards a difference in the overall levels of expression between the ASD and control groups was seen for 8-OH-dG, with lower levels being more typical of children and adolescents in the ASD group. The results are presented in Table 2.
Table 2.
Marker | ASD Group (n = 139) | Control Group (n = 47) | W | p | ||||
---|---|---|---|---|---|---|---|---|
Me | IQR | Range | Me | IQR | Range | |||
8-OH-dG | 1.12 | 1.42 | 0.05–22.81 | 1.57 | 1.24 | 0.01–6.38 | 2716.00 | 0.085 |
8-isoprostane | 143.72 | 525.42 | 2.86–8000 | 130.94 | 436.90 | 3.48–2026.96 | 3241.50 | 0.939 |
Dityrosine | 268.04 | 338.61 | 0–6475.71 | 171.94 | 269.16 | 4.05–877.83 | 3722.00 | 0.179 |
Hexanoil-lysine | 5.84 | 5.35 | 0.5–97.39 | 5.44 | 5.14 | 1.62–30.21 | 3291.00 | 0.940 |
Among all of the examined SVMs, only the SVM with a radial kernel function proved to accurately predict an ASD diagnosis (see Table 3). This SVM predicted an ASD diagnosis with a balanced accuracy of 73% and explained a significant amount of variance. It also proved to be the only SVM that was able to predict an ASD diagnosis with any accuracy in the validation dataset.
Table 3.
SVM Kernel Function | Balanced Accuracy | Kappa | p | R 2 | p | AUC | 95% CI for AUC |
---|---|---|---|---|---|---|---|
Linear (training data) | 50% | 0.000 | 0.999 | 0.000 | 0.999 | 0.404 | 0.270–0.537 |
Radial (training data) | 73% | 0.455 | 0.823 | 0.208 | 0.001 | 0.799 | 0.691–0.908 |
Polynomial (training data) | 57% | 0.129 | 0.860 | 0.017 | 0.458 | 0.643 | 0.518–0.767 |
Linear (validation data) | 50% | 0.000 | 0.999 | 0.000 | 0.999 | 0.579 | 0.443–0.715 |
Radial (validation data) | 60% | 0.194 | 0.071 | 0.038 | 0.174 | 0.641 | 0.502–0.781 |
Polynomial (validation data) | 55% | 0.093 | 0.391 | 0.009 | 0.663 | 0.623 | 0.490–0.755 |
Despite their relatively poor predictive power in the context of the validation data, our results offer some insight into the importance of individual biomarkers in predicting a diagnosis of ASD. While investigating the standardized variable importance of each biomarker in the SMV with a radial kernel, we found that the most important predictors were 8-OH-dG (VI = 100.00) and dityrosine (VI = 73.94), followed by 8-isoprostane (VI = 16.20), and HEL (VI = 0.00). When using predictions from the SVM with the radial kernel function to plot the likelihood of receiving an ASD diagnosis in relation to 8-OH-dG and dityrosine, we found that the control group was predicted to have an optimal level of 8-OH-dG expression at around 2.5 to 3.0 standardized units (see Figure 1). Our second-most important predictor in the radial kernel SVM showed a somewhat different trend. Higher levels of dityrosine expression tended to be associated with a higher likelihood of receiving an ASD diagnosis. Additional information on the predicted probabilities of receiving a diagnosis based on the SVM with the radial kernel function are presented in Figure A1 and Figure A2 in Appendix A.
When examining the association between the predicted probability of having an ASD diagnosis and ratings of deficits in social interaction and behavioral flexibility within the training dataset, we found several significant correlations for the SVM model with the radial kernel function. However, we could not verify these correlations within the validation sample (Table 4).
Table 4.
Symptom Domain | Linear | Radial | Polynomial | |||
---|---|---|---|---|---|---|
rho | p | rho | p | rho | p | |
Deficits in social communication | ||||||
Training data | −0.128 | 0.337 | 0.418 | 0.001 | 0.187 | 0.223 |
Validation data | −0.093 | 0.755 | 0.239 | 0.120 | 0.242 | 0.120 |
Deficits in behavioral flexibility | ||||||
Training data | −0.143 | 0.337 | 0.446 | 0.001 | 0.198 | 0.223 |
Validation data | −0.061 | 0.755 | 0.234 | 0.120 | 0.207 | 0.144 |
5. Discussion
The results of our study indicate that, among the four biomarkers used, 8-OH-dG, a biomarker of DNA damage due to oxidative stress and an individual’s DNA repair capacity [20,45], and dityrosine, an oxidation damage marker and indicator of protein oxidation [29,44], proved to be the most influential predictors of having an ASD diagnosis in the group of children and adolescents included in our study. The predictive accuracy of our SVM algorithm was not as high as that of the SVM algorithms published in a previous study by Anwar et al. [37], and was also significantly reduced in an independent validation dataset. Although far from having the potential of being a reliable diagnostic tool, our SVMs did have some predictive accuracy in the validation data set and offered some interesting insights into the role of oxidative stress in the etiology of ASD.
Our examination of the SVM predicted probabilities of having an ASD diagnosis across a range of biomarker expression, which indicates a potentially interesting finding in relation to the measurement and involvement of 8-OH-dG in ASD. The superior performance of the SVM using a radial kernel function indicates that individuals with ASD might have levels of 8-OH-dG below or above an optimal range [46,47], rather than simply levels that are higher than neurotypical individuals. This could explain some the disparate findings of previous studies, among which some have found increased levels of 8-OH-dG in individuals with ASD [12,48,49], while others have not [35,36,50]. In individuals with ASD, such deviations from an optimal level of 8-OH-dG could be a reflection of a departure from an appropriate range of ROS expression, which has been shown to be important in regulating neuronal differentiation, migration [51,52], and synaptic pruning [53,54], which are all processes thought to be involved in the etiology of ASD [55,56]. It could also be an indicator of the potential genetic vulnerability of children with ASD to oxidative stress [12,57,58,59], environmental factors contributing to it [12,60,61], as well as deficient mechanisms of DNA repair [62].
The second-most import predictor of diagnostic status in our radial kernel SVM was dityrosine. This result is in line with a previous study that used an SVM algorithm with a linear kernel function to classify children according to ASD status. The study by Anwar et al. [37] found dityrosine to be an important predictor of ASD, and as in our study, ASD diagnosis was associated with higher levels of dityrosine expression. This finding also fits well with other studies implicating tyrosine metabolism in the etiology of ASD [63,64,65].
The remaining two biomarkers used in our study, hexanol-lysine and 8-isoprostane, did not have high variable importance in our SVM that used a radial kernel function. This does not mean they have no role in the study of oxidative stress in ASD, but merely that they did not provide much additional information in the specific set context of our biomarkers and data. However, they have in other studies been shown to have aberrant levels of expression in individuals with ASD [28,35,50].
We hope our study also adds to the current literature from a methodological standpoint. We feel our use of an independent validation dataset somewhat guards against the potential overfitting of data that can occur when using SVMs, especially those using a radial kernel function. We also hope that our results illustrate the reduction in predictive accuracy when SVMs are employed on data which are not part of the dataset used for SVM model tuning. In light of the public interest in such studies, it would seem important to emphasize that fact to the general public, as pointed out by Buxbaum et al. [66].
In regard to our own study, we would also like to note some other limitations. Due to a discrepancy in the number of individuals in the ASD and control groups, we had to employ SMOTE sampling procedures [42] to control for the uneven number of participants across groups when tuning our SVM models. If we had the resources, even more data for the control group would have been preferable, making the numbers of participants in each of our research groups more comparable. The relatively small number of participants in our study also limits our ability to generalize the results across the diverse population of individuals with ASD. We therefore feel that the interpretation of our findings would greatly be enhanced by the replication of our results on new data sets by other research groups. We therefore provide the R+ code for the SVM calculations used in our study in Supplementary File S1, hoping researchers might utilize the SVM algorithms and settings used in future studies.
We are aware that our groups are different in terms of gender representation. The parameters that we have determined in urine are not subject to gender differences, and therefore this difference does not introduce an additional bias. The concentrations and profiles of oxidative stress markers are not significantly affected by gender, age, or body mass index (BMI) [67,68,69,70,71,72].
When looking at the literature on oxidative stress in ASD from a wider methodological viewpoint, we also feel that the field would benefit from a greater effort in obtaining larger datasets, beyond those currently available. This would seem especially prudent if the field is intent on using machine learning methods to gain greater insight into the etiology of ASD. A multi-center collaborative study of oxidative stress in ASD, similar to those in the field of ASD neuroimaging [73,74], might represent a way to gather data from hundreds of participants in order to make the predictions of machine learning algorithms more reliable and informative. By including genetic and neuroimaging data, such efforts could help deepen our understanding of the aberrant neurodevelopmental processes that the biomarkers used in this study measure in individuals with ASD.
6. Conclusions
Support vector machines (SVMs) offer great promise for enhancing the methodological toolset used in studying oxidative stress in ASD, if used and interpreted properly [74,75]. The ability of SVMs to recognize nonlinear boundaries in the multi-dimensional space formed by measurements of biochemical markers could be an advantage when trying to identify aberrant biochemical processes in ASD. In our study, SVMs allowed us to improve our prediction of an ASD diagnosis based on the utilized biomarkers and granted us greater insight into the measurement of biomarker expression. We discovered that, in addition to identifying a pathological level of biomarker expression, it may also be important to identify potential deviations for an optimal set-point of biomarker expression using SVMs. We hope our work will encourage others to replicate the use of SVMs in this field of research, and we look forward to this line of inquiry having an impact on the practice of ASD diagnosis and treatment.
Acknowledgments
We thank each of the participants for providing urine samples and Vera Troha for the processing of samples.
Supplementary Materials
The following are available online at https://www.mdpi.com/2076-3921/8/6/187/s1, Supplementary File S1: R+ syntax for SVMs with linear, radial and polynomial kernel functions.
Appendix A
Author Contributions
All authors met the criteria for this journal’s authorship credit as set forth by the author’s guide. Each author’s name is given next to the appropriate category. Study conception and design: J.O. and D.G.; acquisition of patients: J.M. and M.J.V.; acquisition of control group: M.Z.; analysis: P.F., S.Š. T.F., and K.K.; interpretation of data: J.M., M.J.V., D.G. and J.O.; statistics: D.G.; drafting of manuscript: J.O., D.G. and T.F.; critical revision: M.J.V. and D.G.
Funding
This study was supported by a research grant from the University Medical centre Ljubljana (No 20150085).
Conflicts of Interest
The authors have not applied for any patents relating to the content of the manuscript, and did not receive reimbursements, fees, funding, or salary from an organization that holds or has applied for a patent relating to the content of the manuscript. The authors declare that they have no conflict of financial and nonfinancial interest relating to this work.
References
- 1.American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders. 4th ed. American Psychiatric Association; Washington, DC, USA: 1994. [Google Scholar]
- 2.Diagnostic and Statistical Manual of Mental Disorders: DSM-5. American Psychiatric Association; Arlington, VA, USA: 2013. [Google Scholar]
- 3.Momeni N., Bergquist J., Brudin L., Behnia F., Sivberg B., Joghataei M.T., Persson B.L. A novel blood-based biomarker for detection of autism spectrum disorders. Transl. Psychiatry. 2012;2:e91. doi: 10.1038/tp.2012.19. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Birben E., Sahiner U.M., Sackesen C., Erzurum S., Kalayci O. Oxidative stress and antioxidant defense. World Allergy Organ. J. 2012;5:9–19. doi: 10.1097/WOX.0b013e3182439613. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Lambeth J.D. Nox enzymes, ROS, and chronic disease: An example of antagonistic pleiotropy. Free Radic. Biol. Med. 2007;43:332–347. doi: 10.1016/j.freeradbiomed.2007.03.027. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Ranjbar A., Rashedi V., Rezaei M. Comparison of urinary oxidative biomarkers in Iranian children with autism. Res. Dev. Disabil. 2014;35:2751–2755. doi: 10.1016/j.ridd.2014.07.010. [DOI] [PubMed] [Google Scholar]
- 7.Al-Gadani Y., El-Ansary A., Attas O., Al-Ayadhi L. Metabolic biomarkers related to oxidative stress and antioxidant status in Saudi autistic children. Clin. Biochem. 2009;42:1032–1040. doi: 10.1016/j.clinbiochem.2009.03.011. [DOI] [PubMed] [Google Scholar]
- 8.James S.J., Cutler P., Melnyk S., Jernigan S., Janak L., Gaylor D.W., Neubrander J.A. Metabolic biomarkers of increased oxidative stress and impaired methylation capacity in children with autism. Am. J. Clin. Nutr. 2004;80:1611–1617. doi: 10.1093/ajcn/80.6.1611. [DOI] [PubMed] [Google Scholar]
- 9.James S.J., Melnyk S., Fuchs G., Reid T., Jernigan S., Pavliv O., Hubanks A., Gaylor D.W. Efficacy of methylcobalamin and folinic acid treatment on glutathione redox status in children with autism. Am. J. Clin. Nutr. 2009;89:425–430. doi: 10.3945/ajcn.2008.26615. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.James S.J., Melnyk S., Jernigan S., Cleves M.A., Halsted C.H., Wong D.H., Cutler P., Bock K., Boris M., Bradstreet J.J., et al. Metabolic endophenotype and related genotypes are associated with oxidative stress in children with autism. Am. J. Med Genet. Part B Neuropsychiatr. Genet. 2006;141B:947–956. doi: 10.1002/ajmg.b.30366. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.James S.J., Rose S., Melnyk S., Jernigan S., Blossom S., Pavliv O., Gaylor D.W. Cellular and mitochondrial glutathione redox imbalance in lymphoblastoid cells derived from children with autism. FASEB J. 2009;23:2374–2383. doi: 10.1096/fj.08-128926. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Melnyk S., Fuchs G.J., Schulz E., Lopez M., Kahler S.G., Fussell J.J., Bellando J., Pavliv O., Rose S., Seidel L., et al. Metabolic imbalance associated with methylation dysregulation and oxidative damage in children with autism. J. Autism Dev. Disord. 2012;42:367–377. doi: 10.1007/s10803-011-1260-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Rossignol D.A., Frye R.E. A review of research trends in physiological abnormalities in autism spectrum disorders: Immune dysregulation, inflammation, oxidative stress, mitochondrial dysfunction and environmental toxicant exposures. Mol. Psychiatry. 2012;17:389–401. doi: 10.1038/mp.2011.165. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Yorbik O., Sayal A., Akay C., Akbiyik D.I., Sohmen T. Investigation of antioxidant enzymes in children with autistic disorder. Prostaglandins Leukot. Essent. Fat. Acids. 2002;67:341–343. doi: 10.1054/plef.2002.0439. [DOI] [PubMed] [Google Scholar]
- 15.Halliwell B. Biochemistry of oxidative stress. Biochem. Soc. Trans. 2007;35:1147–1150. doi: 10.1042/BST0351147. [DOI] [PubMed] [Google Scholar]
- 16.Kryston T.B., Georgiev A.B., Pissis P., Georgakilas A.G. Role of oxidative stress and DNA damage in human carcinogenesis. Mutat. Res. Fundam. Mol. Mech. Mutagen. 2011;711:193–201. doi: 10.1016/j.mrfmmm.2010.12.016. [DOI] [PubMed] [Google Scholar]
- 17.Abou-Donia M.B., Suliman H.B., Siniscalco D., Antonucci N., ElKafrawy P. de novo Blood Biomarkers in Autism: Autoantibodies against Neuronal and Glial Proteins. Behav. Sci. 2019;9:47. doi: 10.3390/bs9050047. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Cadet J., Ravanat J.L., TavernaPorro M., Menoni H., Angelov D. Oxidatively generated complex DNA damage: Tandem and clustered lesions. Cancer Lett. 2012;327:5–15. doi: 10.1016/j.canlet.2012.04.005. [DOI] [PubMed] [Google Scholar]
- 19.Dizdaroglu M. Oxidatively induced DNA damage and its repair in cancer. Mutat. Res. Rev. Mutat. Res. 2015;763:212–245. doi: 10.1016/j.mrrev.2014.11.002. [DOI] [PubMed] [Google Scholar]
- 20.Dizdaroglu M., Jaruga P. Mechanisms of free radical-induced damage to DNA. Free Radic. Res. 2012;46:382–419. doi: 10.3109/10715762.2011.653969. [DOI] [PubMed] [Google Scholar]
- 21.Wu Q., Ni X. ROS-mediated DNA methylation pattern alterations in carcinogenesis. Curr. Drug Targets. 2015;16:13–19. doi: 10.2174/1389450116666150113121054. [DOI] [PubMed] [Google Scholar]
- 22.Kadiiska M.B., Gladen B.C., Baird D.D., Germolec D., Graham L.B., Parker C.E., Nyska A., Wachsman J.T., Ames B.N., Basu S., et al. Biomarkers of oxidative stress study II: Are oxidation products of lipids, proteins, and DNA markers of CCl4 poisoning? Free Radic. Biol. Med. 2005;38:698–710. doi: 10.1016/j.freeradbiomed.2004.09.017. [DOI] [PubMed] [Google Scholar]
- 23.Saito S., Yamauchi H., Hasui Y., Kurashige J., Ochi H., Yoshida K. Quantitative determination of urinary 8-hydroxydeoxyguanosine (8-OH-dg) by using ELISA. Res. Commun. Mol. Pathol. Pharmacol. 2000;107:39–44. [PubMed] [Google Scholar]
- 24.Roberts L.J., Morrow J.D. Measurement of F(2)-isoprostanes as an index of oxidative stress in vivo. Free Radic. Biol. Med. 2000;28:505–513. doi: 10.1016/S0891-5849(99)00264-6. [DOI] [PubMed] [Google Scholar]
- 25.Gopaul N.K., Halliwell B., Anggard E.E. Measurement of plasma F2-isoprostanes as an index of lipid peroxidation does not appear to be confounded by diet. Free Radic. Res. 2000;33:115–127. doi: 10.1080/10715760000300671. [DOI] [PubMed] [Google Scholar]
- 26.Basu S. Isoprostanes: Novel bioactive products of lipid peroxidation. Free Radic. Res. 2004;38:105–122. doi: 10.1080/10715760310001646895. [DOI] [PubMed] [Google Scholar]
- 27.Morrow J.D. The isoprostanes: Their quantification as an index of oxidant stress status in vivo. Drug Metab. Rev. 2000;32:377–385. doi: 10.1081/DMR-100102340. [DOI] [PubMed] [Google Scholar]
- 28.van’t Erve T.J., Kadiiska M.B., London S.J., Mason R.P. Classifying oxidative stress by F2-isoprostane levels across human diseases: A meta-analysis. Redox Biol. 2017;12:582–599. doi: 10.1016/j.redox.2017.03.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Malencik D.A., Anderson S.R. Dityrosine as a product of oxidative stress and fluorescent probe. Amino Acids. 2003;25:233–247. doi: 10.1007/s00726-003-0014-z. [DOI] [PubMed] [Google Scholar]
- 30.Bhattacharjee S., Pennathur S., Byun J., Crowley J., Mueller D., Gischler J., Hotchkiss R.S., Heinecke J.W. NADPH oxidase of neutrophils elevates o,o’-dityrosine cross-links in proteins and urine during inflammation. Arch. Biochem. Biophys. 2001;395:69–77. doi: 10.1006/abbi.2001.2557. [DOI] [PubMed] [Google Scholar]
- 31.Chien C.T., Chang W.T., Chen H.W., Wang T.D., Liou S.Y., Chen T.J., Chang Y.L., Lee Y.T., Hsu S.M. Ascorbate supplement reduces oxidative stress in dyslipidemic patients undergoing apheresis. Arterioscler. Thromb. Vasc. Biol. 2004;24:1111–1117. doi: 10.1161/01.ATV.0000127620.12310.89. [DOI] [PubMed] [Google Scholar]
- 32.Jordan W., Cohrs S., Degner D., Meier A., Rodenbeck A., Mayer G., Pilz J., Ruther E., Kornhuber J., Bleich S. Evaluation of oxidative stress measurements in obstructive sleep apnea syndrome. J. Neural Transm. 2006;113:239–254. doi: 10.1007/s00702-005-0316-2. [DOI] [PubMed] [Google Scholar]
- 33.Manary M.J., Leeuwenburgh C., Heinecke J.W. Increased oxidative stress in kwashiorkor. J. Pediatrics. 2000;137:421–424. doi: 10.1067/mpd.2000.107512. [DOI] [PubMed] [Google Scholar]
- 34.Sakai K., Kino S., Masuda A., Takeuchi M., Ochi T., Osredkar J., Rejc B., Gersak K., Ramarathnam N., Kato Y. Determination of HEL (Hexanoyl-lysine adduct): A novel biomarker for omega-6 PUFA oxidation. Sub-Cell. Biochem. 2014;77:61–72. doi: 10.1007/978-94-007-7920-4_5. [DOI] [PubMed] [Google Scholar]
- 35.Ghezzo A., Visconti P., Abruzzo P.M., Bolotta A., Ferreri C., Gobbi G., Malisardi G., Manfredini S., Marini M., Nanetti L., et al. Oxidative Stress and Erythrocyte Membrane Alterations in Children with Autism: Correlation with Clinical Features. PLoS ONE. 2013;8:e66418. doi: 10.1371/journal.pone.0066418. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Yui K., Tanuma N., Yamada H., Kawasaki Y. Reduced endogenous urinary total antioxidant power and its relation of plasma antioxidant activity of superoxide dismutase in individuals with autism spectrum disorder. Int. J. Dev. Neurosci. 2017;60:70–77. doi: 10.1016/j.ijdevneu.2016.08.003. [DOI] [PubMed] [Google Scholar]
- 37.Anwar A., Abruzzo P.M., Pasha S., Rajpoot K., Bolotta A., Ghezzo A., Marini M., Posar A., Visconti P., Thornalley P.J., et al. Advanced glycation endproducts, dityrosine and arginine transporter dysfunction in autism—A source of biomarkers for clinical diagnosis. Mol. Autism. 2018;9:3. doi: 10.1186/s13229-017-0183-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Lord C., Risi S., Lambrecht L., Cook E.H., Jr., Leventhal B.L., DiLavore P.C., Pickles A., Rutter M. The autism diagnostic observation schedule-generic: A standard measure of social and communication deficits associated with the spectrum of autism. J. Autism Dev. Disord. 2000;30:205–223. doi: 10.1023/A:1005592401947. [DOI] [PubMed] [Google Scholar]
- 39.Vovk Ornik N. Kriteriji za Opredelitev Vrste in Stopnje Primanjkljajev, ovir oz. Motenj Otrok s Posebnimi Potrebami. Zavod RS za šolstvo; Ljubljana, Slovenia: 2014. [Google Scholar]
- 40.R Core Team . R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing; Vienna, Austria: 2018. [Google Scholar]
- 41.Kuhn M., Wing J., Weston S., Williams A., Keefer C., Allan E., Cooper T., Mayer Z., Kenkel B., Benesty M., et al. Caret: Classification and Regression Training. [(accessed on 18 December 2018)]; Available online: http://topepo.github.io/caret/index.html.
- 42.Bowyer K.W., Chawla N.V., Hall L.O., Kegelmeyer W.P. SMOTE: Synthetic Minority Over-sampling Technique. J. Artif. Intell. Res. 2002;16:321–357. [Google Scholar]
- 43.Powers D. Evaluation: From Precision, Recall and F-Factor to ROC, Informedness, Markedness & Correlation. [(accessed on 18 December 2018)]; Available online: http://david.wardpowers.info/BM/index.htm.
- 44.Landis J.R., Koch G.G. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174. doi: 10.2307/2529310. [DOI] [PubMed] [Google Scholar]
- 45.Il’yasova D., Scarbrough P., Spasojevic I. Urinary biomarkers of oxidative status. Clin. Chim. Acta. 2012;413:1446–1453. doi: 10.1016/j.cca.2012.06.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Kaneko K., Kimata T., Tsuji S., Ohashi A., Imai Y., Sudo H., Kitamura N. Measurement of urinary 8-oxo-7,8-dihydro-2-deoxyguanosine in a novel point-of-care testing device to assess oxidative stress in children. Clin. Chim. Acta Int. J. Clin. Chem. 2012;413:1822–1826. doi: 10.1016/j.cca.2012.07.009. [DOI] [PubMed] [Google Scholar]
- 47.Tamura S., Tsukahara H., Ueno M., Maeda M., Kawakami H., Sekine K., Mayumi M. Evaluation of a urinary multi-parameter biomarker set for oxidative stress in children, adolescents and young adults. Free Radic. Res. 2006;40:1198–1205. doi: 10.1080/10715760600895191. [DOI] [PubMed] [Google Scholar]
- 48.Gonzalez- Fraguela M., Díaz M.-L., Vera H., Maragoto C., Noris E., Blanco L. Oxidative stress markers in children with autism spectrum disorders. Br. J. Med. Med. Res. 2013;3:307–317. doi: 10.9734/BJMMR/2013/2335. [DOI] [Google Scholar]
- 49.Ming X., Stein T.P., Brimacombe M., Johnson W.G., Lambert G.H., Wagner G.C. Increased excretion of a lipid peroxidation biomarker in autism. Prostaglandins Leukot. Essent. Fat. Acids. 2005;73:379–384. doi: 10.1016/j.plefa.2005.06.002. [DOI] [PubMed] [Google Scholar]
- 50.Yui K., Sasaki H., Shiroki R., Kawasaki Y. Comparing Urinary Effect Size Related to Behavioral Symptoms between Total Antioxidant Capacity and Hexanoyl-lysine in Individuals with Autism Spectrum Disorders. Am. J. Clin. Med. Res. 2018;6:58–64. [Google Scholar]
- 51.Le Belle J.E., Orozco N.M., Paucar A.A., Saxe J.P., Mottahedeh J., Pyle A.D., Wu H., Kornblum H.I. Proliferative Neural Stem Cells Have High Endogenous ROS Levels that Regulate Self-Renewal and Neurogenesis in a PI3K/Akt-Dependant Manner. Cell Stem Cell. 2011;8:59–71. doi: 10.1016/j.stem.2010.11.028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Oswald M.C.W., Garnham N., Sweeney S.T., Landgraf M. Regulation of neuronal development and function by ROS. FEBS Lett. 2018;592:679–691. doi: 10.1002/1873-3468.12972. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Milton V.J., Jarrett H.E., Gowers K., Chalak S., Briggs L., Robinson I.M., Sweeney S.T. Oxidative stress induces overgrowth of the Drosophila neuromuscular junction. Proc. Natl. Acad. Sci. USA. 2011;108:17521–17526. doi: 10.1073/pnas.1014511108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Sidlauskaite E., Gibson J.W., Megson I.L., Whitfield P.D., Tovmasyan A., Batinic-Haberle I., Murphy M.P., Moult P.R., Cobley J.N. Mitochondrial ROS cause motor deficits induced by synaptic inactivity: Implications for synapse pruning. Redox Biol. 2018;16:344–351. doi: 10.1016/j.redox.2018.03.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Piven J., Elison J.T., Zylka M.J. Toward a conceptual framework for early brain and behavior development in autism. Mol. Psychiatry. 2017;22:1385–1394. doi: 10.1038/mp.2017.131. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Yenkoyan K., Grigoryan A., Fereshetyan K., Yepremyan D. Advances in understanding the pathophysiology of autism spectrum disorders. Behav. Brain Res. 2017;331:92–101. doi: 10.1016/j.bbr.2017.04.038. [DOI] [PubMed] [Google Scholar]
- 57.Kushima I., Aleksic B., Nakatochi M., Shimamura T., Okada T., Uno Y., Morikawa M., Ishizuka K., Shiino T., Kimura H., et al. Comparative Analyses of Copy-Number Variation in Autism Spectrum Disorder and Schizophrenia Reveal Etiological Overlap and Biological Insights. Cell Rep. 2018;24:2838–2856. doi: 10.1016/j.celrep.2018.08.022. [DOI] [PubMed] [Google Scholar]
- 58.Meguid N.A., Ghozlan S.A.S., Mohamed M.F., Ibrahim M.K., Dawood R.M., Bader El Din N.G., Abdelhafez T.H., Hemimi M., El Awady M.K. Expression of Reactive Oxygen Species–Related Transcripts in Egyptian Children With Autism. Biomark. Insights. 2017:12. doi: 10.1177/1177271917691035. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Rose S., Frye R.E., Slattery J., Wynne R., Tippett M., Melnyk S., James S.J. Oxidative stress induces mitochondrial dysfunction in a subset of autistic lymphoblastoid cell lines. Transl. Psychiatry. 2015;5:e526. doi: 10.1038/tp.2015.29. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.James S., Zimmerman A. Oxidative Stress and the Metabolic Pathology of Autism. Autism. 2008:245–268. doi: 10.1007/978-1-60327-489-0_11. [DOI] [Google Scholar]
- 61.Morris G., Puri B.K., Frye R.E., Maes M. The Putative Role of Environmental Mercury in the Pathogenesis and Pathophysiology of Autism Spectrum Disorders and Subtypes. Mol. Neurobiol. 2018;55:4834–4856. doi: 10.1007/s12035-017-0692-2. [DOI] [PubMed] [Google Scholar]
- 62.Servadio M., Manduca A., Melancia F., Leboffe L., Schiavi S., Campolongo P., Palmery M., Ascenzi P., di Masi A., Trezza V. Impaired repair of DNA damage is associated with autistic-like traits in rats prenatally exposed to valproic acid. Eur. Neuropsychopharmacol. 2018;28:85–96. doi: 10.1016/j.euroneuro.2017.11.014. [DOI] [PubMed] [Google Scholar]
- 63.Anwar A., Marini M., Abruzzo P.M., Bolotta A., Ghezzo A., Visconti P., Thornalley P.J., Rabbani N. Quantitation of plasma thiamine, related metabolites and plasma protein oxidative damage markers in children with autism spectrum disorder and healthy controls. Free Radic. Res. 2016;50:S85–S90. doi: 10.1080/10715762.2016.1239821. [DOI] [PubMed] [Google Scholar]
- 64.Gevi F., Zolla L., Gabriele S., Persico A.M. Urinary metabolomics of young Italian autistic children supports abnormal tryptophan and purine metabolism. Mol. Autism. 2016;7:47. doi: 10.1186/s13229-016-0109-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Kelly R.S., Boulin A., Laranjo N., Lee-Sarwar K., Chu S.H., Yadama A.P., Carey V., Litonjua A.A., Lasky-Su J., Weiss S.T. Metabolomics and Communication Skills Development in Children; Evidence from the Ages and Stages Questionnaire. Metabolites. 2019;9:42. doi: 10.3390/metabo9030042. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Buxbaum J.D., Baron-Cohen S., Anagnostou E., Ashwin C., Betancur C., Chakrabarti B., Crawley J.N., Hoekstra R.A., Hof P.R., Lai M.-C., et al. Rigor in science and science reporting: Updated guidelines for submissions to Molecular Autism. Mol. Autism. 2019;10:6. doi: 10.1186/s13229-018-0249-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Di Martino A., O’Connor D., Chen B., Alaerts K., Anderson J.S., Assaf M., Balsters J.H., Baxter L., Beggiato A., Bernaerts S., et al. Enhancing studies of the connectome in autism using the autism brain imaging data exchange II. Sci. Data. 2017;4:170010. doi: 10.1038/sdata.2017.10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Zanolin M.E., Girardi P., Degan P., Rava M., Olivieri M., di Gennaro G., aNicolis M., de Marco R. Measurement of a urinary marker (8-hydroxydeoxyguanosine, 8-OH-dG) of DNA oxidative stress in epidemiological surveys: A pilot study. Int. J. Biol. Mark. 2015;30:e341–e345. doi: 10.5301/jbm.5000129. [DOI] [PubMed] [Google Scholar]
- 69.Martinez-Moral M.-P., Kannan K. How stable is oxidative stress level? An observational study of intra- and inter-individual variability in urinary oxidative stress biomarkers of DNA, proteins, and lipids in healthy individuals. Environ. Int. 2019;123:382–389. doi: 10.1016/j.envint.2018.12.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Liu A., Zhou W., Qu L., He F., Wang H., Wang Y., Cai C., Li X., Zhou W., Wang M. Altered Urinary Amino Acids in Children With Autism Spectrum Disorders. Front. Cell. Neurosci. 2019;13:7. doi: 10.3389/fncel.2019.00007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Lussu M., Noto A., Masili A., Rinaldi A.C., Dessì A., De Angelis M., De Giacomo A., Fanos V., Atzori L., Francavilla R. The urinary (1) H-NMR metabolomics profile ofan italian autistic children population and their unaffected siblings. Autism Res. 2017;10:1058–1066. doi: 10.1002/aur.1748. [DOI] [PubMed] [Google Scholar]
- 72.Yui K., Tanuma N., Yamada H., Kawasaki Y. Decreased total antioxidant capacityhas a larger effect size than increased oxidant levels in urine in individuals with autism spectrum disorder. Environ. Sci. Pollut. Res. Int. 2017;24:9635–9644. doi: 10.1007/s11356-017-8595-3. [DOI] [PubMed] [Google Scholar]
- 73.Heinsfeld A.S., Franco A.R., Craddock R.C., Buchweitz A., Meneguzzi F. Identification of autism spectrum disorder using deep learning and the ABIDE dataset. Neuroimage Clin. 2017;17:16–23. doi: 10.1016/j.nicl.2017.08.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Chen J.H., Asch S.M. Machine Learning and Prediction in Medicine—Beyond the Peak of Inflated Expectations. N. Engl. J. Med. 2017;376:2507–2509. doi: 10.1056/NEJMp1702071. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Gianfrancesco M.A., Tamang S., Yazdany J., Schmajuk G. Potential Biases in Machine Learning Algorithms Using Electronic Health Record Data. JAMA Intern. Med. 2018;178:1544–1547. doi: 10.1001/jamainternmed.2018.3763. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.