Abstract
Widespread application of omic technologies is evolving our understanding of population health and holds promise in providing precise guidance for selection of therapeutic interventions based on patient biology. The opportunity to use hundreds of analytes for diagnostic assessment of human health compared to the current use of 10–20 analytes will provide greater accuracy in deconstructing the complexity of human biology in disease states. Conventional biochemical measurements like cholesterol, creatinine, and urea nitrogen are currently used to assess health status; however, metabolomics captures a comprehensive set of analytes characterizing the human phenotype and its complex metabolic processes in real-time. Unlike conventional clinical analytes, metabolomic profiles are dramatically influenced by demographic and environmental factors that affect the range of normal values and increase the risk of false biomarker discovery. This review addresses the challenges and opportunities created by the evolving field of clinical metabolomics and highlights features of study design and bioinformatics necessary to maximize the utility of metabolomics data across demographic groups.
Keywords: metabolomics, biomarker, demographics, clinical, phenotype, discovery
1. Introduction
Metabolomics is an emerging field of “omics” that characterizes small molecule metabolites in biological systems (http://metabolomicssociety.org/). Metabolomics analyses reflect both the steady-state physiological equilibrium of cells or organisms as well as their dynamic metabolic responses to environmental stimuli [1,2,3,4,5]. In comparison to other human biological measurements, the metabolome is uniquely suited to depict the phenotype and measure the impact of environmental factors on the end products of metabolism [2]. The field has expanded rapidly since its inception more than two decades ago as a result of parallel improvements in bioanalytical platforms and methods for data analysis [1,2,3,4,5].
Current methods of clinical decision support rely on a limited selection of diagnostic biomarkers to monitor response to treatment in individual patients. Human metabolites serve as valid clinical markers and are listed in the Mayo Clinic test catalog at https://www.mayocliniclabs.com/test-catalog/, LabCorp test menu https://www.labcorp.com/test-menu/search, and Quest Diagnostics Test Directory https://testdirectory.questdiagnostics.com/test/home [4]. Many of these biomarkers were identified decades ago before metabolomics was invented. By comparison, the Human Metabolite Database (HMDB, https://hmdb.ca/) now catalogs more than 25,000 metabolites in human blood [1]. Publications referencing metabolomics assisted biomarker discovery demonstrate exponential growth in utilization (Figure 1) by academia and industry. A search for the word metabolomics in U.S. National Library of Medicine at Clinical Trials retrieved 962 studies (https://clinicaltrials.gov/) and an almost equal number of completed or recruiting clinical studies.
The human metabolome is composed of endogenous and exogenous compounds and their respective metabolites, which originate internal and external to the host. Food components, microbiome products, supplements, and pharmaceuticals are examples of sources of human exogenous metabolites. Recent evidence links the microbiome to alterations in the human metabolome that impact human health [6,7,8]. For example, gut microorganisms can induce excess production of uremic toxins [9], like indoxyl sulphate, p-cresol sulphate, and trimethylamine-N-oxide, which accumulate in the circulation as markers of renal dysfunction [8]. Multi-omic profiling of the fecal microbiome demonstrates a strong association with visceral fat mass and abdominal obesity only modestly influenced by the host. A similar relationship between the gut microbiome, diet, and the metabolome has been observed. In particular, plant-derived nutrients are associated with alterations in circulating metabolites such as bile acids [7], indicating potential relationships between the composition of the gut microbiome and resulting dietary impacts on host metabolism.
Technological advancements have enabled novel strategies to discover individual biomarkers as well as panels of markers derived from different -omics platforms [5,6,7,8,9,10,11,12,13,14]. These technologies harvest substantial volumes of data at multiple biological levels and sift the resulting large data sets with informatics tools including artificial intelligence (AI). This intriguing approach has accelerated biomarker discovery and routinely incorporated in preclinical study workflows, including for the search for potential novel therapeutic targets and candidate drugs [15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33]. The capability of metabolites to illustrate varied biological processes, such as cell differentiation and maturation, insulin signaling, T-cell survival, and macrophage immune responses is reported and extensively reviewed [20,21]. Commercial services to identify relevant metabolic biomarkers, investigate biochemical pathways, and report the metabolic state of a cell, tissue, or living organism, have become mainstream (https://www.biocrates.com/services/metabolomics-services). The data allow research institutions and commercial organizations to identify metabolites with active and passive effects on phenotypes of interest. The field of clinical metabolomics will continue to evolve as GCLP standards for CLIA laboratories remain under development. With sufficient scientific rigor and validation, metabolomic profiles may acquire FDA approval for clinical use and monitoring of therapy.
2. Results
2.1. Current Challenges
Major challenges exist translating metabolomic biomarkers from discovery to application in population health studies that characterize human biology focused on systemic metabolism [2,3,4,32,33,34,35]. Wide chemical diversity and the presence of isomers and isobaric compounds prevent a single bioanalytical platform from providing all-inclusive discovery of metabolites in a biological system. Therefore, a combination of orthogonal separation techniques, including gas and liquid chromatography coupled with mass spectrometry, must be employed in global metabolite profiling protocols. Separation of hydrophobic analytes requires application of reverse phase and hydrophilic chromatography to separate polar metabolites. Increased metabolome coverage may be achieved with the different ionization techniques such as electrospray, chemical, and electron impact. Detected metabolites must be identified through chemical standard analysis and characterized by method-specific retention times as well as mass spectrometry measurements like monoisotopic mass and fragmentation patterns. The absence of authenticated standards requires that detected features be annotated by matching to known parameters and mass fragmentation patterns within existing mass spectrometry databases like (METLIN (http://metlin.scripps.edu/index.php), HMDB (http://www.hmdb.ca/), MASSBANK (http://www.massbank.jp/Index), NIST-MS (http://chemdata.nist.gov/), IDEOME (http://mzmatch.sourceforge.net/ideom.php), and mzCloud (https://mzcloud.org/).
The field has evolved rapidly due to the increasing use of targeted metabolomics. Targeted approaches provide reliable identification and simultaneous quantification of hundreds of metabolites made possible by developments in tandem mass spectrometry and high-resolution high mass accuracy mass spectrometry [2,3,4,5]. Technology notwithstanding, extensive quality control and quality assurance protocols are mandatory. Standard operation procedures (SOP) must be implemented to reduce the preanalytical variation and batch to batch variability of data in a metabolomics workflow. Preanalytical variation is rooted in sample harvesting, storage, and transportation. Therefore, it is highly desirable to implement testing at biobanks to reduce the risk of study failure and allow early identification of metabolites that demonstrate excessive preanalytical variation. For example, there is no accepted procedure to limit the impact of hemolysis on plasma, serum, and buffy coat samples.
Significant degradation of metabolites can occur if existing SOPs are not followed, such as quenching protocols to inhibit the degradation of metabolites during tissue harvest and extraction, particularly in relation to in vitro studies [2,3,4,5]. Although biofluid harvest and storage protocols are standardized in most clinics and hospitals, the processes may vary between countries and different regions. The need to achieve standardization in metabolomics resulted in the formation of the metabolomics quality assurance and quality control consortium (mQACC; https://epi.grants.cancer.gov/Consortia/mQACC/). mQACC was established in February 2018 to address key quality assurance (QA) and quality control (QC) issues in the untargeted metabolomics field among relevant stakeholders in academia, industry, and government institutions.
2.2. Assessment of Sample Size Requirements for Clinical and Translational Research
A recent large-scale study in clinical metabolomics demonstrated the importance of insufficient sample size on the reproducibility of results [23]. Mass spectrometry-based metabolomics was used to establish baseline levels and variation in the sera of 1200 adults from the United Kingdom. The authors evaluated three groups based on age, sex, and BMI to test their hypothesis “that many biological studies are underpowered with regard to their ability to come to a robust and statistically significant and justifiable biological conclusion” [23]. Not unexpectedly, median accuracy increased, and variation decreased, as sample size approached 600, a sample size that was representative of the whole sample population.
Subsequent data estimated statistical power and sample size in metabolic phenotyping and demonstrated complex relationships between sample size, power, and effect size for real multivariate data sets [24]. Using univariate and multivariate approaches, the authors projected a power of 0.8 at a sample size of 200, whereas a sample size of 300 was required to obtain 0.95 power. The authors observed that attributed variations in the results of prior biological studies to datasets using a low minimum sample size of around 20 samples. The authors extended their approach to both nuclear magnetic resonance and liquid chromatography−mass spectrometry data from human cohorts (1861 urine samples (ARIC study) and 951 plasma samples (AIRWAVE study)). A recent review in Drug Discovery Today suggested that a power of 0.8 become the benchmark for effective biomarker discovery in precision medicine [14]. Employing the power analysis module in MetaboAnalyst 4.0 (https://www.metaboanalyst.ca), 63 urine metabolites were measured among 77 samples in two groups of cancer patients. In order to achieve the desired power of 0.84 at a false discovery rate (FDR) 0.1, the estimated sample size was 400 per group.
Despite these strong recommendations concerning sample size, peer-review journals report pilot clinical -omics studies with insufficient sample size. For instance, a recent study of the mechanism by which APOA2-saturated fat intake affects obesity [25] was validated across several populations in an epigenome-wide association study. The authors assumed that a sample size of 20 for each CC and TT genotype was sufficient to provide 95% statistical power to detect epigenetic signatures. This assumption proved false for the metabolomics analysis due to the well-known impact of environmental factors on human metabolomics studies. Despite p-value calculations using ANCOVA contrast in a two-way ANOVA model adjusting BMI for metabolite levels, FDR adjustment was not performed during the metabolomics data analysis. Longitudinal datasets may augment underpowered studies by demonstrating dynamic changes over time that are associated with actionable changes. Bayesian analytical approaches to causal inference may increase the effectiveness of biomarker identification by comparison to standard statistical association.
2.3. Demographic Impacts
Although the effects of sample size and sample quality can be minimized by adopting strict protocols, demographic variability must be addressed independently during metabolite biomarker discovery. Dunn et al. [23] set the benchmark for evaluating the effect of demographics and sample size on phenotyping quality. This study conducted as a part of The Husermet project utilized mass spectrometry to analyze the metabolome of human serum. Demographic factors had an important impact on metabolic changes associated with sex, age, BMI, blood pressure, and smoking habits of the participants. A significant number of metabolites were associated with insulin resistance, and metabolic syndrome increased with age. Correlations between metabolite profiling and clinical chemistry were discovered, such as circulating HDL cholesterol and levels of fatty acids, di- and triglycerides, liver function, uric acid levels, etc. A recent cross-sectional study measured 106 metabolites in human plasma from 2503 healthy subjects [34]. Metabolites from multiple classes, including amino acids, lipids and acylcarnitines were monitored because of their involvement in core metabolic processes. Interestingly, liver function had the strongest association with plasma metabolite profiles, followed by kidney function and insulin resistance. In this study, the authors established the main clinical covariates associated with differences in the plasma metabolite profiles. Authors used principal component analysis (PCA) to reduce the large number of metabolites into independent components. Results suggest that liver function demonstrates the strongest association with the major differences in the plasma metabolite profiles measured in this study in particular lipid profiles, including cholesterol. Medium-chain acyl carnitines mainly contributed to components associated with hypertension and kidney function. Associations between the short list of measured metabolites and specific patient phenotypes suggest that multiple independent metabolic mechanisms may contribute to recognized clinical conditions. One possible limitation on the external validity of this study was the homogeneous population of patients from a specific region in Sweden. A recent Australian study acquired blood samples from 1180 children and 1325 parents and analyzed amino acid species, lipoprotein subclass measures, lipids, and fatty acids as composite biomarkers of inflammation and energy homeostasis [35]. Applied in this study NMR profiling technique demonstrated metabolic measures for each participant that segregated the population according to age and sex.
Longitudinal metabolomic studies have confirmed impacts of age and sex on metabolite profiles. A total of 2344 plasma samples in fasting patients from the longitudinal Wisconsin Registry for Alzheimer’s Prevention (WRAP) study were analyzed from 1212 participants initially free of Alzheimer’s disease at enrollment. After corrections for multiple testing, 56.8% of measured metabolites were associated with age and 63.4% with sex. Genome-wide screening to evaluate the role of hereditary factors on metabolite profiles demonstrated significant influence by a complex combination of genomic and environmental factors [36,37,38,39]. A cross-sectional study evaluating associations between the human lipidome and age enrolled 100 subjects with an apolipoprotein E (APOE) E3/E3 genotype aged 56–100 years. After rigorous statistical analysis, a strong negative association between age and lipid levels was observed that predominated in male compared to female subjects [36]. Sex and age-related differences were also found in a study of elderly subjects with pre-frailty sub-phenotypes [38]. Further, metabolomic analysis has been used to investigate gait speed in the Baltimore Longitudinal Study of Aging (BLSA). Baseline and follow-up measurements were from 504 adults aged 50 or older over a median follow-up of 50.5 months. Plasma metabolites were measured by targeted mass spectrometry using a commercially available metabolomics kit (Absolute IDQ p180 Kit, Biocrates). Low plasma levels of LPC 18:2 was an independent predictor of decline in gait speed in older adults [38]. LPC 18:2 is associated with impaired glucose tolerance, insulin resistance, type 2 diabetes, coronary artery disease, and memory impairment. These meticulous studies (Table 1) make the critical link between demographic characteristics and phenotyping by omics protocols.
Table 1.
Metabolite Class | Metabolite | Gender/F | Age | BMI | Clinical Relevance (Mayo Clinic) | Reference |
---|---|---|---|---|---|---|
Carboxylic acids | Citrate | ☑ ⇧ | ☑ ⇧ | ☑ ⇩ | Metabolic diseases ⇩ | [23,36] |
Aconitate | ☑ ⇧ | [36] | ||||
Urate | ☑ ⇧ | Acute uric acid nephropathy ⇧ | [23,36] | |||
Hexadecenoic acid | ☑ ⇧ | Nutrients deficiency ⇩ | [23,36] | |||
4-hydroxyphenyllactic acid | ☑ ⇩ | [23] | ||||
Octadecadienoic acid | ☑ ⇧ | Nutrients deficiency ⇩ | [23] | |||
Dodecanoic acid | ☑ ⇩ | [23] | ||||
Acylcarnitines | Butyrylcarnitine | ☑ ⇩ | Fatty acid beta-oxidation disorders ⇧ | [37] | ||
Oleoylcarnoiitine | ☑ ⇩ | ☑ ⇧ | Fatty acid beta-oxidation disorders ⇧ | [36] | ||
Palmitoylcarnitine | ☑ ⇩ | ☑ ⇧ | Fatty acid beta-oxidation disorders ⇧ | [36] | ||
Eicosenoylcarnitine | ☑ ⇩ | ☑ ⇧ | fatty acid beta-oxidation disorders ⇧ | [36] | ||
Amino acids | Tyrosine | ☑ ⇩ | ☑ ⇧ | ☑ ⇧ | Inborn errors of metabolism ⇧ | [23,36] |
Creatinine | ☑ ⇧ | ☑ ⇧ | ☑ ⇧ | Kidney disease/failure ⇧ | [23,33] | |
Methionine sulfoxide | ☑ ⇧ | [23] | ||||
Serine | ☑ ⇧ | ☑ ⇩ | ☑ ⇩ | Inborn errors of metabolism ⇧ | [23,36] | |
Aspartate | ☑ ⇩ | ☑ ⇩ | Inborn errors of metabolism ⇧ | [23] | ||
Tryptophan | ☑ ⇩ | ☑ ⇩ | Inborn errors of metabolism ⇧ | [23,36] | ||
Methionine | ☑ ⇩ | ☑ ⇩ | Inborn errors of metabolism ⇧ | [23] | ||
Threonine | ☑ ⇩ | ☑ ⇩ | Inborn errors of metabolism ⇧ | [23,36] | ||
Cysteine | ☑ ⇧ | ☑ ⇧ | [23] | |||
Cystine | ☑ ⇧ | Inborn errors of metabolism ⇧ | [23] | |||
Glutamine | ☑ ⇧ | ☑ ⇧ | Inborn errors of metabolism ⇧ | [23,36] | ||
Phenylalanine | ☑ ⇩ | ☑ ⇧ | ☑ ⇧ | Inborn errors of metabolism ⇧ | [23] | |
Valine | ☑ ⇩ | ☑ ⇧ | Inborn errors of metabolism ⇧ | [23,36] | ||
Leucine | ☑ ⇩ | ☑ ⇩ | [36] | |||
Histidine | ☑ ⇩ | ☑ ⇩ | Inborn errors of metabolism ⇧ | [23,36] | ||
Phosphoserine | ☑ ⇩ | ☑ ⇩ | [23] | |||
2-aminomalonic acid | ☑ ⇩ | [23] | ||||
Aminooctanoic acid | ☑ ⇧ | [23,38] | ||||
Lipids | DAG | ☑ ⇧ | ☑ ⇩ | [23] | ||
PC | ☑ ⇧ | [23] | ||||
Glycerol | ☑ ⇧ | ☑ ⇧ | ☑ ⇧ | [23] | ||
Glycerol-3-phosphate | ☑ ⇧ | ☑ ⇧ | ☑ ⇧ | [23] | ||
Threitol | ☑ ⇧ | [23] | ||||
Phosphate | ☑ ⇧ | [23] | ||||
LPC | ☑ ⇩ | [23] | ||||
SM | ☑ ⇩ | [23] | ||||
Cholesterol | ☑ ⇧ | ☑ ⇧ | [33] | |||
TAG | ☑ ⇧ | ☑ ⇧ | lipoprotein metabolism ⇧ | [33] | ||
LPE | ☑ ⇩ | [38] | ||||
Sterol lipids | Androgenic | ☑ ⇩ | ☑ ⇩ | [36] | ||
Sugars | Mannose | ☑ ⇩ | [38] | |||
Fructose | ☑ ⇩ | inborn errors of metabolism ⇧ | [38] | |||
Nucleotides | N1-methylinosine | ☑ ⇩ | ☑ ⇧ | [36] | ||
5-methylthioadenosine | ☑ ⇩ | ☑ ⇧ | [36] | |||
Pseudouridine | ☑ ⇩ | ☑ ⇧ | [36] | |||
Vitamins | Vitamin D | ☑ ⇩ | chronic renal failure ⇩ | [23] |
Major classes of metabolites affected by sex, age, and BMI. DAG—diacylglycerol, PC—phosphatidylcholine, LPC—lysophosphatidylcholine, SM—sphingomyelin, TAG—triacylglycerol, and LPE—lysophosphatidylethanolamine. In the sex columns, ⇧ means the metabolite level was higher in women (F), whereas ⇩ means it decreased. The corresponding level in men has the opposite trend. For all other columns, ☑ means reported dependence with the reference provided, and ⇧ means the metabolite level increased with age, or BMI, whereas ⇩ means it decreased with age or BMI. Clinical relevance column shows the assay for diagnosing disease involved with measurements of the corresponding metabolites with the expected direction of metabolite level changes in bio-fluids. ⇧ means the metabolite level increased with the onset of disease, whereas ⇩ means it decreased. For greater details we recommend exploration of the original articles.
Although animal models permit strict control over the study population and environmental conditions, demographic variation persists. Despite controlled genetics, age, sex, feeding, and environmental conditions among animals in the same cohort, variation in metabolite levels is commonly observed and must be addressed through increased sample size as in human studies. One design consideration to overcome these limitations of metabolomics is to recruit demographically balanced cohorts, a strategy of importance to longitudinal studies of difficult diseases like Alzheimer’s (AD). If demographically balanced cohorts are not possible, exclusion of metabolite markers for biomarker assessment that correlate with demographics should be removed for further development. Serum-based liver function markers and cerebrospinal fluid (CSF) biomarkers were measured during 8 consecutive years in a longitudinal study of 1581 AD participants. Associations of liver function markers with AD were assessed using generalized linear models adjusted for confounding variables and multiple comparisons. Although liver function had the most intriguing association with AD [40], liver function also was most strongly associated with the plasma metabolite profile among healthy subjects [34]. Integrating analyses of genomics, longitudinal metabolomics, and Alzheimer’s risk factors in 1111 cohort participants revealed that changes in CSF metabolite levels explained more than 60% of variance in CSF levels of tau, a detrimental protein that accumulates in the brain of AD patients and is necessary for diagnosis [40].
2.4. Metabolic Markers in Clinical Studies
The metabolome is directly linked to perturbations in cell metabolism caused by environmental stimuli as well as disease, thus metabolomics has been successfully used to measure phenotypic outcomes in vitro and in vivo [15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,40,41,42,43,44,45,46,47,48,49]. Examples include observations of oncometabolites, such as 2-hyroxybutyrate, sarcosine, choline, succinate, lactate, fumarate, and glucose, associated with tumor growth and metastasis that may also function as biomarkers for leukemia, renal carcinoma, breast, brain, or prostate cancer [26,27,28,29,30,31,32]. Metabolomics may also be used to accumulate additional insights during studies of clinical pharmacology and biomarker discovery [3,4,14,15,16], recognizing that large scale and multi-cohort studies will increase the discovery of candidate biomarkers.
Advances in bioanalytical capability has expanded the number of metabolites discovered in retrospective and prospective studies that form the basis for existing clinical diagnostic assays. A recent report validated a rapid, repeatable, and precise method for extracting and quantifying 32 eicosanoid urinary metabolites by LC–MS/MS [42]. These signaling mediators were rapidly metabolized and excreted as a mixture of primary and secondary metabolites, a finding that has expanded interest in human urine as a useful, readily accessible biofluid for monitoring the endogenous synthesis of these molecules despite the inherent difficulties that urine’s chemical complexity poses for normalizing metabolite results. Human urine contains a candidate panel of 17 metabolites potentially useful as a biomarker of colorectal cancer (CRC). The performance of the panel was tested among 342 participants (CRC, 171; healthy controls, 171) in Canada and the United States) by comparison to standard of care colonoscopy and histopathology. Targeted liquid chromatography–mass spectrometry was performed to quantify urine metabolites. Multiple statistical models demonstrated sufficient separation of CRC from controls, opening up an excellent opportunity for translation to clinical diagnosis [43].
In another example, targeted clinical metabolite profiling was used to stratify patients with diabetes [43]. An LC–MS/MS platform quantified and discovered new, clinically relevant metabolites. One such marker is Trimethylamine N-oxide (TMAO), a newly identified gut microbiota-dependent metabolite that contributes to a variety of conditions, such as diabetes, atherosclerosis, and cardiovascular disease. TMAO is also a prognostic marker of unfavorable clinical outcomes among patients with acute ischemic stroke [45,46].
Modern metabolomics studies have considerably benefited from improvements in study design that minimize the uncontrolled effects of demographic variation and sample size and account for unique sources of bias. These lessons apply to both observational and interventional studies as well as those with multi-arm or multi-stage designs. Study recruitment must balance demographic characteristics among participants in each cohort and provide sufficient sample size to satisfy requirements for sufficient statistical power at the anticipated false discovery rate. For example, a cohort of 50 type 1 diabetics underwent measurements of amino acids like tyrosine and homocitrulline previously linked to participant demographic characteristics [44]. No age or BMI dependent changes in tyrosine, tryptophan, glutamine, or phenylalanine levels were reported, contradicting prior studies conducted with a larger sample size (Table 1).
Given the recognized link between population demographics and biomarker discovery, the biotechnology industry has used complex statistical methodologies to control for the confounding influences of sex, age, and BMI on metabolomics data generated from study participants and healthy controls. A prominent example is the US patent issued to Metanomics GMBH (Germany) in 2013 in its search for a quantitative assay kit for metabolite biomarkers for pancreatic cancer [47]. This patent protected three critical aspects related to precision medicine for pancreatic cancer: a novel method for diagnosis, treatment selection, and evaluation of treatment outcome. The patent described numerous small molecule biomarkers as candidates to differentiate pancreatic carcinoma from liver cirrhosis and pancreatitis. Statistical analysis was performed using a simple linear model (ANOVA) with the following fixed effects: Disease, body mass index, age, storage time, and recruitment site. A long list of candidate markers was supported by statistical evidence for their significance and included coenzymes, carboxylic acids, fatty acids, amino acids, saccharides, sugar alcohols, and lipids Metanomics GMBH (Germany) published a metabolic signature of nine molecules discriminating pancreatic ductal adenocarcinoma from chronic pancreatitis in 2017 [48]. The signature was selected based on the multivariate elastic net analysis comprising of the biomarker panel, and their univariate statistical analysis performed by a linear model on log base 10-transformed data considering disease status, sex, body mass index, age, and storage time as fixed effects. Weaknesses of their approach included limited sample size and failure to balance sex between the cohorts, which may compromise the clinical utility of this marker panel in commercial use. The proposed panel listed histidine as a candidate biomarker despite its known interactions with age and body mass index (Table 1), as well as phosphatidylcholine and sphingomyelins levels that correlate with sex and BMI (Table 1). Given the tiny fraction of total body mass represented by the underlying pancreatic cancer, it remains unclear whether metabolomics approaches by themselves are sufficiently specific as a diagnostic and prognostic tool in the absence of other complementary -omics approaches, which account for the confounding effects of metabolic processes in the normal major organs.
The Bogalusa Heart Study is an example of a successful demographically balanced study to find cognition phenotypes among its participants [49]. Metabolite profiling of plasma samples from 1177 participants was performed by Metabolon, Inc. (USA) and linked to cognition. Multiple linear regression was used and adjusted for demographics. Weighted correlation network analysis evaluated correlations between cognition and modules of co-abundant metabolites after adjustment for covariables, including age, sex, ethnicity, cigarette smoking, drinking, education, depression, vocabulary, BMI, systolic blood pressure (SBP), LDL-C, and glucose. In contrast, several small metabolomics studies claim to have discovered a wide variety of metabolic biomarker candidates, which have not been successfully validated nor approved by the FDA (FDA official site, 16 April 2019) [14].
One technical approach to improve trust in metabolomics is the introduction of replication studies [50,51,52]. Such studies are demonstrating demographical balance in both the discovery and validation cohorts and may account for different geographical regions. Statistical power is considered in parallel. An example of this approach is a mass spectrometry-based metabolite profiling study to identify potential markers of colorectal cancer detection in circulation [50]. The Geijsen study used a discovery replication design to screen two independent, relatively large, patient cohorts of Caucasian origin from two different countries. Plasma samples from 268 colorectal cancer patients and 353 controls were analyzed using separate discovery and replication sets from two European cohorts (ColoCare Study: n = 180 patients/n = 153 controls; the Colorectal Cancer Study of Austria (CORSA) n = 88 patients/n = 200 controls). Multiple logistic regression was used to test the association between disease state and metabolites. Potential markers were validated in the replication set and adjusted for sex, age, BMI, and smoking status to assure robustness of the resulting panel, which identified changes in the levels of several amino acids and lipids. Interestingly, changes in valine were inversely proportional to age and BMI, suggesting that age and BMI could not account for decreased circulating levels of valine among CRC patients (Table 1). Conversely, levels of leucine and LPCs were associated with age and BMI as shown in Table 1. The results may illustrate early metabolic changes during colorectal carcinogenesis rather than the process of metastatic spread and do not provide insight into causality. Another similar study investigated circulating markers for incident Type 2 Diabetes between two Swedish prospective cohorts comprising > 4000 study participants. Independent, replicable associations were discovered between the future risk of T2DM and three metabolites: N2,N2-dimethylguanosine, 7-methylguanine, and 3-hydroxytrimethyllysine [51]. Another Swedish study used plasma or serum samples from three community-based cohorts to identify metabolites associated with incident heart failure in a general population (total n = 3924; 341 incident heart failure events; median follow-up ranging from 4.6 to 13.9 years) and discovered associations between heart failure and circulating levels of urobilin and sphingomyelin (30:1) [52]. Elevated levels of sphingomyelin (30:1) linked to heart failure could not be explained by known associations between BMI and sphingomyelin (SM) in other studies (Table 1). Thus, this process exemplifies the optimal strategy to improve translational utility of the data and validation of the findings.
3. Conclusions/Recommendations
Despite its inherent complexities and challenges, metabolomics is emerging as an important tool to characterize patient phenotypes in parallel with other -omics platforms [12]. The establishment and incorporation of optimized clinical study design, standardized protocols and quality metrics, and utilization of independent demographic factors will allow for efficient translation of actionable metabolite biomarkers impacting clinical trials and population health studies. Further, power calculations should be performed to assess confidence in the biomarker discovery output. As referenced in Dunn et al., which performed metabolomic assessment on samples from the UK biobank and determined utility of metabolites in stratifying demographic features powered at 0.8 for 200 samples and 0.95 for 300 samples. This study established the ideal reference point for discovery of biomarkers using known biological influence from demographics, which could be applied to powering studies evaluating markers for heterogeneous diseases. In this line, groups should further be balanced demographically, or a plan should be in place to exclude metabolite variables that correlate with demographic features. Additionally, cross validation in studies using multi-site cohorts further exemplifies the potential translational utility and should be encouraged in all studies. These advances and strategies in metabolomic biomarker discovery promise to improve multidimensional assessment of a population’s health while accelerating drug discovery and the adoption of precision medicine into general clinical practice.
Acknowledgments
We thank Lianne Borax for administrative assistance and Bennett Greenwood for technical input.
Author Contributions
Conceptualization, V.T. and M.A.K.; writing, review and editing, V.T., M.A.K., A.J.M., R.S., and N.R.N. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Conflicts of Interest
The authors declare no conflict of interest. The authors alone are responsible for the content and writing of the paper.
References
- 1.Wishart D.S., Feunang Y.D., Marcu A., Guo A.C., Liang K., Vázquez-Fresno R., Sajed T., Johnson D., Li C., Karu N., et al. HMDB 4.0: The human metabolome database for 2018. Nucleic Acids Res. 2018;46:D608–D617. doi: 10.1093/nar/gkx1089. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Pinu F.R., Beale D.J., Paten A.M., Kouremenos K., Swarup S., Schirra H.J., Wishart D. Systems Biology and Multi-Omics Integration: Viewpoints from the Metabolomics Research Community. Metabolites. 2019;9:76. doi: 10.3390/metabo9040076. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Kohler I., Hankemeier T., van der Graaf P.H., Knibbe C.A.J., van Hasselt J.G.C. Integrating clinical metabolomics-based biomarker discovery and clinical pharmacology to enable precision medicine. Eur. J. Pharm. Sci. 2017;109S:S15–S21. doi: 10.1016/j.ejps.2017.05.018. [DOI] [PubMed] [Google Scholar]
- 4.Trivedi D.K., Hollywood K.A., Goodacre R. Metabolomics for the masses: The future of metabolomics in a personalized world. New Horiz. Transl. Med. 2017;3:294–305. doi: 10.1016/j.nhtm.2017.06.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Lucarelli G., Loizzo D., Franzin R., Battaglia S., Ferro M., Cantiello F., Castellano G., Bettocchi C., Ditonno P., Battaglia M. Metabolomic insights into pathophysiological mechanisms and biomarker discovery in clear cell renal cell carcinoma. Expert Rev. Mol. Diagn. 2019;19:397–407. doi: 10.1080/14737159.2019.1607729. [DOI] [PubMed] [Google Scholar]
- 6.Tang Z.-Z., Chen G., Hong Q., Huang S., Smith H.M., Shah R.D., Scholz M., Ferguson J. Multi-Omic Analysis of the Microbiome and Metabolome in Healthy Subjects Reveals Microbiome-Dependent Relationships Between Diet and Metabolites. Front. Genet. 2019;10:454. doi: 10.3389/fgene.2019.00454. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Zierer J., Jackson M., Kastenmüller G., Mangino M., Long T., Telenti A., Mohney R.P., Small K.S., Bell J.T., Steves C., et al. The fecal metabolome as a functional readout of the gut microbiome. Nat. Genet. 2018;50:790–795. doi: 10.1038/s41588-018-0135-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Chen Y.-Y., Chen D.-Q., Chen L., Liu J.-R., Vaziri N., Guo Y., Zhao Y.-Y. Microbiome-metabolome reveals the contribution of gut-kidney axis on kidney disease. J. Transl. Med. 2019;17:5. doi: 10.1186/s12967-018-1756-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Wilmanski T., Rappaport N., Earls J.C., Magis A.T., Manor O., Lovejoy J., Omenn G.S., Hood L., Gibbons S.M., Price N.D. Blood metabolome predicts gut microbiome α-diversity in humans. Nat. Biotech. 2019;37:1217–1228. doi: 10.1038/s41587-019-0233-9. [DOI] [PubMed] [Google Scholar]
- 10.Dao M.-C., Sokolovska N., Brazeilles R., Affeldt S., Pelloux V., Prifti E., Chilloux J., Verger E., Kayser B.D., Aron-Wisnewsky J., et al. A Data Integration Multi-Omics Approach to Study Calorie Restriction-Induced Changes in Insulin Sensitivity. Front. Physiol. 2019;9:1958. doi: 10.3389/fphys.2018.01958. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Benítez-Páez A., Kjølbæk L., Del Pulgar E.M.G., Brahe L.K., Astrup A., Matysik S., Schött H.-F., Krautbauer S., Liebisch G., Boberska J., et al. A Multi-omics Approach to Unraveling the Microbiome-Mediated Effects of Arabinoxylan Oligosaccharides in Overweight Humans. mSystems. 2019;4:e00209–e00219. doi: 10.1128/mSystems.00209-19. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Kiebish M.A., Narain N.R. Enabling biomarker discovery in Parkinson’s disease using multiomics: Challenges, promise and the future. Per. Med. 2019;16:5–7. doi: 10.2217/pme-2018-0115. [DOI] [PubMed] [Google Scholar]
- 13.Kiebish M.A., Cullen J., Mishra P., Ali A., Milliman E., Rodrigues L.O., Chen E.Y., Tolstikov V., Zhang L., Panagopoulos K., et al. Multi-omic serum biomarkers for prognosis of disease progression in prostate cancer. J. Transl. Med. 2020;18:10. doi: 10.1186/s12967-019-02185-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Khan S.R., Manialawy Y., Wheeler M.B., Cox B.J. Unbiased data analytic strategies to improve biomarker discovery in precision medicine. Drug Discov. Today. 2019;24:1735–1748. doi: 10.1016/j.drudis.2019.05.018. [DOI] [PubMed] [Google Scholar]
- 15.Beger R.D., Schmidt M.A., Kaddurah-Daouk R. Current Concepts in Pharmacometabolomics, Biomarker Discovery, and Precision Medicine. Metabolites. 2020;10:129. doi: 10.3390/metabo10040129. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Pinu F.R., Goldansaz S.A., Jaine J. Translational Metabolomics: Current Challenges and Future Opportunities. Metabolites. 2019;9:108. doi: 10.3390/metabo9060108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Jiang Y., Zhu Z., Shi J., An Y., Zhang K., Wang Y., Li S., Jin L., Ye W., Cui M., et al. Metabolomics in the Development and Progression of Dementia: A Systematic Review. Front. Neurosci. 2019;13:343. doi: 10.3389/fnins.2019.00343. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Adebiyi M.G., Manalo J.M., Xia Y. Metabolomic and molecular insights into sickle cell disease and innovative therapies. Blood Adv. 2019;3:1347–1355. doi: 10.1182/bloodadvances.2018030619. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Arroyo-Crespo J.J., Armiñán A., Charbonnier D., Deladriere C., Palomino-Schätzlein M., Lamas-Domingo R., Forteza J., Pineda-Lucena A., Vicent M.J. Characterization of triple-negative breast cancer preclinical models provides functional evidence of metastatic progression. Int. J. Cancer. 2019;145:2267–2281. doi: 10.1002/ijc.32270. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Rinschen M.M., Ivanisevic J., Giera M., Siuzdak G. Identification of bioactive metabolites using activity metabolomics. Nat. Rev. Mol. Cell Biol. 2019;20:353–367. doi: 10.1038/s41580-019-0108-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Guijas C., Montenegro-Burke J.R., Warth B., Spilker M.E., Siuzdak G. Metabolomics activity screening for identifying metabolites that modulate phenotype. Nat. Biotechnol. 2018;36:316–320. doi: 10.1038/nbt.4101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Barupal D.K., Zhang Y., Shen T., Fan S., Roberts B.S., Fitzgerald P., Wancewicz B., Valdiviez L., Wohlgemuth G., Byram G., et al. A Comprehensive Plasma Metabolomics Dataset for a Cohort of Mouse Knockouts within the International Mouse Phenotyping Consortium. Metabolites. 2019;9:101. doi: 10.3390/metabo9050101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Dunn W.B., Lin W., Broadhurst D., Begley P., Brown M., Zelená E., Vaughan A.A., Halsall A., Harding N., Knowles J., et al. Molecular phenotyping of a UK population: Defining the human serum metabolome. Metabolomics. 2015;11:9–26. doi: 10.1007/s11306-014-0707-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Blaise B.J., Correia G.D.S., Tin A., Young J.H., Vergnaud A.-C., Lewis M.R., Pearce J.T.M., Elliott P., Nicholson J., Holmes E., et al. Power Analysis and Sample Size Determination in Metabolic Phenotyping. Anal. Chem. 2016;88:5179–5188. doi: 10.1021/acs.analchem.6b00188. [DOI] [PubMed] [Google Scholar]
- 25.Lai C.-Q., E Smith C., Parnell L.D., Lee Y.-C., Corella D., Hopkins P., A Hidalgo B., Aslibekyan S., Province M.A., Absher D., et al. Epigenomics and metabolomics reveal the mechanism of the APOA2-saturated fat intake interaction affecting obesity. Am. J. Clin. Nutr. 2018;108:188–200. doi: 10.1093/ajcn/nqy081. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Herranz D., Ambesi-Impiombato A., Sudderth J., Sanchez-Martin M., Belver L., Tosello V., Xu L., Wendorff A.A., Castillo M., Haydu J.E., et al. Metabolic reprogramming induces resistance to anti-NOTCH1 therapies in T cell acute lymphoblastic leukemia. Nat. Med. 2015;21:1182–1189. doi: 10.1038/nm.3955. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Donti T.R., Cappuccio G., Hubert L., Neira J., Atwal P.S., Miller M.J., Cardon A.L., Sutton V.R., Porter B.E., Baumer F.M., et al. Diagnosis of adenylosuccinate lyase deficiency by metabolomic profiling in plasma reveals a phenotypic spectrum. Mol. Genet. Metab. Rep. 2016;8:61–66. doi: 10.1016/j.ymgmr.2016.07.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Pera B., Krumsiek J., Assouline S.E., Marullo R., Patel J., Phillip J.M., Roman L., Mann K.K., Cerchietti L. Metabolomic Profiling Reveals Cellular Reprogramming of B-Cell Lymphoma by a Lysine Deacetylase Inhibitor through the Choline Pathway. EBioMedicine. 2018;28:80–89. doi: 10.1016/j.ebiom.2018.01.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Wishart D.S., Mandal R., Stanislaus A., Ramirez-Gaona M. Cancer Metabolomics and the Human Metabolome Database. Metabolites. 2016;6:10. doi: 10.3390/metabo6010010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Hashim N.A.A., Ab-Rahim S., Suddin L.S., Saman M.S.A., Mazlan M. Global serum metabolomics profiling of colorectal cancer. Mol. Clin. Oncol. 2019;11:3–14. doi: 10.3892/mco.2019.1853. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Donnelly D., Aung P.P., Jour G. The "-OMICS" facet of melanoma: Heterogeneity of genomic, proteomic and metabolomic biomarkers. Semin. Cancer Biol. 2019;59:165–174. doi: 10.1016/j.semcancer.2019.06.014. [DOI] [PubMed] [Google Scholar]
- 32.Drucker E., Krapfenbauer K. Pitfalls and limitations in translation from biomarker discovery to clinical utility in predictive and personalized medicine. EPMA J. 2013;4:7. doi: 10.1186/1878-5085-4-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Marchand C.R., Farshidfar F., Rattner J., Bathe O.F. A Framework for Development of Useful Metabolomic Biomarkers and Their Effective Knowledge Translation. Metabolites. 2018;8:59. doi: 10.3390/metabo8040059. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Al-Majdoub M., Herzog K., Daka B., Magnusson M., Råstam L., Lindblad U., Spégel P. Population-Level Analysis to Determine Parameters That Drive Variation in the Plasma Metabolite Profiles. Metabolites. 2018;8:78. doi: 10.3390/metabo8040078. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Ellul S., Wake M., A Clifford S., Lange K., Würtz P., Juonala M., Dwyer T., Carlin J.B., Burgner D.P., Saffery R. Metabolomics: Population epidemiology and concordance in Australian children aged 11–12 years and their parents. BMJ Open. 2019;9:106–117. doi: 10.1136/bmjopen-2017-020900. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Darst B.F., Koscik R.L., Hogan K.J., Johnson S.C., Engelman C.D. Longitudinal plasma metabolomics of aging and sex. Aging. 2019;11:1262–1282. doi: 10.18632/aging.101837. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Wong M.W., Braidy N., Pickford R., Vafaee F., Crawford J., Muenchhoff J., Schofield P., Attia J., Brodaty H., Sachdev P., et al. Plasma lipidome variation during the second half of the human lifespan is associated with age and sex but minimally with BMI. PLoS ONE. 2019;14:e0214141. doi: 10.1371/journal.pone.0214141. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Pujos-Guillot E., Pétéra M., Jacquemin J., Centeno D., Lyan B., Montoliu I., Madej D., Pietruszka B., Fabbri C., Santoro A., et al. Identification of Pre-frailty Sub-Phenotypes in Elderly Using Metabolomics. Front. Physiol. 2019;9:1903. doi: 10.3389/fphys.2018.01903. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Gonzalez-Freire M., Moaddel R., Sun K., Fabbri E., Zhang P., Khadeer M., Salem N., Ferrucci L., Semba R.D. Targeted Metabolomics Shows Low Plasma Lysophosphatidylcholine 18:2 Predicts Greater Decline of Gait Speed in Older Adults: The Baltimore Longitudinal Study of Aging. J. Gerontol. Biol. Sci. Med. Sci. 2019;74:62–67. doi: 10.1093/gerona/gly100. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Nho K., Kueider-Paisley A., Ahmad S., Mahmoudiandehkordi S., Arnold M., Risacher S.L., Louie G., Blach C., Baillie R., Han X., et al. Association of Altered Liver Enzymes with Alzheimer Disease Diagnosis, Cognition, Neuroimaging Measures, and Cerebrospinal Fluid Biomarkers. JAMA Netw. Open. 2019;2:e197978. doi: 10.1001/jamanetworkopen.2019.7978. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Darst B.F., Lu Q., Johnson S.C., Engelman C.D. Integrated analysis of genomics, longitudinal metabolomics, and Alzheimer’s risk factors among 1,111 cohort participants. Genet. Epidemiol. 2019;43:657–674. doi: 10.1002/gepi.22211. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Gómez C., Gonzalez-Riano C., Barbas C., Kolmert J., Ryu M.H., Carlsten C., Dahlén S.-E., Wheelock C.E. Quantitative metabolic profiling of urinary eicosanoids for clinical phenotyping. J. Lipid Res. 2019;60:1164–1173. doi: 10.1194/jlr.D090571. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Deng L., Ismond K.P., Liu Z., Constable J., Wang H., Alatise O.I., Weiser M.R., Kingham T.P., Chang D. Urinary Metabolomics to Identify a Unique Biomarker Panel for Detecting Colorectal Cancer: A Multicentre Study. Cancer Epidemiol. Biomark. Prev. 2019;28:12183–12191. doi: 10.1158/1055-9965.EPI-18-1291. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Ahonen L., Jäntti S., Suvitaival T., Theilade S., Kostiainen R., Rossing P., Orešič M., Hyötyläinen T., Risz C. Targeted Clinical Metabolite Profiling Platform for the Stratification of Diabetic Patients. Metabolites. 2019;9:184. doi: 10.3390/metabo9090184. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Zhai Q., Wang X., Chen C., Tang Y., Wang Y., Tian J., Zhao Y., Liu X. Prognostic Value of Plasma Trimethylamine N-Oxide Levels in Patients with Acute Ischemic Stroke. Cell Mol. Neurobiol. 2019;39:1201–1206. doi: 10.1007/s10571-019-00714-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Rexidamu M., Li H., Jin H., Huang J. Serum levels of Trimethylamine-N-oxide in patients with ischemic stroke. Biosci. Rep. 2019;39:BSR20190515. doi: 10.1042/BSR20190515. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Kamlage B., Reszka R., Kluttig M., Kalthoff H., Schniewind B., Mayerie J., Lerch M. Means and methods for diagnosing pancreatic cancer in a subject. 2013/0140452A1. U.S. Patent. 2013 Jun 6
- 48.Mayerle J., Kalthoff H., Reszka R., Kamlage B., Peter E., Schniewind B., Maldonado S.G., Pilarsky C., Heidecke C.-D., Schatz P., et al. Metabolic biomarker signature to differentiate pancreatic ductal adenocarcinoma from chronic pancreatitis. Gut. 2018;67:128–137. doi: 10.1136/gutjnl-2016-312432. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Shi M., Bazzano L.A., He J., Gu X., Li C., Li S., Yaffe K., Kinchen J.M., Stuchlik P., Mi X., et al. Novel serum metabolites associate with cognition phenotypes among Bogalusa Heart Study participants. Aging. 2019;11:5124–5139. doi: 10.18632/aging.102107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Geijsen A.J., Brezina S., Keski-Rahkonen P., Baierl A., Bachleitner-Hofmann T., Bergmann M.M., Boehm J., Brenner H., Chang-Claude J., Van Duijnhoven F.J., et al. Plasma metabolites associated with colorectal cancer: A discovery-replication strategy. Int. J. Cancer. 2019;145:1221–1231. doi: 10.1002/ijc.32146. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Ottosson F., Smith E., Gallo W., Fernandez C., Melander O. Purine Metabolites and Carnitine Biosynthesis Intermediates Are Biomarkers for Incident Type 2 Diabetes. J. Clin. Endocrinol. Metab. 2019;104:4921–4930. doi: 10.1210/jc.2019-00822. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Stenemo M., Ganna A., Salihovic S., Nowak C., Sundström J., Giedraitis V., Broeckling C.D., Prenni J.E., Svensson P., Magnusson P.K., et al. The metabolites urobilin and sphingomyelin (30:1) are associated with incident heart failure in the general population. ESC Heart Fail. 2019;6:764–773. doi: 10.1002/ehf2.12453. [DOI] [PMC free article] [PubMed] [Google Scholar]