Skip to main content
mSystems logoLink to mSystems
. 2018 Mar 13;3(2):e00153-17. doi: 10.1128/mSystems.00153-17

Translating Lung Microbiome Profiles into the Next-Generation Diagnostic Gold Standard for Pneumonia: a Clinical Investigator’s Perspective

Georgios D Kitsios a,b,2,
PMCID: PMC5850077  PMID: 29556537

Severe bacterial pneumonia is a major global cause of morbidity and mortality, yet current diagnostic approaches rely on identification of causative pathogens by cultures, which require extended incubation periods and often fail to detect relevant pathogens. Consequently, patients are prescribed broad-spectrum antibiotics in a “one-size-fits-all” manner, which may be inappropriate for their individual needs and promote antibiotic resistance.

KEYWORDS: intensive care unit, lung microbiome, metagenomics, next-generation sequencing, pneumonia

ABSTRACT

Severe bacterial pneumonia is a major global cause of morbidity and mortality, yet current diagnostic approaches rely on identification of causative pathogens by cultures, which require extended incubation periods and often fail to detect relevant pathogens. Consequently, patients are prescribed broad-spectrum antibiotics in a “one-size-fits-all” manner, which may be inappropriate for their individual needs and promote antibiotic resistance. My research focuses on leveraging next-generation sequencing of microbial DNA directly from patient samples for the development of new, culture-independent definitions of pneumonia. In this perspective article, I discuss the current state of the field and focus on the conceptual and research design challenges for clinical translation. With ongoing technological advancements and application of computational biology methods for assessing clinical validity and utility, I anticipate that sequencing-based diagnostics will soon be able to positively disrupt the way we think about, diagnose, and treat pulmonary infections.

SCOPE OF THE CLINICAL PROBLEM

In caring for patients with severe pneumonia in the intensive care unit (ICU), I am routinely faced with the frustrating challenges familiar to all clinicians treating infections: “What is the causative pathogen? Are we using the right antibiotics? Did the sputum culture results ever come back? No pathogen identified, but our patient is not getting better … Have we actually ruled out an infection? Is our patient going to recover from this?” Critical questions that frequently cannot be answered at the bedside. The root cause of the problem stems from our reliance on culture-based diagnostic tests that are neither sensitive nor fast enough to guide precise and timely treatment, resulting in empirical, suboptimal care for individual patients.

With substantial diagnostic limitations, it is not surprising that severe pneumonia has high mortality rates from 20 to 50% and long-term morbidity in ICU survivors (1). For patients presenting with fevers, sputum purulence, hypoxia, and an abnormal chest radiograph, an infectious bacterial pneumonia is rightly on top of the differential diagnosis. Along with collection of microbiologic culture specimens (respiratory secretions and/or blood samples), prompt initiation of empirical antibiotics is imperative, as even small delays translate into measurable increases in mortality (2). Following this initial encounter of clinical syndrome recognition and response, precise identification of the culprit pathogen (and its antimicrobial susceptibility) is needed to tailor further therapy. However, cultures require long incubation periods of 48 to 72 h to provide actionable results, and they frequently fail to define a causative organism (in up to 60% of cases despite systematic workup) (3), offering no specific guidance to clinicians (Fig. 1A). The resultant untailored, broad-spectrum antibiotics (typically targeting Gram-positive/negative and atypical bacteria) can be disproportionately intense, inadequate, or entirely unnecessary, depending on the causative microbial agent (4). Such intense regimens also increase the risk of toxicity, ablate indigenous protective microbiota leading to secondary infections such as Clostridium difficile colitis, and most concerning of all, apply selective pressure for emergence of multiresistant microbial strains, a major public health threat (5). Thus, the ability to efficiently and precisely target antibiotics is an unmet critical need in the care of severe pneumonia in the ICU, which has fueled my interest in leveraging the lung microbiome study tools for this purpose.

FIG 1 .

FIG 1 

Stepwise clinical translation of next-generation sequencing (NGS) diagnostics for pneumonia. (A) Scope of the clinical problem, as delays or the inability to establish an etiologic diagnosis of bacterial pneumonia based on culture results lead to empirical one-size-fits-all antibiotic regimens. (B) Current state of research in the field with comparisons of either point-of-care or standard sequencing device outputs with clinical, culture-based diagnoses of pneumonia. The lack of a diagnostic gold standard limits our ability to assess the diagnostic performance of NGS in this context. (C) Clinical validity assessment of NGS output (and specifically metagenomic sequencing) against construction of a gold standard (incorporating clinical variables, vital signs, chest radiography scores, culture results, and validated biomarkers of injury and inflammation) with the use of machine-learning algorithms to develop a sequencing-based definition of pneumonia (pneumonia index). (D) Clinical utility assessment of the developed pneumonia index in a randomized clinical trial design of NGS (metagenomics) versus standard-of-care cultures for assessment of NGS impact on antibiotic prescriptions and clinical outcomes.

RESPIRATORY MICROBIOME RESEARCH IN THE ICU

The recent wave of human lung microbiome research was made possible by the development of next-generation sequencing (NGS) techniques. Without the need for ex vivo growth and isolation of microbial species, amplicon-based sequencing of the highly conserved 16S rRNA gene (16S sequencing) in bacteria has uncovered bacterial communities in respiratory health and disease that are low in biomass but complex in composition, debunking long-held dogmas of “lung sterility” (6).

In proof-of-concept examinations of the validity of 16S sequencing as a diagnostic tool for pneumonia, my group (7) and others (8) have demonstrated that respiratory samples from intubated patients with pneumonia have profiles of low alpha diversity and dominance by taxa corresponding to clinically significant pathogenic organisms isolated in cultures, such as Staphylococcus aureus and Klebsiella pneumoniae. 16S sequencing has also afforded us with first-time surveys of the composition of the diagnostic “black box” that culture-negative cases represent: in our cohort, about 20% of communities are dominated by common pathogens (yet missed by cultures), and the remaining majority of cases show high abundance of bacteria with probable oral origin (e.g., Prevotella, Veillonella, etc.) (9), challenging our conventional thinking of pneumonia pathogenesis and the presumptive clinical diagnosis (7). Despite these novel insights into the ecology of pneumonia, 16S sequencing cannot be deployed quickly enough for clinical applications and does not provide information on bacterial species/strains, antibiotic resistance, or nonbacterial pathogens.

To overcome the limitations of 16S sequencing, whole metacommunity shotgun sequencing of DNA (metagenomics) or RNA (metatranscriptomics) has begun to be applied to respiratory samples to capture the wide microorganismal breadth and coding potential of pathogens with metagenomics (10, 11) and the functional activity of communities with metatranscriptomics (12, 13). With the advent of rapid, point-of-care (POC) sequencing devices (nanopore sequencing; Oxford Nanopore Technologies), bedside pathogen identification and antibiotic resistance prediction may become feasible in a matter of hours (14). In proof-of-concept case reports, investigators used nanopore sequencing competing against the clinical microbiology lab to determine who defines the causative pathogen first, and indeed they won by detecting pathogen sequences several hours before cultures provided a diagnostic signal (15). Apart from their potential for faster diagnosis, shotgun approaches offer an unprecedented opportunity for “hypothesis-free” diagnostics: with “agnostic” interrogation of metacommunity members (including viruses, fungi, or parasites), metagenomics/transcriptomics can expand our knowledge of pathogenic organisms (16), characterize poorly defined clinical syndromes (17, 18), and help identify emerging disease entities (19) across the spectrum of human pathology. However, shotgun approaches have yet to be optimized for application in respiratory samples with overwhelming amounts of human DNA compared to microbial DNA (ratio of up to 99:1) that compromise signal and analyses (11).

Shotgun approaches are not ready for clinical prime time, not just due to technical challenges but also because we still lack the diagnostic test framework to utilize their output. Feeding sequencing reports to clinicians without the obligatory (but yet to be developed) interpretive decision support would stir more confusion and clinically inappropriate decision making. As a clinical investigator, I am looking at the future research needs and the type of clinical studies that will allow us to develop actionable diagnostic tests, with a primary focus on metagenomics for the diagnosis of bacterial pneumonias that mandate targeted antibiotic therapies.

CHALLENGES ON THE WAY TO CLINICAL TRANSLATION

Creating a clinically useful diagnostic test based on metagenomics needs to overcome several technological, practical, and cost-related challenges, including but not limited to sample preparation optimization, minimization of hands-on time, sequencing error reduction, and streamlining of analytical pipelines. Whereas such tasks are not trivial, I expect that with alignment of academic and industry interests in this field, the technical capacities of rapid sequencing devices will continue to evolve with measurable improvements in fidelity, resolution, timeliness, and cost-effectiveness within the next 5 years (20, 21). Such advancements hold the potential to change diagnostic paradigms not only for pulmonary infections but also for several infectious diseases where culture-based diagnostic approaches are currently being used (1618). Nonetheless, from a clinical translation standpoint, the question remains: how can we move from sequencing outputs to a clinically actionable test result?

This is a formidable challenge, not unique to critical care or pulmonary infections: diagnostic performance in the absence of a gold standard, or rather, in the presence of a standard of care that is not golden (22). Metagenomic sequencing directly from patient samples can comprehensively detect viable, dead, or fastidious bacteria, whereas clinical microbiologic cultures can effectively grow only the subset of cultivable bacteria that have not been inhibited or killed by antecedent antibiotic administration. Given that metagenomics is a far more sensitive technology, conventional sensitivity/specificity analyses contrasting metagenomics with cultures are meaningless (Fig. 1B). At the same time, this “ultrasensitivity” of metagenomics can create reporting problems, as the detection of commensal communities or bacteria not typically considered pathogenic will require context-specific interpretation of their “pathogenicity” or lack thereof. To overcome these diagnostic framework challenges, we ought to apply more advanced methods for assessing clinical validity and utility (22).

A TRANSLATIONAL ROADMAP AHEAD

Clinical validity assessment: Can metagenomics identify the correct pathogen in pneumonia cases?

To answer the clinical validity question, the main prerequisite is knowledge of the true pathogen(s) in pneumonia, which can be unavailable in up to 60% of cases despite systematic workup (3). Thus, analyses have to be split into those with a known answer versus unknown answer.

Pathogen-confirmed cases (by cultures or rarely ancillary antigenic/antibody testing) allow for direct comparisons to derive diagnostic thresholds of sequencing output (e.g., number of specific pathogen reads, community diversity indices) associated with bacterial culture positivity above clinically accepted thresholds (e.g. >10−4 CFU). Culture-positive cases also offer the opportunity to refine predictive algorithms of antibiotic resistance gene detection versus clinical antibiograms (14), so that real-time antibiotic recommendations would become feasible. Consequently, observational studies of culture-confirmed cases can help develop statistical models and/or train machine-learning algorithms for sequencing-based definitions of pneumonia (pneumonia index).

In culture-negative cases, the true pathogen (if any) is unknown, and diagnosis is syndromic based on clinical constellations. To interpret the metagenomic bacterial signal in these cases, we need to refine the clinical reference standard with synthesis of multilevel data. These data can include clinical variables (e.g., vital signs, leukocytosis, sputum purulence), chest radiography scores, validated biomarkers of host inflammation (e.g., interleukin-6 and -8), alveolar epithelial injury (receptor of advanced glycation products [RAGE]), and infectious responses (procalcitonin) to be combined in “construct gold standard” pneumonia definitions. Such definitions can emerge either from supervised learning (involving expert input) of clear-cut cases (on the two ends of the pneumonia diagnosis distribution) or unsupervised classification methods identifying phenotypic classes directly from metagenomic and clinical data (2224). With iterative training, metagenomic profiles can be translated into probabilities of pneumonia diagnosis, also incorporating prior probabilities learned from the reference culture-positive profiles. At the end of such complex algorithms, the output has to be simple and binary in order to be clinically usable: “Pneumonia by Pathogen X” or “No Pneumonia” (Fig. 1C).

Clinical utility assessment: Does use of metagenomics in clinical practice result in better outcomes?

Demonstration of clinical efficacy for improving patient outcomes is the ultimate determinant for clinical adoption of any diagnostic test, regardless of its sophistication. The idea of “genetic exceptionalism,” i.e., the belief that genetic information is uniquely important for disease prediction over other clinically available information, did not prove to be conducive for clinical translation of genomics (25). Similarly, microbiome-based approaches have to reach standard thresholds of scientific evidence rigor to be recommended for use. Thus, metagenomics-based diagnostic tests have to be compared against standard-of-care microbiologic cultures in randomized clinical trials, anticipating that improved diagnostic accuracy with sequencing would cut down empirical and unnecessary antibiotics and result in improved (or at least noninferior) clinical response outcomes.

CONCLUSIONS

The advent of NGS and the microbiome scientific field offer revolutionizing opportunities for entering a new, culture-independent epoch of clinical thinking, definitions, and management of infectious diseases. Ongoing technological and bioinformatic innovations, coupled with smart clinical testing and sophisticated computational biology analytics, will hopefully bring to the bedside the next-generation diagnostic tools for timely, targeted and precise antibiotic use in the ICU. Despite the challenges on the way to this culture-independent era, “the Rubicon has been crossed.”

ACKNOWLEDGMENTS

I thank Barbara Methé, Alison Morris, and Bryan McVerry for their comments on the manuscript. I also thank Evaggelos Makkas for his assistance in the graphic design of Fig. 1.

Research reported in this publication is supported by the National Heart, Lung, and Blood Institute of the National Institutes of Health under award number K23HL139987.

mSystems® vol. 3, no. 2, is a special issue sponsored by Janssen Human Microbiome Institute (JHMI).

REFERENCES

  • 1.Chalmers JD, Taylor JK, Mandal P, Choudhury G, Singanayagam A, Akram AR, Hill AT. 2011. Validation of the Infectious Diseases Society of America/American Thoracic Society minor criteria for intensive care unit admission in community-acquired pneumonia patients without major criteria or contraindications to intensive care unit care. Clin Infect Dis 53:503–511. doi: 10.1093/cid/cir463. [DOI] [PubMed] [Google Scholar]
  • 2.Seymour CW, Gesten F, Prescott HC, Friedrich ME, Iwashyna TJ, Phillips GS, Lemeshow S, Osborn T, Terry KM, Levy MM. 2017. Time to treatment and mortality during mandated emergency care for sepsis. N Engl J Med 376:2235–2244. doi: 10.1056/NEJMoa1703058. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Jain S, Self WH, Wunderink RG, Fakhran S, Balk R, Bramley AM, Reed C, Grijalva CG, Anderson EJ, Courtney DM, Chappell JD, Qi C, Hart EM, Carroll F, Trabue C, Donnelly HK, Williams DJ, Zhu Y, Arnold SR, Ampofo K, Waterer GW, Levine M, Lindstrom S, Winchell JM, Katz JM, Erdman D, Schneider E, Hicks LA, McCullers JA, Pavia AT, Edwards KM, Finelli L, CDC EPIC Study Team . 2015. Community-acquired pneumonia requiring hospitalization among U.S. adults. N Engl J Med 373:415–427. doi: 10.1056/NEJMoa1500245. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Magazine R, Rao S, Chogtu B. 2015. Prescribing patterns of drugs in acute respiratory distress syndrome (ARDS): an observational study. J Clin Diagn Res 9:FC01–FC04. doi: 10.7860/JCDR/2015/10411.5519. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Laxminarayan R, Duse A, Wattal C, Zaidi AK, Wertheim HF, Sumpradit N, Vlieghe E, Hara GL, Gould IM, Goossens H, Greko C, So AD, Bigdeli M, Tomson G, Woodhouse W, Ombaka E, Peralta AQ, Qamar FN, Mir F, Kariuki S, Bhutta ZA, Coates A, Bergstrom R, Wright GD, Brown ED, Cars O. 2013. Antibiotic resistance-the need for global solutions. Lancet Infect Dis 13:1057–1098. doi: 10.1016/S1473-3099(13)70318-9. [DOI] [PubMed] [Google Scholar]
  • 6.Dickson RP, Huffnagle GB. 2015. The lung microbiome: new principles for respiratory bacteriology in health and disease. PLoS Pathog 11:e1004923. doi: 10.1371/journal.ppat.1004923. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Kitsios GD, Fitch A, Rapport S, Qin S, Evankovich J, Fair K, Nouraie S, Lee J, Cheng X, Morris A, McVerry B. 2017. Dysbiosis associated with the acute respiratory distress syndrome: a prospective cohort study in adults. Am J Respir Crit Care Med 195:A2942. [Google Scholar]
  • 8.Kelly BJ, Imai I, Bittinger K, Laughlin A, Fuchs BD, Bushman FD, Collman RG. 2016. Composition and dynamics of the respiratory tract microbiome in intubated patients. Microbiome 4:7. doi: 10.1186/s40168-016-0151-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Segal LN, Clemente JC, Tsay J-CJ, Koralov SB, Keller BC, Wu BG, Li Y, Shen N, Ghedin E, Morris A, Diaz P, Huang L, Wikoff WR, Ubeda C, Artacho A, Rom WN, Sterman DH, Collman RG, Blaser MJ, Weiden MD. 2016. Enrichment of the lung microbiome with oral taxa is associated with lung inflammation of a Th17 phenotype. Nat Microbiol 1:16031. doi: 10.1038/nmicrobiol.2016.31. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Yan Q, Cui S, Chen C, Li S, Sha S, Wan X, Yang R, Xin Y, Ma Y. 2016. Metagenomic analysis of sputum microbiome as a tool toward culture-independent pathogen detection of patients with ventilator-associated pneumonia. Am J Respir Crit Care Med 194:636–639. doi: 10.1164/rccm.201601-0034LE. [DOI] [PubMed] [Google Scholar]
  • 11.Cookson WOCM, Cox MJ, Moffatt MF. 2018. New opportunities for managing acute and chronic lung infections. Nat Rev Microbiol 16:111–120. doi: 10.1038/nrmicro.2017.122. [DOI] [PubMed] [Google Scholar]
  • 12.Fischer N, Indenbirken D, Meyer T, Lütgehetmann M, Lellek H, Spohn M, Aepfelbacher M, Alawi M, Grundhoff A. 2015. Evaluation of unbiased next-generation sequencing of RNA (RNA-seq) as a diagnostic method in influenza virus-positive respiratory samples. J Clin Microbiol 53:2238–2250. doi: 10.1128/JCM.02495-14. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Lim YW, Schmieder R, Haynes M, Willner D, Furlan M, Youle M, Abbott K, Edwards R, Evangelista J, Conrad D, Rohwer F. 2013. Metagenomics and metatranscriptomics: windows on CF-associated viral and microbial communities. J Cyst Fibros 12:154–164. doi: 10.1016/j.jcf.2012.07.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Schmidt K, Mwaigwisya S, Crossman LC, Doumith M, Munroe D, Pires C, Khan AM, Woodford N, Saunders NJ, Wain J, O’Grady J, Livermore DM. 2017. Identification of bacterial pathogens and antimicrobial resistance directly from clinical urines by nanopore-based metagenomic sequencing. J Antimicrob Chemother 72:104–114. doi: 10.1093/jac/dkw397. [DOI] [PubMed] [Google Scholar]
  • 15.Pendleton KM, Erb-Downward JR, Bao Y, Branton WR, Falkowski NR, Newton DW, Huffnagle GB, Dickson RP. 2017. Rapid pathogen identification in bacterial pneumonia using real-time metagenomics. Am J Respir Crit Care Med 196:1610–1612. doi: 10.1164/rccm.201703-0537LE. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Wilson MR, Suan D, Duggins A, Schubert RD, Khan LM, Sample HA, Zorn KC, Rodrigues Hoffman A, Blick A, Shingde M, DeRisi JL. 2017. A novel cause of chronic viral meningoencephalitis: Cache Valley virus. Ann Neurol 82:105–114. doi: 10.1002/ana.24982. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Doan T, Wilson MR, Crawford ED, Chow ED, Khan LM, Knopp KA, O’Donovan BD, Xia D, Hacker JK, Stewart JM, Gonzales JA, Acharya NR, DeRisi JL. 2016. Illuminating uveitis: metagenomic deep sequencing identifies common and rare pathogens. Genome Med 8:90. doi: 10.1186/s13073-016-0344-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Doan T, Acharya NR, Pinsky BA, Sahoo MK, Chow ED, Banaei N, Budvytiene I, Cevallos V, Zhong L, Zhou Z, Lietman TM, DeRisi JL. 2017. Metagenomic DNA sequencing for the diagnosis of intraocular infections. Ophthalmology 124:1247–1248. doi: 10.1016/j.ophtha.2017.03.045. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Zaki AM, van Boheemen S, Bestebroer TM, Osterhaus ADME, Fouchier RAM. 2012. Isolation of a novel coronavirus from a man with pneumonia in Saudi Arabia. N Engl J Med 367:1814–1820. doi: 10.1056/NEJMoa1211721. [DOI] [PubMed] [Google Scholar]
  • 20.Jain M, Olsen HE, Paten B, Akeson M. 2016. The Oxford Nanopore MinION: delivery of nanopore sequencing to the genomics community. Genome Biol 17:239. doi: 10.1186/s13059-016-1103-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Flygare S, Simmon K, Miller C, Qiao Y, Kennedy B, Di Sera T, Graf EH, Tardif KD, Kapusta A, Rynearson S, Stockmann C, Queen K, Tong S, Voelkerding KV, Blaschke A, Byington CL, Jain S, Pavia A, Ampofo K, Eilbeck K, Marth G, Yandell M, Schlaberg R. 2016. Taxonomer: an interactive metagenomics analysis portal for universal pathogen detection and host mRNA expression profiling. Genome Biol 17:111. doi: 10.1186/s13059-016-0969-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Rutjes AWS, Reitsma JB, Coomarasamy A, Khan KS, Bossuyt PMM. 2007. Evaluation of diagnostic tests when there is no gold standard. A review of methods. Health Technol Assess 11:iii, ix–51. [DOI] [PubMed] [Google Scholar]
  • 23.Huang GT, Tsamardinos I, Raghu V, Kaminski N, Benos PV. 2015. T-ReCS: stable selection of dynamically formed groups of features with application to prediction of clinical outcomes. Pac Symp Biocomput 2015:431–442. [PMC free article] [PubMed] [Google Scholar]
  • 24.Calfee CS, Delucchi K, Parsons PE, Thompson BT, Ware LB, Matthay MA, NHLBI ARDS Network . 2014. Subphenotypes in acute respiratory distress syndrome: latent class analysis of data from two randomised controlled trials. Lancet Respir Med 2:611–620. doi: 10.1016/S2213-2600(14)70097-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Kitsios GD, Kent DM. 2012. Personalised medicine: not just in our genes. BMJ 344:e2161. doi: 10.1136/bmj.e2161. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from mSystems are provided here courtesy of American Society for Microbiology (ASM)

RESOURCES