Abstract
Background
Metagenomics next-generation sequencing (mNGS) has been increasingly used in the clinic, which provides a powerful tool for the etiological diagnosis of infectious diseases. Precise treatment can be carried out according to the positive mNGS results. However, the role of negative results of mNGS remains poorly defined in clinical practice.
Methods
The results of 1,021 samples from patients who received the mNGS test at Zhongshan Hospital, Fudan University, between January 2019 and December 2019 were analyzed.
Results
There were 308 samples (30.17%) of negative results included in the current study. The top 2 types of negative samples were blood (130/308) and tissue (63/308), which also accounted for the highest negative proportion in diseases. Sputum and bronchoalveolar lavage fluid (BALF) were more likely to have positive results. In false-negative results (defined as negative in mNGS test but reported positive in other sample types or assays), 118 samples were found when compared to regular microbiological assays. The negative predictive value (NPV) of mNGS was 95.79% [95%CI, 93.8%–97.8%] as compared to culture and smear. Mycobacterium, Aspergillus, and Mycoplasma ranked as the top 3 microorganisms on the undetected pathogen list.
Conclusions
The present data indicate that when the mNGS test is negative, the negative prediction accuracy rate of the original specimen is significant. However, other laboratory assays results and clinical presentations should always be carefully considered prior to drawing a diagnosis.
Keywords: metagenomics next-generation sequencing (mNGS), false negative, clinical practice, true negative, sample type
Introduction
Infectious diseases are caused by a variety of pathogens, which lead to systemic or local inflammation (Honda and Littman, 2012) with significant mortalities (Lozano et al., 2012). As the clinical manifestations of infectious diseases are diverse, an accurate clinical diagnosis is challenging when a pathogen is unknown (Simner et al., 2018).
With the development of gene detection technology, metagenomics next-generation sequencing (mNGS) has been increasingly used in the clinic, which provides a powerful tool for the etiological diagnosis of infectious diseases (Chiu and Miller, 2019). As it directly extracts all microbial nucleic acids from clinical samples, mNGS theoretically meets the detection needs of all microorganisms in one detection (Goldberg et al., 2015; Li et al., 2021). Through unbiased and full coverage sequencing technology, the acquired sequence information is compared with a microbial database to obtain the specific species and relative content of microorganisms (Miao et al., 2018). Compared with the conventional culture assay, mNGS is less time-consuming, not limited by culture conditions, and capable of detecting those pathogens that are difficult to culture (Kitsios et al., 2018).
When the mNGS test is positive, precise treatment could be carried out soundly according to the actual clinical situation. However, the role of negative results of mNGS remains poorly defined in clinical practice. As such, the present study is aimed to evaluate the clinical value of negative mNGS results and to provide evidence for its proper applications.
Methods
Study Subjects
A total of 1,021 samples from hospitalized patients who received mNGS test at Zhongshan Hospital, Fudan University, from January 2019 to December 2019 were collected and reviewed. Results of regular clinical assays of these samples were also collected at the same time. The study was approved by the institutional review board of Zhongshan Hospital, Fudan University (#B2021-694R). Written informed consent was obtained from each patient prior to the enrollment.
Metagenomics Next-Generation Sequencing Test
Samples were collected at standard procedures according to their various types including blood, sputum, bronchoalveolar lavage fluid (BALF), and tissue. Nucleic acid was extracted and fragmented into DNA fragments, and then these fragments were end-repaired, barcoded, and amplified to be qualified libraries. Libraries were sequenced on the BGISEQ-50 platform. Sequencing data were compared to human references, then human sequence reads were removed, and nonhuman sequence reads were further filtered and compared to databases (bacteria, fungi, and parasite databases). Final data including stringent mapped reads number (SMRN), coverage rate (CovRate), relative abundance (Re_Abu), and sequencing depth were analyzed and reported.
Statistical Analysis
Continuous data are shown as mean values ± SE. Student’s t-test was used to measure the differences in variables, where appropriate. Data analysis was performed using SPSS 16.0 software. p-Values <0.05 were considered significant, and all tests were two-tailed.
Results
Sample Characteristics
A total of 1,021 samples were included in the current study, with 713 samples (69.83%) of positive results and 308 samples (30.17%) of negative results ( Table 1 ). Reports that only with colonization or background microorganisms were considered negative. The sample type distribution of all negative samples is listed in Figure 1A . The most common negative sample type was blood (130/308, 42.2%). Tissue, including lung tissue, bone tissue, lymph node tissue, valve tissue, and skin tissue, ranked second (63/308, 20.5%). Other sample types included BALF, sputum, pleural fluid, cerebrospinal fluid (CSF), ascetic fluid, pericardial fluid, pus, swab, joint fluid, and drainage fluid. The negative rate was calculated in each sample type (sample numbers >10) and shown in Figure 1B . Pleural fluid (54.55%), ascetic fluid (42.86%), and blood (38.12%) ranked the top 3, and pus (9.68%) ranked the last.
Table 1.
Sample type | Negative mNGS cases | Positive mNGS cases |
---|---|---|
Blood | 130 (42.2%) | 211 (29.6%) |
Tissue | 63 (20.45%) | 136 (19.1%) |
BALF | 33 (10.7%) | 125 (17.5%) |
Sputum | 28 (9%) | 131 (18.4%) |
Pleural fluid | 24 (7.79%) | 20 (2.8%) |
CSF | 12 (3.9%) | 26 (3.6%) |
Ascitic fluid | 6 (1.95%) | 8 (1.12%) |
Pericardial fluid | 4 (1.3%) | 3 (0.42%) |
Pus | 3 (1%) | 28 (3.92%) |
Swab | 3 (1%) | 8 (1.12%) |
Joint fluid | 1 (0.3%) | 0 (0.00%) |
Drainage fluid | 1 (0.3%) | 3 (0.42%) |
Bile | 0 (0.00%) | 5 (0.7%) |
Stool | 0 (0.00%) | 1 (0.14%) |
Urine | 0 (0.00%) | 8 (1.12%) |
Total | 308 | 713 |
mNGS, metagenomics next-generation sequencing; BALF, bronchoalveolar lavage fluid; CSF, cerebrospinal fluid.
Blood and tissue accounted for the highest negative proportion in different common infectious diseases as listed in Figure 2 . For instance, blood accounted for 79.27% (65/82) in a fever of unknown origin and 67.74% (21/31) in digestive system diseases. Tissue accounted for 90% (9/10) in lymph node enlargement and 69.23% (9/13) in orthopedic diseases.
Concordance of Negative Result Between Metagenomics Next-Generation Sequencing and Conventional Assays
In order to study the influence of sample type on mNGS results, true negative (TN) and false negative (FN) were defined. Laboratory results that were negative in all sample types and all assays were defined as TN, and laboratory results that were positive in some sample types or some assays were defined as FN. Conventional assays included in our study were culture, smear, TSPOT.TB (TSPOT), cryptococcal antigen (CrAg), immunoassay, 1-3-β-d-glucan test (G test), and galactomannan test (GM test). In addition, parasite detection was all negative in all samples suspected of parasite infection, so it was not listed. All the results of other conventional assays were collected and sampled at the same time as mNGS. However, the paired-culture test was the basic premise of the comparison. Therefore, 23 cases were excluded because they had no paired-culture results. The remaining 285 cases were further classified in Table 2 according to TN and FN. Common colonization pathogens detected in conventional assays were also considered to be negative results.
Table 2.
Definition | Number of cases | |
---|---|---|
True negative | Laboratory negative in all sample types and all assays | 167 (58.6%) |
False negative | Laboratory positive in some sample types or some assays | 118 (41.4%) |
According to the definition and statistical results, TN was 58.6% (167/285) and FN was 41.4% (118/285). FN positively differed among culture and smear in the same specimen, culture, smear, and mNGS of other sample types and other assays as listed in Table 3 . One case might have several positive results.
Table 3.
False-negative classification | Cases |
---|---|
Culture and smear of same specimen | |
Culture positive in the same specimen | 12 |
Other sample types | |
Culture positive in other sample types | 26 |
Smear positive in other sample types | 1 |
mNGS positive in other sample types | 22 |
Other assays | |
TSPOT | 48 |
CrAg | 3 |
Immunoassay | 25 |
G test | 2 |
GM test | 8 |
mNGS, metagenomics next-generation sequencing; TSPOT, TSPOT.TB; CrAg, cryptococcal antigen; G test, 1-3-β-d-glucan test; GM test, galactomannan test.
Negative Predictive Value of Metagenomics Next-Generation Sequencing
Among FN cases, there were 12 paired-culture positive cases ( Figure 3 ). As compared with culture, which is the gold standard in pathogen detection, the negative predictive value (NPV) of mNGS was 273/285 = 95.79% [95%CI, 93.8%–97.8%]. With the removal of the six cases that were detected in a database or shown in the colonization (pathogenicity is not considered even if SMRN is high) or background (common contaminating pathogens in the laboratory) list, the NPV of mNGS could be increased to 279/285 = 97.89% (95%CI, 95.9%–99.8%), as detailed in Table 4 . Among them, Pseudomonas aeruginosa detected in sample 21 was in the colonized microorganism list, and Staphylococcus epidermidis detected in sample 203 was in the background list. Staphylococcus aureus in sample 38, P. aeruginosa in sample 118, Staphylococcus hominis in sample 153, and Actinomyces in sample 178 were not shown in the report but could be found in the database.
Table 4.
Culture result | mNGS result | |||||||
---|---|---|---|---|---|---|---|---|
Sample ID | Type | Culture result | CovRate | Depth | Re_Abu | Genus_Re_Abu | SMRN | SMRNG |
21 | BALF | Pseudomonas aeruginosa | 0.2029 | 1 | 2.59 | 37.36 | 232 | 1855 |
26 | Tissue | Mycobacterium tuberculosis | 0 | 0 | 0 | 0 | 0 | 0 |
35 | BALF | M. tuberculosis | 0 | 0 | 0 | 0 | 0 | 0 |
38 | Sputum | Staphylococcus aureus | 0.0017 | 1 | 0.01 | 0.07 | 1 | 1 |
118 | BALF | P. aeruginosa | 0.0081 | 1 | 0.46 | 0.9 | 10 | 14 |
120 | Drainage fluid | P. aeruginosa | 0 | 0 | 0 | 0 | 0 | 0 |
153 | Pleural fluid | Staphylococcus hominis | 0.0044 | 1 | 0.58 | 1.6 | 1 | 3 |
178 | Tissue | Actinomyces | 0.0016 | 1 | 0.31 | 2 | ||
186 | Ascitic fluid | M. tuberculosis | 0 | 0 | 0 | 0 | 0 | 0 |
203 | Pleural fluid | Staphylococcus epidermidis | 0.0019 | 1 | 1.51 | 6.44 | 1 | 1 |
248 | Blood | Cryptococcus humicolus | 0 | 0 | 0 | 0 | 0 | 0 |
266 | Tissue | Corynebacterium afermentans | 0 | 0 | 0 | 0 | 0 | 0 |
mNGS, metagenomics next-generation sequencing; BALF, bronchoalveolar lavage fluid; CovRate, coverage rate; Re_Abu, relative abundance; SMRN, stringent mapped reads number at species level; SMRNG, stringent mapped reads number at genus level.
Impact of Sample Type and Distribution of Undetected Pathogens
As shown in Table 3 , there were 26 culture positive cases, 1 smear positive case, and 22 mNGS positive cases in other sample types. In terms of blood and tissue that had high negative rates, respiratory samples including sputum and BALF were more likely to have positive results ( Figure 4 ).
In addition to culture, other assays commonly used in clinics include TSPOT for Mycobacterium tuberculosis, CrAg for Cryptococcus, G test and GM test for fungus, and immunoassay for mycoplasma, Legionella, etc. There were 48 cases that were positive in the TSPOT test, but in the mNGS test, no Mycobacterium was detected in these cases, even in the database. G test and GM test were effectively used to detect Aspergillus (Li et al., 2019), and immunoassay was effective for Mycoplasma detection (Parker et al., 2018). These three pathogens were in the top 3 in the undetected pathogen list shown in Figure 5 . In addition, there were 3 cases reported positive in CrAg and 1 case reported Cryptococcus positive in blood culture. Furthermore, there was a case of Rickettsia detection in immunoassay, and no sequence was detected in mNGS.
Comparison of Experimental Data and Infection Indexes Between True-Negative and False-Negative Samples
In order to further exclude the influence of FN from the laboratory, we collected the experimental data of all the negative samples. The data collected cover the whole process of mNGS, including DNA concentration, library concentration, total sequence, and host sequence ratio. Bur for some sample types, since the total amount of the sample type is small, it is not statistically significant and is not included. The comparison of blood, tissue, BALF, sputum, and pleural fluid is shown in Figure 6 . In the DNA extraction step, DNA concentration was significantly lower in FN samples than in TN samples in sputum. In the library construction step, library concentration was lower in FN samples than in TN samples in blood. However, in the last laboratory step, sequencing, neither the total sequence nor the host sequence ratio had a significant difference between TN and FN.
In addition, infection indexes include leukocyte (WBC), neutrophil (Neut), lymphocyte (Lymph), eosinophilia (EO), C-reactive protein (CRP), procalcitonin (PCT), interleukin-6 (IL-6), and erythrocyte sedimentation rate (ESR) of all the negative samples were collected. The disease groups with insufficient data for statistical analysis were removed. The comparison of WBC, Neut, Lymph, and EO between TN and FN is shown in Figure 7A , and CRP, PCT, IL-6, and ESR are shown in Figure 7B . No significant difference was observed between TN and FN.
Discussion
In the present study, 1,021 mNGS reports were analyzed to evaluate the role of mNGS in clinical practice, in particular when the results were negative. The overall negative rate was 30.17%. Blood and tissue had the most frequent negative reports, accounting for 42.21% and 20.45%, respectively. According to the negative rate of all samples, blood (38.12%) and tissue (31.66%) also accounted for the third and fourth place of the negative rate. In addition, according to the distribution of diseases, the negative proportion of blood and tissue in various diseases was greater than that of other sample types.
Although the negative result rates of blood and tissue were high, compared with culture and smear, the NPV of mNGS reached 95.79% (95%CI, 93.8%–97.8%) in the current study, which implies that when a negative mNGS result is reported, the negative prediction accuracy rate of the original specimen is high. The NPV of another study was 100% (95%CI, 71.7%–100%) for bacteria, 72.7% (95%CI, 39.3%–92.7%) for fungi, and 100% (95%CI, 76%–100%) for M. tuberculosis in mNGS vs. culture and smear (Li et al., 2018). However, when other assays, such as TSPOT, were added to the NPV comparison, the proportion of undetected M. tuberculosis increased significantly. In our study, only 2 cases were cultured M. tuberculosis positive in the same specimen, 2 cases were culture positive, and 1 case was smear positive in other sample types; however, 48 cases were TSPOT positive. A positive TSPOT may merely due to the manifestation of old tuberculosis (Ma et al., 2019), especially when its mNGS test is negative. Hence, it is recommended that when a specific infection is suspected in the clinic, other proper assays should also be used as combined diagnostic measures.
Some pathogens with low SMRN or SMRNG were excluded in the report, and some pathogens were identified as colonized or background microorganisms. When the report is negative and there is a suspected specific pathogen infection in the clinic, it can be traced back to the original database for a query.
The causes of FN both in the clinic and in the laboratory were analyzed. The first is the selection of sample types in the clinic. Clinicians should have a comprehensive consideration of the sample type for the mNGS test including the clinical symptoms, the location, and the type of the infection (Liu et al., 2019). However, blood and tissue samples should be avoided if there are other sample types available for selection. If there are indications of respiratory tract infection, we recommend respiratory tract samples for the mNGS test. The negative rates of sputum (17.61%) and BALF (20.89%) were much lower than those of other sample types in our study. Moreover, the false-negative samples of blood and tissue were reanalyzed, and the data showed that when both culture and mNGS were negative when sputum and BALF samples were sent for detection, the positive rate would be significantly increased. Furthermore, in the case of unknown pathogen infection, selecting multiple sample types for combined detection is recommended (Wang et al., 2020).
Second, the correlation between the status of infection and FN was explored. Complete blood count, CRP, PCT, IL-6, and ESR were collected on the day of examination of mNGS to determine the differences between FN and TN. There were no statistical differences between these two groups, which was consistent with another study (Duan et al., 2021). The data of the infection indexes showed that the samples with a clinical diagnosis of respiratory disease tended to be non-infectious diseases in mNGS samples. Therefore, the differential diagnosis (tumor, autoimmune diseases, etc.) should be considered in the clinical practice (Consensus Group Of Experts On Application Of Metagenomic Next Generation Sequencing In The Pathogen Diagnosis In Clinical M, Severe I, Professional Committee Of S, Shock Chinese Research Hospital A, Professional Committee Of Microbial Toxins Chinese Society For M, Professional Committee Of Critical Care Medicine Shenzhen Medical A, 2020).
Third, the experimental data were compared to analyze the false-negative results in the experiment. There were differences between FN and TN groups in DNA concentration of sputum and library concentration of blood. When there is lower DNA concentration in sputum samples and lower library concentration in blood emerged, we should be vigilant. The experimental steps should first make sure that each step is double-checked. When it turned into a negative report, it should be returned to the clinic, and clinicians should be reminded to make a comprehensive diagnosis and judgment. There were no statistical differences between FN and TN groups in the sequencing step. Therefore, increasing the amount of data is meaningless for false-negative samples. Moreover, the host sequence ratio had no reference significance in the judgment of false negatives.
Furthermore, Mycobacterium and Aspergillus were found to be the two most undetected pathogens. A possible explanation is that the cell walls of these pathogens were both thick and elaborate (Alderwick et al., 2015; Gow et al., 2017). It implies that before DNA extraction, precaution should be observed for the step of cell wall broken to obtain optical results.
Some limitations exist in our study. First, the definition of negative and positive in the study is limited to laboratory results, without clinical verification. Second, the laboratory results of bacteria, fungi, and parasites were analyzed in this study. Although viruses can be divided into DNA viruses and RNA viruses, the mNGS test in the current study only collected the result of DNA, as RNA viruses would degrade and could not be detected (Chen et al., 2020). Therefore, virus research was not included in the present study. Third, since prior antibiotic exposure has been reported to have less impact on the results of the mNGS test, the impact of antibiotics was not examined in study (Miao et al., 2018).
In conclusion, the present study showed that when the mNGS result is negative, the negative prediction accuracy rate of the original specimen is significant. However, other laboratory results and clinical presentations should always be carefully considered prior to the diagnosis.
Data Availability Statement
The original contributions presented in the study are included in the article/supplementary material. Further inquiries can be directed to the corresponding authors.
Ethics Statement
The studies involving human participants were reviewed and approved by Zhongshan Hospital, Fudan University. The patients/participants provided their written informed consent to participate in this study.
Author Contributions
MQ, BZ, XW, and YC conceived the study. BZ, YZ, LW, QS, MZ, and LY performed the experiments and analyzed the data. MQ, DW, HC, XW, and YC performed the literature review and drafted and revised the manuscript. All authors read and approved the final manuscript.
Funding
This work was supported by grants from the Program of Shanghai Academic/Technology Researcher leader (20XD1401000), Key Subject Construction Program of Shanghai Health Administrative Authority (ZK2019B30), the Shanghai Engineering Research Center of Tumor Multi-Target Gene Diagnosis (20DZ2254300), and Innovation Project funded by Science and Technology Commission of Jinshan District (2018-3-5). All authors obtained permission to acknowledge all those mentioned in the Acknowledgments.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
This study was conducted at the Institute of Clinical Science of Zhongshan Hospital, Fudan University. We sincerely thank all the staff and participants for their important contributions.
References
- Alderwick L. J., Harrison J., Lloyd G. S., Birch H. L. (2015). The Mycobacterial Cell Wall–Peptidoglycan and Arabinogalactan. Cold Spring Harb. Perspect. Med. 5 (8), a021113. doi: 10.1101/cshperspect.a021113 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chen L, Liu W., Zhang Q., Xu K., Ye G., Wu W., et al. (2020). RNA Based mNGS Approach Identifies a Novel Human Coronavirus From Two Individual Pneumonia Cases in 2019 Wuhan Outbreak. Emerg. Microbes Infect. 9 (1), 313–319. doi: 10.1080/22221751.2020.1725399 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chiu C. Y., Miller S. A. (2019). Clinical Metagenomics. Nat. Rev. Genet. 20 (6), 341–355. doi: 10.1038/s41576-019-0113-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Consensus Group Of Experts On Application Of Metagenomic Next Generation Sequencing In The Pathogen Diagnosis In Clinical M, Severe I, Professional Committee Of S, Shock Chinese Research Hospital A, Professional Committee Of Microbial Toxins Chinese Society For M, Professional Committee Of Critical Care Medicine Shenzhen Medical A . (2020). [Expert Consensus for the Application of Metagenomic Next Generation Sequencing in the Pathogen Diagnosis in Clinical Moderate and Severe Infections (First Edition)]. Zhonghua. Wei. Zhong. Bing. Ji. Jiu. Yi. Xue. 32 (5), 531–536. doi: 10.3760/cma.j.cn121430-20200228-00095 [DOI] [PubMed] [Google Scholar]
- Duan H., Li X., Mei A., Li P., Liu Y., Li X., et al. (2021). The Diagnostic Value of Metagenomic Next Rectanglegeneration Sequencing in Infectious Diseases. BMC Infect. Dis. 21 (1), 62. doi: 10.1186/s12879-020-05746-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Goldberg B., Sichtig H., Geyer C., Ledeboer N., Weinstock G. M. (2015). Making the Leap From Research Laboratory to Clinic: Challenges and Opportunities for Next-Generation Sequencing in Infectious Disease Diagnostics. mBio 6 (6), e01888-01815. doi: 10.1128/mBio.01888-15 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gow N. A. R., Latge J. P., Munro C. A. (2017). The Fungal Cell Wall: Structure, Biosynthesis, and Function. Microbiol. Spectr. 5 (3), 1–25. doi: 10.1128/9781555819583.ch12 [DOI] [PubMed] [Google Scholar]
- Honda K., Littman D. R. (2012). The Microbiome in Infectious Disease and Inflammation. Annu. Rev. Immunol. 30, 759–795. doi: 10.1146/annurev-immunol-020711-074937 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kitsios G. D., Fitch A., Manatakis D. V., Rapport S. F., Li K., Qin S., et al. (2018). Respiratory Microbiome Profiling for Etiologic Diagnosis of Pneumonia in Mechanically Ventilated Patients. Front. Microbiol. 9, 1413. doi: 10.3389/fmicb.2018.01413 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Li N., Cai Q., Miao Q., Song Z., Fang Y., Hu B. (2021). High-Throughput Metagenomics for Identification of Pathogens in the Clinical Settings. Small. Methods 5 (1), 2000792. doi: 10.1002/smtd.202000792 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Li H., Gao H., Meng H., Wang Q., Li S., Chen H., et al. (2018). Detection of Pulmonary Infectious Pathogens From Lung Biopsy Tissues by Metagenomic Next-Generation Sequencing. Front. Cell Infect. Microbiol. 8, 205. doi: 10.3389/fcimb.2018.00205 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Li H., Rui Y., Zhou W., Liu L., He B., Shi Y., et al. (2019). Role of the Aspergillus-Specific IgG and IgM Test in the Diagnosis and Follow-Up of Chronic Pulmonary Aspergillosis. Front. Microbiol. 10, 1438. doi: 10.3389/fmicb.2019.01438 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Liu N., Kan J., Cao W., Cao J., Jiang E., Zhou Y., et al. (2019). Metagenomic Next-Generation Sequencing Diagnosis of Peripheral Pulmonary Infectious Lesions Through Virtual Navigation, Radial EBUS, Ultrathin Bronchoscopy, and ROSE. J. Int. Med. Res. 47 (10), 4878–4885. doi: 10.1177/0300060519866953 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lozano R., Naghavi M., Foreman K., Lim S., Shibuya K., Aboyans V., et al. (2012). Global and Regional Mortality From 235 Causes of Death for 20 Age Groups in 1990 and 2010: A Systematic Analysis for the Global Burden of Disease Study 2010. Lancet 380 (9859), 2095–2128. doi: 10.1016/S0140-6736(12)61728-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ma Y., Li R., Shen J., He L., Li Y., Zzhang N., et al. (2019). Clinical Effect of T-SPOT.TB Test for the Diagnosis of Tuberculosis. BMC Infect. Dis. 19 (1), 993. doi: 0.1186/s12879-019-4597-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Miao Q., Ma Y., Wang Q., Pan J., Zhang Y., Jin W., et al. (2018). Microbiological Diagnostic Performance of Metagenomic Next-Generation Sequencing When Applied to Clinical Practice. Clin. Infect. Dis. 67 (suppl_2), S231–S240. doi: 10.1093/cid/ciy693 [DOI] [PubMed] [Google Scholar]
- Parker A. M., Sheehy P. A., Hazelton M. S., Bosward K. L., House J. K. (2018). A Review of Mycoplasma Diagnostics in Cattle. J. Vet. Intern. Med. 32 (3), 1241–1252. doi: 10.1111/jvim.15135 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Simner P. J., Miller S., Carroll K. C. (2018). Understanding the Promises and Hurdles of Metagenomic Next-Generation Sequencing as a Diagnostic Tool for Infectious Diseases. Clin. Infect. Dis. 66 (5), 778–788. doi: 10.1093/cid/cix881 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang Q., Wu B., Yang D., Yang C., Jin Z., Cao J., et al. (2020). Optimal Specimen Type for Accurate Diagnosis of Infectious Peripheral Pulmonary Lesions by mNGS. BMC Pulm. Med. 20 (1), 268. doi: 10.1186/s12890-020-01298-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The original contributions presented in the study are included in the article/supplementary material. Further inquiries can be directed to the corresponding authors.