Blood culture (BC) often fails to detect bloodstream microorganisms in sepsis. However, molecular diagnostics hold great potential. The molecular method PCR/electrospray ionization-mass spectrometry (PCR/ESI-MS) can detect DNA from hundreds of different microorganisms in whole blood. The aim of the present study was to evaluate the performance of this method in a multicenter study including 16 teaching hospitals in the United States (n = 13) and Europe (n = 3).
KEYWORDS: sepsis, bacteremia, direct detection, PCR/ESI-MS
ABSTRACT
Blood culture (BC) often fails to detect bloodstream microorganisms in sepsis. However, molecular diagnostics hold great potential. The molecular method PCR/electrospray ionization-mass spectrometry (PCR/ESI-MS) can detect DNA from hundreds of different microorganisms in whole blood. The aim of the present study was to evaluate the performance of this method in a multicenter study including 16 teaching hospitals in the United States (n = 13) and Europe (n = 3). First, on testing of 2,754 contrived whole blood samples, with or without spiked microorganisms, PCR/ESI-MS produced 99.1% true-positive and 97.2% true-negative results. Second, among 1,460 patients with suspected sepsis (sepsis-2 definition), BC and PCR/ESI-MS on whole blood were positive in 14.6% and 25.6% of cases, respectively, with the following result combinations: BC positive and PCR/ESI-MS negative, 4.3%; BC positive and PCR/ESI-MS positive, 10.3%; BC negative and PCR/ESI-MS positive, 15.3%; and BC negative and PCR/ESI-MS negative, 70.1%. Compared with BC, PCR/ESI-MS showed the following sensitivities (coagulase-negative staphylococci not included): Gram-positive bacteria, 58%; Gram-negative bacteria, 78%; and Candida species, 83%. The specificities were >94% for all individual species. Patients who had received prior antimicrobial medications (n = 603) had significantly higher PCR/ESI-MS positivity rates than patients without prior antimicrobial treatment—31% versus 22% (P < 0.0001)—with pronounced differences for Gram-negative bacteria and Candida species. In conclusion, PCR/ESI-MS showed excellent performance on contrived samples. On clinical samples, it showed high specificities, moderately high sensitivities for Gram-negative bacteria and Candida species, and elevated positivity rates during antimicrobial treatment. These promising results encourage further development of molecular diagnostics to be used with whole blood for detection of bloodstream microorganisms in sepsis.
INTRODUCTION
The World Health Organization (WHO) recently recognized sepsis as a global health priority, as it is a common and severe disease that can often be cured with adequate treatment, including appropriate antimicrobial therapy (1, 2). In order to enable targeted antimicrobial therapy with maximum effect and avoid unnecessary use of broad-spectrum antimicrobials, the microbiological diagnosis of sepsis should be established (3). However, even in patients with known bacterial sepsis, blood culture (BC) often provides negative results (4). For improved detection of bloodstream pathogens, a number of commercial molecular methods have been developed (5). Unfortunately, most methods are limited by a narrow spectrum of detectable microorganisms (e.g., the T2Bacteria panel [T2 Biosystems]) (6) or suboptimal sensitivity (e.g., the LightCycler SeptiFast test [Roche]) or specificity (e.g., the Magicplex sepsis real-time test [Seegene] and the Karius test [Karius]) (5, 7).
Based on the PCR/electrospray ionization-mass spectrometry (PCR/ESI-MS) technology, Abbott (Carlsbad, CA) developed the IRIDICA BAC BSI assay, which has the capacity to detect DNA from >200 different microorganisms in whole-blood samples (8). Clinical diagnostic studies have shown promising results, with PCR/ESI-MS-positive detections typically exceeding BC-positive results (9, 10). However, the previous studies of PCR/ESI-MS on whole blood have been too small to enable evaluation on individual microorganisms and to compare the performance of the method on samples from patients with and without prior antimicrobial medication (11).
The aims of the present study were (i) to test PCR/ESI-MS on blood samples spiked with known microorganisms (contrived specimens) and (ii) to compare PCR/ESI-MS with BC on whole blood from patients with suspected sepsis in a large multicenter study. The study was the basis for an application to the U.S. Food and Drug Administration (FDA) regarding the IRIDICA BAC BSI assay. However, Abbott withdrew the FDA application and ceased producing IRIDICA instruments and IRIDICA test kits in 2017.
MATERIALS AND METHODS
Study design and settings.
This was a prospective, multicenter, observational cohort study, with patients enrolled and samples collected from December 2014 through March 2016 at 16 teaching hospitals in three countries: United States (n = 13; Baylor College of Medicine, Houston, TX; Harbor-UCLA Medical Center, Torrance, CA; Henry Ford Hospital, Detroit, MI; Johns Hopkins Hospital, Baltimore, MD; Kern Medical Center, Bakersfield, CA; Maricopa Medical Center, Phoenix, AZ; New York Methodist Hospital, New York, NY; Olive View-UCLA Medical Center, Sylmar, CA; eStudySite, Sharp Chula Vista, San Diego, CA; Truman Medical Center, Kansas City, MO; Beaumont Hospital, Royal Oak, MI; University of Alabama, Birmingham, AL; and University of Washington, Seattle, WA); Sweden (n = 2; Karolinska University Hospital, Stockholm, and Örebro University, Örebro); and the United Kingdom (n = 1; University College London Hospitals, London).
The study also included four clinical testing sites, each with an installed IRIDICA PCR/ESI-MS system, that included Johns Hopkins Hospital, Baltimore, MD, USA; Karolinska University Hospital, Stockholm, Sweden; med fusion, Lewisville, TX, USA; and AthoGen Testing, Carlsbad, CA, USA.
Clinical whole-blood samples from enrolled study patients were collected and stored at −70°C and later sent to the clinical testing sites for analysis by PCR/ESI-MS (IRIDICA BAC BSI). In addition, the clinical testing sites also analyzed contrived specimens with PCR/ESI-MS.
Contrived whole-blood specimens.
EDTA-containing whole-blood lots were collected by Ibis Biosciences (Abbott) from 110 healthy adults, 500 ml from each subject. The whole-blood lots were prescreened for contaminating bacterial DNA using the IRIDICA BAC BSI assay, and contaminated lots were excluded. Each whole-blood lot was split into aliquots of 5 ml that were spiked with culture-quantified stocks of 50 different microorganisms (see Table S1 in the supplemental material).
For each microorganism, the limit of detection (LOD) was determined. Whole-blood aliquots were spiked with microorganisms at 3 to 10 different concentrations (5 samples at each concentration). The lowest concentrations for which all samples were PCR/ESI-MS positive were then used in a confirmation analysis of additionally 20 spiked samples. The confirmed LOD was defined as the lowest concentration (in CFU per milliliter) for which the detection rate was at least 95% (minimum of 19/20 valid replicates). In Table S1, the confirmed LOD of 50 microorganisms are presented.
It is well known that the concentration of bacteria in the bloodstream varies among patients with bloodstream infection (12). Thus, in order to reflect a patient scenario with different bloodstream concentrations of microorganisms, whole-blood aliquots were spiked to the following target levels: 1.5× LOD (25 aliquots), 3× LOD (15 aliquots), and 10× LOD (10 aliquots). Altogether, 50 contrived blood samples of each of 50 microorganisms were made, totaling 2,500 specimens.
In addition, from the prescreened EDTA whole-blood lots from healthy adults described above, Ibis Biosciences provided 254 specimens without spiked microorganisms (negative contrived specimens).
Patients.
Patients aged ≥6 years who presented to the emergency department or who were being cared for in the hospital’s intensive care unit (ICU) or other similar units with suspected sepsis according to the sepsis-2 definition, i.e., suspected bloodstream infection and a diagnosis of systemic inflammatory response syndrome (SIRS) (13), motivating standard-of-care BC, were eligible for inclusion. The SIRS diagnosis required at least two of the following SIRS criteria: body temperature of >38°C or < 36°C, heart rate of >90 beats/minute, respiratory rate of >20/min or a partial CO2 pressure of <32 mm Hg, and white blood cell count of >12,000 cells/μl or <4,000 cells/μl. The single exclusion criterion was previous enrollment in the study. Data on antimicrobial medication taken within 14 days prior to enrollment were collected from each patient’s record by chart review shortly after enrollment.
From each study patient, at least 10 ml whole blood was collected in 1 or 2 EDTA tubes for testing with PCR/ESI-MS, concurrently with standard-of-care BC.
PCR/ESI-MS.
PCR/ESI-MS (IRIDICA BAC BSI) was performed at the clinical testing sites according to the manufacturer's instructions. The assay was designed to identify unique DNA sequences from >200 different bacteria and fungi for species-level identification, as well as the antibiotic resistance markers mecA, vanA, vanB, and blaKPC. A negative control was included in every run, and a positive control was included at least once per day of analysis. Four different positive controls, supplied by ZeptoMetrix Corporation (Buffalo, NY), were used on a rotating basis, i.e., whole-blood samples spiked with either methicillin-resistant Staphylococcus aureus (MRSA) bundled with Candida albicans, vancomycin-resistant Enterococcus faecium (VRE), vancomycin-resistant Enterococcus faecalis, or carbapenem-resistant Klebsiella pneumoniae (KPC). The analytic procedure was run in two separate rooms, one room for sample preparation and DNA extraction and the other room for PCR, desalting, and mass spectrometry. Assay turnaround time was approximately 8 h, and system throughput was 5 patient samples at a time, permitting a maximum of 15 samples per 24 h. Operating the IRIDICA system required one full-time laboratory technologist.
Briefly, 5 ml of whole blood was lysed using the IRIDICA bead beater. DNA was extracted with the IRIDICA DNA preparation kit, using the automated extraction system. Purified DNA in buffer was automatically distributed by the IRIDICA sample preparation into 16-well IRIDICA BAC BSI assay strips containing PCR reagents and primers for 18 PCRs. PCR was performed on the IRIDICA thermal cycler using a preloaded PCR amplification protocol. After PCR amplification, the IRIDICA BAC BSI assay strips were loaded onto the IRIDICA desalter, which purified DNA to remove substances that might interfere with mass spectrometry. Following desalting, plates were loaded onto the IRIDICA mass spectrometer. Purified amplicons were injected one well at a time into an electrospray ionization time-of-flight mass spectrometer for determination of the molecular mass of the amplicons. The resulting information was used for species identification by automated database comparison, as previously described (8).
The IRIDICA BAC BSI assay strip contained an internal control template at a known concentration, which generated a control amplicon. The ratio of the amount of the amplicon in the sample DNA to that of the control amplicon was reported as a “level,” which represented a semiquantitative marker of the DNA content of the sample.
Blood cultures.
BC was carried out as standard of care. One or two sets of BC bottles were collected, each set consisting of one aerobic and one anaerobic bottle. The standardized and accredited blood culture systems of each study hospital were used. Identification and susceptibility testing of the species were performed according to the local laboratory standards, including matrix-assisted laser desorption ionization–time-of-flight mass spectrometry, VITEK2 (bioMérieux, Durham, NC, USA), and disc diffusion and Etest gradient diffusion. No information about blood volume in the BC bottles was available.
Statistics.
IBM SPSS Statistics (20.0) software was used for statistical analyses. Chi-square and Fisher´s exact tests were used for comparison of proportions, and the Mann-Whitney U test was used for comparison of independent groups. A P value of <0.05 was considered significant.
Ethics.
The study was approved by an ethical board at each study site and was conducted according to the requirements of the individual country’s laws and regulations and the Declaration of Helsinki. All study participants provided written informed consent.
RESULTS
Limits of detection and contrived specimens.
Table S1 shows the confirmed LOD for individual microorganisms. There was no significant difference between the LOD of Gram-positive and Gram-negative bacteria, with a median of 48 CFU/ml (interquartile range [IQR], 16 to 128 CFU/ml) versus a median of 32 CFU/ml (IQR, 16 to 64 CFU/ml) (P = 0.24). However, the LOD of Candida species, with a median of 8 CFU/ml (IQR, 6 to 12 CFU/ml), were significantly lower than those of Gram-positive (P = 0.012) and Gram-negative (P = 0.016) bacteria. It should be noted that coagulase-negative staphylococci (CoNS) had high LOD; e.g., that for Staphylococcus epidermidis was 256 CFU/ml.
The results of PCR/ESI-MS for 2,500 positive contrived specimens are shown in Table S2. PCR/ESI-MS identified the inoculated organism (true-positive result) in 2,477 cases (99.1%) and detected other organisms (false positives) in 33 cases (1.3%). The false-positive results included Cutibacterium acnes (n = 7), Nocardia farcinica (n = 4), Escherichia coli (n = 3), S. aureus (n = 3), S. epidermidis (n = 3), and 9 other species with 1 or 2 positive results each (see Table S2).
Among 254 negative contrived specimens, the PCR/ESI-MS system reported true-negative results in 247 cases (97.2%). False-positive results were noted in 7 cases, one each of C. acnes, Nocardia species, E. coli, S. aureus, Staphylococcus lugdunensis, Micrococcus species, and Mycobacterium species.
There were 255 contrived samples with microorganisms with known resistance markers (143 with mecA, 35 with vanA, 43 with vanB, and 34 with blaKPC). All of these resistance markers were correctly detected by PCR/ESI-MS. Among 1,143 contrived samples spiked with microorganisms known not to harbor any of the four resistance markers, there were 4 false positives for mecA (0.3%) but no false positives for the other resistance markers.
Patients.
Altogether, 1,501 patients were included in the study (Fig. 1). They had a median age of 54 years (range, 6 to 96 years), and 625 patients (41.6%) were females.
Forty-one patients had PCR/ESI-MS results that were either invalid (n = 33) or not comparable with BC results (n = 8), meaning that the microorganisms reported by BC were not part of the PCR/ESI-MS organism reporting list. These patients were omitted from the study, and thus, the results for 1,460 patients were used in the final analyses. Two sets of BC bottles were obtained for 995 patients (68.2%), and one set was obtained for 465 patients (31.8%).
Among 1,460 study patients, 603 patients (41.3%) had received any antimicrobial medication within 14 days prior to enrollment (antibiotics in 555 patients, antifungals in 79 patients, and antivirals in 114 patients).
Results of blood culture and PCR/ESI-MS in patients and clinical samples.
In the study group of 1,460 patients with suspected sepsis, a microorganism was detected by either BC or PCR/ESI-MS or both in 437 patients (29.9%), i.e., by BC in 213 patients (14.6%) and by PCR/ESI-MS in 374 patients (25.6%). The following result combinations were noted: BC positive and PCR/ESI-MS negative (n = 63), BC positive and PCR/ESI-MS positive (n = 150), and BC negative and PCR/ESI-MS positive (n = 224) (Fig. 2A). Table 1 shows the combined results of PCR/ESI-MS and BC. Concordant negative results were noted for 1,023 patients. Fully concordant positive results (identical specimens detected by BC and PCR/ESI-MS) were noted for 113 patients, of whom 109 had concordant single microorganisms and 4 had concordant multiple microorganisms. Among 150 BC-positive PCR/ESI-MS-positive patients, fully discordant results (different species detected by BC and PCR/ESI-MS) were noted in 8 cases (5.3%). Figure 2B shows combined positive results of BC and PCR/ESI-MS among patients with two sets of BC bottles and among those with one set of BC bottles. As noted, the BC positivity rate was similar between the two categories of patients (15% and 14%), but BC positivity and PCR/ESI-MS positivity combined were significantly more common among patients with one set of BC bottles.
TABLE 1.
No. of organisms detected by: |
No. (%) of patients (n = 1,460) | |
---|---|---|
PCR/ESI-MS | BC | |
0 | 0 | 1,023 (70) |
0 | 1 | 53 (3.6) |
0 | ≥2 | 10 (0.7) |
1 | 0 | 187 (13) |
1 | 1 | 114a (7.8) |
1 | ≥2 | 8b (0.5) |
≥2 | 0 | 37 (2.5) |
≥2 | 1 | 18c (1.2) |
≥2 | ≥2 | 10d (0.7) |
The same organism was detected by PCR/ESI-MS and BC in 109/114 cases. Four patients were PCR/ESI-MS positive for Escherichia coli and BC positive for coagulase-negative staphylococci. One patient was PCR/ESI-MS positive for Candia albicans and BC positive for Bacteroides species.
The organism detected by PCR/ESI-MS was also detected by BC in all 8 cases.
The organism detected by BC was also detected by PCR/ESI-MS in 15/18 cases. One patient was BC positive for Peptostreptococcus species and PCR/ESI-MS positive for Bacteroides species and Clostridium species; one patient was BC positive for Eggerthella lenta and PCR/ESI-MS positive for Bacteroides species and Fusobacterium species; and one patient was BC positive for Streptococcus anginosus and PCR/ESI-MS positive for Gemella morbillorum and two anaerobic bacterial species.
The identical organisms were detected by PCR/ESI-MS and BC in 4/10 cases. At least one organism was detected by both PCR/ESI-MS and BC in 10/10 cases.
Among 25 patients with positive BC for CoNS with two sets of BC bottles analyzed, CoNS was detected in both BCs in 8 cases and in just one BC in 17 cases.
Figure 3 shows the combined positive results of BC and PCR/ESI-MS for Gram-positive and Gram-negative bacteria. As noted, the positive BC rate was similar between Gram-positive (7.8%) and Gram-negative (7.7%) bacteria. However, as noted in Fig. 3, the combination of BC positivity and PCR/ESI-MS positivity was significantly more common for Gram-negative than for Gram-positive bacteria. In addition, PCR/ESI-MS positivity was significantly more common for Gram-negative than for Gram-positive bacteria, 243/1,460 (16.6%) versus 145/1,460 (9.9%) (P < 0.0001). The same pattern was noted for individual microorganisms (Fig. 4 and Table S3).
All non-S. aureus staphylococci observed in the study were categorized as CoNS and included S. epidermidis, Staphylococcus hominis, Staphylococcus capitis, and Staphylococcus haemolyticus. CoNS were detected by BC in 45 patients (3.1%) and by PCR/ESI-MS in 10 patients (0.68%) (P < 0.0001) (Fig. 4).
Candida species were detected by BC in 6 patients (0.41%) and by PCR/ESI-MS in 23 patients (1.6%) (P = 0.0028) (Fig. 4).
Sensitivities and specificities of PCR/ESI-MS compared with blood culture.
When results for individual species were considered (CoNS not included), the sensitivity of PCR/ESI-MS compared with BC was 71% (144/203) overall, 58% (45/77) for Gram-positive bacteria, 78% (94/120) for Gram-negative bacteria, and 83% (5/6) for Candida species. The specificities were >94% for all individual species. Table 2 shows sensitivities and specificities for the most frequently detected microorganisms.
TABLE 2.
Species | Sensitivity [no. PCR/ESI-MS+/no. BC+ in % (ratio)] | Specificity [no. PCR/ESI-MS−/no. BC− in % (ratio)] |
---|---|---|
Gram-positive bacteria | ||
Staphylococcus aureus | 70 (19/27) | 99.2 (1,421/1,433) |
Coagulase-negative staphylococci | 11 (5/45) | 99.6 (1,410/1,415) |
Streptococcus mitis/Streptococcus pneumoniae | 58 (7/12) | 99.4 (1,440/1,448) |
Streptococcus pyogenes | 100 (4/4) | 99.9 (1,455/1,456) |
Streptococcus species | 27 (3/11) | 99.7 (1,445/1,449) |
Enterococcus faecalis | 57 (4/7) | 99.7 (1,449/1,453) |
Enterococcus faecium | 100 (6/6) | 98.8 (1,437/1,454) |
Micrococcus species | 0 (0/1) | 99.6 (1,453/1,459) |
Cutibacterium acnes | 0 (0/1) | 98.8 (1,442/1,459) |
Nocardia species | 0 (0/0) | 98.9 (1,444/1,460) |
Gram-negative bacteria | ||
Escherichia coli | 93 (50/54) | 94.4 (1,327/1,406) |
Klebsiella pneumoniae | 80 (20/25) | 98.3 (1,411/1,435) |
Klebsiella oxytoca | 100 (4/4) | 99.9 (1,454/1,456) |
Enterobacter cloacae complex | 80 (4/5) | 99.0 (1,441/1,455) |
Pseudomonas aeruginosa | 100 (5/5) | 99.7 (1,451/1,455) |
Citrobacter freundii | 0 (0/0) | 99.6 (1,454/1,460) |
Serratia marcescens | 62 (5/8) | 99.9 (1,451/1,452) |
Haemophilus influenzae | 0 (0/2) | 99.7 (1,453/1,458) |
Bacteroides fragilis/Bacteroides thetaiotaomicron | 50 (1/2) | 99.3 (1,448/1,458) |
Fusobacterium nucleatum | 0 (0/0) | 99.6 (1,454/1,460) |
Candida species | ||
Candida albicans | 67 (2/3) | 99.4 (1,448/1,457) |
Candida glabrata | 0 (0/0) | 99.6 (1,454/1,460) |
Species with more than 5 positive results from PCR/ESI-MS and/or BC are included.
Results in patients with and without antimicrobial medication prior to enrollment.
Figure 5 shows the results of BC and PCR/ESI-MS for patients without and with any prior antimicrobial medication. The BC positivity rate tended to be lower for patients with prior antimicrobial medication (13%; 77/603) than for those without prior antimicrobials (16%; 136/857) (P = 0.099) (Fig. 5A). However, patients treated with prior antimicrobials had significantly higher BC positivity and PCR/ESI-MS positivity combined for any microorganism (Fig. 5A) and for Gram-negative bacteria (Fig. 5C), but not for Gram-positive bacteria (Fig. 5B), than patients without prior treatment. Accordingly, the PCR/ESI-MS rate was significantly higher for patients with than for patients without prior antimicrobials, for any microorganism (P < 0.0001) and for Gram-negative bacteria (P < 0.0001), but not for Gram-positive bacteria (P = 16).
Figure 6 presents the detection rates of individual microorganisms in patients with and without prior antimicrobial medication. E. coli was clearly the most commonly detected microorganism in both categories. This bacterium, as well as Enterococcus species, Enterobacter species, and Bacteroides species, was significantly more often detected by BC and/or PCR/ESI-MS in patients who received treatment than in patients without prior antimicrobial medication (P < 0.05 in all cases) (Fig. 6). These organisms were also more often detected by PCR/ESI-MS alone (P < 0.05 in all cases).
Figure 7 shows that prior antifungal medication was strongly associated with PCR/ESI-MS positivity for Candida species. Prior antifungal medication was also strongly associated with BC positivity for Candida species: 2.5% versus 0.29% (P = 0.038).
Semiquantitative results for Staphylococcus aureus and Escherichia coli DNA.
The semiquantitative levels of S. aureus and E. coli DNA produced by the PCR/ESI-MS system were studied as one representative each for Gram-positive and Gram-negative microorganisms. The levels were significantly higher for BC-positive PCR/ESI-MS-positive results than for BC-negative PCR/ESI-MS-positive results for both microorganisms (Fig. 8).
Resistance markers in clinical samples.
Among 1,460 study patients, PCR/ESI-MS detected resistance markers combined with relevant bacteria in 29 cases, i.e., mecA in 18 cases and vanA in 11 cases. No patient was PCR/ESI-MS positive for vanB or blaKPC together with relevant bacterial species.
The mecA-positive patients were PCR/ESI-MS positive for S. aureus in 10 cases and PCR/ESI-MS positive for CoNS in 8 cases. Among 10 patients who were PCR/ESI-MS positive for S. aureus and mecA, BC was positive for S. aureus in 7 cases, including 3 cases with MRSA and 4 cases of methicillin-susceptible S. aureus.
Among 11 patients who were PCR/ESI-MS positive for vanA and E. faecium, two were BC positive for E. faecium, one with VRE and one with vancomycin-susceptible E. faecium.
blaKPC was identified by standard laboratory methods in a BC isolate of K. pneumoniae. The corresponding patient´s whole-blood sample was PCR/ESI-MS positive for K. pneumoniae but PCR/ESI-MS negative for blaKPC.
DISCUSSION
This is the largest study of PCR/ESI-MS performed on either contrived samples or clinical samples. The study showed excellent results of PCR/ESI-MS performed on contrived samples, with very few false-negative or false-positive results. Evaluation of whole-blood samples from patients with suspected sepsis found that PCR/ESI-MS was more often positive than BC, and that trend was more pronounced in those who had received prior antimicrobial medication. While the specificity of PCR/ESI-MS was high relative to that of BC, sensitivities varied between species but were generally higher for Gram-negative than for Gram-positive bacteria.
It is well known that the BC positivity rate in a sepsis population increases with the number of BC bottles analyzed. Thus, the fact that the patients with one set of BC bottles had almost as high BC positivity rates as patients with two sets of BC bottles (Fig. 2B) indicates that the population with one set may have had a higher rate of true bloodstream infection. A higher frequency of bloodstream infection could be a reason for the high rate of PCR/ESI-MS-positive results among patients for whom one BC bottle set was collected (Fig. 2B). An alternative possible reason could be more false positives in this patient group. The obvious difference between those with one and two BC sets suggests a possibly biased or unrepresentative sample population.
The low rate of PCR/ESI-MS positivity for CoNS in the study (Fig. 4) was unexpected. However, it could perhaps be explained by the high LOD of PCR/ESI-MS for CoNS (Table S1).
Seven previous studies of PCR/ESI-MS on 5-ml whole-blood samples (9, 10, 14–18) reported BC positivity rates of 5.4 to 34% and PCR/ESI-MS positivity rates of 10.6 to 37% (19). Higher rates of PCR/ESI-MS-positive results (versus BC) were seen in 5 of those studies (9, 10, 14, 16, 18), and more BC-positive results (versus PCR/ESI-MS) were seen in 2 studies (15, 17). In the largest previous study (n = 616), by Vincent et al. (10), BC was positive in 11% and PCR/ESI-MS was positive in 37% of the cases. In the present study, BC was positive in 14.6% and PCR/ESI-MS was positive in 25.6% of patients.
An interesting finding of the present study was that although the BC positivity rates for Gram-positive and Gram-negative bacteria were similar (7.8% and 7.7%), the PCR/ESI-MS positivity rate was significantly higher for Gram-negative than for Gram-positive bacteria (Fig. 3). Accordingly, the sensitivity of PCR/ESI-MS compared to BC was higher for Gram-negative organisms (78%) than for Gram-positive organisms (58%). The reason for this difference is not clear. A possible explanation could be different loads of bacterial DNA in the bloodstream during sepsis. However, the PCR/ESI-MS semiquantitative levels did not differ significantly between Gram-negative and Gram-positive bacteria, as illustrated by data for S. aureus and E. coli in Fig. 8. Similarly, Ziegler et al. (20) found comparable PCR cycle thresholds of bacterial DNA in whole blood from patients with Gram-positive and Gram-negative bloodstream infection, using the LightCycler SeptiFast test. Another possible explanation could be different LOD. However, the present study could not find any general difference in LOD between Gram-positive and Gram-negative organisms (Table S1). Thus, the reason for the difference remains unclear. An interesting finding, however, was that the difference between Gram-negative and Gram-positive detections with PCR/ESI-MS was predominantly noted for patients who had received prior antimicrobial medication (Fig. 5B and C).
The design of this study enabled analysis of the importance of prior antimicrobial medication for the results of BC and PCR/ESI-MS. Similar to previous studies (21, 22), patients with prior antimicrobial medication tended to have lower BC positivity rates than patients who had not received antimicrobials (Fig. 5A). However, PCR/ESI-MS was significantly more often positive for patients with than patients without antimicrobials, and consequently, the combined results of BC and PCR/ESI-MS were more often positive for patients with than patients without prior antimicrobials (Fig. 5A). This pattern was pronounced for Gram-negative bacteria (Fig. 5C) but was not noted for Gram-positive bacteria (Fig. 5B).
Notably, differences between individual Gram-negative species were observed (Fig. 6). Prior antimicrobial medication was associated with higher combined positivity rates (BC and PCR/ESI-MS) for E. coli, Enterobacter species, and Bacteroides species, but not for Klebsiella species. Among Gram-positive organisms, Enterococcus species was more common in patients with prior antimicrobials (Fig. 6). This was an unexpected pattern, as we expected patients with prior antimicrobials to have lower PCR/ESI-MS positivity rates, in line with lower BC positivity rates. The reason for this pattern is not known. It could perhaps reflect the fact that the cases with and without prior antimicrobials represent different patient populations. Prior antimicrobial medication is, based on clinical practice patterns, likely associated with an increased likelihood of true infection and with inpatient care prior to enrollment. Bloodstream infections with Enterobacter species and Enterococcus species have been associated with long hospital durations prior to onset (23). However, the unexpected pattern of more PCR/ESI-MS-positive results in patients with prior antimicrobials could also be caused by false-positive PCR/ESI-MS results, possibly due to contamination during the extraction step, which could perhaps be more problematic with Gram-negative species.
Candida DNA was detected by PCR/ESI-MS significantly more often than Candida species was detected by BC (Fig. 4), similar to the performance of the commercial T2Candida test (T2 Biosystems, Lexington, MA ) (24). Detection of Candida species by both BC and PCR/ESI-MS was linked to prior antifungal medication (Fig. 7). As antifungal medication is usually based on microbiological findings and/or clinical suspicion of fungal infection, this link can reasonably be interpreted as support for BC-negative PCR/ESI-MS-positive results for Candida species, which would have important value for decisions in clinical practice.
A very important question is whether BC-negative PCR/ESI-MS-positive results represent true infections. It should be noted that in the present study, 2.8% of the negative contrived samples were false positive by PCR/ESI-MS. This could represent contamination or false positivity due to nonmicrobial components or microbial cell-free DNA within the blood (25). Unfortunately, the present study was not designed to evaluate the clinical relevance of BC-negative PCR/ESI-MS-positive results, as clinical data apart from SIRS data were not collected. However, there are some important findings from previous studies that should be mentioned. Jordana-Lluch et al. (26) identified 80 BC-negative PCR/ESI-MS-positive microorganisms, of which 41 microorganisms (51%) correlated with clinical findings. In another study, the same group (16) identified 84 BC-negative PCR/ESI-MS-positive microorganisms, of which 42 microorganisms (50%) had support from clinical findings. In a European ICU sepsis study (27) (a subgroup study of that described in reference 10), the 28-day mortality was found to be higher in patients with BC-negative PCR/ESI-MS-positive results than in patients with BC-negative PCR/ESI-MS-negative results (42% versus 26%; P = 0.001). This association with disease severity may perhaps be due to true bloodstream infection in a substantial proportion of cases with BC-negative PCR/ESI-MS-positive results. Proper evaluation of the clinical relevance of BC-negative PCR/ESI-MS-positive results requires additional studies designed to evaluate PCR/ESI-MS with detailed clinical data and should include severely ill patients without infections.
The present study’s design, with BC as the reference standard, enabled proper analysis of diagnostic sensitivity. Overall, the sensitivity of PCR/ESI-MS was 71%, which is similar to the pooled sensitivity of 66% that was recently found in the meta-analysis by Huang et al. (28). This suboptimal clinical sensitivity combined with the low frequency of false-negative results among contrived specimens indicates that a substantial proportion of patients with bloodstream infection may have bloodstream concentrations of microorganisms below the LOD for those microorganisms. The 5 species for which sensitivities were highest compared with BC in the present study, i.e., Streptococcus pyogenes, E. faecium, E. coli, Klebsiella oxytoca, and Pseudomonas aeruginosa (sensitivities > 92%) (Table 2), all had low PCR/ESI-MS LOD (8 to 16 CFU/ml [Table S1]). As it has been reported that patients with bloodstream infection may have as few as 1 to 10 CFU of circulating microorganisms per ml (25), the LOD of PCR/ESI-MS may not be clinically optimal for many microorganisms. Accordingly, the concentrations of microorganisms used in the contrived specimens of the present study may have been too high to mimic clinically relevant concentrations. Thus, due to the suboptimal sensitivity, PCR/ESI-MS cannot be used to rule out bloodstream infection.
A disadvantage of PCR/ESI-MS and other molecular methods is the limited information provided about antimicrobial susceptibility. The IRIDICA PCR/ESI-MS panel contains only four resistance markers (mecA, vanA, vanB, and blaKPC). However, on contrived whole blood samples spiked with microorganisms with known presence or absence of resistance in the present study, PCR/ESI-MS showed excellent performance regarding the resistance markers. Clinical samples from 10 patients were PCR/ESI-MS positive for S. aureus and mecA, but only 3 of them had culture-proven MRSA in their bloodstream. Similarly, 11 patients were PCR/ESI-MS positive for E. faecium and vanA, but only one of them had culture-proven VRE in the bloodstream. These results were not conclusive, as we do not have any additional microbiological data on the patients apart from BC and PCR/ESI-MS. Thus, there is a need for additional evaluations and, in particular, a need for new sensitive methods to determine antimicrobial susceptibility.
At the end of 2014, the PCR/ESI-MS IRIDICA BAC BSI Assay was CE marked and became commercially available for in vitro diagnostics in Europe. When it was used in routine practice in addition to BC at Karolinska University Hospital (29), it detected BC-negative PCR/ESI-MS-positive microorganisms that were considered clinically relevant (30). However, in April 2017, Abbott withdrew their application to the FDA regarding the IRIDICA BAC BSI assay and ceased producing IRIDICA instruments and IRIDICA test kits (29). Since then, PCR/ESI-MS has not been commercially available. Still, the present study and previous PCR/ESI-MS studies (9, 10, 16, 18) show that for patients with suspected sepsis, bacterial DNA is detected in blood more often than viable bacteria are detected by BC, especially in patients who were previously treated. This is encouraging and supports the value of further advancing new molecular diagnostics for clinical practice, which is critical for improved detection of bloodstream microorganisms and has important downstream implications for improved patient outcomes (5). Such development is further motivated by the WHO resolution on sepsis (1) and their global action plan on antimicrobial resistance (31).
The present study has several strengths. First, the large number of contrived samples spiked with microorganisms of different concentrations enabled solid conclusions regarding the analytic performance of PCR/ESI-MS. Second, the large number of clinical samples enabled comparisons between Gram-positive and Gram-negative bacteria and performance analysis with regard to individual microorganisms. Third, data on prior antimicrobial medication were collected shortly after enrollment, enabling a comparison between patients with and without prior antimicrobial treatment. Altogether, the study provided new knowledge about bacterial DNA in the bloodstream of patients with suspected sepsis.
The study also has limitations. First, the patient population was heterogenous, as the patients were enrolled at different clinical sites and were not consecutively enrolled. This design may have allowed bias between variables and may have caused lack of replicability. In addition, due to the lack of a homogenous population, we could not evaluate the additive value of PCR/ESI-MS for the etiologic spectrum of sepsis. Second, the lack of standardized blood culturing may have introduced variability regarding blood culture results. Third, standard microbiological tests apart from BC were not registered, and thus, we could not properly evaluate BC-negative PCR/ESI-MS-positive findings. Fourth, severity data apart from SIRS criteria were not registered, and thus we could not stratify patients according to the sepsis-3 classification. However, all patients had suspected sepsis according to the sepsis-2 definition, with suspected bloodstream infection and at least 2 SIRS criteria.
In conclusion, PCR/ESI-MS showed excellent performance on contrived whole blood samples. On clinical samples, it showed high specificities, moderately high sensitivities for Gram-negative bacteria and Candida species, and elevated positivity rates during antimicrobial treatment. These promising results encourage further development of molecular diagnostics to be used with whole blood for detection of bloodstream microorganisms in sepsis.
Supplementary Material
ACKNOWLEDGMENTS
The study was designed and funded by Ibis Biosciences, a division of Abbott.
We acknowledge the Ibis team for the preparation of contrived specimens, study monitoring, and technical support. We thank research and clinical microbiology laboratory scientists who assisted with the study.
Potential conflicts of interest in addition to Abbott´s above-mentioned role in the present study include the following. Richard E. Rothman has served on advisory panels for Ibis Biosciences (an Abbott company), Roche Molecular Systems Inc., Cepheid, Inflammatix, and Qvella Corporation, has been an invited speaker for Roche Molecular Systems Inc., and has had grant support for research from Abbott and Cepheid. David Brealey has received payment from Abbott to do educational sessions. Lara Poling and Kristin Lowery were employees of Ibis Biosciences at the time of the study. Gregory J. Moran has received consulting fees from Light AI and research grant support from ContraFect and Nabriva Therapeutics AG. Emanuel P. Rivers has received funds for research and educational projects from Lajolla Pharmaceuticals (Athos), Abbott, Alere Corporation, Spectral Diagnostics, Ferring Pharmaceuticals, Inflammix, and VICTASm. Matthew Sims has served as an investigator on studies sponsored by Nabriva Therapeutics AG, Sanofi Pasteur Inc., Curetis GmbH, Pfizer Inc., Merck and Co., Cidara Therapeutics Inc., Shire, ContraFect, Aridis Pharmaceuticals Inc., Epigenomics Inc., Genentech Inc., Finch Therapeutics, Seres Therapeutics Inc., Diasorin Molecular, Janssen Research and Development, NeuMoDx Molecular, and Iterum Therapeutics International and has been a consultant for Paratek Pharmaceuticals, Curetis GmbH, and Cutis Pharma. Kristoffer Strålin, Volkan Özenci, Kieron Barkataki, Nellam Dhiman, Michael C. Kurz, Ajit P. Limaye, Frank LoVecchio, Loren G. Miller, J. Scott Overcash, Amisha Parekh, W. Frank Peacock, Amy M. Stubbs, Martin Sundqvist, Måns Ullberg, and Karen C. Carroll declare no conflicts of interest.
Footnotes
Supplemental material is available online only.
REFERENCES
- 1.Reinhart K, Daniels R, Kissoon N, Machado FR, Schachter RD, Finfer S. 2017. Recognizing sepsis as a global health priority—a WHO resolution. N Engl J Med 377:414–417. doi: 10.1056/NEJMp1707170. [DOI] [PubMed] [Google Scholar]
- 2.Seymour CW, Gesten F, Prescott HC, Friedrich ME, Iwashyna TJ, Phillips GS, Lemeshow S, Osborn T, Terry KM, Levy MM. 2017. Time to treatment and mortality during mandated emergency care for sepsis. N Engl J Med 376:2235–2244. doi: 10.1056/NEJMoa1703058. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Rhodes A, Evans LE, Alhazzani W, Levy MM, Antonelli M, Ferrer R, Kumar A, Sevransky JE, Sprung CL, Nunnally ME, Rochwerg B, Rubenfeld GD, Angus DC, Annane D, Beale RJ, Bellinghan GJ, Bernard GR, Chiche JD, Coopersmith C, De Backer DP, French CJ, Fujishima S, Gerlach H, Hidalgo JL, Hollenberg SM, Jones AE, Karnad DR, Kleinpell RM, Koh Y, Lisboa TC, Machado FR, Marini JJ, Marshall JC, Mazuski JE, McIntyre LA, McLean AS, Mehta S, Moreno RP, Myburgh J, Navalesi P, Nishida O, Osborn TM, Perner A, Plunkett CM, Ranieri M, Schorr CA, Seckel MA, Seymour CW, Shieh L, Shukri KA, Simpson SQ, Singer M, Thompson BT, Townsend SR, Van der Poll T, Vincent JL, Wiersinga WJ, Zimmerman JL, Dellinger RP. 2017. Surviving Sepsis Campaign: international guidelines for management of sepsis and septic shock: 2016. Crit Care Med 45:486–552. doi: 10.1097/CCM.0000000000002255. [DOI] [PubMed] [Google Scholar]
- 4.Rangel-Frausto MS, Pittet D, Costigan M, Hwang T, Davis CS, Wenzel RP. 1995. The natural history of the systemic inflammatory response syndrome (SIRS). A prospective study. JAMA 273:117–123. doi: 10.1001/jama.1995.03520260039030. [DOI] [PubMed] [Google Scholar]
- 5.Sinha M, Jupe J, Mack H, Coleman TP, Lawrence SM, Fraley SI. 2018. Emerging technologies for molecular diagnosis of sepsis. Clin Microbiol Rev 31:e00089-17. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Nguyen MH, Clancy CJ, Pasculle AW, Pappas PG, Alangaden G, Pankey GA, Schmitt BH, Rasool A, Weinstein MP, Widen R, Hernandez DR, Wolk DM, Walsh TJ, Perfect JR, Wilson MN, Mylonakis E. 2019. Performance of the T2Bacteria panel for diagnosing bloodstream infections: a diagnostic accuracy study. Ann Intern Med 170:845–852. doi: 10.7326/M18-2772. [DOI] [PubMed] [Google Scholar]
- 7.Blauwkamp TA, Thair S, Rosen MJ, Blair L, Lindner MS, Vilfan ID, Kawli T, Christians FC, Venkatasubrahmanyam S, Wall GD, Cheung A, Rogers ZN, Meshulam-Simon G, Huijse L, Balakrishnan S, Quinn JV, Hollemon D, Hong DK, Vaughn ML, Kertesz M, Bercovici S, Wilber JC, Yang S. 2019. Analytical and clinical validation of a microbial cell-free DNA sequencing test for infectious disease. Nat Microbiol 4:663–674. doi: 10.1038/s41564-018-0349-6. [DOI] [PubMed] [Google Scholar]
- 8.Jordana-Lluch E, Giménez M, Quesada MD, Ausina V, Martró E. 2014. Improving the diagnosis of bloodstream infections: PCR coupled with mass spectrometry. Biomed Res Int 2014:501214. doi: 10.1155/2014/501214. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Metzgar D, Frinder MW, Rothman RE, Peterson S, Carroll KC, Zhang SX, Avornu GD, Rounds MA, Carolan HE, Toleno DM, Moore D, Hall TA, Massire C, Richmond GS, Gutierrez JR, Sampath R, Ecker DJ, Blyn LB. 2016. The IRIDICA BAC BSI assay: rapid, sensitive and culture-independent identification of bacteria and Candida in blood. PLoS One 11:e0158186. doi: 10.1371/journal.pone.0158186. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Vincent JL, Brealey D, Libert N, Abidi NE, O'Dwyer M, Zacharowski K, Mikaszewska-Sokolewicz M, Schrenzel J, Simon F, Wilks M, Picard-Maureau M, Chalfin DB, Ecker DJ, Sampath R, Singer M, Rapid Diagnosis of Infections in the Critically Ill Team. 2015. Rapid Diagnosis of Infection in the Critically Ill, a multicenter study of molecular detection in bloodstream infections, pneumonia, and sterile site infections. Crit Care Med 43:2283–2291. doi: 10.1097/CCM.0000000000001249. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Vincent JL, Sampath R, Rapid Diagnosis of Infections in the Critically Ill Team. 2016. The authors reply. Crit Care Med 44:e315. [DOI] [PubMed] [Google Scholar]
- 12.Yagupsky P, Nolte FS. 1990. Quantitative aspects of septicemia. Clin Microbiol Rev 3:269–279. doi: 10.1128/cmr.3.3.269. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Levy MM, Fink MP, Marshall JC, Abraham E, Angus D, Cook D, Cohen J, Opal SM, Vincent JL, Ramsay G, SCCM/ESICM/ACCP/ATS/SIS. 2003. 2001 SCCM/ESICM/ACCP/ATS/SIS International Sepsis Definitions Conference. Crit Care Med 31:1250–1256. doi: 10.1097/01.CCM.0000050454.01978.3B. [DOI] [PubMed] [Google Scholar]
- 14.Bacconi A, Richmond GS, Baroldi MA, Laffler TG, Blyn LB, Carolan HE, Frinder MR, Toleno DM, Metzgar D, Gutierrez JR, Massire C, Rounds M, Kennel NJ, Rothman RE, Peterson S, Carroll KC, Wakefield T, Ecker DJ, Sampath R. 2014. Improved sensitivity for molecular detection of bacterial and Candida infections in blood. J Clin Microbiol 52:3164–3174. doi: 10.1128/JCM.00801-14. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Desmet S, Maertens J, Bueselinck K, Lagrou K. 2016. Broad-range PCR coupled with electrospray ionization time of flight mass spectrometry for detection of bacteremia and fungemia in patients with neutropenic fever. J Clin Microbiol 54:2513–2520. doi: 10.1128/JCM.01066-16. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Jordana-Lluch E, Rivaya B, Marco C, Gimenez M, Quesada MD, Escobedo A, Batlle M, Martró E, Ausina V. 2017. Molecular diagnosis of bloodstream infections in onco-haematology patients with PCR/ESI-MS technology. J Infect 74:187–194. doi: 10.1016/j.jinf.2016.11.011. [DOI] [PubMed] [Google Scholar]
- 17.Tassinari M, Zannoli S, Farabegoli P, Pedna MF, Pierro A, Mastroianni A, Fontan R, Luongo L, Sarnataro G, Menegatti E, Caruso A, Sambri V. 2018. Rapid diagnosis of bloodstream infections in the critically ill: evaluation of the broad-range PCR/ESI-MS technology. PLoS One 13:e0197436. doi: 10.1371/journal.pone.0197436. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Makristathis A, Harrison N, Ratzinger F, Kussmann M, Selitsch B, Forstner C, Hirschl AM, Burgmann H. 2018. Substantial diagnostic impact of blood culture independent molecular methods in bloodstream infections: superior performance of PCR/ESI-MS. Sci Rep 8:16024. doi: 10.1038/s41598-018-34298-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Özenci V, Strålin K. 2019. Clinical implementation of molecular methods in detection of microorganisms from blood with a special focus on PCR electrospray ionization mass spectrometry. Expert Rev Mol Diagn 19:389–395. doi: 10.1080/14737159.2019.1607728. [DOI] [PubMed] [Google Scholar]
- 20.Ziegler I, Josefson P, Olcén P, Mölling P, Strålin K. 2014. Quantitative data from the SeptiFast real-time PCR is associated with disease severity in patients with sepsis. BMC Infect Dis 14:155. doi: 10.1186/1471-2334-14-155. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Bloos F, Hinder F, Becker K, Sachse S, Mekontso Dessap A, Straube E, Cattoir V, Brun-Buisson C, Reinhart K, Peters G, Bauer M. 2010. A multicenter trial to compare blood culture with polymerase chain reaction in severe human sepsis. Intensive Care Med 36:241–247. doi: 10.1007/s00134-009-1705-z. [DOI] [PubMed] [Google Scholar]
- 22.Scheer CS, Fuchs C, Grundling M, Vollmer M, Bast J, Bohnert JA, Zimmermann K, Hahnenkamp K, Rehberg S, Kuhn SO. 2019. Impact of antibiotic administration on blood culture positivity at the beginning of sepsis: a prospective clinical cohort study. Clin Microbiol Infect 25:326–331. doi: 10.1016/j.cmi.2018.05.016. [DOI] [PubMed] [Google Scholar]
- 23.Wisplinghoff H, Bischoff T, Tallent SM, Seifert H, Wenzel RP, Edmond MB. 2004. Nosocomial bloodstream infections in US hospitals: analysis of 24,179 cases from a prospective nationwide surveillance study. Clin Infect Dis 39:309–317. doi: 10.1086/421946. [DOI] [PubMed] [Google Scholar]
- 24.Clancy CJ, Pappas PG, Vazquez J, Judson MA, Kontoyiannis DP, Thompson GR III, Garey KW, Reboli A, Greenberg RN, Apewokin S, Lyon GM III, Ostrosky-Zeichner L, Wu AHB, Tobin E, Nguyen MH, Caliendo AM. 2018. Detecting Infections Rapidly and Easily for Candidemia Trial, part 2 (DIRECT2): a prospective, multicenter study of the T2Candida panel. Clin Infect Dis 66:1678–1686. doi: 10.1093/cid/cix1095. [DOI] [PubMed] [Google Scholar]
- 25.Opota O, Jaton K, Greub G. 2015. Microbial diagnosis of bloodstream infection: towards molecular diagnosis directly from blood. Clin Microbiol Infect 21:323–331. doi: 10.1016/j.cmi.2015.02.005. [DOI] [PubMed] [Google Scholar]
- 26.Jordana-Lluch E, Gimenez M, Quesada MD, Rivaya B, Marco C, Dominguez MJ, Arméstar F, Martró E, Ausina V. 2015. Evaluation of the broad-range PCR/ESI-MS technology in blood specimens for the molecular diagnosis of bloodstream infections. PLoS One 10:e0140865. doi: 10.1371/journal.pone.0140865. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.O'Dwyer MJ, Starczewska MH, Schrenzel J, Zacharowski K, Ecker DJ, Sampath R, Brealey D, Singer M, Libert N, Wilks M, Vincent JL. 2017. The detection of microbial DNA but not cultured bacteria is associated with increased mortality in patients with suspected sepsis—a prospective multi-centre European observational study. Clin Microbiol Infect 23:208. [DOI] [PubMed] [Google Scholar]
- 28.Huang L, Lu B, Qin R, Sun L. 2018. PCR-ESI/MS for molecular diagnosis of bloodstream infections directly from blood samples: a systematic review and meta-analysis. Clin Lab 64:1153–1161. doi: 10.7754/Clin.Lab.2018.180112. [DOI] [PubMed] [Google Scholar]
- 29.Özenci V, Patel R, Ullberg M, Strålin K. 2018. Demise of polymerase chain reaction/electrospray ionization-mass spectrometry as an infectious diseases diagnostic tool. Clin Infect Dis 66:452–455. doi: 10.1093/cid/cix743. [DOI] [PubMed] [Google Scholar]
- 30.Strålin K, Patel R, Ullberg M, Özenci V. 2019. Reply to Spyridou et al. Clin Infect Dis 68:351. doi: 10.1093/cid/ciy109. [DOI] [PubMed] [Google Scholar]
- 31.World Health Organization. 2015. Global action plan on antimicrobial resistance, p 17–19. In Sixty-Eighth World Health Assembly. Document WHA68/2015/REC/1 World Health Organization, Geneva, Switzerland. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.