Abstract
Sepsis is a leading cause of death. Rapid and accurate identification of pathogens and antimicrobial resistance directly from blood culture could improve patient outcomes.
The FilmArray® (FA; Idaho Technology, Inc., Salt Lake City, UT) Blood Culture (BC) panel can identify > 25 pathogens and 4 antibiotic resistance genes from positive blood cultures in 1 hour. We compared a development version of the panel to conventional culture and susceptibility testing on 102 archived blood cultures from adults and children with bacteremia. Of 109 pathogens identified by culture, 95% were identified by FA. Among 111 prospectively collected blood cultures, the FA identified 84 of 92 pathogens (91%) covered by the panel. Among 25 Staphylococcus aureus and 21 Enterococcus species detected, FA identified all culture-proven MRSA and VRE.
The FA BC panel is an accurate method for the rapid identification of pathogens and resistance genes from blood culture.
Keywords: polymerase chain reaction, sepsis, bacteremia, blood culture, molecular diagnostics, bloodstream infection, FilmArray
Introduction
Sepsis is a leading cause of death in U.S. adults and children (Kochanek, et al., 2011). Prompt initiation of appropriate antimicrobial therapy is associated with improved outcomes (Bochud, et al., 2001; Dellinger, et al., 2008; Kumar, 2009). Definitive identification of the causative organism through traditional culture methods often requires 24–72 hours. This delay can lead to administration of either inadequate or overly broad antimicrobial therapy. Inappropriate antimicrobial selection may result in therapy-related complications, emergence of antimicrobial resistance, and increases in patient morbidity, mortality, and costs (Bauer, et al., 2010; Bochud, et al., 2001; Dellinger, et al., 2008; Kumar, 2009).
Continuously monitoring automated blood culture systems have enabled the detection of most blood stream pathogens within 24 hours of inoculation (Cockerill, et al., 2004). Automated systems for identification and susceptibility testing are available, however the organism must be isolated in pure culture prior to using them (Jorgensen and Ferraro, 2009). This requires a minimum of 12–24 hours after the blood culture becomes positive, and methods to improve bacterial growth rates are lacking (Mancini, et al., 2010).
Identification of pathogens directly from positive blood culture is one proposed solution. Ideally for such identification, rapid, species-specific identification of a wide range of pathogens would be provided. For PCR-based systems, this requires a high level of multiplexing that has been difficult to achieve (Mackay, 2004; Persson, et al., 2005). Here we describe the preliminary development of such an assay based on Idaho Technology’s FilmArray® Platform (Poritz, et al., 2011), a closed diagnostic system allowing high-order multiplex PCR analysis with automated read-out of results. The assay described can identify 15 species-specific and 6 genus level targets, encompassing almost 95 percent of organisms commonly found in positive blood cultures (Biedenbach, et al., 2004). Four antibiotic resistance determinants are also included. Design of the assay panel as well as initial testing of a development version with clinical samples is presented.
Materials and Methods
The Institutional Review Boards of the University of Utah and Primary Children’s Medical Center (PCMC, Salt Lake City, UT) approved this study. Informed consent was waived.
FilmArray®
The FDA approved FilmArray (FA) System has been described (Poritz, et al., 2011). Briefly, it is a closed diagnostic system that combines nucleic acid extraction from clinical specimens, high-order nested multiplex PCR, and post-PCR DNA melt curve analysis.
Panel Design
Nested and nested multiplex PCR
The FA system performs a “nested multiplex” PCR (nmPCR) within the instrument (Poritz, et al., 2011). Briefly, nmPCR is a 2-stage PCR in which the first-stage reaction is a multiplex that produces a 200–500 bp amplicon for each target. The second-stage primers are “nested” within this amplicon and amplify a shorter product. Nested PCR provides increased sensitivity compared with conventional PCR; the specificity is similar to probe-based assays (Narayanan, 1996). Assays were developed to function within the context of nmPCR, with first-stage multiplex amplification performed for 20 cycles and the array of second stage singleplex nested PCRs performed for 25 cycles.
Panel Design
Organisms were chosen for the BC panel based on laboratory data provided by our collaborating microbiology laboratory director (JAD) and through review of SENTRY data regarding organism prevalence in blood cultures (Biedenbach, et al., 2004). Both organisms with a high frequency and low pathogenicity [i.e. coagulase-negative staphylococci (CONS)] and those with a low frequency and high pathogenicity (i.e., Neisseria meningitidis) were included. The panel used in the studies presented here includes 15 species-specific targets and 6 genus-level assays. This panel (Table 1) represents ~90–95% of all pathogens identified from participating laboratories and the SENTRY database.
Table 1.
Organism | Gene 1 | Gene 2 |
---|---|---|
Gram Positive | ||
Streptococcus pneumoniae | lytA | rpoB |
Streptococcus agalactiae | sip | |
Streptococcus pyogenes | speB | |
Streptococcus spp1 | rpoB | |
Staphylococcus aureus | nuc | rpoB |
Coagulase-negative staphylococci2 | rpoB | |
Enterococcus spp3 | rpoB | |
Listeria monocytogenes | rpoB | |
Gram-Negative | ||
Escherichia coli | gyrB | ompA |
Klebsiella oxytoca | gyrB | ompA |
Klebsiella pneumoniae | gyrB | ompA |
Enterobacter cloacae | gyrB | ompA |
Serratia marcescens | gyrB | ompA |
Enterobacteriaceae4 | ompA | |
Neisseria meningitidis | ctrA | |
Haemophilus influenzae | rpoB | bexA |
Pseudomonas aeruginosa | gyrB | |
Acinetobacter baumanii | tusA | rpoB |
Yeast | ||
Candida albicans | ACT | |
Candida non-albicans5 | RPB-1 | |
Antibiotic Resistance | ||
Methicillin | mecA | |
Vancomycin* | vanA | vanB |
Carbapenem | blaKPC |
vanC gene included in panel used for the validation study, but subsequently removed.
Streptococcal species included for primer design were: S. pneumoniae, S. parasanguinis, S. anginosus, S. salivarius, S. pyogenes, S. uberis, S. mitis, S. sanguis, S. mutans, S. oralis, S. equinis, S. gordonii, S. gallolyticus
Coagulase-negative staphylococci included for primer design were: S. epidermidis, S. hominis, S. haemolyticus, S. capitis, S. saprophyticus, S. warneri, S. xylosus, S. caprae, S. cohnii, S. koosii, S. saccrolyticus, S. nepalensis, S. microti, S. simiae, S. lugdunensis
Enterococcal species included for primer design were: E. facaelis, E. faecium, E. casseliflavus, E. durans, E. gallinarum
Enterobacteriaceae included for primer design were: E.coli, E. hermannii, E. fergusonii, Shigella sonnei, S. boydii, S. dysenteriae, S.flexneri, C. freundii, Salmonella enterica, S. typhimurium, Enterobacter. aerogenes, E. cloacae, E. sakazaki, Klebsiella. oxytoca, K.pneumoniae, Serratia. marcescens
Non-albicans candida included are: C. parapsilosis, C. glabrata, C. tropicalis, C. krusei
Antibiotic resistance targets were chosen based on frequency of detection, implications for change in antibiotic therapy, and the likelihood of a direct correlation between gene presence and antibiotic resistance. The genes mecA, van A, van B and the Klebsiella pneumoniae carbapenemase (blaKPC) were included in the panel (Cole, et al., 2009; Fluit, et al., 2001). In the version of the panel used for clinical validation, the vanC gene was also included, however this gene was removed from the panel used for the prospective study due to its low prevalence and association with a variable resistance phenotype (Clark, et al., 1998).
For species-specific bacterial targets such as virulence factors, genes were chosen based on a review of the literature. For genus (i.e. “Streptococcus spp.”) or family (i.e. “Enterobacteriaceae”) level assays, conserved housekeeping genes were targeted and degenerate primers were designed to encompass important species within the group. For example, the Streptococcus species assay targets the RNA polymerase β subunit (rpoB) gene and was designed to capture 7 species in the target alignment. Primers for antibiotic resistance genes are all located in conserved regions so that only one set contains degenerate bases (vanA gene; 2-fold degeneracy). The developmental panel used in these studies includes 50 first-stage primers in the multiplex and 65 second-stage singleplex PCRs.
Primer Design
Gene sequences were obtained through the National Center for Biotechnology Information’s GenBank Database (Benson, et al., 2011; Sayers, et al., 2011). Alignments were created and analyzed using Lasergene® software (DNASTAR, Madison, WI). Primers were designed using LightCycler® Primer Probe Design Software (Roche Applied Science, Indianapolis, IN). Degenerate primers were used in primer design in cases where species were divergent within the gene target and in genus-level assays.
Assay optimization
Assay optimization was performed as previously described for FilmArray system development (Poritz, et al., 2011).
Bacteria and Yeast Isolates
Bacteria and yeast isolates were obtained from the PCMC microbiology laboratory and from the University of Utah’s Associated Regional and University Pathologists (ARUP) Laboratories (Salt Lake City, UT). Clinical isolates were identified by standard microbiologic methods (see below). In addition isolates were obtained from the American Type Culture Collection (ATCC; Manassas, VA) and from JMI Laboratories (North Liberty, IA).
Assay validation
All assays were validated for sensitivity and specificity as individual real-time PCR reactions and in the FA pouch with bacterial isolates and their extracted nucleic acids. For the Blood Culture (BC) panel described, targets analyzed in the FA included known positives for each pathogen at levels of approximately 100 – 10,000 genomes per pouch based on DNA fluorimeter measurements (Qubit Fluorimeter, Life Technologies, Grand Island, NY). Testing was also performed with bacteria/yeast isolates (2–3 colonies resuspended in 500 μl of the sample buffer). For species-specific assays, testing was performed with at least 5 different isolates of each organism. Specific amplification of targets was evaluated by testing against “nearest neighbors” (ie, testing of the S. pneumoniae assay against viridans streptococci, S. pyogenes and S. agalactiae). Genus or group level assays were tested with 1–5 isolates of each target organism within the group. All assays in the developmental panel had a sensitivity of <100 genomes per pouch and 100% species-or genus-level specificity for bacterial isolates tested (data not shown).
Blood Culture Analyses
Conventional microbiology at Primary Children’s Medical Center (PCMC) and the University of Utah’s Associated Regional and University Pathologists (ARUP) Laboratories
Both PCMC and ARUP are Clinical Laboratory Improvement Amendments (CLIA) certified. In both laboratories, blood culture is performed using the BACTEC automated blood culture system (BD Diagnostic Systems, Franklin Lakes, NJ). Cultures signaling positive are removed immediately from the instrument and Gram-stain is performed within 15 minutes. Isolates of bacteria and yeast are grown on solid media and at PCMC are identified by VITEK® (bioMerieux, Inc., Durham, NC) and by bench top biochemical testing. At ARUP, isolates are identified by Phoenix automated identification system (BD Diagnostic Systems), bench top biochemical testing and/or 16S rRNA gene sequencing. Antibiotic susceptibility is performed at PCMC by VITEK and by E-Test® (bioMerieux, Inc.) and at ARUP by the Phoenix (BD Diagnostic Systems), manual broth microdilution (Trek Diagnostic Systems, Inc., Cleveland, OH), and/or E-Test®. PCR is performed at ARUP for identification of the mecA gene.
Collection of Blood Culture Samples
1.5 ml samples from blood culture bottles (BD Diagnostic Systems, Franklin Lakes, NJ) signaling positive were collected from PCMC and from ARUP Laboratories. Sample collection was initiated at the onset of panel development and samples were stored frozen at −80 °C until testing.
Validation Study
A validation designed to demonstrate the accuracy of pathogen identification from clinical blood cultures was performed using blood culture specimens obtained and frozen in 2006–2007 from PCMC. De-identified samples were chosen to represent the majority of pathogens on the development version of the FA BC panel by an investigator (AJB) aware of the culture result, and were tested using the FA by an investigator who was blinded to the culture results (CH).
Prospectively Collected Sequential Samples
The utility of the panel for identification of pathogens commonly encountered in the clinical setting was evaluated through prospectively collected sequential samples from all positive blood cultures obtained between June and August 2010 from PCMC and ARUP. As the intended use of the panel in the clinical laboratory is to test samples that signal positive in the automated blood culture system, negative blood cultures were not specifically tested. Testing was performed, however, if a culture bottle signaled positive, even if organisms were not seen on Gram stain. When more than one sample was collected from a single patient, only the first positive sample was analyzed. Samples were de-identified and frozen within 2 hours of the blood culture signaling positive. All investigators testing samples on the FA were blinded to culture results.
Data Analysis
FA Results
Automated calls for the assays in the FA BC pouch were made using a beta version of the FA software (Poritz, et al., 2011) tuned for the BC pouch. Two investigators (AJB and CH) confirmed all automated calls based on examination of amplification and melt curves.
In this developmental pouch version we observed low-level background contamination of reagents and the pouch. This is a common problem of broad-range PCR-based bacterial detection systems (Chang, et al., 2011; Corless, et al., 2000; Millar, et al., 2002; Philipp, et al., 2010; Sontakke, et al., 2009). Contaminants demonstrated late amplification [after 22 cycles in the second stage PCR (36 cumulative first + second stage cycles)] but generated positive calls by the software. Contaminants were consistent across a production lot of pouches and were identified by positive calls in the 3–5 negative control (water) runs performed for each lot. With this information, positive software calls were classified as contamination if a run was positive for a known lot-contaminating organism and the cycle crossing point was > 22 cycles in the second-stage PCR.
Statistical analysis
For both the validation and prospective studies sensitivity and specificity were calculated for the BC panel overall and for each pathogen on the BC panel independently. 95% confidence intervals were calculated according to the efficient-score method (corrected for continuity) (Newcombe, 1998). Blood culture was considered the gold standard. A FA test positive was identified when the FA BC assay was positive for a pathogen, and a true positive was identified when the blood culture was positive for the same pathogen. For specificity calculation, all samples negative for a particular pathogen were included.
Results
Clinical validation study using retrospectively collected positive blood cultures
Initial validation of the BC panel was performed on 102 clinical blood culture samples selected to be positive for organisms representing the majority of panel pathogens. These samples were tested retrospectively. Sixteen different pathogens were represented. No clinical specimens containing Listeria monocytogenes, Acinetobacter baumanii or Candida spp. were available in this study set and thus these are not included in Table 2. Due to the wide confidence intervals around the point estimates of sensitivity, these results are reported with an asterisk for organisms with < 5 clinical samples available (Table 2). Organisms containing vanA/B/C and mecA were tested, but no organisms were found either by culture or FA to be carbapenem-resistant or to contain blaKPC.
Table 2.
Organism | Culture | FA | Culture+/FA− | Culture−/FA+ | % Sensitivity (95% CI) | % Specificity (95% CI) |
---|---|---|---|---|---|---|
Total | 109 | 106 | 5 | 3 | 95 (89–98) | N/A |
S. pneumoniae | 8 | 8 | - | - | 100 (60–100) | 100 (95–100) |
S. agalactiae | 2 | 3 | - | 1b | 100* (20–100) | 99 (94–100) |
S. pyogenes | 6 | 5 | 1a | - | 83 (36–99) | 100 (95–100) |
Streptococcus spp | 7 | 7 | - | - | 100 (56–100) | 100 (95–100) |
S. aureus | 14 | 14 | 1b | 1c | 93 (64–100) | 99 (93–100) |
CONS | 16 | 14 | 2c,d | 1e | 88 (60–98) | 99 (93–100) |
Enterococcus spp | 14 | 14 | - | - | 100 (73–100) | 100 (95–100) |
E. coli | 10 | 9 | 1a | - | 90 (54–99) | 100 (95–100) |
K. oxytoca | 7 | 7 | - | - | 100 (56–100) | 100 (95–100) |
K. pneumoniae | 3 | 3 | - | - | 100* (31–100) | 100 (95–100) |
E. cloacae | 5 | 5 | - | - | 100 (46–100) | 100 (95–100) |
S. marcescens | 4 | 4 | - | - | 100* (40–100) | 100 (95–100) |
Enterobacteriaceae | 4 | 4 | - | - | 100* (40–100) | 100 (95–100) |
N. meningitidis | 3 | 3 | - | - | 100* (31–100) | 100 (95–100) |
H. influenzae | 1 | 1 | - | - | 100* (5–100) | 100 (95–100) |
P. aeruginosa | 5 | 5 | - | - | 100 (46–100) | 100 (95–100) |
AbxR | ||||||
mecA (MRSA) | 4 | 4 | - | - | 100* (40–100) | 100 (63–100) |
vanA/B/C (VRE) | 1 | 3 | - | 2f | 100* (5–100) | 85 (54–97) |
Less than 5 positive cultures tested
Sample negative by both alternative organism-specific PCR and by broad-range 16S PCR.
Culture positive for S. aureus/FA positive for S. agalactiae; S. agalactiae confirmed by standard PCR and sequencing.
Culture positive for CONS/FA positive for S. aureus; S. aureus confirmed by standard PCR and sequencing.
Culture positive for CONS/FA negative; could not rule out a CONS species missed by the FA assay.
Culture negative, FA positive for CONS; S. epidermidis confirmed by standard PCR and sequencing.
One sequence positive for E. faecium/vanA; one sequence positive for E. casseliflavus/vanC
From 102 clinical specimens, 109 pathogens were identified by culture (7 cultures were positive for more than one organism). Of the 109 pathogens identified by culture, 104 (95%) were also identified by FA. Three pathogens identified by FA were not identified by culture. Sensitivity for each pathogen ranged from 83–100% and specificity was 99% or greater for all. (Table 2)
The culture-positive/FA-negative discordant samples were analyzed using standard PCR. In 2 cases the specimen was also negative using both an alternative organism-specific assay as well as broad-range (16S) PCR, suggesting a mislabeled or incorrect culture sample. In two discordant samples in which culture and FA identified different pathogens, standard PCR and sequencing demonstrated that the organism identified by FA was correct. In one case of a culture-identified CONS missed by FA, the organism could not be detected using alternative PCR strategies. In the case of a FA-identified CONS not identified by culture, sequencing confirmed the presence of S. epidermidis.
Antibiotic resistance testing demonstrated good concordance with conventional susceptibility data. Thirteen S. aureus were identified by both culture and FA, of which 4 were methicillin-resistant S. aureus (MRSA) by susceptibility testing. The FA appropriately identified all S. aureus as MSSA (mecA negative) or MRSA (mecA positive). Of 13 enterococci identified, one was found by culture to be vancomycin-resistant (VRE) and positive for vanA/B/C by FA. Two enterococci tested susceptible to vancomycin in the microbiology laboratory but tested positive for vanA/B/C by FA. One of these isolates was identified by culture, standard PCR, and sequencing as E. faecium. PCR and sequencing also demonstrated the vanA gene to be present, with E. faecium-specific vanA polymorphisms based on alignment to sequences in GenBank. The other sample, identified by culture as vancomycin-susceptible E. faecalis, was identified by sequencing as E. casseliflavus containing the vanC gene.
Prospective analysis of sequentially collected samples
One hundred eleven blood culture samples were tested in this study (Table 3). Ninety-three were culture-positive. Eighteen were Gram-stain and culture-negative despite signaling positive on the automated blood culture machine. The 93 positive cultures grew 99 organisms (6 dual-positive cultures), of which 92 (93%) were pathogens included in the BC panel. Seven were positive for non-panel organisms [Micrococcus spp. (n=3); Corynebacterium spp., Fusobacterium nucleatum, Propionibacterium acnes, Diptheroids (n=1 each)]. In this study set there were no samples positive by culture or FA for L. monocytogenes, E. cloacae, N. meningitidis or H. influenzae and no pathogens contained blaKPC.
Table 3.
Organism | Culture | FA | Culture+/FA− | Culture−/FA+ | % Sensitivity (95% CI) | % Specificity (95% CI) |
---|---|---|---|---|---|---|
Total | 92* | 89 | 8** | 7 | 91 (83–96) | 77 (58–90) |
S. pneumoniae | 3 | 3 | - | - | 100$ (31–100) | 100 (96–100) |
S. agalactiae | 2 | 2 | - | - | 100$ (20–100) | 100 (96–100) |
S. pyogenes | 3 | 3 | - | - | 100$ (31–100) | 100 (96–100) |
Streptococcus spp | 11 | 11 | - | 1i | 100 (66–100) | 99 (94–100) |
S. aureus | 12 | 13 | - | 1f | 100 (70–100) | 99 (94–100) |
CONS | 29 | 27 | 3d† | 2g,h | 89 (71–97) | 98 (91–100) |
Enterococcus spp | 8 | 7 | 1a† | - | 88 (47–99) | 100 (96–100) |
E. coli | 4 | 5 | - | 1e | 100$ (40–100) | 99 (94–100) |
K. oxytoca | 0 | 1 | - | 1c | - | 99 (94–100) |
K. pneumoniae | 5 | 5 | - | - | 100 (46–100) | 100 (96–100) |
S. marcescens | 2 | 1 | 1b† | - | 50$ (3–97) | 100 (96–100) |
Enterobacteriaceae | 4 | 3 | 1c | - | 75$ (22–99) | 100 (96–100) |
P. aeruginosa | 2 | 2 | - | - | 100$ (20–100) | 100 (96–100) |
A. baumanii | 0 | 1 | - | 1e | - | 99 (94–100) |
C. albicans | 4 | 3 | 1a | - | 75$ (22–99) | 100 (96–100) |
Candida non-albicans | 2 | 1 | 1a | - | 50$ (3–97) | 100 (96–100) |
Not in panel | 7 | All neg | 7 | - | N/A | N/A |
Negative | 18 | 21 | 4 | 1g | N/A | N/A |
AbxR | ||||||
mecA (MRSA) | 3 | 3 | - | 100$ (31–100) | 100 (63–100) | |
vanA/B (VRE) | 4 | 4 | - | - | 100$ (40–100) | 100 (31–100) |
not counted: organisms not in BCID panel
in 2 cases, 2 organisms of one species were detected by culture (viridians streptococci/CONS). The species-level FA assay could not differentiate the two, but this was not counted as a missed organism.
Less than 5 positive cultures tested
Identified in the culture using standard nested PCR with an increased number of cycles.
Not identified in this culture with increased cycles, but identified in subsequent cultures from the same subject.
Culture positive for Salmonella enterica/FA positive for Klebsiella oxytoca; standard PCR and sequencing identified S. enterica.
2 episodes in which CONS assay negative by FA, but mecA positive
Gram stain positive for 2 types of GNR; FA PCR positive for E. coli and A. baumanii, confirmed by standard PCR and sequencing.
S.aureus confirmed by standard PCR and sequencing.
Culture negative. CONS (S. haemolyticus) confirmed by standard PCR and sequencing
Cross-reactivity of S. aureus with CONS primers confirmed by sequencing
Confirmed by standard PCR and sequencing as S. mitis/oralis
Missed organism in a dual-positive culture
The FA identified 84 of the 92 (91%) BC pathogens identified by culture. Sensitivity varied by organism, and some organisms were rarely seen, but all assays had high specificity (Table 3). The overall likelihood ratio positive for the test was 4 and the likelihood ratio negative was 0.11.
In two instances, a culture was positive for two different organisms of the same genus [2 different species of viridans streptococci (n = 1) and 2 species of CONS (n = 1)]. These could not be resolved by the genus-level PCR and were not counted as discordant results. FA accurately identified all S. aureus as MSSA or MRSA and all enterococci as susceptible or resistant to vancomycin. Except for one coagulase-negative staphylococcus detection by FA, all culture-negative samples and those positive for pathogens not in the BC panel were negative by FA.
FA did not identify eight pathogens identified in the 92 blood cultures. In six instances (6.5%) these were shown to be FA false-negatives. In three of these cases (2 yeast and 1 Enterococcus spp.) standard PCR with an increased number of cycles identified the organism. In two cases, samples positive for CONS by culture were negative by the CONS FA assay, although the mecA gene PCR was positive. In one case, S. marcescens identified in culture was not detected by FA or with an increased number of cycles in standard PCR, but was found by both culture and PCR in subsequent blood cultures from the same patient. Three of the 8 (37.5%) missed organisms were in dual-positive cultures; FA correctly identified one of the pathogens but did not detect the second. In 2 instances, primer cross-reactivity resulted in misidentification of organisms: in one culture positive for Salmonella enterica the FA misidentified the organism as Klebsiella oxytoca; in another case, FA identified CONS as well as S. aureus in a culture positive for S. aureus alone. The CONS identification was confirmed to be a cross-amplification of this particular S. aureus by the CONS primers.
Seven pathogens identified by FA were not identified by culture. While 2 were the result of the primer cross-reactivity described above, the other five organisms identified by FA but not by culture were likely true positives. In one case, Gram stain of BACTEC bottles showed Gram-negative rods, but no growth was detected on culture. FA identified two organisms, E. coli and Acinetobacter baumanii, both of which were confirmed by standard PCR and sequencing. In two cases, the FA identified a second organism in cultures that yielded growth for only one organism. In the first, S. aureus was detected by FA in a sample also culture and PCR positive for GAS. In the second, S. mitis/oralis was detected by FA in a sample also culture and PCR positive for CONS. In each case, the presence of both pathogens was confirmed by PCR and sequencing. Finally the FA identified a CONS that was confirmed by PCR and sequencing to be present in a clinical specimen that was negative by culture.
Discussion
Rapid identification of organisms causing sepsis is critical to reducing inappropriate antibiotic use and infection-related morbidity and mortality. Here we describe preliminary development and clinical testing of a novel molecular diagnostic test for the identification of organisms in positive blood culture based on the FilmArray® System (Poritz, et al., 2011). The FA BC panel identifies a wide range of bacterial and fungal pathogens, accounting for 93% of organisms isolated from clinical specimens in our study. In addition, the panel identifies select antibiotic resistance genes, including those responsible for resistance to methicillin, vancomycin and carbapenems. Identification of pathogens and resistance markers was achieved from clinical samples with good sensitivity and specificity for all targets. An analysis of prospectively obtained blood cultures demonstrated accurate identification of 91% of pathogens and 100% of MRSA and VRE. When fully developed, this technology has the potential to contribute significantly to improvements in the management of adults and children with sepsis.
Rapid molecular identification of organisms from positive blood cultures is increasingly available in clinical laboratories. Both PCR and probe-based platforms are commercially available, but all have limitations. In the U.S., the Xpert® MRSA/SA BC assay (Cepheid, Sunnyvale, CA) and the fluorescence in situ hybridization method employing novel peptide-nucleic acids as probes (PNA-FISH®; AvanDx, Woburn, MA) are available, but both target limited numbers of organisms or require several panels (Hensley, et al., 2009; Morgan, et al., 2010; Shepard, et al., 2008). In Europe, bacterial detection methods from blood culture based on broad-range PCR are available that target a larger range of organisms in a single assay, but downstream identification using ELISA (Hyplex®; Cepheid Benelux, Bouwel, Belgium) or microarray hybridization (Prove-it™ Sepsis; Mobidiag, Helsinki, Finland) is required. One of the most comprehensive systems under investigation is based on matrix-assisted laser desorption ionization time-of-flight (MALDI-TOF) mass spectrometry (La Scola and Raoult, 2009; Stevenson, et al., 2010). MALDI-TOF has the advantage of rapid turn-around time, modest sample preparation, and the ability to directly identify a large range of microorganisms. Disadvantages include the high start-up costs associated with the purchase of mass-spectrometry equipment and training of personnel.
Identification of blood culture pathogens using the FilmArray® System’s BC panel has several advantages. A particular strength is the large number of targets, all evaluated in a single test, covering the majority of organisms detected in both adult and pediatric blood cultures. In this study, organisms identified by blood culture but not contained in the FA BC panel primarily included those often considered contaminants, such as diphtheroids and micrococcus. In addition, the FA System performs all steps of the assay, from nucleic acid extraction to interpretation of amplification data in closed system using a single pouch on a minimally processed clinical sample. The laboratory procedures required are not technologically complex and can be performed by persons who do not have training in molecular techniques (Poritz, et al., 2011).
Our clinical validation study of 102 retrospectively-collected blood culture samples demonstrated accurate identification of most pathogens. In the primary analysis there were 8 discordant identifications (5 culture+/FA−; 3 culture−/FA+), however all but one identification (of CONS) could be resolved in favor of the FA. Specificity was high for all pathogens, including species-specific and genus-level targets. Specificity was comparable to that of the VITEK2 for cultured organisms, for which the accuracy of identification ranges from 92–97% (Abele-Horn, et al., 2006; Nonhoff, et al., 2005; O’Hara and Miller, 2003; Rennie, et al., 2008).
The FA BC panel also contains antibiotic resistance markers. MRSA is a well-described health-threat (Klevens, et al., 2007), and a number of commercially available panels can distinguish MRSA from methicillin-susceptible strains through the identification of the mecA gene that is also identified in our panel. While in Europe a Nanosphere panel (Verigene System, Nanosphere, Northbrook IL) is available for detection of the primary genetic determinants of vancomycin-resistance in enterococci [vanA and vanB] (Courvalin, 2006), no commercially available panels approved for blood culture in the U.S. contain assays for vanA and vanB or carbapenem-resistance in enteric organisms [blaKPC] (Nordmann, et al., 2009).
In choosing resistance targets for the BC panel, we chose genes in which detection of the resistance marker almost always indicates a phenotypically drug-resistant organism. We had one true genotype-phenotype discordance detected with regard to vancomycin susceptibility in our validation study: an E. faecium that was PCR positive for vanA, yet phenotypically vancomycin-susceptible. This discordance has been rarely reported (Choi, et al., 2011).
Our prospective study of consecutively collected samples was designed to evaluate the performance of the system on an unbiased selection of positive blood cultures. Overall, the system performed well, although the sensitivity was lower for Serratia marcescens (1/2), broad Enterobacteriaceae detection (3/4) and yeasts (4/6). The small numbers of samples preclude accurate assessment of the sensitivity for these organisms, however for others, sensitivity was good (88–100%). Specificity was >98% for all organisms.
There are limitations to the BC system at this point in development. While comprehensive, the FA BC panel does not detect all possible organisms. This reflects both a limitation in the number of assays that could be placed into the multiplex, and a conscious decision to primarily target organisms that occur at a high enough frequency to support FDA clearance. Sensitivity was not an issue for most organisms, however two of six Candida species detected in culture were not detected by FA. We hypothesized that yeast might signal “positive” at lower titers in automated blood culture systems. We performed growth studies in which the concentration of yeast at the time of culture positivity ranged from 103 – 107 CFU/ml rather than the 107 – 1011 seen with bacteria (Tan, et al., 2008) similar to another published report (Chang, et al., 2000). For this reason we are evaluating multi-copy rather than single-copy targets for yeast detection.
Polymicrobial culture was the most common reason that a cultured organism went undetected by PCR. Approximately 7% of blood cultures in the prospective study were polymicrobial, however in three of eight (38%) instances in which the FA did not detect a pathogen, the blood culture was positive for two organisms. We speculate that in cultures positive for two organisms, one may grow more rapidly and trigger a positive signal in the culture system. At the time of the positive call, the second organism may be below the level of molecular detection.
As often reported for PCR-based detection systems that evaluate a broad range of bacteria, contamination of reagents and materials was an issue in this developmental version of the system (Chang, et al., 2011; Corless, et al., 2000; Millar, et al., 2002; Philipp, et al., 2010; Sontakke, et al., 2009). This is most often reported for 16S PCR-based detection, however in our system we have specific assays for potentially contaminating bacteria such as CONS and E. coli. At the level of research and development this was not a significant issue for evaluation of the sensitivity and specificity of the panel. In positive blood cultures, second stage crossing thresholds for culture-identified organisms were generally in the range of 13–16 cycles. The level of contamination in the pouches was quite low, with second stage PCR crossing thresholds beyond 22 cycles [36 cumulative cycles] or signal only detected by the presence of a melting curve. Current development efforts are focused on eliminating detectible contamination through improvements in manufacturing as well as software cutoffs for commonly contaminating organisms. Overall system sensitivity must be maintained for the detection of yeasts and polymicrobial cultures as previously discussed.
A primary limitation of this study was the low number of samples positive for some organisms. While nucleic acid testing demonstrated good sensitivity and specificity of assays such as those for L. monocytogenes, N. meningitidis and H. influenzae, the low number of positive blood culture specimens makes clinical sensitivity hard to determine. In addition, there were no clinical specimens demonstrating carbapenem resistance or that were positive by PCR for blaKPC. Additional studies, including at sites with higher rates of resistance will be necessary for clinical evaluation of these assays.
Overall the FA BC panel demonstrated accurate identification of pathogens found in positive blood cultures from both adult and pediatric patients. This panel identifies a larger range of pathogens than most currently available platforms in a system that is technically simple for the laboratory. The data presented here suggest that the FA BC system could be an important and useful tool for the management of bloodstream infection in the future.
Acknowledgments
This work was supported by: NIH/NIAID: 1K23AI079401 (AJB); 1U01AI082184 (AJB, ATP, JAD, IO); NIH/NICHD K24HD047249, 1U01AI082482 (CLB), 1U01AI074419 (CLB, MP, JAD); U01A1061611 (MAP, CLB); CDC: 1U18IP000303 (AJB, ATP, CLB) and NIH/NCRR UL1RR025764 (AJB, CLB).
Footnotes
Portions of this work were presented as a poster presentation at the American Society for Microbiology Annual Meeting, 2011 (New Orleans, LA)
Conflict of Interest: CH, EB, NFG, ST, GDA, KMR, IO and MAP are or were at the time of the study employees of Idaho Technology, Inc. AJB, CLB, JAD and ATP collaborate with Idaho Technology, Inc., on several NIH and CDC-funded projects (see funding above).
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
References
- Abele-Horn M, Stoy K, Frosch M, Reinert RR. Comparative evaluation of a new Vitek 2 system for identification and antimicrobial susceptibility testing of Streptococcus pneumoniae. Eur J Clin Microbiol Infect Dis. 2006;25:55–7. doi: 10.1007/s10096-005-0071-1. [DOI] [PubMed] [Google Scholar]
- Bauer KA, West JE, Balada-Llasat JM, Pancholi P, Stevenson KB, Goff DA. An antimicrobial stewardship program’s impact with rapid polymerase chain reaction methicillin-resistant Staphylococcus aureus/S. aureus blood culture test in patients with S. aureus bacteremia. Clin Infect Dis. 2010;51:1074–80. doi: 10.1086/656623. [DOI] [PubMed] [Google Scholar]
- Benson DA, Karsch-Mizrachi I, Lipman DJ, Ostell J, Sayers EW. GenBank. Nucleic Acids Res. 2011;39:D32–7. doi: 10.1093/nar/gkq1079. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Biedenbach DJ, Moet GJ, Jones RN. Occurrence and antimicrobial resistance pattern comparisons among bloodstream infection isolates from the SENTRY Antimicrobial Surveillance Program (1997–2002) Diagn Microbiol Infect Dis. 2004;50:59–69. doi: 10.1016/j.diagmicrobio.2004.05.003. [DOI] [PubMed] [Google Scholar]
- Bochud PY, Glauser MP, Calandra T. Antibiotics in sepsis. Intensive Care Med. 2001;27 (Suppl 1):S33–48. doi: 10.1007/pl00003796. [DOI] [PubMed] [Google Scholar]
- Chang HC, Chang JJ, Huang AH, Chang TC. Evaluation of a capacitance method for direct antifungal susceptibility testing of yeasts in positive blood cultures. J Clin Microbiol. 2000;38:971–6. doi: 10.1128/jcm.38.3.971-976.2000. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chang SS, Hsu HL, Cheng JC, Tseng CP. An efficient strategy for broad-range detection of low abundance bacteria without DNA decontamination of PCR reagents. PLoS One. 2011;6:e20303. doi: 10.1371/journal.pone.0020303. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Choi HJ, Nam D, Peck KR, Song JH, Shin D, Ko KS. Loss of vancomycin resistance not completely dependent on the Tn1546 element in Enterococcus faecium isolates. Diagn Microbiol Infect Dis. 2011;69:105–10. doi: 10.1016/j.diagmicrobio.2010.08.030. [DOI] [PubMed] [Google Scholar]
- Clark NC, Teixeira LM, Facklam RR, Tenover FC. Detection and differentiation of vanC-1, vanC-2, and vanC-3 glycopeptide resistance genes in enterococci. J Clin Microbiol. 1998;36:2294–7. doi: 10.1128/jcm.36.8.2294-2297.1998. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cockerill FR, 3rd, Wilson JW, Vetter EA, Goodman KM, Torgerson CA, Harmsen WS, et al. Optimal testing parameters for blood cultures. Clin Infect Dis. 2004;38:1724–30. doi: 10.1086/421087. [DOI] [PubMed] [Google Scholar]
- Cole JM, Schuetz AN, Hill CE, Nolte FS. Development and evaluation of a real-time PCR assay for detection of Klebsiella pneumoniae carbapenemase genes. J Clin Microbiol. 2009;47:322–6. doi: 10.1128/JCM.01550-08. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Corless CE, Guiver M, Borrow R, Edwards-Jones V, Kaczmarski EB, Fox AJ. Contamination and sensitivity issues with a real-time universal 16S rRNA PCR. J Clin Microbiol. 2000;38:1747–52. doi: 10.1128/jcm.38.5.1747-1752.2000. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Courvalin P. Vancomycin resistance in gram-positive cocci. Clin Infect Dis. 2006;42 (Suppl 1):S25–34. doi: 10.1086/491711. [DOI] [PubMed] [Google Scholar]
- Dellinger RP, Levy MM, Carlet JM, Bion J, Parker MM, Jaeschke R, et al. Surviving Sepsis Campaign: international guidelines for management of severe sepsis and septic shock: 2008. Crit Care Med. 2008;36:296–327. doi: 10.1097/01.CCM.0000298158.12101.41. [DOI] [PubMed] [Google Scholar]
- Fluit AC, Visser MR, Schmitz FJ. Molecular detection of antimicrobial resistance. Clin Microbiol Rev. 2001;14:836–71. doi: 10.1128/CMR.14.4.836-871.2001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hensley DM, Tapia R, Encina Y. An evaluation of the advandx Staphylococcus aureus/CNS PNA FISH assay. Clin Lab Sci. 2009;22:30–3. [PubMed] [Google Scholar]
- Jorgensen JH, Ferraro MJ. Antimicrobial susceptibility testing: a review of general principles and contemporary practices. Clin Infect Dis. 2009;49:1749–55. doi: 10.1086/647952. [DOI] [PubMed] [Google Scholar]
- Klevens RM, Morrison MA, Nadle J, Petit S, Gershman K, Ray S, et al. Invasive methicillin-resistant Staphylococcus aureus infections in the United States. JAMA. 2007;298:1763–71. doi: 10.1001/jama.298.15.1763. [DOI] [PubMed] [Google Scholar]
- Kochanek KD, Xu J, Murphy SL, Minino AM, Kung H-C. Deaths: Preliminary Data for 2009. National Vital Statistics Reports. 2011;59 [PubMed] [Google Scholar]
- Kumar A. Optimizing antimicrobial therapy in sepsis and septic shock. Crit Care Clin. 2009;25:733–51. viii. doi: 10.1016/j.ccc.2009.08.004. [DOI] [PubMed] [Google Scholar]
- La Scola B, Raoult D. Direct identification of bacteria in positive blood culture bottles by matrix-assisted laser desorption ionisation time-of-flight mass spectrometry. PLoS One. 2009;4:e8041. doi: 10.1371/journal.pone.0008041. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mackay IM. Real-time PCR in the microbiology laboratory. Clin Microbiol Infect. 2004;10:190–212. doi: 10.1111/j.1198-743x.2004.00722.x. [DOI] [PubMed] [Google Scholar]
- Mancini N, Carletti S, Ghidoli N, Cichero P, Burioni R, Clementi M. The era of molecular and other non-culture-based methods in diagnosis of sepsis. Clin Microbiol Rev. 2010;23:235–51. doi: 10.1128/CMR.00043-09. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Millar BC, Xu J, Moore JE. Risk assessment models and contamination management: implications for broad-range ribosomal DNA PCR as a diagnostic tool in medical bacteriology. J Clin Microbiol. 2002;40:1575–80. doi: 10.1128/JCM.40.5.1575-1580.2002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Morgan M, Marlowe E, Della-Latta P, Salimnia H, Novak-Weekley S, Wu F, et al. Multicenter evaluation of a new shortened peptide nucleic acid fluorescence in situ hybridization procedure for species identification of select Gram-negative bacilli from blood cultures. J Clin Microbiol. 2010;48:2268–70. doi: 10.1128/JCM.00166-10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Narayanan S. Concepts, principles, and applications of selected molecular biology techniques in clinical biochemistry. Advances in Clinical Chemistry. 1996;32:1–38. doi: 10.1016/s0065-2423(08)60424-2. [DOI] [PubMed] [Google Scholar]
- Newcombe RG. Two-sided confidence intervals for the single proportion: comparison of seven methods. Stat Med. 1998;17:857–72. doi: 10.1002/(sici)1097-0258(19980430)17:8<857::aid-sim777>3.0.co;2-e. [DOI] [PubMed] [Google Scholar]
- Nonhoff C, Rottiers S, Struelens MJ. Evaluation of the Vitek 2 system for identification and antimicrobial susceptibility testing of Staphylococcus spp. Clin Microbiol Infect. 2005;11:150–3. doi: 10.1111/j.1469-0691.2004.01047.x. [DOI] [PubMed] [Google Scholar]
- Nordmann P, Cuzon G, Naas T. The real threat of Klebsiella pneumoniae carbapenemase-producing bacteria. Lancet Infect Dis. 2009;9:228–36. doi: 10.1016/S1473-3099(09)70054-4. [DOI] [PubMed] [Google Scholar]
- O’Hara CM, Miller JM. Evaluation of the Vitek 2 ID-GNB assay for identification of members of the family Enterobacteriaceae and other nonenteric gram-negative bacilli and comparison with the Vitek GNI+ card. J Clin Microbiol. 2003;41:2096–101. doi: 10.1128/JCM.41.5.2096-2101.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Persson K, Hamby K, Ugozzoli LA. Four-color multiplex reverse transcription polymerase chain reaction--overcoming its limitations. Anal Biochem. 2005;344:33–42. doi: 10.1016/j.ab.2005.06.026. [DOI] [PubMed] [Google Scholar]
- Philipp S, Huemer HP, Irschick EU, Gassner C. Obstacles of Multiplex Real-Time PCR for Bacterial 16S rDNA: Primer Specifity and DNA Decontamination of Taq Polymerase. Transfus Med Hemother. 2010;37:21–8. doi: 10.1159/000265571. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Poritz MA, Blaschke AJ, Byington CL, Meyers L, Nilsson K, Jones DE, et al. FilmArray, an automated nested multiplex PCR system for multi-pathogen detection: development and application to respiratory tract infection. PLoS One. 2011;6:e26047. doi: 10.1371/journal.pone.0026047. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rennie RP, Brosnikoff C, Shokoples S, Reller LB, Mirrett S, Janda W, et al. Multicenter evaluation of the new Vitek 2 Neisseria-Haemophilus identification card. J Clin Microbiol. 2008;46:2681–5. doi: 10.1128/JCM.00449-08. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sayers EW, Barrett T, Benson DA, Bolton E, Bryant SH, Canese K, et al. Database resources of the National Center for Biotechnology Information. Nucleic Acids Res. 2011;39:D38–51. doi: 10.1093/nar/gkq1172. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shepard JR, Addison RM, Alexander BD, Della-Latta P, Gherna M, Haase G, et al. Multicenter evaluation of the Candida albicans/Candida glabrata peptide nucleic acid fluorescent in situ hybridization method for simultaneous dual-color identification of C. albicans and C. glabrata directly from blood culture bottles. J Clin Microbiol. 2008;46:50–5. doi: 10.1128/JCM.01385-07. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sontakke S, Cadenas MB, Maggi RG, Diniz PP, Breitschwerdt EB. Use of broad range16S rDNA PCR in clinical microbiology. J Microbiol Methods. 2009;76:217–25. doi: 10.1016/j.mimet.2008.11.002. [DOI] [PubMed] [Google Scholar]
- Stevenson LG, Drake SK, Murray PR. Rapid identification of bacteria in positive blood culture broths by matrix-assisted laser desorption ionization-time of flight mass spectrometry. J Clin Microbiol. 2010;48:444–7. doi: 10.1128/JCM.01541-09. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tan TY, Ng LS, Kwang LL. Evaluation of disc susceptibility tests performed directly from positive blood cultures. J Clin Pathol. 2008;61:343–6. doi: 10.1136/jcp.2007.050757. [DOI] [PubMed] [Google Scholar]