Skip to main content
PLOS One logoLink to PLOS One
. 2021 Apr 30;16(4):e0250767. doi: 10.1371/journal.pone.0250767

Real-time gastrointestinal infection surveillance through a cloud-based network of clinical laboratories

Juliana M Ruzante 1,*, Katherine Olin 2, Breda Munoz 1,¤, Jeff Nawrocki 2, Rangaraj Selvarangan 3, Lindsay Meyers 4
Editor: Baochuan Lin5
PMCID: PMC8087049  PMID: 33930062

Abstract

Acute gastrointestinal infection (AGI) represents a significant public health concern. To control and treat AGI, it is critical to quickly and accurately identify its causes. The use of novel multiplex molecular assays for pathogen detection and identification provides a unique opportunity to improve pathogen detection, and better understand risk factors and burden associated with AGI in the community. In this study, de-identified results from BioFire® FilmArray® Gastrointestinal (GI) Panel were obtained from January 01, 2016 to October 31, 2018 through BioFire® Syndromic Trends (Trend), a cloud database. Data was analyzed to describe the occurrence of pathogens causing AGI across United States sites and the relative rankings of pathogens monitored by FoodNet, a CDC surveillance system were compared. During the period of the study, the number of tests performed increased 10-fold and overall, 42.6% were positive for one or more pathogens. Seventy percent of the detections were bacteria, 25% viruses, and 4% parasites. Clostridium difficile, enteropathogenic Escherichia coli (EPEC) and norovirus were the most frequently detected pathogens. Seasonality was observed for several pathogens including astrovirus, rotavirus, and norovirus, EPEC, and Campylobacter. The co-detection rate was 10.2%. Enterotoxigenic E. coli (ETEC), Plesiomonas shigelloides, enteroaggregative E. coli (EAEC), and Entamoeba histolytica were detected with another pathogen over 60% of the time, while less than 30% of C. difficile and Cyclospora cayetanensis were detected with another pathogen. Positive correlations among co-detections were found between Shigella/Enteroinvasive E. coli with E. histolytica, and ETEC with EAEC. Overall, the relative ranking of detections for the eight GI pathogens monitored by FoodNet and BioFire Trend were similar for five of them. AGI data from BioFire Trend is available in near real-time and represents a rich data source for the study of disease burden and GI pathogen circulation in the community, especially for those pathogens not often targeted by surveillance.

Introduction

Every year around the world, 1.5 to 2.5 million children under the age of five die from diarrhea, one of the main symptoms of acute gastrointestinal infections (AGI) [1]. In the United States, AGI accounts for 178.8 million cases a year [2], representing a significant burden to public health. AGI can be caused by a wide range of noninfectious and infectious agents. To effectively control and reduce the disease burden associated with AGI, it is critical to understand which agent is causing the disease, how frequently and when infection occurs in the population, and the potential sources of exposure. Surveillance systems often rely on cases that are reported to public health authorities to compile and analyze this information and monitor the occurrence of illnesses in a population. Among the critical events that must occur for a disease to be reported to authorities is the identification of the AGI agent(s) by clinical laboratories [3]. The quick and accurate identification of the cause of illness is also essential for the effective treatment of AGI patients, which can result in shorter hospital stays, appropriate use of antimicrobials, avoidance of unnecessary isolation of patients, and cost savings [4, 5].

Bacteria, viruses, and parasites are among the infectious agents frequently associated with AGI [6]. Historically, clinical diagnoses and surveillance efforts have been mainly focused on bacteria and relied on culture methods to detect and characterize GI pathogens. Culture is highly specific, only detecting viable organisms that can be cultured. Culture has been the diagnostic pillar for foodborne disease surveillance providing isolates that can be furthered analyzed to obtain information for outbreak detection, food source attribution, and antimicrobial resistance monitoring [79]. However, culturing methods can be expensive, time consuming, and limited to organisms for which methods have been validated [4]. Given that culture methods for most pathogens are specific, and often AGI symptoms are generic, it might not always be evident to physicians which type of culture tests to order, potentially resulting in the request of diagnostic tests that will not identify the actual cause of the infection [4, 10, 11]. Novel molecular based culture-independent diagnostics tests (CIDTs), on the other hand, can detect ten or more pathogens in a single test, increasing the likelihood of identifying pathogens especially for which culture is not available or not often requested [4, 5]. Further, CIDTs are highly sensitive, faster, and generally more cost-effective than culture methods [4, 5]. For those reasons, their usage in clinical laboratories is increasing, even though they do not yield an isolate and may detect genetic material from non-viable organisms unrelated to disease.

One example of an FDA-cleared molecular based CIDT, is the BioFire® FilmArray® Gastrointestinal (GI) Panel [12]. The technology used is based on the extraction, amplification, and detection of target nucleic acid sequences by real-time polymerase chain reaction (RT-PCR) and melting curve analysis. The BioFire GI Panel detects 22 pathogens, including 13 bacteria, 5 viruses, and 4 parasites in patients’ stool samples [12]. The BioFire GI Panel is a qualitative test that has been validated with human stool collected in Cary Blair transport medium [12]. The indications for use of the test are only for patients with signs and symptoms of AGI and its methodology has been described in detail previously [12, 13]. Clinical laboratories using BioFire® FilmArray® Panels for respiratory and gastrointestinal pathogens have the option to upload de-identified test results to a BioFire cloud database named BioFire® Syndromic Trends (Trend) in near real-time [14, 15]. BioFire Trend then aggregates results from participating clinical laboratories across the globe. The use of BioFire Trend for the surveillance of respiratory pathogens has been previously described [15], but there is no equivalent study conducted on GI pathogens.

While CIDTs pose some immediate challenges to the current way GI pathogens are surveyed by not immediately yielding an isolate [79], they also provide a unique opportunity for the public health community to both improve pathogen detection and better understand the circulation and burden of AGI in the community. To explore and convey the potential use of CIDTs, data from BioFire Trend was obtained, described, and a subset was compared to data from the Foodborne Diseases Active Surveillance Network (FoodNet), an active surveillance system from the Centers for Disease Control and Prevention (CDC) for selected foodborne pathogens frequently associated with AGI [3].

Materials and methods

BioFire Trend GI data was extracted in July 2019 for the period of January 01, 2016 to October 31, 2018 (34 months). The dataset contained de-identified clinical test variables, anonymized at the participating site level, and included: laboratory location, organism(s) detected, approximate date of the test (obfuscated for privacy) for all participating BioFire Trend sites using the BioFire GI Panel. The test time obfuscation process imports tests from each site in sets of three tests, leading to an average of hours to a couple days between actual time and time recorded in BioFire Trend. To ensure the panel was being routinely used for patient testing and not for test validation, only sites utilizing an average of 10 or more GI tests per month with a median monthly test count within 20% of the mean were included in this study. Additionally, only sites located in the United States were selected. An IRB waiver was obtained as the study did not involve private, identifiable human subjects data, interactions with any human subject, and did not constitute research involving human subjects as defined by the United States Code of Federal Regulations (45 CFR 46.102) [16].

Time series plots were calculated using a centered three-week moving average for the number of tests and number of detections in BioFire Trend. The overall percentage of positives was calculated as the number of pathogen detections over the total number of GI tests performed, including negative tests, for all the 34 months. Further, to estimate seasonality, pathogen specific percentage of positives were calculated overtime using a centered three-week moving average where the number of detections for a given pathogen was divided by the total number of tests performed (including negatives).

The overall co-detection rate was estimated as the number of tests positive for multiple pathogens (e.g.: 2 or more pathogens detected in the same test) divided by the total number of tests, including negative tests. The proportion of co-detection for each pathogen was estimated as the number of a given pathogen detected with one more organism (i.e.: 2 detections) or two (i.e.: 3 detections) divided by the total number of the given pathogen detected during all the 34 months.

To further explore the potential associations between different GI pathogens being detected together, pairwise pathogen correlations were conducted and the phi coefficient was calculated for each pathogen combination across all positive tests with two and three pathogens detected in the same test.

The proportion of detection for eight pathogens monitored by CDC’s FoodNet surveillance network: Salmonella, Campylobacter, Shigella, Yersinia, Shiga toxin-producing Escherichia coli (STEC), Vibrio, Cryptosporidium, and Cyclospora was calculated to compare their magnitude of detection and relative ranking with data obtained from BioFire Trend for the same time period. FoodNet regularly contacts the clinical laboratories located in 10 states, covering about 15% of the United States population [3]. Data from FoodNet is still subjected to underreporting and underdiagnosis [3], however out of the surveillance systems for the eight pathogens above, its data is the most reliable, accessible, and therefore was selected as the dataset for our comparison. The number of confirmed and probable pathogen infections were obtained from FoodNet for 2016 and 2017 via an email request to the surveillance program at CDC. The probable cases included results where CIDT was positive and reflex culture (i.e., culture of CIDT-positive specimens) was either negative or was not performed. The FoodNet proportion of detection for each of the eight pathogens was calculated by dividing the total pathogen count by the sum of all FoodNet confirmed and suspected pathogens. The same method was applied to the BioFire Trend dataset for these eight pathogens. BioFire Trend reports Vibrio cholerae and Vibrio non-cholerae, as well as STEC and E. coli O157, however in the data received from FoodNet those pathogens were only characterized as Vibrio and STEC. Therefore, the detections recorded in BioFire Trend for those pathogens were combined respectively into a single Vibrio and STEC category to ensure similar comparisons.

All descriptive and statistical analyses were done using Python 3.7.

Results

BioFire Trend data included a total of 45 clinical laboratories, which consisted of i) laboratories receiving pediatric and non-pediatric patient samples from many medical institutions to one location (20% (9/45)), and ii) in-house laboratories servicing large (>500 beds, 22% (10/45)), medium (100–500 beds, 40% (18/45)), or small hospitals (<100 beds, 18% (8/45)). Out the 45 clinical laboratories, 29 (3 pediatric and 26 general population) met the test utilization criteria for this analysis. From January 01, 2016 through October 31, 2018; 91,401 GI tests were performed by the selected laboratories across 19 states in the United States. Table 1 shows the distribution of tests by year and across the four United States regions as well as the states where the participating laboratories were located. Out of all the tests, 38,943 (42.6%) were positive (detected one or more pathogens) and 52,458 (57.4%) were negative. The total number of tests performed increased approximately 10-fold during the period of the study, from 127 tests per week in January 2016 to 1,226 tests per week in October 2018 (Fig 1). Along with the growth in usage of GI tests, the number of pathogens detected also increased over time (Fig 1). A total of 50,192 organisms were detected during the 34 months of the study. Bacterial pathogens accounted for 71% (35,421/50,192) of all organisms detected, followed by viruses (25%; 12,588/50,192), and parasites (4%; 2,183/50,192). Clostridium difficile (30.4%; 15,257/50,192), Enteropathogenic Escherichia coli (EPEC) (15.6%; 7,848/50,192), and norovirus (11.1%; 5,567/50,192;), represented over half (57.1%) of the pathogens detected during the 34 months of the study (Fig 2).

Table 1. Distribution of test number by United States region and year (N = 91,401) for the 29 clinical laboratories.

Year Region States # Tests in Trend
2016 West AK, CAa, COa, HI, UT, WA 4,511
South GAa, SC, TX 2,531
Northeast NYa 612
Midwest IL, IN, KS, NE, OH, SD, WI 7,353
2017 West AK, CAa, COa, HI, UT, WA 9,216
South GAa, SC, TX 3,801
Northeast NYa, PA 4,154
Midwest IL, IN, KS, MI, NE, OH, SD, WI 14,035
2018 West AK, CAa, COa, HI, ID, UT 9,865
South FL, GAa, SC, TX 3,424
Northeast NYa, PA 9,716
Midwest IA, IL, IN, KS, MI, NE, OH, SD, WI 22,183
Total 91,401

a States (or selected counties in CA and CO) are also FoodNet sites.

Fig 1. Number of BioFire Trend GI tests collected from the selected laboratories (N = 91,401) and detected pathogens from January 2016 through October 2018 (N = 50,192).

Fig 1

Fig 2. Total number of pathogen detections and overall proportion of single and co-detections for 22 GI pathogens in BioFire Trend from January 2016 through October 2018 (N = 50,192).

Fig 2

The pathogen weekly percentage of positives are shown in Fig 3. Overall, the data from BioFire Trend suggests a clear seasonality for several GI pathogens. Astrovirus and norovirus had increased percentage of positives during the winter months (January–March), while the detection of rotavirus increased in the Spring (April and May). Both sapovirus and adenovirus did not seem to vary in their percentage of positive over the period of the study (Fig 3). No seasonal trends were apparent for C. difficile, Y. enterocolitica, and the Vibrios; but percentage of positives increased during the summer months (June-September) for Campylobacter, Salmonella (less pronounced), and Plesiomonas shigelloides. The percentage of positives of EPEC had clear, distinct peaks during the months of August and September; however, those were not as pronounced for the other E. coli types, including Shigella/Enteroinvasive E. coli (EIEC) among others. Of the parasitic GI pathogens evaluated, a significant increase in the percentage of positives was observed for Cryptosporidium around September 2016. Only a few Cyclospora cayetanensis detections (N = 201) were observed; however, across all years those were primarily concentrated between the months of March and September, with increased percentages around July. The pattern of detection for G. lamblia had several peaks during the 34 months for the study, however no distinct season pattern was observed. Only 37 positives were associated with Entamoeba histolytica, with more than 50% (20/37) occurring in October 2016 and April 2017.

Fig 3. Weekly percentage of positives for viral (N = 12,588), bacterial FoodNet (N = 7,798), bacterial non-FoodNet (N = 27,623), and parasitic (N = 2,183) GI pathogens detected using BioFire Trend from January 2016 through October 2018.

Fig 3

The overall co-detection rate was 10.2% (9,356/91,401) of the total number of tests or 24.0% of positive tests (9,356/38,943). Co-detections with two pathogens (79.8%; 7,463/9,356) were more frequent than co-detections with three organisms (20.2%; 1,893/9,356) detected. In the dataset there were 3,889 tests with four or more pathogens detected, however those were excluded from the analysis due to the likelihood that those were validation tests and not actual patient samples. Fig 2 shows the proportion of single detections as well as co-detections (two or three organisms detected) for each of the pathogens from the BioFire GI Panel. Overall the co-detection proportions varied from 26.9% to 71.3% depending on the pathogen. Over 60% of the detections of ETEC, E. histolytica, P. shigelloides, and EAEC were co-detections; while less than 30% of the detections of C. difficile and C. cayetanensis, included another pathogen (Fig 2).

The phi coefficient for each pathogen combination is shown in Fig 4. There was not a strong correlation between any of the pathogen pairs (i.e.: coefficients values between ±0.25); however, C. difficile was generally negatively correlated with other pathogens, especially with EPEC (-0.24). Conversely, the Shigella/EIEC-E. histolytica and ETEC–EAEC pairs have a weak positive correlation with each other, with phi coefficients equal to 0.10 and 0.11, respectively.

Fig 4. Pathogen correlation for all positive tests with two or more pathogens detected (N = 9,356).

Fig 4

(Phi coefficient for each pairwise correlation. Darker red indicates stronger positive correlation between two pathogens, while darker blue indicates negative correlation. The scale range is -0.25 to 0.25).

During 2016 through 2017, there were a total of 49,736 confirmed and suspected infections captured by FoodNet for the eight pathogens Salmonella (16,159), Campylobacter (18,145), Shigella (5,076), Yersinia (816), STEC (5,039), Vibrio (596), Cryptosporidium (3,686), and Cyclospora (219). The proportion of detection for these eight pathogens were compared in Fig 5. Overall, the relative ranking of detections for the eight pathogens were similar between the two data sources, with Campylobacter and Salmonella being the top pathogens for both datasets during 2016 and 2017, and Y. enterocolitica, Vibrio and C. cayetanensis being the lowest ranking for each. Although the relative rankings were comparable, over 69% of the detections in FoodNet were Campylobacter and Salmonella while those pathogens only made up 50.2% of BioFire Trend results for those eight pathogens (Fig 5).

Fig 5. Proportion of detection and relative ranking of eight pathogens monitored by FoodNet (N = 49,736) and reported to BioFire Trend (N = 4,832) during 2016 and 2017.

Fig 5

Discussion

This is the first study to summarize and evaluate a large dataset of test results for 22 GI pathogens obtained from 29 clinical laboratories across the United States that use a multiplex real-time PCR assay, the BioFire GI Panel. The results were obtained from BioFire’s cloud database, BioFire Trend, Syndromic Trends (Trend), which collects, aggregates, and displays calculated de-identified test results in near real-time for participating sites. BioFire Trend data represents patients who seek medical care in institutions that not only used the BioFire GI Panel, but also participated in BioFire Trend. For those reasons, results are not representative of the United States. Nevertheless, the overall percentage of positives, negatives, co-detection rate, as well as the most frequently detected pathogens (i.e.: C. difficile, EPEC, norovirus, EAEC, and Campylobacter) reported in this study were similar to what has been reported in previous studies that used the BioFire GI Panel in clinical settings [12, 1721].

C. difficile was the most frequently detected pathogen in this study; however, without further information such as age and medical history of patients, the clinical and public health relevance of this finding is difficult to interpret but is consistent with what others have found when working with this type of dataset [1721]. Rates of C. difficile are also likely to have been overestimated since we were not able to identify and exclude test results from children under 2 years of age; a population known to have high colonization rates of C. difficile [22] and for which testing for this pathogen is not generally recommended [23]. EPEC and EAEC were also detected frequently, but not much is known about the domestically acquired burden of those two pathogens in developed countries [24, 25]. A study conducted in Minnesota suggested that EAEC represents an important GI pathogen and that the proportion of domestically acquired EAEC infections might be underestimated [24]. Further, it has been suggested that AGI can change host inflammation causing an imbalance in the host microbiota leading to an outgrowth of Enterobacteriales [17, 25]. This could potentially justify the high numbers of EAEC and EPEC found in this study since over 50% of the detections of these two pathogens were associated with other highly prevalent GI pathogens such as C. difficile, norovirus, Salmonella and Campylobacter. The high frequency of detection of EAEC and EPEC found here suggests that those pathogens have a more significant impact in the burden of AGI than previously thought and requires further research to better characterize their epidemiology as well as sources of exposures and risk factors. Norovirus, on the other hand, has a known burden of illness and is estimated to cause over 21 million AGI annually in the United States, making it the leading cause of foodborne diseases, followed by Salmonella [26]. Not surprisingly, norovirus was the third most frequently detected pathogen in this study and also showed a clear seasonality pattern aligned with surveillance reports from the CDC [27].

In addition to norovirus, distinct seasonal trends were observed for rotavirus, astrovirus, and Campylobacter for the 34-month study period. These findings are in agreement with data published in the literature and with surveillance reports presented by CDC [2830]. P. shigelloides and EPEC showed distinct peaks in the percentage of positives during the summer months, also consistent with the literature [31, 32]. The peak percentage rates for P. shigelloides were particularly pronounced during July. This pathogen is often undetected by culture methods because of its small colony size and/or low prevalence in stool samples. As such, P. shigelloides can be easily overlooked; however, PCR-based methods, such as the BioFire FilmArray have increase its detection [32]. A review published on P. shigelloides highlighted the need to investigate risk factors associated with both intestinal and systemic infections and the frequency of co-detection of this pathogen with others [32]. The seasonality of Cryptosporidium, suggested by the increase in the percentage of positives for the pathogen around September and October, differs from data from the CDC that indicates outbreaks peak during summer months [33]. A possible explanation for this difference is that BioFire Trend is capturing sporadic cases of Cryptosporidium, as well as small, localized outbreaks that go undetected by public health agencies given the complexities of disease reporting and potential for underdiagnosis and underreporting [2, 3].

With the increased use of novel molecular CIDTs, the rates of detection of multiple pathogens have also increased. In 2017, the CDC’s Food Safety Modernization Act Surveillance Working Group highlighted the need to better understand those types of detections and their significance [34]. However, only a few studies in the United States have been published describing the interactions between GI pathogens. In a study conducted at the University of Washington and Harborview Medical Centers, co-detections represented 9.8% of all detections of GI pathogens [19]. Patients with more than one pathogen detected in their stool, tended to be younger, and more likely to have traveled internationally [19]. In the current study, the overall patterns of co-detection (i.e., rates, proportions, and correlations) for all 22 pathogens detected over 34 months in 29 medical institutions located across the United States were characterized and was found to be similar to previous published studies [12, 18, 19]; however, because de-identified data was used, further characterization was not possible. The correlations found between pathogens were weak, however, this could be potentially helpful in generating hypotheses that could be further investigated. For instance, while C. difficile was detected in high numbers during the study period, less than 30% of the detections occurred with other organisms and there were negative correlations between the pathogens detected with C. difficile (Fig 4). It might be possible that some of the patients had history of recent antibiotic treatment thereby pre-disposing them to C. difficile while reducing the presence of other GI pathogens [35].

Direct comparisons between Trend and FoodNet rates of detection would not have been appropriate with the data available in this study since they covered different regions in the country (Table 1). However, an initial comparison of the proportion of detection for eight FoodNet pathogens (Campylobacter, Cyclospora, Salmonella, STEC, Cryptosporidium, Shigella, Vibrio, and Yersinia) was done to assess, at the higher level, the magnitude and relative ranking of those eight enteric pathogens across the two datasets. Our findings demonstrated that overall, the relative ranking of the eight pathogens is quite similar with exception of Cryptosporidium and Shigella. Further, the proportion of lower ranking pathogens in BioFire Trend (i.e.: Yersinia, Vibrio and Cyclospora) were higher than in FoodNet potentially due to the comprehensive nature of the BioFire GI Panel (i.e.: every stool is tested for all 22 GI pathogens) which increases the chances of detecting those pathogens that otherwise would not have been identified since clinicians might be less likely to order culture tests for those types of pathogens [11]. A region-by-region comparison between data from BioFire Trend and FoodNet were not possible at the time of the study, because only a few contributing states overlapped (Table 1). Comparisons over time were not done as new participating sites were constantly added during the study period.

In this study, the potential for outbreak detection was not investigated; however, it has been suggested in the literature that the BioFire GI Panel could play a role in early detection of outbreaks [10]. Our data for C. cayetanensis also suggests this possibility. In Fig 3, there are two distinct peaks in the percentage of detection for C. cayetanensis around July 2016 and July 2017; those coincide with two multistate outbreaks detected by the CDC around the same time [36, 37]. The CDC epidemiologic curve is only available for the 2017 outbreak [36] and also shows a sharp increase in the number of cases in the month of July, suggesting BioFire Trend detected the same pattern. There might be potential to explore outbreak detection for those pathogens with discrete percent of positives peaks and that are detected infrequently.

A cornerstone of BioFire Trend is the protection of patient’s privacy. For this reason, the data does not contain any information on age, risk factors, exposure, or medical history. This limitation poses some challenges on how the dataset can be used when interpreting the results, as it has been identified in this paper. However, the benefit of BioFire Trend to public health is not related to the scientific questions that could be answered if demographic and medical histories were available. As demonstrated in this paper, BioFire Trend offers an opportunity to: i) improve the overall understanding of the burden of AGI in the community (especially for those pathogens not often routinely tested or surveyed), ii) track pathogen seasonality, iii) generate scientific hypothesis, and iv) potentially detect outbreaks and monitor pathogens trends over time. Because BioFire Trend results are uploaded to the cloud database within a day, on average, near real-time monitoring of changes in the frequency of detection are possible.

The adoption of multiplex CIDTs is increasing rapidly as shown by the 10-fold increase in tests usage in the 34-month study period, representing a unique chance for public health, as well as the opportunities for the scientific and medical community to learn more about the epidemiology of these pathogens.

Data Availability

There are both legal and ethical restrictions on sharing the data publicly. The data obtained by BioFire is subject to the terms and conditions of a Data Use Agreement (DUA) by and between BioFire and each facility participating in the Trend program. Primarily, the DUA is intended to protect the patient’s privacy and comply with applicable privacy laws and regulations. If a data set is requested, BioFire will review such request internally to ensure that any disclosure does not conflict with BioFire’s obligations and restrictions set forth in the DUA. For more information, contact Joel Hartsell (joel.hartsell@biofiredx.com).

Funding Statement

This study was funded by BioFire Diagnostics. BioFire Diagnostics funded the study at RTI International and provided support in the form of salaries for the following authors: KO, JN, and LM (LM is no longer an employee of BioFire). The specific roles of these authors are articulated in the ‘author contributions’ section. The funders had no additional role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Chow CM, Leung AKC, Hon KL. Acute gastroenteritis: from guidelines to real life. Clin Exp Gastroenterol. 2010; 3: 97–112. 10.2147/ceg.s6554 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Scallan E, Griffin PM, Angulo FJ, Tauxe RV, Hoekstra RM. Foodborne illness acquired in the United States—unspecified agents. Emerg Infect Dis. 2011; 17:16–22. 10.3201/eid1701.091101p2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.The Center for Disease Control and Prevention (CDC). 2015 [cited 30 April 2019]. In: FoodNet surveillance [Internet]. [about 2 screens]. Available from: https://www.cdc.gov/foodnet/surveillance.html
  • 4.Beal SG, Tremblay EE, Toffel S, Velez L, Rand KH. A Gastrointestinal PCR Panel improves clinical management and lowers health care costs. J Clin Microbiol. 2017; 56: e01457–17. 10.1128/JCM.01457-17 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Janda JM, Abbott SA. Culture-independent diagnostic testing: have we opened Pandora’s box for good? Diagn Microbiol Infect Dis. 2014; 80: 171–176. 10.1016/j.diagmicrobio.2014.08.001 [DOI] [PubMed] [Google Scholar]
  • 6.Hall AJ, Wikswo ME, Manikonda K, Roberts VA, Yoder JS, Gould LH. Acute gastroenteritis surveillance through the National Outbreak Reporting System, United States. Emerg Infect Dis. 2013; 19: 1305–1309. 10.3201/eid1908.130482 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Shea S, Kubota KA, Maguire H, Gladbach S, Woron A, Atkinson-Dunn R, et al. Clinical microbiology laboratories’ adoption of culture-independent diagnostic tests is a threat to foodborne-disease surveillance in the United States. J Clin Microbiol. 2016; 55:10–19. 10.1128/JCM.01624-16 Print 2017 Jan. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Atkinson R, Maguire H, Gerner-Smidt P. A challenge and an opportunity to improve patient management and public health surveillance for food-borne infections through culture-independent diagnostics. J Clin Microbiol. 2013; 51:2479–2482. 10.1128/JCM.00253-13 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Cronquist AB, Mody RK, Atkinson R, Besser J, D’Angelo MT, Hurd S, et al. Impacts of culture-independent diagnostic practices on public health surveillance for bacterial enteric pathogens. Clin Infect Dis. 2012; 54: S432–439. 10.1093/cid/cis267 [DOI] [PubMed] [Google Scholar]
  • 10.Buss SN, Alter R, Iwen PC, Fey PD. Implications of culture-independent panel-based detection of Cyclospora cayetanensis. J Clin Microbiol. 2013; 51: 3909. 10.1128/JCM.02238-13 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Stockmann C, Rogatcheva M, Harrel B, Vaughn M, Crisp R, Poritz M, et al. How well does physician selection of microbiologic tests identify Clostridium difficile and other pathogens in paediatric diarrhoea? Insights using multiplex PCR-based detection. Clin Microbiol Infect. 2015; 21:179.e9–179. 10.1016/j.cmi.2014.07.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Buss SN, Leber A, Chapin K, Fey PD, Bankowski MJ, Jones MK, et al. Multicenter evaluation of the BioFire FilmArray gastrointestinal panel for etiologic diagnosis of infectious gastroenteritis. J Clin Microbiol. 2015; 53: 915–925. 10.1128/JCM.02674-14 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Biofire Diagnostics. 2019 [cited 05 November 2019]. In: FilmArray GI reagent instruction booklet—ITI0030. Available from: https://www.online-ifu.com/ITI0030/14480/EN
  • 14.BioFire Diagnostics. 2017 [cited 30 April 2019]. In: About FilmArray® Trend [Internet]. [about 2 screens]. Available from: https://syndromictrends.com/info/main
  • 15.Meyers L, Ginocchio CC, Faucett AN, Nolte FS, Gesteland PH, Leber A, et al. Automated real-time collection of pathogen-specific diagnostic data: Syndromic infectious disease epidemiology. JMIR Public Health Surveill. 2018; 4: e59. 10.2196/publichealth.9876 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.US Department of Health and Human Services. Title 45. Public Welfare CFR 46 (2018).
  • 17.Murphy CN, Fowler RC, Iwen PC, Fey PD. Evaluation of the Biofire FilmArray gastrointestinal panel in a midwestern academic hospital. Eur J Clin Microbiol Infect Dis. 2017; 36: 747–754. 10.1007/s10096-016-2858-7 [DOI] [PubMed] [Google Scholar]
  • 18.Khare R, Espy MJ, Cebelinski E, Boxrud D, Sloan LM, Cunningham SA, et al. Comparative evaluation of two commercial multiplex panels for detection of gastrointestinal pathogens by use of clinical stool specimens. J Clin Microbiol. 2014; 52: 3667–3673. 10.1128/JCM.01637-14 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Cybulski RJ Jr, Bateman AC, Bourassa L, Bryan A, Beail B, Matsumoto J, et al. Clinical impact of a multiplex gastrointestinal polymerase chain reaction panel in patients with acute gastroenteritis. Clin Infect Dis. 2018; 67:1688–1696. 10.1093/cid/ciy357 [DOI] [PubMed] [Google Scholar]
  • 20.Spina A, Kerr KG, Cormican M, Barbut F, Eigentler A, Zerva L, et al. Spectrum of enteropathogens detected by the FilmArray GI panel in a multicentre study of community-acquired gastroenteritis. Clin Microbiol Infect. 2015; 21: 719–728. 10.1016/j.cmi.2015.04.007 [DOI] [PubMed] [Google Scholar]
  • 21.Binnicker MJ. Multiplex molecular panels for diagnosis of gastrointestinal infection: performance, result interpretation, and cost-effectiveness. J Clin Microbiol. 2015; 53:3723–3728. 10.1128/JCM.02103-15 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Jangi S, Lamont JT. Asymptomatic colonization by Clostridium difficile in infants: implications for disease in later life. J Pediatr Gastroenterol Nutr. 2010; 51: 2–7. 10.1097/MPG.0b013e3181d29767 [DOI] [PubMed] [Google Scholar]
  • 23.McDonald CL, Gerding DN, Johnson S, Bakken JS, Carroll KC, Coffin SE, et al. Clinical practice guidelines for Clostridium difficile infection in adults and children: 2017 update by the Infectious Diseases Society of America (IDSA) and Society for Healthcare Epidemiology of America (SHEA). Clin Infect Dis. 2018; 66:987–994. 10.1093/cid/ciy149 [DOI] [PubMed] [Google Scholar]
  • 24.Beczkiewicz A, Cebelinski E, Decuir M, Lappi V, Wang X, Smith K, et al. High relative frequency of Enteroaggregative Escherichia coli among patients with reportable enteric pathogens, Minnesota, 2016–2017. Clin Infect Dis. 2019; 69: 473–479. 10.1093/cid/ciy890 [DOI] [PubMed] [Google Scholar]
  • 25.Lupp C, Robertson ML, Wickham ME, Sekirov I, Champion OL, Gaynor EC, et al. Host-mediated inflammation disrupts the intestinal microbiota and promotes the overgrowth of Enterobacteriaceae. Cell Host Microbe. 2007; 16:119–129. [DOI] [PubMed] [Google Scholar]
  • 26.Scallan E, Hoekstra RM, Angulo FJ, Tauxe RV, Widdowson MA, Roy SL, et al. Foodborne illness acquired in the United States—major pathogens. Emerg Infect Dis. 2011; 17:7–15. 10.3201/eid1701.p11101 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.The Center for Disease Control and Prevention (CDC). 2019 [cited 1 May 2019]. In: NoroSTAT data [Internet]. [about 2 screens]. Available from: https://www.cdc.gov/norovirus/reporting/norostat/data.html
  • 28.Bosh A, Pinto RM, Guix S. Human astrovirus. Clin Microbiol Rev. 2014; 27: 1048–1074. 10.1128/CMR.00013-14 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.The Center for Disease Control and Prevention (CDC). 2018 [cited 1 May 2019]. In: Rotavirus in the U.S. [Internet]. [about 2 screens]. Available from: https://www.cdc.gov/rotavirus/surveillance.html
  • 30.Geissler AL, Carrillo FB, Swanson K, Patrick ME, Fullerton KE, Bennett C, et al. Increasing Campylobacter infections, outbreaks, and antimicrobial resistance in the United States, 2004–2012. Clin Infect Dis. 2017; 65:1624–1631. 10.1093/cid/cix624 [DOI] [PubMed] [Google Scholar]
  • 31.Croxen MA, Law RJ, Scholz R, Keeney KM, Wlodarska M, Finlay BB. Recent advances in understanding Enteric Pathogenic Escherichia coli. Clin Microbiol Rev. 2013; 26: 822–880. 10.1128/CMR.00022-13 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Janda JM, Abbott SL, Mclver CJ. Plesiomonas shigelloides revisited. Clin Microbiol Rev. 2016; 29: 349–374. 10.1128/CMR.00103-15 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Gharpure R, Perez A, Miller AD, Wikswo ME, Silver R, Hlavsa MC. Cryptosporidiosis outbreaks—United States, 2009–2017. MMWR Morb Mortal Wkly Rep. 2019; 68:568–572. 10.15585/mmwr.mm6825a3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Board of Scientific Counselors, Office of Infectious Diseases, Food Safety Modernization Act Surveillance Working Group. Annual report to the secretary, Department of Health and Human Services. 2017. Available from https://www.cdc.gov/ddid/docs/BSC-OID-FSMA-SurvWG-2017-AnnualReport-508.pdf.
  • 35.Brown KA, Khanafer N, Daneman N, Fisman DN. Meta-analysis of antibiotics and the risk of community-associated Clostridium difficile infection. Antimicrob Agents Chemother. 2013; 57: 2326–2332. 10.1128/AAC.02176-12 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.The Center for Disease Control and Prevention (CDC). 2018 [cited 1 May 2019]. In: Cyclosporiasis outbreaks investigations–United States, 2017 [Internet]. [about 4 screens]. Available from: https://www.cdc.gov/parasites/cyclosporiasis/outbreaks/2017/index.html
  • 37.Casillas SM, Bennett C, Straily A. Notes from the field: multiple cyclosporiasis outbreaks—United States. MMWR Morb Mortal Wkly Rep. 2018; 67:1101–1102. icon. 10.15585/mmwr.mm6739a6 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Baochuan Lin

7 Jan 2021

PONE-D-20-22634

Real-time gastrointestinal infection surveillance through cloud-based network of clinical laboratories

PLOS ONE

Dear Dr. Ruzante,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

I have received the review of your paper.  While your paper addresses an interesting question, there are several issues that need to be addressed, please see reviewer’s insightful comments below.  In addition, I have couple points that need to be clarified.  1) can you specify what challenges that CIDTs  (line 84 – 85); 2) how does the results discussed (line 229 – 232) compare to the Foodnet? One minor point, please change “…and melt analysis.” To “…and melting curve analysis.” (line 74).

Please submit your revised manuscript by Feb 21 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Baochuan Lin, Ph.D.

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please provide a list of the BioFire Trend sites included in this study.

3. In your ethics statement in the Methods section and in the online submission form, please provide additional information about the data used in your retrospective study.

Specifically, please ensure that you have discussed whether all data were fully anonymized before you accessed them and/or whether the IRB or ethics committee waived the requirement for informed consent.

If patients provided informed written consent to have data from their medical records used in research, please include this information.

4. Please include the date(s) on which you accessed the databases or records to obtain the data used in your study.

5. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

6. Thank you for providing the following Funding Statement: 

'This study was funded by BioFire Diagnostics (https://www.biofiredx.com/products/filmarray/). Further, the authors: Katherine Olin, Jeff Nawrocki and Lindsay Meyers are paid employees of BioFire Diagnostics and hold shares of BioMérieux (owner of BioFire). Dr. Selvarangan is also on BioFire's Scientific  Advisory Board, and has received funding for research from BioFire Diagnostics, as well as other companies.'

a. We note that one or more of the authors is affiliated with the funding organization, indicating the funder may have had some role in the design, data collection, analysis or preparation of your manuscript for publication; in other words, the funder played an indirect role through the participation of the co-authors.

If the funding organization did not play a role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript and only provided financial support in the form of authors' salaries and/or research materials, please review your statements relating to the author contributions, and ensure you have specifically and accurately indicated the role(s) that these authors had in your study in the Author Contributions section of the online submission form. Please make any necessary amendments directly within this section of the online submission form.  Please also update your Funding Statement to include the following statement: “The funder provided support in the form of salaries for authors [insert relevant initials], but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘author contributions’ section.”

If the funding organization did have an additional role, please state and explain that role within your Funding Statement.

b. Please also provide an updated Competing Interests Statement declaring this commercial affiliation along with any other relevant declarations relating to employment, consultancy, patents, products in development, or marketed products, etc.  

Within your Competing Interests Statement, please confirm that this commercial affiliation does not alter your adherence to all PLOS ONE policies on sharing data and materials by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests). If this adherence statement is not accurate and  there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The paper by Ruzante et al. details their findings on detection and epidemiology of AGI pathogens using de-identified BioFire FilmArray data uploaded to their Trend software over a period of 34 months by 29 clinical laboratories spread across the U.S. The authors present data on the seasonality of AGI pathogens, co-detection rates for each and compare their findings to data available from the CDC FoodNet for a subset of 8 pathogens.

The paper is clearly and concisely written and requires only a few minor modifications.

Line 20: Specify in the Abstract that these are anonymized or de-identified results.

Line 95: For the approximate date of testing, within how many days does the cloud data typically differ from the actual date? Please specify here if you can.

Lines 104-107: This appears to reiterate what is mentioned in lines 101-102. Could you combine these somehow since they both pertain to generation of time series plots.

Line 141: It appears that designation of the first type of lab should occur prior to mention of “reference laboratories”.

Line 293: Change “access” to “assess”.

References 3 and 16: Consider combining these since they both point to the CDC FoodNet page.

References 10 and 27 are the same.

References 38 and 40 could be combined since they both point to Cyclospora outbreaks in 2017.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Apr 30;16(4):e0250767. doi: 10.1371/journal.pone.0250767.r002

Author response to Decision Letter 0


10 Apr 2021

ANSWERS TO QUESTIONS SUBMITTED ON 03/08/2021

1.Please provide contact information for the data owner. Katherine Olin (Katherine.Olin@biofiredx.com)

2.Please confirm that authors had no special access to the data, and that any qualified researcher can obtain access to the data in the same way the authors obtained it. We confirm that. However, as mentioned in the response to reviewers, a data user agreement (DUA) is required to grant access to the data by a qualified researcher. That is part of the current terms and conditions that BioFire has with each facility participating in the Trend program.

3. Thank you for providing the following information regarding your funding: "Biofire employees, Katherine Olin, Jeff Nawrocki, and Lindsay Meyers (who is no longer a BioFire employee), were part of the data analysis of this study and helped revising the manuscript. We revised the financial/funding statement to reflect that, please see below:“This study was funded by BioFire Diagnostics (https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.biofiredx.com%2Fproducts%2Ffilmarray%2F&data=04%7C01%7Cjruzante%40rti.org%7Ce089235adf7846c0e3da08d8e2796359%7C2ffc2ede4d4449948082487341fa43fb%7C0%7C0%7C637508358290331728%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=ErqXjBfRN%2BX0ZySyZWcPsUwNlNI%2FFkq6Gfn93rqQZOs%3D&reserved=0). Further, the authors: Katherine Olin, Jeff Nawrocki and Lindsay Meyers, under the direction of Dr. Ruzante, contributed to the data analysis and manuscript preparation. Katherine Olin and Jeff Nawrocki are paid employees of BioFire Diagnostics and Lindsay Meyers was a paid BioFire employee during the time of the study. The three of them hold stocks and shares of BioMérieux (owner of BioFire). Dr. Selvarangan is also on BioFire's Scientific Advisory Board, and has received funding for research from BioFire Diagnostics, as well as other companies.” Dr. Ruzante is current a co-PI in a proposal submitted to BioFire Diagnostics and the company paid for her travel expenses from San Diego to Salt Lake City in 2017 when Dr. Ruzante visited BioFire’s headquarter."

Please clarify the following:

a.Is the "funding for research from BioFire Diagnostics" received by Dr. Selvarangan related to the present study? Dr. Selvarangan did not receive any funding for this study. His institution received grant funding for other BioFire studies in which he participated, not this one

b.Please specify which companies are meant by the "other companies" that provided funding research to Dr. Selvarangan, and clarify whether any or all of these funding sources are related to the present study. Dr. Selvarangan also received funding from Cepheid, Abbott, Becton and Dickinson, Hologic, Diasorin, Luminex, Merck and Bacterioscan. Nonetheless, none of those resources were used to conduct the present study.

c.With regards to Dr. Ruzante, are either the "proposal submitted to BioFire Diagnostics" and/or "travel expenses from San Diego to Salt Lake City in 2017" related to the present study? Dr. Ruzante is collaborating with researchers from Ohio State University (OSU) to conduct a new study that will be funded by BioFire. From the time the revisions were submitted to PLOS One to now, this new project was awarded to Ohio State and RTI will be a sub-awardee to OSU. Dr. Ruzante will serve as co-PI, but the new study is not related to the present one. As for the travel expenses in 2017, that trip was made to discuss, in general terms, opportunities for collaborations, and also for Dr. Ruzante to better understand the technology behind BioFire’s FilmArray diagnostic method and Trend.

4.Are there any patents, products in development or marketed products associated with this research to declare? There are no patents, products in development or marketed products associated with this research.

GENERAL COMMENTS AND QUESTIONS

1. Can you specify what challenges that CIDTs (line 84 – 85): We added text to the introduction to address to provide more context to the challenges that CIDTS pose to public health. Please see lines 58-59 and 86.

2. How does the results discussed (line 229 – 232) compare to the Foodnet? A direct comparison of FilmArray and FoodNet results is not appropriate in this case because the geographic locations do not overlap substantially to allow for comparison of rates of detection (see Table 1). However, since FoodNet is an active surveillance system with high quality data for those eight AGI pathogens, we decided that a preliminary comparison would be desirable. Therefore, we calculated and compared the proportions of detection (total pathogen count was divided by the sum of all pathogens detected) for each of the eight pathogens. This way we were able to compare the relative ranking of these pathogens within the two datasets. That, we believe, is a more appropriate approach given the limitation of the two datasets. We added text to the discussion (lines 296 - 297) to make this limitation clearer.

3. One minor point, please change “…and melt analysis.” To “…and melting curve analysis.” (line 74). We made that change, thank you for the correction.

4. Please provide a list of the BioFire Trend sites included in this study: The data obtained by BioFire is subject to the terms and conditions of a Data Use Agreement (DUA) by and between BioFire and each facility participating in the Trend program. Primarily, the DUA is intended to protect the patient’s privacy. To do so, the test run data for any participating facility is aggregated with the test run data of three or more participating facilities. This protects patients by making it far less likely that any patient run data can be traced to a particular facility and/or individual. Accordingly, we cannot provide details regarding the participating sites, more than what provided in Table 1.

5. In your ethics statement in the Methods section and in the online submission form, please provide additional information about the data used in your retrospective study. Specifically, please ensure that you have discussed whether all data were fully anonymized before you accessed them and/or whether the IRB or ethics committee waived the requirement for informed consent. If patients provided informed written consent to have data from their medical records used in research, please include this information. The data used in this study was de-identified at the participant laboratory level and imported into Trend already anonymized and without any link to patient information. Therefore, the data received by RTI contained no link that could trace the test results to individuals. RTI and BioFire have a DUA in place that detailed how the data would be stored and who would have access to it. In addition, before starting the study, Dr. Ruzante submitted a waiver to RTI’s IRB office, which concluded that: “the study did not involve private, identifiable human subjects data nor interaction with any human subjects. Therefore, while research, it was not considered research with human subjects. This activity does not constitute research involving human subjects as defined by the US Code of Federal Regulations (45 CFR 46.102) and approval of those activities by the RTI IRB was not necessary.” We added a sentence regarding the IRB – lines 101 – 104.

6. Please include the date(s) on which you accessed the databases or records to obtain the data used in your study. The data was extracted from Trend in July 2019 and we added this information to the text as well (line 95).

7. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. We will update your Data Availability statement on your behalf to reflect the information you provide. Use .

8. Financial and funding Statement and Biofire employees’ role in the study: Biofire employees, Katherine Olin, Jeff Nawrocki, and Lindsay Meyers (who is no longer a BioFire employee), were part of the data analysis of this study and helped revising the manuscript. We revised the financial/funding statement to reflect that, please see below:

“This study was funded by BioFire Diagnostics (https://www.biofiredx.com/products/filmarray/). Further, the authors: Katherine Olin, Jeff Nawrocki and Lindsay Meyers, under the direction of Dr. Ruzante, contributed to the data analysis and manuscript preparation. Katherine Olin and Jeff Nawrocki are paid employees of BioFire Diagnostics and Lindsay Meyers was a paid BioFire employee during the time of the study. The three of them hold stocks and shares of BioMérieux (owner of BioFire). Dr. Selvarangan is also on BioFire's Scientific Advisory Board, and has received funding for research from BioFire Diagnostics, as well as other companies.” Dr. Ruzante is current a co-PI in a proposal submitted to BioFire Diagnostics and the company paid for her travel expenses from San Diego to Salt Lake City in 2017 when Dr. Ruzante visited BioFire’s headquarter. The disclosures by the authors in this study do not alter their adherence to PLOS ONE policies on sharing data and materials.

9. Please also provide an updated Competing Interests Statement declaring this commercial affiliation along with any other relevant declarations relating to employment, consultancy, patents, products in development, or marketed products, etc. Please see revised financial statement above (#8) for the conflict-of-interest disclosures. "This does not alter our adherence to PLOS ONE policies on sharing data and materials.”

REVIEWER’S COMMENTS

1. Line 20: Specify in the Abstract that these are anonymized or de-identified results. We added text to clarify this point as well as other instances in the paper. A few minor changes were made to the abstract to meet the word limit.

2. Line 95: For the approximate date of testing, within how many days does the cloud data typically differ from the actual date? Please specify here if you can. The test time obfuscation process imports tests from each site in sets of three tests, leading to an average of hours to a couple days between actual time and time reported in BioFire Trend. Text was added to the manuscript to clarify this point (lines 99 – 101).

3. Lines 104-107: This appears to reiterate what is mentioned in lines 101-102. Could you combine these somehow since they both pertain to generation of time series plots. We made a few changes to that paragraph, but believe it is important to keep the distinction between methods, since they are all slightly different. We hope it is acceptable to this reviewer.

4. Line 141: It appears that designation of the first type of lab should occur prior to mention of “reference laboratories”. There were no reference labs in this study. We edited for clarity.

5. Line 293: Change “access” to “assess”. Done, thank you for catching the misspell.

6. References 3 and 16: Consider combining these since they both point to the CDC FoodNet page. We decided to use the general reference and delete the other. Thank you for catching the duplicate.

7. References 10 and 27 are the same. I believe it is reference 10 and 37, we removed the duplicate. Thank you for catching the duplicate.

8. References 38 and 40 could be combined since they both point to Cyclospora outbreaks in 2017. Those were two different outbreaks, but we could use the general page.

Attachment

Submitted filename: Response to questions about funding statement.docx

Decision Letter 1

Baochuan Lin

14 Apr 2021

Real-time gastrointestinal infection surveillance through cloud-based network of clinical laboratories

PONE-D-20-22634R1

Dear Dr. Ruzante,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Baochuan Lin, Ph.D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Baochuan Lin

22 Apr 2021

PONE-D-20-22634R1

Real-time gastrointestinal infection surveillance through a cloud-based network of clinical laboratories

Dear Dr. Ruzante:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Baochuan Lin

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    Attachment

    Submitted filename: Response to questions about funding statement.docx

    Data Availability Statement

    There are both legal and ethical restrictions on sharing the data publicly. The data obtained by BioFire is subject to the terms and conditions of a Data Use Agreement (DUA) by and between BioFire and each facility participating in the Trend program. Primarily, the DUA is intended to protect the patient’s privacy and comply with applicable privacy laws and regulations. If a data set is requested, BioFire will review such request internally to ensure that any disclosure does not conflict with BioFire’s obligations and restrictions set forth in the DUA. For more information, contact Joel Hartsell (joel.hartsell@biofiredx.com).


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES