Skip to main content
PLOS One logoLink to PLOS One
. 2021 Feb 26;16(2):e0247767. doi: 10.1371/journal.pone.0247767

Evaluation of sample pooling for screening of SARS CoV-2

Andargachew Mulu 1, Dawit Hailu Alemayehu 1, Fekadu Alemu 1, Dessalegn Abeje Tefera 1, Sinknesh Wolde 1, Gebeyehu Aseffa 1, Tamrayehu Seyoum 1, Meseret Habtamu 1, Alemseged Abdissa 1, Abebe Genetu Bayih 1, Getachew Tesfaye Beyene 1,*
Editor: Etsuro Ito2
PMCID: PMC7909632  PMID: 33635923

Abstract

Background

The coronavirus disease 2019 (COVID-19) pandemic has revealed the global public health importance of robust diagnostic testing. To overcome the challenge of nucleic acid (NA) extraction and testing kit availability, an efficient method is urgently needed.

Objectives

To establish an efficient, time and resource-saving and cost-effective methods, and to propose an ad hoc pooling approach for mass screening of SARS-CoV-2.

Methods

We evaluated pooling approach on both direct clinical and NA samples. The standard reverse transcriptase polymerase chain reaction (RT-PCR) test of the SARS CoV-2 was employed targeting the nucleocapsid (N) and open reading frame (ORF1ab) genomic region of the virus. The experimental pools were created using SARS CoV-2 positive clinical samples and extracted RNA spiked with up to 9 negative samples. For the direct clinical samples viral NA was extracted from each pool to a final extraction volume of 200μL, and subsequently both samples tested using the SARS CoV-2 RT-PCR assay.

Results

We found that a single positive sample can be amplified and detected in pools of up to 7 samples depending on the cycle threshold (Ct) value of the original sample, corresponding to high, and low SARS CoV-2 viral copies per reaction. However, to minimize false negativity of the assay with pooling strategies and with unknown false negativity rate of the assay under validation, we recommend pooling of 4/5 in 1 using the standard protocols of the assay, reagents and equipment. The predictive algorithm indicated a pooling ratio of 5 in 1 was expected to retain accuracy of the test irrespective of the Ct value samples spiked, and result in a 137% increase in testing efficiency.

Conclusions

The approaches showed its concept in easily customized and resource-saving manner and would allow expanding of current screening capacities and enable the expansion of detection in the community. We recommend clinical sample pooling of 4 or 5 in 1. However, we don’t advise pooling of clinical samples when disease prevalence is greater than 7%; particularly when sample size is large.

Background

The coronavirus disease 2019 (COVID-19) pandemic has revealed the global public health importance of efficient diagnostic testing [1, 2] to differentiate severe acute respiratory syndrome coronavirus 2 (SARS CoV-2) from other routine respiratory infections and to guide appropriate public health and individual clinical management [1]. Detecting carriers of the virus at various population levels is fundamental to response efforts. It ensures the quarantine of COVID-19 patients to prevent local community transmission, and more broadly informs national response team to take measures [3]. However, it remains uncertain whether there may have been community circulation of SARS CoV-2 prior to the identification of individuals with positive results through standard public health surveillance as detection and monitoring capacity is limited [4]. Testing in Ethiopia is generally done on handful of facilities while potentially infectious carriers at the community remain undiagnosed. Given the limited testing capacity available in Ethiopia, the decision to test is based on clinical and epidemiological factors and linked to an assessment of the likelihood of infection. However, testing of appropriate specimens from patients meeting the suspected case definition for COVID-19 is a priority for clinical management and outbreak control [4]. Thus, it is necessary to come up with new ways to efficiently and effectively use available resources.

Sample pooling (mixing of samples and testing at a single pool, but subsequent testing of individual samples is needed only if the pool tests positive) has been used as an attractive method for community monitoring of infectious diseases as it requires no additional training, equipment, or materials [57]. The key principles for successful application of group testing involve knowledge of the limit-of-detection, sensitivity, and specificity of the assay, and the prevalence of disease in a given population [8, 9]. Here we have shown a proof-of-concept for direct clinical sample and NA pooling for the diagnosis of SARS CoV-2 in Ethiopia using the existing assay.

Objective

To establish an efficient, time and resource-saving and cost- effective methods and to propose an ad hoc laboratory-based surveillance approach for mass screening of SARS-CoV-2

Materials and methods

Design

The workflow comprises pooling of clinical respiratory samples and NA extraction, and extraction of NA from individual respiratory samples (Nasopharyngeal or oropharyngeal swabs in viral transport medium), followed by pooling of individually extracted NA samples. Then, conduct SARS-CoV-2 specific real-time RT-PCR using the Novel Coronavirus 2019-nCov PCR Kit-fluorescent PCR method of Da An Gene Co., Ltd, China, which is used currently for the diagnosis of SARS CoV-2 in the country. Nucleic acid was extracted from 200 μL respiratory specimen using the NA extraction and Purification Reagent, DAAN Gene Co., Ltd, as recommended by the manufacturer (Da An Gene Co., Ltd, of Sun Yat-Sen University, China). All laboratory procedures (Sample processing: NA extraction and purification, master mix (MM) preparation, mixing of NA and MM, amplification/detection and analysis) were performed according to the manual provided by the manufacturer (Da An Gene Co., Ltd). Throughout the experiment we used BioRad CFX96 Deep Well Real-Time System, BioRad Laboratories, Inc, Singapore and program. Change in cycle threshold (ct) value (which is defined as the ct value of a reaction when the fluorescence of a PCR product can be detected above the background signal) of positive sample were analyzed. A Ct value is inversely proportional to the amounts of viral RNA in a reaction. The assay targets N and ORF 1ab region of SARS CoV-2. With this assay, a positive SARS CoV-2 result is determined when both targets reach a Ct value of ≤40, along with a Ct value of ≤32 and 40 for positive control and internal control, respectively.

Pooling

We conducted the pooling in two arms (direct clinical samples arm and nucleic acid arm), and experiments for direct clinical samples were done in triplicate. The total number pools done on direct clinical sample were 54 using two positive and 18 negative samples. For the nucleic acid arm, a total of 18 pools were conducted using two positive and 16 negative samples.

First, we pooled direct clinical samples of previously known positive samples with low and high ct values up to 10 samples in 1 prior to NA extraction step (maximum dilution factor of 10), to a final extraction volume of 200μL when combined with an increasing number of confirmed negative samples (Table 1).

Table 1. Direct clinical sample pools tested for SARS-CoV-2 RNA.

Pooling proportion (Dilution) Volume of positive sample (μl) The sum volume of negative samples in a pool (μl)
1 (Original) 200 0
1:1 (2 in 1) 100 100
1:2 (3 in 1) 67 133
1:3 (4 in 1) 50 150
1:4 (5 in 1) 40 160
1:5 (6 in 1) 34 166
1:6 (7 in 1) 29 171
1:7 (8 in 1) 25 175
1:8 (9 in 1) 23 177
1:9 (10 in 1) 20 180

In this study, a positive sample with ct value ≤ 32 considered as low ct value, between [> 32 and ≤ 34] medium, and between [>34 and ≤40] is high. Then, NA was extracted from final pooled samples of 200μL with a final elution volume of 50 μL. From the eluate template NA, 5 μl was mixed with 20 μl of the RT-qPCR reagent master mix to have a final volume of 25 μl reaction mixture. Then, change in ct value of the positive control, positive samples, and the cycle when all tested with no ct value were analyzed.

Second, we pooled individual NA preparation extracted earlier from 200μL of direct clinical samples. To minimize pipetting error during the pool assembly, we took the same high volume (3μl) of extracted RNA as indicated in Table 2.

Table 2. Nucleic Acid (NA) pooling design: Known positive individually extracted RNA and known negative samples separately extracted NA were pooled and a final volume of 5μl was taken from each pool to the master mix for amplification and detection.

Pooling proportion Volume of positive RNA (μl) Sum volume of known negative NA (μl)
original 5 0
1:1 (2 in 1) 3 3
1:2 (3 in 1) 3 6
1:3 (4 in 1) 3 9
1:4 (5 in 1) 3 12
1:5(6 in 1) 3 15
1:6 (7 in 1) 3 18
1:7 (8 in 1) 3 21
1:8 (9 in 1) 3 24
1:9 (10 in 1) 3 27

For detecting a single positive sample within a pool of negative nucleic acid extracts, we evaluated the ability of the standard qRT-PCR test under the protocol recommended by manufacture of the kits. Then, change in ct value of samples with low and high ct value was analyzed.

To assess the pool testing strategy, the most optimal testing configuration pool size was calculated using a Shiny App for pooled testing of Hierarchical algorithm (https://www.chrisbilder.com/shiny). As per the key principles of pooling, the following assumptions with numeric parameters were taken in to consideration: an experimental prevalence rate of SARS CoV-2 in Ethiopia to be 0.05 (whereas the observed positive rate within the tested individuals is reaching to 0.66% in the last 5 weeks), a two-stage pooling in a range of pool sizes 3–10 samples, an assay limit of detection (LOD) of 2.5 RNA copies/μL of reaction, an assay sensitivity of 98% -100% and an assay specificity of 100%. With these calculations, a pool size of 5 samples predicted and would provide the largest reduction in the expected number of tests of 58% when compared to testing clinical samples separately (Table 3).

Table 3. A comparison of the influence of optimal pool size on test efficiency* when the disease prevalence rate is 0.05.

Optimal sample pool size Expected number of tests reduced (%) Expected increase in testing efficiency (%)
3 53 111
4 57 132
5 58 137
6 57 135
7 56 128
8 55 120
9 53 111
10 51 103

*Calculated using Shiny application of pooling strategy available at http://www.chrisbilder.com/shiny with the specified key principles of pooling indicated above. Expected increase in test efficiency is obtained by dividing expected number of tests reduced by expected number of tests per individual.

To ensure the quality of the work during pooling, one staff member had been overseeing the pool assembly process, and had mitigated potential laboratory errors. Furthermore, experiments for direct clinical samples were done in triplicate. To avoid potential pipetting errors, we used relatively higher volume of dilutions for RNA pooling. Moreover, our laboratory is participating in an external quality assessment program and have the approval that results we produce are reliable.

Data analysis

To check if the variation between and within our experiments is statistically different, we run one-way Analysis of Variance (ANOVA) using an excel add-in program known as Analysis ToolPak.

Ethical approval

The study is approved by the Armauer Hansen Research Institute/ALERT Ethics Review Committee.

Results

With our pooling strategy, we were able to detect SARS CoV-2 positives samples in pooling up to 8 in 1 which tested positive in individual RT-PCR (Figs 1 and 2).

Fig 1.

Fig 1

Change in ct value of positive direct biological sample with low ct value (high viral copy) spiked with up to 9 negative samples for the two target genes (A N and B ORF 1ab genes).

Fig 2.

Fig 2

Change in ct value of RNA positive sample with low ct value (high viral copy) spiked with up to 9 negative samples for the two target genes (A N gene and B ORF1ab gene).

The results showed that pooled samples were positive within a range of 0 Ct to 6.75 Ct value difference from the original samples. Briefly, a total of 54 pools on direct clinical specimens each containing one positive sample were group tested. Of these pools conducted with positive samples with originally low ct value (high viral copy number), their Ct values were within a range of 29.28 to 35.67 for nucleocapsid (N) gene (Fig 1A and S1 Table) and 29.61 to 38.88 for the open reading frame (ORF)1ab genes (Fig 1B and S1 Table), where the highest dilution is 10 samples in 1 pool.

Similarly, the pools ct value for the SARS CoV-2 positive samples with originally high ct value (low viral copy number) were within a range of 35.09 to 38.67 for N gene and 37.43 to 40.00 for ORF1ab (S2 Table).

Overall, the average variance between the experiments and within the experiments is not statistically different. For the pooling experiments done with low Ct values of positive samples, the average variation of Ct values of N gene between the experiments is 0.032 while within the experiment is 2.258. For ORF1ab gene the average variation between experiments and within experiments is 0.67 and 3.05, respectively. Likewise, for pools done with high Ct values samples, the average variation for N gene between experiments is 0.02 and the variation within experiments is 1.92. and for ORF1ab gene, Ct value average variation is 0.16 and 0.75 in their order between and within experiments.

In our RNA pool, we were able to detect SARS-CoV-2 positives samples in pooling of up to 10 in 1(Fig 2A and 2B). Nine pools were done using SARS CoV-2 positive samples with original low ct value, and the Ct value of the pools range from 29.27 to 30.93 for N gene and from 30.41 to 32.63 for ORF1ab gene. Strictly speaking, the results show that RNA pooled samples were positive within a range of 1.53 to 3.19 and 1.23 to 3.45 Ct value difference from the original samples for N and ORF1ab genes, respectively (S3 Table).

In addition, the RNA pool experiments conducted with a positive sample of original high ct value, the pools Ct value ranges from 34.39 to 39.23 for N gene and from 36.58 to 38.86 for ORF1ab in 10 in 1 pool (Fig 3A and 3B). Similarly, the results show that RNA pooled samples were positive within a range of 0.48 to 4.48 and 0.95 to 3.20 Ct value differences from the original sample for N and ORF1ab genes, respectively (S4 Table).

Fig 3.

Fig 3

Change in ct value of positive RNA sample with high ct value (low viral copy) spiked with up to 9 negative samples for the two target genes (A N gene and B ORF1ab gene).

As clearly seen in the figures above, as the number of negative pooled samples increases, the amplified RNA reaches the threshold later, which is expected from a diluted sample with the principle of sample dilution effect. However, in pools that were conducted using a positive sample with low viral copy number the result for ORF1ab gene tends to be negative at higher level of dilution. For instance—out of the three replicate experiments, two of them revealed no Ct value or negative test result. Furthermore, when a positive sample spiked with nine negative samples (tenfold diluted), the ORF1ab gene was totally not detected as opposed to N gene (S2 Table). Otherwise, nearly for all samples there is a linear correlation between the threshold reached and the doubling of the pool size (S3 Table).

Using the online application http://www.chrisbilder.com/shiny, keeping all the numeric parameters indicated in the method section the same, we compared the influence of optimal pool size and disease prevalence rate on test efficiency. The data shows that when the disease prevalence is between 1% to 7%, the optimal pool size ranges between 10 to 4, respectively. For a disease prevalence greater than 7%, the expected number tests reduced is less than 50% and the expected increase in test efficiency is less than 100% (S5 Table).

An important variable in the process of SARS CoV-2 testing that impacts epidemic control is the time interval between sample collection, sample delivery, testing, and result reporting. In our laboratory the potential maximum number of individual samples we can process over 24 to 36 hours is 276. However, using pooling of 4 samples in 1 we were able to process 1104 samples. This shows that our pooling strategy is robust and can significantly reduce turnaround time from 72–120 hours to 24–36 hours.

Discussion

Globally, shortage of molecular laboratories for the diagnosis of SARS CoV-2, shortage of trained human capital, shortage of NA extraction, amplification and detection kits, and shortage of accessory and supplementary consumables despite an increasing number of testing demands has become an issue of concern [9, 10]. Particularly, the burden posed by these shortages is very high in Ethiopia given the pandemic has widely spread in a relatively short period of time. To minimize work load, resources and costs, a pooling approach for amplification and detection might be required. Here, we showed a proof-of-concept for direct clinical sample and RNA pooling for the diagnosis of SARS CoV-2 in Ethiopia using the existing assay.

Results from this pooling method supports that pooled screening strategy can be pursued to increase testing throughput, limit use of reagents, and to increase testing efficiency [7, 8], at an expected slight loss of sensitivity for direct clinical sample pooling. The same could be attained with no loss of sensitivity for RNA pooling. This study also showed that pooling is feasible using the current SARS CoV-2 assay in both public and clinical setting., implementing the method is especially imperative in resources limited the countries where the desire to test large number of individuals has been impacted by the shortage of key supply of detection kits. The predictive algorithm indicated a direct clinical sample pooling ratio of 5 in 1 was expected to retain accuracy of the test irrespective of the ct value of the sample spiked, and results in a 137% increase in test efficiency.

In general, the practical application of the pooling approach is confirmed in that it saved reagents, and reduced personnel time by three-fold that could expand testing. Assuming a consistent positivity rate in the country, pooling strategy on direct biological and RNA would expand testing by 168% and 120%, respectively. However, in a rapidly changing epidemic, testing strategies will need to adapt to real time situation. That is, a potential increases in the prevalence rate of a diseases requires the use of highly sensitive assays to avoid missing samples with low RNA copy number [810]. Furthermore, the impact of different extraction methods on the recovery of RNA/NA and overall assay sensitivity needs to be evaluated. And, thus both public and clinical laboratories must perform validation pool studies for their own methods of RNA/NA extraction and detection, to align their testing methods with the prevalence rates of SARS CoV-2 in real time of the settings. Because of the availability of limited SARS CoV-2 diagnosis facility, access to diagnostic tests, kit supplies, and the increasing number of individuals to be tested while there is shortage of trained human capital, this approach is important to facilitates rational use of resources. Furthermore, the approach could allow for prospective monitoring of the effectiveness of contact reduction measures at the population level and early detection of epidemic waves [11].

However, the limitation of this study is that because of the lack of a plasmid with known concentration, we were not able to quantify the changes occurred in between the dilutions in terms of viral copy number.

Conclusion

Considering an increasing SARS CoV-2 epidemic and the possibility of unrecognized spread of the diseases within the community, we propose a rapid and straightforward screening strategy for SARS CoV-2 using either direct biological sample pooling of 4/5 in 1 or RNA pooling up to 8 in 1. We do not recommend pooling of clinical samples if the disease prevalence is greater than 7%; especially in case of large sample size. This approach proved its concept and principles, and may facilitate detection of early community transmission of SARS CoV-2 to enable the timely implementation of appropriate infection control measures to reduce spread. The method can also be used for routine monitoring of healthcare workers and individuals at higher risk of exposure.

Supporting information

S1 Table. Ct values of the original positive sample (with low Ct value highlighted in silver) and the pools from direct clinical samples, this corresponds to Fig 1A and 1B.

(DOCX)

S2 Table. Ct values of the original positive sample (with a high Ct value silver highlighted) and the pools from direct clinical samples.

(DOCX)

S3 Table. Ct values of the original RNA positive sample (with low Ct value highlighted in silver) and the RNA pools, this corresponds to Fig 2A and 2B.

(DOCX)

S4 Table. Ct values of the original RNA positive sample (with high Ct value highlighted in silver) and the RNA pools, this corresponds to Fig 3A and 3B.

(DOCX)

S5 Table. A comparison of the influence of optimal sample pool size and disease prevalence rate on test efficiency.

(DOCX)

Data Availability

All relevant data are within the manuscript and Supporting Information files.

Funding Statement

The author(s) received no specific funding for this work.

References

Decision Letter 0

Etsuro Ito

7 Dec 2020

PONE-D-20-35695

Evaluation of Sample Pooling for Screening of SARS CoV-2

PLOS ONE

Dear Dr. Beyene,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jan 18 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Etsuro Ito

Academic Editor

PLOS ONE

Additional Editor Comment:

The language should be improved.

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdfú

2. Thank you for including your ethics statement:  "Being an Internal Experiment at methods validation level and given the decoded nature of testing, individual patient consent was not required and conducted based on institutional system.

And, the Armauer Hansen Research Institute/ALERT Ethics Review Committee has also waived it."

Please amend your current ethics statement to confirm that your named institutional review board or ethics committee specifically approved this study.

Once you have amended this/these statement(s) in the Methods section of the manuscript, please add the same text to the “Ethics Statement” field of the submission form (via “Edit Submission”).

For additional information about PLOS ONE ethical requirements for human subjects research, please refer to http://journals.plos.org/plosone/s/submission-guidelines#loc-human-subjects-research.

3. We note that you have included the phrase “data not shown” in your manuscript. Unfortunately, this does not meet our data sharing requirements. PLOS does not permit references to inaccessible data. We require that authors provide all relevant data within the paper, Supporting Information files, or in an acceptable, public repository. Please add a citation to support this phrase or upload the data that corresponds with these findings to a stable repository (such as Figshare or Dryad) and provide and URLs, DOIs, or accession numbers that may be used to access these data. Or, if the data are not a core part of the research being presented in your study, we ask that you remove the phrase that refers to these data.

4. Your ethics statement should only appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please move it to the Methods section and delete it from any other section. Please ensure that your ethics statement is included in your manuscript, as the ethics statement entered into the online submission form will not be published alongside your manuscript.

5. We noticed you have some minor occurrence of overlapping text with the following previous publication(s), which needs to be addressed:

- https://academic.oup.com/ajcp/article/153/6/715/5822023

- https://www.medrxiv.org/content/10.1101/2020.03.26.20039438v1

- https://jamanetwork.com/journals/jama/fullarticle/2764364

In your revision ensure you cite all your sources (including your own works), and quote or rephrase any duplicated text outside the methods section. Further consideration is dependent on these concerns being addressed.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

Reviewer #2: No

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Mulu A and coworkers describe sample pooling for the screening of SARS-CoV-2 in Ethiopia. The authors performed the experiments both on direct clinical sample pooling and extracted RNA pooling.

Major comments:

1. One of the objectives of the study was to establish time and resource-saving method for the screening of SARS-CoV-2. But the authors did not show or discuss on the turnaround time of this strategy.

2. The RT-PCR kit describes in the Methods detected E and ORF1ab genes, but the results describe the Ct value of N and ORF1ab genes.

3. The Ct values of each pool and original sample should be demonstrated. The numbers of specimens and the numbers of pools should be shown.

4. The results described the ability of pooling strategy to detect the virus in the pool of direct clinical sample of up to eight samples. Why did the authors recommend the pooling of four samples? Also, in the extracted RNA, the pooling strategy detected the virus in the pool of 10 samples, but recommend the pool of eight. Please provide the reasons for the recommendation.

5. It might be more interesting if the authors describe that they performed the experiments in both direct clinical sample and extracted RNA in the abstract.

Minor comments:

1. COVID-19 stands for coronavirus disease 2019. The full name of the disease should be corrected both in the Abstract and Background.

2. The method for calculation of pool size should be moved to the Method section. Please specify the algorithm that the authors used in the website. Does the reduction in the expected number of tests were 741% for the pool of 10 samples in Table 2? Please describe the term “testing efficiency”.

3. The manuscript should be language check. There are many typos. Also, the writing can be improved by reorganizing the content.

Reviewer #2: The experimental study by Mulu et al proposed a simple and straightforward screening strategy for SARS CoV-2 using either direct clinical specimen or pooling of NA after the extraction step. Such a strategy has been demonstrated to be useful in the face of global scarcity of kits and consumables, among others, particularly in resource constrained settings. However, the manuscript requires some clarity in the methodology and findings. Specific comments to improve the manuscript include:

General:

Language edition needed, including revising long sentences

Method:

• Clearly indicate how many samples from each of Low, Medium, High Ct values categories were used in the study. Indicate their Ct values as well (for both target genes). In other words, how many different pools were made for each category of samples

• How were the low, medium and High Ct cutoffs determined?

• Lines 135 to 137: the sentence is not clear.

• When preparing the negative pool, indicate the volume of sample taken from each individual sample (just for clarity)

• Authors have stated tests were done in triplicate. It is not clear from the document that how the final result was determined and what decision were made if triplicates do not agree. Also state the degree of acceptable variation between triplicates

• For the reader, authors need to clarify how they determined rates of test efficiency in the method section (though shown as table footnote)

• Include a section on Quality Assurance

Result

• Complete the figures for the 3 cut off levels of positive samples pooled. In the result only the following figures were shown with no explanation why only those depicted (Fig 1=direct sample Low Ct, Fig 2=RNA Low Ct, Fig 3=RNA High Ct)

• Accordingly revise the discussion section

Discussion

• Lines 230231: Instead of using the phrase “ lack of” better to state “shortage of”

• Lines 230-234 needs revision; particularly the last phrase after the reference lacks continuity with the preceding statement (Lines 233-234)

• There is inconsistency in the suggested RNA pooling: Lines 249-250 states 10 in 1 while in the conclusion part it is stated 8 in 1

• Pooling strategy depends on the prevalence rate of SARS Cov-2. Can you suggest a rate that pooling is not recommended?

• With the increasing SARS Cov-2 prevalence, please comment on the applicability of the findings

Thank you!

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Feb 26;16(2):e0247767. doi: 10.1371/journal.pone.0247767.r002

Author response to Decision Letter 0


30 Jan 2021

Responses Reviewer

Reviewer #1:

Mulu A and co-workers describe sample pooling for the screening of SARS-CoV-2 in Ethiopia. The authors performed the experiments both on direct clinical sample pooling and extracted RNA pooling.

Major comments:

1. One of the objectives of the study was to establish time and resource-saving method for the screening of SARS-CoV-2. But the authors did not show or discuss on the turnaround time of this strategy.

Response: Thanks a lot! this has now been included both in the result (last paragraph) and discussion section.

2. The RT-PCR kit describes in the Methods detected E and ORF1ab genes, but the results describe the Ct value of N and ORF1ab genes.

Response: It was my mistake that we wrote “E gene”, now corrected to N gene in all sections.

3. The Ct values of each pool and original sample should be demonstrated. The numbers of specimens and the numbers of pools should be shown.

Response: we included supplementary (S1-S4) Tables with the Ct value of the original positive samples and Ct values of the pools for both direct clinical samples and RNA samples

4. The results described the ability of pooling strategy to detect the virus in the pool of direct clinical sample of up to eight samples. Why did the authors recommend the pooling of four samples? Also, in the extracted RNA, the pooling strategy detected the virus in the pool of 10 samples, but recommend the pool of eight. Please provide the reasons for the recommendation.

Response: Indeed, the pooling strategy using the specified NA extraction and RT-PCR protocol we can detect the virus in pool of 8 for direct clinical sample and in pool of 10 for RNA. However, considering the uncertainty in quality of samples, the efficiency of RNA extraction protocols, sensitivity of RT-PCR and possible human error in preparing pool of large samples, we recommended pool of 4/5 and 8. Furthermore, reports show that the gold standard test (detection of nucleic acids of SARS-CoV2 by RT-PCR) has up to 30% False negative reports.

5. It might be more interesting if the authors describe that they performed the experiments in both direct clinical sample and extracted RNA in the abstract.

Response: Thanks again: We included pool of RNA in the abstract section too.

Minor comments:

1. COVID-19 stands for coronavirus disease 2019. The full name of the disease should be corrected both in the Abstract and Background.

Response: this is now corrected!

2. The method for calculation of pool size should be moved to the Method section. Please specify the algorithm that the authors used in the website. Does the reduction in the expected number of tests were 741% for the pool of 10 samples in Table 2? Please describe the term “testing efficiency”.

Response: Thank you very much, this question has helped us to re-analyse the calculation. We ask apologies that our calculation of the figures in the previous Table 2 were wrong. Now we have correctly calculated the most optimal testing configuration pool size, expected number of tests reduced, and testing efficiency using a Shiny App for pooled testing by Hierarchical algorithm. the previous Table 2 now is Table 3. By using disease prevalence rate 0.05, the calculated optimal pool size is 5 and the expected is number of tests reduced is 58%, with test efficiency of 137%.

3. The manuscript should be language check. There are many typos. Also, the writing can be improved by reorganizing the content.

Response: Thanks again, now the MS is read by native speaker.

Thanks a lot for your comments and suggestions!

Reviewer #2:

The experimental study by Mulu et al proposed a simple and straightforward screening strategy for SARS CoV-2 using either direct clinical specimen or pooling of NA after the extraction step. Such a strategy has been demonstrated to be useful in the face of global scarcity of kits and consumables, among others, particularly in resource constrained settings. However, the manuscript requires some clarity in the methodology and findings. Specific comments to improve the manuscript include:

General:

Language edition needed, including revising long sentences

Response: we revised and edited the Language

Method:

• Clearly indicate how many samples from each of Low, Medium, High Ct values categories were used in the study. Indicate their Ct values as well (for both target genes). In other words, how many different pools were made for each category of samples

Response: Thank you, now we included in the method section that the total number of pools done on direct clinical sample were 54 using two positive and 18 negative samples. For the nucleic acid arm, a total of 18 pools were conducted using two positive and 16 negative samples.

• How were the low, medium and High Ct cutoffs determined?

Response: This is really a very nice comment. As there could be subjectivity, and we could not come across any literatures that categorise Ct values in to Low, Medium and High, we just determined the cut-off values based on convince. Now we have modified the range of categories Ct values that is, we used the Ct value of the internal positive control as a reference. That is, Ct values less than or equal to the Ct value of the internal control (32) was considered as low ct value, and Ct values between >32 and < 34 were considered as medium and Ct value greater than 34 were considered as high. Please note that Ct value for negativity is 40 and above.

• Lines 135 to 137: the sentence is not clear.

Response: We have revised this section

• When preparing the negative pool, indicate the volume of sample taken from each individual sample (just for clarity)

Response: The sum volume of negative samples taken for dilution (pooling) indicated, for direct clinical samples in Table 1, and Table 2 for RNA.

• Authors have stated tests were done in triplicate. It is not clear from the document that how the final result was determined and what decision were made if triplicates do not agree. Also state the degree of acceptable variation between triplicates

Response: We agree on the importance of showing the statistical variation of the experiments. We have used One-way ANOVA and analysed the average variance of pools Ct values between experiments and within, this is now indicated it result section.

• For the reader, authors need to clarify how they determined rates of test efficiency in the method section (though shown as table footnote)

Response: Thanks, now we clearly stated in method section how test efficiency is calculated. We obtained test efficiency by dividing expected number of tests reduced by expected number of tests per individual.

• Include a section on Quality Assurance

Response: We included quality assurance section in this revised version, at the end of method section. We also indicated that our laboratory has been participating in an external quality assessment program, and given the approval that results we produce are reliable.

Result

• Complete the figures for the 3 cut off levels of positive samples pooled. In the result only the following figures were shown with no explanation why only those depicted (Fig 1=direct sample Low Ct, Fig 2=RNA Low Ct, Fig 3=RNA High Ct)

• Accordingly revise the discussion section

Response: we have revised this part accordingly.

Discussion

• Lines 230-231: Instead of using the phrase “lack of” better to state “shortage of”

Response: we revised this section and we replace the “lack of” by “shortage of”

• Lines 230-234 needs revision; particularly the last phrase after the reference lacks continuity with the preceding statement (Lines 233-234)

Response: thank you, we revised this statement

• There is inconsistency in the suggested RNA pooling: Lines 249-250 states 10 in 1 while in the conclusion part it is stated 8 in 1

Response: thanks again, what we indicated in Lines 249-250 is the highest number of sample pool (9 negative and 1 positive samples) that we can get positive test. However, in the conclusion part, considering the uncertainties in the quality of samples, the efficiency of RNA extraction protocols, sensitivity of RT-PCR, and the possible human error in preparing pools of large samples, we recommended pooling of 8 samples in 1 for RNA.

• Pooling strategy depends on the prevalence rate of SARS Cov-2. Can you suggest a rate that pooling is not recommended?

Response: Although we did not see the impacts of pooling in community-based samples, we suggest using pooling in a community samples with estimated prevalence of less than or equal to 7%. However, we don’t advise pooling of clinical samples when disease prevalence is greater than 7%; particularly when sample size is large. Because, a disease prevalence of greater than 7% has a benefit of less than 50% in terms of the expected number of tests reduced.

• With the increasing SARS Cov-2 prevalence, please comment on the applicability of the findings.

Response: with the increasing SARS Cov-2 prevalence the benefit of pooling is very minimal especially, when processing a very large volume sample. For example, suppose that the disease prevalence is 8%, if you are processing 1000 samples in a pooling of 4 samples in 1, you will have 250 pools. Out the 250 pools, potentially 80 of your pools will have positive signal. Then, in the subsequent step, you have to process 4x80 = 320 samples separately to find out which of the sample/s from each pool is truly positive. From this we can conclude that using sample pooling in such situation is a waste of time and resource.

Thank you very much for your comments and suggestions!

Attachment

Submitted filename: Response to Reviewers.doc

Decision Letter 1

Etsuro Ito

15 Feb 2021

Evaluation of Sample Pooling for Screening of SARS CoV-2

PONE-D-20-35695R1

Dear Dr. Beyene,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Etsuro Ito

Academic Editor

PLOS ONE

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #2: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Acceptance letter

Etsuro Ito

17 Feb 2021

PONE-D-20-35695R1

Evaluation of sample pooling for screening of SARS CoV-2

Dear Dr. Beyene:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Prof. Etsuro Ito

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Ct values of the original positive sample (with low Ct value highlighted in silver) and the pools from direct clinical samples, this corresponds to Fig 1A and 1B.

    (DOCX)

    S2 Table. Ct values of the original positive sample (with a high Ct value silver highlighted) and the pools from direct clinical samples.

    (DOCX)

    S3 Table. Ct values of the original RNA positive sample (with low Ct value highlighted in silver) and the RNA pools, this corresponds to Fig 2A and 2B.

    (DOCX)

    S4 Table. Ct values of the original RNA positive sample (with high Ct value highlighted in silver) and the RNA pools, this corresponds to Fig 3A and 3B.

    (DOCX)

    S5 Table. A comparison of the influence of optimal sample pool size and disease prevalence rate on test efficiency.

    (DOCX)

    Attachment

    Submitted filename: Response to Reviewers.doc

    Data Availability Statement

    All relevant data are within the manuscript and Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES