Skip to main content
Wellcome Open Research logoLink to Wellcome Open Research
. 2020 Jul 7;5:162. [Version 1] doi: 10.12688/wellcomeopenres.16063.1

An optimisation of four SARS-CoV-2 qRT-PCR assays in a Kenyan laboratory to support the national COVID-19 rapid response teams

Khadija Said Mohammed 1,#, Zaydah R de Laurent 1,#, Donwilliams O Omuoyo 1,#, Clement Lewa 1, Elijah Gicheru 1, Robinson Cheruiyot 1, Brian Bartilol 1, Shadrack Mutua 1, Jennifer Musyoki 1, Horace Gumba 1, Jedidah Mwacharo 1, Debra Riako 1, Shaban J Mwangi 1, Bonface M Gichuki 1, Lydia Nyamako 1, Angela Karani 1, Henry Karanja 1, Daisy Mugo 1, John N Gitonga 1, Susan Njuguna 1, Wilson Gumbi 1, Brian Tawa 1, Metrine Tendwa 1, Wesley Cheruiyot 1, Yiakon Sein 1, John K Nyambu 2, Shem O Patta 3, Thani Suleiman Thani 3, Eric K Maitha 4, Benson Kitole 4, Mohamed S Mwakinangu 5, Barke S Muslih 6, John Ochieng Otieno 7, Joyce U Nyiro 1, Patience Kiyuka 1, Leonard Ndwiga 1, Kevin Wamae 1, Domtila Kimani 1, Johnstone Makale 1, John Mwita Morobe 1, Victor Osoti 1, Arnold W Lambisia 1, Calleb Odundo 1, Salim Mwarumba 1, Martin Mutunga 1, Philip Bejon 1,8, Benjamin Tsofa 1, Charles N Agoti 1, Lynette Isabella Ochola-Oyier 1,a
PMCID: PMC8921690  PMID: 35330938

Abstract

Background: The global COVID-19 outbreak relies on a quantitative real-time polymerase chain reaction (qRT-PCR) for the detection of severe acute respiratory syndrome coronavirus (SARS-CoV-2), to facilitate the roll-out of patient care and infection control measures. There are several qRT-PCR assays with little evidence on their comparability. We report alterations to the developers’ recommendations to sustain the testing capability in our setting, where the supply of testing reagents is limited.

Methods: Standards generated from a serially-diluted positive control and previously identified positive/negative samples were used to determine the optimal volumes of the qRT-PCR reagents and to evaluate the validity and performance of four assays: Charité Berlin and European Virus Archive – GLOBAL (EVAg) primer-probe sets, and DAAN and Beijing Genomics Institute (BGI) premixed commercial kits. A multiplex and singleplex RT-PCR kit was used with the two primer-probe sets and the recommended assay volumes of the two premixed kits were altered.

Results: In comparison to the multiplex RT-PCR kit, the singleplex RT-PCR kit combined with the primer-probe sets yielded consistent cycle threshold (Ct) values across the different titrations tested. The DAAN premixed kit produced comparable Ct values across the titrations, while the BGI kit showed incomparable Ct values and inconsistent results between batches using the manufacturer’s recommended volumes.

Conclusion: We achieved a 2.5-fold and 4-fold increase in the number of tests/kit for the premixed kits and the primer-probe sets, respectively. The primer-probe set assays were reliable and consistent, and we preferred a combination of an EVAg and a Berlin target. Any inconclusive result was repeated by different individuals following the same protocol. DAAN was a consistent and reliable assay even at lower concentrations from the stated recommendations. BGI in contrast, required dilution to improve its performance and was hence an assay that was used in combination with EVAg or Berlin targets.

Keywords: COVID-19, SARS-CoV-2, coronavirus, RT-PCR, diagnosis, optimisation

Introduction

The coronavirus disease 2019 (COVID-19) pandemic that began in China 1 is caused by a novel coronavirus, named severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) 2 . It is an important public health concern due to its global spread and unexpected high mortality (of 411,680 globally as at 10 th June 2020) [ https://coronavirus.jhu.edu/map.html], which is compounded by the unavailability of a treatment or vaccine to control or prevent the disease. SARS-CoV-2 belongs to a wider group of coronaviruses that causes respiratory distress in animals, birds and humans 3 . The genomic characterization of SARS-CoV-2 has shown that it is distinct from severe acute respiratory syndrome coronavirus (SARS-CoV) and the Middle East respiratory syndrome (MERS)-CoV 4 . COVID-19 mainly affects the lower respiratory tract, which can result in fatal pneumonia 5 . As at 10 th June 2020, there were over 7.25 million accumulated cases globally 6 and Africa accounted for 203,899 cases and 5,530 deaths. Of these, Kenya had reported 3094 cases and 89 fatalities 7 and these cases may be largely underestimated due to the limited capacity for testing 8 .

Highly sensitive and specific diagnostics for COVID-19 can inform efforts geared towards case detection, isolation, quarantine, contact tracing and subsequent infection control measures. Many antibody and antigen detection tests are still under development and validation 4 . Furthermore, antibody tests provide evidence of exposure to infection and do not clearly diagnose the presence of active infections for decisions to be made on treatment and isolation. Due to these limitations, quantitative reverse transcription-PCR (qRT-PCR) remains a valuable laboratory diagnostic test for COVID-19. Progress in developing specific primers and standardized laboratory protocols for COVID-19 was made possible by the availability of SARS-CoV-2 genomes early in the epidemic 4, 9, 10 . The first qRT-PCR assay (Charité, Berlin) was subsequently developed, targeting three regions in the SARS-CoV-2 genome, including envelope (E), nucleocapsid (N) and RNA-dependent RNA polymerase (RdRp) 11 . Other test kits in the market include the European Virus Archive – GLOBAL (EVAg) primer-probe set that targets the E and RdRp regions 12, 13 , the DAAN kit that targets the ORF1ab and N coding regions 14 , and the BGI kit targets the ORF1ab region 15 .

The Kenya Medical Research Institute-Wellcome Trust Research Programme (KWTRP), Kilifi, laboratory was assigned the responsibility of providing diagnostic testing support for all Coastal counties since the outbreak started in Kenya. Currently, like many low and middle-income countries, Kenya depends on international purchases and donations of testing kits. The main limitation of this process is the delays in receiving reagents from the international manufacturers due to the global travel restrictions, resulting in an inconsistent supply of testing reagents. To mitigate these challenges, the aforementioned assays were optimised and validated to primarily distinguish between false positives and true positives. This article details the lessons learnt from using these assays and presents the optimal parameters to maximise the use of the limited kits and reagents available while still maintaining assay performance.

Methods

Sample collection and processing

Both nasopharyngeal (NP) (FLOQswabs, COPAN Diagnostics) and oropharyngeal (OP) swabs (COPAN Diagnostics) were collected from patients presenting to health facilities with suspected COVID-19 symptoms; contacts of positive cases in quarantine facilities and positive cases in isolation centres being monitored by the rapid response teams across the six counties. Their NP/OP swabs were placed into a single tube of 3ml Universal Transport Media (COPAN Diagnostics), initially supplied by KWTRP, and later in 2ml viral transport media, supplied by KEMRI Headquarters (Nairobi). The samples were processed in a Biosafety level 2 cabinet 16 at KWTRP, as per WHO guidelines.

RNA extraction

SARS-CoV-2 RNA was extracted from the NP/OP patient samples, a positive control from a heat-inactivated culture of SARS-CoV-2 isolates from Aix-Marseille University, Marseille, France and a non-template control (nuclease-free water), using the manual QIAamp Viral RNA Mini Kit (Qiagen), and later the automated RNAeasy Mini QIAcube Kit (Qiagen) to accommodate the increase in the number of samples being tested. Extraction was done as per the manufacturers' instructions. The SARS-CoV-2 positive control RNA sample, derived from the culture, was serially diluted 10-fold to generate standards that were used in the four qRT-PCR assays for optimization and a comparison of their performance.

Real-time PCR assays

Our first tests were conducted with the Berlin Charité Laboratory protocol 11 , which targets the RNA dependent RNA polymerase (RdRp), envelope (E) and nucleocapsid (N) regions (Berlin protocol). Within a week of using the Berlin protocol, KWTRP had received the European Virus Archive - GLOBAL (EVAg) Kit 12, 13 targeting the E region. After 45 tests runs, we depleted the EVAg E primers and thereafter received the DAAN kit (DAAN Gene Co., Ltd of Sun Yat-sen University) that targeted the open reading frame (ORF)1ab and N coding regions, and also contained an internal human control gene. Following the rapid depletion of the DAAN kit due to a scale-up of testing in the coastal Counties, we received the BGI Kit (BGI Genomics Co. Ltd) that targets the ORF1ab region and contains a human housekeeping β-actin gene as an internal control. Both the BGI and DAAN kits were donations to Africa by the Jack Ma foundation through the Africa CDC to Ministries of Health in the region, whereas the EVAg and Charité Berlin primer-probe sets were procured by KWTRP.

The SARS-CoV-2 RNA qRT-PCR amplification assays were optimised using the QuantiFast Multiplex RT-PCR +R kit (Qiagen) and primer-probe sets from Charité Berlin and EVAg, as per manufacturer instructions. Given the large number of samples being tested and the long runtime required for the multiplex kit protocols (approximately 2 hours), we tested the singleplex TaqMan ® Fast Virus 1-step Master Mix kit (Thermo Fisher), with an approximately 1 hour runtime, to ascertain its validity and adaptability for both the Charité Berlin and EVAg assays. We used the same primer and probe concentrations with the singleplex TaqMan ® Fast Virus Master Mix kit. Both the multiplex and singleplex RT-PCR kits were available in the laboratory since they are routinely used for other viral research work at KWTRP. The commercial premixed fluorescent RT-PCR reagents from the BGI and DAAN kits were used according to the manufacturer’s instructions.

Optimisation of the qRT-PCR assays

For optimisation of the qRT-PCR assays, we used two positive RNA samples, two negative RNA samples, a non-template control and five dilutions of the positive control RNA standards. However, for the commercial premixed kits, we included the positive and negative controls accompanying the BGI and DAAN kits. Each sample was run in duplicate. To determine the optimal concentrations and volumes of primers and probes, while maximising reagent utilization, we varied the primer and probe volumes across the Charité Berlin ( Table 1Table 3) and EVAg ( Table 4) assays. Of note, we initially received EVAg E as primers and probes separately; later on in the testing process we received EVAg E and RdRp as a primer and probe mixed together ( Table 5). The total reaction volume was reduced from 25µl to 10µl, necessitating a subsequent reduction in the PCR buffer for the TaqMan ® Fast Virus 1-step Master Mix, which contains the reverse transcription enzyme and ROX dye (probe).

Table 3. Charité Berlin RdRp assay reagents.

Component Volume (µl)
Neat * 0.75 0.5
Nuclease-free water 3.9 4.3 4.7
4x TaqMan ® Fast Virus 1-Step Master Mix 2.5 2.5 2.5 *
N Sarbeco forward primer 0.6 0.45 0.3
N Sarbeco reverse primer 0.8 0.6 0.4
N Sarbeco probe 0.2 0.15 0.1
RNA template 2 2 2
Total reaction volume 10 10 10
*

Half of recommended assay volumes

Table 1. Charité Berlin E assay reagents.

Component Volume (μl)
Neat * 0.75 0.5
Nuclease-free water 4.5 4.75 5
4x TaqMan ® Fast Virus 1-Step Master Mix 2.5 * 2.5 * 2.5 *
E Sarbeco forward primer 0.4 0.3 0.2
E Sarbeco reverse primer 0.4 0.3 0.2
E Sarbeco probe 0.2 0.15 0.1
RNA template 2 2 2
Total reaction volume 10 10 10
*

Half of recommended assay volumes

Table 2. Charité Berlin N assay reagents.

Component Volume (μl)
Neat * 0.75 0.5
Nuclease-free water 3.9 4.3 4.7
4x TaqMan ® Fast Virus 1-Step Master Mix 2.5 2.5 2.5 *
N Sarbeco forward primer 0.6 0.45 0.3
N Sarbeco reverse primer 0.8 0.6 0.4
N Sarbeco probe 0.2 0.15 0.1
RNA template 2 2 2
Total reaction volume 10 10 10
*

Half of recommended assay volumes

Table 4. European Virus Archive – GLOBAL (EVAg) E gene (primers-probe set) assay reagents.

Component Volume (µl)
Neat
Nuclease-free water 4.3
4x TaqMan ® Fast Virus 1-Step Master Mix 2.5 *
EVA-g E Forward primer 0.5
EVA-g E Reverse primer 0.5
EVA-g E probe 0.2
RNA template 2
Total reaction volume 10
*

Half of recommended assay volume where 4X TaqMan ® Fast Virus 1-Step Master Mix (recommended 5 µl)

Table 5. European Virus Archive – GLOBAL (EVAg) E and RdRP gene assay reagents with readily provided mix of forward and reverse primers and probes.

Component Volume (µl)
0.75 0.5
Nuclease-free water 2.9 3.75
4x TaqMan ® Fast Virus 1-Step Master Mix 2.5 * 2.5 *
Primer-probe mix 2.6 1.75
RNA template 2 2
Total reaction volume 10 10
*

Half of recommended assay volume where 4X TaqMan ® Fast Virus 1-Step Master Mix (recommended 5 μl)

The commercial BGI and DAAN kits have primers and probes pre-mixed in PCR reaction buffers that were supplied in limited amounts. We titrated the reaction buffer to determine the optimal concentration and volumes required for the detection of SARS-CoV-2 RNA from clinical samples. The recommended volume of the enzyme mix (Hot Start Taq DNA polymerase and c-MMLV reverse transcriptase) per reaction for the DAAN kit was 3µl. We reduced this to 0.5µl and consistently used this alongside varying volumes of the PCR reaction mix (Liquid A) containing the primers and probes ( Table 6). For the BGI kit, in addition to titrating the PCR reaction mix ( Table 7), we went further to assess its validity by also altering the amount of enzyme mix, testing two conditions, 0.5µl and 0.25µl, of the enzyme mix while maintaining the PCR reaction mix volume, as shown in Table 8. For all the kits, we tested three titration points across the four RT-PCR assays as follows: neat (50% of the manufacturer’s recommendations), 75% of the neat and 50% of the neat.

Table 6. DAAN assay reagents.

Component Volume (µl)
Neat* 0.75 0.5
Nuclease-free water - 1.1 3.2
Reaction mix (Liquid A) 8.5 6.4 4.3
Enzyme mix (Liquid B) 0.5 0.5 0.5
RNA template 2 2 2
Total reaction volume 11 10 10
*

Half of recommended assay volume of the reaction mix (recommended volume is 17 μl)

Table 7. BGI assay reagents.

Component Volume (μl) Altered enzyme
volume (μl)
Neat * 0.75 0.5 Mix 1 Mix 2
Reaction mix 9.3 7 4.7 0.5 0.75
Enzyme mix 0.8 0.8 0.8 0.25 0.25
RNA template 2 2 2 2 2
Reaction mix 7 7
Total reaction volume 12.1 9.8 7.5 10 10
*

Half of recommended assay volume of the reaction mix (recommended volume is 18.5 μl)

Table 8. BGI assay reagents with altered enzyme mix volumes.

Component Volume (µl)
Mix1 Mix2
Nuclease free water 0.5 0.75
Reaction mix 7 7
Enzyme mix 0.5 0.25
RNA template 2 2
Total reaction volume 10 10

All these assays were run on the Applied Biosystems™ 7500 Real-Time PCR System and analysed on the 7500 software v2.3. The qRT-PCR conditions are indicated in Table 9. The annealing and extension conditions varied depending on the gene targets and detection assays. For the analysis of the amplification plots and subsequent data, different baseline points and thresholds were set manually as illustrated in Table 10.

Table 9. Quantitative reverse transcription-PCR (qRT-PCR) cycling conditions for detection of SARS-CoV-2 RNA using four assays.

Step Berlin Charité (E, N and
RdRP)
EVAg (E and RdRp) BGI
(ORF1ab)
DAAN
(ORF1ab
and N)
QuantiFast
RT-PCR +R
TaqMan ® Fast
Virus
QuantiFast
RT-PCR +R
TaqMan ® Fast
Virus
Kit
component
Kit
component
Reverse transcription 55°C 50°C 55°C 50°C 50°C 50°C
20 min 5 min 20 min 5 min 20 mins 15 mins
Activation 95°C 95°C 95°C 95°C 95°C 95°C
5 min 20 sec 5 min 20 sec 10 mins 15 mins
Denaturation 95°C 95°C 95°C
15 sec
45 cycles
95°C 95°C 94°C
15 sec 3 sec 3 sec 15 sec 15 sec
45 cycles 40 cycles 40 cycles 40 cycles 45 cycles
Annealing and
extension
58°C 60°C 58°C 58°C 60°C 55°C
30 sec 30 sec 45 sec 45 sec 30 sec 45 sec
45 cycles 40 cycles 40 cycles 40 cycles 40 cycles 45 cycles

Table 10. ABI 7500 Real-Time PCR System analysis settings for detection of SARS-CoV-2 RNA using four assays.

Charité Berlin primer-probe sets (E, N and RdRp genes), European Virus Archive – GLOBAL (EVAg) primer-probe sets (E and RdRp genes), DAAN kit (ORF1ab region and N gene) and BGI kit (ORF1ab region) based on the standard curves.

TaqMan® Fast Virus 1-step Master Mix
RT-PCR Kit
QuantiFast Multiplex
RT-PCR +R Kit
DAAN RT-PCR
Kit
BGI RT-PCR
Kit
Berlin E Berlin N Berlin
RdRp
EVAg E EVAg
RdRp
Berlin RdRp EVAg E
Baseline starting point 3 3 3 3 3 3 3 3 3
Baseline ending point 20 24 19 18 19 12 12 22 18
Threshold 0.54 0.02 0.02 0.58 0.09 0.21 2.47 16271 110241
Positive sample cut-off
Ct value
35 36 31 37 36 35 38 N gene – 39
ORF1ab - 40
34

Ethical statement

Ethical approval was not required since the patient samples used in the optimisation assays were part of the testing process for ensuring consistency, replicability and the validity of all the testing kits used. These optimisations allowed us to develop testing SOPs to ensure we report a valid result to the COVID-19 county rapid response teams.

Results

Primer-probe set assays

There were differences between the multiplex (QuantiFast RT-PCR +R Kit) and singleplex (TaqMan® Fast Virus 1-Step Master Mix Kit) kits for both the Charité Berlin and EVAg primer-probes sets. Compared with the singleplex kit assay ( Underlying data: Data file 1 17 ), the multiplex EVAg E gene assay showed delayed Ct values ( Underlying data: Data file 2 17 ) potentially due to differences in the assays’ chemistry, the differential salt concentration and pH. The singleplex kit, therefore, appeared to have improved sensitivity compared to the multiplex kit ( Figure 1A). Using the singleplex kit and maintaining the same PCR conditions, we titrated the primer-probe volumes to determine the best concentration with high signal to noise ratio. We used primer concentrations in the 200nM-600nM range, and probe concentrations between 75nM-200nM ( Underlying data: Data file 3 17 ). The EVAg RdRp primer-probe set showed similar Ct values across the titrations tested and 50% of the neat recommendations were used to extend the number of tests conducted with this assay ( Underlying data: Data file 4 17 ; Figure 1B). Notably, the Berlin RdRP target assay inconsistently detected positive sample replicates and did not report cycle threshold (Ct) values for known positive samples in the multiplex assay ( Underlying data: Data file 5 17 ). However, the singleplex assay was able to detect only one positive sample and all the standards ( Underlying data: Data file 6 17 ), while generally reporting earlier Ct values ( Figure 1C). The Berlin E assay had comparable mean Ct values across the titrations with consistent performance ( Underlying data: Data file 7 17 ; Figure 1D). On the other hand, the Berlin N assay resulted in mean Ct values with a difference of 1 in some samples and standards across the titrations ( Underlying data: Data file 8 17 ; Figure 1E). Consequently, we settled for the lowest titration point (50% of neat volume) for the Berlin E assay and 75% of the neat volume for the Berlin N assay as our optimal volume for subsequent testing to get the maximum number of assays for the reagents available. We also determined that running two target regions concurrently saved on time and allowed us to definitively and rapidly identify a positive result. This was evident with the EVAg E and RdRp assays, and this combination increased our confidence in calling a positive test result ( Figures 2A and 2B).

Figure 1. Standard curves of 10-fold dilutions and their corresponding Ct values resulting from titrating RT-PCR reagents from four assays.

Figure 1.

Charité Berlin assay targeting E gene ( D), N gene ( E) and RdRp gene ( A); EVA-g, targeting E gene ( B) and RdRp gene ( C); DAAN, targeting N gene ( F) and ORF1ab region ( G) and BGI, targeting ORF1ab region ( H). All assays indicated “Neat” used half the concentration of the recommended assay volume and those indicated “0.5X” or “0.75X” used 0.5 times and 0.75 times the volume of the “Neat” assay volume, respectively. The primer-probe set assays are used alongside commercial RT-PCR kits TaqMan® Fast Virus 1-Step Master Mix and QuantiFast Multiplex RT-PCR +R Kit. In the BGI assays (panel H), “EnzymeMix1” and “EnzymeMix2” assays were similar to the “0.75X” assay, however, the enzyme mix volumes used were 0.5ul and 0.25ul, respectively. The light grey lines in each plot illustrate comparisons of all other assays versus the respective coloured plot assay.

Figure 2. Amplification curves of the two target gene approach.

Figure 2.

The EVAg E and Berlin RdRp assays were run under the same RT-PCR conditions in the same PCR 96-well plate. ( A) Shows a definitive positive result for test sample 1 for the E target region (orange line, Ct 32.2) underlying the green line (the E positive control, Ct 32.4) and the R region (yellow line, Ct 36.3) and R positive control (red line, Ct 38.7). ( B) Shows a definite negative result for test sample 2 with no amplification curves when compared to the E positive control (green line) and the R positive control (red line).

Commercial premixed test kits

For the BGI and DAAN premixed kits, the quantities supplied conducted about 50 and 96 tests per kit, respectively. The kits were used at 50% of the manufacturer’s recommendation to maximise the number of tests per kit. Upon further optimization, it was clear that half, quarter and even an eighth of the manufacturer’s recommended volumes produced similar results for the DAAN kit ( Underlying data: Data files 9 and 10 17 ; Figures 1F and 1G). Since the DAAN kit is a three-gene target assay, it proved to be an efficient assay in confirming the presence of SARS-CoV-2 RNA and the quality of the sample taken using the presence of the human gene internal control.

We noted batch to batch variation with the BGI kit when we used 50% of the manufacturer’s recommended volumes. As shown in Figures 3A and 3B, a large number of the samples tested (>70% of the samples) were positive, and we considered this to be unlikely, and thus ran confirmatory testing. The confirmatory second test with either Berlin E or Berlin N primer-probe set assay did not yield the equivalent number of positives as the BGI test, and we therefore concluded the initial results were false positives. The titration of the assay downwards to 75% of the neat reaction volumes and scaling down the enzyme mix by a third improved the specificity of the test ( Figure 3C), as there was a reduction in the number of false positives. Further titrations down to 25% of the manufacturer’s recommendations (50% of neat) yielded a difference of >2 Ct values between this titration and the neat and 75% titrations for the standards, while the previously identified positive samples and internal control were not detected ( Underlying data: Data file 11 17 ). The results across different enzyme mix titrations were consistent in their detection of the samples and internal controls in several runs as well as the serially-diluted positive ( Underlying data: Data file 12 17 ; Figure 1H).

Figure 3. BGI assay amplification plots using 50% of the manufacturer’s recommendation.

Figure 3.

( A) The multicoloured curves indicate a large number of positive results from a 96 sample test run. ( B) A zoom in on a single column of 8 test samples indicates at least 6 test samples as being SARS-CoV-2 positive. ( C) Following the use of 75% of neat volumes and 0.25µl of the enzyme mix showed improved sensitivity in the assay as indicated from the 96 sample test run with. Only 4 samples testing positive using a Ct cut-off of <34.

Based on the 10-fold serial dilutions of the positive control SARS-CoV-2 RNA, we established assay-specific Ct value cut-offs ( Table 10) to determine a positive result, since the assays have different levels of signal-to-noise ratio.

Discussion

Our experience from over 15,500 tests has allowed us to develop a series of adjustments to the assays to optimize their use in testing for SARS-CoV-2. We settled on a two-target gene assay to improve the detection of SARS-CoV-2 RNA. This finding was similar to Corman et al. (2020), where they suggested that the E region could be used as an initial screening tool, followed by a confirmatory test with the RdRp assay 11 . Our ranking of the individual test performance based on calling a true positive was as follows: EVAg E, Berlin E, EVAg RdRp, Berlin N and Berlin RdRp. However, we settled on a combination of two targets being positive for a definitive positive test result. If one of the targets was negative it was considered an inconclusive result and was repeated by an independent team with a different assay. As the scale of testing increased from receiving tens of samples a day to more than 400 per day, our test ranking allowed us to settle on a single test for a quicker turn-around-time of validated results and at the same time maximising resources. For the DAAN (premixed) assay we used the same workflow since it was a combined two targets assay and any inconclusive results were repeated with a different test, EVAg or Berlin assays. In addition, this kit had the advantage of the human internal control gene to further ensure the validity of the test result.

Even though the BGI kit sensitivity was improved when run according to the dilutions that we described above, rather than the manufacturer’s instructions, the assay still had a low signal-to-noise ratio at the high Ct value range, making it difficult to confidently call positives. We determined that a positive result was more reliable when Ct values were lower than 34, but unreliable with higher Ct values. We therefore always combined BGI with a more reliable assay, EVAg RdRp, Berlin N or Berlin RdRp (in this order depending on which primers were available), since at the time of receiving this assay we had depleted EVAg E and DAAN and were low on the E Berlin test kit and needed to economize their use.

For quality control during testing, we included in every assay a negative template control, two positive extraction controls (a neat and 1 in 10 dilution) and 2 negative controls placed randomly (but not near each other) across the wells of a 96-well format plate. Furthermore, any repeat assays were conducted by an independent team, emphasizing the importance of well-trained personnel that are required to conduct the testing and to ensure the thorough and careful set up of the assay to minimise contamination. Since it is a two-step procedure (RNA extraction and qPCR) any errors will have downstream consequences during the labour-intensive testing process. To create a seamless pipeline for COVID-19 testing, sample and data management teams were required to collate the qRT-PCR test result with the patient data and produce an individual result report for each sample tested.

Conclusions

We achieved a 2.5-fold and 4-fold increase in the number of tests per kit for the commercial premixed kits and primer-probe sets, respectively, by adjusting the manufacturer’s recommendations on quantities following careful optimization in our laboratory. This enabled us to continuously conduct and support testing in the Coastal region of Kenya and address the challenge of inconsistencies in the supply of testing reagents. We highlight the challenges encountered in the use of the BGI kit that we noted was prone to false positives, but this was mitigated by diluting the reagent volumes and by including an additional confirmatory assay. Due to the nature of the qPCR assay, any kit may lead to false positives and thus in addition to negative controls, a dilution series of the positive controls, a confirmatory test and a set threshold must all be included to more confidently report a positive test result. Assays should be repeated where the Ct value falls into the indeterminate range. A key lesson learnt, when rapidly setting up and scaling up novel testing kits in a pandemic, is the need for sufficient, well-trained and dedicated staff to optimise and conduct the test and the requirement of a specialist data management team.

Data availability statement

Underlying data

Havard Dataverse: An optimisation of four SARS-CoV-2 qRT-PCR assays in a Kenyan laboratory to support the national COVID-19 rapid response teams, https://doi.org/10.7910/DVN/WPZHQR 17 .

This project contains the following underlying data:

  • -

    Data_File_1 -_EVA-g_E_(Fast Virus 1)

  • -

    Data_File_2 -_EVA-g_E_(QuantiFast)

  • -

    Data_File_3 -_EVA-g_E_(Fast Virus 2)

  • -

    Data_File_4 -_EVA-g_RdRp_(FastVirus)

  • -

    Data_File_5 -_Berlin_RdRp_(QuantiFast)

  • -

    Data_File_6 -_Berlin_RdRp_(Fast_Virus)

  • -

    Data_File_7 -_Berlin_E_(FastVirus)

  • -

    Data_File_8 -_Berlin_N_(FastVirus)

  • -

    Data_File_9 -_DAAN_N

  • -

    Data_File_10 -_DAAN_ORF1ab

  • -

    Data_File_11 -_BGI1-ORF1ab

  • -

    Data_File_12 -_BGI2-ORF1ab

Data are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication).

Acknowledgments

This manuscript is published with the permission of the Director of Kenya Medical Research Institute. We are immensely grateful to Prof. Bernard La Scola (IHU-Méditerranée Infection, and Aix Marseille University, IRD, AP-HM, MEPHI Marseille, France) for provision of the cultured SARS-CoV-2 supernatant.

Funding Statement

We are grateful to Prof James Nokes whose funding from the National Institute for Health Research (NIHR) (project reference 17/63/82) using UK aid from the UK Government to support global health research, and the UK Department for International Development (DfID) and Wellcome (grant # 102975; 220985) provided reagents to support the testing. Also, the KEMRI-Wellcome Core award 203077/Z/16/Z from Wellcome award to PB supports the ongoing testing. LIO-O and VO are supported by a Wellcome Trust Intermediate Fellowship awarded to L.I.O.-O. (grant no. 107568/Z/15/Z). CNA is supported through the DELTAS Africa Initiative [DEL- 15-003]. The DELTAS Africa Initiative is an independent funding scheme of the African Academy of Sciences (AAS)‘s Alliance for Accelerating Excellence in Science in Africa (AESA) and supported by the New Partnership for Africa’s Development Planning and Coordinating Agency (NEPAD Agency) with funding from the Wellcome Trust [107769/Z/10/Z] and the UK government. J.U.N is supported by a PATH grant (PATH grant # GAT.1890-01665713-SUB). Views expressed in this publication are those of the authors and not necessarily those of AAS, NEPAD Agency, Wellcome Trust or the UK government.

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

[version 1; peer review: 1 approved, 1 approved with reservations]

References

  • 1. Zhu N, Zhang D, Wang W, et al. : A Novel Coronavirus from Patients with Pneumonia in China, 2019. N Engl J Med. 2020;382(8):727–733. 10.1056/NEJMoa2001017 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Coronaviridae Study Group of the International Committee on Taxonomy of Viruses: The species Severe acute respiratory syndrome-related coronavirus: classifying 2019-nCoV and naming it SARS-CoV-2. Nat Microbiol. 2020;5(4):536–544. 10.1038/s41564-020-0695-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Masters PS: The Molecular Biology of Coronaviruses. Adv Virus Res. 2006;66:193–292. 10.1016/S0065-3527(06)66005-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Lu R, Zhao X, Li J, et al. : Genomic characterisation and epidemiology of 2019 novel coronavirus: implications for virus origins and receptor binding. Lancet. 2020;395(10224):565–574. 10.1016/S0140-6736(20)30251-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Huang C, Wang Y, Li X, et al. : Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet. 2020;395(10223):497–506. 10.1016/S0140-6736(20)30183-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. COVID-19 Dashboard by the Center for Systems Science and Engineering (CSSE) at Johns Hopkins University (JHU).2020;1–2. Accessed 30 April 2020. Reference Source [Google Scholar]
  • 7. Ministry of Health (Kenya): National Emergency Response Committee on Corona Virus. Update of Corona Virus in the Country and Response Measures, as at 29th April, 2020.Day:48. Brief No:42.2020. Accessed 30 April 2020. Reference Source [Google Scholar]
  • 8. Gilbert M, Pullano G, Pinotti F, et al. : Preparedness and vulnerability of African countries against importations of COVID-19: a modelling study. Lancet. 2020;395(10227):871–877. 10.1016/S0140-6736(20)30411-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Wu F, Zhao S, Yu B, et al. : A new coronavirus associated with human respiratory disease in China. Nature. 2020;579(7798):265–269. 10.1038/s41586-020-2008-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. Zhou P, Yang XL, Wang XG, et al. : A pneumonia outbreak associated with a new coronavirus of probable bat origin. Nature. 2020;579(7798):270–273. 10.1038/s41586-020-2012-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Corman VM, Landt O, Kaiser M, et al. : Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. Euro Surveill. 2020;25(3):2000045. 10.2807/1560-7917.ES.2020.25.3.2000045 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. EVAg: Protocol for Real-Time RT-PCR SARS-CoV-2 (2019-nCoV) (RdRp Wuhan/CUB gene) with P&P.2019. Reference Source [Google Scholar]
  • 13. EVAg: Protocol for Real-Time RT-PCR SARS-CoV-2 (2019-nCoV) (E gene) with P&P. 2019. Reference Source [Google Scholar]
  • 14. DAAN: Instructions for Use of Detection Kit for Novel Coronavirus (2019-nCoV) RNA (Fluorescent PCR). Guangzhou, China:2019. Reference Source [Google Scholar]
  • 15. BGI: Real-Time Fluorescent RT-PCR Kit for Detecting SARS-2019-nCoV2. Shenzhen, China:2020. Reference Source [Google Scholar]
  • 16. Organization WH: Laboratory biosafety guidance related to coronavirus disease 2019 (‎COVID-19)‎: interim guidance. Geneva PP - Geneva: World Health Organization,2020. Reference Source [Google Scholar]
  • 17. Mohammed KS, de Laurent ZR, Omuoyo DO, et al. : An optimisation of four SARS-CoV-2 qRT-PCR assays in a Kenyan laboratory to support the national COVID-19 rapid response teams. Harvard Dataverse, V1,2020. 10.7910/DVN/WPZHQR [DOI] [PMC free article] [PubMed] [Google Scholar]
Wellcome Open Res. 2021 May 12. doi: 10.21956/wellcomeopenres.17620.r43607

Reviewer response for version 1

John Waitumbi 2, Esther Omuseni 1

General comments:

  • The paper has practical utility in addressing limited resources in order to sustain Covid-19 testing amidst global reagent shortages.

Abstract:

  • Background: The authors are probably not aware of a paper by Altamimi et al. that compared the performance of 17 SARS-CoV-2 kits that included BGI and DAAN. 1

  • Results: Consider rewarding the last sentence in the result’s section. For example, replace the sentence with …..“while BGI kit improved performance on dilution. This kit test results were inconsistent between batches using manufacturer's recommended volumes”.

  • Conclusion: Consider rewording the last sentence of the conclusion to include reason/s why BGI was the best suited for comparison. Why not DAAN? Is it because BGI is singleplex?

Introduction:

  • The authors should consider citing Altamimi et al (doi:1002/jmv_26900) that compared the performance of 17 SARS-CoV-2 kits that included BGI and DAAN. In the paper, the authors evaluated the kits in the format recommended by the manufacturer. BJI and DAAN were among the best performers.

Methods:

  • In Tables 1-5, shouldn’t the QuantiFast multiplex RT-PCR Master mix not be included as highlighted?

    Component                                                                               Volume

    Nuclease-free water                                                                  4.5

    4x TaqMan® Fast Virus 1-Step Master Mix/ QuantiFast          2.5

    Multiplex RT-PCR +R Kit Master Mix

 

  • The paper is silent on the performance of the recommended manufacturer’s volumes. On page 6 (highlighted section), neat is indicated as 50%. Author’s should consider including data on 100%, which is the manufacturer’s recommended volume.

Discussion:

  • The authors should consider discussion data by Altamimi et al. in the light of the poor performance of the BGI kit. 1 In the paper, BGI and DAAN were among the best performers.

Annotated PDF

Is the rationale for developing the new method (or application) clearly explained?

Yes

Is the description of the method technically sound?

Yes

Are the conclusions about the method and its performance adequately supported by the findings presented in the article?

Yes

If any results are presented, are all the source data underlying the results available to ensure full reproducibility?

Yes

Are sufficient details provided to allow replication of the method development and its use by others?

Partly

Reviewer Expertise:

Molecular epidemiology

We confirm that we have read this submission and believe that we have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

References

  • 1. : Assessment of 12 qualitative RT-PCR commercial kits for the detection of SARS-CoV-2. J Med Virol .2021;93(5) : 10.1002/jmv.26900 3219-3226 10.1002/jmv.26900 [DOI] [PMC free article] [PubMed] [Google Scholar]
Wellcome Open Res. 2022 Feb 24.
Khadija Said 1

Thank you for your review and comments. Please find appended the responses.

Abstract

  • Background - This manuscript was first published on 7 th July 2020 and the referenced paper was not out then ( Altamimi et al. 2021/).

  • Results - This has been done. The ‘Results’ section has been restructured to accommodate the necessary changes.

  • Conclusion - This section was restructured to convey this. We gave our findings and recommendations based on optimal volumes.

Introduction

  • Our manuscript was first published on 7 th July 2020 and the referenced paper was not out then ( Altamimi et al. 2021/). The timeline difference would not fit the narrative. However, we have now referenced this paper in the ‘Discussion’ section as advised.

Methods

  • We restructured the methods section to ensure we have comparable data for all the reagents used. Unfortunately, the QuantiFast Multiplex RT-PCR +R Kit Master Mix was only used in a limited set of assays. Consequently, we excluded these results to eliminate the confusion and misrepresentation.

  • The upscaling of testing in the Coastal counties and the country at large coupled with the crippled supply chain due to the COVID pandemic meant rapid depletion of kits faster than we could replenish our stocks. This prompted us to optimize the kits in a bid to maximize the number of tests we could perform while still maintaining the integrity of the assay. As a result, we did not test the recommended manufacturer’s volumes during this optimization.

Discussion

  • As previously mentioned, this manuscript was first published on 7 th July 2020 and the referenced paper was not out then. However, we have mentioned this in the latest version (L218-220 with hidden tracked changes). It is possible that the kit was improved by the manufacturer considering it was released around 2020. We have documented that this kit’s performance improved after the modifications were made. We believe that batch-to-batch variation based on the lot numbers would have resulted in our findings. This has been supported by an assessment done on the kit by Public Health England (see new citation 18 in the bibliography).

Wellcome Open Res. 2020 Aug 11. doi: 10.21956/wellcomeopenres.17620.r39453

Reviewer response for version 1

Davis Nwakanma 1,2

The manuscript describes the optimisation of real-time quantitative reverse transcription PCR (qRT-PCR) protocols for SARS-CoV-2 detection with objective of increasing the reactions that could be conducted per kit (or primer-probe set) over that of the manufacturer’s recommended protocols. The authors used a set of positive and negative patient samples (four in total) and a 10-fold dilution series (up to 10 7) of extracted virus culture to evaluate assay performance. On the whole two primer/probe sets and two premixed kits were evaluated.

The rationale for this type of assay optimisation is obvious given the widespread shortage of COVID-19 diagnostic reagents across the world because of disruptions in the supply chain.

However, I have a number of general and specific recommendation to improve the manuscript.

In its present form, the optimisation steps are not reported in a clear and sequential format for easy comprehension. Although the processes may have been conducted in disparate steps, it would improve the clarity of the manuscript if the reporting is structured around common themes. An example could be: (1) optimisation to establish lowest concentration of reagents that produce consistent diagnostic performance (usually measured by comparison of the sensitivity and specificity against a reference, which in this case, could be the manufacturers recommended protocol; (2) determination of the combination of gene targets for optimal scoring and confirmation of positive samples; and (3) workflow optimisation to increase assay throughput.

The use of non-standard terminologies to describe the dilutions results in unnecessary complexity for example “we tested three titration points across the four RT-PCR assays as follows: neat (50% of the manufacturer’s recommendations), 75% of the neat and 50% of the neat”. This should be simplified by designating the reagent concentration in the standard protocol as either 1X or 100%. Then the subsequent dilutions investigated would fractions of the standard and designated as .75X, .5X, .25X as the case may be.

In reviewing the supporting files, some evaluations were conducted with a dilutions series extending only up to 10 4 and others to 10 7. It is difficult to understand how was the cut off for the Berlin RdRP assay was determined to be 31, given that the limit of detection (LOD) was not reached in the evaluation shown in data files 5 & 6 where the lowest dilution of 10 4 was detected with a CT of 26-27.

Figure 1 is particularly difficult to follow given the amount of information contained. This is not helped by ignoring the chronological order in the explanatory text which begins with graph ‘D’ instead of ‘A’.

A large part of the discussion section is devoted to reporting optimisation steps (which would fit better under methods) instead of highlighting the implications and potential impact of these changes, for example, “For quality control during testing, we included in every assay a negative template control, two positive extraction controls (a neat and 1 in 10 dilution) and 2 negative controls placed randomly (but not near each other) across the wells of a 96-well format plate”.

Overall, the manuscript will benefit from reporting the optimisation steps in a structured format, simplifying the ‘nomenclature’ used in describing the dilutions, reviewing the discussions to remove description of the methods, explaining the rationale for the cut-off CTs for the various assays (gene targets) in the absence of determining the LOD and by simplifying Figure 1.

Is the rationale for developing the new method (or application) clearly explained?

Yes

Is the description of the method technically sound?

Partly

Are the conclusions about the method and its performance adequately supported by the findings presented in the article?

Partly

If any results are presented, are all the source data underlying the results available to ensure full reproducibility?

Partly

Are sufficient details provided to allow replication of the method development and its use by others?

Yes

Reviewer Expertise:

Molecular Genetics.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

Wellcome Open Res. 2022 Feb 24.
Khadija Said 1

Thank you for your review and comments. Please find appended the responses.

a) Response to comment 1: The manuscript has been restructured and centered around establishing the lowest volumes of the reagents required to generate consistent diagnostic performance while increasing assay throughput. For a clear narrative, the four assays have been introduced in the ‘Introduction’ section (L25-32 in the hidden tracked version of the manuscript). The optimization method has been initially defined in the ‘Real-time PCR assay modifications’ section (L57-60) within the ‘Methods’ section. The adjustments that make up our optimization steps have been explained in two sections based on the type of assay - primer-probe sets (L63-71) and commercial kits (L82-96).

b) Response to comment 2: Noted and modified as suggested. Herein, we refer to the manufacturer-recommended volumes at 1X, and our titration points are referred to by 0.5X, 0.375X and 0.25X to represent 50%. 37.5% and 25% of the manufacturer-recommended volumes respectively.

c) Response to comment 3: Included the relevant data for Berlin RdRp comprising all the dilution series tested up to 10 7. Refer to Updated Data File 9. However, due to issues with Berlin RdRp curves we excluded the Ct cut-off of this assay in Table 6.

d) Response to comment 4: The plot in Figure 1 was replaced by a more succinct one. Ensured the chronological order of the accompanying plots and texts was maintained.  

e) Response to comment 5: For this part of the discussion section, the idea was to report our experience and emphasize on the importance of including controls in the qRT-PCR assays especially during optimization. However, following the restructuring of the ‘Discussion’ section this was excluded and the message adheres to the context.

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    Underlying data

    Havard Dataverse: An optimisation of four SARS-CoV-2 qRT-PCR assays in a Kenyan laboratory to support the national COVID-19 rapid response teams, https://doi.org/10.7910/DVN/WPZHQR 17 .

    This project contains the following underlying data:

    • -

      Data_File_1 -_EVA-g_E_(Fast Virus 1)

    • -

      Data_File_2 -_EVA-g_E_(QuantiFast)

    • -

      Data_File_3 -_EVA-g_E_(Fast Virus 2)

    • -

      Data_File_4 -_EVA-g_RdRp_(FastVirus)

    • -

      Data_File_5 -_Berlin_RdRp_(QuantiFast)

    • -

      Data_File_6 -_Berlin_RdRp_(Fast_Virus)

    • -

      Data_File_7 -_Berlin_E_(FastVirus)

    • -

      Data_File_8 -_Berlin_N_(FastVirus)

    • -

      Data_File_9 -_DAAN_N

    • -

      Data_File_10 -_DAAN_ORF1ab

    • -

      Data_File_11 -_BGI1-ORF1ab

    • -

      Data_File_12 -_BGI2-ORF1ab

    Data are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication).


    Articles from Wellcome Open Research are provided here courtesy of The Wellcome Trust

    RESOURCES