Skip to main content
PLOS One logoLink to PLOS One
. 2020 Aug 18;15(8):e0237655. doi: 10.1371/journal.pone.0237655

Development and evaluation of loop-mediated isothermal amplification for detection of Yersinia pestis in plague biological samples

Lovasoa N Randriantseheno 1,2, Anjanirina Rahantamalala 3, Ando L Randrianierenana 2, Minoarisoa Rajerison 1, Voahangy Andrianaivoarimanana 1,*
Editor: Henk D F H Schallig4
PMCID: PMC7437451  PMID: 32810167

Abstract

Background

Several tests are available for plague confirmation but bacteriological culture with Yersinia pestis strain isolation remains the gold standard according to the World Health Organization. However, this is a time consuming procedure; requiring specific devices and well-qualified staff. In addition, strain isolation is challenging if antibiotics have been administered prior to sampling. Here, we developed a loop-mediated isothermal amplification (LAMP) technique, a rapid, simple, sensitive and specific technique that would be able to detect Y. pestis in human biological samples.

Methods

LAMP primers were designed to target the caf1 gene which is specific to Y. pestis. The detection limit was determined by testing 10-fold serial dilution of Y. pestis DNA. Cross-reactivity was tested using DNA extracts from 14 pathogens and 47 residual samples from patients suffering from non-plague diseases. Specificity and sensitivity of the LAMP caf1 were assessed on DNA extracts of 160 human biological samples. Then, the performance of the LAMP caf1 assay was compared to conventional PCR and bacteriological culture.

Results

The detection limit of the developed Y. pestis LAMP assay was 3.79 pg/μl, similar to conventional PCR. The result could be read out within 45 min and as early as 35 minutes in presence of loop primer, using a simple water bath at 63°C. This is superior to culture with respect to time (requires up to 10 days) and simplicity of equipment compared to PCR. Furthermore, no cross-reactivity was found when tested on DNA extracts from other pathogens and human biological samples from patients with non-plague diseases. Compared to the gold standard, LAMP sensitivity and specificity were 97.9% (95% CI: 89.1%-99.9%) and 94.6% (95% CI: 88.6%-97.9%), respectively.

Conclusion

LAMP detected Y. pestis effectively with high sensitivity and specificity in human plague biological samples. It can potentially be used in the field during outbreaks in resource limited countries such as Madagascar.

Introduction

Plague is a zoonotic disease caused by a gram-negative bacterium, Yersinia pestis, which has been responsible for three major historical pandemics leading to millions of deaths. Currently, plague is endemic in some American, Asian and African countries including Madagascar which reports the vast majority of human plague cases across the globe (85.93% of global cases in 2015) [1]. The disease remains in foci that are mainly located in countries of extreme poverty. The World Health Organization (WHO) has classified plague as a re-emerging infectious disease. The recent pneumonic plague outbreak occurring in 2017 in two densely populated urban areas in Madagascar [2] reminds us that plague is far from being eradicated and its control is still challenging. Moreover, most of human cases originate and surface in rural low resourced regions where local health centers suffers from very limited diagnostic capability to robustly identify plague.

Plague is a rapidly progressing disease that has two main clinical forms depending on the transmission route. Bubonic plague (BP), the most common form, is acquired following the bite of infected rodent fleas. From the inoculation site, Y. pestis reaches the lymph nodes where massive multiplication occurs. Pneumonic plague (PP), a rare but even more deadly form, can evolve from a BP complication or resulting from a human to human transmission. The 2017 PP outbreak in Madagascar [2] illustrates the dangers of undiagnosed plague and the urgent need for wide distribution of diagnostic capabilities throughout Madagascar, especially in low resource setting of rural health facilities.

In Madagascar, national law mandates that all suspected plague cases must be diagnostically confirmed and reported. Multiple types of diagnostic tools are employed in this effort; the easy-to-use rapid diagnostic test for F1 antigen detection (F1 RDT) [3], quantitative real-time PCR (qPCR) detecting two Y. pestis targets (caf1 and pla genes) [2], an anti-F1 antibody ELISA [4] and the bacteriological culture with Y. pestis strain isolation [5]. This last method remains the gold standard for plague confirmation according to the WHO [6]. However, culture is time-consuming (10 days minimum) and successful strain isolation is highly dependent on other variables such as quality of sample conservation and low amount of contaminating bacteria. In addition, success of isolation is lower in samples from patients who started their treatment with antibiotics. A conventional PCR targeting the caf1 gene was previously developed and assessed but was not recommended as a routine diagnostic test for plague in Madagascar due to its low sensitivity compared to culture [7].‬ ‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬Although RDT and qPCR/conventional PCR are of much value in facilitating major improvements in disease management, when each are taken alone they do not constitute a confirmatory test. A confirmatory result is constituted through either a combination of tests (positive RDT and qPCR/conventional PCR) or an ELISA test result showing four-fold rise in anti-F1 antibody titer in paired-sera [6].

Official confirmatory testing is conducted at the Central Laboratory for Plague (CLP) hosted at the Plague Unit of the Institut Pasteur de Madagascar (IPM) located in the capital Antananarivo. The main reason these tests are conducted at IPM and not in local rural hospitals is because most require complex technologies and technical expertise which are not available in rural hospitals (except for the rapid test F1 RDT). The lack of diagnostic capability in rural hospitals likely contributes to the underreporting of plague. The delays and logistical burdens of transporting biological specimens to IPM can hamper official confirmation by resulting in unsuccessful strain isolation (gold standard confirmation). The rapidness of disease progression and the danger of underreporting disease illustrate the urgent need for robust diagnostic capabilities in low resource rural health facilities.

A diagnostic technology useable in a low resource setting would need to be simple, rapid, specific and cost-effective. Loop-mediated isothermal amplification (LAMP) is a rapid, efficient and specific DNA amplification method developed in 2000 by Notomi et al [8]. LAMP technique has been used for various infectious diseases diagnosis: visceral leishmaniasis [9], tuberculosis [10], malaria [11], bacillary dysentery [12], rickettsiosis [13], african trypanosomiasis [14], Zika virus [15]. LAMP methods detecting Y. pestis have previously been developed but evaluated only on Y. pestis pure cultures [16] or on simulated samples [17].

This technique relies on autocycling strand displacement coupled to DNA synthesis by Bst DNA polymerase. This eliminates the necessity for the heat denaturation step. The use of a set of four to six primers (two outer primers F3 and B3, two inner primers FIP and BIP, and two optional loop primers LF and LB) are responsible of its great sensitivity and specificity. The simplicity and the rapidness of the technique are associated with the isothermal condition of the reaction carried out for approximately 1 hour at 60°C to 65°C (requiring a simple water bath or heating block) and the results can be read by the naked eye with visual turbidity [18] or visual fluorescence (calcein [19], propidium iodide [20]) or using colorimetric agents (such as hydroxynaphtol blue [21]) or intercalating agent (such as SYBR green I [8]).

In this study, we developed a rapid, simple and sensitive/specific LAMP method assay for the detection of the caf1 gene sequence that is specific to Y. pestis and to evaluate its performance on biological samples from plague suspected patients from Madagascar.

Materials and methods

Ethics statement

The DNAs used in this study were extracted from Y. pestis cultures or human biological samples originally isolated or collected by the CLP and IPM as part of the plague national control program (PNCP) of the Malagasy Ministry of Public Health (S1 Appendix). This PNCP requires declaration of all suspected human plague cases and collection of biological samples from those cases. These samples and any cultures or DNA derived from those samples were collected under this mandatory reporting system and thus exempt as human subjects research. All culture isolates and biological samples were de-linked from the patients’ identifiable information and analyzed anonymously. Therefore no approval from the Malagasy Ethical Committee was required for this study.

Y. pestis strains and human biological samples

Y. pestis strains used in this study were isolated in 2015. A total of 113 biological samples from suspected plague patients (88 bubo aspirates, 12 sputum samples, 13 post-mortem samples consisting of 8 samples of lung punctures and 5 of liver punctures) stored at the CLP-Plague Unit Collection were used to evaluate the LAMP caf1 technique. Forty-nine of the biological samples were bacteriology positive with strain isolation and the remaining 64 were negative for all tests available (i.e. F1 RDT, qPCR and bacteriology). For ethical reasons, it was not possible to obtain negative control bubo aspirates or sputum samples from healthy populations. Therefore, as negative controls, we used 47 samples (29 pus and 18 sputum) from patients confirmed with other infectious diseases not consistent with plague.

DNA extraction

Bacterial strains were sub-cultured in brain-heart infusion broth at 26°C for 48h. The culture (1.5 ml) was then subjected to DNA extraction using DNeasy Blood & Tissue Kit (Qiagen, Germany) according to the manufacturer’s protocols for “Pretreatment for Gram-Negative Bacteria” and “Purification of Total DNA from Animal Tissues (Spin-Column Protocol)” [22].

DNA extracts from biological samples were obtained using a method previously described by Rivoarilala et al. [23] with slight modification. Samples were placed into a boiling water bath for 10 min and centrifuged at 12,000 rpm for 5 min. Five microliters (5 μl) of the supernatant were used for LAMP assays.

LAMP primer design

The caf1 sequence previously targeted by Rahalison et al. [7] for conventional PCR was recovered and used as a template to design LAMP primers. Primers F3, B3, FIP and BIP were automatically designed using the Primer Explorer V.4 software (https://primerexplorer.jp/elamp4.0.0/). The primers sequences selected for our LAMP system and used on the biological samples in this study are shown in Table 1.

Table 1. Nucleotide sequences of the set of LAMP caf1 primers designed in this study.

Primer Sequence (5’-3’)
F3 CGGGTGATCCCATGTACT
B3 CATCAGTGTATTTACCTGCTG
FIP ATCAAAATCTCTAGAATCCTTGCCATTTTCTCAGGATGGAAATAACCACC
BIP GGATGACGTCGTCTTGGCTATTTTCAAGTTTACCGCCTTTGG

F3: forward outer primer, B3: backward outer primer, FIP: forward inner primer, BIP: backward inner primer

Optimization of LAMP amplification protocol

The fully validated LAMP reaction mixture contained the following reagents for a final reaction volume of 25 μl: 1X thermopol buffer (New England Biolabs), 0.95 M of betaine (Sigma-Aldrich), 7 mM of MgSO4 (New England Biolabs), 1.4 mM of deoxynucleoside triphosphate (dNTPs) (Invitrogen), 0.13 μM each of F3 and B3 primers (Sigma-Aldrich), 1.06 μM each of FIP and BIP primers (Sigma-Aldrich), 8U Bst DNA polymerase (New England Biolabs) and 5 μl of positive control DNA (Y. pestis strain 59/15) or negative control (sterile distilled water). To identify the conditions optimal for maximal amplification, the following parameters were tested within a specified range: reaction times (30–60 min), incubation temperatures (57–69°C), and betaine concentrations (0 and 0.95 M). With the goal of employing simpler equipment, we tested incubations of LAMP reaction mixture on a Veriti 96 Well Thermal Cycler (Applied Biosystems) in parallel with a water bath to confirm that the bath worked equally well to that of the thermal cycler. All experiments testing the parameters included duplicate samples and were repeated twice to ensure repeatability.

Analysis of LAMP products

To determine if the LAMP reaction amplified DNA, 2 μl of 10-fold diluted SYBR Green I 10,000X (Sigma-Aldrich) was added directly into the tube containing the LAMP reaction mix. SYBR Green I, when bound to double stranded DNA, emits green light which can be visualized by naked eye. A positive LAMP amplification is indicated by a color change from orange to green in the reaction tube whereas no amplification is indicated by the color remaining orange (no color change) (Fig 1). To independently confirm positive DNA amplification, 5 μl of LAMP reaction mix were visualized by electrophoresis using 1.5% agarose gel stained with ethidium bromide. Characteristic ladder-like bands of multiple sizes and no band were shown for positive and negative reactions, respectively [8].

Fig 1. Visualization of LAMP products.

Fig 1

(A) stained with SYBR Green I and observed under natural light (Tube 1: Y. pestis, Tube 2: negative control); (B) with agarose gel electrophoresis (Lane 1: Y. pestis, Lane 2: negative control, Lane 3: DNA ladder marker 100 bp).

Loop primers to enhance LAMP amplification

The use of loop primers is not compulsory but was reported to reduce LAMP reaction time and improve specificity [24]. Therefore, four backward loop primers (LB) were designed with Primer Explorer V.4 (Table 2) and tested at 0.38 μM.

Table 2. Sequences of backward loop primers.

Name Sequence (5’-3’)
LB1 CAGCCAGGATTTCTTTGTTCGCTCA
LB2 AGCCAGGATTTCTTTGTTCGCTCA
LB3 GCCAGGATTTCTTTGTTCGCTCA
LB4 CCAGGATTTCTTTGTTCGCTCA

Outer primers (F3 and B3) specificity

Conventional PCR using the outer primers (F3 and B3 LAMP primers) was performed in order to confirm the specificity of the targeted region amplification. The sequence of Y. pestis CO92 plasmid pMT1 (GenBank Accession No. AL 117211.1) was used to localize the primer position on the targeted region with Sequence Extractor (https://www.bioinformatics.org/seqext/). The size of the targeted region was determined and compared to the size of the PCR amplicons obtained with F3 and B3. The conventional PCR reaction volume was 25 μl and contained 1X of CoralLoad® PCR Buffer (Qiagen), 0.4 mM of dNTPs (Invitrogen), 0.06 mM each of F3 and B3 primers (Sigma-Aldrich) (Table 1), 1U of Taq DNA Polymerase (Qiagen) and 5 μl of Y. pestis DNA extract for positive control and sterile distilled water for negative control. The test of specificity was carried out on seven different DNA extracts from Y. pestis strains 39/15, 56/15, 59/15, 69/15, 70/15, 72/15 and 73/15. The reaction comprised an initial denaturation step of 3 min at 94°C, 40 cycles of 94°C for 30 sec, 58°C for 30 sec, 72°C for 30 sec and a final extension of 10 min at 72°C. Amplicons were analyzed on 1.5% agarose gel stained with ethidium bromide during 60 min.

Detection limit of LAMP and conventional PCR

To characterize the minimum concentration of Y. pestis DNA detectable by LAMP caf1 and conventional PCR, Y. pestis DNA (initial concentration: 37.9 ng/μl) was 10-fold serially diluted with sterile distilled water, ranging from 10−1 to 10−5 and tested in parallel with LAMP and conventional PCR. The performance of LAMP caf1 was compared to that of the conventional PCR using primers previously tested by Rahalison et al., (Forward 5’- CAGTTCCGTTATCGCCATTGC– 3’ and reverse 5’- TATTGGTTAGATACGGTTACGGT– 3’, with 501 bp of expected amplification product) [7]. The reaction mixture and the program were the same as for specificity assessment of the outer primers described above.‬ ‬‬‬‬‬‬‬‬‬‬‬‬

Cross-reactions

Cross-reactions with other Yersinia spp, other bacterial or parasitological diseases prevalent in Madagascar were assessed. Five microliters (5 μl) of DNA extract of each strain (Yersinia enterocolitica, Yersinia pseudotuberculosis, Escherichia coli, Enterobacter cloacae, Shigella sonnei, Proteus mirabilis, Serratia odorifera, Serratia marcescens, Pseudomonas aeruginosa, Staphylococcus aureus, Taenia solium, Plasmodium vivax, Plasmodium falciparum and 4 of Mycobacterium tuberculosis) was tested. Concentrations of all DNA extracts were measured with spectrophotometer (Nanodrop 2000). Forty-seven biological samples tested positive with other diseases (schistosomiasis (n = 7), taeniasis (n = 3), cysticercosis (n = 8), filariosis (n = 1) and tuberculosis (n = 28)) were also tested to better assess potential cross-reactions.

Statistical analysis

LAMP caf1 was evaluated with the pre-treated human biological samples using the determined optimal conditions. Results were compared to those of the reference method (bacteriological culture). Specificity and sensitivity of LAMP caf1 were calculated with 95% confidence intervals using R 3.6.2. The kappa coefficient (κ) was also calculated to assess the level of agreement between the index test (LAMP caf1) and the reference test (bacteriological culture).

Results

Optimization of LAMP reaction

The optimal LAMP reaction was obtained using 0.95 mM betaine at 63°C after 45 min of amplification (Fig 2). Similar results were obtained using a thermal cycler and a simple water bath in parallel. Therefore, subsequent LAMP assays tests were conducted using water bath.

Fig 2. Optimization of LAMP caf1.

Fig 2

Optimal reaction was found by varying LAMP reaction parameters. Amplification was verified by naked eye with color change from orange to green (positive test) and without color change remaining orange (negative test) and by agarose gel electrophoresis. Optimization results of (A) the reaction time: 30 min (Tubes and Lanes 1–4), 45 min (Tubes and Lanes 5–8) and 60 min (Tubes and Lanes 9–12) (B) the reaction temperature: 57°C (Tubes and Lanes 1–4), 59°C (Tubes and Lanes 5–8), 61°C (Tubes and Lanes 9–12), 63°C (Tubes and Lanes 13–16), 65°C (Tubes and Lanes 17–20), 67°C (Tubes and Lanes 21–24) and 69°C (Tubes and Lanes 25–28) (C) the betaine concentration: 0 M (Tubes 1–4) and 0.95 M (Tubes 5–8).

When we tested the four LB (Table 2), they were all effective for target sequence amplification. Therefore, LB1 was kept for LAMP caf1 assays, making this a five primer Y. pestis LAMP assay. The target fragment was well amplified using LB1 after 35 min.

Specificity of the outer primers (F3 and B3)

The positions of the outer primers (F3 and B3) on the Y. pestis CO92 plasmid pMT1 (GenBank Accession No. AL 117211.1) determined with Sequence Extractor is shown in S2 Appendix. The expected target sequence was found to be 225 bp long (located between 86209–86433) which corresponded to the length of the obtained PCR amplicons (Fig 3). The conventional PCR specificity test did not show the presence of other additional bands using 7 DNA extracts confirming the specificity of the outer primers used for LAMP assay.

Fig 3. PCR amplifying the target sequence in 7 Y. pestis strains with the outer primers (F3 and B3).

Fig 3

Lanes 1 to 7: Y. pestis DNA; Lane 8: no DNA template (sterile distilled water); Lane 9: DNA ladder marker 100 bp.

Detection limit of LAMP and PCR assays

When amplifying serial dilution templates of Y. pestis DNA, the detection limit of LAMP caf1 was found to be 3.79 pg/μl (10−4) (Fig 4). The detection limit of LAMP caf1 was similar to that of PCR caf1.

Fig 4. Detection limit of LAMP and PCR caf1.

Fig 4

Ten-fold serial dilutions of Y. pestis DNA extract were tested. (A) Visualization of color change by the naked eye. (B) Confirmation of results by agarose gel electrophoresis. Tubes and Lanes 1, 2, 3, 4, 5, 6, and 7: Y. pestis DNA extracts undiluted stock, 10−1, 10−2, 10−3, 10−4, 10−5, and no DNA template (sterile distilled water) respectively, Lane 8: DNA ladder marker 100 bp. (C) Detection limit of conventional PCR caf1. Lanes 1, 2, 3, 4, 5, 6, and 7: 10−1, 10−2, 10−3, 10−4, 10−5, Y. pestis DNA extracts undiluted stock and no DNA template (sterile distilled water) respectively, Lane 8: DNA ladder marker 100 bp.

Cross-reactions

When amplifying DNA extracts from 14 other pathogens, a false positive result was observed with one DNA extract out of the four tested for M. tuberculosis (1) after SYBR Green I addition (Fig 5A). Further confirmation of the amplification products by electrophoresis showed no ladder-like pattern characteristic of LAMP products but a smear revealing the absence of LAMP amplification (Fig 5B). We hypothesis that this smear was pre-existing and not generated by the LAMP amplification. High specificity of LAMP caf1 was indicated by the lack of cross-reaction when the assay was tested against 14 pathogens and 47 plague-negative biological samples.

Fig 5. Cross-reactions of LAMP caf1.

Fig 5

LAMP reaction was assessed for DNA amplification of 14 pathogens: (A) Eye visualization of LAMP reaction after SYBR Green I addition, (B) visualization after gel electrophoresis migration of the LAMP products. Tubes and Lanes 1: Y. enterocolitica, 2: extraction control, 3: Y. pseudotuberculosis, 4: E. cloacae, 5: E. coli, 6: S. sonnei, 7: P. mirabilis, 8: S. odorifera, 9: S. marcescens, 10: P. aeruginosa, 11: S. aureus, 12: M. tuberculosis (1), 13: M. tuberculosis (2), 14: M. tuberculosis (3), 15: M. tuberculosis (4), 16: P. vivax, 17: P. falciparum, 18: T. solium,19: Y. pestis, 20: no DNA template (sterile distilled water) and Lane 21: DNA ladder marker 100 bp.

Sensitivity and specificity of LAMP caf1

A total of 160 human biological samples were tested for LAMP caf1 evaluation. Of the 49 plague culture positive samples tested, 47 were found positive, 1 negative and 1 inconclusive with LAMP caf1 based on naked eye observation with SYBR green I. The inconclusive LAMP reaction was from a sample that was dark in color before LAMP amplification. This dark coloration of the sample interfered with the ability to detect color change with Sybr Green I. However, visualization on 1.5% agarose gel electrophoresis showed faint LAMP ladder-like bands pattern. The faint DNA signal combined with the ladder-like bands after amplification seemed to suggest low concentration of the starting template DNA. The sensitivity of the LAMP assay compared to the bacteriological culture was 97.9% (95% CI: 89.1%-99.9%). Of the 111 culture negative samples, 105 remained negative with LAMP caf1 resulting to a specificity of 94.6% (95% CI: 88.6%-97.9%) (Table 3). A kappa coefficient of 0.89 (95% CI: 0.83%-0.97%) was obtained.

Table 3. Evaluation of LAMP caf1 performance.

LAMP caf1 Bacteriological culture
Positive Negative Total
Positive 48 6 54
Negative 1 105 106
Total 49 111 160

Discussion

Rapid diagnosis at the very early acute phase of plague is key to preventing mortality and spread through human to human transmission. Since plague outbreak mainly occurs in rural remote regions, a highly simple, inexpensive and rapid diagnosis would need to occur locally. The F1 RDT is widely used at the national level but, alone, is not considered an official confirmation. The current WHO gold standard for plague confirmation is the isolation of Y. pestis strains from biological samples [6], a time-intensive procedure that can take up to 10 days for results and requires a special biosecurity infrastructure facility that is non-existent in low-resource settings. Since the 2017 pneumonic plague outbreak in Madagascar, the CLP of the Malagasy Ministry of Public Health adopted a new diagnostic scheme for plague cases confirmation that includes, in addition to bacteriological culture, the combination of F1 RDT and duplex qPCR assays (detecting caf1 and pla genes) [2]. Although qPCR is rapid, yielding results in less than 4 hours, it requires sophisticated expensive equipment that is cost-prohibitive for regional hospital laboratories in developing countries. In this study, we described a new LAMP technique with high sensitivity and specificity for the rapid detection of Y. pestis and only require low-cost equipment. Combined with F1 RDT, LAMP caf1 assay would endow confirmatory capabilities at the local health clinics level throughout developing countries where plague foci are still endemic.

LAMP caf1 is significantly more rapid than qPCR, with 50 min (15 min “boil & spin” and 35 min amplification) vs less than 4 hours of completion time. The duplex qPCR also requires extraction of DNA from samples which places added resource burden. Two LAMP assays detecting Y. pestis have already been described targeting caf1 gene [16] and the 3a sequence on Y. pestis chromosome [17]. Both assays were evaluated on Y. pestis strains but not on infected biological samples. To the best of our knowledge, our study is the first to demonstrate the successful diagnostic use of the LAMP method on Y. pestis infected biological samples. In addition to the DNA extraction step, previously published Y. pestis LAMP assays required longer amplification time than our assay by 10 to 25 minutes (45 min [16] and 60 min [17]) and an additional 5 min step of either denaturation [16] or inactivation [17].

Our results showed a similar detection limit (3.79 pg/μl) between LAMP caf1 assay and conventional PCR caf1 using Y. pestis DNA. Although a similar result was previously reported with Y. pestis LAMP assay [16], several studies characterizing LAMP techniques on other pathogens reported lower detection limit compared to conventional PCR [2529]. However, LAMP caf1, using five different primers, has the advantage of being more robust compared to conventional PCR (with 2 primers). The LAMP assay was reported to be tolerant to certain types of biological substances that are not well tolerated in conventional PCR [30] thus making the additional steps to clean DNA template not necessary. A simple, rapid and cheaper (“boil & spin”) pre-treatment of the biological samples is enough for LAMP technique and makes it a significantly more feasible tool in low resource settings.

Compared to bacteriological culture, our LAMP caf1 showed efficacy for the detection of Y. pestis in biological samples with a sensitivity of 97.9% (95% CI: 89.1%-99.9%) and a specificity of 94.6% (95% CI: 88.6%-97.9%). The kappa coefficient of 0.89 (95% CI: 0.83%-0.97%) reflects an almost perfect agreement between bacteriological culture and LAMP caf1.

Certain parameters influenced LAMP caf1 performance. With regard to the reagents, it has been hypothesized that only GC rich sequences require the use of betaine [25]. In our case, betaine was found to be compulsory for LAMP caf1 even though the %GC of the target sequence was only 44.4%.

The duration of the reaction decreased by 10 min when adding the backward loop primer (45 min without LB1 vs 35 min). Other studies already emphasized similar findings and explained that when the loop primer is used, the initiation of synthesis at several regions resulted in a drastic amplification of the target sequence [24].

Although LAMP caf1 assay is highly promising, the technique presents some limitation and some challenges. This technique would not be able to detect Y. pestis strains with a deletion of all or part of the caf1 gene or a loss of the entire pFra/pMT1 plasmid [7, 31] but these modifications are rare for Y. pestis. Our LAMP assay uses SYBR Green I to visually confirm amplification of DNA. SYBR Green I proves not to be compatible when template DNA concentrations are high or the biological samples are dark in coloration. Firstly, when assessing LAMP caf1 for cross-reaction, 1 out of 4 M. tuberculosis DNA samples showed positive result after SYBR Green I addition (Fig 5). SYBR Green I is an intercalating dye binding non-specifically to all double stranded DNA, thus a sample containing high concentration of the DNA template would give a positive result without amplification of the target sequence. The resulting quantification of the M. tuberculosis DNA concentration (1171.9 ng/μl) using spectrophotometer seems to support this hypothesis. To overcome this challenge, DNA concentration can be quantified before the start of LAMP amplification to avoid the case of false positive result using SYBR Green I. If no DNA quantification method is available, another colorimetric method such as addition of hydroxy naphtol blue [21] or malachite green [32] may be more appropriate. An alternative approach used in this study was the addition of SYBR Green I to a representative aliquot of DNA before amplification. A green color indicates that the DNA extract is too concentrated and should be diluted before starting the reaction. We did not encounter false positive result once this M. tuberculosis (1) DNA extract was diluted before amplification. Overall, no cross-reaction was found against the remaining pathogens tested and on negative human samples thus demonstrating the high specificity of the amplification with LAMP caf1. Secondly, the use of colorimetric agent such as SYBR Green I on dark colored biological samples was incompatible due to interfering with the ability to visualize the color change. In our case, after gel electrophoresis of a dark colored sample, we found it to be positive with blurred ladder-like bands pattern indicating a low concentration of template DNA. Therefore, we concluded that analyzing amplified products using colorimetric methods are not suitable for dark colored samples, especially if samples had low DNA concentration. These findings are in agreement with a previous publication [33]. Each challenge encountered had alternative ways of resolving which may not always be suitable for point-of-care use.

In conclusion, LAMP caf1 developed in this study detected Y. pestis effectively in human biological samples with remarkable levels of sensitivity (97.9%) and specificity (94.6%). The use of this technique will save considerable time and effort which is particularly important for a fatal disease like plague that progresses rapidly without treatment. If combined with F1 RDT, its use would make it suitable as a potential confirmation method within plague endemic countries. Although further evaluation is needed in rural remote settings and training should be provided to healthcare staff who are not familiar to molecular technique, this LAMP assay holds great promise due to its simplicity and high performance. Adoption of this assay would greatly help address the urgent need to endow robust diagnostic capabilities at the local level in plague endemic foci which are mainly located in rural remote regions throughout Madagascar.

Supporting information

S1 Appendix. Plague national control program.

(PDF)

S2 Appendix. Delimitation of the sequence targeted by the outer primers (F3 and B3) using sequence extractor.

(TIF)

S1 Raw images. Original images supporting Fig 1(B), Fig 2(A), Fig 2(B), Fig 3, Fig 4(B), Fig 4(C) and Fig 5(B).

(PDF)

Acknowledgments

We would like to thank Pr Milijaona Randrianarivelojosia (Malaria Research Unit, Institut Pasteur de Madagascar) for the kind provision of DNA extracts of Plasmodium spp. We also thank Dr Niaina Rakotosamimanana (Mycobacteria Unit, Institut Pasteur de Madagascar) and Dr Frédérique Randrianirina (Clinical Center of Biology, Institut Pasteur de Madagascar) for the kind provision of DNA extracts of M. tuberculosis and residual samples from unsuspected plague patients used for the evaluation test in this study.

We are grateful to Dr Dawn Birdsell for editing this manuscript.

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

This work was supported by the Institut Pasteur de Madagascar. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.WHO. Plague around the world, 2010–2015. Wkly Epidemiol Rec. 2016;91(8):89–93. [PubMed] [Google Scholar]
  • 2.Randremanana R, Andrianaivoarimanana V, Nikolay B, Ramasindrazana B, Paireau J, Bosch Q, et al. Epidemiological characteristics of urban plague epidemic in Madagascar, August-November 2017: an outbreak report. Lancet Infect Dis. 2019;19(5):537–45. 10.1016/S1473-3099(18)30730-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Chanteau S, Rahalison L, Ralafiarisoa L, Foulon J, Ratsitorahina M, Ratsifasoamanana L, et al. Development and testing of a rapid diagnostic test for bubonic and pneumonic plague. Lancet. 2003;361(9353):211–6. 10.1016/S0140-6736(03)12270-2 [DOI] [PubMed] [Google Scholar]
  • 4.Rasoamanana B, Leroy F, Boisier P, Rasolomaharo M, Buchy P, Carniel E, et al. Field evaluation of an immunoglobulin G anti-F1 enzyme-linked immunosorbent assay for serodiagnosis of human plague in Madagascar. Clin Diagn Lab Immunol. 1997;4(5):587–91. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Rasoamanana B, Rahalison L, Raharimanana C, Chanteau S. Comparison of Yersinia CIN agar and mouse inoculation assay for the diagnosis of plague. Trans R Soc Trop Med Hyg. 1996;90(6):651 10.1016/s0035-9203(96)90420-4 [DOI] [PubMed] [Google Scholar]
  • 6.WHO. International Meeting on Preventing and Controlling Plague: The Old Calamity Still Has a Future. Wkly Epidemiol Rec. 2006;81(28):278–84. [PubMed] [Google Scholar]
  • 7.Rahalison L, Vololonirina E, Ratsitorahina M, Chanteau S. Diagnosis of bubonic plague by PCR in Madagascar under field conditions. J Clin Microbiol. 2000;38(1):260–63. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Notomi T, Okayama H, Masubuchi H, Yonekawa T, Watanabe K, Amino N, et al. Loop-mediated isothermal amplification of DNA. Nucleic Acids Res. 2000;28(12):E63 10.1093/nar/28.12.e63 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.de Avelar DM, Carvalho DM, Rabello A. Development and Clinical Evaluation of Loop-Mediated Isothermal Amplification (LAMP) Assay for the Diagnosis of Human Visceral Leishmaniasis in Brazil. Biomed Res Int. 2019;2019:8240784 10.1155/2019/8240784 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Thapa J, Maharjan B, Malla M, Fukushima Y, Poudel A, Pandey BD, et al. Direct Detection of Mycobacterium Tuberculosis in Clinical Samples by a Dry Methyl Green Loop-Mediated Isothermal Amplification (LAMP) Method. Tuberculosis. 2019;117:1–6. 10.1016/j.tube.2019.05.004 [DOI] [PubMed] [Google Scholar]
  • 11.Polley SD, González IJ, Mohamed D, Daly R, Bowers K, Watson J, et al. Clinical Evaluation of a Loop-Mediated Amplification Kit for Diagnosis of Imported Malaria. J Infect Dis. 2013;208(4):637–44. 10.1093/infdis/jit183 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Li S, Zhang X, Wang D, Kuang Y, Xu Y. Simple and rapid method for detecting foodborne Shigella by a loop-mediated isothermal amplification. J Rapid Methods Autom Microbiol. 2009;17:465–75. 10.1111/j.1745-4581.2009.00183.x [DOI] [Google Scholar]
  • 13.Dittrich S, Castonguay-Vanier J, Moore CE, Thongyoo N, Newton PN, Paris DH. Loop-mediated Isothermal Amplification for Rickettsia Typhi (The Causal Agent of Murine Typhus): Problems With Diagnosis at the Limit of Detection. J Clin Microbiol. 2014;52(3):832–8. 10.1128/JCM.02786-13 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Grab DJ, Nikolskaia O V, Inoue N, Thekisoe OMM, Morrison LJ, Gibson W, et al. Using Detergent to Enhance Detection Sensitivity of African Trypanosomes in Human CSF and Blood by Loop-Mediated Isothermal Amplification (LAMP). PLoS Negl Trop Dis. 2011;5(8):e1249 10.1371/journal.pntd.0001249 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Wang X, Yin F, Bi Y, Cheng G, Li J, Hou L, et al. Rapid and sensitive detection of Zika virus by reverse transcription loop-mediated isothermal amplification. J Virol Methods. 2016;238:86–93. 10.1016/j.jviromet.2016.10.010 [DOI] [PubMed] [Google Scholar]
  • 16.de Lira Nunes M, Mendes-Marques CL, de Almeida AMP, Leal NC. The development of a loop-mediated isothermal amplification (LAMP) procedure for plague diagnostic. Am J Anal Chem. 2014;5(16):1069–77. [Google Scholar]
  • 17.Feng N, Zhou Y, Fan Y, Bi Y, Yang R, Zhou Y, et al. Yersinia pestis Detection by Loop-Mediated Isothermal Amplification Combined With Magnetic Bead Capture of DNA. Brazilian J Microbiol. 2018;49(1):128–37. 10.1016/j.bjm.2017.03.014 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Mori Y, Nagamine K, Tomita N, Notomi T. Detection of Loop-Mediated Isothermal Amplification Reaction by Turbidity Derived From Magnesium Pyrophosphate Formation. Biochem Biophys Res Commun. 2001;289(1):150–4. 10.1006/bbrc.2001.5921 [DOI] [PubMed] [Google Scholar]
  • 19.Tomita N, Mori Y, Kanda H, Notomi T. Loop-mediated isothermal amplification (LAMP) of gene sequences and simple visual detection of products. Nat Protoc. 2008;3(5):877–82. 10.1038/nprot.2008.57 [DOI] [PubMed] [Google Scholar]
  • 20.Hill J, Beriwal S, Chandra I, Paul VK, Kapil A, Singh T, et al. Loop-mediated Isothermal Amplification Assay for Rapid Detection of Common Strains of Escherichia coli. J Clin Microbiol. 2008;46(8):2800–4. 10.1128/JCM.00152-08 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Goto M, Honda E, Ogura A, Nomoto A, Hanaki K-I. Colorimetric Detection of Loop-Mediated Isothermal Amplification Reaction by Using Hydroxy Naphthol Blue. Biotechniques. 2009;46(3):167–72. 10.2144/000113072 [DOI] [PubMed] [Google Scholar]
  • 22.Qiagen. DNeasy® Blood & Tissue Handbook. 2006. Available: http://www.qiagen.com/products/genomicdnastabilizationpurification/dneasytissuesystem/dneasybloodtissuekit.aspx#Tabs=t0
  • 23.Rivoarilala O, Garin B, Andriamahery F, Collard J. Rapid in Vitro Detection of CTX-M Groups 1, 2, 8, 9 Resistance Genes by LAMP Assays. PLoS One. 2018;13(7):e0200421 10.1371/journal.pone.0200421 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Nagamine K, Hase T, Notomi T. Accelerated Reaction by Loop-Mediated Isothermal Amplification Using Loop Primers. Mol Cell Probes. 2002;16(3):223–9. 10.1006/mcpr.2002.0415 [DOI] [PubMed] [Google Scholar]
  • 25.Han F, Wang F, Ge B. Detecting Potentially Virulent Vibrio Vulnificus Strains in Raw Oysters by Quantitative Loop-Mediated Isothermal Amplification. Appl Environ Microbiol. 2011;77(8):2589–95. 10.1128/AEM.02992-10 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Horisaka T, Fujita K, Iwata T, Nakadai A, Okatani AT, Horikita T, et al. Sensitive and Specific Detection of Yersinia pseudotuberculosis by Loop-Mediated Isothermal Amplification. J Clin Microbiol. 2004;42(11):5349–52. 10.1128/JCM.42.11.5349-5352.2004 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Chen S, Wang F, Beaulieu JC, Stein RE, Ge B. Rapid Detection of Viable Salmonellae in Produce by Coupling Propidium Monoazide With Loop-Mediated Isothermal Amplification. Appl Environ Microbiol. 2011;77(12):4008–16. 10.1128/AEM.00354-11 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Ranjbar R, Afshar D. Development of a Loop-Mediated Isothermal Amplification Assay for Rapid Detection of Yersinia enterocolitica via Targeting a Conserved Locus. Iran J Microbiol. 2015;7(4):185–90. [PMC free article] [PubMed] [Google Scholar]
  • 29.Wang L, Shi L, Alam MJ, Geng Y, Li L. Specific and rapid detection of foodborne Salmonella by loop-mediated isothermal amplification method. Food Res Int. 2008;41:69–74. 10.1016/j.foodres.2007.09.005 [DOI] [Google Scholar]
  • 30.Kaneko H, Kawana T, Fukushima E, Suzutani T. Tolerance of Loop-Mediated Isothermal Amplification to a Culture Medium and Biological Substances. J Biochem Biophys Methods. 2007;70(3):499–501. 10.1016/j.jbbm.2006.08.008 [DOI] [PubMed] [Google Scholar]
  • 31.Cui Y, Schmid BV, Cao H, Dai X, Du Z, Easterday WR, et al. Evolutionary Selection of Biofilm-Mediated Extended Phenotypes in Yersinia Pestis in Response to a Fluctuating Environment. Nat Commun. 2020;11(1):281 10.1038/s41467-019-14099-w [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Nzelu CO, Gomez EA, Cáceres AG, Sakurai T, Martini-Robles L, Uezato H, et al. Development of a Loop-Mediated Isothermal Amplification Method for Rapid Mass-Screening of Sand Flies for Leishmania Infection. Acta Trop. 2014;132:1–6. 10.1016/j.actatropica.2013.12.016 [DOI] [PubMed] [Google Scholar]
  • 33.Li S, Liu Y, Wang Y, Chen H, Liu C, Wang Y. Lateral Flow Biosensor Combined With Loop-Mediated Isothermal Amplification for Simple, Rapid, Sensitive, and Reliable Detection of Brucella spp. Infect Drug Resist. 2019;12:2343–53. 10.2147/IDR.S211644 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Henk D F H Schallig

17 Apr 2020

PONE-D-20-06493

Development and evaluation of loop-mediated isothermal amplification for detection of Yersinia pestis in plague biological samples

PLOS ONE

Dear Dr. Andrianaivoarimanana,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

In particular your are asked to further study the diagnostic performance of the developed assay by incliuding more samples, in particular of healthy endemic controls and other diseases.

The employed statistics require further attention

The issues about diagnostic performance should be addressed in an inteligent manner

All issues and points raised by the reviewers must be addressed

The figures need to be of better quality

We would appreciate receiving your revised manuscript by Jun 01 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Henk D. F. H. Schallig, Ph.D

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements:

1.    Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at http://www.plosone.org/attachments/PLOSOne_formatting_sample_main_body.pdf and http://www.plosone.org/attachments/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. PLOS ONE now requires that authors provide the original uncropped and unadjusted images underlying all blot or gel results reported in a submission’s figures or Supporting Information files. This policy and the journal’s other requirements for blot/gel reporting and figure preparation are described in detail at https://journals.plos.org/plosone/s/figures#loc-blot-and-gel-reporting-requirements and https://journals.plos.org/plosone/s/figures#loc-preparing-figures-from-image-files. When you submit your revised manuscript, please ensure that your figures adhere fully to these guidelines and provide the original underlying images for all blot or gel data reported in your submission. See the following link for instructions on providing the original image data: https://journals.plos.org/plosone/s/figures#loc-original-images-for-blots-and-gels.

In your cover letter, please note whether your blot/gel image data are in Supporting Information or posted at a public data repository, provide the repository URL if relevant, and provide specific details as to which raw blot/gel images, if any, are not available. Email us at plosone@plos.org if you have any questions.

3. We note you have two different tables labeled as Table 3. Please ensure that all your tables are numbered separately.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The manuscript by Lovasoa Nomena Randriantseheno describes the development of a LAMP assay that would be able to detect Y. pestis in human biological samples, and thereby improving the diagnosis of plague and circumventing cumbersome bacteriological culture.

The authors claim that no ethical approval is needed fort his study and that there is no informed consent needed from study cases. Although I believe that this might be right in this specific case a document supporting this would be good to have.

The work aimed to develop a rapid, simple and sensitive/specific LAMP method for the detection of the caf1 gene sequence that is specific to Y. pestis and to evaluate its performance on biological samples from plague suspected patients from Madagascar. However, apparently previously a LAMP assay has been developed see line 100. The authors should specify why they undertook the current study. What is their novel approach.

The development of the LAMP assay is straightforward and well described.

Diagnostic characteristics of the test would have been more convincing if also patient samples of cases with other diseases were tested. Can the authors do this?

Sensitivity and specificity should be presented with 95% confidence intervals (also in the abstract). Agreement between tests (kappa values) must be estimated and presented. In particular there should be a clear definition of the reference test. This is now presented partly in the discussion but must be included in the Methods section and presented in the Results section.

Figures are not of very good quality. This must be improved.

Reviewer #2: The manuscript addresses the development of a loop-mediated isothermal amplification (LAMP) test to aid in the diagnosis of Plague by detecting Yersinia pestis nucleic acids in clinical samples.

The authors explain the advantages of polymerase chain reaction (PCR) in the diagnosis of Plague, in opposition to culture and antigen detection rapid diagnostic test (RDT). The aim of the study is to develop a LAMP method that being simpler than PCR can replace it and implemented at lower levels of the health system, provided it has good diagnostic performance.

The methodology used is appropriate, but I would like to discuss some aspects of this work:

1) According to the authors PCR alone is not enough to confirm a diagnosis of Plague and this requires also a positive RDT result or a 4X increase in antibody titre, why is this required? Please, explain. Why not aiming at a LAMP method that can be used alone as confirmatory tool?

2) The LAMP method proposed is home brewed, will this be accepted by the Ministry of Health? Is the PCR method also home brewed?

3) When cross-reactions were assessed was DNA preparation and measurement the same for all samples? This is not clear.

4) LAMP shows lower sensitivity than culture. Is not this a suboptimal performance? Also, the use of SYBRGreen is a big limitation, the authors suggest to quantify DNA first and adjust DNA concentration, which is not ideal for a point-of-care (POC) test. Also, for coloured DNA samples analysis of amplified products by PCR is also suggested, which again is far from a POC.

5) Sensitivity and specificity are not estimated with confidence intervals, please apply the statistics needed for this.

6) The resulting LAMP test, as it is, does not seem to bring any advantage to the diagnosis of Plague

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Aug 18;15(8):e0237655. doi: 10.1371/journal.pone.0237655.r002

Author response to Decision Letter 0


27 May 2020

Response to Reviewers

PONE-D-20-06493

Development and evaluation of loop-mediated isothermal amplification for detection of Yersinia pestis in plague biological samples

PLOS ONE

PLoS ONE Academic editor requirements

In particular you are asked to further study the diagnostic performance of the developed assay by incliuding more samples, in particular of healthy endemic controls and other diseases.

Answer: For ethical reasons, it was not possible to obtain negative control adenitis aspirates from patients without suspected plague. Therefore, samples from negative patients tested on our LAMP caf1 were constituted of samples from patients not suspected for plague which were archived at the Clinical Center of Biology (Institut Pasteur de Madagascar) for other analysis: sputum (n= 18) and pus (n= 29)

We were also able to add 47 patient samples with other diseases to test on our LAMP caf1. They are distributed as follows: schistosomiasis (n= 7), taeniasis (n= 3), cysticercosis (n= 8), filariosis (n= 1) and tuberculosis (n= 28). They were kindly provided by other research units from the Institut Pasteur de Madagascar from their samples collection.

The employed statistics require further attention

Answer: Thank you for pointing this out. Estimations of the Sensibility and specificity of the LAMP caf1 were reviewed using appropriate statistical tests. In this purpose, we replaced in the “Materials and Methods” section the paragraph “Sensitivity and specificity of LAMP caf1” to “Statistical analysis” which highlighted the method used for sensitivity and specificity estimation (see page 11, line 206 of the revised manuscript).

The issues about diagnostic performance should be addressed in an inteligent manner

Answer: Following these requirements from the Academic editor and reviewers, statements on the diagnostic performance were added in the manuscript for better clarification.

All issues and points raised by the reviewers must be addressed

Answer: Thank you very much. We have answered to all the issues and questions raised by the reviewers. See our Answers below.

The figures need to be of better quality

Answer: Thank you. We also reviewed all the figures to meet the journal’s requirements for quality.

Journal requirements

When submitting your revision, we need you to address these additional requirements:

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at http://www.plosone.org/attachments/PLOSOne_formatting_sample_main_body.pdf and http://www.plosone.org/attachments/PLOSOne_formatting_sample_title_authors_affiliations.pdf

Answer: The revised manuscript meets PLOS ONE's style requirements

2. PLOS ONE now requires that authors provide the original uncropped and unadjusted images underlying all blot or gel results reported in a submission’s figures or Supporting Information files. This policy and the journal’s other requirements for blot/gel reporting and figure preparation are described in detail at https://journals.plos.org/plosone/s/figures#loc-blot-and-gel-reporting-requirements and https://journals.plos.org/plosone/s/figures#loc-preparing-figures-from-image-files. When you submit your revised manuscript, please ensure that your figures adhere fully to these guidelines and provide the original underlying images for all blot or gel data reported in your submission. See the following link for instructions on providing the original image data: https://journals.plos.org/plosone/s/figures#loc-original-images-for-blots-and-gels.

Answer: Original underlying images for all gel data reported in the revised manuscript are provided as Supporting Information file (pdf file) with specific details.

In your cover letter, please note whether your blot/gel image data are in Supporting Information or posted at a public data repository, provide the repository URL if relevant, and provide specific details as to which raw blot/gel images, if any, are not available. Email us at plosone@plos.org if you have any questions.

Answer: Gel image data in Supporting Information was mentioned in the revised cover letter

3. We note you have two different tables labeled as Table 3. Please ensure that all your tables are numbered separately.

Answer: The numbers of tables were corrected accordingly:

Page 11, line 199 (previous version) and Page 11, line 205 (revised version): Table 3. “Classification of the LAMP results” was deleted.

The paragraph entitled “Sensitivity and specificity of LAMP caf1” has been renamed to “Statistical analysis” to highlight the statistical method used to assess the performance of LAMP caf1.

Page 15, line 272 (previous version) and Page 15, line 279 (revised version): Table 3. now refers to “Evaluation of LAMP caf1 performance”

Review Comments to the Authors

Reviewer #1: The manuscript by Lovasoa Nomena Randriantseheno describes the development of a LAMP assay that would be able to detect Y. pestis in human biological samples, and thereby improving the diagnosis of plague and circumventing cumbersome bacteriological culture.

1- The authors claim that no ethical approval is needed for his study and that there is no informed consent needed from study cases. Although I believe that this might be right in this specific case a document supporting this would be good to have.

Answer: Thank you for asking for this supporting document. Although not available online, the French hard copy version of the Plague National Control Program (Edition 2012) of the Malagasy Ministry of Public Health stated at page 7, paragraph 4.4 that the notification of each plague case is mandatory at national level. It consists in recording all the necessary and useful information concerning each suspect plague patient as well as the epidemiological context in the official individual declaration form, a copy of which will be sent with the sample to the central laboratory for plague for confirmation, the surveillance of the sensitivity of strains to antibiotics and for the international weekly declaration.

We would also want to notice that these statements were already mentioned as such in other publications (see list below) using biological samples and/ or Y. pestis strains derived from plague suspected patients of Madagascar, see below:

- Vogler AJ, Andrianaivoarimanana V, Telfer S, Hall CM, Sahl JW, Hepp CM, Centner H, Andersen G, Birdsell DN, Rahalison L, Nottingham R, Keim P, Wagner DM, Rajerison. M. Temporal phylogeography of Yersinia pestis in Madagascar: Insights into the long-term maintenance of plague. PLoS Negl Trop Dis. 2017 Sep 5;11(9):e0005887. doi: 10.1371/journal.pntd.0005887. eCollection 2017 Sep.

- Vogler AJ, Chan F, Wagner DM, Roumagnac P, Lee J, Nera R, Eppinger M, Ravel J, Rahalison L, Rasoamanana BW, Beckstrom-Sternberg SM, Achtman M, Chanteau S, Keim P. Phylogeography and molecular epidemiology of Yersinia pestis in Madagascar. PLoS Negl Trop Dis. 2011 Sep;5(9):e1319. doi: 10.1371/journal.pntd.0001319. Epub 2011 Sep 13.

2- The work aimed to develop a rapid, simple and sensitive/specific LAMP method for the detection of the caf1 gene sequence that is specific to Y. pestis and to evaluate its performance on biological samples from plague suspected patients from Madagascar. However, apparently previously a LAMP assay has been developed see line 100. The authors should specify why they undertook the current study. What is their novel approach.

Answer: References cited at line 100-101 are related to the development of Yersinia pestis LAMP assay using pure cultures of Y. pestis (ref#20: de Lira Nunes M et al., 2014) and simulated samples (ref#21: Feng N et al, 2017) which are already clearly stated at the introduction section. These LAMP assays were not evaluated on biological samples collected from plague suspected patients which was the aim of our study. Therefore we think that our LAMP technique was the first which was evaluated on true plague samples as they are intended to be used later.

3- The development of the LAMP assay is straightforward and well described.

Diagnostic characteristics of the test would have been more convincing if also patient samples of cases with other diseases were tested. Can the authors do this?

Answer: Thank you for this interesting suggestion. We were able to add 47 patient samples with other diseases to test on our LAMP caf1. They are distributed as follows: schistosomiasis (n = 7), taeniasis (n = 3), cysticercosis (n = 8), filariosis (n = 1) and tuberculosis (n = 28). They were kindly provided by other research units from the Institut Pasteur de Madagascar from their samples collection.

They did not show cross reactions.

4- Sensitivity and specificity should be presented with 95% confidence intervals (also in the abstract). Agreement between tests (kappa values) must be estimated and presented. In particular there should be a clear definition of the reference test. This is now presented partly in the discussion but must be included in the Methods section and presented in the Results section.

Answer: Thank you for pointing this out. The presentation of Sensitivity and specificity of the test was reviewed according to the requirement of the reviewers i.e. using 95% confidence intervals. Agreement between tests (kappa values) were also estimated and presented in all the section of the manuscript (Abstract, Materials and Methods, Results and Discussion).

We used bacteriology with isolation of Y. pestis strain as reference test for plague diagnosis which is the gold standard as per the WHO (Wer, 2006)

5- Figures are not of very good quality. This must be improved.

Answer: We agree with the reviewer’s comment. They were improved to meet the journal requirement accordingly.

Reviewer #2: The manuscript addresses the development of a loop-mediated isothermal amplification (LAMP) test to aid in the diagnosis of Plague by detecting Yersinia pestis nucleic acids in clinical samples.

The authors explain the advantages of polymerase chain reaction (PCR) in the diagnosis of Plague, in opposition to culture and antigen detection rapid diagnostic test (RDT). The aim of the study is to develop a LAMP method that being simpler than PCR can replace it and implemented at lower levels of the health system, provided it has good diagnostic performance.

The methodology used is appropriate, but I would like to discuss some aspects of this work:

1) According to the authors PCR alone is not enough to confirm a diagnosis of Plague and this requires also a positive RDT result or a 4X increase in antibody titre, why is this required? Please, explain. Why not aiming at a LAMP method that can be used alone as confirmatory tool?

Answer: We refer to the plague case definition according to the WHO (see WER, 2006) which stated that a confirmed plague case requires: a culture positive with isolation of Y. pestis OR a combination of PCR and RDT positive OR a 4X increase in antibody titre. To date, there is no updated guideline from the WHO which can validate the use of PCR alone as a confirmatory test. However, as it was designed to be used at least at the district hospital, at the patient’s bedside, the plague LAMP method can help physicians (working at the health centers in remote plague areas) to confirm plague cases when combined with F1 RDT. Indeed, F1 RDT is already widely used in plague endemic areas since 2002.

2) The LAMP method proposed is home brewed, will this be accepted by the Ministry of Health? Is the PCR method also home brewed?

Answer: We think that this will be accepted by the MoH since almost biological tools used at the CLP for plague diagnosis followed home-made protocols. In addition, they were all validated on biological samples as required by the WHO.

3) When cross-reactions were assessed was DNA preparation and measurement the same for all samples? This is not clear.

Answer: Fourteen pathogens were tested for cross-reactions with LAMP caf1. Most of these pathogens were cultured in CLP and DNA extraction was performed using DNeasy Blood & Tissue Kits. However, for Taenia solium, Plasmodium vivax, Plasmodium falciparum and Mycobacterium tuberculosis, DNA extraction was conducted by other research units of the Institut Pasteur de Madagascar following their own protocols. The methods may be slightly different compared to our extraction protocol: DNeasy Blood & Tissue Kit (Qiagen Kit) used for Taenia solium, Plasmodium vivax, Plasmodium falciparum and an in-house protocol for Mycobacterium tuberculosis.

However, DNA measurements of all these pathogens were performed using Nanodrop 2000 but no DNA concentration adjustment was done before testing. Therefore, we added clarifications in the manuscript according to the reviewer’s comment.

4) LAMP shows lower sensitivity than culture. Is not this a suboptimal performance?

Answer: It is true that compared to culture, LAMP caf1 shows a lower sensitivity. However, in most of countries affected by plague, having additional test which can be used at the peripheral level allows health care workers to confidently rule in cases mainly for pneumonic plague, a severe and contagious disease, which may be clinically confused with acute respiratory infection (IRA).

Also, the use of SYBRGreen is a big limitation, the authors suggest to quantify DNA first and adjust DNA concentration, which is not ideal for a point-of-care (POC) test. Also, for coloured DNA samples analysis of amplified products by PCR is also suggested, which again is far from a POC.

Answer: We actually highlighted some problems related to the use of Sybr Green I during this study. While testing M. tuberculosis DNA for cross-reactions, we found that high concentration of DNA can lead to a false positive result with Sybr Green I. We proposed to quantify the DNA extract before amplification but for point-of-care diagnostic, we understood that this is not the ideal scenario. That is why we proposed an alternative method consisting in adding Sybr Green I to an aliquot of DNA before starting the amplification reaction. This is to make sure that the DNA concentration of the pre-treated sample is not too high and will not lead to a false positive result, if Sybr Green I turns green with this prior test, a simple dilution of the pre-treated sample is needed before starting the amplification. Regarding the dark colored sample, of the 113 samples tested, only one sample was dark colored and led to misinterpretation of the colorimetric result. For this sample, we run LAMP amplicons in a gel electrophoresis and saw the ladder-like pattern to classify it as a positive reaction. This case is an exception. Indeed, the biological samples collected for plague tests are either bubo aspirates or sputum samples which are usually not dark colored. For the case of septicemic plague, which is rarely reported, blood samples are collected and additional steps in the pre-treatment procedure can be applied to avoid such problems as reported previously (Viana GMR, Silva-Flannery L, Lima Barbosa DR, et al. Field evaluation of a real time loop-mediated isothermal amplification assay (RealAmp) for malaria diagnosis in Cruzeiro do Sul, Acre, Brazil. PLoS One. 2018;13(7):e0200492. Published 2018 Jul 11. doi:10.1371/journal.pone.0200492). However, no blood samples were included in our study.

5) Sensitivity and specificity are not estimated with confidence intervals, please apply the statistics needed for this.

Answer: Thank you for this remark. Sensitivity and specificity are now estimated with 95% confidence intervals as recommended by the reviewers. Agreement between tests (kappa values) were also estimated and presented in the whole manuscript.

6) The resulting LAMP test, as it is, does not seem to bring any advantage to the diagnosis of Plague

Answer: We don’t agree with the reviewer’s comment. According to the performance of the LAMP test developped in this study (Sensitivity of 97.9% and Specificity of 94.6% compared to the gold standard which is the bacteriological culture) and its practicability particularly for low resource countries such as Madagascar, it is a promising technology for plague diagnosis. Indeed, low income countries where such infectious disease is still endemic have a urgent need to develop diagnostic tool which can be performed at the level of the district hospital without the use of sophisticated equipment and devices. In addition to the F1RDT (already used at the level of plague endemic districts), the implementation of LAMP PCR will allow the confirmation of plague cases on site. This will significantly reduce the time for confirmation and therefore the implementation of appropriate preventive measures to stop the transmission.

________________________________________

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Henk D F H Schallig

29 May 2020

PONE-D-20-06493R1

Development and evaluation of loop-mediated isothermal amplification for detection of Yersinia pestis in plague biological samples

PLOS ONE

Dear Dr. Andrianaivoarimanana,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

You are requested to address the issues raised by the reviewers. In particular:

- provide statement/evidence for ethical approval;

- consult native English speaking person to improve use of English

- try to improve the quality of the figures (high resolution)

Also ensure that you follow PLoS ONE policy: The revised submission should include the raw blot/gel image data for your review, either in Supporting Information or via a public data repository; the Data Availability Statement should indicate where these data can be found. The original blot/gel image data should (1) represent unadjusted, uncropped images, (2) be provided for all blot/gel data reported in the main figures and Supporting Information, and (3) match the images in the manuscript figure(s).

Please submit your revised manuscript by Jul 13 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Henk D. F. H. Schallig, Ph.D

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Most of my comments have been addressed and some addiitonal samples seem to be analysed. I would like to see a statement on the patients'consent that these addiitonal sample could have been used for this study (and/or ethical review outcome that supports this). Also the relevant part of the document the authors refer to that cover the ethical approval for the study should be uploaded as suplementary material

English may require some attention

Quality of figures remains a concenr

Reviewer #2: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Aug 18;15(8):e0237655. doi: 10.1371/journal.pone.0237655.r004

Author response to Decision Letter 1


10 Jul 2020

Review Comments to the Author

Reviewer #1:

Most of my comments have been addressed and some addiitonal samples seem to be analysed. I would like to see a statement on the patients'consent that these addiitonal sample could have been used for this study (and/or ethical review outcome that supports this).

Answer: Additional samples used for this study have been anonymized and aggregated precluding identification of patients at individual level. They are part of residual samples from:

- Research project authorized for further use in future research (following the reference # 041-MSANP/CERBM du 08 juin 2017 from the Ethics Committee for Biomedical Research of the Malagasy Ministry of Public Health).

- Tuberculosis confirmation: mandatory samples collection as part of Madagascar’s routine surveillance system under national public health law.

They were all provided in the purpose of Public Health improvement in Madagascar.

Also the relevant part of the document the authors refer to that cover the ethical approval for the study should be uploaded as suplementary material

Answer: A copy of the Plague National Control Program (Edition 2012) of the Malagasy Ministry of Public Health has been uploaded as supplementary material (S1 Appendix. Plague National Control Program).

English may require some attention

Answer: The whole manuscript has now been reviewed by Dr Dawn Birdsell - a native English speaking scientist- for English improvement.

Quality of figures remains a concenr

Answer: All figure files have been greatly improved in terms of resolution to meet the Journal requirements. They have also been uploaded to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/ as required by the Journal.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 2

Henk D F H Schallig

31 Jul 2020

Development and evaluation of loop-mediated isothermal amplification for detection of Yersinia pestis in plague biological samples

PONE-D-20-06493R2

Dear Dr. Andrianaivoarimanana,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Henk D. F. H. Schallig, Ph.D

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Henk D F H Schallig

6 Aug 2020

PONE-D-20-06493R2

Development and evaluation of loop-mediated isothermal amplification for detection of Yersinia pestis in plague biological samples

Dear Dr. Andrianaivoarimanana:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Henk D. F. H. Schallig

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix. Plague national control program.

    (PDF)

    S2 Appendix. Delimitation of the sequence targeted by the outer primers (F3 and B3) using sequence extractor.

    (TIF)

    S1 Raw images. Original images supporting Fig 1(B), Fig 2(A), Fig 2(B), Fig 3, Fig 4(B), Fig 4(C) and Fig 5(B).

    (PDF)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES