Abstract
Background
Algorithms that bridge the gap between syndromic sexually transmitted infection (STI) management and treatment based in realistic diagnostic options and local epidemiology are urgently needed across Africa. Our objective was to develop and validate a risk algorithm for Neisseria gonorrhoeae (NG) and Chlamydia trachomatis (CT) diagnosis among symptomatic Rwandan women and to compare risk algorithm performance to the current Rwandan National Criteria for NG/CT diagnosis.
Methods
The risk algorithm was derived in a cohort (n = 468) comprised of symptomatic women in Kigali who sought free screening and treatment for sexually transmitted infections and vaginal dysbioses at our research site. We used logistic regression to derive a risk algorithm for prediction of NG/CT infection. Ten-fold cross-validation internally validated the risk algorithm. We applied the risk algorithm to an external validation cohort also comprised of symptomatic Rwandan women (n = 305). Measures of calibration, discrimination, and screening performance of our risk algorithm compared to the current Rwandan National Criteria are presented.
Results
The prevalence of NG/CT in the derivation cohort was 34.6%. The risk algorithm included: age < =25, having no/primary education, not having full-time employment, using condoms only sometimes, not reporting genital itching, testing negative for vaginal candida, and testing positive for bacterial vaginosis. The model was well calibrated (Hosmer-Lemeshow p = 0.831). Higher risk scores were significantly associated with increased prevalence of NG/CT infection (p < 0.001). Using a cut-point score of > = 5, the risk algorithm had a sensitivity of 81%, specificity of 54%, positive predictive value (PPV) of 48%, and negative predictive value (NPV) of 85%. Internal and external validation showed similar predictive ability of the risk algorithm, which outperformed the Rwandan National Criteria. Applying the Rwandan National Criteria cutoff of > = 2 (the current cutoff) to our derivation cohort had a sensitivity of 26%, specificity of 89%, PPV of 55%, and NPV of 69%.
Conclusions
These data support use of a locally relevant, evidence-based risk algorithm to significantly reduce the number of untreated NG/CT cases in symptomatic Rwandan women. The risk algorithm could be a cost-effective way to target treatment to those at highest NG/CT risk. The algorithm could also aid in sexually transmitted infection risk and prevention communication between providers and clients.
Supplementary Information
The online version contains supplementary material available at 10.1186/s12879-021-06073-z.
Keywords: Neisseria gonorrhoeae, Chlamydia trachomatis, Rwanda, Risk algorithm
Introduction
The World Health Organization (WHO) estimates that Neisseria gonorrhoeae (NG) and Chlamydia trachomatis (CT) prevalence has increased more than other curable sexually transmitted infections (STIs) in Africa [1]. Infection with NG or CT has been shown to increase risk of HIV transmission [2–5] and, in women, to increase risk of pelvic inflammatory disease, infertility, and preterm birth [6].
Syndromic STI management systems [7–14] remain the standard of care across much of Africa due to the high cost of culture-based and molecular diagnostics. While STI symptoms may be useful in identifying STIs in men, they are less easily interpreted in women who often experience non-STI genital conditions that produce discharge [15]. A particular challenge with syndromic management of women is distinguishing causes of endocervical infection (NG/CT) from vaginal infection or dysbiosis (Trichomonas vaginalis (TV), bacterial vaginosis (BV), and vaginal Candida albicans (VCA)).
Per the 2019 Rwandan National Criteria [16], management of men presenting with urethral discharge is presumptive treatment for NG/CT. Management of women presenting with vaginal discharge requires report of at least two of the following three risk factors to be treated for NG/CT cervicitis: age < 21, single, and > =2 sexual partners. Though WHO calls for development of locally relevant algorithms to improve STI diagnosis [17], the 2019 Rwanda criteria for women are not based on the local NG/CT prevalence or correlates of NG/CT.
We recruited symptomatic men and women in Kigali between January 2016 and August 2019 using radio announcements and referrals for free point-of-care STI screening and treatment at the Center for Family Health Research (CFHR) site in Kigali, Rwanda. We found very high NG and CT prevalence in men (among 1013 tests, 74% were NG positive, 20% CT positive, and 19% were negative) (Wall et al., under review). These data support that syndromic treatment of NG/CT in men according to the 2019 Rwandan National Criteria [16] may perform relatively well. In contrast, while we also found high NG and CT prevalence in women, the clinical picture was more complex (among 579 tests, 26% were NG positive, 17% CT positive, 21% BV positive, 21% VCA positive, 13% TV positive, 30% negative) (Wall et al., under review).
Here, our objective is to develop and validate a risk algorithm for diagnosis of NG/CT among symptomatic women in Rwanda and to compare the performance of this algorithm with the 2019 Rwandan National Criteria [16].
Methods
Ethics
This program was approved as non-research by the Rwandan National Ethics Committee and the US Centers for Disease Control (CDC) that funded service provision through PEPFAR. This program also met non-research criteria of the Emory Institutional Review Board. STI diagnosis and treatment were provided anonymously as free public health services. All methods were carried out in accordance with relevant guidelines and regulations.
Derivation cohort
Women were recruited between January 2016 and August 2019 in Kigali, the capital of Rwanda. Radio announcements encouraged men and women with genital discharge, discomfort, or ulcer to seek free STI screening and treatment services at our CFHR site from trained staff. Clients were asked to refer sex partners and any known symptomatic person. Pharmacists were asked to refer people seeking treatment for STI-suggestive symptoms to the CFHR site. We limited the derivation cohort to symptomatic women, defined as reporting vaginal discharge, to be comparable with the Rwandan National criteria. Some women returned for additional care, confirmation of treatment effectiveness, or other reasons. The final risk algorithm derivation cohort was composed of women’s first visits only.
External validation cohort
Between January to March 2020, symptomatic women were again recruited for free STI screening and treatment at our CFHR site using the same recruitment strategies described above. However instead of trained site staff, STI diagnoses were made by eight government clinic providers who were trained by our staff during a didactic training session (with pre/post-training assessment) on STI etiologies, treatments, and use of the Rwandan National Criteria for diagnosis among symptomatic patients. After government providers made diagnoses, patients underwent gold standard STI diagnosis and treatment as described below. The final external validation cohort was composed of women’s first visits only.
Survey, genital exam, and laboratory measures
In both the derivation and external validation cohort, demographic, risk factor, and symptom data were collected via standardized surveys. Survey questions were identified through literature review and based on our previous work describing STIs in Rwanda [18–21]. Surveys were administered by nurses who entered participant responses into MS Access. Genital exams were performed by trained physicians and nurses. We conducted laboratory testing of patient samples including phlebotomy for rapid HIV and rapid plasma reagin (RPR) serologies; microscopy of vaginal swab wet mount preparations to diagnose TV, BV and VCA; and endocervical swabs for GeneXpert (Cepheid, Sunnyvale USA) testing for NG and CT. Given concerns about emergence of antibiotic resistance of NG in Rwanda and elsewhere in Africa [12, 22] and the dated information from Rwanda (last published study in 2000) [23] we requested patients treated for NG return for retesting 2–3 weeks after treatment. National guidelines (2015) for first-line NG treatment specified ciprofloxacin with ceftriaxone used in cases of resistance, and doxycycline for CT. This changed in the 2019 Guidelines to ceftriaxone as first-line treatment for NG.
Data analyses
Analyses are conducted with Statistical Analysis Software version 9.4 (Cary, NC).
Outcome of interest
Our outcome of interest was NG and/or CT infection diagnosed on GeneXpert in women presenting with vaginal discharge. We recognize and discuss below the difference between a positive nucleic acid test and a confirmed infection. We focus on symptomatic women and combined NG and CT to be comparable with the Rwandan National Criteria for diagnosis of NG/CT.
Baseline characteristics and associations with NG or CT infection
Demographic, behavioral, and symptom data are described for the derivation and validation cohorts. Counts and percentages (categorical variables) and means and standard deviations (continuous variables) are presented. The data were described overall and by NG/CT infection status. Chi-square (or Fisher’s exact) or t-tests evaluated whether differences in the distribution of baseline data by NG/CT infection status was due to chance.
Derivation and calibration of the risk algorithm
Bivariate and multivariable logistic regression models identified variables associated with the outcome of interest. Variables were included in multivariable models if they were associated (p < 0.05) with the outcome in bivariate analyses, survived backward elimination, and were considered feasible measures in a Rwandan government clinic setting (for example, phlebotomy and microscopy are available in most health centers while physical exams are not). Variable multi-collinearity was assessed. Crude and adjusted prevalence odds ratios, 95% confidence intervals, and p-values were calculated. Score values for individual variables in the final model were obtained by dividing each variable’s estimated model coefficient by the lowest coefficient among all variables and rounding to the nearest integer. To assess model calibration, we used the Hosmer-Lemeshow Goodness-of-Fit test using the LACKFIT option in SAS.
Internal validation of the risk algorithm
We used standard 10-fold cross validation methods [24] for internal validation. Briefly, variables significantly (p < 0.05) associated with the outcome in bivariate analysis were included in initial multivariate models excluding a random 1/10th of the data. The final model was derived by backwards elimination and a model coefficient-weighted score was created from the variables retained in the final model. The scores derived were then tested in the remaining 1/10th of the data. This process was repeated ten times such that each 1/10th was withheld and then tested in turn. Then the same process was applied to ten 90% training sets and 10% test sets.
Discrimination of the risk algorithm and the Rwandan National Criteria
The area under the receiver operating curve (AUC) was calculated using standard methods [25] for the risk algorithm applied to the derivation cohort, after 10-fold cross validation (average AUC of the 10 different models is presented), and applied to the external validation cohort. The AUC was also calculated after applying the Rwandan National Criteria to the derivation cohort. Receiver operating curves were graphed and compared for the risk algorithm versus the Rwandan National Criteria, both as applied to the derivation cohort. Measures of sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of the risk algorithm were calculated using score cut-offs defined as the median score.
Distribution of NG/CT prevalence and population by score categories
The prevalence of NG/CT within risk score categories were calculated in the derivation cohort comparing the risk algorithm with the Rwandan National Criteria. The population distribution of the derivation cohort falling within each risk score category was also calculated.
Results
Baseline characteristics and associations with NG or CT infection
Most (82%) women were symptomatic. Among the n = 468 symptomatic women in the derivation cohort, the prevalence of NG/CT infection was 35% (Table 1). Most women reported only one or no partner in the last month (83%) and most (64%) reported never using condoms during vaginal sex in the last 3 months. Roughly one-fifth of women were BV positive and one-fifth were candida positive. Roughly half had endocervical inflammation or discharge on physical exam. Overall, the derivation and external validation cohorts were similar. Among the n = 305 women in the external validation cohort, the prevalence of NG/CT was 28% (Supplemental Table 1). Some differences include the prevalence of BV (21% derivation versus 40% validation cohort), and endocervical inflammation or discharge on physical exam (53% derivation versus 36% validation cohort).
Table 1.
Baseline characteristics and associations with NG or CT infection in symptomatic women, Kigali (N = 468): derivation cohort
| Total (N = 468) | Either NG or CT (n = 162) | NG and CT Uninfected (n = 306) | p-value | ||||
|---|---|---|---|---|---|---|---|
| N | Col % | N | Row % | N | Row% | ||
| Demographics | |||||||
| Age | |||||||
| 25 or younger | 187 | 40% | 86 | 46% | 101 | 54% | < 0.0001 |
| Older than 25 | 281 | 60% | 76 | 27% | 205 | 73% | |
| Referrer | |||||||
| Radio Advert | 233 | 50% | 70 | 30% | 163 | 70% | 0.038 |
| Othera | 235 | 50% | 92 | 39% | 143 | 61% | |
| Living and Marital Status Composite | |||||||
| Married and Cohabiting | 216 | 46% | 57 | 26% | 159 | 74% | 0.001 |
| Other | 252 | 54% | 105 | 42% | 147 | 58% | |
| Education Level | |||||||
| None/Primary | 256 | 55% | 75 | 29% | 181 | 71% | 0.008 |
| Secondary/Higher | 212 | 45% | 87 | 41% | 125 | 59% | |
| Employment Status | |||||||
| Full-time employment | 165 | 35% | 43 | 26% | 122 | 74% | 0.004 |
| Part-time/Student/Jobless | 302 | 65% | 119 | 39% | 183 | 61% | |
| Sexual behaviors | |||||||
| Number of partners in last 30 days | |||||||
| None or one partner | 355 | 83% | 102 | 29% | 253 | 71% | < 0.0001 |
| More than one partner | 72 | 17% | 44 | 61% | 28 | 39% | |
| Condom use during vaginal sex in the last three months | |||||||
| Always (or did not have vaginal sex) | 30 | 7% | 7 | 23% | 23 | 77% | < 0.0001 |
| Sometimes | 123 | 29% | 68 | 55% | 55 | 45% | |
| Never | 274 | 64% | 71 | 26% | 203 | 74% | |
| Number of days since sexual contact you suspect STI was acquired from | |||||||
| 0–16 | 90 | 21% | 42 | 47% | 48 | 53% | 0.006 |
| >=17 | 339 | 79% | 106 | 31% | 233 | 69% | |
| Self-reported symptoms | |||||||
| Genital itching | |||||||
| Yes | 266 | 57% | 72 | 27% | 194 | 73% | <.001 |
| No | 199 | 43% | 87 | 44% | 112 | 56% | |
| Number of days with symptoms | |||||||
| 1–10 | 113 | 21% | 48 | 42% | 65 | 58% | 0.029 |
| 11 or more | 321 | 60% | 100 | 31% | 221 | 69% | |
| HIV and Other STI Results | |||||||
| HIV Status | |||||||
| Positive | 59 | 13% | 29 | 49% | 30 | 51% | 0.012 |
| Negative | 409 | 87% | 133 | 33% | 276 | 67% | |
| RPR Result | |||||||
| Positive (1, 11 or greater) | 39 | 8% | 23 | 59% | 16 | 41% | 0.001 |
| Negative | 423 | 92% | 138 | 33% | 285 | 67% | |
| Candida | |||||||
| Positive | 106 | 23% | 17 | 16% | 89 | 84% | < 0.0001 |
| Negative | 348 | 77% | 138 | 40% | 210 | 60% | |
| BV | |||||||
| Positive | 96 | 21% | 49 | 51% | 47 | 49% | < 0.0001 |
| Negative | 355 | 79% | 104 | 29% | 251 | 71% | |
| Physical exam | |||||||
| Vaginal Inflammation or Discharge | |||||||
| Yes | 398 | 92% | 129 | 32% | 269 | 68% | 0.014 |
| No | 36 | 8% | 19 | 53% | 17 | 47% | |
| Endocervical Inflammation or Discharge | |||||||
| Yes | 230 | 53% | 96 | 42% | 134 | 58% | 0.001 |
| No | 202 | 47% | 52 | 26% | 150 | 74% | |
aHeard from Friends/Walk-in/Pharmacy/Other/Invitation/Contact Partner/Internet
Not associated, not tabled: number of children under 18, number of additional children desired, pregnancy status, wanting more children in the next two years, family planning method, burning sensations when passing urine, genital ulcer, dyspareunia, unpleasant odor, lower abdominal pain, trichomonas, genital ulcer
CT Chlamydia trachomatis, NG Neisseria gonorrhoeae, SD standard deviation, STI sexually transmitted infection, RPR rapid plasma reagin, BV bacterial vaginosis
Risk algorithm components, calibration, and discrimination
As shown in Table 2, the risk algorithm included being 25 or younger (2 points), having no/primary education (1 point), not having full-time employment (1 point), sometimes using condoms (2 points), not reporting genital itching (2 points), not having candida (2 points), and having BV (1 point). The Hosmer-Lemeshow Goodness-of-Fit test indicated good calibration (p-value = 0.831). The risk algorithm had reasonable discrimination in the derivation cohort (AUC = 0.75, 95%CI: 0.70–0.79, p < 0.001). We also had reasonable discrimination in the 10-fold cross validation (AUC = 0.71, 95%CI: 0.55–0.86, p < 0.01, Table 3) and the external validation cohort (AUC = 0.63, 95%CI: 0.56–0.70, p < 0.01).
Table 2.
Risk score algorithm comprised of factors associated with NG or CT infection in symptomatic women, Kigali (N = 468)
| Final multivariable model | Score points | ||||
|---|---|---|---|---|---|
| aPOR | 95% CI | p-value | |||
| Age | |||||
| 25 or younger | 2.38 | 1.47 | 3.84 | <.001 | 2 |
| Older than 25 | ref | ||||
| Education Level | |||||
| None/Primary | 1.68 | 1.04 | 2.72 | 0.034 | 1 |
| Secondary/Higher | ref | ||||
| Employment Status | |||||
| Full-time employment | ref | ||||
| Part-time/Student/Jobless | 1.76 | 1.05 | 2.94 | 0.032 | 1 |
| Condom use during vaginal sex in the last three months | |||||
| Always (or did not have vaginal sex) | 1.06 | 0.40 | 2.84 | 0.906 | |
| Sometimes | 2.51 | 1.52 | 4.14 | <.001 | 2 |
| Never | ref | ||||
| Genital itching | |||||
| Yes | ref | ||||
| No | 2.28 | 1.43 | 3.66 | 0.001 | 2 |
| Candida | |||||
| Positive | ref | ||||
| Negative | 2.76 | 1.46 | 5.22 | 0.002 | 2 |
| BV | |||||
| Positive | 1.99 | 1.17 | 3.38 | 0.011 | 1 |
| Negative | ref | ||||
CT Chlamydia trachomatis, NG Neisseria gonorrhoeae, aPOR adjusted prevalence odds ratio, CI confidence interval, BV bacterial vaginosis
Area Under the Curve: 0.75 (95%CI: 0.70–0.79, p < 0.001)
Hosmer-Lemeshow: Chi-square = 4.29, p = 0.831
Table 3.
Results of 10-fold cross validation or a risk score algorithm comprised of factors associated with NG or CT infection in symptomatic women, Kigali (N = 468)
| Test Group | AUC | 95%CI | p-value | |
|---|---|---|---|---|
| 10 | 0.71 | 0.54 | 0.89 | 0.019 |
| 9 | 0.69 | 0.51 | 0.86 | 0.037 |
| 8 | 0.83 | 0.70 | 0.96 | < 0.0001 |
| 7 | 0.66 | 0.50 | 0.81 | 0.048 |
| 6 | 0.72 | 0.57 | 0.86 | 0.003 |
| 5 | 0.68 | 0.51 | 0.84 | 0.039 |
| 4 | 0.73 | 0.57 | 0.89 | 0.005 |
| 3 | 0.76 | 0.63 | 0.90 | < 0.001 |
| 2 | 0.72 | 0.58 | 0.86 | 0.003 |
| 1 | 0.60 | 0.43 | 0.76 | 0.258 |
| Average | 0.71 | 0.55 | 0.86 | < 0.01 |
CT Chlamydia trachomatis, NG Neisseria gonorrhoeae, AUC area under the curve, CI confidence interval
Discrimination of the risk algorithm compared to the Rwandan National Guideline Criteria
Sensitivity, specificity, PPV, and NPV for the risk algorithm and the Rwandan National Criteria are shown in Table 4. The risk algorithm in the derivation cohort had 81% sensitivity, 54% specificity, 48% PPV, and 85% NPV for a score cutoff of > = 5. As shown in Table 4, the risk algorithm performed similarly in the external validation cohort. In comparison, the Rwandan National Criteria was substantially less sensitive than the risk algorithm. Applying the Rwandan National Criteria cutoff of > = 2 (the cutoff level in 2019 Guidelines) to our derivation cohort had a sensitivity of 26%, specificity of 89%, PPV of 55%, and NPV of 69%. These findings are reflected in the receiver operating curve shown in Fig. 1. The Rwandan National Criteria had lower discrimination compared to the risk algorithm.
Table 4.
Risk algorithm performance to identify NG or CT infection in symptomatic women compared with Rwandan National Criteria
| Sensitivity | Specificity | PPV | NPV | |
|---|---|---|---|---|
| Risk Score | ||||
| Derivation cohort | ||||
| Score > =4 | 91% | 36% | 43% | 88% |
| Score > =5 | 81% | 54% | 48% | 85% |
| Score > =6 | 65% | 74% | 57% | 80% |
| Score > =7 | 44% | 84% | 59% | 74% |
| External validation cohort | ||||
| Score > =4 | 79% | 33% | 32% | 80% |
| Score > =5 | 67% | 48% | 34% | 79% |
| Score > =6 | 53% | 66% | 38% | 78% |
| Score > =7 | 35% | 79% | 39% | 76% |
| Rwanda National Criteria | ||||
| Derivation cohort | ||||
| Score > =2a | 26% | 89% | 55% | 69% |
CT Chlamydia trachomatis, NG Neisseria gonorrhoeae, PPV positive predictive value, NPV negative predictive value
aCurrent cutoff used in the 2019 Rwandan National Guidelines
Fig. 1.
Receiver operating curves companing the risk algorithm and Rwandan National Criteria (derivation cohort, n = 468 women)
Distribution of NG/CT prevalence and population by score category comparing the risk algorithm to the Rwandan National Criteria
For both the risk algorithm and the Rwandan National Criteria, higher scores were significantly associated with increased prevalence of NG/CT infection (p < 0.001) (Fig. 2a and b). Applying the risk algorithm (Fig. 2a), most of the population had risk algorithm scores of 4 (15% of the population), 5 (19%), or 6 (14%). The prevalence of NG/CT within these risk algorithm categories were 21, 30, and 53%, respectively. Applying the Rwandan National Criteria (Fig. 2b), most of the population had risk scores of 0 (42% of the population) or 1 (42%). The prevalence of NG/CT within these risk algorithm categories was 20 and 40%, respectively.
Fig. 2.
Prevalence of CT/NG and population distribution within exact risk score categories comparing the risk algorithm (panel a) and the 2019 Rwandan National Guidelines Criteria (panel b) applied to the derivation cohort (n = 468 women)
Discussion
In this study, we developed and validated a simple risk algorithm comprised of demographic, symptoms, and laboratory data and based on up-to-date epidemiological data from Kigali, Rwanda. This risk algorithm outperformed the current Rwandan National Criteria. Importantly, the current Rwandan National Criteria cutoff score of > = 2 would have missed identifying many women who were NG/CT positive in our derivation cohort – the proportion of NG/CT cases not diagnosed (i.e., the proportion of false negatives) was 19% using the risk algorithm (cutoff > = 5) compared to 74% using Rwandan National Criteria (cutoff > = 2). These findings exemplify the WHO recommendation that locally relevant data should inform approaches to diagnosis and treatment [17].
The advent of GeneXpert diagnostics for NG and CT has greatly enhanced STI management. A recent study in Rwanda found that providing GeneXpert tests for NG/CT as well as point-of-care tests for BV and TV in symptomatic, high-risk women significantly reduced overtreatment [26]. However, at $18/test for GeneXpert reagents and reliance on an expensive machine that is not widely available, this technology remains unaffordable in much of Africa. Algorithms that bridge the gap between syndromic management and treatment based in realistic diagnostic options and local epidemiology are urgently needed.
Women commonly experience genital symptoms that are due to non-STIs like VCA or BV, which has been a challenge with syndromic diagnosis of STIs in women. In our model, testing negative for VCA or positive for BV on microscopic examination of vaginal swab wet preparations was associated with NG/CT infection. While microscopy is generally available in health centers, laboratory technicians may need to be (re) trained to diagnose TV, BV, or VCA on vaginal swab wet mount preparations. Microscopy could also potentially have a role in NG diagnosis. Gram-stained endocervical (or urethral) discharge, which is feasible in government health facilities, could be further explored. In our laboratory, 12/13 GeneXpert NG positive and 2/41 GeneXpert NG negative endocervical swabs from women were positive for NG on Gram stain. Of urethral discharge samples from men, 64/93 GeneXpert NG positive and 2/68 GeneXpert NG negative samples were positive for NG on Gram stain (unpublished data). The sensitivity of Gram stain is suboptimal and false positives may result when other Gram-negative coccobacilli including Moraxella osloensis, Moraxella phenylpyruvica, Kingella denitrificans, and Acinetobacter species are present. This is particularly true when microscopists have not been trained to distinguish intra from extra-cellular diplococci. That said, the cost is low and, with adequate quality control of microscopy, GeneXpert could, for example, be a backup for microscopy negative clients with an otherwise suggestive profile.
We did not include physical exam findings in our risk algorithm since physical exams are not routinely conducted in Rwandan government health facilities where trained clinicians and equipment for speculum exams may not be available. However, in our previous publication of data from this program (Wall et al., under review), we reported that distinguishing vaginal from endocervical discharges via physical exam may improve diagnostic performance. Visual examination of ulcer may also improve STI diagnosis [27]. We previously reported that most RPR+ patients did not report ulcers, which may be internal in women and difficult to see. Conversely, most men and women with ulcers were not RPR+. While physical exams are likely infeasible for all symptomatic patients in government clinic outpatient departments, genital exams for men are more feasible and targeted genital exams for women may be possible and useful.
We learned some relevant lessons when training the eight government healthcare providers who made diagnoses in the external validation cohort. Following didactic training, knowledge of the Rwandan National Criteria for syndromes substantially increased from 60 to 88% (p < 0.0001) and correct treatment for STI etiologies increased from 44 to 80% (p < 0.0001) (unpublished data). However, after providers were trained, overtreatment of NG/CT was more common using National Guidelines, with 59% of prescriptions being unnecessary. The cost-effectiveness of implementing an evidence-based risk algorithm along with improved provider trainings to identify and treat STI should be explored.
One important provider training topic is antibiotic resistance in NG. Initially, patients diagnosed with NG by GeneXpert at the CFHR site were treated with ciprofloxacin (first line using 2015 National Guidelines with ceftriaxone for cases of resistance) or ceftriaxone (first line in 2019 Guidelines) and asked to return in 2–3 weeks for re-testing. We found that NG positivity after treatment was significantly higher among those who received ciprofloxacin versus ceftriaxone (86% vs 15% measured 1–16 days after initial treatment). While some positive repeat tests may be due to persistence of nucleic acids detectable by GeneXpert for 2 weeks [28, 29] or re-infection, these results strongly suggest resistance to ciprofloxacin. As a result of our preliminary findings of resistance to ciprofloxacin, the 2019 National Guidelines changed the first line NG treatment to ceftriaxone (Wall et al., under review).
Another important training topic is partner notification to diagnose new cases and reduce reinfection in index cases. In the subset of the NG patients above, the proportion who were NG positive 17–30 days after Ceftriaxone treatment was 30% and this increased to 68% at > 30 days after Ceftriaxone treatment. Although without negative intervening tests we cannot be certain, the increase over time does suggest high rates of reinfection by an untreated partner. Partner notification involves identifying exposed sex partner(s) of index cases with STI, notifying them about their exposure, and offering testing, counselling and treatment [30]. Our program relied on patient referrals of sexual partners as described in National Guidelines. Other strategies include providing a referral slip for the index to give to partner(s) to seek treatment at a facility or asking the index case for contact information for their partners to allow clinic staff to communicate results directly by telephone or by mail [31]. A systematic review found that provider referral strategies may be more effective than patient referral in some populations [32].
Our program and data have some limitations. Data from an external validation cohort from another urban center would have improved the assessment of risk algorithm validity. Our findings are generalizable to symptomatic women who comprise most women seeking care at health facilities. However, many NG/CT cases are asymptomatic [33, 34], GeneXpert screening of high-risk populations may be warranted where feasible and affordable. Additionally, our findings are generalizable to urban women, who experience a larger proportion of STIs in Rwanda compared to rural women. We did not have the facilities to diagnose some etiologies of inflammation (e.g., M. genitalium) or ulcer (e.g., chancroid, lymphogranuloma venereum).
Conclusions
Syndromic management guidelines in Rwanda can be improved with consideration of demographic, symptoms, and simple laboratory measures shown to be predictive of STI and non-STI dysbioses. Our data support use of a locally relevant, evidence-based risk algorithm to greatly reduce the number of untreated NG/CT cases in symptomatic Rwandan women. Our risk algorithm combined with provider training could be a cost-effective way to improve upon syndromic STI management and treatment in the Rwandan capital.
Supplementary Information
Additional file 1: Table S1. Baseline characteristics and associations with CT or NG infection in symptomatic women, Kigali (N = 305): external validation cohort.
Acknowledgements
Not applicable.
Abbreviations
- AUC
Area under the receiver operating curve
- BV
Bacterial vaginosis
- CT
Chlamydia trachomatis
- NPV
Negative predictive value
- NG
Neisseria gonorrhoeae
- PPV
Positive predictive value
- RPR
Rapid plasma reagin
- STI
Sexually transmitted infection
- TV
Trichomonas vaginalis
- VCA
Vaginal Candida albicans
- WHO
World Health Organization
Authors’ contributions
KMW contributed to the analysis and interpretation of data, drafted the article and revised it critically for important intellectual content, and gave final approval of the version to be published. JN, RI, JB, JM, AM, MAU, AT, EK contributed to the conception and design of the study, revised the article critically for important intellectual content, and gave final approval of the version to be published. RP, MP contributed to the analysis and interpretation of data, revised the article critically for important intellectual content, and gave final approval of the version to be published. SA contributed to the study design and conception, contributed to the analysis and interpretation of data, revised the article critically for important intellectual content, and gave final approval of the version to be published.
Funding
This work was funded by the International AIDS Vaccine Initiative (IAVI) with the generous support of USAID; a full list of IAVI donors is available at www.iavi.org. This work was partially funded by CDC, the National Institutes of Health (NIAID R01 AI51231), the AIDS International Training and Research Program Fogarty International Center (D43 TW001042); and the Emory Center for AIDS Research (P30 AI050409). The contents of this manuscript are the responsibility of the authors and do not necessarily reflect the views of USAID, CDC or the US Government.
Availability of data and materials
The datasets analysed during the current study are available from the corresponding author on reasonable request.
Declarations
Ethics approval and consent to participate
This study program was approved as non-research by the Rwandan National Ethics Committee and the US Centers for Disease Control (CDC) that funded service provision through PEPFAR. This program also met non-research criteria of the Emory Institutional Review Board. STI diagnosis and treatment were provided anonymously as free public health services. All methods were carried out in accordance with relevant guidelines and regulations. Waivers of written informed consent were obtained from the Emory Institutional Review Board and the Rwandan National Ethics Committee.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Rowley J, Vander Hoorn S, Korenromp E, Low N, Unemo M, Abu-Raddad LJ, Chico RM, Smolak A, Newman L, Gottlieb S, Thwin SS, Broutet N, Taylor MM. Chlamydia, gonorrhoea, trichomoniasis and syphilis: global prevalence and incidence estimates, 2016. Bull World Health Organ. 2019;97(8):548–62P. doi: 10.2471/BLT.18.228486. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Phiri S, Zadrozny S, Weiss HA, Martinson F, Nyirenda N, Chen CY, Miller WC, Cohen MS, Mayaud P, Hoffman IF. Etiology of genital ulcer disease and association with HIV infection in Malawi. Sex Transm Dis. 2013;40(12):923–928. doi: 10.1097/OLQ.0000000000000051. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Takuva S, Mugurungi O, Mutsvangwa J, Machiha A, Mupambo AC, Maseko V, Cham F, Mungofa S, Mason P, Lewis DA. Etiology and antimicrobial susceptibility of pathogens responsible for urethral discharge among men in Harare. Zimbabwe Sex Transm Dis. 2014;41(12):713–717. doi: 10.1097/OLQ.0000000000000204. [DOI] [PubMed] [Google Scholar]
- 4.Sylverken AA, Owusu-Dabo E, Yar DD, Salifu SP, Awua-Boateng NY, Amuasi JH, Okyere PB, Agyarko-Poku T. Bacterial etiology of sexually transmitted infections at a STI clinic in Ghana; use of multiplex real time PCR. Ghana Med J. 2016;50(3):142–148. [PMC free article] [PubMed] [Google Scholar]
- 5.Chirenje ZM, Dhibi N, Handsfield HH, Gonese E, Tippett Barr B, Gwanzura L, Latif AS, Maseko DV, Kularatne RS, Tshimanga M, Kilmarx PH, Machiha A, Mugurungi O, Rietmeijer CA. The Etiology of Vaginal Discharge Syndrome in Zimbabwe: Results from the Zimbabwe STI Etiology Study. Sex Transm Dis. 2018;45(6):422–428. doi: 10.1097/OLQ.0000000000000771. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Holmes KKSP, Stamm WE, Piot P, Wasserheit JN, Corey L, et al. Sexually transmitted diseases. 4. New York: McGraw-Hill Medical; 2008. [Google Scholar]
- 7.Morikawa E, Mudau M, Olivier D, de Vos L, Joseph Davey D, Price C, McIntyre JA, Peters RP, Klausner JD, Medina-Marino A. Acceptability and Feasibility of Integrating Point-of-Care Diagnostic Testing of Sexually Transmitted Infections into a South African Antenatal Care Program for HIV-Infected Pregnant Women. Infect Dis Obstet Gynecol. 2018;2018:3946862. doi: 10.1155/2018/3946862. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Garrett NJ, Osman F, Maharaj B, Naicker N, Gibbs A, Norman E, Samsunder N, Ngobese H, Mitchev N, Singh R, Abdool Karim SS, Kharsany ABM, Mlisana K, Rompalo A, Mindel A. Beyond syndromic management: Opportunities for diagnosis-based treatment of sexually transmitted infections in low- and middle-income countries. PLoS One. 2018;13(4):e0196209. doi: 10.1371/journal.pone.0196209. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Francis SC, Ao TT, Vanobberghen FM, Chilongani J, Hashim R, Andreasen A, Watson-Jones D, Changalucha J, Kapiga S, Hayes RJ. Epidemiology of curable sexually transmitted infections among women at increased risk for HIV in northwestern Tanzania: inadequacy of syndromic management. PLoS One. 2014;9(7):e101221. doi: 10.1371/journal.pone.0101221. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Guimaraes H, Castro R, Tavora Tavira L. da LEF. Assessing therapeutic management of vaginal and urethral symptoms in an anonymous HIV testing Centre in Luanda, Angola. J Infect Dev Ctries. 2013;7(10):720–725. doi: 10.3855/jidc.2752. [DOI] [PubMed] [Google Scholar]
- 11.Marx G, John-Stewart G, Bosire R, Wamalwa D, Otieno P, Farquhar C. Diagnosis of sexually transmitted infections and bacterial vaginosis among HIV-1-infected pregnant women in Nairobi. Int J STD AIDS. 2010;21(8):549–552. doi: 10.1258/ijsa.2010.010005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Black V, Magooa P, Radebe F, Myers M, Pillay C, Lewis DA. The detection of urethritis pathogens among patients with the male urethritis syndrome, genital ulcer syndrome and HIV voluntary counselling and testing clients: should South Africa's syndromic management approach be revised? Sex Transm Infect. 2008;84(4):254–258. doi: 10.1136/sti.2007.028464. [DOI] [PubMed] [Google Scholar]
- 13.Frohlich JA, Abdool Karim Q, Mashego MM, Sturm AW, Abdool Karim SS. Opportunities for treating sexually transmitted infections and reducing HIV risk in rural South Africa. J Adv Nurs. 2007;60(4):377–383. doi: 10.1111/j.1365-2648.2007.04405.x. [DOI] [PubMed] [Google Scholar]
- 14.Tann CJ, Mpairwe H, Morison L, Nassimu K, Hughes P, Omara M, Mabey D, Muwanga M, Grosskurth H, Elliott AM. Lack of effectiveness of syndromic management in targeting vaginal infections in pregnancy in Entebbe, Uganda. Sex Transm Infect. 2006;82(4):285–289. doi: 10.1136/sti.2005.014845. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.CDC . CDC Fact Sheet: 10 Ways STDs Impact Women Differently from Men. 2011. [Google Scholar]
- 16.Ministry of Health, Rwanda. Ro . National guidelines for and management of viral hepatitis B, C and sexually transmitted infections. 2019. [Google Scholar]
- 17.WHO . Sexually transmitted infections: implementing the Global STI Strategy. 2017. [Google Scholar]
- 18.Allen S, Serufilira A, Bogaerts J, Van de Perre P, Nsengumuremyi F, Lindan C, Carael M, Wolf W, Coates T, Hulley S. Confidential HIV testing and condom promotion in Africa. Impact on HIV and gonorrhea rates. JAMA. 1992;268(23):3338–3343. doi: 10.1001/jama.1992.03490230068030. [DOI] [PubMed] [Google Scholar]
- 19.Ingabire R, Parker R, Nyombayire J, Ko JE, Mukamuyango J, Bizimana J, Price MA, Laufer D, Tichacek A, Wall K, Allen S, Karita E. Female sex workers in Kigali, Rwanda: a key population at risk of HIV, sexually transmitted infections, and unplanned pregnancy. Int J STD AIDS. 2019;30(6):557–568. doi: 10.1177/0956462418817050. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Karita E, Nsanzimana S, Ndagije F, Wall KM, Mukamuyango J, Mugwaneza P, Remera E, Raghunathan PL, Bayingana R, Kayitenkore K, Bekan-Homawoo B, Tichacek A, Allen S. Implementation and Operational Research: Evolution of Couples' Voluntary Counseling and Testing for HIV in Rwanda: From Research to Public Health Practice. J Acquir Immune Defic Syndr (1999) 2016;73(3):e51–ee8. doi: 10.1097/qai.0000000000001138. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Twahirwa Rwema JO, Lyons CE, Herbst S, Liestman B, Nyombayire J, Ketende S, Mazzei A, Olawore O, Nsanzimana S, Mugwaneza P, Kagaba A, Sullivan PS, Allen S, Karita E, Baral SD. HIV infection and engagement in HIV care cascade among men who have sex with men and transgender women in Kigali, Rwanda: a cross-sectional study. J Int AIDS Soc. 2020;23(Suppl 6):e25604. doi: 10.1002/jia2.25604. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Ndowa FJ, Francis JM, Machiha A, Faye-Kette H, Fonkoua MC. Gonococcal antimicrobial resistance: perspectives from the African region. Sex Transm Infect. 2013;89(Suppl 4):iv11–iv15. doi: 10.1136/sextrans-2012-050907. [DOI] [PubMed] [Google Scholar]
- 23.Van Dyck E, Karita E, Abdellati S, Dirk VH, Ngabonziza M, Lafort Y, Laga M. Antimicrobial susceptibilities of Neisseria gonorrhoeae in Kigali, Rwanda, and trends of resistance between 1986 and 2000. Sex Transm Dis. 2001;28(9):539–545. doi: 10.1097/00007435-200109000-00012. [DOI] [PubMed] [Google Scholar]
- 24.Jung Y, Hu J. A K-fold averaging cross-validation procedure. J Nonparametr Stat. 2015;27(2):167–179. doi: 10.1080/10485252.2015.1010532. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, Pencina MJ, Kattan MW. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology. 2010;21(1):128–138. doi: 10.1097/EDE.0b013e3181c30fb2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Verwijs MC, Agaba SK, Sumanyi J-C, Umulisa MM, Mwambarangwe L, Musengamana V, Uwineza M, Cuylaerts V, Crucitti T, Jespers V, van de Wijgert JHHM. Targeted point-of-care testing compared with syndromic management of urogenital infections in women (WISH): a cross-sectional screening and diagnostic accuracy study. Lancet Infect Dis. 2019;19(6):658–669. doi: 10.1016/S1473-3099(18)30724-2. [DOI] [PubMed] [Google Scholar]
- 27.Behets FM, Brathwaite AR, Hylton-Kong T, Chen CY, Hoffman I, Weiss JB, Morse SA, Dallabetta G, Cohen MS, Figueroa JP. Genital ulcers: etiology, clinical diagnosis, and associated human immunodeficiency virus infection in Kingston. Jamaica Clin Infect Dis. 1999;28(5):1086–1090. doi: 10.1086/514751. [DOI] [PubMed] [Google Scholar]
- 28.Centers for Disease C, Prevention Recommendations for the laboratory-based detection of Chlamydia trachomatis and Neisseria gonorrhoeae--2014. MMWR Recomm Rep. 2014;63(RR-02):1–19. [PMC free article] [PubMed] [Google Scholar]
- 29.CDC . Gonococcal Infections. 2015. [Google Scholar]
- 30.Wynn A, Moucheraud C, Moshashane N, Offorjebe OA, Ramogola-Masire D, Klausner JD, Morroni C. Using partner notification to address curable sexually transmitted infections in a high HIV prevalence context: a qualitative study about partner notification in Botswana. BMC Public Health. 2019;19(Suppl 1):606. doi: 10.1186/s12889-019-6813-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Pellowski J, Mathews C, Kalichman MO, Dewing S, Lurie MN, Kalichman SC. Advancing Partner Notification Through Electronic Communication Technology: A Review of Acceptability and Utilization Research. J Health Commun. 2016;21(6):629–637. doi: 10.1080/10810730.2015.1128020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Mathews C, Coetzee N. Partner notification. BMJ Clin Evid. 2009;2009 Epub 2009/01/01. PubMed PMID: 21733200; PMCID: PMC2907794. [PMC free article] [PubMed]
- 33.Johnson LF, Dorrington RE, Bradshaw D, Coetzee DJ. The effect of syndromic management interventions on the prevalence of sexually transmitted infections in South Africa. Sex Reprod Healthc. 2011;2(1):13–20. doi: 10.1016/j.srhc.2010.08.006. [DOI] [PubMed] [Google Scholar]
- 34.Garrett N, Mitchev N, Osman F, Naidoo J, Dorward J, Singh R, Ngobese H, Rompalo A, Mlisana K, Mindel A. Diagnostic accuracy of the Xpert CT/NG and OSOM Trichomonas Rapid assays for point-of-care STI testing among young women in South Africa: a cross-sectional study. BMJ Open. 2019;9(2):e026888. doi: 10.1136/bmjopen-2018-026888. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Additional file 1: Table S1. Baseline characteristics and associations with CT or NG infection in symptomatic women, Kigali (N = 305): external validation cohort.
Data Availability Statement
The datasets analysed during the current study are available from the corresponding author on reasonable request.


