To the Editor: In their article, Oza et al. proposed a score to risk-stratify Ebola virus disease (EVD) suspected cases while patients in an Ebola treatment center await laboratory confirmation (1). The Ebola symptom-based risk (ESR) score, consisting of 6 symptoms (conjunctivitis, diarrhea, nausea/vomiting, headache, difficulty breathing, loss of appetite), performed well in internal validation, but no external validation was done.
We evaluated the proposed ESR score on 805 EVD-positive and 1,506 EVD-negative case-patients in the Conakry Ebola Treatment Center (ETC), Conakry, Guinea (2). The ESR score yielded an area under the curve of 0.58 (95% CI 0.56–0.61), which is lower than the 0.83 (95% CI 0.79–0.86) Oza et al. reported (Technical Appendix Figure). Using the proposed risk thresholds (i.e., low risk if score <0, medium risk if score = 0, and high risk if score >0), 371 (46%) EVD-positive patients of the Conakry ETC were classified as high risk and 647 (43%) EVD-negative patients as low risk. However, negative and positive predictive values were generally low (Technical Appendix Table). Reasons for poor validation could include differences in applying the general EVD suspect case definition (integration of patients’ contact history); in patient characteristics because organization and access to care for EVD and non-EVD illness was different (patients in holding centers or ETC); in the quality of data collection (symptoms are entirely self-reported); and in underlying diseases of EVD-negative patients.
Our findings underline the importance of external validation in various settings before risk scores are applied outside of the setting within which they were developed, as well as the need to incorporate patient contact history into predictive models. Point-of-care EVD diagnostic platforms can perform reliable confirmatory testing within 90 minutes (3). We argue that, by integrating rapid confirmatory testing in triage, providers can avoid classifying patients by their likelihood of infection with Ebola virus while waiting for laboratory confirmation.
Dr. Ingelbeen, a pharmacist and epidemiologist, worked during the 2014–2016 Ebola outbreak with Médecins sans Frontières in Guinea. He is a European Programme for Intervention Epidemiology Training (EPIET) fellow at Santé publique France. His research interests include emerging and vectorborne infectious diseases.
Additional information about validation testing for Ebola symptom-based risk scores, Guinea.
About the Author
Footnotes
Suggested citation for this article: Ingelbeen B, De Weggheleire A, Van Herp M, van Griensven J. Symptom-based Ebola risk score for Ebola virus disease, Conakry, Guinea. Emerg Infect Dis. 2018 Jun [date cited]. https://doi.org/10.3201/eid2406.171812
References
- 1.Oza S, Sesay AA, Russell NJ, Wing K, Boufkhed S, Vandi L, et al. Symptom- and laboratory-based Ebola risk scores to differentiate likely Ebola infections. Emerg Infect Dis. 2017;23:1792–9. 10.3201/eid2311.170171 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Ingelbeen B, Bah EI, Decroo T, Balde I, Nordenstedt H, van Griensven J, et al. Mortality among PCR negative admitted Ebola suspects during the 2014/15 outbreak in Conakry, Guinea: A retrospective cohort study. PLoS One. 2017;12:e0180070 http://dx.plos.org/10.1371/journal.pone.0180070. 10.1371/journal.pone.0180070 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Van den Bergh R, Chaillet P, Sow MS, Amand M, van Vyve C, Jonckheere S, et al. Feasibility of Xpert Ebola Assay in Médecins Sans Frontières Ebola Program, Guinea. Emerg Infect Dis. 2016;22:210–6. 10.3201/eid2202.151238 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Additional information about validation testing for Ebola symptom-based risk scores, Guinea.