Skip to main content
Wellcome Open Research logoLink to Wellcome Open Research
. 2022 May 12;5:72. Originally published 2020 Apr 17. [Version 2] doi: 10.12688/wellcomeopenres.15824.2

A multi-parameter diagnostic clinical decision tree for the rapid diagnosis of tuberculosis in HIV-positive patients presenting to an emergency centre

Daniël Jacobus van Hoving 1,2,a, Graeme Meintjes 3,4, Gary Maartens 5,#, Andre Pascal Kengne 4,6,#
PMCID: PMC9608260  PMID: 36325129

Version Changes

Revised. Amendments from Version 1

We have explained our choice of the LF-LAM test used in the methods section: ‘The Alere Determine™ TB LAM Ag test was used since it was the only commercially available test at the time.’ We have clarified the difference between ‘Individual PoCUS features’ and ‘Independent PoCUS features’ in the statistical analysis section: ‘Individual PoCUS features were determined by univariable analysis using a 10% significance level 22 . In PoCUS features where different thresholds for positivity exists (e.g., size of intra-abdominal lymphnodes), the lowest threshold was included. Individual PoCUS features included any sized pericardial effusion, pleural effusion, ascites, any focal splenic lesion, and any sized intra-abdominal lymphadenopathy 22 . Independent PoCUS features were determined by multivariable logistical regression 22 . The PoCUS features independently associated with tuberculosis were pericardial effusion of any size, ascites, and intra-abdominal lymphadenopathy of any size 22 .’ We have added a footnote to Table 3 linking the 63 patients with a clinical diagnosis of tuberculosis to Table 4 which provide Reasons for the diagnosis of tuberculosis without microbiological confirmation. We have added the estimated sensitivity and specificity of the FujiLAM test in the discussion: ‘Another urine-based LAM assay, Fujifilm SILVAMP TB LAM (FujiLAM; Fujifilm, Tokyo, Japan), has higher sensitivity (70.4% versus 28.1%) but somewhat lower specificity (90.8% versus 95.0%) than the LF-LAM assay we used 33 .’ We included in the discussion that the number need to scan is likely to increase when used in areas with a lower tuberculosis prevalence (and vice versa). We have added to the limitations that: ‘The individual and independent PoCUS features were based on a single study and needs further evaluation.’ We have added to the conclusion that the role of PoCUS as a rule-in test to diagnose HIV-associated tuberculosis in the emergency centre needs to be further investigated.

Abstract

Background: Early diagnosis is essential to reduce the morbidity and mortality of HIV-associated tuberculosis. We developed a multi-parameter clinical decision tree to facilitate rapid diagnosis of tuberculosis using point-of-care diagnostic tests in HIV-positive patients presenting to an emergency centre.

Methods: A cross-sectional study was performed in a district hospital emergency centre in a high-HIV-prevalence community in South Africa. Consecutive HIV-positive adults with ≥1 WHO tuberculosis symptoms were enrolled over a 16-month period. Point-of-care ultrasound (PoCUS) and urine lateral flow lipoarabinomannan (LF-LAM) assay were done according to standardized protocols. Participants also received a chest X-ray. Reference standard was the detection of Mycobacterium tuberculosis using Xpert MTB/RIF or culture. Logistic regressions models were used to investigate the independent association between prevalent microbiologically confirmed tuberculosis and clinical and biological variables of interest. A decision tree model to predict tuberculosis was developed using the classification and regression tree algorithm.

Results: There were 414 participants enrolled: 171 male, median age 36 years, median CD4 cell count 86 cells/mm 3. Tuberculosis prevalence was 42% (n=172). Significant variables used to build the classification tree included ≥2 WHO symptoms, antiretroviral therapy use, LF-LAM, PoCUS independent features (pericardial effusion, ascites, intra-abdominal lymphadenopathy) and chest X-ray. LF-LAM was positioned after WHO symptoms (75% true positive rate, representing 17% of study population). Chest X-ray should be performed next if LF-LAM is negative. The presence of ≤1 PoCUS independent feature in those with ‘possible or unlikely tuberculosis’ on chest x-ray represented 47% of non-tuberculosis participants (true negative rate 83%). In a prediction tree which only included true point-of-care tests, a negative LF-LAM and the presence of ≤2 independent PoCUS features had a 71% true negative rate (representing 53% of sample).

Conclusions: LF-LAM should be performed in all adults with suspected HIV-associated tuberculosis (regardless of CD4 cell count) presenting to the emergency centre.

Keywords: HIV, tuberculosis, algorithm, emergency, lipoarabinomannan, point-of-care, ultrasound, X-ray

Introduction

Tuberculosis remains an important cause of morbidity and mortality globally, despite ongoing control efforts 1 . The early diagnosis and successful treatment of people with tuberculosis should reduce the risk of mortality and morbidity, and decrease the transmission of tuberculosis 2 . Factors associated with delays in the diagnosis of tuberculosis include the limitations of tuberculosis diagnostic tests, limited availability of these tests in high burden settings, and the reduced diagnostic performance of tuberculosis tests in people living with HIV (PLWH) 35 . In PLWH with advanced immunosuppression, the diagnosis of active tuberculosis is challenging due to more atypical clinical presentations; other opportunistic infections with similar presentations; high proportion with inability to produce sputum or negative sputum smears; and high rates of extra-pulmonary and disseminated tuberculosis 611 . Autopsy studies in HIV-positive adults report a very high proportion with tuberculosis (32% to 47%), almost half (46%) of which was undiagnosed pre-mortem 12 .

The WHO recommends that HIV-positive patients should be systematically screened for active tuberculosis when visiting a healthcare facility 2 . Many patients access the healthcare system through hospital emergency centres. The prevalence of HIV-related admissions to emergency centres varies, with up to 43% documented in Uganda 13 . These patients are often severely ill and would benefit from prompt diagnosis and treatment of tuberculosis to decrease mortality 14 .

The use of point-of-care diagnostic tests would facilitate rapid diagnosis of tuberculosis. Lateral flow lipoarabinomannan (LF-LAM) is currently the only true point-of-care test, with other tests (e.g. smear microscopy, Xpert MTB/RIF, Xpert MTB/RIF Ultra, GeneXpert OMNI, and portable digital chest X-ray) being near point-of-care tests 15 . Point-of-care ultrasound (PoCUS) is also a potentially useful test for extra-pulmonary or disseminated tuberculosis 16 . No evidence-based algorithm incorporating clinical information, individual PoCUS features, and urine LF-LAM for diagnosing tuberculosis in HIV-positive patients currently exists. We performed a cross-sectional diagnostic study and developed a multi-parameter clinical decision tree to facilitate rapid diagnosis of tuberculosis in HIV-positive patients presenting to an emergency centre.

Methods

Study setting and participants

Khayelitsha is a township with a mix of formal and informal housing in Cape Town, South Africa. The Khayelitsha Health sub-district has an antenatal HIV prevalence of 34% 17 , and an annual tuberculosis notification rate of 917 per 100,000 persons 18 . The emergency centre of Khayelitsha Hospital (a district-level hospital) manages ± 35,000 patients per annum with an admission rate around 30%. The HIV prevalence of patients managed in the resuscitation unit is 23% 19 .

Inclusion criteria were adults (≥18 years); HIV-positive (HIV-status was determined by laboratory confirmation or from the clinical records), and presence of at least one symptom of the WHO's recommended four-symptom screening rule for tuberculosis in PLWH (cough of any duration, fever, drenching night sweats, or weight loss) 20 . Exclusion criteria were: presenting to the emergency centre more than 24 hours before screening; received anti-tuberculosis treatment within 3 months of screening; pregnant; main clinical presentation of meningitis syndrome or new focal neurology; trauma, gynaecological or psychiatric presentation. Data from this cohort relating to LF-LAM and PoCUS were previously published 21, 22 . These manuscripts described the use of LF-LAM in an acute care setting and identified PoCUS features independently associated with HIV-associated tuberculosis 21, 22 .

All participants provided written informed consent using a two-phase consent process. Severely ill participants were provided with a short one-page consent form indicating what extra tests would be done and that these would be used to facilitate diagnosis of tuberculosis and for research purposes. Full consent was obtained once patients had recovered and agreed to participate. The study was approved by the Human Research Ethics Committee of the University of Cape Town (HREC REF: 697/2015).

Procedures and samples

Consecutive patients evaluated at the emergency centre were screened for eligibility from June 2016 through October 2017. A standardized data collection form was used to record demographic and clinical information. Urine, sputum and blood samples were obtained from all patients whenever possible (see Extended data) 23 . Fresh urine samples were tested using the Xpert MTB/RIF assay (GX4) (Cepheid Inc., Sunnyvale, CA, USA) and for the presence of LAM (Alere Determine™ TB LAM Ag test, Alere Inc., Waltham, MA, USA); LF-LAM was performed in the emergency centre 21 . The Alere Determine™ TB LAM Ag test was used since it was the only commercially available test at the time. Sputum specimens were tested using the Xpert MTB/RIF assay (GX4) and cultured in mycobacterial growth indicator tubes (MGIT; Becton Dickson, Sparks, MD, USA). Mycobacterial blood cultures were performed using the BACTEC MYCO/F Lytic blood culture bottle (Becton Dickson, Sparks, MD, USA). The MTBDR plus assay (Hain Lifescience, Nehren, Germany) were used to identify culture isolates as M. tuberculosis complex. Complete blood count and CD4 cell count were done as part of routine clinical care. CD4 cell count results were accepted if performed within 3 months of enrolment. The National Health Laboratory Service performed all the tests.

Ultrasound examination was performed in the emergency centre and the findings documented on a standardized assessment form. A single, emergency physician (with adequate training and credentials as specified by the International Federation of Emergency Medicine’s Emergency Ultrasound Special Interest Group 24 ) performed the ultrasound examination using either a Mindray M5™ ultrasound system with a 3C5s (2.5–6.5 MHz) convex probe and a 7L4s (5.0–10 MHz) linear probe (Mindray DS USA, Inc., Mahwah, NJ, USA) or a NanoMaxx™ ultrasound system with a L38n (10–5 MHz) linear array probe and a C60n (5–2 MHz) curved array probe (SonoSite Inc., Bothell, WA, USA). Ultrasound examinations were performed before any specimens were collected. At the time of the ultrasound, the point-of-care sonographer had access to the clinical information but not to results from the reference standard (detection of M. tuberculosis from Xpert MTB/RIF and/or culture on any specimen obtained from any anatomical site).

Chest x-rays were reviewed by a single radiologist using a standardized assessment form (see Extended data 23 . Chest x-rays were classified as unlikely tuberculosis, probable tuberculosis, and likely tuberculosis. The radiologist had no access to clinical information or the reference standard.

Statistical analyses

The sample size was determined with the aim of including more than the recommended 10 candidate predictors (including interaction terms) from multivariable logistic regression analyses 25 . The tuberculosis prevalence in HIV-positive patients in the emergency centre is around 25% 19 , and a sample size of 400 HIV-positive participants was deemed adequate to include 100 tuberculosis cases. Data were analysed with the use of SAS/STAT ® software (Version 9.4 of the SAS System for Windows [Copyright © 2019 SAS Institute Inc. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc., Cary, NC, USA]), R statistical software version 3.4.3 (2017-11-30) [The R® Foundation for Statistical Computing Platform], and SPSS Statistics for Windows, Version 25.0 (IBM Corp. Released 2017. Armonk, NY: IBM Corp.). Group comparisons used χ2 test and variants for qualitative variables and Student’s t-test or non-parametric equivalents for continuous variables. Results are presented as count (percentages), mean and standard deviation (SD) or median and 25th-75th percentiles as appropriate.

Logistic regressions models were used to investigate the independent association between prevalent microbiologically confirmed tuberculosis and clinical and biological variables of interest. Candidate variables included WHO symptom screen (presence of cough, ≥1 present, ≥2 present, ≥3 present), antiretroviral therapy status (currently on antiretroviral medicine), presence and number of WHO danger signs (≥1 present, ≥2 present, ≥3 present) 26 , number of individual PoCUS features (≥1 present, ≥2 present, ≥3 present), number of PoCUS features independently associated with tuberculosis (≥1 present, ≥2 present, ≥3 present), urinary LF-LAM, haemoglobin, chest X-ray (possible tuberculosis, likely tuberculosis, possible and likely tuberculosis) and CD4 cell count (<100 cells/mm 3, 100–200 cells/mm 3, >200 cells/mm 3).

Individual PoCUS features were determined by univariable analysis using a 10% significance level 22 . In PoCUS features where different thresholds for positivity exists (e.g., size of intra-abdominal lymphnodes), the lowest threshold was included. Individual PoCUS features included any sized pericardial effusion, pleural effusion, ascites, any focal splenic lesion, and any sized intra-abdominal lymphadenopathy 22 . Independent PoCUS features were determined by multivariable logistical regression 22 . The PoCUS features independently associated with tuberculosis were pericardial effusion of any size, ascites, and intra-abdominal lymphadenopathy of any size 22 .

For correlated variables, when more than one index was significant in a univariate model, the one with more significant effect on the -2log L^ statistic was first entered into the multivariable model. However, in the final model, the effect of substituting variables was also assessed. When more than one correlated variable was significant in multivariable models, the final model selected was the one associated with the smallest Akaike’s information criterion (AIC), a statistic derived from the -2log L^ statistic. Multivariable model building was based on the combination of significant variables in univariable models (based on a threshold p<0.10). A model comprising WHO screening symptoms and history of current antiretroviral therapy use was used as starting model 20 . The ability of logistic regression models to discriminate between participants who had and those who did not have microbiologically confirmed tuberculosis was assessed using area under the receiver operating characteristic curves (AUC) and the relative integrated discrimination improvement (RIDI) which measures the percentage increase in discrimination when an extra variable is added to a prediction model 27, 28 . AUC comparisons used nonparametric methods 29 . Bootstrap techniques were used to derive the 95% confidence interval (CI) for the RIDI estimates, which were based on 1000 replications.

We developed a decision tree model to predict microbiologically confirmed tuberculosis, including variables from the best performing multivariable logistic regression model, using the classification and regression tree (CART) algorithm and rpart package (version 4.1-11) of the R statistical software. The CART algorithm builds a tree model through recursive partitioning, through which process the data is successfully split into increasingly homogenous subgroups. At each stage (also known as node), the algorithm selects a predictor and a cut-point associated with the best ability of the predictor to discriminate participants with tuberculosis from those without. This was less an issue in the current analyses with no continuous predictor. However, for class variables with more than two levels, the algorithm could collapse levels in order to achieve the best discrimination. The CART starts with one predictor, then adds other predictors (and nodes) until reaching homogenous groups or having subgroups with few participants (<5), or exhaustion of predictors which can contribute further to subgroups refinement. Due to the small size of the achieved tree, no pre- or post-pruning was applied. CART uses a generalization of the binomial variance (Gini index) for its impurity function, and employs a 10-fold cross-validation to estimate error rates. The algorithm code is available as Extended data 30 .

Results

Study population

We screened 556 patients; 414 (74.5%) of whom were enrolled ( Figure 1). The prevalence of microbiologically confirmed tuberculosis was 41.5% (n=172): both Xpert MTB/RIF and culture positive n=93, 54.1%; only Xpert MTB/RIF positive n=32, 18.6%; only culture positive n=47, 27.3%. A median of 3 samples (25 th–75 th percentile, 2–4) were obtained from participants for culture and/or Xpert MTB/RIF ( Table 1). At least two samples were obtained from two or more different anatomic sites in 350 (84.5%) participants.

Figure 1. Flow diagram of study participants.

Figure 1.

Table 1. Total clinical samples sent for mycobacterial testing (includes ‘research’ and ‘routine’ samples).

Sample Sample Samples obtained within 24 hours Total samples obtained during admission
No. (%)
patients
producing
≥ 1 sample
Total no.
samples
Total no.
Xpert
tests done
Total no.
cultures
done
No.
positive
culture
and Xpert
tests (%)
No. (%) TB
patients with ≥1
positive culture
or Xpert test
No. (%)
patients
producing ≥
1 sample
Total no.
samples
Total no.
Xpert
tests
done
Total no.
cultures
done
No.
positive
culture
and Xpert
tests (%)
No. (%) TB
patients with
≥1 positive
culture or
Xpert test
Urine 266 (69.5) 278 277 1 57 (20.5) 55 (37.2) 312 (75.4) 328 322 6 64 (19.5) 62 (36.0)
Sputum * 227 (59.3) 349 289 232 202 (38.8) 88 (59.5) 291 (70.3) 581 466 441 291 (32.2) 112 (65.1)
Blood 312 (81.5) 343 0 343 66 (19.2) 61 (41.2) 345 (83.3) 404 0 404 72 (17.8) 64 (37.2)
Fine needle
aspirate (FNA)
4 (1.0) 4 2 4 5 (83.3) 3 (2.0) 10 (2.4) 12 5 6 9 (81.8) 5 (2.9)
Cerebrospinal
fluid (CSF)
13 (3.4) 13 12 4 0 (0.0) 0 (0.0) 31 (7.5) 32 27 13 0 (0.0) 0 (0.0)
Pleural fluid 15 (3.9) 16 3 14 8 (47.1) 8 (5.4) 24 (5.8) 27 4 26 13 (44.8) 12 7.0)
Pericardial
fluid
0 (0) 0 0 0 0 (0.0) 0 (0.0) 2 (0.5) 2 0 2 2 (100) 2 (1.2)
Ascitic fluid 1 (0.3) 1 0 1 1 (100) 1 (0.7) 2 (0.5) 2 0 2 1 (50.0) 1 (0.6)
Other (swab,
tracheal
aspirate)
1 (0.3) 1 1 1 0 (0.0) 0 (0.0) 2 (0.5) 2 1 2 0 (0.0) 0 (0.0)
383 (92.5) 1005 584 600 339 (28.6) 148 (86.0) 414 (100) 1390 825 902 452 (26.2) 172 (100)

TB = Tuberculosis

*Culture and Xpert MTB/RIF done on sputum taken on the same day were counted as two samples

Demographic and clinical characteristics of participants with and without confirmed tuberculosis are presented in Table 2. The median CD4 cell count was 86 cells/mm 3 (25 th–75 th percentile, 30–218). The alternative diagnoses and the reasons for a clinical tuberculosis diagnosis in participants without microbiologically confirmed tuberculosis are presented in Table 3 and Table 4. The all-cause in-hospital mortality was 7.2% (n=30), 15 of whom had confirmed tuberculosis (representing 8.7% in hospital). These individual-level data are available at Zenodo 31 .

Table 2. Demographic and clinical characteristics of study population.

Characteristics at enrolment
(n (%) unless otherwise specified)
All
(N=414)
M. tuberculosis
confirmed
(N = 172)
M. tuberculosis
not confirmed
(N = 242)
p-value
Age (years) (Median (Q 1-Q 3)) 36 (30 – 43) 35 (30 – 42) 36 (31 – 44) 0.12
Gender: Male 171 (41.3) 71 (41.3) 100 (41.3) 0.99
Current cough of any duration 352 (85.0) 148 (86.0) 204 (84.3) 0.62
WHO symptom screen ≥ 1 present 414 (100) 172 (100) 242 (100) ---
WHO symptom screen ≥ 2 present 347 (83.8) 152 (88.4) 195 (80.6) 0.03
WHO symptom screen ≥ 3 present 239 (57.7) 104 (60.5) 135 (55.8) 0.34
Currently on antiretroviral therapy 195 (47.1) 62 (36.0) 133 (55.0) <0.01
WHO danger signs ≥ 1 present 320 (77.3) 138 (80.2) 182 (75.2) 0.22
WHO danger signs ≥ 2 present 170 (41.1) 74 (43.0) 96 (39.7) 0.49
WHO danger signs ≥ 3 present 61 (14.7) 24 (14.0) 37 (15.3) 0.71
PoCUS individual features ≥ 1 present 264 (63.8) 133 (77.3) 131 (54.1) <0.01
PoCUS individual features ≥ 2 present 140 (33.8) 86 (50.0) 54 (22.3) <0.01
PoCUS individual features ≥ 3 present 64 (15.5) 47 (27.3) 17 (7.0) <0.01
PoCUS independent features ≥ 1 present 217 (52.4) 116 (67.4) 101 (41.7) <0.01
PoCUS independent features ≥ 2 present 80 (19.3) 58 (33.7) 22 (9.1) <0.01
PoCUS independent features ≥ 3 present 17 (4.1) 17 (9.9) 0 (0.0) <0.01
Urine lateral flow lipoarabinomannan (LF-LAM)
positive *
94 (22.9) 71 (41.8) 23 (9.5) <0.01
Hemoglobin (g/dl) (Mean ± SD) # 9.7 ± 2.7 9.0 ± 2.4 10.2 ± 2.7 <0.01
CD4 cell count < 100 cells/mm 3 219 (53.7) 108 (63.9) 111 (46.4) <0.01
CD4 cell count 100 to 200 cells/mm 3 77 (18.6) 32 (18.6) 45 (18.6) 1.0
CD4 cell count > 200 cells/mm 3 117 (28.3) 32 (18.6) 85 (35.1) <0.01
Chest x-ray: Possible tuberculosis 109 (26.3) 39 (22.7) 70 (28.9) 0.16
Chest x-ray: Likely tuberculosis 150 (36.2) 98 (57.0) 52 (21.5) <0.01

SD = Standard Deviation; Q1-Q3 = 25th – 75th percentile; WHO symptom screen = Cough of any duration, fever, drenching night sweats, weight loss; WHO danger signs = Respiratory rate > 30/min, Heart rate > 120/min, Temperature > 39°C, being unable to walk unaided; PoCUS = Point-of-Care Ultrasound; PoCUS individual features = Pericardial effusion (any size), pleural effusion, ascites, any splenic lesion, intra-abdominal lymphadenopathy (any size); PoCUS independent features = Pericardial effusion (any size), ascites, intra-abdominal lymphadenopathy (any size); * N=411; # N=410; N=408; Comparison between M. tuberculosis confirmed and M. tuberculosis not confirmed

Table 3. Distribution of alternative diagnoses in participants without microbiologically confirmed tuberculosis.

Alternative diagnoses n (%)
Lower Respiratory Tract Infection / Pneumonia 96 (39.7)
Clinical diagnoses of tuberculosis * 63 (26.0)
Gastro-enteritis (acute & chronic) 13 (5.4)
Pneumocystis pneumonia 11 (4.5)
Renal failure (acute & chronic) 8 (3.3)
Bronchiectasis 6 (2.5)
Dysentery 3 (1.2)
HIV wasting syndrome 3 (1.2)
Undifferentiated abdominal pain 3 (1.2)
Appendicitis 2 (0.8)
Congestive cardiac failure 2 (0.8)
Delirium 2 (0.8)
Empyema 2 (0.8)
Gallstones 2 (0.8)
Kaposi sarcoma 2 (0.8)
Urosepsis 2 (0.8)
Bronchitis 1 (0.4)
Chronic Lymphocytic Leukaemia 1 (0.4)
Colon carcinoma 1 (0.4)
Constipation 1 (0.4)
Chronic Obstructive Pulmonary Disease
(COPD) exacerbation
1 (0.4)
Cor Pulmonale 1 (0.4)
Duodenitis 1 (0.4)
E. coli bacteraemia 1 (0.4)
Interstitial lung disease 1 (0.4)
Liver carcinoma 1 (0.4)
Lung abscess 1 (0.4)
Meningitis 1 (0.4)
Non-tuberculous mycobacterial infection
(disseminated)
1 (0.4)
Pelvic inflammatory disease 1 (0.4)
Progressive multifocal leukoencephalopathy 1 (0.4)
Scleroderma 1 (0.4)
Thrombotic thrombocytopenic purpura 1 (0.4)
Vitamin B12 deficiency 1 (0.4)
Unknown diagnosis 4 (1.7)
242 (100)

HIV = Human Immunodeficiency Virus; *See Table 4 for reasons for the clinical diagnoses of tuberculosis

Table 4. Reason for diagnosis of tuberculosis without microbiological confirmation.

Diagnostic test n
Suggestive formal abdominal ultrasound done in radiology
department
19
Suggestive chest X-ray 9
Positive urine lateral flow lipoarabinomannan (LF-LAM) 7
Suggestive formal abdominal ultrasound and suggestive
chest X-ray
6
Not improving on empiric antibiotics 4
Raised adenosine deaminase (ADA) in effusion fluid (pleural
or ascitic)
4
Cerebrospinal fluid suggestive of tuberculous meningitis
(TBM)
4
Suggestive chest X-ray and positive urine LF-LAM 3
Suggestive formal abdominal ultrasound and positive urine
LF-LAM
2
Psoas abscess on formal ultrasound 2
Caseous necrosis on biopsy (histology) 1
Suggestive computer tomography (CT) scan of abdomen 1
Suggestive chest X-ray and raised ADA in effusion fluid 1
Total 63

Univariable associations

Univariable associations between microbiologically confirmed tuberculosis and clinical variables are presented as odds ratio (OR) with 95% CI and summarized in Table 5. The presence of two or more WHO screening symptoms (1.83 (1.04–3.22)), one or more PoCUS individual features (2.89 (1.87-4.47)), one or more PoCUS independent features (2.89 (1.92-4.35)), urinary LF-LAM (6.70 (3.99-11.25)), current antiretroviral therapy use (0.46 (0.31-0.68)), CD4 cell count less than 100 cells/mm 3 (1.98 (1.32-2.95)), and chest x-ray reported as ‘likely tuberculosis’ (4.81 (3.13-7.40)) were significantly associated with confirmed tuberculosis.

Table 5. Univariable associations between microbiologically confirmed tuberculosis and clinical variables.

Variables Subgroups Odds Ratio
(95% CI)
p-value AUC AIC -2 Log L Likelihood ratio
2 (p-value)
Calibration
2 (p-value)
Intercept only 0.0006 564.03 562.03
Presence of cough 1.15 (0.66-2.00) 0.623 0.509 565.79 561.79 0.243 (0.622) NA
WHO symptoms
screen
1 (reference) 1.00 0.128 0.540 562.65 556.65 4.312 (0.116) 0.0 (>0.999)
2 1.84 (0.96-3.52)
3 or more 1.77 (0.99-3.18)
≥ 2 vs. < 2 1.83 (1.04-3.22) 0.036 0.539 561.39 557.39 4.645 (0.031) NA
≥ 3 vs. < 3 1.21 (0.81-1.80) 0.342 0.523 565.13 561.13 0.904 (0.342) NA
WHO danger signs Absent (reference) 1.00 0.511 0.542 566.63 558.63 2.327 (0.507) 0.0 (>0.999)
1 1.31 (0.77-2.23)
2 1.52 (0.86-2.68)
3 or more 1.14 (0.59-2.22)
≥ 1 vs. < 1 1.34 (0.83-2.15) 0.230 0.525 564.57 560.57 1.462 (0.226) NA
≥ 2 vs. < 2 1.15 (0.77-1.71) 0.494 0.517 565.57 561.57 0.467 (0.474) NA
≥ 3 vs. < 3 0.90 (0.52-1.57) 0.706 0.507 565.89 561.89 0.143 (0.705) NA
PoCUS individual
features
Absent (reference) 1.00 <0.0001 0.679 522.43 514.43 46.52 (<0.0001) 0.0 (>0.999)
1 1.74 (1.04-2.91)
2 3.08 (1.72-5.52)
3 or more 7.87 (4.05-15.28)
≥ 1 vs. < 1 2.89 (1.87-4.47) <0.0001 0.616 541.88 537.88 24.149 (<0.0001) NA
≥ 2 vs. < 2 3.48 (2.27-5.33) <0.0001 0.638 531.65 527.65 34.387 (<0.0001) NA
≥ 3 vs. < 3 4.98 (2.74-9.03) <0.0001 0.602 534.32 530.32 31.71 (<0.0001) NA
PoCUS independent
features
Absent (reference) 1.00 <0.0001 0.673 510.29 502.29 58.66 (<0.0001) 0.0 (>0.999)
1 1.87 (1.18-2.96)
2 4.69 (2.57-8.56)
3 or more >999.99 (<0.001-
999.99)
≥ 1 vs. < 1 2.89 (1.92-4.35) <0.0001 0.629 538.98 534.98 27.05 (<0.0001) NA
≥ 2 vs. < 2 5.09 (2.96-8.73) <0.0001 0.623 526.90 522.90 39.13 (<0.0001) NA
≥ 3 vs. < 3 >999.99 (<0.001-
999.99)
0.975 0.549 535.14 531.14 30.89 (<0.0001) NA
Urinary LAM 6.70 (3.99-11.25) <0.0001 0.663 506.21 502.21 59.82 (<0.0001) NA
Hemoglobin (per unit
lower)
0.999
(0.996-1.001)
0.247 0.376 564.51 560.51 1.518 (0.218) 24.78
(0.0017)
Antiretroviral therapy
status
0.46 (0.31-0.68) 0.0001 0.596 550.07 546.07 14.89 (<0.0001) NA
CD4 cell count >200 cells/mm 3
(reference)
1.00 0.0006 0.599 551.39 545.39 15.57 (0.0004) 0.0 (>0.999)
<100 cells/mm 3 2.58 (1.59-4.20)
100-200 cells/mm 3 1.89 (1.03-3.47)
Chest X-ray Unlikely TB g
(reference)
1.00 <0.0001 0.704 506.473 500.47 60.48 (<0.0001) 0.0 (>0.999)
Possible TB 1.94 (1.12-3.34)
Likely TB 6.46 (3.90-10.70)
Possible TB vs
Unlikely & Likely TB
0.73 (0.46-1.15) 0.175 0.530 563.09 559.09 1.86 (0.172)
Likely TB vs.
Unlikely and Likely
TB
4.81 (3.13-7.40) <0.0001 0.677 510.18 506.18 54.78 (<0.0001) NA
Possible & Likely TB
vs. Unlikely TB
3.86 (2.44-6.12) <0.0001 0.641 528.04 524.04 33.16 (<0.0001) NA

CI = Confidence Interval; AUC = Area under the receiver operating characteristics curves; AIC = Akaike information criterion; WHO symptom screen = Cough of any duration, fever, drenching night sweats, weight loss; WHO danger signs = Respiratory rate > 30/min, Heart rate > 120/min, Temperature > 39°C, being unable to walk unaided; PoCUS = Point-of-Care Ultrasound; PoCUS individual features = Pericardial effusion (any size), pleural effusion, ascites, any splenic lesion, intra-abdominal lymphadenopathy (any size); PoCUS independent features = Pericardial effusion (any size), ascites, intra-abdominal lymphadenopathy (any size); LAM = Lateral flow lipoarabinomannan; TB = tuberculosis

Multivariable model

Measures of model performance are summarized in Table 6. The initial model (WHO screening symptoms ≥2, antiretroviral therapy use) had poor discriminatory power in predicting confirmed tuberculosis with an AUC of 0.615. The addition of either PoCUS independent features or PoCUS individual features to the initial model both improved model goodness of fit and its discriminatory power, however the model with PoCUS independent features had a greater AUC and a smaller AIC. The further addition of urinary LF-LAM and chest x-ray improved the model. Adding CD4 cell count did not improve the performance of the model ( Table 6).

Table 6. The performance of multivariable models predicting microbiologically confirmed tuberculosis.

Model Variables in the model AUC (95% CI) AIC -2 Log L Likelihood ratio χ 2 Calibration
χ 2 (p-value)
A WHO symptom screen ≥2, ART use 0.615 (0.564-0.665) 547.80 541.80 18.12 (<0.0001) DF2 1.386 (0.500)
B A + PoCUS independent features 0.703 (0.653-0.753) 503.66 491.66 69.30 (<0.0001) DF5 4.330 (0.741)
C A + PoCUS individual features 0.701 (0.650-0.751) 514.26 502.26 58.70 (<0.0001) DF5 5.391 (0.612)
D A + urinary LAM 0.736 (0.688-0.784) 489.64 481.64 79.32 (<0.0001) DF3 3.981 (0.408)
E D + PoCUS independent features 0.773 (0.727-0.819) 463.38 449.38 111.57 (<0.0001) DF6 5.259 (0.628)
F E + Chest x-ray 0.820 (0.779-0.862) 433.99 415.99 144.966 (<0.0001) DF8 7.429 (0.386)
G F + CD4 cell count 0.821 (0.780-0.863) 435.99 413.99 146.970 (<0.0001) DF10 8.753 (0.363)

p-values for AUC comparisons: 0.0009 (B-A), 0.0001 (C-A), <0.0001 (D-A), <0.0001 (E-A), <0.0001 (F-A), <0.0001 (G-A); 0.868 (C-B), 0.237 (D-B), 0.0003 (E-B), <0.0001 (F-B), <0.0001 (G-B), 0.181 (D-C), 0.0002 (E-C), <0.0001 (F-C), <0.0001 (G-C), 0.0052 (E-D), <0.0001 (F-D), <0.0001 (G-D), 0.002 (F-E), 0.0022 (G-E), 0.8223 (G-F); Overall p<0.0001 for difference across all AUC.

AUC = Area under the receiver operating characteristics curves; CI = Confidence interval; AIC = Akaike information criterion; WHO symptom screen = Cough of any duration, fever, drenching night sweats, weight loss; ART = Antiretroviral therapy; PoCUS = Point-of-Care Ultrasound; PoCUS individual features = Pericardial effusion (any size), pleural effusion, ascites, any splenic lesion, intra-abdominal lymphadenopathy (any size); PoCUS independent features = Pericardial effusion (any size), ascites, intra-abdominal lymphadenopathy (any size); LAM = Lateral flow lipoarabinomannan

Based on RIDI% estimates, adding urinary LF-LAM, PoCUS independent features, and chest x-ray to the initial and subsequent models conferred similar levels of improvement for tuberculosis prediction ( Table 7). Change in RIDI% was meaningless when CD4 cell count was added to the model comprising WHO symptoms screen, antiretroviral therapy use, PoCUS independent features, urinary LF-LAM and chest X-ray (RIDI% 2.6 (2.4-2.7)).

Table 7. Relative integrated discrimination improvement (RIDI, %) statistic comparing different models.

Model Variables in the
model
A B C D E F G
A WHO symptom screen
≥2, ART use
NA 252.6
(242.3-262.8)
224.4
(214.8-233.9)
334.5
(321.0-348.0)
483.0
(464.6-501.5)
653.9
(629.5-678.3)
674.2
(649.0-699.4)
B A + PoCUS
independent features
NA -7.77
(-8.37 to -7.17)
25.3
(23.5-27.1)
65.0
(63.4-66.5)
113.4
(111.1-115.8)
119.0
(116.6-121.4)
C A + PoCUS individual
features
NA 37.1
(35.0-39.3)
80.7
(78.6-82.8)
133.7
(130.8-136.6)
139.8
(136.8-142.8)
D A + urinary LAM NA 34.3
(33.4-35.1)
73.8
(72.3-75.3)
78.4
(76.8-80.0)
E D + PoCUS
independent features
NA 29.4
(28.7-30.1)
32.8
(32.0-33.5)
F E + Chest x-ray NA 2.6 (2.4-2.7)
G F + CD4 cell count NA

WHO symptom screen = Cough of any duration, fever, drenching night sweats, weight loss; ART = Antiretroviral therapy; PoCUS = Point-of-Care Ultrasound; PoCUS individual features = Pericardial effusion (any size), pleural effusion, ascites, any splenic lesion, intra-abdominal lymphadenopathy (any size); PoCUS independent features = Pericardial effusion (any size), ascites, intra-abdominal lymphadenopathy (any size); LAM = Lateral flow lipoarabinomannan.

Prediction tree

Significant variables (Model F in Table 7) were included in the splitting process to build the classification tree for microbiologically confirmed tuberculosis. The CART created for confirmed tuberculosis is shown in Figure 2, and the CART as applied to a theoretical cohort of 1000 patients is presented in Figure 3. The CART analysis suggest that once screened via WHO symptoms as eligible for further diagnostic investigations, the number of WHO symptoms present does not add further to the discrimination of people with tuberculosis from those without. Furthermore, CART positions urinary LF-LAM as the next screening test after WHO symptoms, with 75% of people with positive urinary LF-LAM test (17% of all those with positive WHO symptoms) having a definitive diagnosis of microbiologically confirmed tuberculosis ( Figure 2 and Figure 3). For those with negative urinary LF-LAM, CART positions chest x-ray as the next screening test. Chest x-ray appears twice, but with complementary and not overlapping contributions. The first appearance of chest x-ray (after those with negative urinary LF-LAM) serves to separate participants with ‘likely tuberculosis’ on chest x-ray from those with ‘possible or unlikely tuberculosis’ on chest x-ray. The presence of one or no PoCUS independent features in those with ‘possible or unlikely tuberculosis’ on chest x-ray (47% of the starting sample) isolates 83% of this subgroup (representing 39% of the starting sample) where tuberculosis was not microbiologically confirmed ( Figure 2 and Figure 3). The second appearance of chest x-ray occurs in participants with ≥2 PoCUS independent features and serves to separate those with ‘possible tuberculosis’ on chest x-ray from those with ‘unlikely tuberculosis’ on chest x-ray. The validation for the decision tree is presented in Figure 4.

Figure 2. Prediction tree for microbiologically confirmed tuberculosis.

Figure 2.

Totals might not add up due to rounding. *Point-of-Care ultrasound = Independent point-of-care ultrasound features (ascites, any size pericardial effusion, any size intra-abdominal lymphadenopathy; #ART = Anti-retroviral therapy. Predictor coding: Urinary lipoarabinomannan: 0 = Negative, 1 = Positive; Chest x-ray: 0 = Unlikely tuberculosis, 1 = Possible tuberculosis, 2 = Likely tuberculosis; Point-of-Care ultrasound: 0 = None present; 1 = ≥1 feature present, 2 = ≥2 features present; ART status: 0 = Not on ART, 1 = Currently on ART. Explanation of node: Number in small white block represents the number of the node in the recursive partitioning; Bottom number in big coloured block represents the percentage of the entire dataset that passes through this particular node (e.g. 100% in block 1); Middle numbers in big coloured block represent the proportion with the outcome (right) and without the outcome (left) within the subgroup (e.g. in block, 58% without tuberculosis and 42% with tuberculosis in block1); Top number in big coloured block represent the presence (1) or absence (0) of the outcome in the majority of the observations in that block (e.g. majority in block 1 without tuberculosis (58% versus 42%)); The colour of the block has no particular meaning.

Figure 3. Prediction tree for microbiologically confirmed tuberculosis applied to a theoretical cohort of 1000 patients.

Figure 3.

Nodes show the number of patients and percentage of total sample size (n, %). Totals might not add up due to rounding. *Independent point-of-care ultrasound features (ascites, any size pericardial effusion, any size intra-abdominal lymphadenopathy; LAM = lateral flow lipoarabinomannan; TB = tuberculosis; ART = anti-retroviral therapy.

Figure 4. Cross-validation results of the decision tree.

Figure 4.

Upper panel: cross-validation relative error vs. numbers of split and complexity parameter; Lower panel: apparent R-square and R-square from cross-validation vs the number of splits.

We created a second decision tree to make it more clinically applicable by removing the history of antiretroviral therapy (ART) status, because ART interruption is often not disclosed and ART status may be unavailable in confused patients ( Figure 5 and Figure 6). The branch on the original tree relating to antiretroviral therapy no longer expands, narrowing down what to decide for the 24% of the sample with negative urinary LF-LAM and ‘likely tuberculosis’ on chest x-ray. Just over half (56%) of these participants will have confirmed tuberculosis.

Figure 5. Prediction tree with antiretroviral status removed for microbiologically confirmed tuberculosis.

Figure 5.

Totals might not add up due to rounding. *Point-of-Care ultrasound = Independent point-of-care ultrasound features (ascites, any size pericardial effusion, any size intra-abdominal lymphadenopathy. Predictor coding: Urinary lipoarabinomannan: 0 = Negative, 1 = Positive; Chest x-ray: 0 = Unlikely tuberculosis, 1 = Possible tuberculosis, 2 = Likely tuberculosis; Point-of-Care ultrasound: 0 = None present; 1 = ≥1 feature present, 2 = ≥2 features present. Explanation of node: Number in small white block represents the number of the node in the recursive partitioning; Bottom number in big coloured block represents the percentage of the entire dataset that passes through this particular node(e.g. 100% in block 1); Middle numbers in big coloured block represent the proportion with the outcome (right) and without the outcome (left) within the subgroup (e.g. in block, 58% without tuberculosis and 42% with tuberculosis in block1); Top number in big coloured block represent the presence (1) or absence (0) of the outcome in the majority of the observations in that block (e.g. majority in block 1 without tuberculosis (58% versus 42%)); The colour of the block has no particular meaning.

Figure 6. Prediction tree with antiretroviral status removed for microbiologically confirmed tuberculosis applied to a theoretical cohort.

Figure 6.

Nodes show the number of patients and percentage of total sample size (n, %). Totals might not add up due to rounding. *Independent point-of-care ultrasound features (ascites, any size pericardial effusion, any size intra-abdominal lymphadenopathy; LAM = Lateral flow lipoarabinomannan; TB = tuberculosis.

We created a third prediction tree by only excluding chest x-ray, which is not a true point-of-care test ( Figure 7 and Figure 8). CART positions PoCUS as the next screening test for those with a negative urinary LF-LAM. The presence of two or less independent PoCUS features (75% of the starting sample) had a true negative rate of 71% (representing 53% of the starting sample) in the subgroup where tuberculosis was not microbiologically confirmed.

Figure 7. Prediction tree of point-of-care only tests for microbiologically confirmed tuberculosis applied to a theoretical cohort.

Figure 7.

Nodes show the number of patients and percentage of total sample size (n, %). Totals might not add up due to rounding. *Independent point-of-care ultrasound features (ascites, any size pericardial effusion, any size intra-abdominal lymphadenopathy); LAM = lateral flow lipoarabinomannan; TB = tuberculosis.

Figure 8. Prediction tree with chest x-ray removed for microbiologically confirmed tuberculosis.

Figure 8.

*Point-of-Care ultrasound = Independent point-of-care ultrasound features (ascites, any size pericardial effusion, any size intra-abdominal lymphadenopathy). Predictor coding: Urinary lipoarabinomannan: 0 = Negative, 1 = Positive; Point-of-Care ultrasound: 0 = Negative; 1 = ≥1 feature present, 2 = ≥2 features present, 3 = ≥3 features present. Explanation of node: Number in small white block represents the number of the node in the recursive partitioning; Bottom number in big coloured block represents the percentage of the entire dataset that passes through this particular node(e.g. 100% in block 1); Middle numbers in big coloured block represent the proportion with the outcome (right) and without the outcome (left) within the subgroup (e.g. in block, 58% without tuberculosis and 42% with tuberculosis in block1); Top number in big coloured block represent the presence (1) or absence (0) of the outcome in the majority of the observations in that block (e.g. majority in block 1 without tuberculosis (58% versus 42%)); The colour of the block has no particular meaning.

Discussion

We developed a prediction tree to diagnose HIV-associated tuberculosis in an emergency centre in a high burden setting. The variables selected on multivariable analysis for inclusion in the final model were the presence of >2 WHO screening symptoms, current antiretroviral therapy use, urinary LF-LAM, independent PoCUS features, and chest x-ray. The CART analysis positioned urinary LF-LAM as the first test to perform in participants with positive WHO screening symptoms, followed by chest x-ray. We also developed a simplified prediction tree by excluding chest x-ray, which is not a true point-of-care test: CART positioned PoCUS as the next screening test for those with a negative urinary LF-LAM.

The use of urinary LF-LAM was the predictor with the best ability of creating pure groups (either with or without tuberculosis); classifying almost 25% of the study sample (75% of which were true positives) regardless of their CD4 cell count. The false positive rate of 25% is less than a recent Cochrane review, in which 33% of participants with tuberculosis symptoms had a false positive urinary LF-LAM result for microbiologically confirmed tuberculosis 32 . However, inappropriate exclusions (e.g. participants unable to produce sputum), different enrolment criteria and different CD4 cell counts could potentially explain the high false negative rate seen in the Cochrane review 32 . Another urine-based LAM assay, Fujifilm SILVAMP TB LAM (FujiLAM; Fujifilm, Tokyo, Japan), has higher sensitivity (70.4% versus 28.1%) but somewhat lower specificity (90.8% versus 95.0%) than the LF-LAM assay we used 33 .

Urinary LAM is underutilized despite it being affordable, fast, non-invasive, and simple 34 . Only three high TB/HIV burden countries (Eswatini (formerly Swaziland), South Africa, and Uganda) had national roll-outs of LF-LAM testing by the end of 2018 34 . Urine LF-LAM is a simple point-of-care test achievable in acute care settings 21 , which has been shown to reduce mortality in high-risk HIV-positive inpatients 35, 36 .

The performance of PoCUS when chest x-ray is available is limited ( Figure 2 and Figure 3). One of every 11 PoCUS examinations will be ‘positive’ (i.e. two or more PoCUS independent features), but then an evaluation of the chest x-ray would still be needed to refine the classification of patients with and without tuberculosis. A ‘negative’ PoCUS examination (i.e. the presence of ≤1 PoCUS independent feature) will only rule out 39% of all patients with a clinical suspicion of tuberculosis. This supports other studies and the current WHO guidelines that ultrasound is an additional diagnostic tool and should not replace chest x-ray as the initial imaging step to diagnose tuberculosis in HIV-positive patients 20, 37 . However, chest x-ray is not a true point-of-care test, unlike PoCUS. In acute care settings where chest x-ray is not readily available PoCUS has a 100% true positive rate when all 3 of the independent features were detected, indicating its potential value as a rule-in test; however, 39 PoCUS examinations will need to be performed to confidently diagnose one additional patient in those who had a negative LAM. This number need to scan is likely to increase when used in areas with a lower tuberculosis prevalence (and vice versa). The presence of ≤2 PoCUS independent features will rule out 53% of patients with a clinical suspicion of tuberculosis in situations where chest x-ray is not available; however, the high false negative rate (29%, 218/750) indicates that PoCUS cannot be used as a rule-out test and these patients will need to undergo further testing.

The use of urinary LF-LAM should be prioritised in all HIV-positive patients (regardless of CD4 cell count and clinical condition) who presents to the emergency centre with WHO tuberculosis symptoms. Although a result can be obtained after 25 minutes, a major time increasing factor would be to get a urine sample. The history of current use of ART should be obtained if the patient’s condition allows, as it further refines the diagnostic ability of the algorithm by increasing both the true positive and the true negative rate. Chest x-ray should still be performed if available. In these settings, the value of PoCUS becomes doubtful due to the low positive yield (5%) and the further interpretation of a chest x-ray to better classify cases and non-cases. Although 47% of patients will have negative results for urinary LF-LAM, chest x-ray and PoCUS, the true negative rate is only 83%, too low to confidently rule tuberculosis out. In emergency centres without chest x-ray availability (e.g. limited resources, restricted radiology consulting times), physicians can confidently diagnose tuberculosis in patients where all three independent PoCUS features are present (true positive rate 100%). However, only 2% of the PoCUS examinations are expected to be positive and one can argue whether the time spend to perform the PoCUS is worthwhile. The 71% true negative rate again indicates the need for further diagnostic testing.

Our study has some limitations. Our findings may not be generalizable as the study was conducted in a single emergency centre in a high TB/HIV-prevalence setting; a single, experienced operator performed all the PoCUS examinations; and the chest x-rays were interpreted by a single experienced radiologist. The individual and independent PoCUS features were based on a single study and needs further evaluation. The main strength of our study is the robust microbiologic reference standard composed of TB culture and Xpert MTB/RIF performed on multiple samples from different anatomic sites. However, it is still possible that some TB cases were missed by the reference standard. The study was also performed under routine conditions experienced in the emergency centre. Lastly, robust analytic strategies were used to develop and validate the diagnostic decision tree.

Conclusion

We developed a near-patient and point-of-care decision tree for the diagnosis of HIV-associated tuberculosis in acute care settings. Implementing this decision tree following screening via WHO symptoms can allow immediate initiation of TB treatment within the emergency centre in about a quarter of suspected patients among whom 75% would have microbiologically confirmed tuberculosis, or withhold such treatment in nearly half of suspected patients, among whom less than 18% will have microbiologically confirmed tuberculosis. Urinary LF-LAM had a 75% true positive rate, representing 17% of participants with positive WHO screening symptoms regardless of CD4 cell count and its use should be prioritised. The contribution of PoCUS in the context of urinary LF-LAM and chest X-ray availability was limited, due to the low positive yield, the need for further chest x-ray interpretation and the high false negative rate. In acute care settings without chest x-ray availability, PoCUS has a 100% true positive rate, but will only affect 2% of eligible patients. The role of PoCUS as a rule-in test to diagnose HIV-associated tuberculosis in the emergency centre needs to be further investigated.

Data availability

Underlying data

Zenodo: Rapid diagnosis of HIV-associated tuberculosis in the emergency centre. https://doi.org/10.5281/zenodo.3734101 31 .

This project contains the following underlying data:

  • HIV-TB_diagnostic_algorithm_data.csv. (Data used for diagnostic algorithm.)

  • HIV-TB_diagnostic_samples.csv. (Data of diagnostic samples taken.)

  • HIV-TB_diagnostic_algorithm_codebook.docx. (codebook for diagnostic algorithm data.)

  • HIV-TB_diagnostic_samples_codebook.docx. (codebook for diagnostic samples.)

Extended data

Zenodo: Case report form: Rapid diagnosis of HIV-associated tuberculosis in the emergency centre. https://doi.org/10.5281/zenodo.3738912 23 .

Zenodo: Code: Rapid diagnosis of HIV-associated tuberculosis in the emergency centre. https://doi.org/10.5281/zenodo.3739005 30 .

Reporting guidelines

Zenodo: TRIPOD checklist for ‘A multi-parameter diagnostic clinical decision tree for the rapid diagnosis of tuberculosis in HIV-positive patients presenting to an emergency centre’. https://doi.org/10.5281/zenodo.3738999 38 .

Data are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CCO 1.0 Public domain dedication).

Acknowledgements

We acknowledge the valuable contribution of Rene Goliath (research clinical site coordinator, Wellcome Centre for Infectious Diseases Research in Africa, Institute of Infectious Disease & Molecular Medicine, University of Cape Town), the staff of the National Health Laboratory Service (NHLS), and the staff and administration of Khayelitsha Hospital.

Funding Statement

GrM was supported by the Wellcome Trust (098316 and 203135), the South African Research Chairs Initiative of the Department of Science and Technology and National Research Foundation (NRF) of South Africa (Grant No 64787), NRF incentive funding (UID: 85858), and the South African Medical Research Council through its TB and HIV Collaborating Centres Programme with funds received from the National Department of Health (RFA# SAMRC-RFA-CC: TB/HIV/AIDS-01-2014). GaM was supported by NRF incentive funding (UID: 85810). The opinions, findings and conclusions expressed in this manuscript reflect those of the authors alone.

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

[version 2; peer review: 2 approved, 1 approved with reservations]

References

  • 1. World Health Organization: Global Tuberculosis Report 2018. Geneva: World Health Organization.2018; Accessed January 14, 2019. Reference Source [Google Scholar]
  • 2. World Health Organization: Systematic Screening for Active Tuberculosis: Principles and Recommendations.Geneva: World Health Organization.2015; Accessed April 30, 2019. Reference Source [PubMed] [Google Scholar]
  • 3. Dawson R, Masuka P, Edwards DJ, et al. : Chest radiograph reading and recording system: evaluation for tuberculosis screening in patients with advanced HIV. Int J Tuberc Lung Dis. 2010;14(1):52–58. [PMC free article] [PubMed] [Google Scholar]
  • 4. Steingart KR, Schiller I, Horne DJ, et al. : Xpert ® MTB/RIF assay for pulmonary tuberculosis and rifampicin resistance in adults. Cochrane Database Syst Rev. 2014; (1):CD009593. 10.1002/14651858.CD009593.pub3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Steingart KR, Ng V, Henry M, et al. : Sputum processing methods to improve the sensitivity of smear microscopy for tuberculosis: a systematic review. Lancet Infect Dis. 2006;6(10):664–674. 10.1016/S1473-3099(06)70602-8 [DOI] [PubMed] [Google Scholar]
  • 6. Munthali L, Khan PY, Mwaungulu NJ, et al. : The effect of HIV and antiretroviral therapy on characteristics of pulmonary tuberculosis in northern Malawi: a cross-sectional study. BMC Infect Dis. 2014;14:107. 10.1186/1471-2334-14-107 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Sharma S, Kadhiravan T, Banga A, et al. : Spectrum of clinical disease in a series of 135 hospitalised HIV-infected patients from north India. BMC Infect Dis. 2004;4(1):52. 10.1186/1471-2334-4-52 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Chou SH, Prabhu SJ, Crothers K, et al. : Thoracic diseases associated with HIV infection in the era of antiretroviral therapy: clinical and imaging findings. Radiographics. 2014;34(4):895–911. 10.1148/rg.344130115 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Getahun H, Harrington M, O’ Brien R, et al. : Diagnosis of smear-negative pulmonary tuberculosis in people with HIV infection or AIDS in resource-constrained settings: informing urgent policy changes. Lancet. 2007;369(9578):2042–2049. 10.1016/S0140-6736(07)60284-0 [DOI] [PubMed] [Google Scholar]
  • 10. World Health Organization: Global Tuberculosis Report 2017.Geneva.2017; Accessed January 14, 2019. Reference Source [Google Scholar]
  • 11. Leung AN, Brauner MW, Gamsu G, et al. : Pulmonary tuberculosis: comparison of CT findings in HIV-seropositive and HIV-seronegative patients. Radiology. 1996;198(3):687–691. 10.1148/radiology.198.3.8628855 [DOI] [PubMed] [Google Scholar]
  • 12. Gupta RK, Lucas SB, Fielding KL, et al. : Prevalence of tuberculosis in post-mortem studies of HIV-infected adults and children in resource-limited settings: a systematic review and meta-analysis. AIDS. 2015;29(15):1987–2002. 10.1097/QAD.0000000000000802 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Nakanjako D, Kyabayinze DJ, Mayanja-Kizza H, et al. : Eligibility for HIV/AIDS treatment among adults in a medical emergency setting at an urban hospital in Uganda. Afr Health Sci. 2007;7(3):124–128. 10.5555/afhs.2007.7.3.124 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Tsai TC, Hung MS, Chen IC, et al. : Delayed diagnosis of active pulmonary tuberculosis in emergency department. Am J Emerg Med. 2008;26(8):888–892. 10.1016/j.ajem.2007.11.036 [DOI] [PubMed] [Google Scholar]
  • 15. García-Basteiro AL, DiNardo A, Saavedra B, et al. : Point of care diagnostics for tuberculosis. Pulmonology. 2018;24(2):73–85. 10.1016/j.rppnen.2017.12.002 [DOI] [PubMed] [Google Scholar]
  • 16. Van Hoving DJ, Griesel R, Meintjes G, et al. : Abdominal ultrasound for diagnosing abdominal tuberculosis or disseminated tuberculosis with abdominal involvement in HIV-positive individuals. Cochrane Database Syst Rev. 2019;9:CD012777. 10.1002/14651858.CD012777.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Western Cape Provincial AIDS Council: Annual Progress Report 2014/2015. Provincial Strategic Plan 2012-2016.Cape Town.2016. Reference Source [Google Scholar]
  • 18. Janssen S, Schutz C, Ward AM, et al. : Hemostatic Changes Associated With Increased Mortality Rates in Hospitalized Patients With HIV-Associated Tuberculosis: A Prospective Cohort Study. J Infect Dis. 2017;215(2):247–258. 10.1093/infdis/jiw532 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Hunter LD, Lahri S, van Hoving DJ: Case mix of patients managed in the resuscitation area of a district-level public hospital in Cape Town. Afr J Emerg Med. 2017;7(1):19–23. 10.1016/j.afjem.2017.01.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. World Health Organization: Guidelines for intensified tuberculosis case-finding and isoniazid preventive therapy for people living with HIV in resource-constrained settings. Geneva: World Health Organization.2011. Reference Source [Google Scholar]
  • 21. Van Hoving DJ, Lahri S, Lategan HJ, et al. : Brief Report: Real-World Performance and Interobserver Agreement of Urine Lipoarabinomannan in Diagnosing HIV-Associated Tuberculosis in an Emergency Center. J Acquir Immune Defic Syndr. 2019;81(1):e10–e14. 10.1097/QAI.0000000000002002 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Van Hoving DJ, Kenge AP, Maartens G, et al. : Point-of-Care Ultrasound Predictors for the Diagnosis of Tuberculosis in HIV-Positive Patients Presenting to an Emergency Center. J Acquir Immune Defic Syndr. 2020;83(4):415–423. 10.1097/QAI.0000000000002279 [DOI] [PubMed] [Google Scholar]
  • 23. Van Hoving DJ: Case report form: Rapid diagnosis of HIV-associated tuberculosis in the emergency centre (Version 1). Zenodo. 2020. 10.5281/zenodo.3738912 [DOI] [Google Scholar]
  • 24. Atkinson P, Bowra J, Lambert M, et al. : International Federation for Emergency Medicine point of care ultrasound curriculum. CJEM. 2015;17(2):161–170. 10.1017/cem.2015.8 [DOI] [PubMed] [Google Scholar]
  • 25. Peduzzi P, Concato J, Kemper E, et al. : A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol. 1996;49(12):1373–1379. 10.1016/s0895-4356(96)00236-3 [DOI] [PubMed] [Google Scholar]
  • 26. World Health Organization: Improving the Diagnosis and Treatment of Smear-Negative Pulmonary and Extrapulmonary Tuberculosis among Adults and Adolescents.Geneva: World Health Organization.2007; Accessed September 15, 2014. Reference Source [Google Scholar]
  • 27. Kengne AP, Czernichow S, Huxley R, et al. : Blood pressure variables and cardiovascular risk: new findings from ADVANCE. Hypertension. 2009;54(2):399–404. 10.1161/HYPERTENSIONAHA.109.133041 [DOI] [PubMed] [Google Scholar]
  • 28. Pencina MJ, D’ Agostino RB, D’ Agostino RB, et al. : Comments on ‘ Integrated discrimination and net reclassification improvements— Practical advice.’ Stat Med. 2008;27(2):207–212. 10.1002/sim.3106 [DOI] [Google Scholar]
  • 29. DeLong ER, DeLong DM, Clarke-Pearson DL: Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44(3):837–845. 10.2307/2531595 [DOI] [PubMed] [Google Scholar]
  • 30. Van Hoving DJ: Code: Rapid diagnosis of HIV-associated tuberculosis in the emergency centre (Version 1). Zenodo. 2020. 10.5281/zenodo.3739005 [DOI] [Google Scholar]
  • 31. Van Hoving DJ: Rapid diagnosis of HIV-associated tuberculosis in the emergency centre. Zenodo. 2020. 10.5281/zenodo.3734101 [DOI] [Google Scholar]
  • 32. Bjerrum S, Schiller I, Dendukuri N, et al. : Lateral flow urine lipoarabinomannan assay for detecting active tuberculosis in people living with HIV. Cochrane Database Syst Rev. 2019;10:CD011420. 10.1002/14651858.CD011420.pub3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Broger T, Sossen B, du Toit E, et al. : Novel lipoarabinomannan point-of-care tuberculosis test for people with HIV: a diagnostic accuracy study. Lancet Infect Dis. 2019;19(8):852–861. 10.1016/S1473-3099(19)30001-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34. Makone AS: Mapping of LF-LAM Uptake with Global Fund & PEPFAR Funding.In: 10th International AIDS Society (IAS) Conference on HIV Science.Mexico City.2019; Accessed September 2, 2019. Reference Source [Google Scholar]
  • 35. Gupta-Wright A, Corbett EL, van Oosterhout JJ, et al. : Rapid urine-based screening for tuberculosis in HIV-positive patients admitted to hospital in Africa (STAMP): a pragmatic, multicentre, parallel-group, double-blind, randomised controlled trial. Lancet. 2018;392(10144):292–301. 10.1016/S0140-6736(18)31267-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36. Peter JG, Zijenah LS, Chanda D, et al. : Effect on mortality of point-of-care, urine-based lipoarabinomannan testing to guide tuberculosis treatment initiation in HIV-positive hospital inpatients: a pragmatic, parallel-group, multicountry, open-label, randomised controlled trial. Lancet. 2016;387(10024):1187–1197. 10.1016/S0140-6736(15)01092-2 [DOI] [PubMed] [Google Scholar]
  • 37. Heller T, Goblirsch S, Bahlas S, et al. : Diagnostic value of FASH ultrasound and chest X-ray in HIV-co-infected patients with abdominal tuberculosis. Int J Tuberc Lung Dis. 2013;17(3):342–344. 10.5588/ijtld.12.0679 [DOI] [PubMed] [Google Scholar]
  • 38. Van Hoving DJ: TRIPOD checklist for 'A multi-parameter diagnostic clinical decision tree for the rapid diagnosis of tuberculosis in HIV-positive patients presenting to an emergency centre'. Zenodo. 2020. 10.5281/zenodo.3738999 [DOI] [PMC free article] [PubMed] [Google Scholar]
Wellcome Open Res. 2022 Jun 30. doi: 10.21956/wellcomeopenres.19817.r51280

Reviewer response for version 2

Peter MacPherson 1

Thanks for asking me to review this manuscript. Very nice study, and clearly reported. I have only a few comments the authors should address.

Major comments

  1. Prevalence of microbiologically-confirmed TB is very high in this population, and health facilities seem to be reasonably well resourced. The authors should add text to the Discussion to discuss generalisbility to settings in Africa outside of the Khayelitsha area.

  2. The CD4 cell count profile is low, and antiretroviral therapy coverage considerably lower than we have seen in other settings. It would be good to add a sentence in the discussion to reflect on how the accuracy, performance, and applicability of the final decision tree may be affected in other settings in the African continent where we see different patterns of ART coverage.

  3. Presumably HIV viral load measurements were not available for inclusion in the model? We have seen in several studies now a moderately high prevalence of detectable viraemia in HIV-positive adults who reported taking ART, and is strongly associated with adverse clinical outcomes. I could imagine that HIV viral load measurement (e.g. using the GeneXpert platform) might be a useful diagnostic predictor of prevalent TB. It would be worth adding a sentence to discuss ART coverage and viral failure in the limitations section of the Discussion.

  4. In Figure 1, not clear what were the reasons for “Research related problems” in the 55 participants who were excluded. The authors should add a sentence to describe these participants in more details in the results, and provide reassurance that these exclusions have not resulted in selection/spectrum bias.

  5. Discussion. Sentence about coverage of urine LAM is a little outdated, and several more countries have rolled-out this test, including Malawi.

  6. POCUS is critically dependent on trained operators and high levels of quality assurance, which are not usually available in most settings in Africa. In most settings, operators trained in POCUS will not be available, whereas digital chest with CAD is often available, meaning that pragmatically, the decision tree placement of POCUS prior to CXR doesn’t necessarily make sense. I would perhaps temper the paragraph about the utility of POCUS, especially given the suboptimal performance found here, and in other studies.

Minor Comments:

  1. Abstract, typo: “Logistic regressions” should be “Logistic regression”.

Is the work clearly and accurately presented and does it cite the current literature?

Yes

If applicable, is the statistical analysis and its interpretation appropriate?

Yes

Are all the source data underlying the results available to ensure full reproducibility?

Yes

Is the study design appropriate and is the work technically sound?

Yes

Are the conclusions drawn adequately supported by the results?

Yes

Are sufficient details of methods and analysis provided to allow replication by others?

Yes

Reviewer Expertise:

HIV, TB, Public Health, epidemiology, randomised controlled trials, diagnostic accuracy evaluations, global health

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Wellcome Open Res. 2020 Jun 8. doi: 10.21956/wellcomeopenres.17356.r38643

Reviewer response for version 1

Maria Teresa Giordani 1

This manuscript is aimed to describe the use of LF-LAM in an acute care setting and identified PoCUS features independently associated with HIV-associated tuberculosis. Then, the study proposes a decisional algorithm for the diagnosis of TB in HIV patients, including point-of-care tests, as a result of a regression tree algorithm (CART).

This algorithm combines the only two tests really available at the patient bedside and having the true characteristics of point of care test: LF-LAM and PoCUS, and the “classic” tests, CXR and GeneXpert PCR plus the culture of the sputum or pus: the two latter tests are now considered as the gold standard.

The scenario is peculiar: the patients accessing this hospital have a high prevalence of HIV and are very deeply immunosuppressed, with very low CD4 count (never treated before for both conditions, or only treated for HIV).

General comments: Portable CXR and GeneXpert, reported in the text as “near point-of care-tests” really improved the opportunity of TB diagnosis in the last decades and now are the standard-of-diagnostic tools in many hospitals in many different resource settings. However, the clinical impact of these technologies on the TB epidemic and mortality was not so impressive, particularly if we consider patients living with HIV.

The point-of-care tests like LF-LAM and PoCUS are available also in resource-limited settings (RLS) with affordable costs, can be performed in small and rural hospitals with basic labs without the need for referral centers. This will be a great advantage and an addition in the COVID era.

Limitations of the study (some of the limitations are already discussed in the study).

  1. The authors do not report the TB treatment nor considerations of the patients’ clinical outcome, so these tests are evaluated only in their performances in the diagnosis of TB (compared with the gold standard of culture), not considering the efficacy of treatment.

  2. In the file “clinical data of the patients”, data on HIV treatment are very limited (see questions).

  3. As at least two different types of LF-LAM tests are commercially available and have different performances, the author should explain the choice (LAM Alere Ag test) in the methods section and discuss in depth the performances of the different tests commercially available.

  4. Intrinsic limitations of the sensitivity of LF-LAM were described in a recent paper of Tlali et al. (2020) 1  - the authors should discuss this paper.

  5. POCUS examinations were performed by a single, experienced operator. A second blinded reviewer of the clips and/or sonographer would have added value to the results, considering that the US is a repeatable test.

  6. The difference between the “individual” and “independent” aspect of the US is based on week evidence and considering that the result of this differentiation is that the focal splenic lesions and pleuric effusions, I’d delete it. Or, the author should just propose it separately and say that it needs further evaluation.

Questions and suggestions:

HAART is a relevant issue in these patients. In the database, a considerable part of patients results on HAART therapy, so it is unclear why these patients were so deeply immunosuppressed; failure of the therapy? No compliance? The authors report that the patients are often confused at admission. This is true. However, the failure of the HAART therapy should both have had a role or be a consequence of TB infection: a brief comment of this aspect in the discussion should be appreciated. Also, I’ve noticed that no data on the VL are available, probably the test was not done. Please add it.

Surprisingly, in the cohort, the different levels of CD4 considered by stratifying the patients in different groups with CD4 > of 200 or less. (<100 cells/mm3, 100–200 cells/mm3, >200 cells/mm3) does not have any impact. Probably, you should have considered another group with a higher level of CD4 and a working active therapy in the stratification (if that kind of patient were included in the cohort). If the CD4 doesn’t matter, also the HIV status could have been not so relevant as presumed in the performances of LF-LAM. You should add some considerations on these aspects.

The neurological presentation was considered an exclusion criterion (Figure 1), but, in Table 1, 13 patients result to have a CRF sample. Please explain why these patients did a Lumbar Puncture, it should be interesting.

In Table 3, I’d link with * the 63 patients with clinical diagnoses of tuberculosis of Table 3 with Table 4.

Surprisingly, no one patient was diagnosed as ARL (AIDS-related lymphoma) that is the principal differential diagnosis (both clinical and the US) in TB-HIV patients: I'll speculate of some bias of selections (is it possible that patients with suspected lymphoma are preselected for referral centers? Sometimes it happens in African settings).

Only 1 case of NTM was diagnosed in this cohort: it is interesting because in the work of Nel et al. (2017) 2 a considerable rate of false-positive LF-LAM test was found, and the cohort includes a high number of patients with a low CD4 count.

In Table 4, some of the “Reason for diagnosis of tuberculosis without microbiological confirmation”, as “Suggestive formal abdominal ultrasound is done in radiology department” are really unclear, data on the true outcome of patients if available should be of particular interest.

I partially disagree with the final consideration "The contribution of PoCUS in the context of urinary LF-LAM and chest X-ray availability was limited, due to the low positive yield, the need for further chest x-ray interpretation and the high false-negative rate...." because if you consider that LAM has good sensitivity but lower specificity, PoCUS whose specificity is very high could be the perfect tool. Please add the consideration to the conclusions. 

Final comment: it’s common thinking that “we have CXR, GeneXpert, and QGT, and we don’t need further tests”. Theoretically, it seems difficult to support the need for further tests for TB. But, in “real life”, there is a considerable “grey area” of challenging cases, particularly in patients with extrapulmonary TB, needing expensive second-level tests, like CT scan, Pet CT, laparoscopy with biopsy, staining and pathologists, all not available in LRS were most patients with TB live. The alternative is to start with an “empirical treatment” without any scientific evidence of TB except the WHO symptoms. But this is a rough approach in the MDR-TB era.

The authors present a scenario, with a sidereal prevalence of TB (47%) and tremendously bad treatment of HIV. This peculiar situation might have influenced the results: other studies should have been carried in different settings, including a limited resource setting with a lower prevalence of HIV (and TB); a database including treatment and outcomes of the patients will add a lot. I suggest adding these considerations to the conclusions. To my knowledge, urinary LAM is increasingly used in LRS hospitals, but the test has some limitations and probably should be improved. However, probably there isn't a perfect test in TB and the combination of different tests is the better choice at the present moment. 

I apologize to the editor and authors but my knowledge in statistics is limited, so my review is incomplete and only focused on the clinical aspect of the work. I think a mathematics or a statistics expert should be included as a reviewer of this manuscript

Thank you for asking me to review this manuscript. I read it with high interest, and I found it accurate, written with conviction, and powerfully argued.

Is the work clearly and accurately presented and does it cite the current literature?

Yes

If applicable, is the statistical analysis and its interpretation appropriate?

I cannot comment. A qualified statistician is required.

Are all the source data underlying the results available to ensure full reproducibility?

Partly

Is the study design appropriate and is the work technically sound?

Yes

Are the conclusions drawn adequately supported by the results?

Partly

Are sufficient details of methods and analysis provided to allow replication by others?

Partly

Reviewer Expertise:

I'm a full-time clinician in Infectious Diseases and Tropical Medicine in San Bortolo Hospital, Vicenza, Italy. I started using ultrasound, POCUS and the interventional US in the setting of infective patients included HIV/TB patients in 1995 and exported my experience in remote settings with very constrained resources.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

References

  • 1. : Sensitivity of the lateral flow urine lipoarabinomannan assay in ambulant adults with advanced HIV disease: data from the TB Fast Track study. Trans R Soc Trop Med Hyg .2020; 10.1093/trstmh/traa018 10.1093/trstmh/traa018 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. : Does Disseminated Nontuberculous Mycobacterial Disease Cause False-Positive Determine TB-LAM Lateral Flow Assay Results? A Retrospective Review. Clinical Infectious Diseases .2017;65(7) : 10.1093/cid/cix513 1226-1228 10.1093/cid/cix513 [DOI] [PubMed] [Google Scholar]
Wellcome Open Res. 2022 May 6.
Daniel van Hoving 1

Thank you to the time and effort to review the manuscript. Please find below our responses (in bold italics) to comments raised.

This manuscript is aimed to describe the use of LF-LAM in an acute care setting and identified PoCUS features independently associated with HIV-associated tuberculosis. Then, the study proposes a decisional algorithm for the diagnosis of TB in HIV patients, including point-of-care tests, as a result of a regression tree algorithm (CART).

This algorithm combines the only two tests really available at the patient bedside and having the true characteristics of point of care test: LF-LAM and PoCUS, and the “classic” tests, CXR and GeneXpert PCR plus the culture of the sputum or pus: the two latter tests are now considered as the gold standard.

The scenario is peculiar: the patients accessing this hospital have a high prevalence of HIV and are very deeply immunosuppressed, with very low CD4 count (never treated before for both conditions, or only treated for HIV).

General comments: Portable CXR and GeneXpert, reported in the text as “near point-of care-tests” really improved the opportunity of TB diagnosis in the last decades and now are the standard-of-diagnostic tools in many hospitals in many different resource settings. However, the clinical impact of these technologies on the TB epidemic and mortality was not so impressive, particularly if we consider patients living with HIV.

The point-of-care tests like LF-LAM and PoCUS are available also in resource-limited settings (RLS) with affordable costs, can be performed in small and rural hospitals with basic labs without the need for referral centers. This will be a great advantage and an addition in the COVID era.

Limitations of the study (some of the limitations are already discussed in the study).

  1. The authors do not report the TB treatment nor considerations of the patients’ clinical outcome, so these tests are evaluated only in their performances in the diagnosis of TB (compared with the gold standard of culture), not considering the efficacy of treatment.

This is correct. Patients that were empirically started on anti-tuberculous treatment were not included as cases. These participants were also not followed to determine whether they improved clinically. We did acknowledge this as a limitation.

  1. In the file “clinical data of the patients”, data on HIV treatment are very limited (see questions).

Please see comment below

  1. As at least two different types of LF-LAM tests are commercially available and have different performances, the author should explain the choice (LAM Alere Ag test) in the methods section and discuss in depth the performances of the different tests commercially available.

We only had access to one LF-LAM test (LAM Alere Ag test) when the study was initiated. We’ve explained the choice in the methods section as suggested. We’ve also added the estimated sensitivity and specificity of the FujiLAM test in the discussion.

  1. Intrinsic limitations of the sensitivity of LF-LAM were described in a recent paper of Tlali et al. (2020) 1  - the authors should discuss this paper.

Thanks for the suggestion. The manuscript from Tlali et al evaluates the use of LF-LAM in ambulatory patients only and excluded patients too sick to be managed in ambulant care. The setting and population differ substantially to our study where participants were mostly acutely ill. The TB prevalence also differ markedly, 7% versus 42%. We therefor did not include the study in the discussion section.

  1. POCUS examinations were performed by a single, experienced operator. A second blinded reviewer of the clips and/or sonographer would have added value to the results, considering that the US is a repeatable test.

We agree that a second blinded review of both the POCUS examinations and the chest x-rays would have added value to the results. This is acknowledged in the limitation section.

The difference between the “individual” and “independent” aspect of the US is based on week evidence and considering that the result of this differentiation is that the focal splenic lesions and pleuric effusions, I’d delete it. Or, the author should just propose it separately and say that it needs further evaluation.

The individual and independent PoCUS features were based on a single study. We’ve acknowledge in the limitation section that this needs further evaluation.

Questions and suggestions:

HAART is a relevant issue in these patients. In the database, a considerable part of patients results on HAART therapy, so it is unclear why these patients were so deeply immunosuppressed; failure of the therapy? No compliance? The authors report that the patients are often confused at admission. This is true. However, the failure of the HAART therapy should both have had a role or be a consequence of TB infection: a brief comment of this aspect in the discussion should be appreciated. Also, I’ve noticed that no data on the VL are available, probably the test was not done. Please add it.

Overall 47% of participants were taking anti-retroviral therapy. We did not explore reasons for why participants were still deeply immune-supressed despite being on treatment. The viral load was unfortunately not done in participants.

Surprisingly, in the cohort, the different levels of CD4 considered by stratifying the patients in different groups with CD4 > of 200 or less. (<100 cells/mm3, 100–200 cells/mm3, >200 cells/mm3) does not have any impact. Probably, you should have considered another group with a higher level of CD4 and a working active therapy in the stratification (if that kind of patient were included in the cohort). If the CD4 doesn’t matter, also the HIV status could have been not so relevant as presumed in the performances of LF-LAM. You should add some considerations on these aspects.

We unfortunately did not include a 4th group representing higher CD4 cell counts. We did comment on the use of urinary LF-LAM in participants with positive WHO screening symptoms regardless of CD4 cell count. This is an area that need further exploration.

The neurological presentation was considered an exclusion criterion (Figure 1), but, in Table 1, 13 patients result to have a CRF sample. Please explain why these patients did a Lumbar Puncture, it should be interesting.

Only patients with a main neurological presentation were excluded. All laboratory tests performed by the hospital clinicians (non-research group) were evaluated and included if the tests related to tuberculosis. There is a very low threshold at the hospital to do a lumbar puncture as part of the evaluation of immunodeficient patients and hence the reason for including 13 CSF samples.

In Table 3, I’d link with * the 63 patients with clinical diagnoses of tuberculosis of Table 3 with Table 4.

We have added a footnote to Table 3 linking the 63 patients to Table 4.

Surprisingly, no one patient was diagnosed as ARL (AIDS-related lymphoma) that is the principal differential diagnosis (both clinical and the US) in TB-HIV patients: I'll speculate of some bias of selections (is it possible that patients with suspected lymphoma are preselected for referral centers? Sometimes it happens in African settings).

We are not aware that patients with suspected lymphoma are per-selected for referral centers at the study hospital. We can only speculate on why AIDS-related lymphoma was not diagnosed.

Only 1 case of NTM was diagnosed in this cohort: it is interesting because in the work of Nel et al. (2017) 2 a considerable rate of false-positive LF-LAM test was found, and the cohort includes a high number of patients with a low CD4 count.

We can only speculate on why non-tuberculous mycobacterial infection was only cultured in one patient.

In Table 4, some of the “Reason for diagnosis of tuberculosis without microbiological confirmation”, as “Suggestive formal abdominal ultrasound is done in radiology department” are really unclear, data on the true outcome of patients if available should be of particular interest.

We unfortunately did not follow patients up to see whether their clinical condition actually improves after the empiric initiation of anti-tuberculous treatment. We purposefully used the term ‘suggestive’ as there is no robust evidence on this (hence a motivation for the current study). The clinical diagnosis of tuberculosis also differ between attending physicians as some will only use certain ultrasound features (e.g. hypo echoic splenic lesions), where as others want to see more than one ultrasound feature (e.g. pericardial effusion and splenic lesions).

I partially disagree with the final consideration "The contribution of PoCUS in the context of urinary LF-LAM and chest X-ray availability was limited, due to the low positive yield, the need for further chest x-ray interpretation and the high false-negative rate...." because if you consider that LAM has good sensitivity but lower specificity, PoCUS whose specificity is very high could be the perfect tool. Please add the consideration to the conclusions. 

We have added that the the role of POCUS as a rule-in test to diagnose HIV-associated tuberculosis needs to be further investigated

Final comment: it’s common thinking that “we have CXR, GeneXpert, and QGT, and we don’t need further tests”. Theoretically, it seems difficult to support the need for further tests for TB. But, in “real life”, there is a considerable “grey area” of challenging cases, particularly in patients with extrapulmonary TB, needing expensive second-level tests, like CT scan, Pet CT, laparoscopy with biopsy, staining and pathologists, all not available in LRS were most patients with TB live. The alternative is to start with an “empirical treatment” without any scientific evidence of TB except the WHO symptoms. But this is a rough approach in the MDR-TB era.

The authors present a scenario, with a sidereal prevalence of TB (47%) and tremendously bad treatment of HIV. This peculiar situation might have influenced the results: other studies should have been carried in different settings, including a limited resource setting with a lower prevalence of HIV (and TB); a database including treatment and outcomes of the patients will add a lot. I suggest adding these considerations to the conclusions. To my knowledge, urinary LAM is increasingly used in LRS hospitals, but the test has some limitations and probably should be improved. However, probably there isn't a perfect test in TB and the combination of different tests is the better choice at the present moment. 

I apologize to the editor and authors but my knowledge in statistics is limited, so my review is incomplete and only focused on the clinical aspect of the work. I think a mathematics or a statistics expert should be included as a reviewer of this manuscript

Thank you for asking me to review this manuscript. I read it with high interest, and I found it accurate, written with conviction, and powerfully argued.

Wellcome Open Res. 2020 Jun 1. doi: 10.21956/wellcomeopenres.17356.r38642

Reviewer response for version 1

Jim Connoly 1

This is an extremely well written article of significant importance for the practice of EM in areas of the world with high endemic levels of Infectious diseases, specifically HIV and TB.

It has been well powered, designed and conducted as a study and the presentation of results has been done in such a way as to recognises the limitations present in some low income systems that would affect the decision making tree, specifically by designing a number of trees with different starting points e.g. poor access to radiology. 

In this regard FASH/PoCUS has been thought to have an increased role, specifically due to it’s portability and access at the bedside/out of hours and this work has sought to try and establish it’s role in any decision making tree. Similarly it has assessed the role of true point of care testing

1 Manuscript

1.1 The research is well set out and easy to follow. The tables and figures are appropriately labelled and detailed.

1.2 Editorially when printing it may be that the tables are moved around a little to be closer to where they are referenced.

2 Study Design

2.1 The study design is appropriate for investigation of the subject and formulation of a decision tree.

2.2 The study population as indicated is one of a high prevalence and so appropriate to study though, as the authors clearly indicate the applicability to areas of lower prevalence is more difficult to predict.

2.3 Recruitment was good with respect to exclusion criteria some are obvious, others less obvious with no reason given as to exclusion of gynae/obstetric cases and CNS cases .There was a reasonable large amount excluded (132 in total) and some exclusions would prefer male over female inclusion (i.e. gynae/ obstetric though these appear small in number).

I note however the male study population was only 40%. With respect to the exclusion criteria a clearer statement of any differences with the study group would be of value.

3 Results

3.1 The use of phraseology “PoCUS independent and PoCUS individual features” is slightly unclear and could be clarified.

3.2 Table 4 details the cases diagnosed with TB without microbiological confirmation - a total of 63 compared with a total of 172 microbiologically proven cases. This group would equate to 25% of patients finally treated for TB.

I assume reading the paper these 25% were not included in the final statistics as the abstract clearly states the gold standard that the variables were looked at with respect to microbiologically confirmed TB.

This data raises a few points of interest. I note in Table 4 almost 30% of the group diagnosed without microbiological proof were considered to have TB based on formal US findings. With my PoCUS interest it would be of great interest if the authors were able to review any reasons for differences in the US findings between the expert and PoCUS findings - this may be of interest for future improving of accuracy of any PoCUS algorithm.

These 25% are also of potential interest when considering the results (see 4.2) .

4 Discussion

4.1 This covers all the valid points/shortcomings of the study and gives clear evidenced recommendations. Although the authors comment that a weakness of the study was that it was performed under routine conditions in the emergency department, this in my view makes the research more applicable.

4.2 Table 4 shows a number of patients in whom TB was diagnosed in the absence of microbiology which is over 25% of the final cases.

The main scientific thrust of the paper has to be on confirmed cases as a scientific gold standard.

However I do wonder in the final discussion if it is worth subjecting a few of the main decision trees and some of the univariable factors in Table 6 to data analysis which includes these cases to see how they might perform in a “real world” setting. This would obviously not be the main thrust of the scientific process but would be of great interest. Therein specifically, in light of the 30% being US findings I would be especially interested to see how PoCUS performed including that cohort of those eventually treated and whether it affects the number needed to scan?

In regard to the performance of PoCUS, specifically 39 being needed to opt in one case – is it worth highlighting that this is however likely to increase in low prevalence and decrease in higher prevalence areas?

Is the work clearly and accurately presented and does it cite the current literature?

Yes

If applicable, is the statistical analysis and its interpretation appropriate?

Yes

Are all the source data underlying the results available to ensure full reproducibility?

Yes

Is the study design appropriate and is the work technically sound?

Yes

Are the conclusions drawn adequately supported by the results?

Yes

Are sufficient details of methods and analysis provided to allow replication by others?

Yes

Reviewer Expertise:

Point of Care Ultrasound.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Wellcome Open Res. 2022 May 6.
Daniel van Hoving 1

Thank you to the time and effort to review the manuscript. Please find below our responses (in bold italics) to comments raised.

This is an extremely well written article of significant importance for the practice of EM in areas of the world with high endemic levels of Infectious diseases, specifically HIV and TB.

It has been well powered, designed and conducted as a study and the presentation of results has been done in such a way as to recognises the limitations present in some low income systems that would affect the decision making tree, specifically by designing a number of trees with different starting points e.g. poor access to radiology. 

In this regard FASH/PoCUS has been thought to have an increased role, specifically due to it’s portability and access at the bedside/out of hours and this work has sought to try and establish it’s role in any decision making tree. Similarly it has assessed the role of true point of care testing

1 Manuscript

1.1 The research is well set out and easy to follow. The tables and figures are appropriately labelled and detailed.

1.2 Editorially when printing it may be that the tables are moved around a little to be closer to where they are referenced.

2 Study Design

2.1 The study design is appropriate for investigation of the subject and formulation of a decision tree.

2.2 The study population as indicated is one of a high prevalence and so appropriate to study though, as the authors clearly indicate the applicability to areas of lower prevalence is more difficult to predict.

2.3 Recruitment was good with respect to exclusion criteria some are obvious, others less obvious with no reason given as to exclusion of gynae/obstetric cases and CNS cases .There was a reasonable large amount excluded (132 in total) and some exclusions would prefer male over female inclusion (i.e. gynae/ obstetric though these appear small in number).

All gynae/obstetric cases and CNS cases were not excluded, only patients with a main clinical presentation of meningitis syndrome or new focal neurology; gynaecological or psychiatric presentation.

I note however the male study population was only 40%. With respect to the exclusion criteria a clearer statement of any differences with the study group would be of value.

Many HIV/TB studies have a female dominant sample population. We think this relates to cultural issues, where it is often seen as a weakness for young males to attend healthcare facilities.

3 Results

3.1 The use of phraseology “PoCUS independent and PoCUS individual features” is slightly unclear and could be clarified.

Thanks for pointing this out. Independent POCUS features are POCUS features that were independently associated with tuberculosis and were determined by multivariable logistical regression. In this cohort, the independent POCUS features were pericardial effusion of any size, ascites, and intra-abdominal lymphadenopathy of any size. Individual POCUS features were any POCUS feature that showed an association with microbiologically confirmed tuberculosis without taking other POCUS features in consideration (i.e. univariable analysis) The statistical significant PoCUS feature with the lowest positive threshold was included, where different thresholds for positivity was used (eg, intra-abdominal lymph node size). This is explained in detail in the referenced study (Ref nr 22; Van Hoving DJ, Kenge AP, Maartens G, et al.: Point-of-Care Ultrasound Predictors for the Diagnosis of Tuberculosis in HIV-Positive Patients Presenting to an Emergency Center. J Acquir Immune Defic Syndr. 2020;83(4):415–423. 31904699 10.1097/QAI.0000000000002279), however we’ve reworded the paragraph under statistical analysis to better clarify the difference between the two types of POCUS features.

3.2 Table 4 details the cases diagnosed with TB without microbiological confirmation - a total of 63 compared with a total of 172 microbiologically proven cases. This group would equate to 25% of patients finally treated for TB.

I assume reading the paper these 25% were not included in the final statistics as the abstract clearly states the gold standard that the variables were looked at with respect to microbiologically confirmed TB.

This is correct. Only participants with microbiologically confirmation were included in the 172 cases

This data raises a few points of interest. I note in Table 4 almost 30% of the group diagnosed without microbiological proof were considered to have TB based on formal US findings. With my PoCUS interest it would be of great interest if the authors were able to review any reasons for differences in the US findings between the expert and PoCUS findings - this may be of interest for future improving of accuracy of any PoCUS algorithm.

We did not compare PoCUS with radiology-performed ultrasounds. The 30% referred to, relate to participants without microbiological proof and it does not reflect any difference with POCUS findings. We will consider to determine the correlation between radiology-performed ultrasounds and POCUS findings as it would be of interest.

These 25% are also of potential interest when considering the results (see 4.2) .

We did not include participants with ‘clinically-diagnosed tuberculosis’ as cases. Although initiating patients on empiric anti-tuberculous treatment is an accepted method in highly prevalent areas, we felt it would muddle the results as one never truly knows if the patient had tuberculosis or another disease susceptible to anti-tuberculous treatment.

4 Discussion

4.1 This covers all the valid points/shortcomings of the study and gives clear evidenced recommendations. Although the authors comment that a weakness of the study was that it was performed under routine conditions in the emergency department, this in my view makes the research more applicable.

4.2 Table 4 shows a number of patients in whom TB was diagnosed in the absence of microbiology which is over 25% of the final cases.

The main scientific thrust of the paper has to be on confirmed cases as a scientific gold standard.

However I do wonder in the final discussion if it is worth subjecting a few of the main decision trees and some of the univariable factors in Table 6 to data analysis which includes these cases to see how they might perform in a “real world” setting. This would obviously not be the main thrust of the scientific process but would be of great interest. Therein specifically, in light of the 30% being US findings I would be especially interested to see how PoCUS performed including that cohort of those eventually treated and whether it affects the number needed to scan?

Thanks for the comment. It would be interesting to see how POCUS performed when clinical cases were included. However, we did not follow up patients to determine whether they actually improved on anti-tuberculous treatment and this will severely limit the interpretation of such results.

In regard to the performance of PoCUS, specifically 39 being needed to opt in one case – is it worth highlighting that this is however likely to increase in low prevalence and decrease in higher prevalence areas?

Thanks for the suggestion. We’ve incorporated it in the discussion section.

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    Underlying data

    Zenodo: Rapid diagnosis of HIV-associated tuberculosis in the emergency centre. https://doi.org/10.5281/zenodo.3734101 31 .

    This project contains the following underlying data:

    • HIV-TB_diagnostic_algorithm_data.csv. (Data used for diagnostic algorithm.)

    • HIV-TB_diagnostic_samples.csv. (Data of diagnostic samples taken.)

    • HIV-TB_diagnostic_algorithm_codebook.docx. (codebook for diagnostic algorithm data.)

    • HIV-TB_diagnostic_samples_codebook.docx. (codebook for diagnostic samples.)

    Extended data

    Zenodo: Case report form: Rapid diagnosis of HIV-associated tuberculosis in the emergency centre. https://doi.org/10.5281/zenodo.3738912 23 .

    Zenodo: Code: Rapid diagnosis of HIV-associated tuberculosis in the emergency centre. https://doi.org/10.5281/zenodo.3739005 30 .

    Reporting guidelines

    Zenodo: TRIPOD checklist for ‘A multi-parameter diagnostic clinical decision tree for the rapid diagnosis of tuberculosis in HIV-positive patients presenting to an emergency centre’. https://doi.org/10.5281/zenodo.3738999 38 .

    Data are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CCO 1.0 Public domain dedication).


    Articles from Wellcome Open Research are provided here courtesy of The Wellcome Trust

    RESOURCES