Abstract
Background
Tuberculosis is a major challenge to health in the developing world. Triage prior to diagnostic testing could potentially reduce the volume of tests and costs associated with using the more accurate, but costly, Xpert MTB/RIF assay. An effective methodology to predict the impact of introducing triage prior to tuberculosis diagnostic testing could be useful in helping to guide policy.
Methods
The development and use of operational modelling to project the impact on case detection and health system costs of alternative triage approaches for tuberculosis, with or without X-ray, based on data from Porto Alegre City, Brazil.
Results
Most of the triage approaches modelled without X-ray were predicted to provide no significant benefit. One approach based on an artificial neural network applied to patient and symptom characteristics was projected to increase case detection (82% vs. 75%) compared to microscopy, and reduce costs compared to Xpert without triage. In addition, use of X-ray before diagnostic testing for HIV-negative patients could maintain diagnostic yield of using Xpert without triage, and reduce costs.
Conclusion
A model for the impact assessment of alternative triage approaches has been tested. The results from using the approach demonstrate its usefulness in informing policy in a typical high burden setting for tuberculosis.
Electronic supplementary material
The online version of this article (10.1186/s12879-019-3684-1) contains supplementary material, which is available to authorized users.
Keywords: Triage, Xpert, X-ray, Model
Background
There were an estimated 1.7 million deaths and 10.4 million new cases of tuberculosis (TB) in 2016 [1]. The standard diagnostic approach for pulmonary-TB relies on sputum smear microscopy (SSM), but published research shows that SSM has limitations [2]. These include accuracy (sensitivity 20–80%) [3], the time taken to complete diagnosis and start treatment (4–20 days) [4] and the related costs [5–7].
New diagnostic algorithms to improve accuracy and early diagnosis of TB, including detection of resistance to TB drugs, are required [8]. Xpert MTB/RIF (Xpert) is a rapid, automated molecular test that can detect TB with higher sensitivity (83 to 92%) and, at the same time, resistance to rifampicin [9]. However, due to the high cost per test, implementation of Xpert in many countries is limited [5]. As an example, Porto Alegre City in Brazil is a high prevalence setting for TB with high levels of HIV-coinfection [10]. Data collected in 2011 as part of the Policy Relevant Outcomes from Validating Evidence on Impact (PROVE-IT) study in Brazil [11] showed the prevalence of TB among presumptive-TB cases at primary health care facilities was 15.8% with HIV coinfection at 44.8%. Recent research showed 4.7% of smear-positive pulmonary-TB cases were multi-drug resistant [12]. Porto Alegre is a city where implementation of Xpert could have a significant impact on reducing the TB burden. Currently all presumptive-TB cases are diagnostically tested for TB. If a nurse or clinician could identify using characteristics of the patient and their symptoms (triage) some of the individuals that do not have TB, then the number of diagnostic tests conducted could be reduced, saving cost and speeding up access to TB treatment for those where it is needed [13, 14].
Operational modelling has been used to project health system and patient impacts of introducing new diagnostic algorithms [15–17]. Such an approach could be used to evaluate the impact of triage prior to seeking a diagnosis. This study investigates the use of operational modelling to predict the impact of seven potential alternative approaches to triage (including no triage – base case), with or without X-ray and in combination with the Xpert diagnostic test. The projected outcomes were compared to a base case of sputum smear microscopy without triage or X-ray prior to diagnostic testing.
Methods
Operational model
For this study an operational model was chosen as it could be designed to fully represent the current and potential future patient pathways for diagnosis in Porto Alegre using a visual and interactive model that could engage decision makers. The activities of triage, sputum collection, diagnosis, clinical assessment and treatment initiation were modelled. Waiting areas for patients along with the human resources required for each activity were represented in the model. A snap shot of the screen layout for the developed model is shown in Fig. 1 including a description of the patient pathways. The model was developed using the discrete event simulation (DES) package – WITNESS® [18]. There are five key elements that need to be defined within any WITNESS® DES model. The first of these are ‘entities’ representing either people or objects moving around a process. These entities have ‘attributes’ which can be used to represent either static or changing features of the entity (e.g. quantity, TB status, patient unique identifier, and time in a particular process). Entities travel through ‘activities’ (representing processes where time and resources are involved) and ‘queues’ (representing waiting areas before activities). Activities can be associated with ‘resources’ such as staff. More detail on the structure of the model is in the online appendix. The dynamic and visual representation of the process facilitated validation and calibration of the model.
Data from January to December 2012 were collated for Porto Alegre City in Brazil, sourced in part from the PROVE-IT study [11] (Table 1) to populate and calibrate the model.
Table 1.
Parameter | Value (95% CI) | Source |
---|---|---|
Mean number of presumptive TB cases per day | 44 (34,55) | Data collated from primary health care facilities in Porto Alegre for the PROVE-IT trial [11] |
TB prevalence amongst presumptive-TB cases | 15.8% (14.6, 17.0%) | |
HIV prevalence in TB cases | 44.8% (40.4, 49.2%) | |
HIV prevalence in no TB cases | 27.3% (25.8, 28.8%) | |
Sensitivity - Smear microscopy for HIV-positive | 45% (38, 52%) | Boehme et al [35] |
Specificity - Smear microscopy for HIV-positive | 100% (99, 100%) | |
Sensitivity - Smear microscopy for HIV-negative | 72% (69, 75%) | |
Specificity - Smear microscopy for HIV-negative | 99% (99, 100%) | |
Sensitivity - Xpert for HIV-positive | 82% (77, 87%) | |
Specificity - Xpert for HIV-positive | 99% (98, 100%) | |
Sensitivity - Xpert for HIV-negative | 92% (90, 94%) | |
Specificity - Xpert for HIV-negative | 99% (98, 99%) | |
Sensitivity - Clinical judgement for HIV-positive | 49% | Estimated from reported TB case volumes in Porto Alegre and assumed sensitivity/specificity of Smear microscopy |
Specificity - Clinical judgement for HIV-positive | 90% | |
Sensitivity - Clinical judgement for HIV-negative | 77% | |
Specificity - Clinical judgement for HIV-negative | 90% | |
Sensitivity of X-ray for abnormalities suggestive of active TB | 87% (79, 95%) | WHO [26] |
Specificity of X-ray for abnormalities suggestive of active TB | 89% (87, 92%) | |
Estimated unit cost per test – Microscopy | US$7.20 | Estimates provided by TB research staff working with the TB program in Porto Alegre |
Estimated unit cost per test – Xpert | US$ 17.80 | |
Estimated unit cost per test – X-ray | US$ 6.00 | |
Estimated % of presumptive-TB cases LTFU | 10.0% | |
Estimated cost to treat TB case in Brazil | US$840 | Laurence et al [36] |
Estimated cost to treat MDR-TB in Brazil | US$6313 |
Triage tests
Seven potential triage approaches for TB diagnosis were identified using literature review and expert interviews. These triage approaches were selected on the basis that they made use of information that would be readily available prior to performing a diagnostic test. For example, personal data such as age, HIV-status, and tobacco usage, and clinical symptoms such as cough, fever, chest pain, weight loss, haemoptysis and other respiratory symptoms [19, 20]. In addition, approaches that could combine this information to generate a predictive algorithm for active TB were considered [21]. Algorithms such as a clinical score [22] developed using regression models or an artificial neural network (ANN) [23, 24] were identified. For these approaches, some computation would be necessary by the diagnosing health professional using a scorecard where points are allocated to individual or combinations of characteristics. Six potential alternative triage approaches with estimated sensitivity and specificity for active pulmonary-TB were identified (Table 2). For comparison purposes these included the theoretical target product profiles (TPP) for a triage test proposed by Denkinger et al. [25].
Table 2.
Triage label | Description of triage approach | Sensitivity | Specificity | Additional cost per testb |
---|---|---|---|---|
T1- Base case | No triage | |||
T2- Cough 1 week | Respiratory symptom of cough > 1 week [18] | 88% | 19% | US$0 |
T3 Cough 3 weeks | Respiratory symptom of cough > 3 weeks [18] | 61% | 51% | US$0 |
T4- Clinical Score | Scorecard based on aggregating scores assigned to respiratory symptoms including chest pain, cough, sputum expectoration, hemoptysis, night sweats, fever, shortness of breath and weight loss [18]. | 83% | 52% | US$2 |
T5- ANN | Artificial Neural Network (ANN) based on using a multilayer perceptron (MLP) approach [19] to infer the probability of a patient having active pulmonary-TB from personal data and clinical symptoms i.e. age, gender, cough, fever, weight loss, smoker, night sweats, hospitalisation, chest pain, dyspnea, and hemoptysis. | 98%a | 32%a | US$2 |
T6- TPP (optimal) | A theoretical optimal target product profile (TPP) as proposed by Denkinger et al. [21] | 95% | 80% | US$2 |
T7- TPP (minimal) | A theoretical target product profile (TPP) with the minimum characteristics required to be useful as proposed by Denkinger et al. [21] | 90% | 70% | US$2 |
athe sensitivity and specificity figures are taken from unpublished research in Brazil
bThe additional cost per triage test is assumed to be low as the characteristics are those which clinicians will already consider today. An additional allowance (US$2) has been made if some computation is required in line with the costs proposed by Denkinger et al [20] for the TPP’s
Additional data used in the model is detailed in the online appendix.
Chest X-ray is also an approach commonly used by programmes for triage. Therefore, we also considered X-ray in combination with other triage algorithms as a tool to ensure all patients with X-rays suggestive of TB would receive a diagnostic test [26, 27]. We modelled an X-ray algorithm as a potential add-on to triage for HIV-negative (or unknown status) presumptive-TB cases with any abnormality suggestive of active TB. In these scenarios, it was assumed all HIV-positive presumptive-TB cases would go for laboratory testing due to the difficulty of detecting TB using X-ray in HIV patients (Fig. 2).
Diagnostic algorithms
In Porto Alegre two alternative diagnostic algorithms were considered for testing of presumptive TB cases. Presumptive-TB cases were defined as patients who present with symptoms or signs suggestive of TB at primary health care facilities in Porto Alegre City [28]. The first diagnostic algorithm available was sputum smear microscopy based on two samples collected on different days followed by a clinical assessment for smear negative cases. The second diagnostic algorithm was based on a single sputum sample tested using Xpert MTB/RIF followed by clinical assessment for Xpert negative cases. Both these algorithms were modelled.
Model outputs
The model projected the impact of introducing each alternative triage approach prior to the diagnostic test. Note the context here is triage of patients seeking a TB diagnosis rather than active case finding. The impacts on patients sent for diagnosis, TB cases identified, false positive diagnoses, time to diagnosis and resource usage were projected using the model. The case detection rate (defined as the number of patients with active TB disease that are diagnosed (bacteriologically confirmed or clinically diagnosed) and start treatment, divided by the number of presumptive TB cases with active TB disease). 95% confidence limits were calculated for the key outputs. Sensitivity analysis to the prevalence of TB in presumptive-TB cases was conducted.
Costing
A unit cost to the health system was estimated for each test including triage, X-ray and diagnostic tests (Tables 1 and 2). The unit costs included staff time, consumables, cartridges, slides, running costs and equipment depreciation. They did not include fixed overhead costs (e.g. space) as these were assumed unchanged between tests. The additional cost per triage test was assumed to be low as the characteristics are those which clinicians will already consider. The X-ray and diagnostic costs were taken from the Prove-IT study in Brazil [11] which used an activity-based approach to take into account cost drivers relating to physical infrastructure, human resources, supplies (chemicals, reagents and consumables), and transport. The ratio of the increase in health system costs divided by the benefits in number of true TB cases starting treatment was also assessed as a measure to compare alternative triage approaches.
Results
Summary projections for the impact of introducing Xpert in Porto Alegre, with or without triage, for each of the modelled scenarios are shown in Tables 3 (without X-ray) and 4 (with X-ray).
Table 3.
Diagnostic & triage options | Presumptive TB cases receiving diagnostic test per yr. | True TB cases b starting treatment per year and case detection % c | False TB cases d starting TB treatment per year | Time between starting triage and receiving diagnosis (days) | Additional true TB cases starting treatment over base case per year a | Additional cost compared to base case per year a (US$ 000 s) | Cost per additional true TB patient diagnosed and treated n(US$) a |
---|---|---|---|---|---|---|---|
Microscopy No Triage (base case) | 10,281 | 1238 75% | 543 | 6.0 | 0 | 0 | 0 |
Xpert No Triage | 10,284 | 1375 83% | 419 | 5.0 | 137 (57, 217) | 581 (555, 607) | 4242 (1372, 7111) |
Xpert T2 Cough 1wk | 8411 | 1197 72% | 340 | 4.0 | −41 (−118, 36) | 233 (223, 244) | No benefit over base |
Xpert T3 Cough>3wks | 5183 | 878 53% | 193 | 2.4 | −360 (− 439, −281) | − 393 (− 410, − 375) | No benefit over base |
Xpert T4 Clinical score | 5470 | 1148 70% | 191 | 2.5 | −90 (−166, −14) | −51 (−53, −49) | No benefit over base |
Xpert T5 ANN | 7469 | 1369 82% | 285 | 3.5 | 131 (39, 223) | 367 (351, 384) | 2805 (907, 4703) |
Xpert T6 TPP optimal | 3290 | 1320 80% | 75 | 1.5 | 82 (2, 162) | −49 (−52, −47) | − 604 (−1012, − 195) |
Xpert T7 TPP minimal | 4046 | 1245 76% | 121 | 1.8 | 7 (−74, 88) | −54 (−56, −52) | Minimal benefit over base case |
aNumbers in brackets represent 95% confidence limits
bTrue TB cases include both bacteriologically confirmed and clinically diagnosed cases that have TB
cCase detection rate calculated as the number of true TB cases identified through the complete triage and diagnostic algorithm, divided by the number of TB cases in the presumptive-TB case population calculated from the assumed TB prevalence (Table 2)
dFalse TB cases are individuals diagnosed with TB and placed on TB treatment, but do not have TB (false positives)
Without X-ray – Table 3
For the base case of microscopy without triage, the projected volume of individuals starting TB treatment was 1238 cases per year (75% case detection rate). This included bacteriologically confirmed and clinically diagnosed cases and involved 10,281 patients being tested. The mean time from the patient arriving at the health facility to completing diagnosis was projected to be 6.0 days.
Implementation of Xpert without triage was projected to have a significant impact over the base case. Case detection rate rising to 83% with a projected increase in the number of people with TB starting treatment of 137 (95% CI. 57, 217) per year and an increase in the annual diagnostic cost of US$581 thousand (95% CI. 555, 607). The mean cost per additional TB case treated was projected to be US$4242 (95% CI. 1371, 7111). The mean time to complete diagnosis was reduced by 1.0 day (5 days compared to 6 days).
Implementation of Xpert alongside a triage test of excluding all cases with a cough of less than one week (T2) gave a projected case detection rate of 72% with a reduction in the annual number of patients with TB starting treatment of − 41 (95% CI. -118, 36) compared to the base case. Therefore, there would be no benefit of this option over the current standard diagnostic approach of microscopy. The same was true for implementation of Xpert alongside a triage test of excluding all cases with a cough less than three weeks (T3) – case detection rate dropping to 53%.
Implementation of Xpert together with a triage test using a clinical score (T4) had a projected reduction in case detection rate to 70% with the annual number of people with TB starting treatment falling by − 90 (95% CI. -166, − 14), so despite the lower cost compared to Xpert without triage, this was not considered a useful intervention.
Using the predicted sensitivity and specificity of the ANN (T5) as the triage test along with Xpert as the diagnostic test showed a significant increase in the projected case detection rate to 82% with an increase in the annual number of TB patients starting treatment of 131 (95% CI. 39, 223). Projected additional health system costs compared to the base case were US$367 thousand (95% CI. 351, 384) compared to US$581 thousand (95% CI. 555, 607) for Xpert without triage. This option therefore both increases case detection compared to the base case and would cost less than roll-out of Xpert without triage.
Using a triage test with the performance of the theoretical optimal TPP (T6) with Xpert was projected to have a positive impact on case detection (80%), cost and time to complete diagnosis. The projected impact on the annual number of people with TB starting treatment was an increase of 82 (95% CI. 2, 162) with a significantly reduced annual health system costs to both microscopy -US$49 thousand (95% CI. -52, − 47) and Xpert without triage.
Implementation of Xpert alongside a triage test with the minimal TPP characteristics (T7) was projected to have no significant impact on case detection rate (76%) or the annual number of TB patients starting treatment compared to microscopy.
Figure 3a illustrates the projections from the model of each scenario with a positive impact on the number starting treatment compared to the base case. T6 (Optimal TPP) and T5 (ANN) are the most effective options with reduced cost compared to Xpert without triage.
With X-ray – Table 4
Table 4.
Diagnostic & triage options | Presumptive TB cases receiving diagnostic test per yr. | True TB cases b starting treatment per year and case detection c % | False TB cases d starting TB treatment per year | Time between starting triage and receiving diagnosis (days) | Additional true TB cases starting treatment over base case per year a | Additional cost compared to base case per year a (US$ 000 s) | Cost per additional true TB patient diagnosed and treated (US$) a |
---|---|---|---|---|---|---|---|
Microscopy No Triage (base case) | 10,281 | 1238 75% | 543 | 6.0 | 0 | 0 | 0 |
Xpert No Triage | 10,284 | 1375 83% | 419 | 5.0 | 137 (57, 217) | 581 (555, 607) | 4242 (1372, 7111) |
Xpert T2 Cough 1wk | 9204 | 1370 83% | 401 | 4.4 | 132 (54, 210) | 536 (512, 559) | 4057 (1313, 6802) |
Xpert T3 Cough>3wks | 7340 | 1290 80% | 289 | 3.5 | 52 (−15, 119) | 278 (266, 290) | 5345 (1729, 8960) |
Xpert T4 Clinical score | 7365 | 1353 82% | 296 | 3.5 | 114 (38, 190) | 380 (363, 397) | 3331 (1078, 5584) |
Xpert T5 ANN | 8477 | 1352 82% | 341 | 4.0 | 114 (43, 187) | 451 (431, 470) | 3952 (1278, 6625) |
Xpert T6 TPP optimal | 5823 | 1354 82% | 218 | 2.8 | 116 (45, 187) | 172 (164, 179) | 1481 (479, 2483) |
Xpert T7 TPP minimal | 6367 | 1366 83% | 231 | 3.1 | 128 (56, 200) | 301 (287, 314) | 2349 (760, 3938) |
aNumbers in brackets represent 95% confidence limits
bTB cases include both bacteriologically confirmed and clinically diagnosed cases that have TB
cCase detection rate was calculated as the number of true TB cases identified through the complete triage and diagnostic algorithm, divided by the number of TB cases in the presumptive-TB case population calculated from the assumed TB prevalence (Table 2)
dFalse TB cases are individuals diagnosed with TB and placed on TB treatment, but do not have TB (false positives)
These results are based on the same scenarios as those detailed above, but with X-ray also used as an additional triage tool for HIV-negative (or HIV status unknown) presumptive-TB cases. For HIV-positive patients these options assume all presumptive-TB cases would receive a TB diagnostic test.
Implementation of all the triage approaches with X-ray alongside Xpert as the diagnostic tool would have a significant positive impact on case detection rates compared to the base case (sputum smear microscopy without triage) i.e. 80–83% compared to 75%. As shown in Table 4 and Fig. 3b the projected increase in the annual number of TB patients starting treatment for most of the triage approaches matches the increase projected with no triage when Xpert is the diagnostic tool. The exception is T3 (cough for greater than three weeks) when the increase is smaller. Comparing the results in Table 3 (without X-ray) with the results in Table 4 (with X-ray) shows annual costs increase due to X-ray, an increase in the number of diagnostic tests, and additional treatment costs. However, the projected costs are still below Xpert without triage in all cases. In particular, T4 (clinical score), T5 (ANN), T6 (TPP- optimal) and T7 (TPP-minimal).
Sensitivity analysis
Variation in the outcomes to the sensitivity and specificity parameters of the triage tests can be seen from the range of different triage tests modelled (i.e. sensitivities ranging from 61 to 98% and specificities from 19 to 80%). Additional sensitivity analyses to input parameters such as TB prevalence and costs of tests were also performed. The results of all the sensitivity analyses are shown in the online appendix. The ranking of options by effectiveness was unchanged by varying these parameters.
Discussion
Operational modelling can provide valuable predictions of the impact on case detection, health system costs and time to complete diagnosis of alternative triage approaches for TB diagnosis as shown by this study using data from Porto Alegre City, Brazil. The approach can bring together routine and trial data from the current program along with data from published and ongoing research to model current and potential future patient pathways which are critical to understanding patient and health system impacts in relation to cost and time, as well as yield.
The WHO strongly recommends Xpert should be used as the initial diagnostic test in individuals suspected of having TB-HIV coinfection [29]. In Porto Alegre, Brazil, where TB and HIV prevalence are high, the rollout of the Xpert test could have a large effect. However, Xpert is frequently only used as an add-on test to microscopy rather than for initial diagnosis due to its high cost per test. Our study confirms implementation of Xpert would provide a significant benefit over microscopy in terms of the number of patients with TB starting treatment in Porto Alegre City, with case detection rates estimated to increase from 75 to 83%. Introducing a triage approach prior to the Xpert test could reduce costs but would also reduce the number of TB patients starting treatment as some patients that fail the triage test would have TB and would have been identified by the diagnostic test if they had been tested. For example, a triage test based on cough for greater than 3 weeks could reduce the number of diagnostic tests by almost half, but would see many TB cases not being sent for diagnosis leading to case detection falling to 53%. Most of the triage approaches modelled when combined with Xpert did not provide any significant benefit over microscopy as the diagnostic test. However, one triage approach (T5- ANN) was found to significantly increase TB case detection (82% vs. 75%) compared to microscopy and reduce costs compared to Xpert without triage. This approach combines patient and symptom data in a score. This is an encouraging result, but before an ANN approach could be implemented further work is required to develop the appropriate data collection and computation procedures in the diagnostic centre.
The model shows that X-ray combined with a triage approach prior to Xpert diagnostic testing could deliver almost the same case detection rate as would be achieved when no triage is used (i.e. 82–83%). This could be achieved at reduced costs compared to using Xpert for all presumptive-TB cases (i.e. no triage). For example, X-ray combined with the ANN is projected to reduce costs of the roll-out of Xpert to the TB programme by around US$130,000 per year in Porto Alegre city. This would require access to X-ray at diagnostic facilities, which may not be possible in some locations and would require further investigation.
A triage test with the optimal TPP characteristics [25] would also be highly effective but is not available currently. The minimal TPP proposed was not effective as the number of TB patients starting treatment would not be increased.
An additional observation from the modelled diagnostic and triage options is the effect on reducing false positive diagnoses (i.e. the number of individuals placed on TB treatment who do not have TB disease). This is an important observation as the consequences of false diagnosis for TB can be serious for the individual and the TB programme [30]. As expected the use of Xpert as a diagnostic tool compared to microscopy can reduce the rate of false diagnosis particularly when fewer individuals are clinically diagnosed. Our results also indicate the use of triage can lead to reduced false positive diagnosis (Tables 3 and 4), especially if the specificity of the triage test is high (e.g. in triage tests T3, T4, T6 and T7).
Our study was limited by the availability of some data. Assumptions were necessary from the literature and interviews with experts, for example in relation to sensitivity of clinical diagnosis and the new triage approaches as well as associated costs. In addition, it was assumed that the sensitivity and specificity of each of the tests (i.e. triage, X-ray, sputum smear microscopy, Xpert and clinical judgement) were conditionally independent. In particular, this may not be an accurate assumption for triage and clinical judgement as similar criteria may be used by the nurses and clinicians at triage and following a negative diagnostic test. However, this would not be expected to affect the levels of true TB identified through the diagnostic tests. Further analysis of the correlations between tests would be valuable research. We have not tested the approach in low-HIV or high MDR-TB settings, so further research is required here. The modelling methods used in this study could also be used to assess impacts on patient costs [31] and assessing the impact of different strategies for active case finding. Active case finding is likely to be essential if the TB epidemic is to be controlled and is therefore receiving increased focus from the WHO [32] and others [33, 34].
Conclusions
In conclusion, we have demonstrated that operational modelling as used for this study can provide insights into the impact of alternative triage approaches. In the context of Porto Alegre City, we have shown the introduction of a triage approach alongside Xpert could reduce the TB diagnostic costs of Xpert implementation whilst still significantly increasing the number of patients starting treatment compared to microscopy. Our study indicates that among the optional triage approaches modelled - T5 (ANN) has the greatest potential to improve outcomes whilst controlling costs to the health system. The optimal TPP [25] for TB triage is a theoretical set of performance characteristics for which no triage tools currently exist, but should it become available would be beneficial. Furthermore, adding X-ray as a triage tool for HIV-negative cases (and unknown status) alongside appropriate triage approaches could substantially save costs over Xpert without triage, whilst identifying almost as many cases.
Additional file
Acknowledgements
We thank Daniele Maria Pelissari and Patricia Bartolomay for their involvement and supply of data to support this study and the PROVE-IT study in Porto Alegre, Brazil.
Funding
This research was completed as part of a Masters in Tropical Infectious diseases at the Liverpool School of Tropical Medicine that was self-funded.This document has been produced thanks to a grant from USAID. The contents of this document are the sole responsibilities of the authors and can under no circumstances be regarded as reflecting the positions of the International Union Against Tuberculosis and Lung Disease (The Union North America) nor those of its Donors.
Availability of data and materials
All data generated or analysed during this study are included in this published article and its Additional file 1.
Abbreviations
- AFB
Acid-fast bacilli
- ANN
Artificial Neural Network
- ART
Adaptive Resonance Theory
- CI
Confidence Interval
- CJ
Clinical Judgment
- DST
Drug susceptibility testing
- Dx
Diagnostic tested
- FIND
The Foundation for Innovative New Diagnostics
- HIV
Human immune deficiency virus
- ICER
Incremental Cost Effectiveness Ratio
- INH
Isoniazid
- LED
Light-emitting diodes
- LSTM
Liverpool School of Tropical Medicine
- LTFU
Lost to follow up
- MDR-TB
Multi drug resistance tuberculosis
- MTB
Mycobacterium tuberculosis
- NAAT
Nucleic Acid Amplification Test
- PROVE-IT
Policy Relevant Outcomes from Validating Evidence on ImpacT
- RIF
Rifampicin
- Rx
Initiation of Tuberculosis treatment
- TB
Tuberculosis
- TPP
Target Product Profile
- US$
United State dollars
- WHO
World Health Organization
- XDR-TB
Extensive drug resistance tuberculosis
- ZN
Ziehl-Neelsen
Authors’ contributions
IL, AR and RG designed the study. AK and RG collated much of the data for the study. AR and IL conducted the modelling and data analysis. AR wrote the first draft of the manuscript with IL, ET, BS, AK and RG reviewing and amending the initial draft. All authors read and approved the final version of the manuscript.
Ethics approval and consent to participate
This is a retrospective study and no identifiable human subjects were involved in the research, therefore ethical approval was not sought and informed consent was not applicable.
Consent for publication
Not applicable
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Abu A. M. Shazzadur Rahman, Email: dr.aam_rahman@yahoo.co.uk
Ivor Langley, Email: ivor.langley@lstmed.ac.uk.
Rafael Galliez, Email: galliez77@gmail.com.
Afrânio Kritski, Email: kritskia@gmail.com.
Ewan Tomeny, Email: ewan.tomeny@lstmed.ac.uk.
S. Bertel Squire, Email: bertie.squire@lstmed.ac.uk.
References
- 1.World Health Organization, Global Tuberculosis Report 2017. http://apps.who.int/iris/bitstream/10665/259366/1/9789241565516-eng.pdf?ua=1. Accessed 16 Mar 2017.
- 2.Langley I, Squire SB, Dacombe R, Madan J, Lapa e Silva JR, Barreira D, Galliez R, Oliveira MM, Fujiwara PI, Kritski A. Developments in impact assessment of new diagnostic algorithms for tuberculosis control. Clin Infect Dis. 2015;61(Suppl 3):S126–34. 10.1093/cid/civ580. [DOI] [PubMed]
- 3.Steingart KR, Henry M, Ng V, Hopewell PC, Ramsay A, Cunningham J, Urbanczik R, Perkins M, Aziz MA, Pai M. Fluorescence versus conventional sputum smear microscopy for tuberculosis: a systematic review. Lancet Infect Dis. 2006;6(9):570–81. Review. Erratum in: Lancet Infect Dis 2006 Oct;6(10):628. [DOI] [PubMed]
- 4.Durovni B, Saraceni V, van den Hof S, Trajman A, Cordeiro-Santos M, Cavalcante S, Menezes A, Cobelens F. Impact of replacing smear microscopy with Xpert MTB/RIF for diagnosing tuberculosis in Brazil: a stepped-wedge cluster-randomized trial. PLoS Med. 2014;11(12):e1001766. doi: 10.1371/journal.pmed.1001766. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Albert H, Nathavitharana RR, Isaacs C, Pai M, Denkinger CM, Boehme CC. Development, roll-out and impact of XpertcMTB/RIF for tuberculosis: what lessons have we learnt and how can we do better? Eur Respir J 2016 Jul 13. pii: ERJ-00543-2016. 10.1183/13993003.00543-2016. [DOI] [PMC free article] [PubMed]
- 6.Kemp JR, Mann G, Simwaka BN, Salaniponi FM, Squire SB. Can Malawi's poor afford free tuberculosis services? Patient and household costs associated with a tuberculosis diagnosis in Lilongwe. Bull World Health Organ. 2007;85(8):580–585. doi: 10.2471/BLT.06.033167. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Madan J, Lönnroth K, Laokri S, Squire SB. What can dissaving tell us about catastrophic costs? Linear and logistic regression analysis of the relationship between patient costs and financial coping strategies adopted by tuberculosis patients in Bangladesh, Tanzania and Bangalore, India. BMC Health Serv Res. 2015;15:476. doi: 10.1186/s12913-015-1138-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Pai M, Schito M. Tuberculosis diagnostics in 2015: landscape, priorities, needs, and prospects. J Infect Dis 2015;211 Suppl 2:S21–S28. 10.1093/infdis/jiu803. Review. [DOI] [PMC free article] [PubMed]
- 9.Steingart KR, Sohn H, Schiller I, Kloda LA, Boehme CC, Pai M, Dendukuri N. Xpert® MTB/RIF assay for pulmonary tuberculosis and rifampicin resistance in adults. Cochrane Database Syst Rev. 2013;(1):CD009593 10.1002/14651858.CD009593.pub2. Review. Update in: Cochrane database Syst rev. 2014;(1):CD009593.
- 10.Moreira ASR, Huf G, Vieira MAM, da Costa P, Aguiar F, Marsico A, Fonseca LS, Ricks M, Oliveira MM, Detjen A, Fujiwara PI, Squire SB, Kritski AL. Liquid vs solid culture medium to evaluate proportion and time to change in management of suspects of tuberculosis – a pragmatic randomized trial in secondary and tertiary health care units in Brazil. PLoS One. 2015;10(6):e0127588. doi: 10.1371/journal.pone.0127588. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Ramalho DMP, Miranda PFC, Andrade MK, Brígido T, Dalcolmo MP, Mesquita E, Dias CF, Gambirasio AN, Ueleres Braga L, Detjen A, Phillips PPJ, Langley I, Fujiwara PI, Squire SB, Oliveira MM, Kritski AL. Outcomes from patients with presumed drug resistant tuberculosis in five reference centers in Brazil. BMC Infectious Diseases 2017;17:571. 10.1186/s12879-017-2669-1. [DOI] [PMC free article] [PubMed]
- 12.Micheletti VCD, Kritski AL, Clinical Features BJE. Treatment outcomes of patients with drug-resistant and drug-sensitive tuberculosis: a historical cohort study in Porto Alegre. Brazil Plos One. 2016;11(8):e0160109. doi: 10.1371/journal.pone.0160109.eCollection2016.. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.van't Hoog AH, Cobelens F, Vassall A, van Kampen S, Dorman SE, Alland D, Ellner J. Optimal triage test characteristics to improve the cost-effectiveness of the Xpert MTB/RIF assay for TB diagnosis: a decision analysis. PLoS One. 2013;8(12):e82786. doi: 10.1371/journal.pone.0082786. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Dunbar R, Naidoo P, Beyers N, Langley I. High laboratory cost predicted per tuberculosis case diagnosed with increased case finding without a triage strategy. Int J Tuberc Lung Dis. 2017;21(9):1026–1034. doi: 10.5588/ijtld.17.0156. [DOI] [PubMed] [Google Scholar]
- 15.Dowdy DW, Houben R, Cohen T, Pai M, Cobelens F, Vassall A, Menzies NA, Gomez GB, Langley I, Squire SB, White R. TB MAC meeting participants. Impact and cost-effectiveness of current and future tuberculosis diagnostics: the contribution of modelling. Int J Tuberc Lung Dis. 2014;18(9):1012–1018. doi: 10.5588/ijtld.13.0851.. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Tesfaye A, Fiseha D, Assefa D, Klinkenberg E, Balanco S, Langley I. Modeling the patient and health system impacts of alternative xpert® MTB/RIF algorithms for the diagnosis of pulmonary tuberculosis in Addis Ababa, Ethiopia. BMC Infect Dis. 2017;17(1):318. doi: 10.1186/s12879-017-2417-6.. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Langley I, Lin HH, Egwaga S, Doulla B, Ku CC, Murray M, Cohen T, Squire SB. Assessment of the patient, health system, and population effects of Xpert MTB/RIF and alternative diagnostics for tuberculosis in Tanzania: an integrated modelling approach. Lancet Glob Health. 2014;2(10):e581–91. 10.1016/S2214-109X(14)70291-8 Erratum in: Lancet Glob Health. 2014 Dec;2(12):e697. [DOI] [PubMed]
- 18.Lanner Group, WITNESS Simulation Modelling, https://www.lanner.com/en-gb/technology/witness-simulation-software.html. Accessed 16 Jan 2019.
- 19.Castro CB, Costa PA, Ruffino-Netto A, Maciel EL, Kritski AL. Assessment of a clinical score for screening suspected pulmonary tuberculosis cases. Rev Saude Publica. 2011;45(6):1110–1116. doi: 10.1590/S0034-89102011005000071. [DOI] [PubMed] [Google Scholar]
- 20.Kranzer K, Afnan-Holmes H, Tomlin K, Golub JE, Shapiro AE, Schaap A, Corbett EL, Lönnroth K, Glynn JR. The benefits to communities and individuals of screening for active tuberculosis disease: a systematic review. Int J Tuberc Lung Dis. 2013;17(4):432–446. doi: 10.5588/ijtld.12.0743.. [DOI] [PubMed] [Google Scholar]
- 21.Nguyen DT, Nguyen HQ, Beasley RP, Ford CE, Hwang LY, Graviss EA. Performance of Clinical Algorithms for Smear-Negative Tuberculosis in HIV-Infected Persons in Ho Chi Minh City, Vietnam. Tuberc Res Treat. 2012, Article ID 360852, 6 pages. 10.1155/2012/360852. [DOI] [PMC free article] [PubMed]
- 22.Aguiar FS, Torres RC, Pinto JV, Kritski AL, Seixas JM, Mello FC. Development of two artificial neural network models to support the diagnosis of pulmonary tuberculosis in hospitalized patients in Rio de Janeiro, Brazil. Med Biol Eng Comput. 2016;54(11):1751-9. Epub 2016 Mar 25. [DOI] [PubMed]
- 23.de O Souza Filho JB, de Seixas JM, Galliez R, de Bragança Pereira B, de Q Mello FC, Dos Santos AM, Kritski AL. A screening system for smear-negative pulmonary tuberculosis using artificial neural networks. Int J Infect Dis. 2016;49:33–39. doi: 10.1016/j.ijid.2016.05.019. [DOI] [PubMed] [Google Scholar]
- 24.Grossberg S. Adaptive resonance theory: how a brain learns to consciously attend, learn, and recognize a changing world. Neural Netw. 2013;37:1–47. doi: 10.1016/j.neunet.2012.09.017. [DOI] [PubMed] [Google Scholar]
- 25.Denkinger CM, Kik SV, Cirillo DM, Casenghi M, Shinnick T, Weyer K, Gilpin C, Boehme CC, Schito M, Kimerling M, Pai M. Defining the needs for next generation assays for tuberculosis. J Infect Dis. 2015;211(Suppl 2):S29–38. 10.1093/infdis/jiu821 Review. [DOI] [PMC free article] [PubMed]
- 26.World Health Organization . Systematic screening for active tuberculosis: Principles and recommendations. Geneva, Switzerland: WHO; 2013. [PubMed] [Google Scholar]
- 27.Philipsen RH, Sánchez CI, Maduskar P, Melendez J, Peters-Bax L, Peter JG, Dawson R, Theron G, Dheda K, van Ginneken B. Automated chest-radiography as a triage for Xpert testing in resource-constrained settings: a prospective study of diagnostic accuracy and costs. Sci Rep. 2015;5:12215. doi: 10.1038/srep12215. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.World Health Organization Definitions and reporting framework for tuberculosis – 2013 revision (updated December 2014). Accessed 15 Mar 2017. http://apps.who.int/iris/bitstream/10665/79199/1/9789241505345_eng.pdf
- 29.World Health Organization . Automated real-time nucleic acid amplification technology for rapid and simultaneous detection of tuberculosis and rifampicin resistance: Xpert MTB/RIF assay for the diagnosis of pulmonary and extra pulmonary TB in adults and children. Policy update. Geneva: WHO; 2013. [PubMed] [Google Scholar]
- 30.Houben RMGJ, Lalli M, Kranzer K, Menzies NA, Schumacher SG, Dowdy DW. What if they Don't have tuberculosis? The consequences and trade-offs involved in false-positive diagnoses of tuberculosis. Clin Infect Dis. 2019;68(1):150–156. doi: 10.1093/cid/ciy544. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Langley I, Lin HH, Egwaga S, Doulla B, Ku CC, Murray M, Cohen T, Squire SB. Assessment of the patient, health system, and population effects of Xpert MTB/RIF and alternative diagnostics for tuberculosis in Tanzania: an integrated modelling approach. Lancet Glob Health 2014; 2(10):e581–e591. 10.1016/S2214-109X(14)70291-8. https://www.thelancet.com/cms/10.1016/S2214-109X(14)70291-8/attachment/95e909c9-f712-4837-a799-29099e14108b/mmc1.pdf. [DOI] [PubMed]
- 32.World Health Organization. Global strategy and targets for tuberculosis prevention, care and control after 2015. 2014. Available from: http://www.who.int/tb/post2015_strategy/en. Accessed 11 Aug 2016.
- 33.Raviglione M, Sulis G. Tuberculosis 2015: burden, challenges and strategy for control and elimination. Infect Dis Rep. 2016;8(2):6570. doi: 10.4081/idr.2016.6570. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Dobler CC. Screening strategies for active tuberculosis: focus on cost-effectiveness. Clinico Economics and Outcomes Research. 2016;8:335–347. doi: 10.2147/CEOR.S92244. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Boehme CC, Nicol MP, Nabeta P, Michael JS, Gotuzzo E, Tahirli R, Gler MT, Blakemore R, Worodria W, Gray C, Huang L, Caceres T, Mehdiyev R, Raymond L, Whitelaw A, Sagadevan K, Alexander H, Albert H, Cobelens F, Cox H, Alland D, Perkins MD. Feasibility, diagnostic accuracy, and effectiveness of decentralised use of the Xpert MTB/RIF test for diagnosis of tuberculosis and multidrug resistance: a multicentre implementation study. Lancet. 2011;377(9776):1495-505. 10.1016/S0140-6736(11)60438-8. Epub 2011 Apr 18. PMID:21507477 [DOI] [PMC free article] [PubMed]
- 36.Laurence YV, Griffiths UK, Vassall A. Costs to health services and the patient of treating tuberculosis: a systematic literature review. PharmacoEconomics. 2015;33:939–955. doi: 10.1007/s40273-015-0279-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
All data generated or analysed during this study are included in this published article and its Additional file 1.