Abstract
Background
The diagnosis of tuberculosis (TB) in young children can be challenging, especially in severely malnourished children. There is a critical need for improved diagnostics for children. Thus, we sought to evaluate the performance of a technique that measures antibodies in lymphocyte supernatant (ALS) for the diagnosis of TB in severely malnourished children presenting with suspected pneumonia.
Methods
Children less than 5 years with severe acute malnutrition and radiological features of pneumonia admitted to the Dhaka Hospital of International Centre for Diarrhoeal Disease Research, Bangladesh, were enrolled consecutively following informed written consent. In addition to clinical and radiological assessment, samples taken for TB diagnosis included gastric lavage fluid and induced sputum for microbiological confirmation. ALS was measured from venous blood, and results were evaluated in children classified as “confirmed”, “non-confirmed TB” or “not TB”.
Results
Among 224 children who had ALS analysis, 12 (5.4%) children had microbiologically “confirmed TB”, a further 41 (18%) had clinically diagnosed “non-confirmed TB” and the remaining 168 (75%) were considered not to have TB. ALS was positive in 89 (40%) and negative in 85 (39%) of children, with a large number (47 or 21%) reported as “borderline”. These proportions were similar between the three diagnostic groups. The sensitivity and specificity of ALS when comparing “Confirmed TB” to “Not TB” was only 67% (95% CI: 31–91%) and 51% (95% CI: 42–60%), respectively.
Conclusions and Significance
Our data suggest that ALS is not sufficiently accurate to improve the diagnosis of TB in children with severe malnutrition.
Introduction
The 2013 global tuberculosis report of the World Health Organization (WHO), based on vital registration data, estimated that TB caused 74,000 deaths in HIV-uninfected children globally in 2012 [1]. Recent data suggest that TB in under-15 children may contribute 10–20% of the total disease burden in endemic countries [2,3]. Due to lack of reporting of TB as a cause of deaths in HIV and/or pneumonia related deaths [1,4,5], the actual burden of childhood TB is likely to be higher than these estimates. However, the main impediment to understand the actual burden is the difficulties in the confirmation of diagnosis of TB in children. Obtaining sputum samples from young children can be challenging and disease is paucibacillary, so yield from microscopy is low. Mycobacterial culture takes as long as 8–12 weeks for a result in conventionally used solid cultures, and while real-time PCR technique such as Xpert MTB/RIF assay is much quicker, sensitivity is suboptimal compared to culture [6], so a negative result does not rule out a diagnosis of TB. Undoubtedly, there is a huge need for an accurate and rapid diagnostic test for TB in children.
Our group has previously published novel data of encouraging results from evaluating a blood-based test measuring antibodies in lymphocyte supernatant (ALS) for diagnosis of TB in adults and children [7,8]. The study in children was limited to those with a clinical diagnosis of TB. Among 58 children with clinically diagnosed TB, 9 (15%) had culture-confirmed and 53 (91%) had ALS positive TB [8]. Further, the levels of ALS may be affected by reduced immune function such as occurs in children with severe malnutrition. We recently conducted a prospective study of the prevalence of TB among children with severe malnutrition and radiologic pneumonia [9]. In a subset of children from that study, we have evaluated the diagnostic performance of ALS in the diagnosis of TB in comparison with culture and Xpert MTB/RIF in addition to comparison with clinical diagnoses of childhood TB.
Materials and Methods
Ethics statement
The study was approved by the Research Review Committee (RRC) and the Ethical Review Committee (ERC) of the International Centre for Diarrhoeal Disease Research, Bangladesh (icddr,b). Institutional Review Board of icddr,b comprises of RRC and ERC. Written informed consent was obtained from parents or guardians of each of the participating children; children whose caregivers did not give consent were not enrolled.
Study design
Details of the study population, study setting and clinical management have been comprehensively described previously [9]. Briefly, consecutive young children (< 5 years) with severe malnutrition and respiratory symptoms (cough and/or respiratory distress) with radiological evidence of pneumonia were enrolled following informed consent in a prospective cohort study conducted at the Dhaka Hospital of icddr,b between April 2011 and June 2012 [9]. Detailed clinical, epidemiological and demographic data were collected in addition to gastric lavage fluid and induced sputum for microscopy for acid-fast bacilli and mycobacterial culture, as well as for real-time PCR to identify Mycobacterium tuberculosis by the Xpert MTB/RIF assay once it became available during the study. All children were classified on the basis of study definitions as having either “confirmed TB”, “non-confirmed” TB or “not TB” [9].
Severe malnutrition was defined as the presence of severe wasting [Z score for weight for height <-3 of the WHO median] or severe under-weight [Z score for weight for age <-4 of the WHO median], or nutritional edema. “Confirmed TB” was defined as the identification of M tuberculosis by culture or by Xpert MTB/RIF assay on any of the test specimens. “Non-confirmed TB” was diagnosed clinically with supportive evidence such as positive tuberculin skin test (TST) or a positive contact history or when there was no symptomatic improvement of bacterial pneumonia or severe malnutrition following therapy (without microbiological confirmation of TB). “Not TB” included all other children who were enrolled in the study and had completed the assessments (i.e. sputum sample collected and TST performed and interpreted) but did not fulfill the criteria of either “Confirmed TB” or “Non-confirmed TB”.
In a sub-set of children from that study, we sampled blood for measurement of ALS. Laboratory procedure for ALS has been described earlier. [8]. Briefly, the ALS assay measures spontaneous release of TB-antigen-specific IgG antibodies from in vivo-activated plasmablasts using ex vivo cultures of unstimulated peripheral blood mononuclear cells (PBMC) followed by an ELISA [8,10]. In brief, PBMC were isolated from 2.5 to 3 ml of blood by using Ficol-Paque density gradient centrifugation (GE Healthcare Bio Science AB, Uppsala, Sweden) and cultured in (5x106 cells/ml in 48-well plates; Thermo Fischer Scientific, NUNC, Roskilde, Denmark) in RPMI medium (Gibco, Life technologies, Green Island, NY) for 48 h. Release of IgG antibodies in the culture supernatant was measured using BCG-specific ELISA. The BCG vaccine was obtained from Japan BCG Laboratories, Tokyo, Japan. The ALS response is expressed as relative BCG-specific IgG titers or optical density (OD); ALS results were reported as “positive” if antibody titer was ≥ 0.60, “negative” if antibody titer was < 0.38, or “borderline” if antibody titer was ranged from 0.38 to 0.59. In addition we assessed the performance of ALS at different cut-offs as follows: OD ≥ 0.42 as “positive” and OD < 0.42 as “negative”; and OD ≥ 0.35 as “positive” and OD < 0.35 as “negative”.
Analysis
All data were entered onto a computer using SPSS for Windows (version 17.0; SPSS Inc, Chicago) and Epi-Info (version 6.0, USD, Stone Mountain, GA). We determined the proportion of children that had positive, negative or borderline ALS results within each of the TB categories. The differences in proportions were compared by the Chi-square test. The differences in normally distributed continuous data were compared by Student’s t-test and Mann-Whitney test was used for comparison of data that were not normally distributed. A probability of less than 0.05 was considered statistically significant. The strength of association was determined by calculating odds ratio (OR) and their 95% confidence intervals (CIs). We calculated the sensitivity, specificity, positive and negative predictive values of ALS at different cut-offs for the diagnosis of TB in severely malnourished children by comparing results between those with “Confirmed TB” and those classified as “Not TB”, and by comparing all TB cases (“Confirmed TB” plus “Non-confirmed TB”) to “Not TB”.
Results
Among the 405 children enrolled during the study period [8], ALS from a blood sample was measured in the first 224 children. Of these, 221 children had gastric lavage fluid and induced sputum obtained for microscopy and mycobacterial culture, and 51 of these children also had gastric lavage fluid and induced sputum analyzed by Xpert MTB/RIF. Only one sample of gastric lavage fluid and induced sputum was taken from each study patient and microscopy, mycobacterial culture, and Xpert MTB/RIF were done both from the gastric lavage fluid and induced sputum of each patient. The median (IQR) age of the study children was 10 (5, 16) months and age range was 1 to 59 months. Of the 221 study children, there were 12 (5.4%) children with microbiologically confirmed TB—8 by culture and 5 by X-pert MTB/RIF (1 positive in both tests)—and there were 41 (19%) with clinical, non-confirmed TB and 168 that were considered not to have TB.
Overall, ALS was positive in 89/221(40%), negative in 85/221 (39%), and borderline in 47/221 (21%) children, and the proportion that were positive, negative or borderline are listed in Table 1. The proportion of positive ALS was found to have no significant difference among study children who had “Confirmed TB”, “Non-confirmed TB”, and “Not TB” (Chi-Square for linear trend for positive ALS from “Confirmed TB” to “Non-confirmed TB” to “Not TB” = 1.098, p = 0.295). The clinical characteristics of the severely malnourished children with pneumonia are compared between those with and without a positive ALS in Table 2. The characteristics of the group of children with a positive ALS result were similar to those of the group of children with a negative ALS result, although the former were significantly older on average, and a significantly greater proportion was BCG-vaccinated. The sensitivity, specificity, positive predictive value, negative predictive value and accuracy of ALS at different cut-offs for “confirmed TB” versus “not TB”; and for “all TB” versus “not TB” are shown in Table 3. Although, the sensitivity of ALS with the lower cut-offs was increased from 67% to 75% for “confirmed TB” versus “not TB” and from 57% to 66% for “all TB” versus “not TB”, however, the specificity and accuracy of ALS with the lower cut-offs gradually decreased from 51% to 39% and 52% to 41% for “confirmed TB” versus “not TB” and 51% to 39% and 52% to 45% for “all TB” versus “not TB—respectively. Baseline characteristics of severely malnourished children according to diagnostic groups (confirmed TB”, “Non-confirmed TB”, and “Not TB”) are shown in Table 4.
Table 1. Summary results of ALS in blood (using an optical density ≥ 0.60 as a positive cut-off and < 0.38 as a negative cut-off), confirmed TB, non-confirmed TB, and not TB in children under five with suspected pneumonia and severe malnutrition.
Parameters | Number of patients | ALS positive | ALS borderline | ALS negative |
---|---|---|---|---|
Confirmed TB | 12 | 6 (50%) | 3 (25%) | 3 (25%) |
Non-confirmed | 41 | 19 (46%) | 6 (15%) | 16 (39%) |
Not TB | 168 | 64 (38%) | 38 (23%) | 66 (39%) |
Total | 221 | 89 (40%) | 47 (21%) | 85 (39%) |
Table 2. Characteristics of severely malnourished children with suspected pneumonia who had their ALS done.
Variables | ALS positive | ALS negative | p |
---|---|---|---|
n = 89 | n = 85 | ||
n (%) | n (%) | ||
Age (months) (median, IQR) | 12 (6.8, 18.7) | 8.0 (3.5, 15.0) | 0.002 |
Male | 52 (58) | 51 (56) | 0.898 |
History of contact with sputum positive TB | 5 (6) | 3 (4) | 0.721 |
Poor socio-economic condition* | 73 (80) | 78 (91) | 0.108 |
BCG vaccination | 83 (93) | 66 (78) | 0.007 |
Tuberculin skin test positive | 18 (20) | 17 (20) | 0.879 |
Z score (W/A) (mean ± SD) | -4.8±1.3 | -4.9±1.3 | 0.430 |
Z score (W/L) (mean ± SD) | -4.1±1.3 | -3.6±1.5 | 0.041 |
Cough | 84 (93) | 79 (92) | 0.931 |
Respiratory rate | 49 ± 12 | 51 ± 12 | 0.319 |
Hypoxemia (SPO2 < 90% at sea level) | 6 (7) | 8 (9) | 0.713 |
Bacterial isolates in blood | 5 (6) | 4 (5) | 1.00 |
Confirmed TB | 6 (7) | 3 (4) | 0.279 |
Non-confirmed TB | 19 (21) | 16 (19) | 0.881 |
Not TB | 64 (71) | 66 (77) | 0.881 |
IQR = Inter-quartile range; SD = Standard deviation
*monthly income <USD 125
Table 3. Validity of ALS at different cut-offs for “Confirmed” versus “Not TB”; and for “all TB” (“Confirmed” plus “Non-Confirmed”) versus “Not TB”.
ALS cut-off (OD) | Comparison of ALS validity for “confirmed” versus “not TB” | Comparison of ALS validity for “all TB” versus “not TB” | ||||||||
---|---|---|---|---|---|---|---|---|---|---|
Sensitivity | Specificity | PPV | NPV | Accuracy | Sensitivity | Specificity | PPV | NPV | Accuracy | |
(95% CI) | (95% CI) | (95% CI) | (95% CI) | (95% CI) | (95% CI) | (95% CI) | (95% CI) | |||
(%) | (%) | (%) | (%) | (%) | (%) | (%) | (%) | (%) | (%) | |
≥0.60 | 67 (31–91) | 51 (42–60) | 9 (4–18) | 96 (87–99) | 52% | 57 (41–71) | 51 (42–60) | 28 (19–39) | 78 (67–86) | 52% |
≥0.42 | 67 (35–89) | 45 (37–52) | 8 (4–15) | 95 (87–98) | 46% | 60 (46–73) | 45 (37–52 | 26 (18–34) | 78 (68–86) | 48% |
≥0.35 | 75 (43–93) | 39 (31–47) | 8 (4–15) | 96 (87–99) | 41% | 66 (52–78) | 39 (31–47) | 25 (19–34) | 78 (68–86) | 45% |
OD = Optical density; CI = Confidence intervals; PPV = Positive predictive value; NPV = negative predictive value; All TB = “confirmed TB” and “Non-confirmed TB”
Table 4. Baseline characteristics of study participants according to diagnostic groups.
Variables | Confirmed TB (n = 12) | Non-confirmed TB (n = 41) | Not-TB (n = 168) |
---|---|---|---|
Age (months) (median, IQR) | 13.5 (2.7, 24.0) | 11.0 (5.8, 16.5) | 10.0 (4.9, 15.0) |
Male | 9 (75) | 24 (59) | 91 (54) |
History of contact with sputum positive TB | 3 (25) | 4 (10) | 2 (1) |
BCG vaccination | 10 (83) | 38 (93) | 138 (82) |
Poor socio-economic condition | 11 (92) | 34 (83) | 145 (86) |
Z score (W/A) (mean ± SD) | -5.5±0.9 | -4.9±1.4 | -5.0±1.4 |
Z score (W/L) (mean ± SD) | -4.2±2.0 | -4.2±1.3 | -3.8±1.6 |
Cough | 11 (92) | 38 (93) | 156 (93) |
Duration of cough (days) (median, IQR) | 7.0 (4.0, 15.0) | 5.0 (4.0, 7.0) | 5.0 (3.0, 7.0) |
Fever | 8 (67) | 30 (73) | 124 (74) |
Duration of fever (days) (median, IQR) | 15.0 (7.0, 30.0) | 5.0 (3.0, 8.0) | 4.0 (3.0, 6.8) |
Poor feeding | 1 (8) | 7 (17) | 17 (10) |
Duration of poor feeding (days) (median, IQR) | 10 (10.0, 10.0) | 15.0 (7.0, 30.0) | 4.0 (2.0, 10.0) |
Respiratory rate | 47 ± 14 | 49 ± 12 | 50 ± 11 |
Bacterial isolates in blood | 0 | 2 (5) | 8 (5) |
Tuberculin skin test positive | 1 (8) | 39 (95) | 0 |
Discussion
The important observation of this study is the poor performance of ALS in the diagnosis of TB in our study population. This test was originally validated in an adult population and found to have a sensitivity and specificity of 92.5% and 80% compared to smear positive and microbiologically confirmed TB, respectively [7]. Also, in a previous study investigating ALS in children with clinically diagnosed TB (age range: 11 to 167 months) the sensitivity and specificity of the test were 91% and 87%, respectively [8]. However, in this population of severely malnourished and young children, the diagnostic accuracy of the ALS was poor including in children with microbiologically confirmed TB.
The ALS test is based on the assumption that antigen-specific plasma cells are present in the circulation only at times of active TB disease and not in asymptomatic infections i.e. in latent TB infection [8]. ALS is thus expected to have greater specificity for active disease because it quantifies the amount of antibody actively secreted by TB-specific plasma cells [11]. Based on this, ALS could be expected to perform well in cases with microbiologically confirmed TB. However, among the study children who were considered not to have TB (i.e. who did not have either confirmed or non-confirmed TB), 38% of those children were observed to have a positive ALS result, which either indicates that there are significant issues with test specificity or alternatively could indicate that the ALS assay also produces positive results in children with latent TB infection who coincidentally have another respiratory infection. Notably, none of the children in the “not TB” group had a positive TST result, but it is well-documented that false-negative TST results are common in children with severe malnutrition [12,13]. Due to financial constraints we were not able to perform interferon-gamma release assays (IGRAs), which could have further contributed to excluding potential latent TB infection in those children. One possible explanation for the poor performance of ALS in our study population is that both cell mediated and humoral (i.e. plasma cell function) immune responses are substantially impaired in children with severe malnutrition [14,15]. It is worth noting that our study participants were on average considerably younger than the participants of the two previous studies that evaluated ALS. Similar to other tests that rely on immune response, it is possible the immaturity of the immune system in our study participants has resulted in an increase in the proportions of negative or borderline results, a phenomenon also observed with IGRAs [16,17,18].
We have considered the performance of ALS at different cut-offs. Although, at lower cut-offs the sensitivity of ALS improved slightly, simultaneously false positivity of ALS was increased, thus, resulting in reduction of the specificity and accuracy of ALS that potentially make the performance of the test worse.
The main limitation of the study is a small number of children with microbiologically-confirmed TB that may hinder the actual ability to assess test accuracy. The vast majority of cases were classified as ‘non-confirmed’ TB, some of whom might not have had TB. This may lead to data contamination, which might make test performance appear worse than it actually is. However, our approach to assess the performance of the ALS by comparing children with ‘only confirmed TB’ versus ‘not TB’ intended to address this limitation.
In conclusion, measurement of ALS does not appear to have a role in the diagnosis of TB in severely malnourished children in our population.
Acknowledgments
We gratefully acknowledge the donors for their support and commitment to icddr,b's research efforts. We would like to express our sincere gratitude to Professor Stephen M Graham for his expert review in improving the quality of the manuscript. We would also express our sincere thanks to all physicians, clinical fellows, nurses, members of feeding team and cleaners of the hospital for their invaluable support and contribution during patient enrollment and data collection.
Data Availability
Due to ethical restrictions, data are available upon request. Interested readers may contact the Research & Clinical Administration and Strategy (RCAS) of icddr,b to request the data (http://www.icddrb.org/).
Funding Statement
This research study was funded by the International Centre for Diarrhoeal Disease Research, Bangladesh (icddr,b; grant no Gr- 00233) and its donors, which provide unrestricted support to icddr,b for its operations and research. Current donors providing unrestricted support include Australian Agency for International Development, Government of the People’s Republic of Bangladesh, Canadian International Development Agency, Swedish International Development Cooperation Agency, and the Department for International Development, United Kingdom. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1. World Health Organisation (2013) Global Tuberculosis Report 2013. Geneva: World Health Organisation. [Google Scholar]
- 2. Marais BJ, Schaaf HS (2010) Childhood tuberculosis: an emerging and previously neglected problem. Infect Dis Clin North Am 24: 727–749. 10.1016/j.idc.2010.04.004 [DOI] [PubMed] [Google Scholar]
- 3. Winston CA, Menzies HJ (2012) Pediatric and adolescent tuberculosis in the United States, 2008–2010. Pediatrics 130: e1425–1432. 10.1542/peds.2012-1057 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. McNally LM, Jeena PM, Gajee K, Thula SA, Sturm AW, Cassol S, et al. (2007) Effect of age, polymicrobial disease, and maternal HIV status on treatment response and cause of severe pneumonia in South African children: a prospective descriptive study. Lancet 369: 1440–1451. [DOI] [PubMed] [Google Scholar]
- 5. Punia RS, Mundi I, Mohan H, Chavli KH, Harish D (2012) Tuberculosis prevalence at autopsy: a study from North India. Trop Doct 42: 46–47. 10.1258/td.2011.110314 [DOI] [PubMed] [Google Scholar]
- 6. Boehme CC, Nabeta P, Hillemann D, Nicol MP, Shenai S, Krapp F, et al. (2010) Rapid molecular detection of tuberculosis and rifampin resistance. N Engl J Med 363: 1005–1015. 10.1056/NEJMoa0907847 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Raqib R, Rahman J, Kamaluddin AK, Kamal SM, Banu FA, Ahmed S, et al. (2003) Rapid diagnosis of active tuberculosis by detecting antibodies from lymphocyte secretions. J Infect Dis 188: 364–370. [DOI] [PubMed] [Google Scholar]
- 8. Raqib R, Mondal D, Karim MA, Chowdhury F, Ahmed S, Luby S, et al. (2009) Detection of antibodies secreted from circulating Mycobacterium tuberculosis-specific plasma cells in the diagnosis of pediatric tuberculosis. Clin Vaccine Immunol 16: 521–527. 10.1128/CVI.00391-08 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Chisti MJ, Graham SM, Duke T, Ahmed T, Ashraf H, Faruque AS, et al. (2014) A Prospective Study of the Prevalence of Tuberculosis and Bacteraemia in Bangladeshi Children with Severe Malnutrition and Pneumonia Including an Evaluation of Xpert MTB/RIF Assay. PLoS One 9: e93776 10.1371/journal.pone.0093776 PMCID: PMC3973596 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Rekha RS, Kamal SM, Andersen P, Rahim Z, Hoq MI, Ara G, et al. (2011) Validation of the ALS assay in adult patients with culture confirmed pulmonary tuberculosis. PLoS One 6: e16425 10.1371/journal.pone.0016425 PMCID: PMC3025031 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Thomas T, Brighenti S, Andersson J, Sack D, Raqib R (2011) A new potential biomarker for childhood tuberculosis. Thorax 66: 727–729. 10.1136/thx.2010.147363 [DOI] [PubMed] [Google Scholar]
- 12. Lloyd AV (1968) Tuberculin test in children with malnutrition. Br Med J 3: 529–531. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Aref GH, Osman MZ, Zaki A, Amer MA, Hanna SS (1992) Clinical and radiologic study of the frequency and presentation of chest infection in children with severe protein energy malnutrition. J Egypt Public Health Assoc 67: 655–673. [PubMed] [Google Scholar]
- 14. Suskind D MK, Suskind RM (1990) The malnourished child: an overview In: Suskind RM, Suskind L, editors. The malnourished child. New York: Vevey/Raven Press; pp. 1–22. [Google Scholar]
- 15. Morgan G (1997) What, if any, is the effect of malnutrition on immunological competence? Lancet 349: 1693–1695. [DOI] [PubMed] [Google Scholar]
- 16. Chiappini E, Bonsignori F, Accetta G, Boddi V, Galli L, Biggeri A, et al. (2012) Interferon-gamma release assays for the diagnosis of Mycobacterium tuberculosis infection in children: a literature review. Int J Immunopathol Pharmacol 25: 335–343. [DOI] [PubMed] [Google Scholar]
- 17. Tebruegge M, de Graaf H, Sukhtankar P, Elkington P, Marshall B, Schuster H, et al. (2014) Extremes of age are associated with indeterminate QuantiFERON-TB gold assay results. J Clin Microbiol 52: 2694–2697. 10.1128/JCM.00814-14 PMCID: PMC4097686 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Holm LL, Rose MV, Kimaro G, Bygbjerg IC, Mfinanga SG, Ravn P, et al. (2014) A comparison of interferon-gamma and IP-10 for the diagnosis of tuberculosis. Pediatrics 134: e1568–1575. 10.1542/peds.2014-1570 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Due to ethical restrictions, data are available upon request. Interested readers may contact the Research & Clinical Administration and Strategy (RCAS) of icddr,b to request the data (http://www.icddrb.org/).