Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2017 Feb 21;12(2):e0171930. doi: 10.1371/journal.pone.0171930

PPD-induced monocyte mitochondrial damage is associated with a protective effect to develop tuberculosis in BCG vaccinated individuals: A cohort study

Diana Marín 1,2,¤a,*, Nancy Marín 2,3,¤b, Helena del Corral 1,2,¤b, Lucelly López 1,2,¤a, María Elena Ramirez-Agudelo 2,3, Carlos A Rojas 1,2, María P Arbeláez 1,2, Luis F García 2,3, Mauricio Rojas 2,3,4,*
Editor: Angelo A Izzo5
PMCID: PMC5319776  PMID: 28222109

Abstract

Introduction

The mechanisms of mononuclear phagocyte death have been associated with the permissiveness and resistance to mycobacterial replication, but it remains unknown whether or not they help predict the risk of developing TB.

Objective

To describe the factors associated with the induction of monocyte mitochondrial and membrane damage in response to PPD as well as determine if this type of damage might predict the susceptibility of developing active tuberculosis in a cohort of household contacts (HHCs) from Medellin, Colombia from 2005 to 2008.

Methods

The prospective cohort study contains 2060 HHCs patients with pulmonary tuberculosis who were meticulously followed for two years. A survey of the socio-demographic, clinical, epidemiological factors and blood samples were collected. Mononuclear cell cultures were stimulated with or without PPD and the type of monocyte death was determined by the flow of cytometry, an indicator was also used for its analysis. Logistic regression was adjusted by the Generalized Estimations Equations and the survival was estimated with the Kaplan-Meier and Cox regression. Confidence intervals were used for estimating the association.

Results

1,859 out of 2,060 blood samples of the HHCs patients analyzed showed monocyte death. In response to PPD, 83.4% underwent mitochondrial damage while 50.9% had membrane damage. The membrane damage in response to PPD was higher in children under 4 years (OR: 1.57; (95% CI: 1.1 to 2.4) and the HHCs who slept regularly in the same household has an index case of (OR: 1.54; 95% CI: 1.0 to 2.3). After adjustment by age, comorbidities, nutritional status, proximity to index case and overcrowding, the risk of developing active TB among BCG vaccinated HHCs individuals with induction of mitochondrial damage was HR = 0.19 (95% CI: 0.1 to 0.5).

Conclusions

The induction of monocytes mitochondrial damage by PPD stimulation correlates with protection of TB disease development in BCG-vaccinated HHCs. This represents a potential tool to predict susceptibility of developing active disease in this population.

Introduction

The recent advances in the knowledge of Mycobacterium tuberculosis-host interactions and the immuno-pathogenesis of tuberculosis (TB) has led to further research on the possibility that some immunological parameters may predict the development of active disease among exposed individuals, such as contacts of smear positive TB patients [1, 2].

Several studies have focused on the search for new tools to detect active TB and also to identify infected individuals, the later representing a third of the world’s population [3]. Between 5 to 10% of infected people develop active TB, with half of them developing the disease during the first two years after exposure to a pulmonary TB case and the remaining at any time of their life span [1, 4]. Thus, it is reasonable to presume that most people develop a protective immune response which keeps the infection latent [5]. The chronicity of Mycobacterium tuberculosis (M.tb) infection and the natural course of the exposure to the bacilli, among many other variables, have made the diagnosis of latent-M.tb infection (LTBI) a complicated issue.

There is evidence that the mycobacteria may be eliminated by the host innate immune mechanisms [6] and the possibility of a spontaneous cure after the disease appears,it is unlikely to occur [7]. In addition, in immunocompromised people, the disease frequently develops after primary infection, as it occurs in HIV positive (+) patients, who have higher risk of developing active TB during the first year after exposure to the bacilli depending on the severity of immunodeficiency.

From an epidemiological standpoint, the study of factors that affect the progression from infection to the disease development is important, since their identification may result in the development of strategies that may lead to a more efficient control of the disease [8].

The precise mechanisms by which TB is reactivates in latently infected individuals are not known, although some of the factors that increase this risk have been considered [9]. Among them are the virulence of the bacillus, the intensity and time of exposure, and host factors such as age, sex and immune competence are well established [9]. This is why transmission of infection and progression to active disease is higher in households contacts (HHCs) living in the same dwelling with pulmonary TB cases [10].

One of the most relevant aspects of the study of host responses to M.tb infection is the antimicrobial functions of mononuclear phagocytes, including the mechanisms involved in death of the infected phagocytes [11]. Evidence accumulated during the last decade indicates that this type of cell death could serve as a potential biomarker for identifying the risk of TB disease progression among infected individuals [12, 13].

The pathways involved in triggering phagocytes’ death also play an important role in anti-M.tb effector mechanisms and TB pathogenesis, suggesting that a better understanding of cell death regulation may contribute to improving the immune effector responses and to develop new prophylactic and therapeutic interventions for TB control [13, 14]. There is evidence from animal models, human cells infected in vitro as well as biopsies from patients that mononuclear phagocytes´ death occurs during the course of infection. However, although the exact significance of the cells´ death in the development of the disease is still uncertain, the manipulation of cell death pathways will eventually affect the course of the infection [11, 15]. Although the interplay between the mononuclear phagocytes-apoptosis and the mycobacterial control is still under investigation, there is evidence that apoptosis pathways are able to trigger inflammatory mediators (pyroptosis) and autophagy which may serve to limit bacterial intracellular growth [1619].

We have previously reported that monocyte cell death mechanisms could be related to the pathogenesis of TB. Specifically, we have observed that monocytes from TB patients are more prone to develop membrane damage, as occurs in necrosis, while monocytes isolated from healthy controls undergo a type of cell death that does not induce membrane damage [20, 21]. The aim of the present study is to determine whether the type of monocyte death (apoptosis or necrosis) might be used to predict the susceptibility of developing active TB in a cohort of HHCs. This is the first study that links the cell death mechanisms and susceptibility to the development of active TB at the population level.

Materials and methods

Type of study and population

Three hundred and sixty seven smear positive pulmonary TB patients and a cohort of 2,060 households contacts (HHCs) were recruited at the Medellín‘s metropolitan area (Colombia) from March 2005 to December 2006 and carefully followed during the next two to three years. The methodological aspects and the cohort study have already been extensively described [22].

Ethics statement

The Ethics Committee of the Instituto de Investigaciones Médicas, Facultad de Medicina, of Universidad de Antioquia approved the project, as well as the health authorities from Medellín and the state of Antioquia as previously reported [22]. The detailed explanation about the ethics considerations that we took into account has been described [22]. Briefly, all the people who met the inclusion criteria were invited to participate, and those who agreed, signed the written consent form. Follow-up of participants was carried out by trained personnel that were unaware of the results of the cell death experiments. The local health authorities provided the treatment for those HHCs diagnosed with active tuberculosis, in agreement with Colombian health policies. Documents with personal information and blood samples were protected by codes specifically developed for this project [22].

Monocyte death studies

Peripheral blood mononuclear cells were obtained by centrifugation on Histopaque density gradients (Sigma-Aldrich, St Louis, MO, USA) for 30 min at 900 x g. The cells were washed with Phosphate Saline Dulbeco (DPBS, GIBCO, Life Technologies Grand Island, NY) and the viability (≥95%) was determined by trypan blue exclusion. Two hundred thousand peripheral blood mononuclear cells were resuspended in 1 mL of RPMI-1640 medium (Gibco, Grand Island, NY, USA) with 10% fetal bovine serum (FBS, BioWhittaker (Walkersville, MD, USA), stimulated or not with the Purified Protein Derivative of Mycobacterium tuberculosis (PPD. RT50, Copenhagen, Denmark) and cultured in 12 x 75 mm polystirene tubes for 48 h. After incubation, cells were stained with 700 nM DiOC6 to assess the changes in the state of mitochondrial permeability transition which is affected early during apoptosis and 5 μg/ml Ethidium Bromide (EB) to evaluate the cell membrane damage [15]. Cells were incubated at room temperature for 30 min, washed with DPBS to remove the excess of dye and 10,000 cells were analyzed in a flow cytometer EPICS XL (Beckman Coulter, Hialeah, FL). Based on Forward Scatter (FSC-H) and Side Scatter (SSC-H), cells corresponding to mononuclear phagocytes were gated to determine the percentages of cells with mitochondrial and/or cell membrane damaged (Fig 1). Some samples were also stained with Annexin V and EB (data not shown), to determine whether PPD is able to induce phosphatidylserine exposure, which occurs mainly during apoptosis [23].

Fig 1. Flow cytometry strategy to determine mitochondrial and membrane damage on monocytes from PBMC.

Fig 1

Panel A shows the FSC-H x SSC-H plot and the gate to select the monocyte population in cultured PBMCs. Panel B shows the DIOC6 x EB plot in monocytes from non-stimulated cultures. Panel C shows the DIOC6 x EB plot in monocytes PPD-stimulated cultures. Insets shows in panel A the percentage of cells within the monocyte gate, and in panels B and the percentage of cell with mitochondrial damage (DIOC6 low), membrane damage (EB+), or live cells DIOC6 high).

Cell death index

In order to determine the effect of PPD on the mitochondrial or membrane damage the indexes of the cell damage levels were calculated as follows:

Step 1: The effect of PPD on mitochondrial damage was calculated as the proportion of cells with mitochondrial damage in response to PPD minus the proportion of cells with mitochondrial damage in absence of PPD stimulus (1.1).

Level of mitochondrial damage = % of cells with mitochondrial damage in the PPD-stimulated cultures- % of cells with mitochondrial damage in the non-stimulated cultures (1.1)

Step 2: From 1.1 it was assumed that any level above zero indicates an increase of mitochondrial damage in the stimulated cells, defining this as PPD-induced mitochondrial damage

Step 3: The effect of PPD on cell membrane damage, was determined by the proportion of cells with membrane damage in response to PPD minus the proportion of cells with membrane damage in absence of PPD stimulation (1.2).

Level of membrane damage = % of cells with membrane damage in the PPD-stimulated cultures—% of cells with membrane damage in the non-stimulated cultures (1.2).

Step 4: From 1.2 it was assumed that any level above zero indicates an increase of membrane damage in the stimulated cells, defining this as PPD-induced membrane damage.

Other variables

The outcome in the HHCs was tuberculosis and its diagnosis was established as previously published [22]. The Colombian vaccination program uses the BCG-Japan strain. BCG vaccination was determined by the presence of the scar and confirmed in the case of children by their parents as previously reported [22]. The nutritional status was classified differently in children and adults. Normal nutritional status was defined as body mass index (BMI) ranging 18.5–25 kg/m2 in adults, and -1 Z score of weight and height ≤ 1 in children; underweight was defined as a BMI ≤ 18.5 kg/m2 in adults and in children with a Z score for age ≤ 1 and overweight as a BMI ≥ 25 kg / m2 in adults and children have a Z score > 1. In addition, the presence of any systemic, neurological, pulmonary, gastrointestinal, kidney, dermatological, or ophthalmological disease, previous transplantation or drug abuse was regarded as comorbidity. Rooms were tagged as overcrowded they housed more than 3 people per room [22].

Statistical analysis

The effect of PPD on mitochondrial and cell membrane damage was evaluated using the Wilcoxon test. The frequencies and proportions were calculated for categorical variables and comparisons were done using the chi-square test or chi-square test for trend. To assess the factors associated with the increased apoptosis and necrosis, a logistic regression was performed using those variables in the bivariate analysis that showed a p-value < 0.20.

The odds ratio (OR) and the 95% confidence interval (CI) were adjusted by the generalized estimating equations (GEE), because the cohabitants shared the same exposure conditions that influenced the estimate of the associations. The model was estimated using a link logit function of a binomial probability distribution and an interchangeable correlation matrix. The incidence of tuberculosis was estimated for each of the variables, and the bivariate analysis included the estimated hazard ratio (HR) and 95% CI.

Since the stratified analysis identified an interaction between BCG scar and increased apoptosis, hence, those variables with a p-value < 0.20 in the log-rank test that met the proportional hazards assumption were included in a Cox regression, stratified by the presence of BCG scar. The survival curves were estimated using the Kaplan-Meier (KM) method.

To determine the predictive capacity of the cell death on disease progression, the maximum likelihood ROC Stata model was used, through the rocfit command. The software packages used were: SPSS release 22; Stata release 11.1; Statgraphics release 16.1.18 and Graph Pad Prism release 5.0.

Results

Among the 2,060 HHCs, that were enrolled in this study, 57.2% were women and 34.8% were less than 15 years of age. Forty-Five percent lacked normal nutritional conditions: 18.6% were underweight and 26.4% were overweight. Nearly two thirds lived in low socioeconomic strata and 26.4% in overcrowded conditions.

PPD stimulation induces mitochondrial and cell membrane damage

From a total of 2,060 blood samples obtained from the HHCs, 201 samples were excluded due to very low cell viability at the initiation of the experiment. From the remaining 1859 blood samples, mononuclear cells were stimulated or not with PPD. In non-stimulated cultures, the median percentage of mononuclear phagocytes with mitochondrial damage was 7.2% (IQR: 4.6–9.8%), while the median percentage of cells with cell membrane damage was 0.1% (IQR: 0–0.3%). In response to PPD, both the percentage of monocytes with mitochondrial damage (median 12.2%; IQR: 7.2 to 19.5%) and membrane damage (median 0.2%; IQR: 0 to 0.5%) increased significantly (p <0.01) (Fig 2).

Fig 2. Distribution of the percentage of monocytes with mitochondrial damage and membrane damage in peripheral blood mononuclear cells (PBMC) cultures from household contacts stimulated and non-stimulated with PPD.

Fig 2

The inset shows the Median (Me) of the percentage of monocytes with mitochondrial (Panels A and C) and cell membrane damage (Panels B and D).Stimulated and non-stimulated cultures were compared using the Wilcoxon test.

As defined in steps 2 and 4 (see Materials and Methods: Cell Death Index), in response to PPD, 83.4% monocytes (1151/1859) of the HHCs underwent mitochondrial damage and 50.9% (947/1859) underwent cell membrane damage. In some cases, the stimulation with PPD induced lower cell death compared to those of non-stimulated cells. In some individuals, there were monocytes with both membrane and mitochondrial damage (Fig 3).

Fig 3. Effect of PPD stimulation on mitochondrial and cell membrane damage in mononuclear phagocytes from household contacts of smear-positive patients in Colombia.

Fig 3

The level of mitochondrial damage was calculated as the difference between the percentage of PPD stimulated cells minus the percentage of non-stimulated cells for mitochondrial damage and cell membrane damage.

Factors associated with damage to the mitochondria and cell membrane in response to PPD

The induction of mitochondrial damage had a positive association (p<0.05) with the following variables: low or middle socioeconomic level; exposure to index case for ≥ 168 hours and living in homes where ≥ 3 people slept in the same bedroom. The induction of cell membrane damage in response to PPD was higher in children under 4 years (p = 0.03), and HHCs who slept in the same household with the TB patients (p = 0.04) (Table 1).

Table 1. Risk factors associated with the induction of monocytes’ mitochondrial and membrane damage in response to PPD, in mononuclear phagocytes obtained from household contacts of smear-positive TB patients in Colombia.

Factor PPD-induced mitochondrial damage PPD-induced membrane damage
OR (IC95%) P-value OR (IC95%) P-value
Gender
    Female 1 1
    Male 1,20 1,0–1,5 0,13 0,97 0,8–1,2 0,78
Age, years
    ≤ 4 1,15 0,7–1,8 0,55 1,57 1,1–2,4 0,03
    5 14 0,93 0,7–1,3 0,65 1,20 0,9–1,5 0,12
    15 or older 1 1
Socioeconomic status
    I–II 6,68 1,9–23,0 0,003 0,51 0,3–0,8 0,01
    III–IV 7,66 2,3–25,7 0,001 0,56 0,3–0,9 0,05
    V–VI 1 1
BCG scar
    No 1 1
    Yes 1,02 0,7–1,5 0,94 0,98 0,8–1,3 0,89
Family history of TB
    No 1 1
    Yes 0,88 0,6–1,3 0,49 0,97 0,7–1,3 0,82
Comorbidities
    No 1 1
    Yes 0,92 0,6–1,4 0,67 0,87 0,7–1,1 0,29
Nutritional status
    Normal 1 1
    Underweight 0,78 0,5–1,2 0,21 0,98 0,8–1,3 0,91
    Overweight 0,92 0,7–1,3 0,61 1,18 1,0–1,4 0,09
Sputum bacterial load of index case
    Weak (+) 1 1
    Moderate (++) 1,40 0,9–2,1 0,10 1,1 0,7–1,6 0,68
    Strong (+++) 1,33 0,9–2,0 0,20 1,23 0,9–1,7 0,47
Proximity to the index case
    HHC slept in other household 1 1
    HHC slept in same household 0,86 0,5–1,4 0,53 1,54 1,0–2,3 0,04
    HHC slept in same room 0,93 0,6–1,0 0,71 0,90 0,7–1,2 0,47
Time the Index case remained in the house
    ≤ 84 1 1
    85–140 0,74 0,4–1,3 0,03* 1,27 0,9–1,9 0,62*
    141–167 1,24 0,3–4,9 1,76 0,6–5,1
    168 y + 1,55 1,0–2,4 0,97 0,7–1,3
Persons per room
    Less than 3 1 1
    3 or more 1,50 1,0–2,3 0,05 0,79 0,6–1,1 0,19

HHC: Household contacts. BCG: Bacillus Calmette-Guérin

Odds ratio adjusted for other variables and GEE.

¶ 95% confidence interval

† Including consumption of toxic substances and drugs.

*Chi-square test for trend

There was no correlation between the production of IFN-γ induced by several mycobacterial antigens previously reported [22] and the PPD induced mitochondrial or membrane damage reported herein; however, in the sample of HHCs in whom TST was performed (491 HHCs), the induction of membrane damage was higher in the TST positive HHCs (53.5%) than in TST negative HHCs (40.6%) (p = 0.008).

Mitochondrial damage predicts the susceptibility of the household contact of smear-positive TB patients to develop active disease

The overall incidence rate of tuberculosis during follow-up was 7.2 per 1,000 person-years (PY). The incidence was highest in children under 4 years of age, in HHCs patients who do not have BCG scar, in HHCs with some comorbidity (p ≤ 0.046), especially diabetic patients living in the same household (p ≤ 0.023) or in overcrowded households. The presence of BCG scar and excess weight had no significant protective effect against TB disease development. Tuberculosis incidence rates were similar in HHCs that showed induction of mitochondrial damage and cell membrane damage. However, the risk of developing the disease was higher in HHCs where the response to PPD showed no mitochondrial damage, compared with non-stimulated cultures (p ≤ 0.029) (Table 2).

Table 2. TB incidence and non-adjusted Hazard Ratio (HR) that influences development of TB according to various factors related to households of smear-positive patients in Colombia.

Factor n/N Person-years (PY) Incidence rate x (1000 PY) Non-adjusted HR (95% CI) P-value+
PPD-induced mitocondrial damage
No 11/308 808,57 13,60 1
Yes 23/1545 3897,31 5,90 0,45 (0,22–0,92) 0,029
PPD-induced membrane damage
No 20/909 2275,05 8,79 1
Yes 14/944 2430,82 5,76 0,67 (0,34–1,32) 0,243
Age, years
    ≤ 4 7/181 451,5 15,51 2,05 (0,88–4,79) 0,127
    5–14 4/467 1230,2 3,25 0,44 (0,15–1,27) 0,095
    15 or more 23/1205 3024,3 7,61 1
BCG scar
    No 12/388 987,9 12,15 1
    Yes 22/1428 3632,3 6,06 0,51 (0,25–1,03) 0,060
Comorbidities
    No 21/1469 3795,5 5,53 1
    Yes 8/265 655,0 12,21 2,30 (1,01–5,22) 0,046
Diabetes Mellitus
    No 30/1760 4486,9 6,69 1
    Yes 2/45 102,2 19,57 2,93 (0,70–1,23) 0,142
Nutritional status
    Normal 20/998 2538,5 7,88 1
    Overweight 5/489 1270,0 3,94 0,49 (0,18–1,31) 0,155
    Underweight 9/340 841,9 10,69 1,33 (0,61–2,93) 0,474
Proximity to index case
    HHC slept in other household 20/1388 3516,7 5,69 1
    HHC slept in same household 7/189 479,7 14,59 2,73 (1,15–6,49) 0,023
    HHC slept in same room 7/276 709,5 9,87 1,80 (0,76–4,27) 0,180
Persons per room
    Less than 3 21/1354 3454,8 6,08 1
    3 or more 13/486 1217,1 10,68 1,86 (0,93–3,74) 0,081

HR = Hazard Ratio. CI = Confidence Interval. BCG: Bacillus Calmette-Guérin. HHC: Household contacts

+ Log-rank test

In the HHCs without BCG scars in whom mitochondrial damage was induced in response to PPD, a trend to higher incidence of TB development was observed, however it did not attain statistical significance (HR: 2.06 95% CI 0.26–16.06) (Fig 4A); whereas, in HCCs with BCG scar and evidence of PPD induced mitochondrial damage significantly lower TB incidence was seen (HR: 0.20 95% CI: 0.11 to 0.56, p ≤ 0.001) (Fig 4B).

Fig 4. Effect of the induction of mitochondrial monocyte damage and BCG vaccination on the probability of developing tuberculosis in household contacts (HHC) of smear-positive TB patients.

Fig 4

The dotted line shows the probability of the HHC that did not have mitochondrial damage (MD -); the black line shows the probability of HHC that did have mitochondrial damage (MD+). Household contacts of smear-positive patients were followed up for two years to detect development of active TB disease. Probabilities were calculated by Kaplan-Meier and compared by Log-Rank test. HR: Hazard Ratio.

To further explore the effect of BCG vaccination on the PPD induction of mitochondrial damage and its association with TB incidence in the HHCs, the incidence was determined for the different quartiles of percentages of mitochondrial damage in the total population of HHCs, and in those with or without BCG scar. In the whole group of HHCs (chi square test for trend = 5.98, p = 0.015), and in those HHCs with BCG scar there was a significant decrease in TB incidence (chi square test for trend = 8.66, p = 0.003), at the point that in those BCG vaccinated HHCs located in the highest quartile of mitochondrial damage there were no incident cases; however, among the HHCs that had no BCG vaccination, there was no significant trend in TB incidence development associated with the level of mitochondrial damage (Fig 5).

Fig 5. Incidence of tuberculosis according to the level of mitochondrial damage in household contacts of smear-positive patients with or without BCG vaccination.

Fig 5

The level of mitochondrial damage was categorized by quartiles. The trend in decreasing incidence of active TB was assessed with chi square test for trend (chi square test for trend = 8.66, p = 0.003).

The Cox regression analysis showed that induction of the mitochondrial damage in response to PPD was associated with significant level of protection against development of active TB in 81% of the HHCs positive for BCG scar (HR: 0.19 95% CI: 0.1–0.5) (Table 3).

Table 3. Risk factors associated with TB incidence according to the presence of BCG scar in household contacts of smear-positive TB patients in Colombia.

Factor Without BCG scar With BCG scar
(n = 354) (n = 1313)
Adjusted HR (95% CI) Adjusted HR (95% CI)
PPD-induced mitochondrial damage
No 1 1
Yes 1,65 (0,2–13,2) 0,19* (0,1–0,5)
Age, years
    ≤ 4 2,87 (0,6–14,3) 1,22 (0,3–4,5)
    5–14 ND ND 0,48 (0,2–1,6)
    15 or more 1 1
Comorbidity
    No 1 1
    Yes 1,17 (0,2–6,1) 3,06* (1,1–8,2)
Nutritional status
    Normal 1 1
    Overweight 0,97 (0,2–4,5) 0,32 (0,1–1,5)
    Underweight 1,46 (0,2–9,1) 1,17 (0,4–3,9)
Proximity to the index case
    HHC slept in other household 1 1
    HHC slept in same household 0,79 (0,1–7,2) 2,81** (0,9–8,8)
    HHC slept in same room 1,1 (0,2–5,8) 1,6 (0,5–5,3)
Persons per room
    Less than 3 1 1
    3 or more 2,61 (0,7–10,4) 2,03 (0,8–5,4)

ND = No data. HHC: Household contacts. BCG: Bacillus Calmette-Guérin

¶ Hazard Ratio adjusted by age, comorbidity, nutritional status, proximity of exposure to case and overcrowding

* p <0.05

** p <0.10

The presence of any comorbidity and a closer proximity to the index case during the early period with respiratory symptoms would significantly increase the risk of developing the disease among HHCs, while the induction of mitochondrial damage would significantly reduce the risk in HHCs exhibiting a BCG scar (Table 3). In HHCs without BCG scars had no statistically significant relationship with the development of TB.

The ROC curves show the potential of using increased mitochondrial damage in monocytes to predict the disease development (Fig 6). The positive predictive value was higher when the BCG vaccination was present. Among the HHCs with BCG scar the AUC was 0.71 (95%CI: 0.59–0.83), while in those without BCG scar, the AUC was 0.47 (95%CI: 0.28–0.65).

Fig 6. ROC curves showing the predictive capacity of the level of mitochondrial damage to predict active TB development in household contacts of smear-positive patients with or without BCG vaccination.

Fig 6

The gray area shows the confidence interval of AUC (Area Under Curve),Se (Sensitivity), Sp (Specificity).

Discussion

Different mechanisms of cell death, particularly apoptosis and autophagy [24], have been presumed to play a protective role against a variety of pathogens [11]. When confronted with a pathogen that uses the host cellular resources for survival and replication, one strategy for defense is to activate host cell death programs. Host cell apoptosis is a well-established event in response to viral infections [25]. Many successful viral pathogens encode genes whose products suppress apoptosis of the host cell, thereby sustaining the niche for viral replication [26, 27]. Although, the extension of this paradigm to intracellular bacterial pathogens is more recent, a large number of cases have been identified with cell apoptosis, including mononuclear phagocytes’ death during mycobacterial infections [28]

Most of the published evidence points to apoptosis as an important macrophage response to Mtb infection [15, 19, 2934], what remains unclear is its role in the pathogenesis of the disease [11] and whether the occurrence of any form of cell death could be used as a biomarker for predicting the susceptibility of developing an active TB.

This study provides evidence that increased mitochondrial damage in monocytes, an early event during apoptosis, may be associated with protection from the development of active tuberculosis in a population of individuals at high risk of infection. This is the first population-based study to provide evidence of an association between early events of cell mitochondrial and membrane damage and a protective effect from TB development [33, 35]. Several studies conducted using animal models and humans support the hypothesis that virulent strains of M. tuberculosis induce apoptosis [28, 32, 36, 37], while others argue that virulent mycobacteria strains inhibit it [38, 39]; however, none of these studies had sufficient statistical power to evaluate cell death and disease prognosis.

The findings presented here are based on information from a cohort of HHCs with close adherence to the research protocol and with a sufficiently large sample size to provide an adequate degree of precision and power to the estimates. Besides other immunological indicators that were explored in the cohort of the present study [22], an indicator of monocyte death was derived and validated to elucidate the role of this cellular response in the disease development. Analysis of monocyte death using this indicator is a novel approach that warrants comparison with available evidence on the topic.

In this study we found that the response of monocytes of HHCs of patients with pulmonary TB to PPD is characterized by a mixed profile of mitochondrial and membrane damage, similar to what was reported in patients with active TB [20]. These results are in agreement with Danelishvili et al., who proposed that the outputs of cell death are dependent on the cell background [28]. Our group had previously reported that peripheral blood monocytes from TB patients undergo apoptosis and necrosis in vitro when stimulated with PPD or infected with M. tuberculosis H37Rv, whereas monocytes from healthy controls do not. The mixed profile of apoptosis and necrosis[15], in the setting of high rates of infection and disease development [22], may be attributed in part to the high exposure to a TB case.

The factors associated with increased induction of mitochondrial and cell membrane damage reported herein, were similar to the factors that have been reported to be associated with an increased risk of latent infection [15]. Our findings revealed that HHCs that are younger, mostly impoverished and subjected to prolong and intense exposures to patients severe tuberculosis had more mitochondrial/membrane damage.

In this study, based on the dichotomy established in steps 2 and 4 of the methods section, it was found that in 83.4% of HHCs there was an induction of mitochondrial damage in response to PPD, while in the remaining 17%, PPD-stimulation appeared to be able to inhibit it. Some studies support this dual ability of M. tuberculosis to induce and to inhibit cellular responses. Increased apoptosis has been associated with host defense mechanisms [28] while its inhibition is a strategy that guarantees mycobacterial survival within the host cells [40]. Other studies propose that increased apoptosis is a mechanism employed by virulent strains to avoid the induction of macrophage cell death, hence becoming a key element for the survival of the bacteria inside the host [39] and to evade host immune response [41].

Prolonged exposure to the index case and overcrowded living spaces were among the factors that favored the induction of mitochondrial damage. The latter seems paradoxical taking into account that one of the most important conditions for early cellular responses to a noxious stimulus is its dependence on duration and severity of the injury [42]; mononuclear cells from HHC exposed for a short period of time may undergo apoptosis, but the highest bacterial load per cell may result in membrane damage causing death.

An important link between cell death and malnutrition was also observed. The absence of PPD-induced mitochondrial damage was common in underweight individuals (OR: 0.93 (95% CI: 0.7 to 1.3); while on the other hand, increasing membrane damage was associated with overweight (OR: 1.24 (95% CI: 1.0 to 1.5). It is well known that malnutrition negatively affects the cell-mediated responses which are considered the cornerstone of protective immunity against tuberculosis [43], and additionally obesity plays a significant role in membrane damage [44]. The information gathered also showed that most of the HHCs studied live in poverty and 26.7% of them (95% CI: 24.7 to 28.8) were overweight.

Our results show that the ability of PPD to induce monocyte mitochondrial damage correlates with protection of TB disease development in BCG vaccinated HHCs. The level of protection was 80% (adjusted HR: 0.20 95% CI: 0.1–0.5) among HHCs with BCG scars, while the risk level was 87% (HR: 1.87 95% CI: 0.2–15.2) among HHCs without BCG. The negative effect of the increased mitochondrial damage over active TB development among those without BCG scars could also be accounted for by the increase in monocyte viability due to BCG hindering apoptosis [45]. In addition, although an increase in mitochondrial damage clearly benefits the host in its fight against the mycobacteria still surviving and persisting within the tissues, it has been reported that in the later stages of infection, the mycobacteria use apoptosis to their advantage as they manage to successfully escape from apoptotic bodies and infect new cells which will die by necrosis [39].

The significant effect of apoptosis, not of necrosis, can apparently be explained by the finding that a large number of HHCs participating in this study showed this cell death phenotype [39]. Several studies have demonstrated that apoptosis of infected cells reduces the viability of the intracellular mycobacteria, whereas necrosis facilitates their spread to other cells and tissues [38, 40, 46]. However, no significant predictive capacity of necrosis induction on TB disease incidence was found within 2–3 years of follow-up period.

It would be possible to postulate that, since we used whole mononuclear cell cultures for PPD stimulation, the synergistic effect of BCG vaccination with induction of apoptosis maybe explained by a T-cell dependent recall response resulting in the production of cytokines which induces apoptosis and autophagy (ie, TNF-αα), where mitochondrial damage is an early event, and which are the mechanisms known to participate in mycobacterial control [17].

It is important to note that the lack of correlation between the induction of IFN-γγ previously reported in this HHC cohort [22] and the induction of mitochondrial or membrane damage reported in this study may be explained by the use of different stimuli: purified mycobacterial antigens in the former and PPD in the studies of cells death; this may be confirmed by the finding of an association of PPD-induced membrane damage with the TST response. However, further studies are needed to elucidate the mechanisms behind the interaction of BCG vaccination and the protective effect of apoptosis in individuals vaccinated with BCG. Studies exploring the prognostic value of cell death in different population groups, such as contacts of paucibacillary TB patients and the general population from endemic settings, will be useful to improve our understanding of its role on the outcome of those infected with Mycobacterium tuberculosis.

The result of the present study may be particularly relevant in countries with medium or high incidence of tuberculosis and that continues to use BCG vaccination, like Colombia that had an incidence rate of 36 cases per 100,000 population [47] and BCG vaccine coverage of 92.6% (98.2% in Medellín) as at 2008 when this study was conducted [48]. Elucidation of the immunological phenomena that influences the epidemiological outcomes of tuberculosis may contribute to further strengthen the TB control programs.

Acknowledgments

The authors are grateful to all household contacts who accepted to participate in the study. Also to the field work team, the laboratory group and late Prof. Luis Carlos Orozco for his valuable advice for the analyses. We also thank Dr Yoav Keynan and Dra Zulma Rueda for their critical reading of the manuscript and their help in the preparation of the English manuscript.

Funding for this research was received from Colciencias (http://www.colciencias.gov.co/), Bogotá, (Grants: 11150416335 and 34261817270). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Data Availability

Data are available at https://figshare.com/s/345c12095c00c3ca6092. The data is in anonymized form that complies with data protection/privacy laws.

Funding Statement

Funding for this research was gratefully received from Colciencias (Colombian Administrative Department of Science, Technology and Innovation, http://www.colciencias.gov.co/), Bogotá, Universidad de Antioquia (Grants: 11150416335 and 34261817270). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Andersen P, Doherty TM, Pai M, Weldingh K. The prognosis of latent tuberculosis: can disease be predicted? Trends in molecular medicine. 2007;13(5):175–82. Epub 2007/04/10. 10.1016/j.molmed.2007.03.004 [DOI] [PubMed] [Google Scholar]
  • 2.Barry CE 3rd, Boshoff HI, Dartois V, Dick T, Ehrt S, Flynn J, et al. The spectrum of latent tuberculosis: rethinking the biology and intervention strategies. Nature reviews Microbiology. 2009;7(12):845–55. Epub 2009/10/27. PubMed Central PMCID: PMC4144869. 10.1038/nrmicro2236 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Rangaka MX, Wilkinson KA, Glynn JR, Ling D, Menzies D, Mwansa-Kambafwile J, et al. Predictive value of interferon-gamma release assays for incident active tuberculosis: a systematic review and meta-analysis. The Lancet Infectious diseases. 2012;12(1):45–55. Epub 2011/08/19. PubMed Central PMCID: PMC3568693. 10.1016/S1473-3099(11)70210-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Pai M, Rodrigues C. Management of latent tuberculosis infection: An evidence-based approach. Lung India: official organ of Indian Chest Society. 2015;32(3):205–7. Epub 2015/05/20. PubMed Central PMCID: PMC4429378. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.He H, Yang H, Deng Y. Mycobacterium tuberculosis dormancy-associated antigen of Rv2660c induces stronger immune response in latent Mycobacterium tuberculosis infection than that in active tuberculosis in a Chinese population. European journal of clinical microbiology & infectious diseases: official publication of the European Society of Clinical Microbiology. 2015;34(6):1103–9. Epub 2015/02/06. [DOI] [PubMed] [Google Scholar]
  • 6.Dietrich J, Doherty TM. Interaction of Mycobacterium tuberculosis with the host: consequences for vaccine development. APMIS: acta pathologica, microbiologica, et immunologica Scandinavica. 2009;117(5–6):440–57. Epub 2009/04/30. 10.1111/j.1600-0463.2009.02458.x [DOI] [PubMed] [Google Scholar]
  • 7.Kaufmann SH. Envisioning future strategies for vaccination against tuberculosis. Nature reviews Immunology. 2006;6(9):699–704. Epub 2006/08/19. 10.1038/nri1920 [DOI] [PubMed] [Google Scholar]
  • 8.Wallis RS, Pai M, Menzies D, Doherty TM, Walzl G, Perkins MD, et al. Biomarkers and diagnostics for tuberculosis: progress, needs, and translation into practice. Lancet. 2010;375(9729):1920–37. Epub 2010/05/22. 10.1016/S0140-6736(10)60359-5 [DOI] [PubMed] [Google Scholar]
  • 9.Ai JW, Ruan QL, Liu QH, Zhang WH. Updates on the risk factors for latent tuberculosis reactivation and their managements. Emerging microbes & infections. 2016;5:e10. Epub 2016/02/04. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Yuen CM, Amanullah F, Dharmadhikari A, Nardell EA, Seddon JA, Vasilyeva I, et al. Turning off the tap: stopping tuberculosis transmission through active case-finding and prompt effective treatment. Lancet. 2015;386(10010):2334–43. Epub 2015/10/31. 10.1016/S0140-6736(15)00322-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Kornfeld H, Mancino G, Colizzi V. The role of macrophage cell death in tuberculosis. Cell Death Differ. 1999;6(1):71–8. Epub 1999/04/14. 10.1038/sj.cdd.4400454 [DOI] [PubMed] [Google Scholar]
  • 12.Harris J, Keane J. How tumour necrosis factor blockers interfere with tuberculosis immunity. Clinical and experimental immunology. 2010;161(1):1–9. Epub 2010/05/25. PubMed Central PMCID: PMC2940142. 10.1111/j.1365-2249.2010.04146.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Elliott TO, Owolabi O, Donkor S, Kampmann B, Hill PC, Ottenhoff TH, et al. Dysregulation of Apoptosis Is a Risk Factor for Tuberculosis Disease Progression. The Journal of infectious diseases. 2015;212(9):1469–79. Epub 2015/04/22. 10.1093/infdis/jiv238 [DOI] [PubMed] [Google Scholar]
  • 14.Schaible UE, Winau F, Sieling PA, Fischer K, Collins HL, Hagens K, et al. Apoptosis facilitates antigen presentation to T lymphocytes through MHC-I and CD1 in tuberculosis. Nature medicine. 2003;9(8):1039–46. Epub 2003/07/23. 10.1038/nm906 [DOI] [PubMed] [Google Scholar]
  • 15.Gil DP, Leon LG, Correa LI, Maya JR, Paris SC, Garcia LF, et al. Differential induction of apoptosis and necrosis in monocytes from patients with tuberculosis and healthy control subjects. The Journal of infectious diseases. 2004;189(11):2120–8. Epub 2004/05/15. 10.1086/386369 [DOI] [PubMed] [Google Scholar]
  • 16.Campbell GR, Pallack ZT, Spector SA. Vitamin D attenuates nucleoside reverse transcriptase inhibitor induced human skeletal muscle mitochondria DNA depletion. Aids. 2013;27(9):1397–401. Epub 2013/02/26. PubMed Central PMCID: PMC3762245. 10.1097/QAD.0b013e32836010dd [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Campbell GR, Spector SA. Autophagy induction by vitamin D inhibits both Mycobacterium tuberculosis and human immunodeficiency virus type 1. Autophagy. 2012;8(10):1523–5. Epub 2012/08/16. PubMed Central PMCID: PMC3679232. 10.4161/auto.21154 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Campbell GR, Spector SA. Vitamin D inhibits human immunodeficiency virus type 1 and Mycobacterium tuberculosis infection in macrophages through the induction of autophagy. PLoS pathogens. 2012;8(5):e1002689 Epub 2012/05/17. PubMed Central PMCID: PMC3349755. 10.1371/journal.ppat.1002689 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Rojas M, Olivier M, Gros P, Barrera LF, Garcia LF. TNF-alpha and IL-10 modulate the induction of apoptosis by virulent Mycobacterium tuberculosis in murine macrophages. J Immunol. 1999;162(10):6122–31. Epub 1999/05/07. [PubMed] [Google Scholar]
  • 20.Sanchez MD, Garcia Y, Montes C, Paris SC, Rojas M, Barrera LF, et al. Functional and phenotypic changes in monocytes from patients with tuberculosis are reversed with treatment. Microbes Infect. 2006;8(9–10):2492–500. Epub 2006/07/29. 10.1016/j.micinf.2006.06.005 [DOI] [PubMed] [Google Scholar]
  • 21.Pan H, Yan BS, Rojas M, Shebzukhov YV, Zhou H, L K. Ipr1 gene mediates innate immunity to tuberculosis. Nature. 2005;434:767–72. 10.1038/nature03419 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.del Corral H, Paris SC, Marin ND, Marin DM, Lopez L, Henao HM, et al. IFNgamma response to Mycobacterium tuberculosis, risk of infection and disease in household contacts of tuberculosis patients in Colombia. PloS one. 2009;4(12):e8257 Epub 2009/12/17. PubMed Central PMCID: PMC2788133. 10.1371/journal.pone.0008257 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Gerber A, Bohne M, Rasch J, Struy H, Ansorge S, Gollnick H. Investigation of annexin V binding to lymphocytes after extracorporeal photoimmunotherapy as an early marker of apoptosis. Dermatology. 2000;201(2):111–7. Epub 2000/10/29. [DOI] [PubMed] [Google Scholar]
  • 24.Moraco AH, Kornfeld H. Cell death and autophagy in tuberculosis. Seminars in immunology. 2014;26(6):497–511. Epub 2014/12/03. PubMed Central PMCID: PMC4314446. 10.1016/j.smim.2014.10.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Roulston A, Marcellus RC, Branton PE. Viruses and apoptosis. Annual review of microbiology. 1999;53:577–628. Epub 1999/11/05. 10.1146/annurev.micro.53.1.577 [DOI] [PubMed] [Google Scholar]
  • 26.Zychlinsky A. Programmed cell death in infectious diseases. Trends in microbiology. 1993;1(3):114–7. Epub 1993/06/01. [DOI] [PubMed] [Google Scholar]
  • 27.McCormick AL. Control of apoptosis by human cytomegalovirus. Current topics in microbiology and immunology. 2008;325:281–95. Epub 2008/07/22. [DOI] [PubMed] [Google Scholar]
  • 28.Danelishvili L, McGarvey J, Li YJ, Bermudez LE. Mycobacterium tuberculosis infection causes different levels of apoptosis and necrosis in human macrophages and alveolar epithelial cells. Cellular microbiology. 2003;5(9):649–60. Epub 2003/08/20. [DOI] [PubMed] [Google Scholar]
  • 29.Nigou J, Gilleron M, Rojas M, Garcia LF, Thurnher M, Puzo G. Mycobacterial lipoarabinomannans: modulators of dendritic cell function and the apoptotic response. Microbes and infection / Institut Pasteur. 2002;4(9):945–53. Epub 2002/07/11. [DOI] [PubMed] [Google Scholar]
  • 30.Rojas M, Garcia LF, Nigou J, Puzo G, Olivier M. Mannosylated lipoarabinomannan antagonizes Mycobacterium tuberculosis-induced macrophage apoptosis by altering Ca+2-dependent cell signaling. The Journal of infectious diseases. 2000;182(1):240–51. Epub 2000/07/07. 10.1086/315676 [DOI] [PubMed] [Google Scholar]
  • 31.Repasy T, Lee J, Marino S, Martinez N, Kirschner DE, Hendricks G, et al. Intracellular bacillary burden reflects a burst size for Mycobacterium tuberculosis in vivo. PLoS pathogens. 2013;9(2):e1003190 Epub 2013/02/26. PubMed Central PMCID: PMC3578792. 10.1371/journal.ppat.1003190 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Danelishvili L, Yamazaki Y, Selker J, Bermudez LE. Secreted Mycobacterium tuberculosis Rv3654c and Rv3655c proteins participate in the suppression of macrophage apoptosis. PloS one. 2010;5(5):e10474 Epub 2010/05/11. PubMed Central PMCID: PMC2864267. 10.1371/journal.pone.0010474 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Lee J, Hartman M, Kornfeld H. Macrophage apoptosis in tuberculosis. Yonsei medical journal. 2009;50(1):1–11. Epub 2009/03/05. PubMed Central PMCID: PMC2649858. 10.3349/ymj.2009.50.1.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Fratazzi C, Arbeit RD, Carini C, Balcewicz-Sablinska MK, Keane J, Kornfeld H, et al. Macrophage apoptosis in mycobacterial infections. Journal of leukocyte biology. 1999;66(5):763–4. Epub 1999/11/30. [DOI] [PubMed] [Google Scholar]
  • 35.Pan H, Yan BS, Rojas M, Shebzukhov YV, Zhou H, Kobzik L, et al. Ipr1 gene mediates innate immunity to tuberculosis. Nature. 2005;434(7034):767–72. Epub 2005/04/09. PubMed Central PMCID: PMC1388092. 10.1038/nature03419 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Placido R, Mancino G, Amendola A, Mariani F, Vendetti S, Piacentini M, et al. Apoptosis of human monocytes/macrophages in Mycobacterium tuberculosis infection. The Journal of pathology. 1997;181(1):31–8. Epub 1997/01/01. [DOI] [PubMed] [Google Scholar]
  • 37.Klingler K, Tchou-Wong KM, Brandli O, Aston C, Kim R, Chi C, et al. Effects of mycobacteria on regulation of apoptosis in mononuclear phagocytes. Infection and immunity. 1997;65(12):5272–8. Epub 1997/12/11. PubMed Central PMCID: PMC175759. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Keane J, Shurtleff B, Kornfeld H. TNF-dependent BALB/c murine macrophage apoptosis following Mycobacterium tuberculosis infection inhibits bacillary growth in an IFN-gamma independent manner. Tuberculosis. 2002;82(2–3):55–61. Epub 2002/10/03. [DOI] [PubMed] [Google Scholar]
  • 39.Briken V, Miller JL. Living on the edge: inhibition of host cell apoptosis by Mycobacterium tuberculosis. Future microbiology. 2008;3(4):415–22. Epub 2008/07/25. PubMed Central PMCID: PMC2650273. 10.2217/17460913.3.4.415 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Keane J, Balcewicz-Sablinska MK, Remold HG, Chupp GL, Meek BB, Fenton MJ, et al. Infection by Mycobacterium tuberculosis promotes human alveolar macrophage apoptosis. Infection and immunity. 1997;65(1):298–304. Epub 1997/01/01. PubMed Central PMCID: PMC174591. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Aguilo JI, Alonso H, Uranga S, Marinova D, Arbues A, de Martino A, et al. ESX-1-induced apoptosis is involved in cell-to-cell spread of Mycobacterium tuberculosis. Cell Microbiol. 2013;15(12):1994–2005. Epub 2013/07/16. 10.1111/cmi.12169 [DOI] [PubMed] [Google Scholar]
  • 42.Kumar V, Abbas AK, Aster JC, Robbins SL. Robbins basic pathology 9th ed. Philadelphia, PA: Elsevier/Saunders; 2013. xii, 910 p. p. [Google Scholar]
  • 43.Schaible UE, Kaufmann SH. Malnutrition and infection: complex mechanisms and global impacts. PLoS medicine. 2007;4(5):e115 Epub 2007/05/03. PubMed Central PMCID: PMC1858706. 10.1371/journal.pmed.0040115 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Williams EP, Mesidor M, Winters K, Dubbert PM, Wyatt SB. Overweight and Obesity: Prevalence, Consequences, and Causes of a Growing Public Health Problem. Current obesity reports. 2015;4(3):363–70. Epub 2015/12/03. 10.1007/s13679-015-0169-4 [DOI] [PubMed] [Google Scholar]
  • 45.Kremer L, Estaquier J, Brandt E, Ameisen JC, Locht C. Mycobacterium bovis Bacillus Calmette Guerin infection prevents apoptosis of resting human monocytes. European journal of immunology. 1997;27(9):2450–6. Epub 1997/10/28. 10.1002/eji.1830270945 [DOI] [PubMed] [Google Scholar]
  • 46.Molloy A, Laochumroonvorapong P, Kaplan G. Apoptosis, but not necrosis, of infected monocytes is coupled with killing of intracellular bacillus Calmette-Guerin. The Journal of experimental medicine. 1994;180(4):1499–509. Epub 1994/10/01. PubMed Central PMCID: PMC2191680. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.WHO. Global tuberculosis control 2009: surveillance, planning, financing WHO report 2009. In: WHO, editor. Geneva: WHO; 2009. [Google Scholar]
  • 48.Social SSdSyP. Coberturas de vacunación por vacuna, grupos de edad, municipio y subregión, departamento de Antioquia, acumulado de enero a diciembre durante el período de los años 2007 a 2015 Medellín: Secretaría Seccional de Salud y Protección Social; 2013 [cited 2013]. Available from: https://www.dssa.gov.co/index.php/estadisticas/coberturas-de-vacunacion.

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Data are available at https://figshare.com/s/345c12095c00c3ca6092. The data is in anonymized form that complies with data protection/privacy laws.


Articles from PLoS ONE are provided here courtesy of PLOS

RESOURCES