Skip to main content
Scientific Reports logoLink to Scientific Reports
. 2017 Aug 21;7:8956. doi: 10.1038/s41598-017-09165-6

T follicular helper cells and antibody response to Hepatitis B virus vaccine in HIV-1 infected children receiving ART

Yonas Bekele 1,2, Desalegn Yibeltal 2,3, Kidist Bobosha 2, Temesgen E Andargie 2, Mahlet Lemma 2, Meseret Gebre 4, Eyasu Mekonnen 3, Abiy Habtewold 3, Anna Nilsson 5, Abraham Aseffa 2, Rawleigh Howe 2, Francesca Chiodi 1,
PMCID: PMC5566956  PMID: 28827754

Abstract

HBV vaccine has 95% efficacy in children to prevent HBV infection and related cancer. We conducted a prospective study in HIV-1 infected children receiving ART (n = 49) and controls (n = 63) to assess humoral and cellular responses to HBV vaccine provided with three doses under an accelerated schedule of 4 weeks apart. At 1 month post-vaccination all children, except 4 HIV-1 infected, displayed protective antibody (ab) titers to HBV vaccine; ab titers were lower in infected children (P < 0.0001). Ab titers decreased (P < 0.0001) in both HIV-1 infected and control children at 6 months. The frequency of circulating Tfh (cTFh) cells was 20.3% for controls and 20.8% for infected children prior to vaccination and remained comparable post-vaccination. Cytokine expression by cTfh cells upon activation with HBV antigen was comparable in the two groups at baseline and 1 month post-vaccination. Higher plasma levels (P < 0.0001) of CXCL13 were found in infected children which correlated with cTfh cell frequency at baseline. In conclusion, a lower ab response to HBV vaccine was measured in HIV-1 infected children. The frequency and activation profile of cTfh cells was comparable in infected children and controls suggesting that cells other than Tfh cells are responsible for impaired ab response to HBV vaccine.

Introduction

Hepatitis B Virus (HBV) causes a life-threatening infection which can lead to hepatocellular liver carcinoma (HCC), the second leading cause of death among all cancers, or cirrhosis. HBV is highly endemic in sub-Saharan Africa and East Asia with 5–10% prevalence of chronic HBV infections. The complications of HBV infection typically affect adults; much of the burden of chronic HBV is, however, due to childhood infection. Vaccination against HBV virus has shown to effectively prevent HBV infection, perinatal HBV transmissions and up to 90% of HBV related deaths1; the safety and immunogenicity of vaccines differ with age, genetic background, co-morbidities, gender and type of administered vaccine. While the HBV vaccine was shown to be protective in HIV-1 seronegative individuals, HIV-1 infected individuals showed a less optimal and durable serological response to this vaccine2.

Administration of injectable vaccines, including HBV, results in presentation of vaccine antigens by skin dendritic cells (DCs) which initiates cascades of cellular and humoral immune responses in a special microstructure of the lymph node called germinal center (GC)3. In the GC, CD4+ T cells will be activated by DCs and polarize towards a T follicular helper (Tfh) cell lineage through the up-regulated expression of Bcl-6, CXCR5, ICOS and PD-14; cells committed to the Tfh cell lineage also down-regulate CCR7 expression to migrate into the B cells follicle in response to CXCL13 chemo-attraction. The efficiency of T-B cells interaction within the GC is crucial for development of memory B cells and ab producing plasma cells; a potent ab response induced by HBV vaccination through B and T cell interaction will protect individuals for decades5, 6.

Tfh cells have been described through different lineage and differentiation markers as: CXCR5+CD4+ T cells7, 8, PD-1+CXCR5+ or ICOS+CXCR5+ CD4+ T cells9, CD4+CD45RO+CXCR5+ T cells10, ICOS+PD-1+CXCR3+ among memory CD4+ T cells11, CCR7highCXCR5highCCR6highPD-1high among memory CD4+ T cells12 and CD4 + CD45RA-CXCR5+ in combination with CCR6 and CXCR3 to characterize Th1, Th2 and Th17 like Tfh cells13. Memory Tfh cells found in blood are representative of the Tfh cells found in lymphoid tissue14, 15; thus studying cTfh cells offers a valid approach to dissect the immunology of tissue Tfh cells, especially when examining clinical specimens.

Vaccination studies conducted in humans and in animal models showed that vaccine responses correlated with the frequency of cTfh cells. Specific ab responses induced upon influenza vaccination correlated with the frequency of ICOS + CXCR3+ T fh cells11 and an increase in the number of Tfh cells expressing ICOS + PD-1+ correlated with the avidity of abs to influenza vaccine16. Elderly people have a reduced ab response to vaccines due to a declined frequency of cTfh cells and T cell specimens from elderly people provide poor B cell help in culture17. Tfh cells produce cytokines, including IL-21 and IL-4, important for differentiation and maturation of B cells. Spensieri et al.18 examined the cytokine expression of cTfh cells and found that the frequency of CD4 + IL-21 + ICOS+ T cells correlated with the hemagglutination inhibition (HAI) titers induced upon influenza vaccination. Simian immunodeficiency virus (SIV) vaccine candidates administered to rhesus macaques induced long-lasting vaccine-specific Tfh cells which could be found for more than 53 weeks after the last vaccination dose; in vaccinated macaques, vaccine specific memory B cells correlated with the frequency of Tfh cells19. A vaccination trial with a recombinant Ebola vaccine candidate (rVSV-ZEBOV) showed that the frequency of Tfh cells increased after vaccination and that Th17-like Tfh cells increased more as compared to Th1- or Th2-like Tfh cells7.

Recent finding showed that the plasma levels of CXCL13, the chemokine responsible for migration of Tfh cells to the GCs, correlated with the amplitude of specific ab responses induced upon vaccination20. Thus CXCL13 in plasma could represent a potential biomarker to monitor vaccine responses in lymphoid tissue of humans which are otherwise inaccessible for large clinical studies. Higher CXCL13 plasma levels were also reported in various pathological conditions in humans2126.

In the current study, we measured the ab responses to HBV vaccine provided with three vaccine doses under accelerated schedule of 4 weeks apart in HIV-1 infected children and healthy controls at 1 and 6 months post vaccination. We measured the frequency of cTfh cells and assessed the expression of IFN-γ, IL-2, IL-4 and IL-21 cytokines in these cells following stimulation of peripheral blood mononuclear cells (PBMCs) with hepatitis B surface antigen (HBsAg). We also measured the levels of CXCL13 in plasma to assess its potential as biomarker for GC activities and response to HBV vaccination.

Results

Anti-HBs abs in plasma decline at 6 months from the last vaccination in both HIV-1 infected children and healthy controls

Plasma levels of anti-HBs abs were measured in specimens from HIV-1 infected children and healthy controls prior to and following vaccination. The plasma concentration of anti-HBs abs before vaccination was below the detection limit of the assay for all children included in the study. After one month from the last vaccination, 61 (96.8%) healthy controls and 35 (71.4%) HIV-1 infected children were high responders with titers of anti-Hbs abs between >2–4.4 log IU/L [Fig. 1A]. Among the vaccinated, 10 HIV-1 infected children (20.4%) and 2 healthy controls (3.2%) were weak responders with median titers between 1–2 log IU/L. Four HIV-1 infected children were non-responders with titers below 1 log IU/L.

Figure 1.

Figure 1

Anti-HBs ab levels in healthy controls and HIV-1 infected children at 1 month and 6 months post-vaccination. Anti-HBs abs were measured in plasma specimens from healthy controls (n = 63) and HIV-1 infected (n = 49) children at baseline and at 1 month (A) and 6 months (B) [healthy controls (n = 57) and HIV-1 infected children (n = 43) children] after vaccination. All children had undetectable anti-HBV ab levels before vaccination and after three doses of HBV vaccine, all children, except 4 HIV-1 infected (non-responder), responded with production of specific HBV abs. When ab titers to HBV vaccine were compared within the same group of healthy or HIV-1 infected children (C), a decline in ab titer was detected at 6 months from the last vaccination dose in both groups. Unpaired T test was used for panels A and B and paired T test for panel C. The lines represent the median values in the figures. ***p < 0.001 and ****p < 0.0001.

Anti-HBs ab levels were significantly lower in HIV-1 infected children compared to healthy controls at 1 month from the last vaccination [median 2.44 (range: 0.1–3.8) log IU/L vs 3.3 (range: 1.9–4.4) log IU/L, P < 0.0001] [Fig. 1A]. We also compared the median levels of anti-HBs abs after 6 months from the last vaccination [Fig. 1B] in healthy controls (2.8 log IU/L, range: 1.5–4 log IU/L) and HIV-1 infected children (median 1.9 log IU/L, range: 0.1–3.5 log IU/L); the difference between the groups at this time point was also highly significant (P < 0.001). Nine (21%) of the HIV-1 infected children were found to be non-responders at 6 months; this pattern was not detected in any of the healthy controls. The levels of anti-HBs abs decreased significantly between 1 and 6 months from the last vaccination in both HIV-1 infected children (P < 0.0001) and healthy controls (P < 0.0001) [Fig. 1C].

Similar frequency of cTfh cells before and after vaccination in HIV-1 infected and control children

The gating strategy for identification of cTfh cells is illustrated in Supplementary Figure 1. We measured the frequency of cTfh cells before and after vaccination in HIV-1 infected children and controls and no significant difference was detected in the frequency of Tfh cells between the groups. The median frequency of cTfh cells prior to vaccination was 20.3% (range: 6.0–33.5%) for healthy controls and 20.8% (range: 6.7–41.2%) for HIV-1 infected children (Fig. 2A). At 1 month after vaccination, the median frequency of cTfh cells was 26.0% (range: 12.6–43.8%) in healthy controls and 22.3% (range: 5.8–41.3%) in HIV-1 infected children (Fig. 2A).

Figure 2.

Figure 2

Frequency of cTfh cells and of Th1-, Th2- and Th17-like cTfh cells. The frequency of cTfh cells (A) and Th1-, Th2- and Th17-like cTfh cells (BD) was measured in specimens from healthy controls and HIV-1 infected children. 22 healthy controls (HC) and 19 HIV-1 infected children were examined at baseline (BL) and 36 HC and 25 HIV-1 infected children after 1 month from last vaccination. A correlation between CD4+ T cell count and Th17-like cTfh cells was found at baseline in HIV-1 infected children (E). Unpaired and paired T test was used to calculate the differences between and within the groups. ns = not statistical significant, *p < 0.05, and **p < 0.01.

We also assessed the frequency of Th1, Th2 and Th17-like cTfh cells by characterizing CCR6 and CXCR3 expression on cTfh cells (Fig. 2B–D). The frequency of Th1-like cTfh (CXCR3 + CCR6−) was lower at 1 month post-vaccination as compared to baseline in healthy controls (31.8 vs 29.1%, P = 0.03). Prior to vaccination, a higher frequency of cTfh cells with a Th2-like phenotype (CXCR3 − CCR6−) was found in healthy controls compared to HIV-1 infected children (41 vs 34%, P = 0.01); no difference, was however, detected for this subset of cTfh cells at 1 month post-vaccination.

The frequency of Th17-like cTfh cells (CXCR3 − CCR6+) was significantly higher in HIV-1 infected children compared to healthy controls at baseline (median: 21.8 vs 13.3%, P = 0.007) [Fig. 2D]. After vaccination however, the frequency of Th17-like cTfh cells significantly increased in healthy controls compared to baseline (median: 13.3 vs 20.1%, P = 0.007), whereas the frequency of Th17-like cTfh cells remained similar when comparing baseline and 1 month post-vaccination in HIV-1 infected children (19.0 vs 21.8%, P > 0.05).

We then analysed the levels of anti-HBs abs in relation to the frequency of cTfh cells, CD4+ T cell count and length of ART treatment. A significant negative correlation was found between the CD4+ T cell count and the frequency of Th17-like cTfh cells in HIV-1 infected children prior to vaccination (r = −0.51, p = 0.03) (Fig. 2E).

Cytokine expression in Tfh cells stimulated with HBsAg

PBMCs were cultured for 5 days in presence of the CD28/CD49d costimulatory complex alone or together with the HBsAg and the frequency of cTfh cells expressing IFN-γ, IL-2, IL-4 and IL-21 was measured. The gating strategy for the identification of cytokine expressing cTfh cells in HBsAg activated PBMCs is shown in Supplementary Figure 1.

At baseline, there was no difference between the frequencies of cTfh cells expressing cytokines in samples stimulated with the co-stimulatory complex alone or in presence of the HBsAg. Comparing the cytokine expression in cTfh cells in specimens from healthy controls and HIV-1 infected children stimulated with HBsAg, we found a similar frequency of cTfh cells expressing IFN-γ, IL-2, IL-4 and IL-21 between the two groups at baseline; the median frequency of IFN-γ was 3.2 vs 3.0%; IL-2, 3.2 vs 2.7%; IL-4, 3.8 vs 3.9% and IL-21, 4.0 vs 4.8% in healthy controls and HIV-1 infected children, respectively [Fig. 3A–D]. Cytokine expression in cTfh cells stimulated with the HBsAg protein significantly increased in specimens from 1 month after vaccination compared to baseline in both healthy controls and HIV-1 infected children. In healthy controls, the frequency of cTfh cells expressing IFN-γ (3.3 vs 5.5%, P < 0.01), IL-2 (3.4 vs 4.0%, P < 0.01), IL-4 (3.9 vs 6.1%, P < 0.001) and IL-21 (4.1 vs 7.9%, P < 0.01) was significantly increased in specimens obtained at 1 month post vaccination. Similarly, in specimens from HIV-1 infected children, the expression of IFN-γ (3.0 vs 4.4%, P < 0.01), IL-2 (2.7 vs 4.3%, P < 0.01), IL-4 (3.9 vs 7.0%, P < 0.01) and IL-21(4.8 vs 6.6%, P < 0.01) was increased significantly at 1 month post-vaccination compared with baseline. The cytokine expression in cTfh was comparable between healthy controls and HIV-1 infected children following vaccination [Fig. 3A–D]. In presence of HBsAg, the expression of IFN-γ, IL-4 and IL-21 increased significantly compared to stimulation with costimulatory complex alone. On the other hand, at 1 month post-vaccination, IL-2 expression increased to a significant level only in PBMCs from HIV-1 infected children treated with HBsAg [Fig. 3B], but not in healthy controls.

Figure 3.

Figure 3

Expression of IFN-γ, IL-2, IL-4 and IL-21 by cTfh cells. The expression of cytokines IFN-γ, IL-2, IL-4 and IL-21 by cTfh cells in specimens from HIV-1 infected children and healthy controls after 5 days of culture is shown. Anti-human CD28/CD49d alone (Cos) or anti-human CD28/CD49d together with HBsAg protein (Ag) were added to the cultures. The expression of IFN-γ, IL-2, IL-4 and IL-21 among cTfh cells (Figure AD) in response to HBsAg is shown for 20 healthy controls and 20 HIV-1 infected children at baseline (BL) and for 31 HC and 26 HIV-1 infected children at 1 month (M1) after vaccination. Samples from HC (BL = 4 and M1 = 9) and HIV-1 infected children (BL = 8 and M1 = 10) were used in culture stimulated with the CD28/CD49d complex. ns = not statistical significant, *p < 0.05, **p < 0.01 and ***p < 0.001.

We analyzed whether there was a correlation between the length of pre-ART period, length of ART treatment, CD4+ T cell counts and viral load with the frequency of cytokine expressing cTfh cells at 1 month from vaccination in HIV-1 infected children. We could identify a positive significant correlation between the length of ART treatment and the frequency of IL-4 + cTfh cells (r = 0.42; p = 0.03).

High levels of CXCL13 in plasma from HIV-1 infected children

Plasma levels of CXCL13 were measured before and after vaccination in HIV-1 infected children and healthy controls. The levels of CXCL13 were significantly higher (p < 0.0001) in HIV-1 infected children prior to vaccination (median: 2.5 log pg/ml; range: 2.1–3.2 log pg/ml) compared to healthy controls (median: 2.2 log pg/ml; range: 1.7–3.1 log pg/ml) [Fig. 4A]. There was no change in CXCL13 concentration after vaccination within the groups. HIV-1 infected children had a higher median of CXCL13 plasma level at 1 month and 6 months post-vaccination (p < 0.0001) compared to healthy controls (2.4 vs 2.2 log pg/ml and 2.4 vs 2.2 log pg/ml, respectively).

Figure 4.

Figure 4

CXCL13 levels in plasma of healthy controls and HIV-1 infected children prior to vaccination and at 1 and 6 months post vaccination. CXCL13 was measured prior to vaccination and at 1 and 6 months post vaccination in specimens from healthy controls (n = 63, 62 and 53) and HIV-1 infected children (n = 49, 47 and 41) (A). ANOVA was used to calculate the differences between healthy controls and HIV-1 infected children at the 3 time points. Unpaired T test was also used to calculate the differences between healthy controls and HIV-1 at individual time points. The lines represent the median values in the figures. ****p < 0.0001. A correlation was found between the plasma levels of CXCL13 and anti-HBs abs at 6 months from the last vaccination in healthy controls (panel B: n = 53). A significant correlation was found in the group of healthy controls at 1 month post vaccination (C; n = 35) and HIV-1 infected children when comparing the levels of plasmatic CXCL13 expression and frequency of cTfh cells at baseline (D; n = 19). HIV = HIV-1 infected children; HC = healthy controls.

We correlated the levels of plasma CXCL13 with the frequency of cTfh cells, Th1-, Th2- and Th17-like Tfh cells and the levels of anti-HBV vaccine abs (Table 1). At 6 months from the last vaccination, plasma levels of CXCL13 were positively correlated with anti-HBs ab (r = 0.41, p = 0.003) [Fig. 4B] levels only in healthy controls. In healthy controls a negative correlation was found between the frequency of cTfh cells and the plasma levels of CXCL13 at 1 month post vaccination (r = −0.37, p = 0.03) [Fig. 4C].We found a positive correlation between the frequency of cTfh cells and plasma levels of CXCL13 in HIV-1 infected children prior to vaccination (r = 0.58, p = 0.01) [Fig. 4D] but this correlation was not found prior to vaccination in healthy controls.

Table 1.

Correlation of plasma CXCL13 with sub-populations of Tfh cells and antibodies to HBV vaccine.

Parameters analyzed CXCL13 HC CXCL13 HIV-1
At baseline
cTfh cells ns r = 0.58
p = 0.01
Th1-like Tfh cells ns ns
Th2-like Tfh cells ns ns
Th17-like Tfh cells ns ns
At month 1
cTfh cells r = −0.37 ns
p = 0.03
Th1-like Tfh cells ns ns
Th2-like Tfh cells ns ns
Th17-like Tfh cells ns ns
Anti-HBs Abs ns ns
At month 6
Anti-HBs Abs r = 0.41 ns
p = 0.003

HC = healthy children; ns = not significant.

Discussion

The introduction of HBV vaccine in countries with a high burden of HBV infection has significantly reduced the prevalence of this infection and related complications27. Several clinical trials have previously shown that an accelerated vaccination schedule increases the likelihood of inducing high ab response in highly HBV endemic areas and in individuals who are at risk of acquiring HBV infection, especially immuno-compromised patients2833. In our prospective vaccination study, healthy controls and HIV-1 infected children received three doses of HBV vaccine and 96% of the children responded to this vaccine with an increased titer of anti-HBV vaccine abs at 1 month from the last vaccination dose. Anti-HBs ab titers, however, declined significantly in both healthy controls and HIV-1 infected children at 6 months from the last vaccination and, at this time point, a significant proportion (21%) of HIV-1 infected children were non-responders with anti-HBs Abs titers lower than the cut-off value for protection. The rapid decline in protective abs to HBV vaccine in HIV-1 infected individuals is a known phenomenon which requests special attention; in this group of patients a second series of vaccination or increasing the vaccine dose may be alternative strategies34, 35. Despite the rapid decline in protection previously noticed following HBV vaccination and the recommendation formulated by experts to introduce a fourth booster of HBV vaccine in order to slow down the rapidly declining HBV vaccine ab levels30, 36, most African countries still provide only three doses of HBV vaccine.

T-cell dependent vaccine responses rely on the formation of specialized structures within the GC and the differentiation of ab producing cells9. In order to understand whether the cellular components involved in the GC may be affected in their phenotype and function during HIV-1 infection, we determined the frequency of cTfh cells in healthy controls and HIV-1 infected children. To our surprise, the frequency of cTfh cells was comparable in the two groups of HIV-1 infected children and healthy controls and was not affected by vaccination. We could not find a correlation between ab responses to HBV in HIV-1 infected and control children and frequency of cTfh cells. A correlation between cTfh cells and Ab responses has been reported for other T-cell dependent types of vaccines including influenza virus11, 16. Accordingly, it is possible that the engagement of cTfh cells and their activation upon vaccination may differ between vaccines. Our previous results revealed a lower frequency of cTfh cells in blood of HIV-1 infected children compared to healthy controls37. This discrepancy in the frequency of Tfh cells between the previously published and present studies could be due to an improved response to ART in HIV-1 infected children in Ethiopia, possibly by earlier ART initiation and increased adherence. Another study assessing influenza vaccine responses recently reported that the frequency of peripheral Tfh in HIV-1 infected and healthy children was similar between the groups and independent from the hemagglutination inhibition titers which were used to group HIV-1 infected children in responders and not responders38.

We also measured the frequency of Th1, Th2 and Th17-like cTfh cells using CXCR3 and CCR6 expression13. We found that the frequency of Th17-like cTfh cells was significantly higher in HIV-1 infected children compared to controls prior to vaccination and that the CD4+ T cell count and the frequency of Th17-like cTfh cells were negatively correlated. In the group of healthy controls included in our study, the frequency of Th17-like cTfh cells increased after vaccination. A similar observation was reported by Farooq et al.7, showing that rVSV-ZEBOV Ebola vaccine induces higher frequencies of Th17-like Tfh cells but not of Th1 or Th2 Tfh cells in humans. These findings should promote further investigations to assess the role that Th17-like Tfh cells may play in vaccine response.

We also addressed the capacity of cTfh cells to express cytokines in vitro in response to HBV antigenic stimulation and showed, for the first time, that cTfh cells expressed IFN-γ, IL-2, IL-4 and IL-21 upon stimulation with HBsAg. Litjens and collaborators39 studied how IFN-γ + CD4+ T cells and different subsets of memory CD4+ T cells obtained from HBV vaccinated individuals responded to stimulation with HBsAg. They showed that HBsAg specific IFN-γ producing CD4+ T cells were significantly higher in vaccinated compared to non-vaccinated healthy adults. In our study, the frequency of cTfh cells expressing cytokines in response to HBsAg significantly increased in both HIV-1 infected children and controls after vaccination. Several studies confirmed the role of IL-21, produced by Tfh cells, to induce B cells differentiation into memory B cells and ab-producing cells40, 41. In IL-21 knockout mice, the formation of GC is normal but the GC reaction declines rapidly and affects ab production42, 43. Studies performed in IL-4 knockout mice showed that lack of IL-4 resulted in reduced IgG1 production due to loss of class switching function and that blocking the IL-4Rα reduced plasmablast density in the lymph nodes44. Although IL-4 and IL-21 cooperate for efficient ab production and GC reaction45, these two main Tfh cell cytokines work independently from one another as IL-21 is expressed earlier than IL-4; efficient GC B cells somatic hypermutation is mediated by IL-21 and plasma cell differentiation and class switching by IL-446. The production of IL-21, however, influences IL-4 levels as shown by reduced IL-4 production in IL-21 knockout mice. In the present study, the decline in anti-HBs abs’ levels following vaccination was more pronounced in HIV-1 infected children; however cTfh cells from HIV-1 infected and control children once exposed to HBsAg showed similar IL-21 and IL-4 expression. These results suggest that the function of other cells important to sustain ab response may be impaired in HIV-1 infection. The IL-4 expression in HBsAg stimulated cTfh cells from vaccinated HIV-1 infected children showed a correlation with the length of ART treatment illustrating the beneficial effect of ART on parameters of vaccine responses.

CXCL13, mainly secreted by follicular DCs, is a chemoattractant critical for the distribution of lymphocytes within the GC20. In this study, elevated plasma CXCL13 concentration was measured in HIV-1 infected children compared to controls at baseline. It has been previously reported that elevated plasma CXCL13 levels can be found during HIV-1 infection produced by activated monocytes and that increased CXCL13 production during HIV-1 infection may lead to impairment of B cell function20, 47. In the present study we could not detected any change in CXCL13 concentration after vaccination in either control or HIV-1 infected children. Havenar-Daughton and collaborators20 reported an increase in plasma CXCL13 concentration in two cohorts of non-HIV infected individuals following vaccination with either yellow fever virus vaccine or with a candidate HIV vaccine. A positive correlation was also reported between the frequency of GC Tfh cells and plasma CXCL13 concentration in the latter study20 in a small number of HIV-1 infected and non-infected individuals. It is interesting that, prior to vaccination, there was a positive correlation between CXCL13 and the frequency of cTfh cells in the group of HIV-1 infected subjects in our study which could not be demonstrated in the group of healthy children. We also found a positive correlation between CXCL13 and the titers of anti-HBs abs in healthy controls at 6 months post-vaccination. Further studies are needed to confirm the validity of monitoring GC functions during vaccination in humans by measuring CXCL13 in plasma and to clarify whether the high CXCL13 level in the serum of HIV-1 infected patients promotes or disrupts the capacity of the individuals to respond to vaccination.

In conclusion, our results showed that three doses of HBV vaccine induced protective titers of anti-HBs abs at 1 month after vaccination in HIV-1 infected children which rapidly declined at 6 months post-vaccination, suggesting the need for an additional vaccine dose to booster the titers of specific abs in circulation. The capacity of cTfh cells to respond to stimulation with HBV antigens is comparable between HIV-1 infected and control children. Further studies are accordingly needed to pin-point the molecular and immunological mechanisms responsible for reduced Ab production in HIV-1 infected children receiving HBV vaccine.

Method and Materials

Study design and participants

The study was conducted at Zewditu Memorial Hospital and the Pediatric department of the All Africa Leprosy, Tuberculosis and Rehabilitation Training Center (ALERT) in Addis Ababa, Ethiopia. Age matched healthy controls were recruited from two child care centers in Addis Ababa (Muday Charity organization and SOS village). A total of 158 children, 93 HIV-1 negative and 65 HIV-1 positive, were enrolled in the study. All participants underwent an initial screening for previous or active HBV infection; children showing previous or active infection with HBV were excluded from the study. HBV vaccine was administrated intramuscularly to a total of 63 non HIV-1 infected controls and 49 HIV-1 infected children; all HIV-1 infected children received antiretroviral treatment (ART). Clinical parameters were collected from all children (Table 2).

Table 2.

Clinical characteristics of healthy controls and HIV-1 infected children included in the HBV vaccination study.

Characteristic Controls (N = 63) HIV-1 (N = 49)
Age (years): Mean (Range) 6.7 (4.0–8.0) 7 (4.0–9.0)
Gender
  Male 42 (66.7%) 25 (51.0%)
  Female 21 (33.3%) 24 (49.0%)
MUAC
  <13.5 cm 5 (10.2%)
  13.5–14.5 cm 5 (7.9%) 10 (20.4%)
  >14.5 cm 58 (92.1%) 34 (69.4%)
CD4+ T cell count (cells/μl): Mean (Range) ND 933.3 (195–2744)
WHO stage
  I NA 27 (55.1%)
  II 15 (30.6%)
  III 4 (8.2%)
  IV 3 (6.1%)
ART regimen
    First line
   AZT + 3TC + NVP NA 39 (79.6%)
   AZT + 3TC + EFV 3 (6.1%)
   ABC + 3TC + EFV 4 (8.2%)
   ABC + 3TC + NVP 1 (2.0%)
    Second line
   ABC + ddl + LPV/r 1 (2.0%)
   AZT + 3TC + LPV/r 1 (2.0%)
Months on ART: Mean (Range) NA 41,8 (0.03–85)
Months pre-ART: Mean (Range) NA 41.5 (2–100)
Viral load (Copies/ml)
   <150 copies/ml NA 36 (73.5%)
   150–999 copies/ml 4 (8.1%)
   1000–57001 copies/ml 9 (18.4%)

ND = not done.

NA = not applicable. MUAC = Mid-Upper Arm Circumference.

The project proposal was reviewed and approved by the ethical review committees of the Armauer Hansen Research Institute (AHRI) Addis Ababa, the IRB of College of Health Sciences, Addis Ababa University, Addis Ababa Health Bureau Ethics Board and the National Research Ethics Review Committee of Ethiopia. Written informed consent was obtained from the parents or guardians of study participants following a clear explanation of the study purpose, benefit and possible discomfort. The ethical committee at the Karolinska Institutet approved the study of the patient material collected during the vaccination study in Addis Ababa. All experiments were performed in accordance with relevant guidelines and regulations.

Vaccine administration and blood sampling

The vaccine used in our study was the Hepatitis B vaccine (rDNA), (Serum Institute of India, India) which consists of purified HBsAg. All children received 3 doses (each of 10 μg) with 4 weeks interval (accelerated vaccination schedule) in between the doses30. There was no severe adverse event reported upon vaccination in either healthy controls or HIV-1 infected children. Blood (3–5 ml) was collected at baseline (prior to vaccination) and at 1 and 6 months from the last dose of vaccine. Six children in the group of HIV-1 infected and 6 healthy controls were lost for sample collection at 6 months.

PBMCs were isolated by Ficoll gradient centrifugation and stored in 90% fetal bovine serum (Sigma-Aldrich, USA) and 10% dimethyl sulfoxide (DMSO) (Sigma-Aldrich, USA) in liquid nitrogen at −196 °C. Plasma specimens were frozen at −80 °C until further analyses were conducted.

Determination of plasma anti-HBs abs and CXCL13 titers by ELISA

The HBsAg EIA 3.0 enzyme immunoassay and the anti-hepatitis B nucleocapsid core (anti-HBc) antigen monolisa assay (Bio-Rad, France) were used to exclude active or previous HBV infection. The anti-HBs Monolisa Plus assay (Bio-Rad, France) and Human CXCL13 DuoSet ELISA (R&D systems, Minneapolis, MN) were used to measure the plasma levels of anti-HBs abs and CXCL13 chemokine, respectively. The assays were run according to the instruction provided by the manufacturers and all samples and standards were tested in duplicate. The OD values were converted to concentrations using Microplate manager version 6 (Bio-Rad, California, USA).

Plasma HIV-1 viral load determination

RNA was extracted from plasma using an automated m2000sp Abbott Real-Time HIV-1 assay system following the manufacturer’s protocol (Abbot Laboratories, Abbot Park, IL). Plasma HIV-1 RNA levels were measured using Quantitative Real-Time HIV-1 assay by the Abbott m2000rt instrument with the lower detection limit of 40 copies/ml.

In the present study, 73.5% (36) of the HIV-1 infected children had levels of plasma HIV-1 RNA below 150 copies/ml prior to vaccination and only 18.4% (9) of them had over 1000 copies/ml. At 1 month post-vaccination all children with HIV-1 RNA below 150 copies/ml at baseline displayed HIV-1 RNA below 150 copies/ml, except 4 children with over 1000 copies/ml after vaccination.

Characterization of cTfh cells

PBMCs were thawed and washed in complete RPMI-1640 medium supplemented with L-glutamine, in the presence of 10% FCS and penicillin-streptomycin (Thermo Scientific, South Logan, Utah, USA). To characterize cTfh cells, defined as CD4 + CD45RO + CXCR5+ T cells, PBMCs were stained with the following monoclonals: V500 anti-CD4 (L200), FITC anti-CD45RO (UCHL1), PerCp/Cy5.5 anti-CXCR5 (RF8B2), APC anti-CXCR3 (1C6/CXCR3), PE-Cy7 anti-CCR6 (11A9), all from BD Biosciences, and LIVE/DEAD® Fixable Near Infrared dead Cell Stain (Molecular Probes by Life Technologies, OR, USA). To assess the cytokine expression of cTfh cells in response to stimulation with HBsAg, PBMCs were cultured at a concentration of 1.5 × 106 cells/ml with either the BD FastImmune CD28/CD49d (BD, San José, CA, USA) costimulatory complex or with CD28/CD49d complex together with the HBsAg (Subtype adw9; Fitzgerald, Concord, MA, USA)39. Cells were cultured for 5 days and 1 μl/ml Golgistop (BD, San José, CA, USA) was added to all culture conditions during the last 6 hours of incubation to block release of cytokines from cells. Thereafter cells were first stained for cell surface markers with the following monoclonals: Texas red anti-CD4 (RFT-4g; Abcam, Cambridge, UK), FITC anti-CD45RO (UCHL1; BD), PE-Cy7 anti-CXCR5 (J252D4; BioLegend, San Diego, CA, USA) and LIVE/DEAD® Fixable Near-IR dead Cell Stain (Life Technologies, Eugene, OR, USA). Cells were fixed and permeabilized using the BD Cytofix/Cytoperm kit according to the protocol from the manufacturer and thereafter stained with BV421 anti-IL-2 (5344.111), APC anti-IL-4 (MP4-25D2), BV711 anti-IFN-γ (B27) all from BD and PE anti-IL-21 (3A3-N2) from eBioscience (San Diego, CA, USA).

Cells were fixed in 2% paraformaldehyde; the samples were acquired in the LSR-II flow cytometer (BD Biosciences) and analyzed using FlowJo V9.8 (Tree Star Inc., Ashland, Oregon, USA).

Data analysis and interpretation

Statistical analysis of the clinical characteristics was computed using a SPSS version 23 (IBM Corp, Armonk, NY, USA). The GraphPad prism version 7 (La Jolla, CA, USA) was used for ELISA and flow cytometry data analyses. ANOVA and t-test were used to assess the differences between HIV-1 infected and healthy controls pre and post-vaccination. Spearman correlation was also used to demonstrate the relationship between two continuous variables. A P value less than 0.05 was considered statistically significant.

Data availability statement

We will make upon request materials, data and associated protocols promptly available to readers.

Electronic supplementary material

Acknowledgements

The study was supported with grants from the Swedish Medical Research Council (grant number: 521-2012-3520). Yonas Bekele is the recipient of a PhD scholarship from the Karolinska Institutet.

Author Contributions

Yonas Bekele: designed the study, applied for ethical permission in Ethiopia, participated in the collection of specimens, performed all experiments on Tfh cells, reviewed all data and wrote the manuscript; conducted the analyses and modified the text upon revision of manuscript. Desalegn Yibeltal: participated in the collection of specimens and measured antibody titers to the vaccine; read and approved the manuscript. Kidist Bobosha: organized the collection of specimens in Ethiopia, participated in the writing, read and approved the manuscript. Temesgen E. Andargie: participated in the collection of specimens and measured antibody titers to the vaccine; read and approved the manuscript. Mahlet Lemma: measured plasma levels of the CXCL13 chemokine, read and approved the manuscript. Meseret Gebre: designed the study, identified and followed HIV-1 infected children included in the study, read and approved the manuscript. Eyasu Mekonnen: wrote the ethical permit in Ethiopia, supervised DY, read and approved the manuscript. Abiy Habtewold: wrote the ethical permit in Ethiopia, supervised DY, read and approved the manuscript. Anna Nilsson: designed the study, supervised the experiments, wrote the ethical permission in Sweden, participated in the writing of the manuscript. Abraham Aseffa: designed the study, participated in the writing of the manuscript. Rawleigh Howe: designed the study, participated in the writing of the manuscript. Francesca Chiodi: designed the study, reviewed all data and wrote the manuscript; modified the text upon revision of manuscript.

Competing Interests

The authors declare that they have no competing interests.

Footnotes

Electronic supplementary material

Supplementary information accompanies this paper at doi:10.1038/s41598-017-09165-6

Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Franco E, et al. Hepatitis B: Epidemiology and prevention in developing countries. World J Hepatol. 2012;4:74–80. doi: 10.4254/wjh.v4.i3.74. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.van den Berg R, van Hoogstraten I, van Agtmael M. Non-responsiveness to hepatitis B vaccination in HIV seropositive patients; possible causes and solutions. AIDS Rev. 2009;11:157–164. [PubMed] [Google Scholar]
  • 3.Koff RS. Immunogenicity of hepatitis B vaccines: implications of immune memory. Vaccine. 2002;20:3695–3701. doi: 10.1016/S0264-410X(02)00405-X. [DOI] [PubMed] [Google Scholar]
  • 4.Nutt SL, Tarlinton DM. Germinal center B and follicular helper T cells: siblings, cousins or just good friends? Nat Immunol. 2011;12:472–477. doi: 10.1038/ni.2019. [DOI] [PubMed] [Google Scholar]
  • 5.Huang LM, Lu CY, Chen DS. Hepatitis B virus infection, its sequelae, and prevention by vaccination. Curr Opin Immunol. 2011;23:237–243. doi: 10.1016/j.coi.2010.12.013. [DOI] [PubMed] [Google Scholar]
  • 6.Plotkin SA. Correlates of protection induced by vaccination. Clin Vaccine Immunol. 2010;17:1055–1065. doi: 10.1128/CVI.00131-10. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Farooq F, et al. Circulating follicular T helper cells and cytokine profile in humans following vaccination with the rVSV-ZEBOV Ebola vaccine. Sci Rep. 2016;6 doi: 10.1038/srep27944. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Pallikkuth S, et al. Impaired peripheral blood T-follicular helper cell function in HIV-infected nonresponders to the 2009 H1N1/09 vaccine. Blood. 2012;120:985–993. doi: 10.1182/blood-2011-12-396648. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Baumjohann D, et al. Persistent antigen and germinal center B cells sustain T follicular helper cell responses and phenotype. Immunity. 2013;38:596–605. doi: 10.1016/j.immuni.2012.11.020. [DOI] [PubMed] [Google Scholar]
  • 10.Bossaller L, et al. ICOS deficiency is associated with a severe reduction of CXCR5 + CD4 germinal center Th cells. J Immunol. 2006;177:4927–4932. doi: 10.4049/jimmunol.177.7.4927. [DOI] [PubMed] [Google Scholar]
  • 11.Bentebibel SE, et al. Induction of ICOS + CXCR3 + CXCR5+ TH cells correlates with antibody responses to influenza vaccination. Sci Transl Med. 2013;5 doi: 10.1126/scitranslmed.3005191. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Boswell KL, et al. Loss of circulating CD4 T cells with B cell helper function during chronic HIV infection. PLoS Pathog. 2014;10 doi: 10.1371/journal.ppat.1003853. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Morita R, et al. Human blood CXCR5(+)CD4(+) T cells are counterparts of T follicular cells and contain specific subsets that differentially support antibody secretion. Immunity. 2011;34:108–121. doi: 10.1016/j.immuni.2010.12.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.He J, et al. Circulating precursor CCR7(lo)PD-1(hi) CXCR5(+) CD4(+) T cells indicate Tfh cell activity and promote antibody responses upon antigen reexposure. Immunity. 2013;39:770–781. doi: 10.1016/j.immuni.2013.09.007. [DOI] [PubMed] [Google Scholar]
  • 15.Locci M, et al. Human circulating PD-1+ CXCR3-CXCR5+ memory Tfh cells are highly functional and correlate with broadly neutralizing HIV antibody responses. Immunity. 2013;39:758–769. doi: 10.1016/j.immuni.2013.08.031. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Bentebibel SE, et al. ICOS(+)PD-1(+)CXCR3(+) T follicular helper cells contribute to the generation of high-avidity antibodies following influenza vaccination. Sci Rep. 2016;6 doi: 10.1038/srep26494. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Herati RS, et al. Circulating CXCR5 + PD-1+ response predicts influenza vaccine antibody responses in young adults but not elderly adults. J Immunol. 2014;193:3528–3537. doi: 10.4049/jimmunol.1302503. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Spensieri F, et al. Early Rise of Blood T Follicular Helper Cell Subsets and Baseline Immunity as Predictors of Persisting Late Functional Antibody Responses to Vaccination in Humans. PLoS One. 2016;11 doi: 10.1371/journal.pone.0157066. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Vargas-Inchaustegui DA, et al. Vaccine Induction of Lymph Node-Resident Simian Immunodeficiency Virus Env-Specific T Follicular Helper Cells in Rhesus Macaques. J Immunol. 2016;196:1700–1710. doi: 10.4049/jimmunol.1502137. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Havenar-Daughton C, et al. CXCL13 is a plasma biomarker of germinal center activity. Proc Natl Acad Sci USA. 2016;113:2702–2707. doi: 10.1073/pnas.1520112113. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Widney DP, et al. Serum levels of the homeostatic B cell chemokine, CXCL13, are elevated during HIV infection. J Interferon Cytokine Res. 2005;25:702–706. doi: 10.1089/jir.2005.25.702. [DOI] [PubMed] [Google Scholar]
  • 22.Regidor DL, et al. Effect of highly active antiretroviral therapy on biomarkers of B-lymphocyte activation and inflammation. AIDS. 2011;25:303–314. doi: 10.1097/QAD.0b013e32834273ad. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Vuga LJ, et al. C-X-C motif chemokine 13 (CXCL13) is a prognostic biomarker of idiopathic pulmonary fibrosis. Am J Respir Crit Care Med. 2014;189:966–974. doi: 10.1164/rccm.201309-1592OC. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Wu B, et al. CXCL13, CCL4, and sTNFR as circulating inflammatory cytokine markers in primary and SLE-related autoimmune hemolytic anemia. J Transl Med. 2015;13 doi: 10.1186/s12967-015-0474-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Li JQ, et al. MicroRNA-125-5p targeted CXCL13: a potential biomarker associated with immune thrombocytopenia. Am J Transl Res. 2015;7:772–780. [PMC free article] [PubMed] [Google Scholar]
  • 26.Greisen SR, et al. CXCL13 predicts disease activity in early rheumatoid arthritis and could be an indicator of the therapeutic ‘window of opportunity’. Arthritis Res Ther. 2014;16 doi: 10.1186/s13075-014-0434-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Zampino R, et al. Hepatitis B virus burden in developing countries. World J Gastroenterol. 2015;21:11941–11953. doi: 10.3748/wjg.v21.i42.11941. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Costumbrado J, et al. Implementation of a hepatitis A/B vaccination program using an accelerated schedule among high-risk inmates, Los Angeles County Jail, 2007–2010. Vaccine. 2012;30:6878–6882. doi: 10.1016/j.vaccine.2012.09.006. [DOI] [PubMed] [Google Scholar]
  • 29.Wilkinson SE, Morath M, Bennett DL, Burgess MA, Isaacs D. Accelerated schedule of hepatitis B vaccination in high-risk youth. J Paediatr Child Health. 1996;32:60–62. doi: 10.1111/j.1440-1754.1996.tb01544.x. [DOI] [PubMed] [Google Scholar]
  • 30.Jin H, et al. Comparison of Accelerated and Standard Hepatitis B Vaccination Schedules in High-Risk Healthy Adults: A Meta-Analysis of Randomized Controlled Trials. PLoS One. 2015;10 doi: 10.1371/journal.pone.0133464. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.de Vries-Sluijs TE, et al. A randomized controlled study of accelerated versus standard hepatitis B vaccination in HIV-positive patients. J Infect Dis. 2011;203:984–991. doi: 10.1093/infdis/jiq137. [DOI] [PubMed] [Google Scholar]
  • 32.Hwang LY, et al. Accelerated hepatitis B vaccination schedule among drug users: a randomized controlled trial. J Infect Dis. 2010;202:1500–1509. doi: 10.1086/656776. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Shah DP, Grimes CZ, Nguyen AT, Lai D, Hwang LY. Long-term effectiveness of accelerated hepatitis B vaccination schedule in drug users. Am J Public Health. 2015;105:e36–43. doi: 10.2105/AJPH.2014.302487. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Catherine, F. X. & Piroth, L. Hepatitis B virus vaccination in HIV-infected people: a review. Hum Vaccin Immunother, 1–10, doi:10.1080/21645515.2016.1277844 (2017). [DOI] [PMC free article] [PubMed]
  • 35.Whitaker JA, Rouphael NG, Edupuganti S, Lai L, Mulligan MJ. Strategies to increase responsiveness to hepatitis B vaccination in adults with HIV-1. Lancet Infect Dis. 2012;12:966–976. doi: 10.1016/S1473-3099(12)70243-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Santagostino E, et al. Accelerated schedule of hepatitis B vaccination in patients with hemophilia. J Med Virol. 1993;41:95–98. doi: 10.1002/jmv.1890410202. [DOI] [PubMed] [Google Scholar]
  • 37.Bekele Y, et al. Impaired Phenotype and Function of T Follicular Helper Cells in HIV-1-Infected Children Receiving ART. Medicine (Baltimore) 2015;94 doi: 10.1097/MD.0000000000001125. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.de Armas LR, et al. Induction of IL21 in Peripheral T Follicular Helper Cells Is an Indicator of Influenza Vaccine Response in a Previously Vaccinated HIV-Infected Pediatric Cohort. J Immunol. 2017;198:1995–2005. doi: 10.4049/jimmunol.1601425. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Litjens NH, Huisman M, Baan CC, van Druningen CJ, Betjes MG. Hepatitis B vaccine-specific CD4(+) T cells can be detected and characterised at the single cell level: limited usefulness of dendritic cells as signal enhancers. J Immunol Methods. 2008;330:1–11. doi: 10.1016/j.jim.2007.10.013. [DOI] [PubMed] [Google Scholar]
  • 40.Ettinger R, et al. IL-21 induces differentiation of human naive and memory B cells into antibody-secreting plasma cells. J Immunol. 2005;175:7867–7879. doi: 10.4049/jimmunol.175.12.7867. [DOI] [PubMed] [Google Scholar]
  • 41.Berglund LJ, et al. IL-21 signalling via STAT3 primes human naive B cells to respond to IL-2 to enhance their differentiation into plasmablasts. Blood. 2013;122:3940–3950. doi: 10.1182/blood-2013-06-506865. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Linterman MA, et al. IL-21 acts directly on B cells to regulate Bcl-6 expression and germinal center responses. J Exp Med. 2010;207:353–363. doi: 10.1084/jem.20091738. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Zotos D, et al. IL-21 regulates germinal center B cell differentiation and proliferation through a B cell-intrinsic mechanism. J Exp Med. 2010;207:365–378. doi: 10.1084/jem.20091777. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Fairfax KC, et al. IL-4-secreting secondary T follicular helper (Tfh) cells arise from memory T cells, not persisting Tfh cells, through a B cell-dependent mechanism. J Immunol. 2015;194:2999–3010. doi: 10.4049/jimmunol.1401225. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.McGuire HM, et al. IL-21 and IL-4 Collaborate To Shape T-Dependent Antibody Responses. J Immunol. 2015;195:5123–5135. doi: 10.4049/jimmunol.1501463. [DOI] [PubMed] [Google Scholar]
  • 46.Weinstein JS, et al. TFH cells progressively differentiate to regulate the germinal center response. Nat Immunol. 2016;17:1197–1205. doi: 10.1038/ni.3554. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Cohen KW, Dugast AS, Alter G, McElrath MJ, Stamatatos L. HIV-1 single-stranded RNA induces CXCL13 secretion in human monocytes via TLR7 activation and plasmacytoid dendritic cell-derived type I IFN. J Immunol. 2015;194:2769–2775. doi: 10.4049/jimmunol.1400952. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Data Availability Statement

We will make upon request materials, data and associated protocols promptly available to readers.


Articles from Scientific Reports are provided here courtesy of Nature Publishing Group

RESOURCES